Why not use PVC pipe or another plastic container?
Unless you are stashing items to be retrieved within a relatively short period like a year or two, stainless steel remains the best security option for you. PVC pipe emits harmful chemicals over time that break down organic materials inside the container. Any above ground placement, even shielded by a hollow rock, would also leave the plastic exposed to freezing and cracking.