I recently emailed English Heritage as I had located a great spot close to home at a Scheduled Ancient Monument, that was crying out for a geocache. They soon emailed me back and confirmed that not only do English Heritage allow geocaching at these sites they actually welcome it.
So there you have it, from the horses mouth. Time to start planning a geocache!