Pitstone Quarry is located about 3 miles north-east of Tring.
The northern part of the quarry is in Buckinghamshire and the southern section is in Hertfordshire (Dacorum Borough). The whole quarry is in the Chilterns Area of Outstanding Natural Beauty/ National Landscape.
The eastern boundary of the site is next to Pitstone Hill which is a Site of Special Scientific Interest (SSSI). The National Trust’s Ashridge Estate also borders the quarry, to the east. There is a public footpath along the side of Pitstone Hill and The Ridgeway National Trail leads across the top of the hill.
Along the south-western edge of the site is a public footpath and Northfield Road. This public footpath runs along the north-western boundary of the site next to the B488, Upper Icknield Way. The current access road into the quarry is off this road, just south of Vicarage Road. Land to the north-east and the south-east of the quarry is privately owned.