St Mary's Cemetery is located on the southwest side of the City of New Hampton, geographically in Dayton Township.

It is situated just to the south of the New Hampton Graceland Cemetery, separated by Garfield Street.

St Mary's was established in 1897 when a tract of land was purchased from the New Hampton Cemetery Association.