Yes, the Vatican Grottoes are open to the public and house the tombs of many Popes, including that of Saint Peter. The visit is free.