The keys are the symbol of Saint Peter and represent the power given to him by Christ to "bind and loose" in the Kingdom of Heaven, symbolizing papal authority.