On the holiest day of the year, a goat was pushed off a mountain. On its head it carried the Sins of all the Jews. The Rambam teaches us that they were forgiven for the vast majority of their Sins, through this process, even without doing Teshuva.