The day following Rosh Hashana was established as a public fast day, for it was on that day that all the Jewish where complete removed from Jerusalem specifically and from judea in general. The glory was only restored when the Ramban made pilgrimage up to yerushalayim (not in the podcast but important to note)