The people expected judgment to take place on Earth and were disappointed in the location of the judgment but not in the event. The judgement is taking place in heaven as Jesus describes in the wedding parable.