It was here in the bailey that the people would take refuge when the castle was under siege.