Not recognising Joseph, the brothers immediately think that his accusing them of being spies it is punishment for their past sins. It seems the brothers regret what they did to their brother and feel guilty about it. The weight of guilt and shame can be a heavy burden to carry.