The fellas talk about receiving backhanded compliments and recount a voicemail fiasco