Peric goes in on a touchy topic and sheds some light on why he is longer close with his ex-employees and ex-bestfriends