Hanging out with your ex is no easy task