How do you handle this situation? You don't confront him, but you do have a conversation with him. There is a difference. You don't want to go in with this accusatory attitude...in case you're wrong. But if you don't say anything, the problem will fester, and you will end up blowing up at him. Remember, above all, listen to your gut feeling.