The boys have a nice coffee date until Sam reveals a hidden secret about his past