The brothers talk about the Lizzo allegations, valuing mother over wife and more