Leaven is a picture of adding something small that corrupts the whole thing. Jesus warned against adding small old beliefs and ways of living to his way, instead inviting us to leave our old ways behind and trust him to satisfy our souls.