Sometimes we desire inappropriate things. In a marriage, if someone is desiring someone else outside the relationship, demonstrates a deep weakness in the bond. The same is true with our connection to G-d.