When you do different exercises every week, you feel like you're getting a "good workout" in.
Because it's hard, your muscles are working, it's novel, new, exciting, and different to last time.
But you lose all that progress the minute you swap those old exercises out for new ones. That's why it's so dangerous, and why I caution against it.