While the deep questions concerning the ethics of AI necessarily address the processes that generate our data and the impacts that automated decisions will have, neither ML tools nor proposed ML-based mitigation strategies tackle these problems head on. This talk explores the consequences and limitations of employing ML-based technology in the real world, the limitations of recent solutions for mitigating societal harms, and contemplates the meta-question: when should (today’s) ML systems be off the table altogether?