We invited Asli Celikyilmaz for this episode to talk about evaluation of text generation systems. We discussed the challenges in evaluating generated text, and covered human and automated metrics, with a discussion of recent developments in learning metrics. We also talked about some open research questions, including the difficulties in evaluating factual correctness of generated text.

Asli Celikyilmaz is a Principal Researcher at Microsoft Research.

Link to a survey co-authored by Asli on this topic: https://arxiv.org/abs/2006.14799