Data Skeptic

StrategyQA and Big Bench

11.18.2022 - By Kyle PolichPlay

Download our free app to listen on your phone

Download on the App StoreGet it on Google Play

Did Aristotle Use a Laptop?  That's a question from the StrategyQA benchmark which highlights the stretch goals for current artificial intelligence systems.  Answering a question like that requires several cognitive steps and reasoning.  Constructing a dataset of similarly challenging questions is a major undertaking.  On today's episode, Mor Geva returns to share details about the creation of StrategyQA and the larger Big Bench dataset it has been included in.

More episodes from Data Skeptic