[DISCLAIMER] - For the full visual experience, we recommend you tune in through our YouTube channel to see the presented slides.

If you enjoyed this talk, consider joining the Molecular Modeling and Drug Discovery (M2D2) talks live.

Also, consider joining the M2D2 Slack.

Abstract: In this work we propose a principled evaluation framework for model-based optimisation to measure how well a generative model can extrapolate. We achieve this by interpreting the training and validation splits as draws from their respective ‘truncated’ ground truth distributions, where examples in the validation set contain scores much larger than those in the training set. Model selection is performed on the validation set for some prescribed validation metric. A major research question however is in determining what validation metric correlates best with the expected value of generated candidates with respect to the ground truth oracle; work towards answering this question can translate to large economic gains since it is expensive to evaluate the ground truth oracle in the real world. We compare various validation metrics for generative adversarial networks using our framework. We also discuss limitations with our framework with respect to existing datasets and how progress can be made to mitigate them

Full Paper

Speakers: Christopher Beckham

Twitter Prudencio

Twitter Therence

Twitter Jonny

Twitter Valence Discovery