High Output AI

Bad AI metrics and How to understand things | EP006


Listen Later

Tom and Elliot discuss how AI metrics get used and abused and a paper looking at how to understand things.  

Part 1

-   How to Understand Things by Nabeel - https://nabeelqu.co/understanding
-   Not Overthinking podcast episode that discusses Nabeel's article - https://notoverthinking.com/how-to-understand-things-2/
-   Visual image of "Bag of words" and Natural Language Processing -https://twitter.com/nwilliams030/status/1278008507044937728/photo/1
-   Decision tree analysis for house prices - I could not find this one, sorry folks
-   The Sequences from Less Wrong -https://www.readthesequences.com/Book-I-Map-And-Territory
- Modernist bread - https://modernistcuisineshop.com/products/modernist-bread 

Part 2

-   Concepts we covered; accuracy, sensitivity, specificity, AUC, prevalence, prior probability, positive predictive value, the negative predictive value
-   The Metric Matrix - https://medium.com/swlh/how-to-remember-all-these-classification-concepts-forever-761c065be33
-   Ibis -https://en.wikipedia.org/wiki/Ibis
-   Bin Chicken - https://www.youtube.com/watch?v=w4dYWhkSbTU  Ibis Photo: By JJ Harrison (https://www.jjharrison.com.au/)
- Own work, CC BY-SA 3.0, https://commons.wikimedia.org/w/index.php?curid=18800827 ROC Image: By cmglee, MartinThoma - Roc-draft-xkcd-style.svg, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=109730045 

00:00 Intro  

01:04 What are we drinking  
04:47 How to Understand Things  
06:44 The smartest people aren't the quickest to answer  
09:23 Part 1 - Not Giving Up  
13:22 When to go deep on a topic  
22:08 Asking Dumb Questions  
29:52 Life update post paper  
32:31 AI metrics and which ones to use  
46:21 Sensitivity and Specificity Mistakes

...more
View all episodesView all episodes
Download on the App Store

High Output AIBy High Output AI