Machine Learning Street Talk (MLST)

#040 - Adversarial Examples (Dr. Nicholas Carlini, Dr. Wieland Brendel, Florian Tramèr)


Listen Later

Adversarial examples have attracted significant attention in machine learning, but the reasons for their existence and pervasiveness remain unclear. there's good reason to believe neural networks look at very different features than we would have expected.  As articulated in the 2019 "features not bugs" paper Adversarial examples can be directly attributed to the presence of non-robust features: features derived from patterns in the data distribution that are highly predictive, yet brittle and incomprehensible to humans. 


Adversarial examples don't just affect deep learning models. A cottage industry has sprung up around Threat Modeling in AI and ML Systems and their dependencies. Joining us this evening are some of currently leading researchers in adversarial examples;


Florian Tramèr - A fifth year PhD student in Computer Science at Stanford University

https://floriantramer.com/​

https://twitter.com/florian_tramer​


Dr. Wieland Brendel - Machine Learning Researcher at the University of Tübingen & Co-Founder of layer7.ai

https://medium.com/@wielandbr​

https://twitter.com/wielandbr​



Dr. Nicholas Carlini - Research scientist at Google Brain working in that exciting space between machine learning and computer security. 

https://nicholas.carlini.com/​


We really hope you enjoy the conversation, remember to subscribe! 


Yannic Intro [00:00:00​]

Tim Intro [00:04:07​]

Threat Taxonomy [00:09:00​] 

Main show intro [00:11:30​]

Whats wrong with Neural Networks? [00:14:52​]

The role of memorization [00:19:51​]

Anthropomorphization of models [00:22:42​]

Whats the harm really though / focusing on actual ML security risks [00:27:03​]

Shortcut learning / OOD generalization [00:36:18​]

Human generalization [00:40:11​]

An existential problem in DL getting the models to learn what we want? [00:41:39​]

Defenses to adversarial examples [00:47:15​]

What if we had all the data and the labels? Still problems? [00:54:28​]

Defenses are easily broken [01:00:24​]

Self deception in academia [01:06:46​]

ML Security [01:28:15​]


https://www.youtube.com/watch?v=2PenK06tvE4

...more
View all episodesView all episodes
Download on the App Store

Machine Learning Street Talk (MLST)By Machine Learning Street Talk (MLST)

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

84 ratings


More shows like Machine Learning Street Talk (MLST)

View all
Data Skeptic by Kyle Polich

Data Skeptic

481 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

441 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

298 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

323 Listeners

Machine Learning Guide by OCDevel

Machine Learning Guide

764 Listeners

Practical AI by Practical AI LLC

Practical AI

190 Listeners

ManifoldOne by Steve Hsu

ManifoldOne

87 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

199 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

371 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

122 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

199 Listeners

Unsupervised Learning by by Redpoint Ventures

Unsupervised Learning

39 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

76 Listeners

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

441 Listeners

Training Data by Sequoia Capital

Training Data

36 Listeners