Security Cryptography Whatever

Cryptanalyzing LLMs with Nicholas Carlini


Listen Later

'Let us model our large language model as a hash function—' 

Sold.

Our special guest Nicholas Carlini joins us to discuss differential cryptanalysis on LLMs and other attacks, just as the ones that made OpenAI turn off some features, hehehehe.

Watch episode on YouTube: https://youtu.be/vZ64xPI2Rc0

Transcript: https://securitycryptographywhatever.com/2025/01/28/cryptanalyzing-llms-with-nicholas-carlini/

Links:

- https://nicholas.carlini.com
- “Stealing Part of a Production Language Model”: https://arxiv.org/pdf/2403.06634
- ‘Why I attack"’: https://nicholas.carlini.com/writing/2024/why-i-attack.html
- “Cryptanalytic Extraction of Neural Network Models”, CRYPTO 2020: https://arxiv.org/abs/2003.04884
- “Stochastic Parrots”: https://dl.acm.org/doi/10.1145/3442188.3445922
- https://help.openai.com/en/articles/5247780-using-logit-bias-to-alter-token-probability-with-the-openai-api
- https://community.openai.com/t/temperature-top-p-and-top-k-for-chatbot-responses/295542
- https://opensource.org/license/mit
- https://github.com/madler/zlib
- https://ai.meta.com/blog/yann-lecun-ai-model-i-jepa/
- https://nicholas.carlini.com/writing/2024/how-i-use-ai.html


"Security Cryptography Whatever" is hosted by Deirdre Connolly (@durumcrustulum), Thomas Ptacek (@tqbf), and David Adrian (@davidcadrian)

...more
View all episodesView all episodes
Download on the App Store

Security Cryptography WhateverBy Deirdre Connolly, Thomas Ptacek, David Adrian

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

79 ratings


More shows like Security Cryptography Whatever

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,332 Listeners

Planet Money by NPR

Planet Money

30,839 Listeners

Hacked by Hacked

Hacked

189 Listeners

Security Now (Audio) by TWiT

Security Now (Audio)

2,004 Listeners

WSJ Tech News Briefing by The Wall Street Journal

WSJ Tech News Briefing

1,661 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,098 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

624 Listeners

Risky Business by Patrick Gray

Risky Business

373 Listeners

The Quanta Podcast by Quanta Magazine

The Quanta Podcast

541 Listeners

Darknet Diaries by Jack Rhysider

Darknet Diaries

8,117 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,277 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

526 Listeners

Search Engine by PJ Vogt

Search Engine

4,567 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

142 Listeners

The 404 Media Podcast by 404 Media

The 404 Media Podcast

394 Listeners