Everyday AI Podcast – An AI and ChatGPT Podcast

EP 336: A Complete Guide to Tokens Inside of ChatGPT


Listen Later

Win a free year of ChatGPT or other prizes! Find out how.

Wait.... tokens? When using a large language model like ChatGPT, tokens really matter. But hardly no one understands them. And NOT knowing how tokens work is causing your ChatGPT output to stink. We'll help you fix it. 

Newsletter: Sign up for our free daily newsletter
More on this Episode: Episode Page
Join the discussion: Ask Jordan questions on ChatGPT

Related Episodes: Ep 253: Custom GPTs in ChatGPT – A Beginner’s Guide
Ep 318: GPT-4o Mini: What you need to know and what no one’s talking about

Upcoming Episodes: Check out the upcoming Everyday AI Livestream lineup
Website: YourEverydayAI.com
Email The Show: [email protected]
Connect with Jordan on LinkedIn

Topics Covered in This Episode:
1. Tokenization in ChatGPT
2. Comparison of Different AI Models
3. Importance of Tokenization and Memory in AI Models
4. Limitations of ChatGPT
5. Explanation of Tokenization Process

Timestamps:
02:10 Daily AI news
07:00 Introduction to tokens
10:08 Large language models understand words through tokens.
12:05 Understanding tokenization in generative AI language models.
16:35 Contextual analysis of words for language understanding.
19:15 Different models have varying context window sizes.
23:57 Misconception about GPT-4. Detailed explanation follows.
26:38 Promotion of PPP course, common language mistakes.
28:57 Excess text to exceed word limit intentionally.
33:19 Keeping up with ever-changing AI rules.
36:50 Recall important information by prompting chat GPT.
40:37 Highlight information, use quotation button, request summary.
43:41 Clear communication is crucial for ChatGPT.

Keywords:
Jordan Wilson, Bears football team, personal information, Carolina blue, deep dish pizza, token counts, memory limitations, ChatGPT, tokenization, language models, generative AI, controlling response, token range, memory recall, AI models, GPT, anthropic Claude, Google Gemini, context window, book interaction, large language models, OpenAI's GPT 4.0, transcript summary, Everyday AI, Google's Gemini Live AI assistant, new Pixel 9 series, XAI's Grok 2, OpenAI's GPT 4 update, importance of tokens in chatbots, podcast promotion.

Send Everyday AI and Jordan a text message. (We can't reply back unless you leave contact info)

Ready for ROI on GenAI? Go to youreverydayai.com/partner 

...more
View all episodesView all episodes
Download on the App Store

Everyday AI Podcast – An AI and ChatGPT PodcastBy Everyday AI

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

95 ratings


More shows like Everyday AI Podcast – An AI and ChatGPT Podcast

View all
NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

333 Listeners

AI Today Podcast by AI & Data Today

AI Today Podcast

152 Listeners

Practical AI by Practical AI LLC

Practical AI

210 Listeners

The Artificial Intelligence Show by Paul Roetzer and Mike Kaput

The Artificial Intelligence Show

197 Listeners

AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning

153 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

225 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

607 Listeners

AI For Humans: Making Artificial Intelligence Fun & Practical by Kevin Pereira & Gavin Purcell

AI For Humans: Making Artificial Intelligence Fun & Practical

273 Listeners

A Beginner's Guide to AI by Dietmar Fischer

A Beginner's Guide to AI

54 Listeners

AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI by Jaeden Schafer and Jamie McCauley

AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI

172 Listeners

The TED AI Show by TED

The TED AI Show

48 Listeners

AI Applied: Covering AI News, Interviews and Tools - ChatGPT, Midjourney, Gemini, OpenAI, Anthropic by Jaeden Schafer and Conor Grennan

AI Applied: Covering AI News, Interviews and Tools - ChatGPT, Midjourney, Gemini, OpenAI, Anthropic

146 Listeners

Leveraging AI by Isar Meitis

Leveraging AI

62 Listeners

Beyond The Prompt - How to use AI in your company by Jeremy Utley & Henrik Werdelin

Beyond The Prompt - How to use AI in your company

62 Listeners

Using AI at Work: AI in the Workplace & Generative AI for Business Leaders by Chris Daigle

Using AI at Work: AI in the Workplace & Generative AI for Business Leaders

24 Listeners