Sign up to save your podcasts
Or
Share 20260113 - If AI coding is so good, where are the performance numbers?
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
20260113 - If AI coding is so good, where are the performance numbers?
Claude bros know how to measure performance. They just don't.
https://pivot-to-ai.com/2026/01/13/if-ai-coding-is-so-good-where-are-the-performance-numbers/ - blog post
- Patreon: https://www.patreon.com/davidgerard
- Ko-Fi: https://ko-fi.com/A1529D5
- Buy me nice things: https://www.amazon.co.uk/hz/wishlist/ls/3Q8VZW46J6DM6
- Get an extremely cool Pivot to AI shirt or mug: https://pivot-to-ai.redbubble.com
Send in your story tips: [email protected]
Sources:
- Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity https://arxiv.org/abs/2507.09089
- DORA: State of AI-assisted Software Development (PDF) https://services.google.com/fh/files/misc/2025_state_of_ai_assisted_software_development.pdf
- AI Coding Assistants Are Getting Worse: Newer models are more prone to silent but deadly failure modes https://spectrum.ieee.org/ai-coding-degrades
Previously on Pivot to AI:
- AI coding tools 'fix' bugs by adding bugs https://pivot-to-ai.com/2025/03/19/ai-coding-tools-fix-bugs-by-adding-bugs/
- video: https://www.youtube.com/watch?v=xnzkgDt-d3o&list=UU9rJrMVgcXTfa8xuMnbhAEA
- Generative AI runs on gambling addiction — just one more prompt, bro! https://pivot-to-ai.com/2025/06/05/generative-ai-runs-on-gambling-addiction-just-one-more-prompt-bro/
- video: https://www.youtube.com/watch?v=QWngvJnoPJA&list=UU9rJrMVgcXTfa8xuMnbhAEA
- AI coders think they're 20% faster — but they're actually 19% slower https://pivot-to-ai.com/2025/07/11/ai-coders-think-theyre-20-faster-but-theyre-actually-19-slower/
- video: https://www.youtube.com/watch?v=96j1cIMYV1U&list=UU9rJrMVgcXTfa8xuMnbhAEA
- AI doomsday and AI heaven: live forever in AI God https://pivot-to-ai.com/2025/08/17/ai-doomsday-and-ai-heaven-live-forever-in-ai-god/
- video: https://www.youtube.com/watch?v=tAJIew3FAJ8&list=UU9rJrMVgcXTfa8xuMnbhAEA
- If AI coding is so good … where are the little apps? https://pivot-to-ai.com/2025/09/09/if-ai-coding-is-so-good-where-are-the-little-apps/
- video: https://www.youtube.com/watch?v=mz_lG6SmgK0&list=UU9rJrMVgcXTfa8xuMnbhAEA
Full Pivot to AI playlist: https://www.youtube.com/playlist?list=UU9rJrMVgcXTfa8xuMnbhAEA
View all episodes
By David GerardClaude bros know how to measure performance. They just don't.
https://pivot-to-ai.com/2026/01/13/if-ai-coding-is-so-good-where-are-the-performance-numbers/ - blog post
- Patreon: https://www.patreon.com/davidgerard
- Ko-Fi: https://ko-fi.com/A1529D5
- Buy me nice things: https://www.amazon.co.uk/hz/wishlist/ls/3Q8VZW46J6DM6
- Get an extremely cool Pivot to AI shirt or mug: https://pivot-to-ai.redbubble.com
Send in your story tips: [email protected]
Sources:
- Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity https://arxiv.org/abs/2507.09089
- DORA: State of AI-assisted Software Development (PDF) https://services.google.com/fh/files/misc/2025_state_of_ai_assisted_software_development.pdf
- AI Coding Assistants Are Getting Worse: Newer models are more prone to silent but deadly failure modes https://spectrum.ieee.org/ai-coding-degrades
Previously on Pivot to AI:
- AI coding tools 'fix' bugs by adding bugs https://pivot-to-ai.com/2025/03/19/ai-coding-tools-fix-bugs-by-adding-bugs/
- video: https://www.youtube.com/watch?v=xnzkgDt-d3o&list=UU9rJrMVgcXTfa8xuMnbhAEA
- Generative AI runs on gambling addiction — just one more prompt, bro! https://pivot-to-ai.com/2025/06/05/generative-ai-runs-on-gambling-addiction-just-one-more-prompt-bro/
- video: https://www.youtube.com/watch?v=QWngvJnoPJA&list=UU9rJrMVgcXTfa8xuMnbhAEA
- AI coders think they're 20% faster — but they're actually 19% slower https://pivot-to-ai.com/2025/07/11/ai-coders-think-theyre-20-faster-but-theyre-actually-19-slower/
- video: https://www.youtube.com/watch?v=96j1cIMYV1U&list=UU9rJrMVgcXTfa8xuMnbhAEA
- AI doomsday and AI heaven: live forever in AI God https://pivot-to-ai.com/2025/08/17/ai-doomsday-and-ai-heaven-live-forever-in-ai-god/
- video: https://www.youtube.com/watch?v=tAJIew3FAJ8&list=UU9rJrMVgcXTfa8xuMnbhAEA
- If AI coding is so good … where are the little apps? https://pivot-to-ai.com/2025/09/09/if-ai-coding-is-so-good-where-are-the-little-apps/
- video: https://www.youtube.com/watch?v=mz_lG6SmgK0&list=UU9rJrMVgcXTfa8xuMnbhAEA
Full Pivot to AI playlist: https://www.youtube.com/playlist?list=UU9rJrMVgcXTfa8xuMnbhAEA