Summary

In this episode of the Quality Talks podcast, host Stu Day and guest Ash Gawthorp discuss the rapid changes in the tech industry driven by AI advancements.

They explore the implications of Andrej Karpathy's tweet expressing feelings of inadequacy among programmers, the evolving nature of software development, and the critical role of testing in ensuring quality in AI-driven systems.

The conversation emphasises the importance of human oversight, the need for explicit verification, and the evolving dynamics between developers and testers in a landscape where AI is increasingly taking on coding tasks.

Key insights highlight the value of existing software testing skills in navigating this new environment and the necessity of adapting to maintain confidence in software outputs.

Useful Links:

Ten10 Website:

https://ten10.com/

Ash Gawthorp's Article:

https://ten10.com/blog/why-software-testing-just-became-the-most-important-skill-in-technology/

Andrej Kaparthy's Tweet: https://x.com/karpathy/status/2004607146781278521

Boris Cherny Tweet:

https://x.com/bcherny/status/2004887829252317325

Takeaways

1. Many in tech feel overwhelmed by rapid AI advancements.
2. Andrej Karpathy's tweet resonated with many programmers.
3. The pace of change in software development is unprecedented.
4. Testing is crucial in AI-driven development environments.
5. Human oversight is essential in AI applications.
6. Testers have a unique skill set that is increasingly valuable.
7. Observability and testability are paramount in AI systems.
8. The role of the verifier is becoming more important than the builder.
9. Imposter syndrome is common among experienced professionals.
10. Continuous quality is vital in software development. 

Chapters

00:00 Introduction to the Tech Landscape in 2026

02:50 The Impact of AI on Software Development

06:14 The Shift in Software Development Workflows

10:22 The Non-Deterministic Nature of AI

11:33 Building Confidence in AI Outputs

15:34 The Role of Testing in AI Development

17:27 The Importance of Skepticism in Testing

21:25 Prompt Engineering and Its Challenges

22:52 Verification and Observability in AI Systems

28:05 Human Oversight in AI Development

31:45 The Evolving Role of Testers

37:06 The Future of Software Development and Testing

43:59 Key Takeaways and Closing Thoughts

49:52 Close