Engineering Enablement by Abi Noda

Measuring and rolling out AI coding assistants | Eirini Kalliamvakou (GitHub)


Listen Later

This week's guest is Eirini Kalliamvakou, a staff researcher at GitHub focused on AI and developer experience. Eirini sits at the forefront of research into GitHub Copilot. Abi and Eirini discuss recent research on how AI coding assistance impacts developer productivity. They talk about how leaders should build business cases for AI tools. They also preview what's to come with AI tools and implications for how developer productivity is measured.


Discussion points:

  • (1:49) Overview of GitHub’s research on AI
  • (2:59) The research study on Copilot
  • (4:48) Defining and measuring productivity for this study
  • (7:44) Exact measures and factors studied
  • (8:16) Key findings from the study
  • (9:45) How the study was conducted 
  • (11:17) Most surprising findings for the researchers
  • (14:01) The motivation for conducting a follow-up study
  • (15:34) How the follow-up study was conducted
  • (18:42) Findings from the follow-up study
  • (21:13) Is AI just hype? 
  • (26:34) How to begin advocating for AI tools
  • (34:44) How to translate data into dollars
  • (37:06) How to roll out AI tools to an organization
  • (38:47) The impact of AI on developer experience
  • (43:24) Implications of AI on how we measure productivity


Mentions and links:

  • Eirini Kalliamvakou on LinkedIn
  • Research on the impact of Copilot 
  • Crossing the Chasm by Geoffrey Moore
...more
View all episodesView all episodes
Download on the App Store

Engineering Enablement by Abi NodaBy DX

  • 5
  • 5
  • 5
  • 5
  • 5

5

37 ratings


More shows like Engineering Enablement by Abi Noda

View all
Hanselminutes with Scott Hanselman by Scott Hanselman

Hanselminutes with Scott Hanselman

377 Listeners

Software Engineering Radio - the podcast for professional software developers by se-radio@computer.org

Software Engineering Radio - the podcast for professional software developers

272 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

284 Listeners

The Cloudcast by Massive Studios

The Cloudcast

152 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,033 Listeners

Thoughtworks Technology Podcast by Thoughtworks

Thoughtworks Technology Podcast

40 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

621 Listeners

Masters of Scale by WaitWhat

Masters of Scale

3,995 Listeners

Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

Kubernetes Podcast from Google

181 Listeners

Practical AI by Practical AI LLC

Practical AI

192 Listeners

The Stack Overflow Podcast by The Stack Overflow Podcast

The Stack Overflow Podcast

62 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

408 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

75 Listeners

Lightcone Podcast by Y Combinator

Lightcone Podcast

22 Listeners

The Pragmatic Engineer by Gergely Orosz

The Pragmatic Engineer

63 Listeners