January 15, 2022

An Exploration Of Effective Pandas Practices With Matt Harrison

49 minutes

Summary

Pandas has grown to be a ubiquitous tool for working with data at every stage. It has become so well known that many people learn Python solely for the purpose of using Pandas. With all of this activity and the long history of the project it can be easy to find misleading or outdated information about how to use it. In this episode Matt Harrison shares his work on the book "Effective Pandas" and some of the best practices and potential pitfalls that you should know for applying Pandas in your own work.

Announcements

Hello and welcome to Podcast.__init__, the podcast about Python’s role in data and science.

When you’re ready to launch your next app or want to try a project you hear about on the show, you’ll need somewhere to deploy it, so take a look at our friends over at Linode. With the launch of their managed Kubernetes platform it’s easy to get started with the next generation of deployment and scaling, powered by the battle tested Linode platform, including simple pricing, node balancers, 40Gbit networking, dedicated CPU and GPU instances, and worldwide data centers. Go to pythonpodcast.com/linode and get a $100 credit to try out a Kubernetes cluster of your own. And don’t forget to thank them for their continued support of this show!

Your host as usual is Tobias Macey and today I’m interviewing Matt Harrison about best practices for using Pandas for data exploration, manipulation, and analysis

Interview

Introductions

How did you get introduced to Python?

What motivated you to write a book about Pandas?

There are a number of books available that cover some aspect of the Pandas framework or its application. What was missing from the available literature?

Who is your target audience for this book?

What are some of the most surprising things that you have learned about Pandas while working on this book?

What are the sharp edges that you see newcomers to pandas run into most frequently?

It is easy to use Pandas in a naive manner and get things done. What are some of the bad habits that you have seen people form in their work with Pandas?

How and when do those habits become harmful?

What are the most interesting, innovative, or unexpected ways that you have seen Pandas used?

What are the most interesting, unexpected, or challenging lessons that you have learned while working on this book?

What are some of the projects that you are planning to work on in the near/medium term?

Keep In Touch

Website

@__mharrison__ on Twitter

Blog

mattharrison on GitHub

Picks

Tobias

MSR Snowshoes

Matt

Telemark Skiing

22 Designs

Closing Announcements

Thank you for listening! Don’t forget to check out our other show, the Data Engineering Podcast for the latest on modern data management.

Visit the site to subscribe to the show, sign up for the mailing list, and read the show notes.

If you’ve learned something or tried out a project from the show then tell us about it! Email [email protected]) with your story.

To help other people find the show please leave a review on iTunes and tell your friends and co-workers

Links

Effective Pandas Book (affiliate link with 20% discount code applied)

Discount code INIT

TCL

Perl

Pandas

Podcast Episode

Pandas Extension Arrays

Podcast Episode

Koalas

Dask

Data Engineering Podcast Episode

Modin

Podcast Episode

The intro and outro music is from Requiem for a Fish The Freak Fandango Orchestra / CC BY-SA

...more

View all episodes

By Tobias Macey

4.4

100100 ratings

January 15, 2022

An Exploration Of Effective Pandas Practices With Matt Harrison

49 minutes

Summary

Announcements

Hello and welcome to Podcast.__init__, the podcast about Python’s role in data and science.

Your host as usual is Tobias Macey and today I’m interviewing Matt Harrison about best practices for using Pandas for data exploration, manipulation, and analysis

Interview

Introductions

How did you get introduced to Python?

What motivated you to write a book about Pandas?

There are a number of books available that cover some aspect of the Pandas framework or its application. What was missing from the available literature?

Who is your target audience for this book?

What are some of the most surprising things that you have learned about Pandas while working on this book?

What are the sharp edges that you see newcomers to pandas run into most frequently?

It is easy to use Pandas in a naive manner and get things done. What are some of the bad habits that you have seen people form in their work with Pandas?

How and when do those habits become harmful?

What are the most interesting, innovative, or unexpected ways that you have seen Pandas used?

What are the most interesting, unexpected, or challenging lessons that you have learned while working on this book?

What are some of the projects that you are planning to work on in the near/medium term?

Keep In Touch

Website

@__mharrison__ on Twitter

Blog

mattharrison on GitHub

Picks

Tobias

MSR Snowshoes