AWS Bites

108. How to Solve Lambda Python Cold Starts


Listen Later

In this episode, we discuss how you can use Python for data science workloads on AWS Lambda. We cover the pros and cons of using Lambda for these workloads compared to other AWS services. We benchmark cold start times and performance for different Lambda deployment options like zip packages, layers, and container images. The results show container images can provide faster cold starts than zip packages once the caches are warmed up. We summarize the optimizations AWS has made to enable performant container image deployments. Overall, Lambda can be a good fit for certain data science workloads, especially those that are bursty and need high concurrency.


💰 SPONSORS 💰

AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com !
In this episode, we mentioned the following resources.

  • Our blog post detailing our research on how to optimise Python Data Science in AWS Lambda: https://fourtheorem.com/optimise-python-data-science-aws-lambda/
  • The repository with our benchmarks and related visualizations: https://github.com/fourTheorem/lambda-datasci-perf
  • On-demand Container Loading on AWS Lambda (AWS Paper): https://arxiv.org/abs/2305.13162

  • Do you have any AWS questions you would like us to address?

    Leave a comment here or connect with us on X, formerly Twitter:
    - ⁠⁠https://twitter.com/eoins⁠⁠
    - ⁠⁠https://twitter.com/loige⁠⁠

    ...more
    View all episodesView all episodes
    Download on the App Store

    AWS BitesBy AWS Bites

    • 4.6
    • 4.6
    • 4.6
    • 4.6
    • 4.6

    4.6

    11 ratings


    More shows like AWS Bites

    View all
    Software Engineering Radio - the podcast for professional software developers by se-radio@computer.org

    Software Engineering Radio - the podcast for professional software developers

    272 Listeners

    The Changelog: Software Development, Open Source by Changelog Media

    The Changelog: Software Development, Open Source

    283 Listeners

    The Cloudcast by Massive Studios

    The Cloudcast

    152 Listeners

    a16z Podcast by Andreessen Horowitz

    a16z Podcast

    1,027 Listeners

    Talk Python To Me by Michael Kennedy

    Talk Python To Me

    592 Listeners

    Software Engineering Daily by Software Engineering Daily

    Software Engineering Daily

    624 Listeners

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

    443 Listeners

    AWS Podcast by Amazon Web Services

    AWS Podcast

    202 Listeners

    Data Engineering Podcast by Tobias Macey

    Data Engineering Podcast

    142 Listeners

    Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

    Syntax - Tasty Web Development Treats

    982 Listeners

    Darknet Diaries by Jack Rhysider

    Darknet Diaries

    7,865 Listeners

    Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

    Kubernetes Podcast from Google

    181 Listeners

    The AWS Developers Podcast by Amazon Web Services

    The AWS Developers Podcast

    23 Listeners

    AI + a16z by a16z

    AI + a16z

    30 Listeners

    The Pragmatic Engineer by Gergely Orosz

    The Pragmatic Engineer

    52 Listeners