AWS Bites

108. How to Solve Lambda Python Cold Starts


Listen Later

In this episode, we discuss how you can use Python for data science workloads on AWS Lambda. We cover the pros and cons of using Lambda for these workloads compared to other AWS services. We benchmark cold start times and performance for different Lambda deployment options like zip packages, layers, and container images. The results show container images can provide faster cold starts than zip packages once the caches are warmed up. We summarize the optimizations AWS has made to enable performant container image deployments. Overall, Lambda can be a good fit for certain data science workloads, especially those that are bursty and need high concurrency.


💰 SPONSORS 💰

AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com !
In this episode, we mentioned the following resources.

  • Our blog post detailing our research on how to optimise Python Data Science in AWS Lambda: https://fourtheorem.com/optimise-python-data-science-aws-lambda/
  • The repository with our benchmarks and related visualizations: https://github.com/fourTheorem/lambda-datasci-perf
  • On-demand Container Loading on AWS Lambda (AWS Paper): https://arxiv.org/abs/2305.13162

  • Do you have any AWS questions you would like us to address?

    Leave a comment here or connect with us on X, formerly Twitter:
    - ⁠⁠https://twitter.com/eoins⁠⁠
    - ⁠⁠https://twitter.com/loige⁠⁠

    ...more
    View all episodesView all episodes
    Download on the App Store

    AWS BitesBy AWS Bites

    • 4.6
    • 4.6
    • 4.6
    • 4.6
    • 4.6

    4.6

    11 ratings


    More shows like AWS Bites

    View all
    Hanselminutes with Scott Hanselman by Scott Hanselman

    Hanselminutes with Scott Hanselman

    383 Listeners

    The a16z Show by Andreessen Horowitz

    The a16z Show

    1,084 Listeners

    Software Engineering Daily by Software Engineering Daily

    Software Engineering Daily

    626 Listeners

    Risky Business by Patrick Gray

    Risky Business

    374 Listeners

    The Cloudcast by Massive Studios

    The Cloudcast

    153 Listeners

    Python Bytes by Michael Kennedy and Brian Okken

    Python Bytes

    215 Listeners

    Y Combinator Startup Podcast by Y Combinator

    Y Combinator Startup Podcast

    226 Listeners

    Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

    Syntax - Tasty Web Development Treats

    987 Listeners

    Cybersecurity Today by Jim Love

    Cybersecurity Today

    181 Listeners

    Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

    Kubernetes Podcast from Google

    181 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    209 Listeners

    AWS Podcast by Amazon Web Services

    AWS Podcast

    203 Listeners

    AWS Morning Brief by Corey Quinn

    AWS Morning Brief

    79 Listeners

    The Real Python Podcast by Real Python

    The Real Python Podcast

    142 Listeners

    The AWS Developers Podcast by Amazon Web Services

    The AWS Developers Podcast

    25 Listeners