AWS Bites

In this episode of the AWS Bites Podcast, we dive into the serverless pattern of using AWS Lambda together with SQS. We explain the basics of both Lambda and SQS for those who may not be familiar with them. We talk about how we use Lambda, a Function as a Service offering in AWS, to write our own functions and have AWS run them in response to certain events. And we also discuss SQS, a scalable and managed queuing system available on AWS, which we use to offload work to background workers.

We delve into how the two services work together through the use of "Event Source Mapping" in Lambda, which polls our SQS queue and makes synchronous Lambda invocation requests when messages are available. We also mention how this feature provides us with the ability to control batch size and window, as well as specify filters to save execution time and cost. But we also share one of the limitations we faced when using SQS and Lambda together which was the lack of control over concurrency and the potential for excessive throttling.

But recently, AWS has released a new feature called "SQS maximum concurrency support" which allows us to specify a maximum number of invocations for an Event Source Mapping. This solves the problem of excessive throttling and eliminates the need to use reserved concurrency. It also allows for more control over concurrency when using multiple Event Source Mappings with the same function. We explain how this new feature has improved our workflow and made it much more efficient.

💰 SPONSORS 💰

AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture.

In this episode, we mentioned the following resources:

You can listen to AWS Bites wherever you get your podcasts:

Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter:

#AWS #rust #lambda

Are you curious about using Rust to write AWS Lambda functions?

In this episode of AWS BItes, we will be discussing the pros and cons of using Rust for serverless applications. With Rust, you'll be able to take advantage of its fast performance and memory efficiency. Plus, its programming model makes it easy to write safe and correct code. However, Rust is not a native runtime for Lambda, but rather a library that implements a custom runtime built and maintained by AWS. This custom runtime is built on top of the Tokio async runtime and even has a built-in middleware engine, which allows for easy hook-in of reusable logic and building your own middleware.

But what if you're new to Rust? Don't worry, we'll also be walking you through the steps on how to write your first Lambda in Rust. From cargo-lambda to the serverless framework plugin for Rust, we'll be sharing different alternatives for building and deploying your Rust-based Lambda functions.

So join us on this journey as we explore the exciting world of Rust and Lambda.

💰 SPONSORS 💰

AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture.

In this episode, we mentioned the following resources:

You can listen to AWS Bites wherever you get your podcasts:

Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter:

#AWS #rust #lambda

We built a Step Function that allows us to generate high-quality transcripts for AWS Bites podcast!

After evaluating different approaches and technologies we ended up using Amazon transcribe and OpenAI whisper. They both have their pros and cons but combined together they gave us everything we were looking for with quite a good degree of accuracy!

In this episode, we describe our use case, our research, and how eventually we did go about productionizing our final solution.

If you run a podcast and you would like to do something similar, we have open source our solution. It's called PodWhisperer and you can find it on GitHub: https://github.com/fourTheorem/podwhisperer .

💰 SPONSORS 💰

AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture.

In this episode, we mentioned the following resources:

You can listen to AWS Bites wherever you get your podcasts:

Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter:

#AWS #speechtotext #openai

re:Invent 2022, the biggest AWS conference of the year is just over and there were tons of interesting announcements: many new features and some interesting new AWS products!

But we are not going to bother you with yet another walkthrough of all of them.

In this episode of AWS Bites podcast we just discuss our top 3 announcements and explained what we liked and what could have made them even better!  We will talk about EventBridge Pipes, Step Functions Distributed Map, and Application Composer.

What are your favorite announcements? Let us know on Twitter or in the comments!

💰 SPONSORS 💰

AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture.

In this episode, we mentioned the following resources:

You can listen to AWS Bites wherever you get your podcasts:

Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter:

#AWS #reinvent #announcements

Let's face it: when it comes to AWS, cost is one of the scariest topics! 

Why? Mostly because the underlying model can get very complex. 

There are too many variables and ultimately it's just hard to predict how much is a given workload going to cost you on AWS. Are going to be bankrupted by this unpredictable cost? Probably not!

In this episode, we share some suggestions and tools on how to approach cost when going to AWS. It's not a simple topic, but it's something you need to embrace, learn and get confident with. With a bit of effort, cost will not be so scary anymore and you'll be able to take advantage of all the awesome services and features of AWS without being so worried about cost!

💰 SPONSORS 💰

AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture.

In this episode, we mentioned the following resources:

You can listen to AWS Bites wherever you get your podcasts:

Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige

#AWS #cost #expense

AWS Lambda is one of the most famous AWS services these days. If you are just starting with your cloud journey you might be confused about what Lambda actually is, what are the limitations, and when you should be using it or not.

In this episode, we provide a beginner-friendly introduction to Lambda and summarise everything there’s to know about it: when to use it and when not, differences with containers, the pricing model, limitations, and integrations.

By the end of this episode, we will also chime in with some of our opinions and share whether we believe that Lambda is the future of cloud computing or not! 

💰 SPONSORS 💰

AWS Bites is sponsored by fourTheorem (https://fourtheorem.com/). fourTheorem is an AWS Consulting Partner offering training, cloud migration, and modern application architecture.

In this episode, we mentioned the following resources:

You can listen to AWS Bites wherever you get your podcasts:

Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige

#AWS #serverless #lambda

The definition of serverless has already changed in the few years since it first emerged. There have been many success stories using serverless - in startups and the enterprise. But what comes next?

In this episode, we will clarify our definition of Serverless, what are the main challenges with it today, and speculate on what we believe will come next! By the end of this episode, you’ll have heard our thoughts and predictions on what Serverless 2.0 will look like. We will also reveal who we think will be the main challenger to AWS for domination of serverless as it goes mainstream! 

AWS Bites is sponsored by fourTheorem. fourTheorem is an AWS Consulting Partner offering training, cloud migration, and modern application architecture.

In this episode, we mentioned the following resources:

You can listen to AWS Bites wherever you get your podcasts:

Do you have any AWS questions you would like us to address?

#AWS #serverless #future

Building actual projects is a great way to consolidate our understanding of AWS. In this episode, we present 4 different project ideas to explore services and concepts in the space of web application development, machine learning, and data science.

Ok, you are probably wondering where kitties come into the equation here. Every one of these 4 project ideas involves kitties! 🐱

We can learn stuff and have some fun too!

In this episode, we mentioned the following resources:

- Our sponsor, fourTheorem: https://fourtheorem.com/

- The Cat Detector workshop  https://github.com/fourTheorem/workshops/tree/master/cat-detector

- AI as a Service (book): https://www.manning.com/books/ai-as-a-service

- Kaggle dataset cat vs dog: https://www.kaggle.com/datasets/shaunthesheep/microsoft-catsvsdogs-dataset

- The best website in the world: https://http.cat

- The true meaning of the 418 HTTP status code: https://http.cat/418

- The cat breeds dataset on Kaggle: https://www.kaggle.com/datasets/ma7555/cat-breeds-dataset

- Our series of live coding streams where we build a serverless WeTransfer clone on AWS from scratch: https://www.youtube.com/playlist?list=PLAWXFhe0N1vI1_z-06EzJ22pz95_gBrId

You can listen to AWS Bites wherever you get your podcasts:

- Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017

- Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q

- Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==

- Breaker: https://www.breaker.audio/aws-bites

- RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss

Do you have any AWS questions you would like us to address?

#AWS #projects #learn

If you looked into Amazon Cognito, chances are that you have been confused by User Pools and Identity Pools (now renamed to Federated Identities). Well, Cognito is not one of the simplest AWS services to get started with but it is indeed very powerful and it can be very convenient to use when you are dealing with authentication and authorization.

In this Episode of the AWS Bites Podcast, we try to clarify what is the difference between User Pools and Identity Pools. When to use one or the other and even when to use them together. Throughout the episode, we will cover several practical examples and use cases.

In this episode, we didn’t really mention any resources, but if you want to deep dive into this topic here are some useful links:

You can listen to AWS Bites wherever you get your podcasts:

- Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017

- Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q

- Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==

- Breaker: https://www.breaker.audio/aws-bites

- RSS:  https://anchor.fm/s/6a3312a0/podcast/rss

Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige

Uploading and downloading files are some of the most common operations for web applications. But let’s face it, as common as they are, they are still challenging features to implement in a reliable and scalable way!  This is especially true for serverless environments where you have strict limits in payload size and you cannot have long-running connections.  So what’s the solution? If you are using S3, pre-signed URLs can help quite a bit!   In this episode of AWS Bites podcast, we are going to learn more about them, and… if you stick until the very end of this episode, we are going to disclose an interesting and quite unknown tip about pre-signed URLs!

In this episode, we mentioned the following resources:

- Documentation for the pre-signed POST: https://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectPOST.html

You can listen to AWS Bites wherever you get your podcasts:

- Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017

- Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q

- Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==

- Breaker: https://www.breaker.audio/aws-bites

- RSS:  https://anchor.fm/s/6a3312a0/podcast/rss

Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige