
Sign up to save your podcasts
Or
Amazon announced that they will be using Nvidia's NVSwitch to create new rackscale AI platforms. This allows customers to use Nvidia technology like Grace Hopper or build something using AWS Nitro DPUs and Elastic Fabric Adapaters. That last combination doesn't use InfiniBand and moves to Ethernet. Two new chips are coming out from the Amazon labs. The first is Graviton4, the latest generation of Arm processor. Graviton4 has 50% more cores and 75% more memory bandwidth. This version of Graviton is based on the Demeter Neoverse V2 core. On the AI front Amazon also announced the next revision of their AI acceleration chip, Trainium2. This update has a 4x performance increase from the first generation and allows for liquid cooling. Trainium2 is designed to be deployed in clusters of 16 chips. In the data space, AWS made news with the GA of Bedrock, which enables customers to run foundational ML models from companies like Anthropic, Meta, and of course AWS itself. But many companies are worried about hallucination and want to include their own data in these models. That's what AWS is delivering with Guardrails, and what AWS partners are leaning into as well. This and more on this week's Gestalt IT Rundown.
0:00 - Welcome to the Rundown
1:18 - DAOS Foundation Launched for Object Storage
4:57 - Autonomous Purple Team annouced by Skyhawk at AWS re:Invent
8:26 - Couchbase's Capella Columnar Service Revealed
10:59 - Hackers Were Inside NXP For Two Years Before Detection
14:47 - AWS re:Invent Announcements
15:26 - NVSwitch For AI Nodes
20:46 - ARM V2 for Graviton4 and Trainium2
25:22 - AWS Guardrails for Bedrock
30:10 - The Weeks Ahead
33:10 - Thanks for Watching
Follow our Hosts on Social Media
Tom Hollingsworth: https://www.twitter.com/NetworkingNerd
Stephen Foskett: https://www.twitter.com/SFoskett
Follow Gestalt IT
Website: https://www.GestaltIT.com/
Twitter: https://www.twitter.com/GestaltIT
LinkedIn: https://www.linkedin.com/company/Gestalt-IT
Tags: #Rundown, AI, #AWSreinvent, #AWS, #Storage, @SkyhawkCloudSec, @Couchbase, #Capella, #Data, #Security, #NXP, #China, @AWS, @NVIDIA, #GraceHopper, @Arm, #Graviton4, #Bedrock, @NetworkingNerd, @SFoskett, @GestaltIT,
5
33 ratings
Amazon announced that they will be using Nvidia's NVSwitch to create new rackscale AI platforms. This allows customers to use Nvidia technology like Grace Hopper or build something using AWS Nitro DPUs and Elastic Fabric Adapaters. That last combination doesn't use InfiniBand and moves to Ethernet. Two new chips are coming out from the Amazon labs. The first is Graviton4, the latest generation of Arm processor. Graviton4 has 50% more cores and 75% more memory bandwidth. This version of Graviton is based on the Demeter Neoverse V2 core. On the AI front Amazon also announced the next revision of their AI acceleration chip, Trainium2. This update has a 4x performance increase from the first generation and allows for liquid cooling. Trainium2 is designed to be deployed in clusters of 16 chips. In the data space, AWS made news with the GA of Bedrock, which enables customers to run foundational ML models from companies like Anthropic, Meta, and of course AWS itself. But many companies are worried about hallucination and want to include their own data in these models. That's what AWS is delivering with Guardrails, and what AWS partners are leaning into as well. This and more on this week's Gestalt IT Rundown.
0:00 - Welcome to the Rundown
1:18 - DAOS Foundation Launched for Object Storage
4:57 - Autonomous Purple Team annouced by Skyhawk at AWS re:Invent
8:26 - Couchbase's Capella Columnar Service Revealed
10:59 - Hackers Were Inside NXP For Two Years Before Detection
14:47 - AWS re:Invent Announcements
15:26 - NVSwitch For AI Nodes
20:46 - ARM V2 for Graviton4 and Trainium2
25:22 - AWS Guardrails for Bedrock
30:10 - The Weeks Ahead
33:10 - Thanks for Watching
Follow our Hosts on Social Media
Tom Hollingsworth: https://www.twitter.com/NetworkingNerd
Stephen Foskett: https://www.twitter.com/SFoskett
Follow Gestalt IT
Website: https://www.GestaltIT.com/
Twitter: https://www.twitter.com/GestaltIT
LinkedIn: https://www.linkedin.com/company/Gestalt-IT
Tags: #Rundown, AI, #AWSreinvent, #AWS, #Storage, @SkyhawkCloudSec, @Couchbase, #Capella, #Data, #Security, #NXP, #China, @AWS, @NVIDIA, #GraceHopper, @Arm, #Graviton4, #Bedrock, @NetworkingNerd, @SFoskett, @GestaltIT,
1,631 Listeners
7,830 Listeners
8,594 Listeners
325 Listeners
154 Listeners
101 Listeners
11,715 Listeners
111,507 Listeners
56,163 Listeners
15 Listeners
418 Listeners