Sign up to save your podcasts
Or
Share Mac Studio Clusters Now Run Trillion-Parameter Models for $40K
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Mac Studio Clusters Now Run Trillion-Parameter Models for $40K
macOS RDMA over Thunderbolt 5 has turned four Mac Studios into a 1.5TB unified memory cluster that runs Kimi K2 at 25 tokens per second - a setup that would cost $780K with NVIDIA H100s.
View all episodes
By Awesome AgentsmacOS RDMA over Thunderbolt 5 has turned four Mac Studios into a 1.5TB unified memory cluster that runs Kimi K2 at 25 tokens per second - a setup that would cost $780K with NVIDIA H100s.