Sign up to save your podcasts
Or
Share Redefining AI Infrastructure: Open-Source, Chips, and the Future Beyond Kubernetes – Andrey Cheptsov
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Redefining AI Infrastructure: Open-Source, Chips, and the Future Beyond Kubernetes – Andrey Cheptsov
In this podcast episode, we talked with Andrey Cheptsov about The future of AI infrastructure.
About the Speaker:
Andrey Cheptsov is the founder and CEO of dstack, an open-source alternative to Kubernetes and Slurm, built to simplify the orchestration of AI infrastructure. Before dstack, Andrey worked at JetBrains for over a decade helping different teams make the best developer tools.
During the event, the guest, Andrey Cheptsov, founder and CEO of dstack, discussed the complexities of AI infrastructure. We explore topics like the challenges of using Kubernetes for AI workloads, the need to rethink container orchestration, and the future of hybrid and cloud-only infrastructures. Andrey also shares insights into the role of on-premise and bare-metal solutions, edge computing, and federated learning.
00:00 Andrey's Career Journey: From JetBrains to DStack
5:00 The Motivation Behind DStack
7:00 Challenges in Machine Learning Infrastructure
10:00 Transitioning from Cloud to On-Prem Solutions
14:30 Reflections on OpenAI's Evolution
17:30 Open Source vs Proprietary Models: A Balanced Perspective
21:01 Monolithic vs. Decentralized AI businesses
22:05 The role of privacy and control in AI for industries like banking and healthcare
30:00 Challenges in training large AI models: GPUs and distributed systems
37:03 DeepSpeed's efficient training approach vs. brute force methods
39:00 Challenges for small and medium businesses: hosting and fine-tuning models
47:01 Managing Kubernetes challenges for AI teams
52:00 Hybrid vs. cloud-only infrastructure
56:03 On-premise vs. bare-metal solutions
58:05 Exploring edge computing and its challenges
🔗 CONNECT WITH ANDREY CHEPTSOV
Twitter - / andrey_cheptsov
Linkedin - / andrey-cheptsov
GitHub - https://github.com/dstackai/dstack/
Website - https://dstack.ai/
🔗 CONNECT WITH DataTalksClub
Join DataTalks.Club:https://datatalks.club/slack.html
Our events:https://datatalks.club/events.html
Datalike Substack -https://datalike.substack.com/
LinkedIn: / datatalks-club
View all episodes
By DataTalks.Club
5
77 ratings
In this podcast episode, we talked with Andrey Cheptsov about The future of AI infrastructure.
About the Speaker:
Andrey Cheptsov is the founder and CEO of dstack, an open-source alternative to Kubernetes and Slurm, built to simplify the orchestration of AI infrastructure. Before dstack, Andrey worked at JetBrains for over a decade helping different teams make the best developer tools.
During the event, the guest, Andrey Cheptsov, founder and CEO of dstack, discussed the complexities of AI infrastructure. We explore topics like the challenges of using Kubernetes for AI workloads, the need to rethink container orchestration, and the future of hybrid and cloud-only infrastructures. Andrey also shares insights into the role of on-premise and bare-metal solutions, edge computing, and federated learning.
00:00 Andrey's Career Journey: From JetBrains to DStack
5:00 The Motivation Behind DStack
7:00 Challenges in Machine Learning Infrastructure
10:00 Transitioning from Cloud to On-Prem Solutions
14:30 Reflections on OpenAI's Evolution
17:30 Open Source vs Proprietary Models: A Balanced Perspective
21:01 Monolithic vs. Decentralized AI businesses
22:05 The role of privacy and control in AI for industries like banking and healthcare
30:00 Challenges in training large AI models: GPUs and distributed systems
37:03 DeepSpeed's efficient training approach vs. brute force methods
39:00 Challenges for small and medium businesses: hosting and fine-tuning models
47:01 Managing Kubernetes challenges for AI teams
52:00 Hybrid vs. cloud-only infrastructure
56:03 On-premise vs. bare-metal solutions
58:05 Exploring edge computing and its challenges
🔗 CONNECT WITH ANDREY CHEPTSOV
Twitter - / andrey_cheptsov
Linkedin - / andrey-cheptsov
GitHub - https://github.com/dstackai/dstack/
Website - https://dstack.ai/
🔗 CONNECT WITH DataTalksClub
Join DataTalks.Club:https://datatalks.club/slack.html
Our events:https://datatalks.club/events.html
Datalike Substack -https://datalike.substack.com/
LinkedIn: / datatalks-club
More shows like DataTalks.Club
View all
Radiolab
44,024 Listeners
Hidden Brain
43,627 Listeners
The Knowledge Project
2,671 Listeners
Super Data Science: ML & AI Podcast with Jon Krohn
303 Listeners
Data Engineering Podcast
144 Listeners
The Real Python Podcast
141 Listeners
Huberman Lab
29,173 Listeners
The Ezra Klein Show
15,942 Listeners
ReThinking
628 Listeners
Data Career Podcast: Helping You Land a Data Analyst Job FAST
160 Listeners
The Analytics Engineering Podcast
28 Listeners
The Tucker Carlson Show
17,036 Listeners