Being that this is “practical” AI, we decided that it would be good to take time to discuss various aspects of AI infrastructure. In this full-connected episode, we discuss our personal/local infrastructure along with trends in AI, including infra for training, serving, and data management.

Join the discussion

Changelog++ members support our work, get closer to the metal, and make the ads disappear. Join today!

Sponsors:

• DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog.

Featuring:

• Chris Benson – Website, GitHub, LinkedIn, Bluesky, X
• Daniel Whitenack – Website, GitHub, X

Show Notes:

Our locally installed stuff:

Where we see AI workflows running:

Experimentation / model development:

Pipelining and automation:

Serving:

Monitoring/visibility:

Something missing or broken? PRs welcome!