Ryan welcomes Benny Chen, co-founder of Fireworks AI, to the show to explore what actually makes an AI application good or not, how to balance qualitative signals with quantitative metrics when evaluating AI, and how open-source eval protocols and community efforts are setting the standard for AI evaluation. 

Episode notes: 

Fireworks AI is a cloud platform designed for developers and enterprises to run, customize, and scale open-source generative AI models. 

Connect with Benny on LinkedIn.

Congrats to user techtabu for winning a Stellar Answer badge for answering How can I delete all local Docker images?.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.