Sign up to save your podcasts
Or
Share LLM Evaluation: Opik with Gideon Mendels
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
LLM Evaluation: Opik with Gideon Mendels
Gideon Mendels (Github: @gidim) is the co-founder and CEO of Comet, the end-to-end model evaluation platform for AI developers. Among the tools in the Comet ecosystem is Opik, an open-source solution for evaluating, testing and monitoring LLM applications. Opik allows users to log traces and spans, define and compute evaluation metrics, score LLM outputs, compare performance across app versions, and more. As a true open-source project, its full featureset is available for use by anyone, completely free.
Contributor is looking for a community manager! If you want to know more, shoot us an email at [email protected].
Subscribe to Contributor on Substack for email notifications!
In this episode we discuss:
How Opik’s popularity blew up beyond the Comet team’s expectations
Why CI/CD is especially important in an end-to-end platform
Gideon’s “severe allergy” to “fake open-source” offerings
Why the number of dedicated machine learning engineers is actually going down
Eric’s thoughts on what it means for venture capital to invest in the LLM space
Links:
Opik
Comet
View all episodes
By Eric Anderson
5
1111 ratings
Gideon Mendels (Github: @gidim) is the co-founder and CEO of Comet, the end-to-end model evaluation platform for AI developers. Among the tools in the Comet ecosystem is Opik, an open-source solution for evaluating, testing and monitoring LLM applications. Opik allows users to log traces and spans, define and compute evaluation metrics, score LLM outputs, compare performance across app versions, and more. As a true open-source project, its full featureset is available for use by anyone, completely free.
Contributor is looking for a community manager! If you want to know more, shoot us an email at [email protected].
Subscribe to Contributor on Substack for email notifications!
In this episode we discuss:
How Opik’s popularity blew up beyond the Comet team’s expectations
Why CI/CD is especially important in an end-to-end platform
Gideon’s “severe allergy” to “fake open-source” offerings
Why the number of dedicated machine learning engineers is actually going down
Eric’s thoughts on what it means for venture capital to invest in the LLM space
Links:
Opik
Comet
More shows like Contributor
View all
The Joe Rogan Experience
223,304 Listeners
Pivot
8,326 Listeners
Python Bytes
214 Listeners
The Daily
112,729 Listeners
Techmeme Ride Home
946 Listeners
Huberman Lab
28,181 Listeners
On with Kara Swisher
3,057 Listeners