Sign up to save your podcasts
Or
Share Building a Local Large Language Model (LLM)
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Building a Local Large Language Model (LLM)
Another #ComputingWeek talk turned into a podcast! Two Red Hat software engineers, both recent graduates of SETU, returned to discuss the issues surrounding running your own LLM on a local machine, how models and datasets are built and reduced (quantised) so as to run on a laptop rather than an array of servers. Mark Campbell and Dimitri Saradkis provided excellent insight on the technical issues surround this topic, before getting into some of the ethical and moral issues with host Rob O'Connor at the end.
You can connect with all the people on this podcast on LinkedIn at:
Here are links to some of the tools referenced in the podcast:
View all episodes
By Rob O'Connor
5
66 ratings
Another #ComputingWeek talk turned into a podcast! Two Red Hat software engineers, both recent graduates of SETU, returned to discuss the issues surrounding running your own LLM on a local machine, how models and datasets are built and reduced (quantised) so as to run on a laptop rather than an array of servers. Mark Campbell and Dimitri Saradkis provided excellent insight on the technical issues surround this topic, before getting into some of the ethical and moral issues with host Rob O'Connor at the end.
You can connect with all the people on this podcast on LinkedIn at:
Here are links to some of the tools referenced in the podcast:
More shows like The Machine: A computer science education podcast
View all
Radiolab
43,843 Listeners
The Joe Rogan Experience
222,642 Listeners
My Brother, My Brother And Me
29,968 Listeners
CodeNewbie
573 Listeners
Science Vs
11,898 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
429 Listeners
The Daily
111,590 Listeners
Up First from NPR
56,083 Listeners
Short Wave
6,223 Listeners
Last Week in AI
275 Listeners