
Sign up to save your podcasts
Or
Another #ComputingWeek talk turned into a podcast! Two Red Hat software engineers, both recent graduates of SETU, returned to discuss the issues surrounding running your own LLM on a local machine, how models and datasets are built and reduced (quantised) so as to run on a laptop rather than an array of servers. Mark Campbell and Dimitri Saradkis provided excellent insight on the technical issues surround this topic, before getting into some of the ethical and moral issues with host Rob O'Connor at the end.
You can connect with all the people on this podcast on LinkedIn at:
Here are links to some of the tools referenced in the podcast:
4.8
88 ratings
Another #ComputingWeek talk turned into a podcast! Two Red Hat software engineers, both recent graduates of SETU, returned to discuss the issues surrounding running your own LLM on a local machine, how models and datasets are built and reduced (quantised) so as to run on a laptop rather than an array of servers. Mark Campbell and Dimitri Saradkis provided excellent insight on the technical issues surround this topic, before getting into some of the ethical and moral issues with host Rob O'Connor at the end.
You can connect with all the people on this podcast on LinkedIn at:
Here are links to some of the tools referenced in the podcast:
7,901 Listeners
66 Listeners
226,206 Listeners
574 Listeners
153,960 Listeners
111,864 Listeners
56,221 Listeners
417 Listeners
5,448 Listeners
15,237 Listeners
0 Listeners
3,276 Listeners
988 Listeners
4 Listeners
2,295 Listeners