Sign up to save your podcasts
Or
Share PBS Tidbit 10 — Run LLMs Locally with Ollama with Steve Mattan
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
PBS Tidbit 10 — Run LLMs Locally with Ollama with Steve Mattan
In a very unusual Tidbit episode of Programming By Stealth, Allison interviews NosillaCastaway and Programming By Stealth student Steve Mattan about how he's running Large Language Models locally on his Mac. He pulls this off using a series of open source tools, starting with Ollama for the models from the command line, and then Enchanted to give him a nice GUI. He explains how he's integrated the local LLM into VSCode for his coding, and how he uses Keyboard Maestro to launch all of this at once.
You can find the outline and links to how Steve's doing this at pbs.bartificer.net.
Read an unedited, auto-generated transcript with chapter marks: PBS_2024_12_07
Join our Slack at podfeet.com/slack and look for the #pbs channel, and check out our pbs-student GitHub Organization. It's by invitation only but all you have to do is ask Allison!
Join the Conversation:
Support the Show:
Referral Links:
View all episodes
By Bart Busschots & Allison Sheridan
5
1515 ratings
In a very unusual Tidbit episode of Programming By Stealth, Allison interviews NosillaCastaway and Programming By Stealth student Steve Mattan about how he's running Large Language Models locally on his Mac. He pulls this off using a series of open source tools, starting with Ollama for the models from the command line, and then Enchanted to give him a nice GUI. He explains how he's integrated the local LLM into VSCode for his coding, and how he uses Keyboard Maestro to launch all of this at once.
You can find the outline and links to how Steve's doing this at pbs.bartificer.net.
Read an unedited, auto-generated transcript with chapter marks: PBS_2024_12_07
Join our Slack at podfeet.com/slack and look for the #pbs channel, and check out our pbs-student GitHub Organization. It's by invitation only but all you have to do is ask Allison!
Join the Conversation:
Support the Show:
Referral Links:
More shows like Programming By Stealth
View all
How Did This Get Made?
23,113 Listeners
Mac Geek Gab — Apple Tips, Tricks, and Troubleshooting
836 Listeners
NosillaCast Apple Podcast
164 Listeners
Mac Power Users
1,288 Listeners
Chit Chat Across the Pond
9 Listeners
The Vergecast
3,702 Listeners
Taming the Terminal
21 Listeners
Interesting Times with Ross Douthat
7,226 Listeners
Conversations With Coleman
568 Listeners
Huberman Lab
29,132 Listeners
Honestly with Bari Weiss
8,730 Listeners