The Bootstrapped Founder

293: Local AI


Listen Later

Today I discuss how I've developed my own advanced AI, moving away from relying on external platforms. I've managed to evolve the Podscan system from basic alerts to being capable of answering complex questions, all thanks to using llama.cpp and Mistral 7b on my own servers.

This approach has given me complete control over our technology and made our project more attractive to potential buyers. By leveraging open-source tools, I've minimized our dependency on other platforms and improved our competitive position.

And it's because of thousands of people working on this for free that I get to do this. The community support for llama.cpp on GitHub has been a testament to the collaborative effort behind this advancement. This episode celebrates the bold initiatives taken by these awesome developers and entrepreneurs in the AI space, and you'll learn how managing AI in-house can revolutionize a small but powerful software venture.


This episode is sponsored by Acquire.com

The blog post: https://thebootstrappedfounder.com/local-ai-for-software-founders/

The podcast episode: https://tbf.fm/episodes/293-local-ai


Check out Podscan to get alerts when you're mentioned on podcasts: https://podscan.fm
Send me a voicemail on Podline: https://podline.fm/arvid

You'll find my weekly article on my blog: https://thebootstrappedfounder.com

Podcast: https://thebootstrappedfounder.com/podcast

Newsletter: https://thebootstrappedfounder.com/newsletter


My book Zero to Sold: https://zerotosold.com/

My book The Embedded Entrepreneur: https://embeddedentrepreneur.com/

My course Find Your Following: https://findyourfollowing.com

Here are a few tools I use. Using my affiliate links will support my work at no additional cost to you.
- Notion (which I use to organize, write, coordinate, and archive my podcast + newsletter): https://affiliate.notion.so/465mv1536drx
- Riverside.fm (that's what I recorded this episode with): https://riverside.fm/?via=arvid
- TweetHunter (for speedy scheduling and writing Tweets): http://tweethunter.io/?via=arvid
- HypeFury (for massive Twitter analytics and scheduling): https://hypefury.com/?via=arvid60
- AudioPen (for taking voice notes and getting amazing summaries): https://audiopen.ai/?aff=PXErZ
- Descript (for word-based video editing, subtitles, and clips): https://www.descript.com/?lmref=3cf39Q
- ConvertKit (for email lists, newsletters, even finding sponsors): https://convertkit.com?lmref=bN9CZw

...more
View all episodesView all episodes
Download on the App Store

The Bootstrapped FounderBy Arvid Kahl

  • 5
  • 5
  • 5
  • 5
  • 5

5

32 ratings


More shows like The Bootstrapped Founder

View all
The Official SaaStr Podcast: SaaS | Founders | Investors by SaaStr

The Official SaaStr Podcast: SaaS | Founders | Investors

172 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

291 Listeners

Startups For the Rest of Us by Rob Walling

Startups For the Rest of Us

696 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

624 Listeners

Built to Sell Radio by John Warrillow

Built to Sell Radio

209 Listeners

Noah Kagan Presents by Noah Kagan

Noah Kagan Presents

902 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

232 Listeners

Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

Syntax - Tasty Web Development Treats

987 Listeners

REWORK by 37signals

REWORK

210 Listeners

My First Million by Hubspot Media

My First Million

2,641 Listeners

The Startup Ideas Podcast by Greg Isenberg

The Startup Ideas Podcast

202 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

97 Listeners

Moneywise by Hampton

Moneywise

651 Listeners

AI + a16z by a16z

AI + a16z

33 Listeners

Lightcone Podcast by Y Combinator

Lightcone Podcast

22 Listeners