The Bootstrapped Founder

293: Local AI


Listen Later

Today I discuss how I've developed my own advanced AI, moving away from relying on external platforms. I've managed to evolve the Podscan system from basic alerts to being capable of answering complex questions, all thanks to using llama.cpp and Mistral 7b on my own servers.

This approach has given me complete control over our technology and made our project more attractive to potential buyers. By leveraging open-source tools, I've minimized our dependency on other platforms and improved our competitive position.

And it's because of thousands of people working on this for free that I get to do this. The community support for llama.cpp on GitHub has been a testament to the collaborative effort behind this advancement. This episode celebrates the bold initiatives taken by these awesome developers and entrepreneurs in the AI space, and you'll learn how managing AI in-house can revolutionize a small but powerful software venture.


This episode is sponsored by Acquire.com

The blog post: https://thebootstrappedfounder.com/local-ai-for-software-founders/

The podcast episode: https://tbf.fm/episodes/293-local-ai


Check out Podscan to get alerts when you're mentioned on podcasts: https://podscan.fm
Send me a voicemail on Podline: https://podline.fm/arvid

You'll find my weekly article on my blog: https://thebootstrappedfounder.com

Podcast: https://thebootstrappedfounder.com/podcast

Newsletter: https://thebootstrappedfounder.com/newsletter


My book Zero to Sold: https://zerotosold.com/

My book The Embedded Entrepreneur: https://embeddedentrepreneur.com/

My course Find Your Following: https://findyourfollowing.com

Here are a few tools I use. Using my affiliate links will support my work at no additional cost to you.
- Notion (which I use to organize, write, coordinate, and archive my podcast + newsletter): https://affiliate.notion.so/465mv1536drx
- Riverside.fm (that's what I recorded this episode with): https://riverside.fm/?via=arvid
- TweetHunter (for speedy scheduling and writing Tweets): http://tweethunter.io/?via=arvid
- HypeFury (for massive Twitter analytics and scheduling): https://hypefury.com/?via=arvid60
- AudioPen (for taking voice notes and getting amazing summaries): https://audiopen.ai/?aff=PXErZ
- Descript (for word-based video editing, subtitles, and clips): https://www.descript.com/?lmref=3cf39Q
- ConvertKit (for email lists, newsletters, even finding sponsors): https://convertkit.com?lmref=bN9CZw

...more
View all episodesView all episodes
Download on the App Store

The Bootstrapped FounderBy Arvid Kahl

  • 5
  • 5
  • 5
  • 5
  • 5

5

32 ratings


More shows like The Bootstrapped Founder

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,272 Listeners

Startups For the Rest of Us by Rob Walling

Startups For the Rest of Us

693 Listeners

Niche Pursuits Podcast: Find Your Next "Niche" Business Idea! by Spencer Haws: NichePursuits.com

Niche Pursuits Podcast: Find Your Next "Niche" Business Idea!

191 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,023 Listeners

The SaaS Podcast - SaaS, Startups, Growth Hacking & Entrepreneurship by Omer Khan

The SaaS Podcast - SaaS, Startups, Growth Hacking & Entrepreneurship

182 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

513 Listeners

Built to Sell Radio by John Warrillow

Built to Sell Radio

210 Listeners

The Official SaaStr Podcast: SaaS | Founders | Investors by SaaStr

The Official SaaStr Podcast: SaaS | Founders | Investors

173 Listeners

Noah Kagan Presents by Noah Kagan

Noah Kagan Presents

907 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

213 Listeners

REWORK by 37signals

REWORK

211 Listeners

My First Million by Hubspot Media

My First Million

2,620 Listeners

The Startup Ideas Podcast by Greg Isenberg

The Startup Ideas Podcast

187 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

77 Listeners

Moneywise by Hampton

Moneywise

643 Listeners