NBTV: Your Money, Your Data, Your Life

How To Host AI Locally


Listen Later

https://youtu.be/CVeZfM0pVyU
https://odysee.com/@NaomiBrockwell:4/Local-LLM:d

AI chatbots are taking over the world. But if you want to guarantee your privacy when using them, running an LLM locally is going to be your best bet. In this video I collaborate with The Hated One to show you how, and to explain some AI terminology so that you understand what's going on.

00:00 Your Data is Used to Train Chatbots
01:11 Understanding AI Models
01:28 LLM
02:23 Parameters
03:34 Size
04:51 AI Engine and UX
07:15 Tutorial, courtesy of The Hated One
08:07 Ollama
12:40 Open Web UI installation
13:23 Docker
15:30 Setting up Open Web UI
16:38 Choose to Take Control of Your Data

The biggest advantage of open source models is that you can fine tune them using your own instructions while keeping all data private and confidential. Why trust your data to someone else when you don’t have to?

A huge thank you to The Hated One for his tutorial.
You can find his playlist for staying anonymous here:
https://www.youtube.com/watch?v=G_QsQp7DyjE&list=PLR_ghQEN2SgDLpuLMLa_0hjJZgrlHoi0a

Brought to you by NBTV team members: The Hated One, Reuben Yap, Lee Rennie, Cube Boy, Sam Ettaro, Will Sandoval and Naomi Brockwell

To support NBTV, visit:
https://www.nbtv.media/support
(tax-deductible in the US)

Visit our shop!
https://Shop.NBTV.media

Our eBook "Beginner's Introduction To Privacy:
https://amzn.to/3WDSfku

Beware of scammers, I will never give you a phone number or reach out to you with investment advice. I do not give investment advice.


Support the show

...more
View all episodesView all episodes
Download on the App Store

NBTV: Your Money, Your Data, Your LifeBy Naomi Brockwell

  • 5
  • 5
  • 5
  • 5
  • 5

5

20 ratings


More shows like NBTV: Your Money, Your Data, Your Life

View all
Security Now (Audio) by TWiT

Security Now (Audio)

2,001 Listeners

CyberWire Daily by N2K Networks

CyberWire Daily

1,017 Listeners

Smashing Security by Graham Cluley

Smashing Security

322 Listeners

Firewalls Don't Stop Dragons Podcast by Carey Parker

Firewalls Don't Stop Dragons Podcast

64 Listeners

Click Here by Recorded Future News

Click Here

414 Listeners

Darknet Diaries by Jack Rhysider

Darknet Diaries

7,999 Listeners

9to5Mac Daily by 9to5Mac

9to5Mac Daily

496 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,829 Listeners

Surveillance Report by Techlore & The New Oil

Surveillance Report

95 Listeners

How to Fix the Internet by Electronic Frontier Foundation (EFF)

How to Fix the Internet

119 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,097 Listeners

The 404 Media Podcast by 404 Media

The 404 Media Podcast

316 Listeners

The Lockdown - Practical Privacy & Security by Ray Heffer

The Lockdown - Practical Privacy & Security

25 Listeners

The Tucker Carlson Show by Tucker Carlson Network

The Tucker Carlson Show

16,745 Listeners

The AI Fix by Graham Cluley and Mark Stockley

The AI Fix

32 Listeners