TILvids

OpenAI GPT-OSS on a RTX 3060!!!

Listen Later

Turns out you can run models LARGER than you VRAM.

Open AI realased a new Open Source, Apache licensed LLM and it runs suprisingly well on my aging hardware.

0:00 Intro

0:12 My Hardware
0:33 GPU and CPU Offloading
0:58 GPT OSS Run
1:23 LM Studio
1:59 AI Website Demo and Prompt
2:09 Outro

TOOLS THAT I USE

🔥 https://kdenlive.org/
🔥 https://www.gimp.org/
🔥 https://www.blender.org/
🔥 https://obsproject.com/
🔥 https://www.audacityteam.org/

HARDWARE I USE

👾 ThinkPad X1 Carbon: https://amzn.to/3a0ZSvr
👾 Canon m50: https://amzn.to/3lFxy48
👾 Sigma 16mm f1.4 EOSM: https://amzn.to/3mKd0sM
👾 FiFine K669B USB Mic: https://amzn.to/3jnDhgd

👾 Keyboard | DIERYA DK63: https://amzn.to/3loFeeQ

👾 Mouse | Logitech M355: https://amzn.to/3A6GPds
👾 Acer SB270 27" 1920x1080 IPS Screen: https://amzn.to/3rSpQbZ

👾 Osmo Pocket: https://amzn.to/2JCAIZJ

👾 Mavic Mini: https://amzn.to/3lFxod2
👾 Samsung Galaxy Tab S6: https://amzn.to/3fsbVnR
👾 Samsung Galaxy S21 Ultra: https://amzn.to/3jmwAuy
👾 Movo TMP100 USBC Mic: https://amzn.to/2WSlV3p

FOLLOW ME:

🤘 https://arthur.pizza
🐘 https://mastodon.sdf.org/@art
📱 https://www.tiktok.com/@arthurrpizza

SUPPORT ME:

🤑 https://www.patreon.com/arthurpizza
💸 https://liberapay.com/arthurreeder/

AFFILIATE DISCLOSURES:

I get commissions for purchases made through links in this video.

...more
View all episodesView all episodes
Download on the App Store
TILvidsBy