Turns out you can run models LARGER than you VRAM.
Open AI realased a new Open Source, Apache licensed LLM and it runs suprisingly well on my aging hardware.
0:12 My Hardware
0:33 GPU and CPU Offloading
0:58 GPT OSS Run
1:23 LM Studio
1:59 AI Website Demo and Prompt
๐ฅ https://kdenlive.org/
๐ฅ https://www.gimp.org/
๐ฅ https://www.blender.org/
๐ฅ https://obsproject.com/
๐ฅ https://www.audacityteam.org/
๐พ ThinkPad X1 Carbon: https://amzn.to/3a0ZSvr
๐พ Canon m50: https://amzn.to/3lFxy48
๐พ Sigma 16mm f1.4 EOSM: https://amzn.to/3mKd0sM
๐พ FiFine K669B USB Mic: https://amzn.to/3jnDhgd
๐พ Keyboard | DIERYA DK63: https://amzn.to/3loFeeQ
๐พ Mouse | Logitech M355: https://amzn.to/3A6GPds
๐พ Acer SB270 27" 1920x1080 IPS Screen: https://amzn.to/3rSpQbZ
๐พ Osmo Pocket: https://amzn.to/2JCAIZJ
๐พ Mavic Mini: https://amzn.to/3lFxod2
๐พ Samsung Galaxy Tab S6: https://amzn.to/3fsbVnR
๐พ Samsung Galaxy S21 Ultra: https://amzn.to/3jmwAuy
๐พ Movo TMP100 USBC Mic: https://amzn.to/2WSlV3p
๐ค https://arthur.pizza
๐ https://mastodon.sdf.org/@art
๐ฑ https://www.tiktok.com/@arthurrpizza
๐ค https://www.patreon.com/arthurpizza
๐ธ https://liberapay.com/arthurreeder/
I get commissions for purchases made through links in this video.