Sign up to save your podcasts
Or
Share AI Everyday - #20 - Llama2, GPTQ Quantization, and Text-Generation-Webui
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
AI Everyday - #20 - Llama2, GPTQ Quantization, and Text-Generation-Webui
Matt discusses Llama2 with GPTQ quantization, which is much more powerful than previous methods of quantizing model weights, and demos text-generation-webui.
View all episodes
By Matthew WallaceMatt discusses Llama2 with GPTQ quantization, which is much more powerful than previous methods of quantizing model weights, and demos text-generation-webui.