Sign up to save your podcasts
Or
Share PowerInfer-2: Fast Large Language Model Inference on a Smartphone
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
PowerInfer-2: Fast Large Language Model Inference on a Smartphone
A podcast discussion about PowerInfer-2, a framework for running large language models on smartphones, focusing on its neuron cluster design, adaptive computation strategies, and I/O optimizations.
View all episodes
By weedgeA podcast discussion about PowerInfer-2, a framework for running large language models on smartphones, focusing on its neuron cluster design, adaptive computation strategies, and I/O optimizations.