Bitcoin Audible

Ai_012 - A Big Leap Forward for Local LLMs


Listen Later

The models, the tools, the implementations, everything is moving incredibly fast.

But a very interesting trend that I've been seeing, is that the open source benchmarks are improving just slightly faster than the closed source alternatives. Slowly but surely, they are catching up.

The day may come where the open source models are the best models, the ones with the greatest number of tools, and the largest variety of implementations, because naturally they're open and available for everyone to work on.

There have been numerous new developments on running models more efficiently, running larger models on even smaller devices, and doing so with less power and computational overhead, as well as a new advancement in one of my favourite open source models, which may just be a big leap forward for how these are going to evolve moving forward. And that is what today's episode of AI Unchained is all about.

A big leap for local LLMs.

 

Ai News Roundup

  • Running Ai locally on a Smartphone: A Performance Evaluation of a Quantized Large Language Model on Various Smartphones (Link: http://tinyurl.com/mv4k7eyp)
  • LLM in a flash: Efficient Large Language Model Inference with Limited Memory (Link:http://tinyurl.com/mrc5ur7m) 
  • Explore the new Mixtral Model below

    • Poe.com (Link:https://poe.com/chat/2vdailufawo9jnkcb4l)
    • Fireworks AI Models (Link: https://app.fireworks.ai/models)
    • GGUF Model for Local Running (Link: http://tinyurl.com/34btrnre)
    • LM Studio - Discover, download, and run local LLMs (Link:https://lmstudio.ai/)
    • Unleashed Chat - One button to deploy your own chat (Link: https://unleashed.chat/app/chat)
    • Host Links

      • Guy on Nostr ⁠(Link: http://tinyurl.com/2xc96ney)
      • ⁠Guy on X ⁠(Link: https://twitter.com/theguyswann)
      • Guy on Instagram (Link: https://www.instagram.com/theguyswann)
      • Guy on TikTok (Link: https://www.tiktok.com/@theguyswann)
      • Guy on YouTube (Link: https://www.youtube.com/@theguyswann)
      • Bitcoin Audible on X⁠ (Link: https://twitter.com/BitcoinAudible)
      • The Guy Swann Network Broadcast Room on Keet (Link: https://tinyurl.com/3na6v839)

      • Check out our awesome sponsors!

        • Fold: The best way to buy, use, and earn #Bitcoin on everything you do! Sats back on your debit card, gift cards, auto-buys, round-ups, you name it. Fold is the true bitcoiner's banking. Get 20K sats for FREE using referral code bitcoinaudible.com/fold
        • Ready for best-in-class self custody?

          • Get the Jade here and use discount code 'GUY' to get 10% off (Link: bitcoinaudible.com/jade)
          • Trying to BUY BITCOIN?

            • River, secure, trusted, bitcoin only, lightning enabled, simple. (Link: https://bitcoinaudible.com/river)
            • Bitcoin Games!

              • Get 10% off the best Bitcoin board game in the world, HODLUP! Or any of the other great games from the Free Market Kids! Use code GUY10 at checkout for 10% off your cart! (Link: https://www.freemarketkids.com/collections/games-1)
              • Bitcoin Custodial Multisig

                • Want to get into Bitcoin but not ready for self custody? Use custodial multisig for the best way to distribute trust across multiple institutions and even jurisdictions! Check out OnRamp. (Link: BitcoinAudible.com/onramp)
                • Education & HomeSchooling

                   

                  • Get the lesson in real economics that you never got in school, and teach your kids the truth, not the statist insanity that is Keynesianism. Liberty Classroom is the invaluable resource you are looking for! (Link: BitcoinAudible.com/Liberty)
                  • ...more
                    View all episodesView all episodes
                    Download on the App Store

                    Bitcoin AudibleBy Guy Swann

                    • 4.9
                    • 4.9
                    • 4.9
                    • 4.9
                    • 4.9

                    4.9

                    416 ratings


                    More shows like Bitcoin Audible

                    View all
                    TFTC: A Bitcoin Podcast by TFTC: A Bitcoin Podcast

                    TFTC: A Bitcoin Podcast

                    763 Listeners

                    The Peter McCormack Show by Peter McCormack

                    The Peter McCormack Show

                    2,162 Listeners

                    The Bitcoin Standard Podcast by Dr. Saifedean Ammous

                    The Bitcoin Standard Podcast

                    435 Listeners

                    Stephan Livera Podcast by Stephan Livera

                    Stephan Livera Podcast

                    415 Listeners

                    The Pomp Podcast by Anthony Pompliano

                    The Pomp Podcast

                    1,837 Listeners

                    What Bitcoin Did by Danny Knowles

                    What Bitcoin Did

                    247 Listeners

                    Swan Signal Live - A Bitcoin Show by Swan Bitcoin

                    Swan Signal Live - A Bitcoin Show

                    182 Listeners

                    The Bitcoin Matrix by Cedric Youngelman

                    The Bitcoin Matrix

                    85 Listeners

                    The "What is Money?" Show by Robert Breedlove

                    The "What is Money?" Show

                    663 Listeners

                    Coin Stories by Natalie Brunell

                    Coin Stories

                    410 Listeners

                    Simply Bitcoin by Simply Bitcoin

                    Simply Bitcoin

                    84 Listeners

                    Rabbit Hole Recap by ODELL and Marty Bent

                    Rabbit Hole Recap

                    119 Listeners

                    THE Bitcoin Podcast by Walker America

                    THE Bitcoin Podcast

                    34 Listeners

                    The Jack Mallers Show by Jack Mallers

                    The Jack Mallers Show

                    96 Listeners

                    The Bitcoin Frontier by Unchained Capital, Inc

                    The Bitcoin Frontier

                    31 Listeners