Tech Beats Unplugged

👨🏽‍🚀 Welcome to Episode 10 of "Tech Beats Unplugged" with Junchen Jiang, CEO & Co-Founder of Tensormesh.

$20M to Fix AI's Most Expensive Problem.

Fresh off Tensormesh's $20M funding announcement backed by AMD Ventures, CoreWeave, NVentures (NVIDIA), Valley Capital Partners, and Laude Ventures, Junchen joins Kosseila HD to unpack the journey from a research insight at the University of Chicago to building one of the fastest-growing AI infrastructure companies.

In this episode, we dive into the story behind LMCache, why KV cache evolved from a largely misunderstood concept in academia into one of the most critical layers of modern AI inference, and how Tensormesh is building an open, caching-accelerated inference platform for the next generation of AI.

We're excited to share one of our most technical conversations yet.

Topics discussed:

1. (00:00) Introduction
2. (01:08) The Origin Story and Insight Behind LMCache
3. (06:27) The Origin of "KV Cache" in Academia
4. (11:25) Day 2 of AI: The Inference Bottleneck
5. (14:59) The Secret to Sustaining a Thriving Open Source Community
6. (16:42) Tensormesh Inference Platform V1 and $0 Cached Tokens
7. (18:28) Designing an Open, Agnostic Ecosystem (Serverless to On-Prem)
8. (21:42) Working with Hardware Vendors
9. (24:01) KV Cache in the Agentic Era
10. (27:38) What GPU & AI Cloud Backing Says About Tensormesh
11. (29:49) Closing Thoughts: Where Tensormesh Goes Next

Show Notes

• LMCache (Open Source): https://github.com/LMCache/LMCache
• Tensormesh: https://www.tensormesh.ai/
• Tensormesh Funding Announcement: https://www.tensormesh.ai/blog-posts/
• Follow Tensormesh on X: https://x.com/tensormesh
• Connect with Junchen Jiang: https://www.linkedin.com/in/junchenjiang/

🎙 About Junchen Jiang

Junchen Jiang is the CEO & Co-Founder of Tensormesh and the co-creator of LMCache, an open-source project developed from research at the University of Chicago. His work focuses on large-scale AI inference infrastructure, KV cache systems, and building an open ecosystem that spans GPUs, inference engines, storage, and enterprise AI deployments.

Follow Tech Beats Unplugged for more conversations with founders, researchers, and engineers building the future of AI infrastructure, open source, cloud, and startups.

👨🏽‍🚀 Welcome to Episode 09 of "Tech Beats unplugged" 𝗜𝗻𝗴𝗹𝗼𝗿𝗶𝗼𝘂𝘀 𝗖𝗹𝗼𝘂𝗱 𝗧𝗿𝗮𝗽𝘀 ☁️" With Mark Boost CEO at Civo Cloud .

𝗜𝘀 𝘁𝗵𝗲 𝗖𝗹𝗼𝘂𝗱 𝗯𝗿𝗼𝗸𝗲𝗻 ...𝗼𝗿 𝗷𝘂𝘀𝘁 𝘂𝗻𝗳𝗮𝗶𝗿?

This time, Mark Boost and Kosseila H. go deep into the infamous 𝗖𝗹𝗼𝘂𝗱 𝘁𝗿𝗮𝗽𝘀 and explore where control is lost - and how to regained it for customers.

🌟 We’re so excited to share our latest tech Beats show with you!

Topics discussed:

1. (00:23) Introduction
2. (01:42) From Formula 3 to serial entrepreneur
3. (08:44) lessons from s𝗰𝗮𝗹𝗶𝗻𝗴 𝗺𝘂𝗹𝘁𝗶𝗽𝗹𝗲 𝗰𝗼𝗺𝗽𝗮𝗻𝗶𝗲𝘀 (pivoting, competition, timing)
4. (18:59) CIVO Elevator pitch
5. (21:50) Why the 𝗰𝗹𝗼𝘂𝗱, 𝗮𝘀 𝘄𝗲 𝗸𝗻𝗼𝘄 𝗶𝘁, 𝗶𝘀 𝗯𝗿𝗼𝗸𝗲𝗻 ?
6. (28:59) The infamous cloud traps: egress fees, exit tax
7. (37:50) startup FREE credit : what's the catch?
8. (44:02) Cloud regulation & fairness: blessing or curse?
9. (47:32) Is Regulation killing AI innovation in Europe ?
10. (51:31) David vs Goliath: independent providers vs the Big 3 hyperscalers "the MOAT"
11. (56:56) 𝗔𝗜 𝗲𝗻𝗲𝗿𝗴𝘆 𝗰𝗿𝗶𝘀𝗶𝘀: how do we power AI without torching the grid👨🏻‍🔧🏭?
12. (01:01) ESG vs Greenwashing?
13. (01:03) 𝗢𝘂𝘁𝗮𝗴𝗲 𝗰𝗵𝗮𝗼𝘀: CEO mistakes — and how to do it right (CrowdStrike case)

𝗦𝗵𝗼𝘄 𝗡𝗼𝘁𝗲𝘀

• Civo website : civo.com
• Egress Fees: Big Tech Braces For Digital Market Act
• Civo talk "The cloud is broken":  The Cloud is Broken 
• Digital Market Acts
• ⁠European Data Act⁠⁠

• Free credits:A Call for Fair Competition by Addressing the Impact of Free Cloud Credits

• Green policies ESG: ESG reporting: Carbon in the cloud

• Data Center Co2 footprint calculator

🎙𝗔𝗯𝗼𝘂𝘁 𝗠𝗮𝗿𝗸 𝗕𝗼𝗼𝘀𝘁:⁠⁠⁠⁠⁠⁠⁠⁠Website: ⁠⁠https://markboost.com/ LinkedIn: ⁠⁠ ⁠markboost  X(Twitter): ⁠@markboost10 tips for a successful career

👨🏽‍🚀 Welcome to Episode 08 of "Tech Beats unplugged"

🌐🦘This time the episode cuts through the 𝗩𝗠𝘄𝗮𝗿𝗲 𝗕𝗿𝗼𝗮𝗱𝗰𝗼𝗺 chaos and breaks down where Nutanix really fits in today’s virtualized/multicloud world. With the help of no other than Nutanix Guru Michael Webster all the way from News Zeeland

🎧 We’re so excited to share our latest tech Beats show with you🧡! Please share away 🤗

We hope you'll enjoy it!!!

Topics discussed:

1. (00:21) Introduction
2. (01:58) What's your story with Nutanix
3. (09:41) Hyper Converged Infrastructure. What's that?
4. (13:38) Understanding Nutanix.
5. (18:25) The VMware–Broadcom Chaos for customers
6. (26:00) Running VMware on Nutanix (and moving off)
7. (30:05) Nutanix hardware ... a Lego of Nodes
8. (36:20) Nutanix building blocks - What's Controller VM
9. (43:05) Nutanix 𝗸𝗶𝗹𝗹𝘀 𝘁𝗵𝗲 𝗹𝗲𝗴𝗮𝗰𝘆 𝗥𝗔𝗜𝗗 storage - how?
10. (52:04) Nutanix; from 𝗵𝗮𝗿𝗱𝘄𝗮𝗿𝗲 𝘁𝗼 𝘀𝗼𝗳𝘁𝘄𝗮𝗿𝗲 company
11. (57:00) What is Nutanix MOAT going forward ?

Show Notes

• VMware customers face up to 1,500% price increase News⁠

• ⁠Nutanix How it works: ⁠⁠⁠Video

• Dutch court forces Broadcom to support VMware migration after 85% price hike: ⁠Networkworld⁠

• Nutanix Bible (nutanixbible.com)⁠

• ⁠AT&T sues broadcom over licensing: ⁠⁠⁠⁠Forbes

• Nutanix AHV: ⁠Built-in Enterprise-Class Virtualization⁠

🎙About Michael Webster:

• ⁠⁠⁠⁠⁠⁠Website: ⁠longwhiteclouds.com⁠

• LinkedIn: ⁠Steve Giguere⁠

• X(Twitter): @vcdxnz001

  
  

  Brought to You by Cloudthrill.

👋🏼 Hey AI heads 🎙️
Join us for the very first Tech Beats Live 🔴, hosted by Kosseila—aka @CloudDude from @CloudThrill.

🎯 This chill & laid-back livestream will unpack LLM quantization 🔥:

• ✅ WHY it matters
• ✅ HOW it works
• ✅ Enterprise (vLLM) vs Consumer (@Ollama) trade-offs
• ✅ and WHERE it’s going next.

We’ll be joined by two incredible guest stars to talk Enterprise vs Consumer Quantz 🗣️:

🔷 Eldar Kurtić – bringing the enterprise perspective with vLLM.
🔷 Colin Kealty – aka Bartowski, creator of the top-downloaded GGUF quantized LLMs on Hugging Face.

🫵🏼 Come learn and have some fun 😎.

𝐂𝐡𝐚𝐩𝐭𝐞𝐫𝐬:

(00:00) Host Introduction
(04:07) Eldar Intro
(07:33) Bartowski Intro
(13:04) What’s Quantization!
(16:19) Why LLM Quantization Matters?
(20:39) Training vs Inference – “The New Deal”
(27:46) Biggest Misconception About Quantization
(33:22) Enterprise Quantization in Production (vLLM)
(48:48) Consumer LLMs & Quantization (Ollama, llama.cpp, GGUF) – “LLMs for the People”
(01:06:45) BitNet 1-Bit Quantization from Microsoft
(01:28:14) How Long It Takes to Quantize a Model (Llama-3 70B) – GGUF or lm-compressor
(01:34:23) What Is I-Matrix & Why People Confuse It with IQ Quantization?
(01:39:36) What’s LoRA & LoRA-Q?
(01:42:36) What Is Sparsity?
(01:47:42) What Is Distillation?
(01:52:34) Extreme Quantization (Unsloth) of Big Models (DeepSeek) at 2-bits 70 % Size Cut
(01:57:27) Will Future Models (Llama-5) Be Trained on FP4 Tensor Cores?
(02:02:15) The Future of LLMs on Edge Devices (Google AI Edge)
(02:08:00) How to Evaluate the Quality of a Quantized Model
(02:26:09) Hugging Face’s Role in the World of LLM/Quantization
(02:33:46) Hugging Face’s Role in the World of LLM/Quantization
(02:36:41) LocalLlama Sub-Reddit Down (Moderator Goes Bananas)
(02:40:11) Guests’ Hope for the Future of LLMs & AI in General

📖 Check out the quantization blog: https://bitly/LLMQuant

#AI #LLM #Quantization #TechBeatsLive #LocalLlama #vLLM #Ollama

👨🏽‍🚀 Welcome to Episode 06 of "Tech Beats unplugged"

This time, we’re diving headfirst into 𝐭𝐡𝐞 𝐜𝐫𝐚𝐳𝐢𝐞𝐬𝐭 𝐆𝐢𝐭𝐇𝐮𝐛 𝐬𝐞𝐜𝐮𝐫𝐢𝐭𝐲 𝐬𝐭𝐨𝐫𝐢𝐞𝐬, and who better to join us than Steve Giguere, an industry veteran and security expert who’s seen it all.

From supply chain security mayhem to GitHub Actions gone wrong, we uncover real-world security blunders, attack vectors, and best practices to keep your repos and workflows safe.

🌟 We’re so excited to share our latest tech Beats show with you🧡! Please share away 🤗

We hope you'll enjoy it!!!

Topics discussed:

1. (00:00) Introduction
2. (03:53) Software Supply Chain Security acronyms (SAST, DAST, IAST, etc.)
3. (09:15) “A workflow is an application within your application” - What does that mean?!
4. (12:16) Public vs. Private Repos - Are private orgs still at risk?
5. (18:27) Self-hosted runners: Safe or security nightmare?
6. (21:16) GitHub Environment Variables - How critical are they?
7. (22:55) Secrets, masks, and how secure they really are
8. (28:05) Artifact vs. Caching: Which is safer?
9. (31:27) Craziest GitHub security screw-ups Steve has ever seen 🔥
10. (36:42) Common attack vectors in GitHub Actions
11. (44:19) Best security practices for GitHub Actions - Low-hanging fruit fixes 🍏
12. (50:22) Are public actions safe? Can they be scanned?
13. (53:52) xz backdoor fiasco - Lessons from the latest supply chain attack
14. (59:00) NVD’s slowdown - What’s at stake?

Show Notes

• CI/CD Goat (Deliberately vulnerable CI/CD environment): GitHub

• GitHub cache poisoning: Cacheract Attack | ScribeSecurity

• Your GitHub Secrets in Plain Text: CloudThrill

• Ghat tool (Updating dependencies in GitHub Actions): GitHub

• OpenSSF Scorecard: Website

• The GitHub Worm (Asi Greenholts): Palo Alto Blog

• OWASP Top 10 CI/CD Risks: OWASP

• Heartbleed OpenSSL Exploit: Wikipedia

🎙About Steve Giguere:

• ⁠⁠⁠⁠Website: stevegiguere.com

• LinkedIn: Steve Giguere

• Book: Cloud Native Application Protection Platforms – O'Reilly

• Personal Blog: Codifyre

• Talk Lessons Learned from OSS and GitOps Journey: YouTube

• OWASP Lisbon Talk: YouTube

• StayWiredIn YouTube Show: StayWiredIn

• DevSecOps Podcast: Spotify

👨🏽‍🚀 Welcome to Episode 05 of "Tech Beats unplugged"

This time, we tried something completely crazy – we're letting the AI hosts take over! That's right 😎. We're flipping the script and giving the AI the mic to guide us through the fascinating world of local LLMs. but that's not all as this episode is actually inspired by my recent talk at Oracle Cloud World in Vegas. The topic? You guessed it: Local LLMs in the cloud.

🌟 We’re so excited to share our latest tech Beats show with you🧡!

We hope you'll enjoy it!!!

Topics discussed:

Show Notes

👨🏽‍🚀 Welcome to Episode 04 of "Tech Beats unplugged"

This time, we dared to tackle the big, yet exciting topic which is "𝐍𝐞𝐭𝐰𝐨𝐫𝐤𝐢𝐧𝐠 𝐢𝐧 𝐭𝐡𝐞 𝐜𝐥𝐨𝐮𝐝", and to help us with this challenge we summoned our expert and networking GURU "Jose Moreno" all the way from Munich Germany.

As an Azure Principal Engineer at Microsoft, he comes to share his knowledge and demystify all those mysterious networking concepts, answering questions you never dared to ask in the universe of SDN and cloud networking😀( SDWAN, Hub&Spoke, migrations, Cloud lies, you name it).

We hope you'll enjoy it!!!

Topics discussed:

Show Notes

Jose Moreno:

👨🏽‍🚀 Welcome to Episode 03 of "Tech Beats unplugged"

This time, we have been incredibly honored and fortunate to host one of the most prolific speakers, storyteller, and thought leader of his generation. He was kind enough to bless us with his presence for an exclusive interview filled with priceless wisdom and life hacks💡. 

Beyond his groundbreaking contributions to Kubernetes, Cloud Native and Open-Source software, he's been one the most influential figures in the tech industry over the past decade.

Today, despite his retirement, he continues to inspire engineers across the world to build smarter, scalable, and highly usable systems🌟.

We’re so excited to share our privileged exchange with the one and only, Kelsey HighTower🧡!

We hope you'll enjoy it!!!

Topics discussed:

Show Notes

Crunchbase news:

👨🏽‍🚀 Welcome to Episode 02 of "Tech Beats unplugged"

This time , we'll explore how,  the open source community, and rebuilders are coping with Redhat's decision to close their source.. And what it means for the future of enterprise Linux? 

Topics discussed:

Show Notes

Although OPEN LA announcements we're already known by the public we decided to keep the chronology of events in our talk because it was recorded 2 days after it happened.

Links:

Open Enterprise Linux Association (OELA):

👨🏽‍🚀 Welcome to the first Episode of "Tech Beats unplugged" Today's session is all about the thrilling "Open Source Debate - Part One." Joining us as a special guest is Erik Benner, the VP of Enterprise Transformation at Mythics .

Erik brings a wealth of experience to our discussion, having used and sold RedHat  over the years but also expert in another enterprise Linux distro and helped customers manage their license and migrate when needed.

💡Together,  we'll venture into the heart of the recent

Topics discussed:

Show Notes

Although the most recent developments weren't completely covered in part 1 we decided to stay faithful to the chronology of events while keeping the episode under 50 minutes. Part 2 will cover the rest.

Links:

Open source definition and GPL: