In this episode of The Inference Show, we are joined by Dr. Manish Gupta, a leading expert in AI training, GPU performance, and compiler optimization. Manish brings a wealth of experience from his work at Magic, Meta, Google, NVIDIA, AMD, and Qualcomm, where he has been at the forefront of scaling custom compute systems, optimizing large language models, and pioneering GPU innovations.

Manish takes us on a journey through his career and dives deep into the cutting edge of AI infrastructure, discussing:

• His early experiences with low-level assembly programming and how it shaped his approach to GPU optimization.
• Insights from working on NVIDIA’s Cutlass project, which powers nearly every major AI training pipeline today.
• The bottlenecks in scaling massive models like LLaMA, including precision trade-offs and checkpointing strategies.
• How test-time compute and reinforcement learning are redefining the future of inference and model performance.
• Why programmability and software-hardware co-design are key for emerging AI accelerators.
• The evolution of GPU architecture from Volta to Blackwell and what it means for developers.
• His vision for the future of AI-driven code generation and automated kernel development.

—

Manish’s work has directly influenced AI training and inference at scale, with his contributions now used by every major company developing foundational models. From building core libraries to optimizing for cutting-edge hardware, he offers a rare perspective on where AI infrastructure is heading and the deep technical challenges ahead.

—

About Dr. Manish Arora

Dr. Arora is the co-founder of LearnDesk and Insaito, where he leads marketing and sales. He has grown LearnDesk into a global platform supporting over 25,000 businesses and is now focused on Automatan, an AI platform for automating business workflows. With 80+ patents and decades of industry experience, Dr. Arora brings deep technical and strategic insights to every conversation.

—

The Inference Show

Stay connected with us and explore more about our guests, topics, and future episodes:

🔗 Manish Gupta: LinkedIn

🔗 Automatan: LinkedIn

🔗 Insaito: LinkedIn

🔗 Dr. Manish Arora: LinkedIn

🔗 Vivek Puri: LinkedIn

🔗 LearnDesk: Website

🔗 Insaito: Website

—

Be our next guest by emailing us at [email protected]

We’d love to hear your insights and have you join the conversation!

In this episode, we talk with Josh Stock, an award-winning middle school teacher who’s changing how kids experience learning through storytelling, creativity, and technology.

For 18 years, Josh has built a classroom where students don’t just read and write — they create podcasts, design VR spaces, produce videos, and tell their own stories. His focus is on helping every student find their voice, build confidence, and take ownership of their learning.

Josh shares:

⬛ His journey from growing up in Kansas surrounded by educators to becoming a nationally recognized leader in education and technology.

⬛ The rituals he uses to create connection and excitement in his classroom.

⬛ Why storytelling is central to his teaching — and how it helps students engage deeply with lessons.

⬛ The turning point when he realized technology could transform learning, from blogging to robotics to VR.

⬛ His honest take on AI in schools — its benefits, its risks, and how it’s reshaping classrooms.

⬛ The biggest challenges teachers face today, from resources to balancing tech with personal connection.

Josh Stock is a middle school educator from Olathe, Kansas, known for blending traditional literacy with modern technology to engage students in new ways. His innovative approach has earned him national recognition, including the National School Boards Association’s “20 to Watch” award, ISTE’s Make It Happen Award, and the Emerging Young Educator Award.

Josh is the author of Awesome Sauce and a contributor to Edutopia and EdTech Magazine. Whether he’s coaching robotics, exploring virtual reality, or guiding students through creative projects, Josh’s mission is simple: to create classrooms where every learner feels empowered to share their voice and ideas.

—

About Dr. Manish Arora

Dr. Arora is the co-founder of LearnDesk and Insaito, where he leads marketing and sales. He has helped grow LearnDesk into a global platform supporting over 25,000 businesses. Currently, he is developing Automatan, an AI platform for automating business workflows. With 80+ patents and years of industry experience, Dr. Arora brings deep technical expertise and practical insights to every conversation.

—

The Inference Show

Stay connected with us and explore more about our guests, topics, and future episodes:

🔗 Automatan: https://www.linkedin.com/company/automatan-ai🔗 Insaito: https://in.linkedin.com/company/insaito-inc🔗 Dr. Manish Arora: https://www.linkedin.com/in/manish7901🔗 Vivek Puri: https://www.linkedin.com/in/vivpuri🔗 LearnDesk: https://www.learndesk.us/🔗 Insaito: https://www.insaito.com/🔗 Josh Stock: https://www.linkedin.com/in/mrstockrocks/

—

Be our next guest by emailing us at [email protected]We’d love to hear your insights and have you join the conversation!

In this episode, we sit down with Sanjeev Jha, a visionary leader in digital transformation and enterprise AI, whose career spans global giants like Amazon, Salesforce, McKinsey, Motorola, and Genentech. Sanjeev brings a unique perspective on how AI can reshape marketing, operations, and customer experience at scale.

He shares powerful stories and insights, including:

⬛ His journey from brand management at Marico and PepsiCo to leading global AI-driven strategies at Amazon and Salesforce

⬛ How he built and scaled Amazon Kindle India, driving massive growth through data-driven decisions and innovation

⬛ The core principles of leading enterprise-wide transformations, from defining problems to aligning teams and stakeholders

⬛ Real-world examples of AI in healthcare, including secure patient data flows, compliance, and improving patient journeys

⬛ Why data ownership, operating models, and human-in-the-loop systems are crucial for scaling AI safely

⬛ The difference between everyday AI vs. true enterprise AI — and how to design role-specific, outcome-driven AI agents

⬛ The biggest barriers that prevent AI pilots from scaling into production and how leaders can overcome them

⬛ His vision for a future where AI reshapes the customer journey, compresses approval cycles, and delivers measurable business outcomes

Sanjeev’s journey spans consumer goods, consulting, technology, and healthcare, giving him a uniquely well-rounded view of how businesses grow and adapt. He has launched new ventures inside global companies, built teams that bridge strategy and execution, and navigated complex challenges across both fast-moving and highly regulated industries.

Having worked at various Fortune 500 companies, Sanjeev combines the rigor of consulting with the creativity of entrepreneurship. His work reflects a deep focus on driving measurable outcomes, whether it’s scaling digital businesses, modernizing customer engagement, or transforming operations for the next era of growth.

—

About Dr. Manish Arora

Dr. Arora is the co-founder of LearnDesk and Insaito, where he leads marketing and sales. He has helped grow LearnDesk into a global platform supporting over 25,000 businesses. Currently, he is developing Automatan, an AI platform for automating business workflows. With 80+ patents and years of industry experience, Dr. Arora brings deep technical expertise and practical insights to every conversation.

—

The Inference Show

Stay connected with us and explore more about our guests, topics, and future episodes:

🔗 Automatan: https://www.linkedin.com/company/automatan-ai

🔗 Insaito: https://in.linkedin.com/company/insaito-inc

🔗 Dr. Manish Arora: https://www.linkedin.com/in/manish7901

🔗 Vivek Puri: https://www.linkedin.com/in/vivpuri

🔗 LearnDesk: https://www.learndesk.us/

🔗 Insaito: https://www.insaito.com/

🔗 Sanjeev Jha: https://www.linkedin.com/in/sanjeev-jha-effective-inspiring/

—

Be our next guest by emailing us at [email protected]

We’d love to hear your insights and have you join the conversation!

In this episode, we are joined by Josh Marmolejo, a mechanical engineer turned award-winning educator from Clint High School in Texas. Josh has transformed hands-on learning in his community and was recently honored with the 2024–25 Milken Educator Award, placing him among the nation’s most influential K-12 teachers .

He takes us through his inspiring journey from tinkering with go-karts to shaping the future of career and technical education (CTE), and talks about:

⬛ How a childhood love of problem-solving and engineering evolved into a teaching career he never planned for—but fully embraced

⬛ The emotional side of teaching, from burnout to building deep bonds with students and parents

⬛ Why classroom culture and rapport matter more than rigid routines in unlocking student success

⬛ How digital portfolios and social media have become powerful tools for student growth, confidence, and employability

⬛ The role of AI in education—from schematics and lesson planning to teaching students how to use it responsibly and ethically

⬛ Inspiring real-world success stories of students who went from not knowing what a wrench was to working in advanced automotive and heavy equipment careers

⬛ His vision for the next 10–20 years of education, where building real things, creativity, and technology blend to prepare students for the future

Josh’s journey is proof that real-world skills and human connection can reshape education. From turning shop projects into digital portfolios that land students jobs, to weaving AI into hands-on automotive training, he shows how innovation in the classroom can ripple out to families, communities, and industries.

—

About Dr. Manish Arora

Dr. Arora is the co-founder of LearnDesk and Insaito, where he leads marketing and sales. He has helped grow LearnDesk into a global platform supporting over 25,000 businesses. Currently, he is developing Automatan, an AI platform for automating business workflows. With 80+ patents and years of industry experience, Dr. Arora brings deep technical expertise and practical insights to every conversation.

—

The Inference Show

Stay connected with us and explore more about our guests, topics, and future episodes:

🔗 Automatan: https://www.linkedin.com/company/automatan-ai

🔗 Insaito: https://in.linkedin.com/company/insaito-inc

🔗 Dr. Manish Arora: https://www.linkedin.com/in/manish7901

🔗 Vivek Puri: https://www.linkedin.com/in/vivpuri

🔗 Josh Marmolejo: https://www.linkedin.com/in/josh-marmolejo-1a3861258/

🔗 LearnDesk: https://www.learndesk.us/

🔗 Insaito: https://www.insaito.com/

—

Be our next guest by emailing us at [email protected]

We’d love to hear your insights and have you join the conversation!

In this episode, we are joined by Dr. Siddhartha (Sid) Nath, Principal Machine Learning Scientist at Intel and Adjunct Faculty at Northeastern and Santa Clara University. He takes us through his remarkable journey at the intersection of AI, chip design, and semiconductor innovation and talks about:

• How his unconventional background in Indian classical music sharpened his approach to solving complex engineering problems
• The pivotal role of power management in shaping early GPU/CPU innovation and battery life breakthroughs
• How deep learning reshaped electronic design automation (EDA) and opened new possibilities in chip design
• Why verification is one of the biggest open frontiers for AI in hardware today
• How conjoint optimization can redefine performance, timing, and power trade-offs in semiconductors
• His vision for digital twins and AI agents that empower “vertical engineers” to bridge RTL, physical design, and sign-off seamlessly
• Why open-source tools and data models are becoming essential to the future of semiconductor design

Sid brings a unique perspective shaped by a career at the crossroads of industry, research, and teaching. He has driven innovations across global tech leaders like NVIDIA, Synopsys, and Broadcom, and continues to mentor the next generation of engineers through his teaching roles at Northeastern and Santa Clara University. With a PhD from UC San Diego, his work is widely recognized for pushing the boundaries of how AI and advanced algorithms are applied to real-world chip design challenges.

—

About Dr. Manish Arora

Dr. Arora is the co-founder of LearnDesk and Insaito, where he leads marketing and sales. He has helped grow LearnDesk into a global platform supporting over 25,000 businesses. Currently, he is developing Automatan, an AI platform for automating business workflows. With 80+ patents and years of industry experience, Dr. Arora brings deep technical expertise and practical insights to every conversation.

—

The Inference Show

Stay connected with us and explore more about our guests, topics, and future episodes:

🔗 Automatan: https://www.linkedin.com/company/automatan-ai

🔗 Insaito: https://in.linkedin.com/company/insaito-inc

🔗 Dr. Manish Arora: https://www.linkedin.com/in/manish7901

🔗 Vivek Puri: https://www.linkedin.com/in/vivpuri

🔗 LearnDesk: https://www.learndesk.us/

🔗 Insaito: https://www.insaito.com/

Episode 1:

In this episode, Sayre Posey, Utah’s 2025 Teacher of the Year, shares her experience teaching at a diverse middle school in Salt Lake City. She talks about:

• How reenactments and National History Day projects bring history to life

• Why equity is a design principle in her classroom

• How she fosters belonging through collaborative projects and community partnerships

• The role of technology and AI in enhancing education

• Why empowering student voice is key to the future of democracy

Sayre Posey is a nationally recognized history educator who challenges students to explore identity and question historical narratives. Her teaching focuses on equity, belonging, and using technology to enhance human connection in the classroom.

Dr. Manish Arora is the co-founder of LearnDesk and Insaito, where he leads marketing and sales. He has helped grow LearnDesk into a global platform supporting over 25,000 businesses. Currently, he is developing Automatan, an AI platform for automating business workflows. With 80+ patents and years of industry experience, Dr. Arora brings deep technical expertise and practical insights to every conversation.

Contents of this video:

0:00 - Intro0:33 - Coming Up…1:06 - About Sayre Posey1:57 - Inspiration to become a teacher4:25 - Sayre’s Grandfather5:42 - Sayre’s Mother as a Kindergarten Teacher6:43 - Changing majors from Social Work to Education7:19 - Teaching at Baltimore9:40 - First year of teaching12:32 - Yearly pass rate doubling in Sayre’s classroom14:43 - Work Life Balance15:50 - Teaching middle school at North West18:29 - Student Belonging21:03 - Empowering Students23:02 - Diversity in the classroom26:18 - Reenacting History27:15 - Deciding which voices to center in the classroom30:35 - Crime Scene Reenactment31:57 - Sayre’s drive behind reenactments33:21 - Equity as a design principle36:02 - Master’s Thesis and Project based learning38:05 - Technology in the classroom41:45 - AI and student plagiarism43:46 - Power of AI45:45 - AI Concerns47:01 - Trends of the future49:35 - Learning better with pen and paper51:03 - Key skill to learn from history lessons52:33 - Being a leader in education55:48 - Speaking to donors, teachers, districts and governments1:02:11 - Final thoughts

The Inference Show

Stay connected with us and explore more about our guests, topics, and future episodes:

🔗 Automatan: https://www.linkedin.com/company/automatan-ai

🔗 Insaito: https://in.linkedin.com/company/insaito-inc

🔗 Dr. Manish Arora: https://www.linkedin.com/in/manish7901

🔗 Vivek Puri: https://www.linkedin.com/in/vivpuri

🔗 LearnDesk: https://www.learndesk.us/

🔗 Insaito: https://www.insaito.com/

Be our next guest by emailing us at [email protected]