Eye On A.I.

This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more.

Download NetSuite's popular KPI Checklist, designed to give you consistently excellent performance - absolutely free at NetSuite.com/EYEONAI

On episode #152 of Eye on AI, Craig Smith sits down with Alex Kendall, founder and CEO of Wavye, a company building autonomous vehicle technology using AI.

In this episode, Alex provides an inside look at Wavye's approach to autonomous driving, which leverages world models and reinforcement learning to create an AI "driver" that can understand complex urban environments. Alex explains how world models allow an AI system to imagine multiple futures before acting, enabling safer decision-making, and shares Wavye's progress on deploying autonomous delivery vehicles with partners in the UK.

We also dive into the differences between world models and large language models, the unique data challenges of perception-based AI, and Wave's ambitions to expand this AI technology to new applications like humanoid robotics.

If you enjoyed this podcast, please consider leaving a 5-star rating on Spotify and a review on Apple Podcasts.

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview, Introduction and Netsuite

(03:45) The Advantages of World Models

(10:12) Developing Autonomous Driving Technology

(16:35) Partnership with Microsoft and Training Challenges

(21:10) Decoding the Concept of Generalization in Autonomous Driving

(27:08) Compute Requirements and Infrastructure

(32:45) The Role of Azure in Training

(37:12) What Is Tokenization of Data

(41:47) Addressing Compute Constraints

(46:12) Future Applications of World Models and Open Source

This episode is sponsored by Celonis ,the global leader in process mining. AI has landed and enterprises are adapting. To give customers slick experiences and teams the technology to deliver. The road is long, but you're closer than you think. Your business processes run through systems. Creating data at every step. Celonis reconstructs this data to generate Process Intelligence. A common business language. So AI knows how your business flows. Across every department, every system and every process. With AI solutions powered by Celonis enterprises get faster, more accurate insights. A new level of automation potential. And a step change in productivity, performance and customer satisfaction Process Intelligence is the missing piece in the AI Enabled tech stack.

Go to https://celonis.com/eyeonai to find out more.

Welcome to episode 151 of the 'Eye on AI' podcast. In this episode, host Craig Smith sits down with Asa Cooper, a postdoctoral researcher at NYU, who is at the forefront of language model safety.

This episode takes us on a journey through the complexities of AI situational awareness, the potential for consciousness in language models, and the future of AI safety research.

Craig and Asa delve into the nuances of AI situational awareness and its distinction from sentience. Asa, with his rich background in NLP and AI safety from Edinburgh University, shares insights from his post-doc work at NYU, discussing collaborative efforts on a paper that has garnered attention for its take on situational awareness in large language models (LLMs).

We explore the economic drivers behind creating AI with such capabilities and the role of scaling versus algorithmic innovation in achieving this milestone. We also delve into the concept of agency in LLMs, the challenges of post-deployment monitoring, and the effectiveness of current measures in detecting situational awareness.

To wrap things off, we break down the importance of source trustworthiness and the model's ability to discern reliable information, a critical aspect of AI safety and functionality, so make sure to watch till the end.

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview and Introduction

(02:30) Asa's NLP Expertise and the Safety of Language Models

(06:05) Breaking Down AI's Situational Awareness

(13:44) Evolution of AI: Predictive Models to AI Coworkers

(20:29) New Frontier in AI Development?

(27:14) Measuring AI's Awareness

(33:49) Innovative Experiments with LLMs

(40:51) The Consequences of Detecting Situational Awareness in AI

(44:07) How To Train AI On Trusted Sources

(49:52) What Is The Future of AI Training?

(56:35) AI Safety: Public Concerns and the Path Forward**

This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.

If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai

Welcome to episode 150 of the 'Eye on AI' podcast. In this episode, host Craig Smith sits down with Yann LeCun, a Turing Award winner who has been instrumental in advancing convolutional neural networks and whose work spans machine learning, computer vision, and more.

Tune is as Craig and Yann explore the intricacies of AI, world models, and the challenges of continuous learning.

In this episode, Yann delves deep into the concept of a "world model" - systems that can predict the world's future states, allowing agents to make informed decisions. The discussion transitions to the challenges of training these models, particularly when dealing with diverse data like text and images. We then discuss the computational demands of modern AI models, with Yann highlighting the nuances between generative models for videos and language.

He also touches upon the idea of the "Embodied Turing Tests" and how augmented language models can bridge the gap between human-like behavior and computational efficiency.The spotlight then shifts to pressing concerns surrounding the open-source nature of AI models, with Yann articulating the legal ramifications and the future of open-source AI. Drawing from global perspectives, including China's stance on open-source, Yann underscores the imperative for a collaborative approach in the AI space, ensuring it's reflective of diverse global needs.

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview, Oracle and Introduction

(02:42) Decoding The World Model and Gaia 1

(07:43) Energy and Computational Demands of AI

(08:06) Video vs. Text Processing & True AI Capabilities

(11:17) Embodied Turing Test & Augmented LLMs

(15:38) Is AI a Threat To Society?

(25:04) Where is AI Development Headed?

(31:06) Interplay of Neuroscience and AI**

(33:33) Yann's Vision, JEPA, and Learning Challenges

(39:05) Yann's Career, AI Progress, and Challenges

(44:47) The Open Source Debate in AI

(55:30) Oracle Cloud Infrastructure

This episode is sponsored by Digimarc, the leader in digital watermarking. Digimarc digital watermarks invisibly guard your digital assets to protect against misuse, prove copyright ownership, and verify authenticity. In an era of artificial intelligence, don't leave your images and other digital content exposed. Demand superior content protection and maintain trust in your brand with Digimarc.

Checkout Digimarc - https://www.digimarc.com/

This episode is sponsored by Celonis ,the global leader in process mining. AI has landed and enterprises are adapting. To give customers slick experiences and teams the technology to deliver. The road is long, but you're closer than you think. Your business processes run through systems. Creating data at every step. Celonis recontrusts this data to generate Process Intelligence. A common business language. So AI knows how your business flows. Across every department, every system and every process. With AI solutions powered by Celonis enterprises get faster, more accurate insights. A new level of automation potential. And a step change in productivity, performance and customer satisfaction Process Intelligence is the missing piece in the AI Enabled tech stack.

Visit Celonis- https://celonis.com/eyeonai

Welcome to episode 149 of the 'Eye on AI' podcast. In this episode, host Craig Smith sits down with Alex Klein, the Cofounder & CEO of STEM and Kano Computing, who boasts an illustrious academic background from Cambridge and Yale.

Alex recalls his transition from journalism to creating STEM kits for children and unveils the inception story of the STEM player, a pioneering music product co-developed with Kanye West. As the conversation progresses, Alex delves deep into his academic experiences, focusing on his economic research at Cambridge, and his venture into the tech world. Emphasizing hands-on tech experiences, Alex discusses the manufacturing processes, and the origin story of KANO - designed to make Raspberry Pi more user-friendly.

Alex describes his unexpected encounter with Kanye West at the Consumer Electronics Show (CES) and their subsequent collaborations. The nuances of their flagship product, the STEM player, giving listeners an insight into how it revolutionizes music listening. Alex also gives us a sneak peek into their upcoming product, STEM 2, and sheds light on the company's future trajectory, emphasizing their commitment to redefining the music and audio space over the next three years.

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

00:00 Preview, Celonis and Digimarc Ad

02:11 Origins of Kano & Alex's Stint with Journalism

04:47 The Evolution of Stem Player

12:55 Alex' Educational & Philosophical Foundations

15:13 Kanye Collaboration

21:24 Deep Dive into Audio & STEM's Technology

27:26 Future of Stem Player

37 02 Revolutionizing Music & Audio Experience Through Hardware

43:22 Innovations in AI & its Use Case Horizons

This epsiode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.

If you want to do more and spend less like Uber and Cohere - take a free test drive of OCI at oracle.com/eyeonai

Welcome to episode 148 of the 'Eye on AI' podcast. In this episode, host Craig Smith sits down with Ahmed Imtiaz, a PhD student from Rice University working on deep learning theory and generative modeling. Ahmed is currently spearheading his research at Google, exploring the dynamics of text-to-image generative models.

In this episode, Ahmed sheds light on the concept of synthetic data, emphasizing the delicate equilibrium between real and algorithmically generated data. We navigate the complexities of model autophagy disorder (MAD) in generative AI,highlighting the potential pitfalls that models can fall into when overly reliant on their own generated data.

We also go through AI capabilities in lesser-explored languages, with Ahmed passionately sharing about his initiative "Bengali AI" aimed at advancing AI proficiency in the Bengali language. Ahmed introduces pioneering strategies to differentiate and manage synthetic data.

As we wrap up, Ahmed and I deliberate on the merits and challenges of open-sourcing formidable AI models. We grapple with the age-old debate of transparency versus performance, juxtaposed against the backdrop of potential risks.

Dive into the world of AI, synthetic data, and deep learning and join the discussion with Ahmed Imtiaz, as we tackle some of the most pressing issues the AI community is facing today.

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview and Oracle ad

(02:56) Ahmed's Academic Journey

(04:14) The Challenge of Non-English AI

(06:34) Model Autophagy Disorder Explained

(14:40) Internet Content: AI's Growing Involvement

(21:08) The New Age of Data Collection

(26:28) AI's Role in Protecting Digital Assets

(38:51) Open-Source vs Proprietary Model Debate

This episode is sponsored by Crusoe. Crusoe Cloud is a scalable, clean, high-performance cloud, optimized for AI and HPC workloads, and powered by wasted, stranded or clean energy. Crusoe offers virtualized compute and storage solutions for a range of applications - including generative AI, computational biology, and rendering.

Visit https://crusoecloud.com/ to see what climate-aligned computing can do for your business

This episode is sponsored by Celonis ,the global leader in process mining. AI has landed and enterprises are adapting. To give customers slick experiences and teams the technology to deliver. The road is long, but you're closer than you think. Your business processes run through systems. Creating data at every step. Celonis recontrusts this data to generate Process Intelligence. A common business language. So AI knows how your business flows. Across every department, every system and every process.

Go to https:/celonis.com/eyeonai/ to find out more.

Welcome to episode 147 of the Eye on AI podcast. In this episode, host Craig Smith sits down with Yilna Du, a final year PhD student at MIT EECS with a background in research at leading institutions like OpenAI, FAIR, and Google Deepmind.

Yilun's extensive expertise spans generative models, decision making, robot learning, and embodied agents, making him a valuable voice in the AI domain.

Our conversation kicks off with a brief on Yilun's academic journey, leading into a deep dive into Reinforcement Learning with AI feedback (RLHF) - its history, inception, and challenges. We then touch upon the effectiveness of RLHF, the intriguing concept of multi-agent debate, and the PAPES procedure.

Craig and Yilun further explore the vast realm of AI, debating the gaps between open-source and proprietary models, the need for more compute resources, and the future of robotics interlaced with AI. Yilun provides a glimpse into his vision of decentralized AI systems, contrasting the industry's commercial trajectory with academia.

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview, Celonis and Crusoe Ad

(04:06) Yilun's Academic Background

(05:52) Origin and Applications of RLHF

(12:16) ROHF and the Multi-Agent Debate Method

(17:32) AI Model Interaction without Human Intervention?

(20:41) Applicability and Inconsistency Detection

(28:43) The Future of AI Training

(45:26) Robotics and Decentralized AI Systems

This episode is sponsored by Celonis ,the global leader in process mining. AI has landed and enterprises are adapting. To give customers slick experiences and teams the technology to deliver. The road is long, but you're closer than you think. Your business processes run through systems. Creating data at every step. Celonis recontrusts this data to generate Process Intelligence. A common business language. So AI knows how your business flows. Across every department, every system and every process. With AI solutions powered by Celonis enterprises get faster, more accurate insights. A new level of automation potential. And a step change in productivity, performance and customer satisfaction Process Intelligence is the missing piece in the AI Enabled tech stack.

Go to https:/celonis.com/eyeonai to find out more. Welcome to episode 146 of the Eye on AI podcast. In this episode, host Craig Smith sits down with Viren Jain, a leading Research Scientist at Google in Mountain View, California. Viren, at the helm of the Connectomics team, has pioneered breakthroughs in synapse-resolution brain mapping in collaboration with esteemed institutions such as HHMI, Max Planck, and Harvard.

The conversation kicks off with Jain introducing his academic journey and the evolution of connectomics – the comprehensive study of neural connections in the brain. The duo delves deep into the challenges and advancements in imaging technologies, comparing their progression to genome sequencing. Craig probes further, inquiring about shared principles across organisms, the dynamic behavior of the brain, and the role of electron microscopes in understanding neural structures.

The dialogue also touches upon Google's role in the research, Jain's collaborative ventures, and the potential future of AI and connectomics. Viren also shares his insights into neuron tracing, the significance of combining algorithm predictions, the zebra finch bird's song-learning mechanism, and the broader goal of enhancing human health and medicine.

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview, Introduction and Celonis

(06:45) Viren's Academic and Professional Journey

(13:17) AI's Technological Progress and Challenges

(22:20) Deep Dive into Connectomics

(39:20) Google's Role in AI

(44:16) Natural Learning vs. AI Algorithms

(57:32) Brain Mapping: Present and Future

(01:00:33) Brain Studies for Medical Advancement

(01:06:05) Final Reflections and Celonis ad

This episode is sponsored by Shopify. Shopify is a commerce platform that allows anyone to set up an online store and sell their products. Whether you're selling online, on social media, or in person, Shopify has you covered on every base. With Shopify you can sell physical and digital products. You can sell services, memberships, ticketed events, rentals and even classes and lessons.

Sign up for a $1 per month trial period at http://shopify.com/eyeonai

On episode #145 of Eye on AI, Craig Smith sits down with Riley McCormack, President and CEO of Digimarc, pioneers in digital watermarking and cloud-based product data.

In this episode, we explore the critical role of digital watermarking in securing our digital assets, especially amidst the surging influence of AI. Riley guides us through the potential risks and benefits this technology brings to the forefront as AI continues to transform our digital world.

We then navigate the intricate territories of NFTs and distributed ledger technology, understanding how digital watermarking is reshaping these fields by ensuring trust and authenticity. Our discussion also delves into the Digital Millennium Copyright Act of 1997, highlighting its relevance in upholding copyrights and fostering trust within the digital stratosphere.

We conclude with a look at how digital watermarking impacts content creation and its role in shaping a secure and sustainable digital future, from collaborations with central banks to innovative products like Digimarc Recycle.

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

00:00 Preview, Introduction and Shopify

03:05 Introduction to Digital Watermarking

07:01 Evolution of Digital Watermarking

14:21 Digimarc's Role in Digital Watermarking

21:13 Exploring the Protection Of Digital Content

28:56 Key Characteristics of Digital Watermarking

35:12 Application and Implementation of Digital Watermarking

42:46 Watermarking in Blockchain

49:11 What is Digimarc Validate?

01:03:01 Outro and Shopify

This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more.

Download NetSuite's popular KPI Checklist, designed to give you consistently excellent performance - absolutely free at NetSuite.com/EYEONAI

On episode #144 of Eye on AI, Craig Smith sits down with Matt Hicks, President and CEO of Red Hat, a leading provider of enterprise open source software solutions.

In this episode, Matt takes us through the evolution of Linux and the rise of the open source models. We explore how Red Hat's long-term support and predictable life cycles have empowered companies to embrace Linux. Additionally, we delve into the transformative potential of deploying open source software alongside proprietary solutions and examine the challenges and opportunities that lie ahead for open source in the realm of generative AI.

To wrap things up,as we discuss the importance of efficiency, cost constraints, and specialized models for businesses, all while navigating the ongoing debate on general-purpose AI and the risks and rewards it brings.

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview,Introduction & Netsuite

(03:11) The Role of OS in Tech

(08:06) Red Hat, Open Source, and Generative AI

(16:12) Large Language Models and Building Foundations

(24:18) AI: Commoditization, Frontier, & Hardware Predictions

(32:24) Open Source AI a Dual-Edged Sword?

(40:30) Regulatory Aspects & Red Hat's Future Directions

(48:36) IBM's Acquisition of Red Hat

(55:21) Outro & Netsuite by Oracle

This episode is sponsored by Crusoe. Crusoe Cloud is a scalable, clean, high-performance cloud, optimized for AI and HPC workloads, and powered by wasted, stranded or clean energy. Crusoe offers virtualized compute and storage solutions for a range of applications - including generative AI, computational biology, and rendering.

Visit crusoecloud.com to see what climate-aligned computing can do for your business.

On episode #143 of Eye on AI, Craig Smith sits down with Scott Aaronson, Schlumberger Centennial Chair of Computer Science at The University of Texas and director of its Quantum Information Center.

In this episode, we cut through the quantum computing hype and explore its profound implications for AI. We reveal the practicality of quantum computing, examining how companies are leveraging it to solve intricate problems, like vehicle routing, using D-Wave systems. Scott and I delve into the distinctions between quantum annealing and Grover-type speedups, shedding light on the potential of hybrid solutions that blend classical and quantum elements.

Shifting gears, we delve into the synergy between quantum computing and AI safety. Scott shares insights from his work at OpenAI, particularly a project aimed at fine-tuning language models like GPT for detecting AI-generated text, highlighting the implications of such advanced AI technology's potential misuse.

If you enjoyed this podcast, please consider leaving a 5-star rating on Spotify and a review on Apple Podcasts.

Craig Smith's Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview and Introduction

(04:13) Demystifying Quantum Computing

(16:04) Leveraging Quantum Computers for Optimization

(31:01) What is Quantum Computing?

(42:40) Advancements and Challenges in Quantum Computing

(54:57) Machine Learning and AI Safety