In this episode of the Entropy Podcast, host Francis Gorman engages with Jimmy White, CTO and president of Calypso AI, discussing the evolving landscape of generative AI, the implications of new technologies like DeepSeek, and the current outlook around regulation in the AI sector. They explore the challenges of data integrity, the risks associated with AI-generated content, and the innovations in AI security. The conversation also touches on geopolitical pressures affecting AI development and predictions for the future of agent technology in the industry.

Takeaways

• Generative AI prompts should be direct and clear.
• DeepSeek has both security concerns and hype surrounding it.
• The US and EU are navigating a complex regulatory landscape.
• Self-regulation in AI is becoming increasingly important.
• Data integrity is crucial to avoid garbage in, garbage out.
• Synthetic data can lead to poor decision-making in enterprises.
• AI models are at risk of ingesting incorrect data.
• The rise of agent technology will change the security landscape.
• Companies need to be aware of the threats posed by generative AI.
• The future of AI will require careful consideration of ethics and security.

Discover the unexpected synergy between safety and security engineering as I chat with Dr. Bob Oates, Associate Director at Cambridge Consultants. Prepare to learn how these often considered distinct fields align in their ultimate mission to prevent harm. Bob takes us on an insightful journey, sharing insights across his distinguished career, Bob leverages a fantastic example of the groundbreaking project delivering the world’s first commercial remotely operated ship he worked on whilst with Rolls Royce to bring the topic to life. We also unravel the vital role of systems engineering in managing risks and ensuring seamless communication among diverse teams.

Together, we explore the many considerations of safety and security in industries where the stakes are high, like shipping, aviation, and finance. We also speak around developments in post-quantum cryptography, to understand potential threats such as "harvest now, decrypt later" and the necessity of updating cryptographic practices. Bob and I emphasize the importance of preparing for these advancements, drawing parallels with safety systems to highlight the need for traceability and effective stakeholder communication. 

Takeaways

• Safety and security aim to prevent harm, whether accidental or malicious.
• Quality is the foundation of both safety and security.
• Systems engineering is crucial for connecting safety and security disciplines.
• Remote operations introduce unique safety and security challenges.
• Connectivity is a critical component for safety in remote systems.
• The integration of safety and security can lead to complex design challenges.
• Cryptography is essential for maintaining security in operational technology.
• Quantum computing poses new threats to traditional cryptographic methods.
• There is a skills shortage in both security and safety engineering fields.
• Understanding the value of cryptography is vital for stakeholder engagement.