
Sign up to save your podcasts
Or


Are your AI agents unreliable? In this guide, we reveal a professional system for AI evals to help you build and ship better AI products, faster. Learn how to systematically test LLM performance, evaluate complex tool use, and improve multi-turn conversations. We break down the exact process for building a high-quality eval dataset, using milestones and minefields to track agent behaviour, and how to properly use an LLM as a judge without compromising quality. Stop guessing and start making real, measurable improvements to your AI today.
Check out Quotient AI
https://www.quotientai.co/
Sign up for A.I. coaching for professionals at: https://www.anetic.co
Get FREE AI tools
pip install tool-use-ai
Connect with us https://x.com/ToolUseAI
https://x.com/MikeBirdTech
https://x.com/freddie_v4
00:00:00 - intro
00:02:54 - Why You Need AI Evals
00:06:13 - How to Evaluate AI Agent Tool Use
00:29:24 - The Process for Building Your First Eval Dataset
00:42:44 - Using an LLM as a Judge The Right Way
Subscribe for more insights on AI tools, productivity, and AI evals.
Tool Use is a weekly conversation with AI experts brought to you by Anetic.
Sign up for A.I. coaching for professionals at: https://www.anetic.co
Unlock the secrets of better communication with AI! In this episode, we explore how to use AI for leadership development, enhance your communication skills, and improve user experience (UX) with AI tools. Innovator and author Ian Pilon (Cultivating Clarity) joins us to discuss the future of human-computer interaction beyond the simple chatbot. Learn how to leverage AI as a sparring partner, analyze your subconscious behaviors to become a more effective leader, and use contextual intelligence to get more from your prompts. We cover everything from building AI agents and organizing communities to the practical strategies for using large language models (LLMs) to overcome the blank page problem and prepare for difficult conversations.
Learn more about Ian Pilon:
https://www.linkedin.com/in/ianpilon/
Get FREE AI tools
pip install tool-use-ai
Connect with us
https://x.com/ToolUseAI
https://x.com/MikeBirdTech
https://x.com/IanTimotheos
00:00:00 - intro
00:01:09 - How Logistics & UX Inform AI Development
00:05:42 - The Future of UX in a World of AI
00:18:02 - Using AI as a Mirror for Better Leadership
00:33:43 - Sparring with AI: Role-Playing for Difficult Conversations
00:36:59 - The Power of Contextual Intelligence in AI
00:46:02 - How to Build a Local AI Community
Subscribe for more insights on AI tools, productivity, and communication.
Tool Use is a weekly conversation with AI experts brought to you by Anetic.
Sign up for A.I. coaching for professionals at: https://www.anetic.co
Unlock the power of your personal data with AI! This episode explores how AI can become your guardian angel for wellbeing, helping anticipate your needs by understanding your unique data. Michael Tiffany, CEO of Fulcra, joins us to discuss building trustworthy AI systems for sensitive human information, the importance of data sovereignty, and how platforms like Fulcra are de-siloing data from wearables like Apple Watch and Oura Ring. Discover insights on sleep optimization, unique data correlations, the future of agentic AI, and the critical need for individual control over personal data in an AI-driven world. We delve into data privacy, the potential of personalized recommendation algorithms, and how to ensure AI empowers rather than creates dependency.
Learn more about Fulcra:
https://www.fulcradynamics.com/
https://discord.gg/pwvzFDTr87
Join the world's largest privacy-preserving sleep study: https://www.fulcradynamics.com/studies/how-the-world-sleeps
Get FREE AI tools
pip install tool-use-ai
Connect with us
https://x.com/ToolUseAI
https://x.com/MikeBirdTech
https://x.com/kubla
00:00:00 - Will AI be your guardian angel?
00:00:42 - From Hacking to AI: Michael Tiffany's Journey & Fulcra's Data Sovereignty Mission
00:04:08 - Uncovering Hidden Insights: Apple Watch Noise & Sleep, Unique User Data Correlations
00:08:50 - Sleep Optimization Deep Dive: Tracking with Wearables, Supplements & Carb Timing
00:18:33 - Building Trustworthy AI: Data Privacy, User Control & Processing Sensitive Information
00:32:28 - The Future of Personal Data Monetization: Skepticism & Trading Data for Better UX
00:46:48 - AI Dependency vs. Empowering User Agency: Who Truly Benefits from Hyper-Optimization?
Subscribe for more insights on AI tools, productivity, and Data Sovereignty.
Tool Use is a weekly conversation with AI experts brought to you by Anetic.
Unlock the secrets to world-class developer experience for AI agents! Discover how to build powerful, reliable AI agents with Ahmad Awais, founder and CEO of Lang Base, a serverless platform revolutionizing AI development. We dive deep into overcoming complex tooling and steep learning curves, exploring AI primitives, and the groundbreaking AI coding agent, Chai, which builds other AI agents for you. Learn about agentic RAG, memory agents, scaling agent workflows, and the future of AI agent creation. Ahmad shares his journey from open-source contributor to AI innovator, and how Lang Base and Chai are tearing down barriers to innovation in the AI space. If you're building, designing, or dreaming of the next generation of AI, this episode is essential viewing.
Lang Base: https://langbase.com/
Chai: https://chai.new/
Sign up for A.I. coaching for professionals at: https://www.anetic.co
Get FREE AI tools
pip install tool-use-ai
Connect with us
https://x.com/ToolUseAI
https://x.com/MikeBirdTech
https://x.com/MrAhmadAwais
00:00:00 - Intro
00:00:46 - Ahmad Awais' Journey into AI & Open Source
00:09:03 - Deep Dive: Lang Base Chai - AI Agent Builder Explained
00:33:45 - Most Compelling AI Agents Built with Lang Base & Chai
00:36:32 - Principles for Great Developer Experience (DevEx) in AI Tooling
00:45:49 - Tools & Advice for Advanced AI Agent Development (ft. MCP)
00:51:04 - Bonus: Ahmad's Open Source Code on Mars with NASA
Subscribe for more insights on AI tools, productivity, and AI agents.
Tool Use is a weekly conversation with AI experts brought to you by Anetic.
Unlock the power of AI development and learn to build your own custom AI tools! In this episode, we dive deep into AI coding strategies with AI engineer Manuel Odendahl. Discover practical approaches to identify opportunities, leverage existing services like Cursor, Gemini, and Sonnet, and craft bespoke software solutions tailored precisely to your unique challenges. Whether you're a developer aiming to expand your toolkit or someone with a problem needing a fix, we teach the mindset and methods to build AI-powered tools yourself, solving those nagging day-to-day problems. Forget waiting for solutions; learn to create them with AI and transform your workflow, moving from detailed coding to high-level ideation and automation.
Sign up for A.I. coaching for professionals at: https://www.anetic.co
Get FREE AI tools
pip install tool-use-ai
Connect with us
https://x.com/ToolUseAI
https://x.com/MikeBirdTech
https://x.com/ProgramWithAi
00:00:00 intro
Subscribe for more insights on AI tools, productivity, and automation.
Tool Use is a weekly conversation with AI experts brought to you by Anetic.
Unlock the reality of AI agents in production! While the AI agent gold rush is on, many businesses and developers struggle to move beyond expectation. This episode dives deep into the three fundamental challenges of AI agents: observability, reliability, and performance. Discover actionable strategies to overcome these hurdles and deploy your AI agent to production with confidence. Learn how to effectively communicate your needs to your AI, avoid common pitfalls like context window overload, and implement effective AI agent evals and debugging processes. We explore building high-value vs. low-value agents, structuring prompts for clarity, and the future of interacting with these powerful AI tools. If you're building or considering AI agents, this conversation is packed with insights on making them truly work.
Learn more about Synth: https://www.usesynth.ai/
Sign up for A.I. coaching for professionals at: https://www.anetic.co
Get FREE AI tools
pip install tool-use-ai
Connect with us
https://x.com/ToolUseAI
https://x.com/MikeBirdTech
https://x.com/JoshPurtell
00:00:00 - intro
00:04:28 - Current & Upcoming Viable AI Agent Use Cases
00:08:11 - Common Pitfalls When Building AI Agents
00:13:32 - Strategies for Debugging Bad LLM Calls
00:21:46 - Enhancing AI Agent Observability
00:33:22 - AI Tooling: Build vs Buy Decision
00:38:51 - Choosing the Right LLM for Your Agent
Subscribe for more insights on AI tools, productivity, and AI agents.
Tool Use is a weekly conversation with AI experts brought to you by Anetic.
Unlock the secrets of AI music generation and learn how to turn a prompt into incredible songs! Discover groundbreaking AI tools that empower you to create incredible songs from simple text prompts. From Suno, to Udio, to Riffusion, we'll show you how AI is revolutionizing music creation, making it easier than ever to produce unique tracks. Generate Custom Songs For Any Occasion In Seconds – no musical experience needed! Dive into the future of music production and start making your own AI-generated masterpieces today. This guide explores the best AI music creators and text-to-music platforms.
Get Phlo's resources
https://aietalk.com/music
Get your free curated AI report from Anetic Daily Intelligence
Sign up at: https://www.anetic.co
Get FREE AI tools
pip install tool-use-ai
Connect with us
https://x.com/ToolUseAI
https://x.com/MikeBirdTech
https://x.com/YoungPhlo_
00:00:00 - Intro
00:00:46 - Phlo's Journey into AI Music & Python Automation
00:03:12 - The Evolution of AI Music Generation: ChatGPT Moment for Music?
00:08:24 - Comparing AI Music Tools: Suno vs. Udio vs. Riffusion
00:12:47 - Creative Control & Unique Features in AI Music Generation Tools
00:20:12 - Live Demo: Crafting an AI Song with Suno & Prompting Techniques
00:45:45 - Phlo's AI Music Resources, Workshop Materials & Further Learning
Subscribe for more insights on AI tools, productivity, and AI music.
Tool Use is a weekly conversation with AI experts brought to you by Anetic.
Is traditional AI Product Management becoming obsolete? Elina Lesyk, AI consultant and host of the AI Ketchup podcast, joins Tool Use to explore how AI is fundamentally reshaping the product management workflow. We dive into the necessary technical skills for AI PMs, whether AI prototyping tools like Bolt and V0 are replacing classic methods, essential AI UX design principles, and the core skills defining effective AI product leaders. Discover common AI implementation pitfalls, strategies for gathering user feedback for AI products, and how to identify promising AI use cases without forcing the tech. Essential insights for product managers, builders, and anyone navigating the AI shift in building products.
Connect with Elina Lesyk:
AI Ketchup Podcast: https://pod.elinalesyk.com
LinkedIn: https://www.linkedin.com/in/elina-lesyk
Get your free curated AI report from Anetic Daily Intelligence
Sign up at: https://www.anetic.co
Get FREE AI tools
pip install tool-use-ai
Connect with us
https://x.com/ToolUseAI
https://x.com/MikeBirdTech
https://x.com/ELesyk
00:00:00 - Intro
00:07:55 - How Technical Do AI Product Managers Need to Be?
00:13:14 - AI Tools & Feedback Loops for Product Managers
00:23:39 - How AI is Changing Prototyping (Bolt, V0, Low-Code)
00:25:36 - Safety & Pitfalls in AI Implementation
00:31:08 - Designing AI User Interactions & Experience
00:41:21 - Identifying Promising AI Use Cases
Subscribe for more insights on AI tools, productivity, and product management.
Tool Use is a weekly conversation with AI experts brought to you by Anetic.
Master AI education and boost AI literacy with insights from Dr. Stefania Druga, Google Gemini research scientist and creator of Cognimates. Explore how to use AI to learn about AI, effective strategies for teaching AI concepts to kids and adults, and the crucial role of hands-on tinkering. We discuss overcoming learning barriers, designing AI tools that augment creativity without stifling imagination (like smart toys vs. real-world learning), the nuances of anthropomorphizing AI, and the future of multimodal AI applications in education and beyond. Learn why user observation and custom eval sets are vital for building truly useful AI tools.
Learn more about Cognimates: http://cognimates.me
Dr. Stefania Druga's Publications: https://stefania11.github.io/publications/
Watch Stefania's AI Engineer Talk: https://www.youtube.com/watch?v=ySYLsoAhXmg
Get your free curated AI report from Anetic Daily Intelligence
Sign up at: https://www.anetic.co
Get FREE AI tools
pip install tool-use-ai
Connect with us
https://x.com/ToolUseAI
https://x.com/MikeBirdTech
https://x.com/Stefania_druga
00:00:00 - intro
00:02:40 - Barriers and Perception in AI Learning
00:06:00 - AI Learning Differences: Adults vs. Kids
00:10:37 - AI Literacy for Non-Tinkerers
00:14:31 - The Impact of Anthropomorphizing AI
00:23:37 - Principles for Building Creative AI Tools
00:33:05 - Common Misconceptions in Building AI Tools
00:42:41 - Core Principle for AI Entrepreneurs: Observe Your Users
Subscribe for more insights on AI tools, productivity, and AI education.
Tool Use is a weekly conversation with AI experts brought to you by Anetic.
Flow engineering, AI workflows, and intelligent automation strategies for developers and AI builders. In this episode of Tool Use, we explore how orchestrating multiple AI steps transforms complex systems beyond simple prompt engineering.
Learn why most AI builders focus too much on crafting perfect prompts when real-world applications demand intelligent workflows. Discover Minki Jung's practical advice on decomposing tasks, designing ergonomic prompts, and building AI systems that actually work.
Key topics covered:
- How to think about AI workflows like Henry Ford's assembly line
- The difference between prompt engineering and flow engineering
- Practical techniques for decomposing complex AI tasks
- When to use LLMs vs. traditional programming in your workflow
- How to create memory and judgment within AI systems
- Tips for testing and evaluating AI workflows
Whether you're building AI content systems, tools, assistants, or decision engines, this episode will completely change how you approach AI architecture.
Get your free curated AI report from Anetic Daily Intelligence
Sign up at: https://www.anetic.co
Get FREE AI tools
pip install tool-use-ai
Connect with us
https://x.com/ToolUseAI
https://x.com/MikeBirdTech
https://x.com/FieroTy
https://x.com/JungMinki7
00:00:00 intro
00:02:20 - What is Flow Engineering?
00:03:41 - Workflows vs Autonomous Agents
00:06:46 - The Henry Ford Approach to Workflows
00:10:26 - How to Decompose AI Tasks (7 Steps)
00:16:38 - Choosing the Right LLM for Each Step
00:21:44 - Pro Tips for Prompt Engineering
00:27:46 - Learning AI & Avoiding Hype (Focus!)
Subscribe for more insights on AI tools, productivity, and building tips.
Tool Use is a weekly conversation with AI experts brought to you by Anetic.
From the publisher's feed