MLOps.community

The Latency Goldilocks Zone Explained


Listen Later

Rafael (Head of Innovation, iFood) and Daniel (Data and AI Manager, iFood) pull back the curtain on ILO-Agent β€” iFood's conversational AI ordering system built for 200 million users across Latin America. Recorded live at AI House Amsterdam, this conversation goes deep into the engineering and product decisions behind building recommendation systems and agentic AI, and why the speed of your AI's response might actually be destroying user trust.


The Latency Goldilocks Zone Explained // MLOps Podcast #376 with iFood's Rafael Borger (Head of Innovation) and Daniel Wolbert (Data and AI Manager)


πŸ• Recommendation Systems at Scale β€” Why personalizing for 200M users with wildly different food tastes, budgets, and cultures is a fundamentally different problem than standard ML

πŸ€– ILO-Agent Deep Dive β€” What iFood's conversational AI agent actually does, how it handles open-ended requests ("a romantic dinner for two, my wife hates onions"), and where it's headed

⏱️ The Latency Goldilocks Zone β€” The fascinating insight that LLM responses can be too fast (users don't trust them) or too slow (users abandon) β€” and how to find the sweet spot

🧠 Perceived vs. Actual Latency β€” Why showing progress indicators and partial results can make a 6-second response feel instant, and how iFood uses this in production

πŸ›’ The Tinder for Food Experience β€” How iFood is experimenting with swipe-based discovery to solve "I don't know what I want to eat" for millions of undecided users

πŸ—£οΈ Voice vs. Text AI Interfaces β€” Why voice ordering limits you to 6 items in 30 seconds, and why text-based agents need radically different output design

πŸ”— Agent-to-Agent (A2A) Architectures β€” What happens when your customer support agent and your ordering agent need to collaborate, and the standardization challenges ahead

πŸ“Š Measuring Product-Market Fit for AI β€” Why the Sean Ellis / Chanel score method breaks down in Brazil, and what iFood uses instead

πŸ—οΈ Scalability vs. Ecosystem Health β€” The real tension between consuming partner APIs aggressively and keeping the food delivery ecosystem sustainable

🌎 Building AI for Global-Local Markets β€” Why one-size-fits-all AI products fail and how iFood builds for cultural and economic diversity simultaneously.


This episode is for ML engineers, AI product managers, and data scientists building production AI systems at scale β€” especially if you're working on recommendation, retrieval, or agentic systems in consumer apps.


πŸ”— Links & Resources

MLOps.community: https://mlops.community

AI House Amsterdam: https://aihouse.amsterdam

iFood: https://www.ifood.com.br/

iFood AILO launch coverage: https://tiinside.com.br/en/10/10/2025/ifood-lanca-ailo-assistente-de-ia-que-inaugura-pedidos-por-conversa/

iFood AI case study (AWS): https://aws.amazon.com/solutions/case-studies/ifood-bedrock/

Related MLOps Community talk β€” "From Zero to AILO" by Nishikant Dhanuka & Chiara Caratelli: https://home.mlops.community/public/videos/from-zero-to-ailo-lessons-learned-from-building-ifoods-ai-agent-nishikant-dhanuka-and-chiara-caratelli-2025-11-25

ZenML LLMOps database write-up on iFood's hyper-personalized agent: https://www.zenml.io/llmops-database/building-a-hyper-personalized-food-ordering-agent-for-e-commerce-at-scale


⏱️ Timestamps

[00:00] Recommending the unknown

[00:18] Ailo Hyperpersonalization Insight

[06:24] Predictive Personalization Insights

[09:13] "Jet skis" of innovation

[17:45] Consumer Behavior and Chatbots

[26:33] Perceived Latency and Engagement

[33:22] AI-driven UI Evolution

[38:17] LCM Voice Mode Inquiry

[45:20] Chat as Interface

[47:46] Wrap up

...more
View all episodesView all episodes
Download on the App Store

MLOps.communityBy Demetrios

  • 4.6
  • 4.6
  • 4.6
  • 4.6
  • 4.6

4.6

23 ratings


More shows like MLOps.community

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,290 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

288 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,096 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

624 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

583 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

301 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

344 Listeners

Practical AI by Practical AI LLC

Practical AI

213 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

561 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

507 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

145 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

100 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

227 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

693 Listeners

AI + a16z by a16z

AI + a16z

32 Listeners