Microsoft Mechanics Podcast

Automate evaluations | Microsoft Foundry


Listen Later

Build AI agents that meet your standards for quality, safety, and performance using Microsoft Foundry. Trace every run end-to-end, generate synthetic datasets to stress-test on demand, fire automated Red Team attacks at your own agents, and pin down why evaluations fail — all from the Microsoft Foundry control plane. Lock in guardrails that inspect every tool call at runtime, define the risks once, and enforce them across every agent run.

Mohammad Abuomar, Responsible AI Principal Architect, shares how to turn a coding agent into production-ready software inside Foundry.

► QUICK LINKS:

00:00 - Microsoft Foundry control plane

00:33 - See a finished agent

02:30 - See where the agent started

03:19 - Traces

04:04 - Built-in monitoring

04:34 - Evaluation types

05:51 - Red team evaluations

07:08 - Evaluation results

08:14 - Built-in Guardrails

08:14 - Wrap up

► Link References

Get everything you need in Microsoft Foundry at https://ai.azure.com

► Unfamiliar with Microsoft Mechanics?

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics

...more
View all episodesView all episodes
Download on the App Store

Microsoft Mechanics PodcastBy Microsoft Mechanics

  • 4.2
  • 4.2
  • 4.2
  • 4.2
  • 4.2

4.2

20 ratings


More shows like Microsoft Mechanics Podcast

View all
WSJ What’s News by The Wall Street Journal

WSJ What’s News

4,353 Listeners

Hanselminutes with Scott Hanselman by Scott Hanselman

Hanselminutes with Scott Hanselman

380 Listeners

This Week in Tech (Audio) by TWiT

This Week in Tech (Audio)

3,062 Listeners

Security Now (Audio) by TWiT

Security Now (Audio)

2,007 Listeners

Windows Weekly (Audio) by TWiT

Windows Weekly (Audio)

887 Listeners

Microsoft Cloud IT Pro Podcast by Ben Stegink, Scott Hoag

Microsoft Cloud IT Pro Podcast

65 Listeners

Tech Brew Ride Home by Morning Brew

Tech Brew Ride Home

963 Listeners

Cybersecurity Today by Jim Love

Cybersecurity Today

179 Listeners

CISO Series Podcast by David Spark, Mike Johnson, and Andy Ellis

CISO Series Podcast

192 Listeners

Practical AI by Practical AI LLC

Practical AI

213 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

507 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

227 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

693 Listeners

AI For Humans: Weekly AI News, Tools & Trends by Kevin Pereira & Gavin Purcell

AI For Humans: Weekly AI News, Tools & Trends

283 Listeners

Prof G Markets by Vox Media Podcast Network

Prof G Markets

1,486 Listeners