MLOps.community

Design and Development Principles for LLMOps // Andy McMahon // #254


Listen Later

Design and Development Principles for LLMOps // MLOps Podcast #254 with Andy McMahon, Director - Principal AI Engineer at Barclays Bank.

A huge thank you to SAS for their generous support!
// Abstract
As we move from MLOps to LLMOps we need to double down on some fundamental software engineering practices, as well as augment and add to these with some new techniques. In this case, let's talk about this!
// Bio
Andy is a Principal AI Engineer, working in the new AI Center of Excellence at Barclays Bank. Previously he was Head of MLOps for NatWest Group, where he led their MLOps Centre of Excellence and helped build out their MLOps platform and processes across the bank. Andy is also the author of Machine Learning Engineering with Python, a hands-on technical book published by Packt.
// MLOps Jobs board
https://mlops.pallet.xyz/jobs
// MLOps Swag/Merch
https://mlops-community.myshopify.com/
// Related Links
Andy's book - https://packt.link/w3JKL
Andy's Medium - https://medium.com/@andrewpmcmahon629
SAS: https://www.sas.com/en_us/home.html
SAS® Decision Builder: https://www.sas.com/en_us/offers/23q4/microsoft-fabric.html
Data Engineering for AI/ML Conference: https://home.mlops.community/home/events/dataengforai
Harnessing MLOps in Finance // Michelle Marie Conway // MLOps Podcast Coffee #174: https://youtu.be/nIEld_Q6L-0The Lean Startup: How Today's Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses book by Eric Ries: https://www.amazon.co.jp/-/en/Eric-Ries/dp/0307887898
--------------- ✌️Connect With Us ✌️ -------------
Join our slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Catch all episodes, blogs, newsletters, and more: https://mlops.community/
Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Andy on LinkedIn: https://www.linkedin.com/in/andrew-p-mcmahon/

Timestamps:
[00:00] Andy's preferred coffee
[00:09] Takeaways
[02:04] Andy's book as an Oxford curriculum
[06:13] Register for the Data Engineering for AI/ML Conference now!
[07:04] The Life Cycle of AI Executives Course
[09:55] MLOps as a term
[11:53] Tooling vs Process Culture
[15:01] Open source benefits
[17:15] End goal flexibility
[20:06] Hybrid Cloud Strategy Overview
[21:11] ROI for tool upgrades
[25:41] Long-term projects comparison
[29:02 - 30:48] SAS Ad
[30:49] AI and ML Integration
[35:40] Hybrid AI Integration Insights
[42:18] Tech trends vs Practicality
[44:39] Gen AI Tooling Debate
[51:57] Vanity metrics overview
[55:22] Tech business alignment strategy
[58:45] Aligning teams for ROI
[1:01:35] Communication mission effectively
[1:03:45] Enablement metrics
[1:06:38] Prioritizing use cases
[1:09:47] Wrap up

...more
View all episodesView all episodes
Download on the App Store

MLOps.communityBy Demetrios

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

20 ratings


More shows like MLOps.community

View all
The AI in Business Podcast by Daniel Faggella

The AI in Business Podcast

160 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

995 Listeners

Data Skeptic by Kyle Polich

Data Skeptic

474 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

292 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

323 Listeners

Data Engineering Podcast by Tobias Macey

Data Engineering Podcast

141 Listeners

DataFramed by DataCamp

DataFramed

271 Listeners

Practical AI by Practical AI LLC

Practical AI

192 Listeners

Last Week in AI by Skynet Today

Last Week in AI

279 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

90 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

122 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

191 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

63 Listeners

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

420 Listeners

AI + a16z by a16z

AI + a16z

26 Listeners