If you’re planning to deploy AI for your business, here’s 5 important capabilities your business needs from the cloud era in order to be successful.  SHOW: 806 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" SHOW SPONSORS:Want to win a Tesla Cybertruck or $100,000? Enter the WS02 Choreo Code Challenge (before April 30th)WSO2 Choreo - Why build a platform? Just add developers insteadSHOW NOTES:The Year Ahead in Cloud and Expectations for AI in 2024 (Altitude podcast)
 IF YOU WANT TO DO AI WELL, YOU NEED TO HAVE DONE CLOUD WELLWhen we first started doing cloud, the smart people would say, “If you don’t do IT well today, you won’t do cloud well in the future”.The same pattern will repeat itself with AI5 IMPORTANT CLOUD CAPABILITIES NEEDED TO SUCCEED WITH AIAutomate everything - Make automation mission-criticalBuild the right abstractions and flexibilities (e.g. sharing GPUs, Devtools, etc.)Leverage platforms to bring together Data Science, MLOps and AppDevKnow how much things cost (e.g. FinOps)Socialize success, and socialize learnings across teamsFEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Cloud Fundamentals needed for AI

Technology

Tech News

Podcasting

Gadgets

Software How-To

Business

Investing

Careers

Management & Marketing

Business News

Shopping

News

Management

What are the key characteristics and red flags with today’s leaders in the tech industry? How to identify the leadership skills, the team building skills, and the execution skills. SHOW: 818 SHOW TRANSCRIPT: The Cloudcast #818 SHOW VIDEO: https://youtube.com/@TheCloudcastNET  CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" 
 SHOW NOTES: 
 WHERE ARE THE LEADERS IN THEIR CAREERS? Are they a 1st time manager?Have they managed distributed teams? Managed multiple teams?Have they managed a P&L;? Have they had significant success in the past? What was their role?
 LEADERSHIP SKILLS, TEAM BUILDING, EXECUTION AND RED FLAGSAre you joining an established “team” or group that’s worked together before?Is the leader repeating a previous success, in a similar or different domain?What motivates the leader? What is their view on competition?What are the leader’s best skills? Do they recognize this? Does the leader augment their skills with the team around them? Do they recognize this?Does your personality mesh with the team you’re joining, or are you expecting to be a change agent?
 
 FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Identifying Leadership Traits to Follow

Aaron (@aarondelp) and Brian (@bgracely) talk about all the major news stories in Cloud and AI from April 2024

SHOW: 817

TRANSCRIPT: Cloudcast #817 - CNOTM - April 2024

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

SHOW NOTES: LINKS TO ALL ARTICLES FOR APRIL 2024 CLOUD NEWSSegments Covered in the Show:Good Old Fashioned Cloud NewsThe AI Innovation Continues - Speed RoundTrend 1 - 2024 is going to be a year of big announcementsTrend 2 - We’re starting to see some (early) reality set in with AITrend 3 - Lots of things are being lost between Broadcom/VMware and AI discussionsFEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Cloud News of the Month - April 2024

Every few years we have to be reminded that open source isn’t a business model. Let’s talk about the business dynamics that everyone seems to keep forgetting.   SHOW: 816 SHOW TRANSCRIPT:  The Cloudcast #816 SHOW VIDEO: https://youtube.com/@TheCloudcastNET  CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" 
 SHOW NOTES:Adam Jacobs discusses open source and business (The Changelog)“figure out how to play nice with competition” (Twitter)The will never be another Red Hat - Economics of OSS (a16z)OPEN SOURCE IS A LICENSE, NOT A BUSINESS MODELThere are rules around software licenses (e.g. Apache, GPL, etc.)There are no rules about how people feel about software, creators or maintainersFREE, FREE TIERS, EXTENSIONS, CLONESRed Flags: Writes most of the code, took VC funding (multiple rounds)Green flags: Lots of diverse (companies) contributorsYellow flags:  Foundation owns copyright“There’s the business side and there’s the hippie side of OSS”“I have endless ambitions”“I didn’t build a forever entity”“When is the rug pull going to happen?”If a company takes VC funding, is open source anything more than a marketing vehicle?“Docker figured it out and now they are doing like $100M”. Did they? When is OSS personal, and when is it a company?Will there never be another Red Hat, or just not another Linux?How much is too much when determining if a company should give things away for free?
 FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Open Source and Business…sigh

John Yue (CEO & Co-Founder @ inference.ai) discusses AI workload sizing, matching GPUs to workloads, availability of GPUs vs. costs, and more.

SHOW: 815

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

SHOW NOTES:Inference.ai (homepage)TechCrunch postSiliconAngle post on ChatGPUTopic 1 - Our topic for today is sizing and IaaS hosting for AI/ML. We’ve covered a lot of basics lately, today we’re going to dig deeper. There is a surprising amount of depth to AI sizing, and it isn’t just speeds and feeds of GPUs. We’d like to welcome John Yue (CEO & Co-Founder @ inference.ai) for this discussion. John, welcome to the show

Topic 2 - Let’s start with sizing, I’ve talked to a lot of customers recently with my day job, and it is amazing how deep AI/ML sizing can go. First, you have to size for training/fine-tuning differently than you would for the inference stage. Second, some just think, pick the biggest GPUs you can afford and go. How should your customers approach this? (GPU’s, software dependencies, etc.)

Topic 2a - Follow-up question what are the business side, what are the business parameters that need to be considered? (budget, cost efficiency, latency/response time, timeline, etc.)

Topic 3 - The whole process can be overwhelming and as we mentioned, some organizations may not think of everything. You recently announced a chatbot to help with this exact process, ChatGPU. Tell everyone a bit about that and how it came to be.

Topic 4 - This is almost like a match-making service, correct? Everyone wants an H100, but not everyone needs or can afford an H100.

Topic 5 - How does GPU availability play into all of this? NVIDIA is sold out for something like 2 years at this point; how is that sustainable? Does everything need to run on a “Ferrari class” NVIDIA GPU?

Topic 6 -  What’s next in the IaaS for AI/ML space? What does a next-generation data center for AI/ML look like? Will the Industry move away from GPUs to reduce dependence on NVIDIA?

FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Sizing AI Workloads

For some strange reason, “maintenance” has been in the news quite a bit lately. Is there ever a time when maintenance is enjoyable, or appreciated?  SHOW: 814 SHOW TRANSCRIPT: The Cloudcast #814 SHOW VIDEO: https://youtube.com/@TheCloudcastNET  CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" 
 SHOW NOTES:AWS increased the price of longer-running EKS clusters by 6xBroadcom changes VMware licensing from perpetual to subscriptionBroadcom offers security patches to perpetual license customersIncreasing the Kubernetes support window to 1 yearDiscovering the XZ backdoor (Oxide and Friends, podcast)IS MAINTENANCE EVER APPRECIATED OR ENJOYABLE?Spent the day surrounded by maintenance activities (oil, AC, power-wash)The costs of maintenance are real and opportunityMaintenance often goes unappreciated and unseenNaming: Release Notes, Technical Debt, Chaos EngineeringTECHNICAL DEBT VS. MAINTENANCEShould we encourage a lack of maintenance vs. innovation as a priority?Should we encourage active maintenance with lower hard costs?Is there a way to put respect on maintenance? (e.g. OSS maintainers)Do we undervalue maintenance (e.g. Backup/Recovery, DisasterRecovery, etc.)?What maintenance best practices do you use? What are the good and bad of them?FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Cloud Fundamentals needed for AI

Download our free app to listen on your phone