
Sign up to save your podcasts
Or


In this Tech Barometer podcast, Nutanix CEO Rajiv Ramaswami describes why a thriving IT ecosystem enables enterprises to maintain investments in traditional infrastructure and applications while evolving to newer innovations such as cloud native and AI technologies.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Podcast transcript:
Jason Lopez: One of the key messages from the 2025 Nutanix .NEXT Conference in Washington DC: the expanding partner ecosystem. This is the Tech Barometer Podcast, I’m Jason Lopez. dot-NEXT is where enterprise IT professionals come together with an eye on building their future on the Nutanix software platform. One thing we learned this year is companies like Pure Storage, NVIDIA, and Dell will play a key role in delivering integrated solutions to customers, in areas like enterprise AI and infrastructure modernization. The Forecast’s Editor in Chief, Ken Kaplan, recorded this walk-and-talk with Nutanix CEO Rajiv Ramaswami as he headed to another session at the .NEXT conference, which continues to build in numbers of attendees and partners.
Rajiv Ramaswami: Yesterday I was at the Partner Summit. I believe there were 1,600 partners in attendance. So a lot more. The partner network is expanding. Our ecosystem partners are growing. This year I think we had about 85 plus, 86 I think, sponsors for the event. A few years ago it was 25. So I think we’ve come a long way.
[Related: Get a Grip on Data Storage in Quest for Enterprise AI]
Ken Kaplan: Yeah, the theme for me is partners and Pure Storage was a big announcement. What is it like to work with NVIDIA, Dell, all these partners you’ve been talking about for years, but you’re really close with them now.
Rajiv Ramaswami: It all comes down to can we work together to create something of value that each of us brings together and create a solution for the customer. That is the core of every partnership. You look at NVIDIA, it’s all about enabling enterprise AI. If you look at Pure, it’s about providing customers with choice. Many of the large install base of customers out there with Pure Storage and now they all have an option to be working together with the Nutanix Cloud Platform and Pure. It’s all about providing a better solution and experience for customers.
Ken Kaplan: There was Cisco, Dell, NVIDIA. What’s driving all this togetherness now? Is it a push for AI? Is it a push that there’s really a lot of innovation and we got to get together on the same page? Why is this happening now?
Rajiv Ramaswami: It’s across all the themes that we talked about. Modernizing infrastructure, building cloud native applications, enabling enterprise AI, and depending on the partner specifically, it’s one or all of these vectors.
[Related: What’s Driving IT Decisions Around Enterprise AI and Cloud Native Technologies]
Ken Kaplan: Do you anticipate more of this happening or does this thing start to close up or are we in a real open go, go, go period?
Rajiv Ramaswami: We’ve always been a company that’s focused on creating a platform and a platform always has an ecosystem around it. I do expect our ecosystem to continue to grow and flourish. Do you see the customers wanting this kind of openness? Absolutely. This is creating a huge value for customers because they know that we can’t provide everything and so combining solutions together, if we can make it work well, yes, absolutely.
Ken Kaplan: Have you seen some of the customers, once they have these capabilities, start going in new directions? You mentioned a customer who came on stage with you and now they’re getting into AI.
Rajiv Ramaswami: Their needs are evolving as well. They may have been running traditional infrastructure stuff on us. They may have been running VDI workloads on us. They’re running mission critical databases on us these days. Now they’re running AI on us. Their needs evolve and we as a platform continue to work hard to evolve with them.
[Related: AI Lifecycle’s Impact on IT Infrastructure]
Ken Kaplan: The last thing here: we’re seeing a lot of people talking about VMs and having cloud native. Are they doing these things and don’t know it or is it just something they have to do now going forward?
Rajiv Ramaswami: They’re all going to have a mix of their traditional applications at the same time be looking at building modern applications and they actually have to do both. They have to run their traditional ones and they have to at the same time be building modern ones and figuring out how to run all of these very efficiently.
Jason Lopez: Rajiv Ramaswami is the the CEO of Nutanix. Ken Kaplan is the Editor in Chief of the Forecast, the producer of this Tech Barometer podcast. They spoke on the floor of the .NEXT conference in Washington DC. .NEXT will move to Chicago in April 2026.The Forecast reports on the enterprise computing industry can be found at theforecastbynutanix dot com. I’m Jason Lopez, thanks for checking in.
In this video interview, Harmail Chatha, senior director of cloud computing operations at Nutanix, describes the growing challenges of managing data centers as business demands for enterprise AI applications climb.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Harmail Chatha: You have GPU clouds available like AWS Google and Azure, but they’re kind of the true ias PaaS platforms. Now you actually have clouds that offer you bare metal with GPUs. And what’s happening across the industry is there’s a lot of companies that are deploying these in traditional data centers and taking up a lot of the power and space as well, because we’ve always had this concept of hyperdepth racks where we optimize for vertical growth versus horizontal growth. But what’s happening within the data centers now is a lot of horizontal growth because of not enough power available, not enough infrastructure available to support the power needs of GPU environments. And obviously cooling isn’t there as well. So I don’t think AI is necessarily pushing the limits within data centers yet, but it’s going to very, very soon if data centers don’t start to adapt to new technologies, new cooling infrastructure, new power densities that are required as well. So I think we’re going to start seeing the limitations within data centers, but I don’t believe it’s there yet. But as more and more consumption goes in and customers identify workloads that they’re going to be running with ai, I definitely see it hitting a limit.
[Related: AI Lifecycle’s Impact on IT Infrastructure]
They’re at the heart of the power problem in the data centers right now as well, right? These newer generations of CPUs with GPUs are consuming anywhere from 30 to 50% more power within the servers. Hence, the industry is really taxed from a power consumption perspective. Whereas you can deploy a full rack of the older gear now you can only deploy half a rack. So how do you solve that problem? So now, whereas we historically have been 17.3 kilowatts per rack, fully maximizing the rack. Now our new design, it’s going to be 34 plus kilowatts per rack with liquid cooling to the rack and ultimately getting to the chip as well. So we’re really at the onset of designing our data center of the future also, because what’s legacy is not going to work any longer. It’s going to be super inefficient. Cooling challenges within the data center. Air cooling is not going to be enough with this new AI technology going in and the consumption of power within the GPUs as well.
[Related: Report Shows Enterprise AI Driving Big Investment Burst in Cloud Services]
Companies have to start really honing in or zooming into their environments. Not so much holistically at a data center level, but what does a workload look like and how do you measure the emissions of that workload in itself? Right? And we’re just kind of touching the surface on scope one, scope two, how do you really measure scope three, which is the most challenging one? It’s basically considered everything else that’s not direct emissions, indirect emissions, but scope three being all encompassing. How do you get to embody emissions as well as an industry? We’re not there yet embodied emissions of a server. So we’re talking about VMs to workloads, but embodied emissions means what’s that single little cable within the system, the server itself, and how do you measure the emissions of that? There’s thousands, hundreds of thousands of parts that go into a server. How do suppliers measure the transportation cost and the development cost of those components as well? So really it’s all about zooming in right now, right? As we continue to mature in this space, there’s a lot of effort that’s going to go into measuring, and there’s so many companies, new startups coming out that are starting to just touch the surface of how do you measure emissions in itself?
[Related: Guiding Enterprise IT Hardware Buyers into the AI Future]
ROI has a lot of interest from companies wanting to learn and understand sustainability. It’s no longer like a hypothetical topic or a conversation, but kind of roll your sleeves up and you have to take the step, take the initiative to first kind of educate yourself, what is it that you need to do, understand the different scopes there are, and really start to measure what your footprint looks like. So what I’m seeing is, of course a lot of interest in the industry, but I think what’s happening with some of the, for example, us who’ve been on this journey for the last three plus years now, or some of the more mature companies that are been measuring their carbon footprint, we’ve been doing this at a very holistic data center level, at a building level, and then kind of have gone down to a customer’s environment level.
[Related: Get a Grip on Data Storage in Quest for Enterprise AI]
So we have data halls, we have cages, so we’re able to measure our footprint there. But now, as we announced just earlier today in the opening keynote is worse within (Nutanix) Prism Central application, we can measure the electrical consumption of a node, and ultimately you can get to a cluster. So we’re going a step deeper versus just being holistic at a data center level now. So this is a good step in the right direction, but where we ultimately need to go and continue to do more work is you got to get to the VM level. Once you can measure the vm, then you got to get to the workload level, and that’s when you’re going to be able to make smart and intelligent decisions on what a workload consumption looks like, correlate that back to the emission factor, and then intelligently you’re able to move those applications around to more sustainable data centers that might have lower P use more renewable energy as well. So I think that’s the journey we’re on. I’m glad we’re measuring at the node level, but ultimately we got to get to that VM and application level as well.
In this Tech Barometer podcast, David Kanter, co-founder of MLCommons, talks about intellectual curiosity and how it led him to the forefront of the enterprise AI revolution.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
David Kanter: The current era of machine learning is very much informed by the supercomputing community. I think the seminal moment for this era of machine learning was AlexNet and ImageNet, which demonstrated that if you took enough compute power, you could train a machine learning model, a neural network that outperforms humans at image recognition. And that was 2011, and that kind of launched the modern era.
[Related: Importance of AI Data Storage Performance]
Jason Lopez: The voice of David Kanter, co-founder of MLCommons, the organization which developed the benchmarks to measure the performance of machine learning and artificial intelligence hardware, software, and computer systems. This is the Tech Barometer Podcast. I’m Jason Lopez. For the past two decades, computer scientists have been working on the performance of machine learning models. Kanter and his colleagues have explored how computer systems across a range of functions can keep up with AI training. Their benchmark suite, MLPerfStorage, reveals the performance of storage systems when running AI.
David Kanter: Debo Dutta and I had sort of brainstormed about this.
Jason Lopez: Debo Dutta is the chief AI officer of Nutanix and a co-founder of MLCommons.
David Kanter: He said, you know, we’ve got this wonderful professor at McGill that we’ve worked with. She was at Nutanix, I think, for a period of time and runs a wonderful lab up at McGill. And so we started some of the brainstorming. And from there, sort of the idea emerged that, hey, we should look at what is the performance that you need out of a storage system to support AI training. That’s really the goal of MLPerfStorage is answering that question.
[Related: Measuring the Prime Ingredient in Enterprise AI]
Jason Lopez: Measuring performance is complex, especially at different scales. Machine learning workloads vary significantly, and they work on a variety of applications and use different levels of computational power.
David Kanter: If you’ve got a system that has, you know, 65 of these generation of accelerators, five nodes of Nutanix may be right for you. Or, you know, maybe you’re looking to build a cluster that’s a bit more expandable. And maybe you should get 10. But that’s ultimately the kind of what the benchmark is telling us. And, you know, we’ve got three different workloads in the benchmark, 3D images and 2D images and scientific workload.
Jason Lopez: Machine learning operates across a big range, from small energy efficient models to very large systems.
David Kanter: One of the things I like to say is it spans from microwatts to megawatts, because some of the largest MLPerf submissions on the compute side for MLPerf training and MLPerf HPC, we had one submission on Kudaku at the time, I think the world’s number one supercomputer. And then we’ve had systems with 10,000, 11,000 accelerators. Those are some of the largest supercomputers out there.
[Related: Get a Grip on Data Storage in Quest for Enterprise AI]
Jason Lopez: One of the most exciting applications of AI is in scientific research, where machine learning can enhance simulations to make them more efficient.
David Kanter: You can do an exact simulation, but that’s very computationally expensive.
Jason Lopez: An exact simulation means, for example, in the case of charting the transformation of a molecule, the system expends the time and energy to go through an exhaustive analysis of how atoms and molecules interact and how they bond and change over time.
David Kanter: What happens if instead of doing pure simulation, maybe we can use machine learning to do some prediction that might be a lot more affordable computationally than an exact simulation. So one of the ways that people are looking at AI for science is training the machine learning model on these exact simulations so that it can approximate them and make very efficient predictions. And then you can use the exact simulation only on the ones that you already believe to be safe.
[Related: Creating AI to Give People Superpowers]
Jason Lopez: Machine learning, by extension AI, isn’t just for research institutions anymore. Its tools and infrastructure are becoming more mainstream, with applications extending far beyond traditional supercomputing environments.
David Kanter: AI is taking a lot of those same tools and infrastructure, including the storage, mainstream and operating it in a different way. Now you have all the leaders in AI and machine learning having those same needs for totally different data. We’re taking the storage that you needed for supercomputers, and now there’s a much broader pool of people who need them for a wide variety of different applications.
Jason Lopez: One field where this shift is already visible is in autonomous driving, where AI must analyze complex data in real time.
David Kanter: The data needs there are super complicated. You’ve got 2D images, you’ve got 3D volumes, you’ve got LiDAR that gives you depth, you’ve got radar. And so you have to combine all of this together and analyze it so that we can get cars that will help inform me as a driver, hey David, you’ve got to stay in the lane or this deer is coming out of nowhere.
[Related: Alex Karargyris’s Path to Becoming a Pioneer of Medical AI]
Jason Lopez: As the field of AI grows, so do the options for access. Companies must decide whether to buy or lease computing power, a challenge that Kanter and his team considered while designing MLPerf benchmarks.
David Kanter: There’s a lot of folks who are going to be doing that in the cloud who may not want to buy, they may want to lease, or it may be a combination of the two. And just the variety of approaches there is really astounding. And that was all something we had to take into account when we built the benchmark to be as inclusive as possible. I read science fiction and fantasy copiously as a kid, but I also loved video games because they could bring that imagery to life. So that got me interested in, well, what computers are good for running video games and why? And those were questions I started to ask myself when I was middle school, high school. That ultimately led me down the path into computing.
Jason Lopez: In some ways, Kanter’s work with MLPerf is just an extension of what he’s been doing since he was a kid. His father was a doctor and he said he was raised in an atmosphere of inquiry.
David Kanter: I didn’t learn until later in life that actually most people don’t talk about medical cases over the dinner table. That was one of the ways in which I became maybe a little bit better rounded in college.
[Related: Enabling AI-Powered Computational Biology in Pursuit of Precision Medicines]
Jason Lopez: His passion for technology carried him through the dot-com boom and into a career where he helps define the future of computing.
David Kanter: In the late 90s, I got really interested in the internet and was starting to read some of the early websites on computers and reviews. Anand Tech, Tom’s Hardware Guide, a lot of the early review sites I read when I was in high school. And then when I was in college, I ended up getting involved with Real World Tech, which was actually kind of the granddaddy of some of these and still is a website for computer engineers, not the general public, focused on understanding computer technology. And so I started writing there while I was in college, actually, and ended up running the website when I moved out to Silicon Valley in 2005. And that’s when I first came into contact with Intel, Itanium, and the transition to 300 millimeter wafers and all sorts of marvels that we bring to life.
Jason Lopez: Today, as AI continues to evolve, the challenge for Kanter remains the same. How to define progress.
David Kanter: Part of the goal is getting the whole industry oriented around what does it mean to be better? And part of that is helping customers understand what they should be buying. And which, again, coming back full circle, that’s why I was reading review websites in middle school and high school, because I was trying to figure out what computer to buy.
[Related: Bridging the Gap Between AI’s Promise and Fulfillment]
Jason Lopez: From figuring out what computer to buy, Kanter’s now helping people figure out how best to implement enterprise AI to run organizations. The work he’s doing for MLCommons is big. Many challenges lie ahead, like power consumption of inference and training systems. Some of the new work they’re doing, measuring AI risk, reliability and safety.
David Kanter: I’m thrilled that inference we delivered a couple of years ago and then training, which is a bit more complicated because they’re bigger systems. We were able to get the first power measurements for AI training systems late last year. And we’ve got hopefully more coming soon with MLPerf training.
Jason Lopez: David Kanter is the co-founder of MLCommons, a consortium that develops benchmarks such as MLPerf Storage for evaluating machine learning performance across hardware, software and cloud platforms. You can find them at mlcommons.org. In our ongoing series on AI leaders, listen to our follow-up segment where David Kanter discusses how they’re creating benchmarks for data storage. This is the Tech Barometer podcast. I’m Jason Lopez. Thanks for listening. Tech Barometer is a production of The Forecast. Find us at theforecastbynutanix.com.
In this Tech Barometer podcast, MLCommons Co-founder David Kanter talks about creating the MLPerf benchmark to help enterprises understand AI workload performance of various data storage technologies.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
David Kanter: Data is the prime ingredient in modern machine learning. I think there was an economist headline saying data is the new oil. Of course, where does that oil live? That oil lives on storage. Storage is kind of like Baskin and Robbins, except it’s possible there might be more than 31 flavors.
Jason Lopez: David Kanter is the co-founder of MLCommons. This is the Tech Barometer podcast. I’m Jason Lopez on this podcast, storage and the critical importance it plays in the age of AI. In this episode, David Cantor explains MLPerf Storage, a benchmark suite of MLCommons. This benchmark is designed to measure machine learning workloads in the context of storage systems, which hold the data used to train models. He says, to unlock the full potential of AI, storage systems need to be tailored to the process of machine learning, which is quite critical to AI training. And this is how the idea for the MLPerf Storage benchmark came about. Data fuels AI’s ability to learn and make decisions. The more data you have, the more powerful your models, the greater the breakthroughs. This is at the heart of the AI scaling laws developed by Greg Diamos, a co-founder of MLCommons. His work on AI scaling laws, neural network optimization, and GPU acceleration has had a big influence on the field of AI development.
[Related: Get a Grip on Data Storage in Quest for Enterprise AI]
David Kanter: The lesson of the scaling laws is that if you get enough data and you get a big enough model and enough compute to combine those together, that’s when you really get these qualitatively different outcomes, whether it’s a self-driving car or the ability to recognize an image better than a human. Data is really the top priority here.
Jason Lopez: But it’s not just about having data.
David Kanter: It’s how you process the data, how you manipulate the data. And there’s a ton of work that really shows that data is a first-class citizen. And of course, data needs a place to live, and that’s storage. You’re going to take batches of data and feed it into your compute system. And then you’re going to compute a forward pass and see how good the model is at predicting on that batch of data, compute the errors, and then adjust the model so it gets better, and then over time, the model will hopefully and often converge to an answer.
Jason Lopez: After enough iterations, the model becomes good at recognizing whatever you’re training it. It has converged to an optimal solution, but it can take a lot of data, which means a lot of storage. And to take it one step further, the faster and more efficient that data storage, the better for training, inference, and tuning models. In MLPerf’s first storage evaluations, the Nutanix Unified Storage Platform was a benchmark leader, and Cantor commented on these benchmark tools.
David Kanter: We built up a great set of infrastructure using some tooling from Argonne National Lab to help us measure sort of that data loading for AI. And critically, we can do it without having to have accelerators. You can actually run our benchmark and ask the question, hey, what would it take to feed 4,000 accelerators without having to shell out for 4,000 accelerators?
Jason Lopez: That’s how artificial intelligence is changing the way we process and analyze information. Making a model to see how something works is nothing new, but AI is raising the bar dramatically. It does this by requiring massive amounts of data to train the system.
David Kanter: I think the really critical thing is the size and type of data. We’ve got three different workloads in the benchmark, 3D images, and 2D images, and a scientific workload. So if we’re doing image recognition for, say, smaller images, you know, each image might be 100 kilobytes or so. When you want to feed your compute system, you’re going to be pulling in a batch of images, so your storage system has to be able to keep up. If you have really big images, then each image fetch is going to be a lot of data all in one fell swoop. But if you have smaller data, like let’s talk about large language models, right, you’re going to be working on a lot of text. That’s much smaller data, and it’s going to have actually a pretty different impact on the storage system.
Jason Lopez: Which leads to this insight. Image size is an issue, but it’s not just about images.
David Kanter: It’s actually about how many data samples, you know, whether it’s a 3D volume, whether it’s a 2D image, whether it’s a sentence, you know, whatever it is, how many of these samples are you getting? And critically, how many accelerators can you keep busy with a given storage system? If you’ve got a system that has, you know, 65 of these generation of accelerators, you know, five nodes of Nutanix may be right for you. Or, you know, maybe you’re looking to build a cluster that’s a bit more expandable, and maybe you should get 10. But that’s ultimately what the benchmark is telling us.
Jason Lopez: What the benchmark reveals helps users to understand how their system choices work together. That’s the big overview. But when you zoom in, the benchmarks evaluate a range of things, such as the safety of chatbot-gen AI systems measured in the AI Luminate benchmark, or the performance of large language models and other AI workloads on PCs in the MLPerf client benchmark.
David Kanter: An initiative that we’ve started recently at MLCommons is trying to turn our expertise in AI measurement to how can we make sure that these AI systems are going to be responsible and doing the right thing for us as we intend.
Jason Lopez: One intention, which gets a lot of headlines around AI, is safety. But another intention is building systems which don’t break the bank and don’t gobble up inordinate amounts of power. The owners of data centers benefit from the MLPerf storage benchmark with insights into how to manage costs or how to build data centers for optimum performance. Today, companies are rethinking how they build data centers.
David Kanter: As we’re shifting into the AI era, a lot of these systems use so much power that we may have to double the footprint of data centers. Obviously, that’s a big deal. And so we’re seeing people looking for new sources of energy and thinking more about where data centers are with energy in mind.
Jason Lopez: Older data centers often lack the electric capacity and cooling infrastructure needed to support hardware like GPUs, as well as train large-scale models, which use far more power than traditional computing. The next generation of data centers needs to be powerful and efficient.
David Kanter: Some of those older generation of data centers that we built in the 90s and 2000s just don’t work for AI. I think part of what we’re seeing is we need new data centers that can do AI. And that’s, you know, stressing the whole system. But the great news is they’re actually way more efficient than what we had before. And the systems we build are more efficient. Every day we’re discovering new things.
Jason Lopez: Kanter says you can’t optimize what you don’t measure, in this case, energy use. Training a single large AI model can produce as much carbon as five cars over its lifetime. Tools like MLPerf Storage measures AI performance per watt, helping developers choose more efficient hardware and software.
David Kanter: From a sustainability standpoint, we focused on measuring energy usage because you can measure it. We want to measure the power consumption of inference and training systems. I’m thrilled that inference we delivered a couple of years ago and then training, which is a bit more complicated because they’re bigger systems. We were able to get the first power measurements for AI training systems late last year. And we’ve got hopefully more coming soon with MLPerf training. The goal of my organization in many ways is how can we measure things in the AI world and help to make AI better for everyone. And where better means faster, more capable, more energy efficient and safer.
Jason Lopez: David Kanter is the co-founder of MLCommons, the organization which developed the benchmark suite MLPerf Storage. Some of the key players in this organization we’ve interviewed for Tech Barometer previously, Debo Dutta, chief AI officer at Nutanix, Greg Diamos, one of the key developers behind generative AI apps and discoverer of scaling laws. And Alex Karagris, the co-founder and co-chair for the MLCommons Medical Working Group.
Look for these podcasts and print stories at our Forecast news page, theforecastbynutanix.com. That’s all one word, theforecastbynutanix.com. Tech Barometer is a production of The Forecast. I’m Jason Lopez. Thanks for listening.
In this video interview, the inherent group President Pierre Jean Beylier describes the state of digital transformation across Europe, including data sovereignty and regulations, public and hybrid cloud, IT resiliency and flexibility, and sustainable energy strategies.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Pierre-Jean Beylier: Today we’re a French player with a small business starting in Belgium, but we’re really a French player. So we’re very focused on what’s happening in France in terms of cybersecurity. And already it’s complex, but we’re dealing with one big government agency that deals with cybersecurity Europe. Each country has its cybersecurity agency. Each country will want you to be certified with their local agency if you want to work with certain government agencies and so on so forth. So it’s a lot of work. It’s additional costs in many cases because you don’t have a certification that allows you to work smoothly around all the European countries. Now, there are some rules in place that give you equivalence. So if you have this level in France, then it works in Germany with some countries, but not with all. So it is very complex in France compared to the rest of Europe. In Northern Europe, we are late in the move to cloud, whether it’s private cloud or public cloud. So we are catching up on that, and we’re also late securing our data and our networks and our infrastructure. So small, medium sized companies have a lot of work to do on that front. In France, 60% of the small companies that get attacked get out of business within 24 months after the attack if the attack was successful.
[Related: Managing Enterprise AI Sprawl]
So there’s more and more education around those risks, and we see that evolving. Obviously, that creates a lot of opportunities for us helping our customers with securing their data, their network, and with helping them define what is the best setup of the infrastructure. Are there things that they want to keep on-prem and it makes sense to keep on-prem? What do they put in a private cloud? Is there a need for them to go to the public cloud? We advise them on that and then deploy it with them and manage it for them. Larger companies can co-manage or let them manage themselves if they want, but smaller companies in general, it’s a fully managed service.
[Related: IT Analysts Discuss the Search for VMware Alternatives After Broadcom Acquisition]
They need a lot of things. They need more reliable, resilient connectivity, and higher speeds. With that comes the need for more security. They have a lot of their systems. If you look at the French market, we are late in terms of moving to the cloud. So they have a lot of systems on-prem, and they’re asking themselves, does it make sense? Wouldn’t I be more secure if I put my systems in an environment that has been built for that and managed by people whose job day after day it is to do that. So typical needs of companies whose business model is evolving towards more and more e-commerce digitalization of all their processes, they’re coming to us. So we are really focused on mid-market companies from 50 employees to 5,000. And then we have also larger companies that come to us when they’re fed up with the big telcos and the lack of agility and response they’re getting.
[Related: 4 Trends Defining the Future of Enterprise AI]
At the beginning of the process, the customer was not sure of what he wanted. It often happens or they think they know what they want. And when you start going through different scenarios with them, no, actually this sounds good. That’s not what we had planned for, but this sounds good. And we wanted a technology that allows us for maximum flexibility because we were not sure where we would land. Maybe some servers would stay on-prem in some stores in the bigger stores, some private cloud they had in mind to have some in frying the public cloud as well. So we wanted the technology that allows us to manage that very smoothly wherever the infrastructure is located. So Nutanix came on top of the list to achieve that. And then we also wanted to go into a hyperconverged solution. So that was a key element in the decision.
[Related: Enterprise IT Teams Jump Into AIOps]
We have 14 data centers in France, seven that we own. And we are looking at a, what can we do better? So what’s interesting in our industry is that 80% of the carbon consumption, carbon footprint comes from terminals. Data centers are very small for us because in France, most of our energy comes from nuclear energy and it’s a green energy, with very low carbon emissions. So energy consumption is not a big issue. Water consumption is, and we’ve put in place cooling systems in our data centers that don’t use water. So we’re quite on the forefront of that. And then in terms of terminals, last year we collected from our customers a bit over 14,000 routers and all kinds of different equipment. And it’s roughly one third we refurbish and reutilize. One third we sell for other people to utilize them, and one third we recycle, destroy, recycle properly. That’s a big objective for us, and we think we are ahead of a lot of our competitors in that 80% of our carbon footprint comes from the equipment at customers, premises, routers for fiberlink, et cetera, et cetera. So that’s a big area of focus for us.
In this video interview with The Forecast, Simon Robinson, principal analyst at Enterprise Strategy Group, discusses the complexities of managing data in cloud and hybrid multicloud environments, a challenge that is growing more acute with the rise of enterprise AI applications and data.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript (edited):
Simon Robinson: We talk a lot about storage, but the important part is the data. That’s the stuff we care about. Managing data according to policy in a cloud environment or multicloud environment is much more complex because it’s much bigger and there are strict rules about what data can go away. So enabling that longer term I think is a really important problem that the industry is focused on addressing. One of the big challenges in the future is going to be: how do we get enough and the right sort of data into those models? So that has a couple of dimensions. One dimension is if I’m building massive GPU clusters, I want to be able to feed data very, very quickly. So I need highly parallelized capabilities on the storage side to keep those GPUs saturated. So that requires some very particular, very high performance storage capabilities.
[Related: 4 Trends Defining the Future of Enterprise AI]
So that is definitely happening. More broadly, I think for the typical enterprise, they’re now at the point where they’re thinking, okay, so we’re going to maybe have some models, build some models ourselves. We’re going to be thinking about what these applications may be. They may be running at the edge. Where is the data going to be for those applications and how do we get data into those models? Storage today is very, very siloed and it’s trapped into different locations. It’s in different flavors of storage. You’ve got sand, you’ve got nasa, you’ve got object storage, you’ve got storage in the cloud, you’ve got storage at the edge, you’ve got storage in multiple data centers. What is the right data that I need? Right? Organizations struggle with visibility into their data. They always have, and there’s always been kind of, well, what is the benefit of solving that problem? And I think AI could be a major enabler in persuading organizations to finally solve that problem. If they don’t have visibility into their data, they’re not able to optimize their AI environments. So I think that’s where we see a real opportunity in some really interesting things going on in the industry in terms of innovation there.
[Related: Enterprise IT Teams Jump Into AIOps]
When we are talking about billions of parameters about generating insight from stuff that wasn’t created by humans, that can only at scale, that’s accessible globally, that can only be done in the cloud and very likely that will be the case for a great many years. Again, the question is how do we take some of those learnings and apply that to our on-premises environments? And it could be that actually we don’t need a large language model. We actually might need many small language models. So how do we build an environment that is able to ingest elements of the public cloud, of the model that’s in the public cloud and apply it for our own data? I think that’s the key. The challenge for organizations, they can become sort of paralyzed by, I dunno where to start. The important point is just start. Just do something. Because the sooner you get going, the faster you’re going to learn. The faster you’re going to perhaps fail or make some mistakes and then learn again and do it again. And the faster you’re going to get to a kind of maturity in terms of delivering some real capability to the business.
Analyst Jean S. Bozman, president of Cloud Architect Advisors, explains how evolving traditional IT to hybrid cloud and enterprise AI forces IT teams them to manage complexity, acquire new skills and manage a myriad of costs.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Jean Bozman: It’s amazingly well accepted. It’s not controversial. Hybrid multi-cloud. You cannot almost go to a tech person that wouldn’t agree with that statement. There’ve been different terms. There was hybrid cloud than they said because there were multi-cloud. It’s hybrid, multicloud. I think it’s an admission. That data is everywhere. And so I’ve distributed data and that was fed by the fact that we had the hyperscaler guys. Some people call ’em CSPs hyperscale, where the big guys know who they are. And the data is not just sitting in one monolithic place, it’s sitting here, there, and everywhere. And even the people who used to think that it would just be on one or two systems, it is not that way anymore. Anyway, so it is a fact of life, but the question is how do you live with it? It’s that way. How do you live with it? How do you get the two things that have been running in parallel, which is distributed, we know that’s happening, but also the traditional enterprise stuff. How do you get those things to sync up and work together? And I think a lot of what we’ve heard here is about how do you get those enterprise capabilities, manageability, all the things we’ve always had to have and how do you make that happen in a world that may otherwise seem chaotic?
[Related: Stepping Stones to Cloud]
This is a challenge for the enterprise where people say, Hey, that’s not how I’ve been doing things for 20 years, or Hey, I didn’t learn how to do this, or I need these new skills. So there is a skills challenge and there’s also a cost challenge because we know what we were doing and the thing we are doing seems additive, but now we really want to kind of embrace everything and do it all at the same time. People were living separately, right? You had the people who always advocated for distributed and lots of little databases here and there, and that was cool. Especially forgive me for my sins, but the open source movement. So fun. But it’s okay to have fun, but you also need to run a company. So you need to put those business best practices. I want to say the best practices to work and that’s what could be a chaotic environment, but should be a smoothly running, unified environment.
[Related: Managing Enterprise AI Sprawl]
A lot of the AI stuff comes out of the same kind of people that have been doing the open work, but it’s applying, I think a new rigor to it. And also there is the demographic piece. I’m absolutely going to talk about that. Where traditional IT has been running for, what, 40 years or something like that. A lot of these things are a sudden shock to systems that have been reliably in place when you talk about let’s do backups, let’s do security. It was done a certain way. All that’s having to be adjusted, I think, and that’s clear to people.
[Related: 4 Trends Defining the Future of Enterprise AI]
AI was kind of, I don’t know, it was almost a shock to people. All of a sudden, it’s in your face now what do I do? I’ve got lots of data. I’ve got these models. I know other people here. We’re talking about the models and where they are and who’s going to do it. And there’s a very big difference in training the models, which takes up a lot of CPUs, GPUs, software. But there’s also the inference stuff, and that can be customized to your business. Healthcare, retail, finance, it’s customized. And also it’s easier to get your arms around it than trying to take in everything that was ever written just to write a haiku. That’s not an enterprise thing by itself. It can fit into the enterprise. People writing things, people being creative, but it’s not enough. There’s a lot of rigor that has to come around that controls guideposts and all of that.
[Related: Enterprise IT Teams Jump Into AIOps]
All the things we were always careful for all these years. So AI is tremendously exciting to people. By the way, I’ll give you my controversial statements, which is Tech GT is great, but AI is much, much bigger. We had ai. AI was in the background doing data management, finding financial fraud, looking at medical records. That wasn’t sexy enough. But now it is more sexy. It’s in my office, I can see, oh ai, that’s great, but it’s not enough. It has to blend in. Great tool, wonderful to learn about and use. Very useful, but it needs to mix in with everything else that’s been developing over the last 10 years.
In this Tech Barometer podcast, go behind the 2025 Enterprise Cloud Index findings numbers with Nutanix AI and cloud native technology experts, who explain current trends and challenges impacting CIOs and IT decision makers.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript (edited):
Debojyoti “Debo” Dutta: Wearing my optimism and imagination hat, enterprise AI will get their act together and will accelerate with better infrastructure to land gen AI workloads for the enterprise users. I absolutely believe that. And also, in order to do that, they will reskill themselves. AI will just become another workload. It’s just new today, but it will become an IT workload. So today’s IT manager will actually become an AI manager tomorrow.
Jason Lopez: Debo Dutta is the Chief AI officer at Nutanix. This is the Tech Barometer podcast, I’m Jason Lopez. Let’s talk ECI… the Nutanix Enterprise Cloud Index. The index is a global survey of IT decision-makers on cloud computing, hybrid cloud adoption, and IT infrastructure. It’s a resource to benchmark cloud strategies, to understand industry shifts and basically address the question, do I have the right infrastructure. This 7th annual index shows some interesting things about how IT is dealing with AI. One of the major findings is that 95 percent of customers say gen AI is changing their priorities and 90 percent say that security is a top concern.
Lee Caswell: That’s really important for Nutanix customers and prospects.
Jason Lopez: Lee Caswell is senior vice president of products and solutions marketing at Nutanix.
Lee Caswell: How do they take these LLMs (large language models) from the public cloud and then basically have them run securely on private data, either in their data center or with inferencing out of the edge?
Debo Dutta: Deploying a model in a private infrastructure where your team has complete control, that solves a lot of the problems. And then your team can select the right models that kind of pass a bunch of benchmarks that your teams decide that these are the qualities that the model should have. And that can be done today.
[Related: Report Shows Enterprise AI Driving Big Investment Burst in Cloud Services]
Jason Lopez: Debo reminds us that AI models don’t just process data, they absorb and internalize patterns from it, which creates new risks that traditional security and governance measures were not designed to handle.
Debo Dutta: Once you train a model with your own data, your data is still properly governed, but if you don’t govern the model itself, it can be used to reverse engineer your data in many cases, which means now you need to extend your corporate governance to models themselves.
[Related: Building a Solid Enterprise AI Infrastructure Strategy]
Jason Lopez: The data from the ECI report includes highlights such as, 94 percent of those surveyed said they benefit from cloud native applications. Almost 90 percent said they’ve containerized their applications, and that proportion is expected to grow with the emergence of gen AI.
Lee Caswell: It could be that those containers are running in the public cloud. What we’re expecting, right, is this onslaught, this wave of containers coming on. Our NKP products, of course, are a huge beneficiary of this as we go and offer container management to our customers.
[Related: DataRobot CEO: Bridging the Gap Between AI’s Promise and Fulfillment]
Jason Lopez: Caswell said more organizations are moving toward cloud-native applications for scalability, security, and hybrid cloud management. Gen AI is a major piece of this as companies rapidly adopt it. ECI findings show that only 2 percent of companies surveyed said they have not begun a gen AI strategy, but over 80 percent have one. For some background, we interviewed the leader of cloud native product management for Nutanix, Dan Ciruli, who talked about the foundational principles that made containers essential in the first place. He said cloud-native computing enables companies to quickly make and deploy software.
Dan Ciruli: There are lots of other benefits too. As it turns out, it can be much more scalable. The cloud-native computing really started with companies like Google and Twitter and Airbnb, early web-scale companies who were building software in a new way and realized that running on commodity hardware, and that was very important at the time, running on standard Linux boxes, Google was able to build the most scalable, performant, and reliable piece of software anyone had ever seen. It was before we created this term cloud-native computing, but it was containerizing applications so they can be deployed very reliably, and then using some sort of container orchestrator to put those on compute nodes without the developer ever having to get involved in using automation. Cloud-native computing, fundamentally, is a set of technologies and practices that let you ship software faster.
[Related: Orthogonal Advantages of Cloud Native Technologies]
Jason Lopez: Ciruli said cloud-native computing really started a little more than a decade ago with the project Kubernetes. It has turned out to be the de facto container orchestrator platform.
Dan Ciruli: For the first five years or so of its existence, it was almost a science project, but at some point, a tipping point was reached, and as an industry, people decided this is the new way to write applications, and for the last five years, virtually all new applications are being written to be deployed this way. Well, gen AI, really, AI has been around for quite a while, but generative AI is new. I just said all new applications are written to be deployed in this cloud-native fashion, which means all the gen AI applications, virtually everything that’s being done in this space is happening in Kubernetes. It’s very scalable. It has been happening in the last several years, so kind of by default, all these new applications are written to run in containers
[Related: Enterprise AI Reality Check: Implementing Practical Solutions]
Jason Lopez: Before containerized applications… it was the era of virtual machines. Enterprises used tools in a VM ecosystem to handle things like application development, networking, and security.
Dan Ciruli: Those are the kind of tools that have spent 20 years developing in the VM ecosystem, a vast ecosystem of tools to help people understand the storage, the networking, the security, the health of their VMs, and so now there’s a whole second set of tools that do those same things for these container-based applications, and so I think, again, that 80% of people are saying, hey, help, now we’ve got a much more complicated landscape than we used to, so we need tooling to help with that.
[Related: AI, Cloud Native and Hybrid Cloud Fuse to Run Apps and Data Anywhere]
Jason Lopez: One more highlight from the ECI, 52 percent of organizations said they’re going to have to basically increase training in order to meet the demands of deploying and managing AI.
Lee Caswell: Makes sense, right? You’ve got new AI hardware elements for GPUs, right, or even CPUs. You’ve got new LLMs, and how do you take those new LLMs? Our NAI product, right, terrific for that, so a great opportunity now to take these new trends and translate those into actual prospects and sales.
Jason Lopez: Debo Dutta talked about the skills gap regarding AI and said it depends on a person’s role. For technical professionals like software engineers, it could mean using AI to help with software development, or learn more AI principles and how systems function and integrate into larger architectures.
Debo Dutta: If you’re not a computer scientist, you still need to learn AI to do your current job better, and that involves techniques like prompt engineering. How do you prompt AI to write better emails, to write better summaries of the context that you provide, and so I believe that there’s a whole new set of skills that can be learned by everybody, whether somebody’s technical or just trying to use AI to be more productive.
[Related: Nutanix Builds GenAI App to Empower Sales Team]
Jason Lopez: And as the Chief AI officer, he’s witnessed the learning curve firsthand, with a group of engineers who knew machine learning though not the new gen AI.
Debo Dutta: I built a team from scratch where we trained everybody. We all learned together the basics of gen AI, but we all knew how to build systems and we kind of pushed the envelope on the job. We all picked up gen AI skills very rapidly within the company. Now we are proliferating this skill set across the board. We have now a team building a chat bot for our SREs that was all built, you know, homegrown.
[Related: Enterprise IT Teams Jump Into AIOps]
Jason Lopez: Debo says as Nutanix’s engineers are getting better at AI through in house training, there are excellent resources outside of the company.
Debo Dutta: There is a lot of information and especially courses available for both engineers and non-engineers to really get proficient with AI. There are generic courses, if you Google generative AI for everyone, which I highly recommend on Coursera, that would be a great place to start. Then there are courses specifically for prompt engineering that will allow anybody to just pick up prompt engineering and start using the current AI models and be very productive at their job, whether somebody’s an accountant or an EA or a writer or just a middle school student like my teenager. Everybody can get productive.
[Related: Managing Enterprise AI Sprawl]
Now, when it comes to engineers, there’s a plethora of courses. If you look at any top-tier US university today, their bachelor’s and master’s program, you will see a lot of introductory courses that start from a very simple material in the space of AI and go very advanced very quickly. So the next generation of engineers are being minted as we speak to fill that gap.
Jason Lopez: Debo Dutta is the Chief AI Officer for Nutanix. Dan Ciruli is the head of cloud native product management for Nutanix. Lee Caswell is senior vice president of products and solutions marketing for the company. This is the Tech Barometer podcast. I’m Jason Lopez. Thank you for listening. Joanie Wexler’s article which reports on the Enterprise cloud index, Study Shows Big Uptake of Enterprise AI and Cloud Native Technologies, is at the The Forecast website. You can find it at theforecastbynutanix.com.
In this Tech Barometer podcast interview with Induprakas Keri, senior vice president and general manager for hybrid multicloud at Nutanix, learn why hybrid cloud IT systems help enterprises evolve their use of AI applications and data.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Induprakas Keri: The only place on the planet where you have enough computing power to create a foundational model is a public cloud.
Jason Lopez: This is the Tech Barometer podcast. I’m Jason Lopez. Induprakas Keri, general manager of hybrid multicloud at Nutanix, says within the AI lifecycle, there’s a minefield for it. AI deployment spans across different infrastructures for each of its three parts, training, augmentation and inferencing. The gist of this story is how these parts challenge the deployment of ai. So starting with part one, the training, this is where the foundational model is created. Keri says, public clouds are the place to do this because of the massive compute power needed, like a lot of GPUs, which you find on AWS Azure or the Google Cloud. In our interview, Keri described the first phase, the training as akin to the gargantuan effort of creating a new language. We move on to the second part of the process where the model undergoes augmentation.
Induprakas Keri: If you train a public foundational model with your proprietary data in the public cloud, you have basically given up ownership and control of the data. It’s now baked into that model and you can’t do much about it. And so what a lot of organizations are going to do is they’re going to take that foundational model, they’re going to augment it or do this thing called retrieval augmented generation and have that happen on-prem so that the data that they control or they own that is really specific to their own success is not in the public cloud. It remains proprietary and it remains under their control, so that creates this new model that, for example, you might have a generic foundational model that does support responses, but you might train it with your own data that makes it much more specific to your business or your sort of products.
[Related: Building a Solid Enterprise AI Infrastructure Strategy]
Jason Lopez: The third part is inferencing. Here, Kere circles back to the language analogy.
Induprakas Keri: Somebody invents the French language, but then the French language is spoken by 50 million people or a hundred million people, and so some group of people spent a lot of effort creating the French language, but it was maybe 20 people, 30 people, 50 people, a hundred people, and they put a lot of effort, but then the usage is in millions day after day after day after day. The law of large numbers I think applies here. Inferencing, which is using the model to make decisions, is something that you do millions of times. If you then save the energy that’s used in the usage and the inference in by let’s say 30%, you then save that energy, not once, but a million times or millions of times.
Jason Lopez: He says most organizations which want to establish AI can’t be choosers, meaning they can’t be rigid about preferring one type of cloud over another.
Induprakas Keri: You can’t say that I’m only going to do things on the public cloud or only on the private cloud because typically most organizations, unless you’re a Fortune 5 company, you’re not going to have the compute resources to go train foundational models and you need to go depend on the public cloud. But by the same token, you probably don’t want to train the foundational model with your specific data in the public cloud, and you certainly want inference close to the edge, which may and may not be in the public cloud. Sometimes public clouds provide inference and endpoints, but most often they’re at the edge where the decision needs to be made because of latency reasons or other reasons.
[Related: Building a GenAI App to Improve Customer Support]
Jason Lopez: Keri emphasizes that open AI’s foundational models while taking the world by storm exposed challenges to it and deploying these models in production. Companies need to make choices to avoid just throwing their data out there. You have to have a plan. In his job managing Nutanix’s hybrid cloud, Keri says there’s a big advantage to having the options hybrid brings like running AI over public cloud or on the company’s own infrastructure. This makes hybrid ideal for AI. A hybrid approach allows businesses to refine models in the public cloud and then move them to a private cloud and maintain control over sensitive data without exposing it unnecessarily.
Induprakas Keri: As users have become more aware of model capability, I think this whole notion of public data versus proprietary data has also started to become more of a consideration. Once they realize that there’s a clear boundary between private data and public data, and once they realize that they need to make sure that any foundational model they need to find a way to take a snapshot of that, create something that’s more in-house, the blast radius of training that with data is limited, and then I might want to go optimize that model so that I can deploy it for inferencing.
[Related: Study Shows Big Uptake of Enterprise AI and Cloud Native Technologies]
Jason Lopez: In talking about AI, Keri boils it down to math and describes it as performing lots of matrix vector multiplications in sequence that gradually transforms raw input data into something meaningful. For an analogy, he draws upon Isaac Asimov’s Foundation trilogy. In the story, there’s a fictional science that blends history, sociology and mathematical statistics to predict the future behavior of large populations of people.
Induprakas Keri: AI seems a little bit like that. I think it’s exceptional for predicting average behavior or generally a particularly prevalent pattern of behavior, but I think that’s also its limitation. The way that these converge, the way that a lot of this linear algebra operations converge is different from how humans reason.
[Related: Bridging the Gap Between AI’s Promise and Fulfillment]
Jason Lopez: He points out. Human reason is based on a kind of self-awareness. Humans have a view of the world, a top down view.
Induprakas Keri: Whereas recent AI, what it’s really done is take data and get structure from that, but without something that provides a top down view of the world. Newton didn’t come up with the laws of gravity by running regressions. It’s not like he took a billion apples and then sort of threw them from a billion trees or watched a billion apples fall did regression and said, oh, wait, there is this thing. He came up with a model and then he ran experiments to validate the model. Generative AI is definitely missing that, and I think unless you have a model of the real world, you’re always done to fall short. I think data only can give you so much insight.
Jason Lopez: Successful AI adoption is not a sure thing, particularly during the experimentation phase, but organizations are under pressure to invest in AI infrastructure quickly to avoid being left behind, even though it’s unclear which use cases will ultimately be successful. Fraud detection and AI copilots are too familiar use cases.
Induprakas Keri: Support is another one. I think if you go talk to a lot of online agents right now, they will interact with you in a very human light way, even though they’re really powered by an AI chat bot, but beyond those three, there’s a lot of fomo right now. I think organizations want to believe that AI is going to transform their business and they don’t want to be settling in that race.
[Related: Future of AI: 9 Predictions for IT Innovation]
Jason Lopez: He says the belief that a substantial investment in AI will pay off doesn’t yet match reality across various use cases, especially in early stages of adoption.
Induprakas Keri: I think what you really want to do in this phase of experimentation is you want to shorten the time to outcomes. You want to make sure that with the least effort possible with the least amount of hardware, infrastructure, investments or training or what have you with the least amount of effort possible, I can gain that insight that I can then scale, and I think that’s what we are trying to do for our customers. You don’t need to spend six months setting up your infrastructure. You don’t need to spend three months setting up your Kubernetes environment. You don’t need to worry about what happens when you take this model that you have trained inside the data center and take it to the edge and all of a sudden find 75 issues because it was a different hardware platform. Every time you interact with chat GPT, for example, you are with your insights. My son was looking for a booth summary the other day. Chad GPD produced something that was very stylish but completely wrong, and then he spent like seven minutes fits in it, and I was telling him, you’re making chat g PT better, but you’re not getting any value from that.
Jason Lopez: It’s a lesson for businesses.
Induprakas Keri: All you have to do is look at how much money OpenAI spends in terms of running its model. I mean, that’s not sustainable if you are even a hundred million dollars business,
Jason Lopez: And he says the massive data sets needed to train AI present this issue. When one person uses data, it doesn’t stop others from using it too.
Induprakas Keri: Data is non-rival risk. It’s an economic term. If I give you a phone for example, I might be able to kill that phone remotely, so that phone all of a sudden becomes useless, but if I give you a piece of data and if you write it down or if you make a copy of it, there is no secret button that I have that allows me to do an auto destruct on the data that you have.
Jason Lopez: Keri is confident that the ability to isolate parts of a model, not meant to be broadly shared, get better.
Induprakas Keri: It’s going to be hard to filter out public data from private data once the model has been produced. Unless we solve that problem, I think enterprises are going to be cautious in terms of how much private data they’re going to expose.
[Related: Role of CIO Expands with Enterprise AI]
Jason Lopez: AI models operate on a stack of hardware and software. The software stack, often open source and containerized runs on a software-defined infrastructure in a hybrid cloud. It brings together things such as storage, compute, power, networking and management tools.
Induprakas Keri: If you have to take that software infrastructure and run it on one platform in the data center and another platform at the edge and a third platform on the public cloud, then it’s your job as an IT organization to make sure that it runs the same way on all those three different infrastructures at the same level of performance and management and usability and all of that.
Jason Lopez: A software stack that works across public clouds, data centers and edge environments makes deployment and management easier. Workloads can be moved between infrastructures with minimal friction,
Induprakas Keri: Even though all the components that you need for running an AI model are containerized. It takes a lot of effort to put all those different Kubernetes components together, and so the pathogens of all those different components, making sure that they work together, making sure that they’re optimized for performance and the underlying hardware infrastructure, we are able to make that drop dead simple, and that’s the value for organizations that are looking to do a lot of experimentation with AI really, really fast.
[Related: Speeding Software Development with AI-Assisted Coding]
Jason Lopez: The interview we did with Keri unfolded along the lines of avoiding large AI investments toward an uncertain goal and toward the advantage of a software-defined infrastructure.
Induprakas Keri: Which means that storage, compute, networking, management, they’re all defined through APIs, they’re all controllable through APIs, they’re all managed through APIs. They’re governed through APIs, and so what that really does is that you can stand up an infrastructure and then you can change the behavior of that really simply by writing code that inverts those APIs. Let’s say that I find out that I need to rethink my cluster because I have too much compute and not enough storage, so then very simply, I add half a dozen storage heavy nodes and I rebalance the storage and compute needs of my cluster to be able to run this model really well, and I can do all of that through software.
Jason Lopez: Induprakas Keri leads the Nutanix Hybrid Cloud team. This is the Tech Barometer podcast. I’m Jason Lopez. We’ve got more tech stories covering enterprise computing and IT technology at the forecast by nutanix.com.
In a video interview with The Forecast, DataRobot CEO Debanjan Saha discusses the need for finding value and building confidence to achieve enterprise AI success.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript (edited for readability):
Debanjan Seha: I was in a Morgan Stanley investment conference in San Francisco, and of course every investor quizzed me about ChatGPT and GeneAI. On the way back, the Uber driver quizzed me for half an hour about ChatGPT. And I realized that AI has arrived. But there are limitations to what some of these models can do. So what are those models doing? I mean, we have trained them on a really, really vast amount of publicly available data and sometimes on proprietary data. And once you run out of those data sources, there is a limit to how those models are going to get better and better over time. Of course, there will probably be better and better models, but I don’t think it can get incrementally better for an infinite amount of time. That’s not going to happen. Now, we are already pretty much fed all of these models with all the written text data that humankind has produced over the last hundreds of years.
So there is not too much text data left that you can feed these models to. What is left, by the way, is a lot of audio and video data, and that data is much easier to collect. And there are a lot of things which you don’t write down. For example, when you lift a cup from a table, nobody writes it down, but there are a lot of videos which show how we go and grab the cup and pick it up from the table. So those are the kind of data sources which are now going to make these models more and more intelligent. But I do think there is a limit to which you can feed them information and make them better.
[Related: Building a GenAI App to Improve Customer Support]
I see two gaps that we are really focused on. One I call the value gap. People are spending a lot of money training models, but ultimately those models have to solve some business problems. They have to make things more productive or predict things more accurately or whatever it is. Business value has to justify the investment that’s going in there. And it’s not easy with AI to create that business value. And one of the things DataRobot does very well is to connect business problems with AI to solve them. So that is the first problem that we are focused on. The second thing, which I also see with any new technology, is you need to build trust. AI is kind of in that phase and there is a confidence gap. There are a lot of people who are creating, especially with GenAI, a lot of prototypes.
[Related: Enterprise IT Teams Jump Into AIOps]
It’s not difficult to put together a chatbot which answers some questions. It’s hard to guarantee that they’re going to answer the question correctly, that it’s not going to create any misleading answers or create harm in more serious cases. And there are a whole lot of things we need to do in terms of managing the risk and creating a framework where you can define and associate risk with various different types of use cases and handle them with the right level of mitigation, compliance, testing and validation, et cetera. So those are the two things which are very, very important for wide scale adoption of AI.
[Related: Role of CIO Expands with Enterprise AI]
For example, the value gap. So the most interesting and most challenging thing about the value gap is that you need people who understand the business and the business challenges that they’re trying to solve. And you need people who understand AI and how those two things can be put together in order to solve a business problem. So we do ideation workshops with our customers. We sit down with customers and their people who understand the business and work with them to figure out their business challenges and what use cases they have. And then our team works with them to figure out how to address those use cases. Do they have all the ingredients…the right datasets? Do we know what business processes need to be updated if we insert AI into that? Those are the things we do first. Then people can use our platform either themselves or we can help them as co-pilots. And we sometimes have our other partners, the service provider partners, to work with them to solve those business problems and actually build those models, build those applications, and then put them in production.
Pretty much every industry you go to, there are enough problems that AI can help solve. And pretty much every business line you go to, there are enough problems that AI can help solve. But bringing AI to business, that’s still not easy for everybody because you need to speak both AI and the business language. And it’s very difficult to find people who speak both. So you have to have two in a box and solve those problems.
From the publisher's feed