
Sign up to save your podcasts
Or


In this Tech Barometer podcast, four IT industry experts discuss trends and early best practices shaping IT sustainability strategies.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Jason Lopez: The sound you’re hearing is in the room at a press conference on IT sustainability, which was done at .NEXT in Chicago in 2023. You’re listening to the Tech Barometer podcast. This was a gathering of journalists in a round table setting, sitting elbow to elbow with subject matter experts, Chris Kanaracus, Research Director of Cloud and Edge Services at IDC, Steve McDowell, Principal Analyst with NAND Research, Harmail Chatha, who oversees data centers at Nutanix, and Steen Dalgas, who at the time of this recording was a London-based cloud economist for Nutanix. This session wasn’t necessarily closed door, but it wasn’t being recorded, and we thought we’d step in just as it started with a Zoom recorder to capture it. It starts off with Steen talking about the focus on frequent hardware upgrades to boost business productivity. He says it’s short-sighted. Instead, he sees a major shift toward software-driven innovation, which extends the life of hardware and scales to meet growing demands and growing sustainability strategies.
Steen Dalgas: I looked at the car industry. They’re much more mature in terms of their sustainability dialogue than we are in the IT industry. So the topic there was embedded emissions, which is the emissions in the manufacturing process. This whole area in the IT industry is not being actively considered. I mean, I used to work at IBM. So you think about the business model of all the big vendors, their hardware vendors. They have this sort of strict end of life, and it’s all about trying to effectively force customers, if you want innovation, to buy new hardware. And the Nutanix approach is completely different. So we come up with the approach where actually the hardware piece is commodity, and all the innovation should come from the software layer. And that’s more sustainable by design. So what that means is every six months, our customers get new features to deliver through the software, and we make the upgrade process really simple. And actually what happens is when we deliver a new upgrade, often the hardware performance improves as a result of the software design. I personally don’t believe the numbers I’m seeing from the hardware vendors in terms of embedded emissions. They’re saying it’s like 10% of the life cycle. I don’t believe those numbers because I’ve seen other evidence that it’s actually a lot higher.
[Related: AI Reorients IT Operations]
So the embedded emissions are the emissions from manufacturing, assembly, and then shipping. And that can often happen. The assembly can be in a different country. So you’re shipping to two different countries. And if you’re talking about three-tier architecture, the server is made in one country, the storage, the networking, and they all have to be assembled together. You’ve got emissions every time you refresh.So the obvious answer is to extend out the life of hardware and deliver innovation through software. So this wasn’t a Nutanix designing this to be sustainable. This was a smarter way, because we want to get away from this forcing customers to buy new hardware every five years and actually extending out the life of hardware. And we know that the hyperscalers are going down the same route. They’re looking to extend out the life of assets up to six, seven, eight years. And I’m working hard with our internal folks. The one issue that we have in Nutanix is you’ve got to test that the software works on the hardware. So we’re actually going beyond end of life. And we can see, so the future is that hardware life will be extended out. And the hardware vendors don’t really want to hear that, but I think that’s, I think, where the industry should be going.
Steve McDowell: Yeah, so I agree with everything you said, right? And I look at it from the bottom up. Technology is intrinsically dirty. Data centers consume something like one and a half percent of the world’s energy. I saw a statistic when I was preparing for this that it generates almost 1% of the CO2 every year in modern times. We’re not going to get off that train, right? We need this technology. We just need less of it. And the way you get less of it is to optimize its usage, with cloud I’m sharing a CPU among X number of instances. With technologies like Nutanix delivers, I’m optimizing my workloads and consolidating them. And that’s a sustainability play. And it’s not a save the planet play necessarily, because industry’s motivated by profit. But there’s regulation in the EU, there’s regulation emerging in the US. 89% of institutional investors look at ESG stories when they invest in technology companies. Yes, they’ll save the environment, but there’s also a huge profit motive to do the right thing. And the way you do the right thing is to efficiently manage your resources.
Harmail Chatha: Well, I feel like we’ve been trying to tackle edge community for like 10 plus years now. That’s still a very hot topic. Everyone’s creating these edge data centers and what does that really mean?
[Related: Building Scalable, Sustainable Data Centers]
Jason Lopez: Harmal Chautha illustrates that the world of IT is evolving rapidly. As data center hubs connect with more dispersed computer resources, such as branch offices, franchise stores, warehouses, or manufacturing plants powered with robots and thousands of connected devices.
Harmail Chatha: Prior to the last couple of years, it was a few hundred kilowatts was your edge. And now we’re pushing it to a megawatt plus is becoming your edge. We conducted our enterprise cloud index study with over 1500 IT decision makers globally and 92% are saying their top of my initiative is corporate sustainability and how do they tackle that? And I think the same conversation holds up. How do you optimize your infrastructure, reduce your footprint, even if it’s at the edge or it’s at your core data center? How do you get away from this three-tier architecture? Consolidate the infrastructure, eliminate the waste and the over-provisioning that happens in a typical three-tier architecture. You’re definitely going to over-provision on compute, you’ll over-provision on network and storage. So how do you eliminate that? You should only be deploying what you need, not over-extending. With the Nutanix infrastructure, even if it’s at the edges, you buy what you initially need, then you scale out. And you maximize that utilization of it and you can build metrics at one point, do you expand the cluster or not? And that inherently will reduce your carbon footprint as well because you’ll be consuming less power and less resources. So wherever the play is, whether it’s in the edge or primary or robo-offices, just this notion of consolidation is tremendous. And going to, again, to Steve’s point is, optimizing at the software tier and then extending the life of the hardware.
Jason Lopez: It’s becoming more important, the shift to software-defined IT strategies, which leverage hybrid multi-cloud resources. Chatha says the mindset today is centered around maximizing resource efficiency in the face of growing demands for more powerful computing resources.
Harmail Chatha: We’re testing GPUs in our environment with our software. And of course, they’re very power-hungry, they’re very intensive. But it goes back to that same point again, is how do you make use of consolidation versus just expanding horizontally? We have this notion in our data centers when we designed them in 2018, they’re optimized for vertical growth rather than horizontal growth. We recognize a 68% reduction in OpEx, CapEx by optimizing vertically versus horizontally. The IT initiative has to be optimization rather than playing it safe and buying so much hardware, so much compute, storage and network, and over-provisioning. And that inherently has been the go-to model in IT versus now IT is having to refocus and say, okay, how do we optimize within the stack rather than horizontally at the hardware tier?
[Related: Making the Future of Streaming Media More Sustainable]
Steen Dalgas: I’ve just been working on a case for the last three weeks on an edge case in partnership with a data center company. And what that highlights is Nutanix doesn’t have all the answers, the data center companies don’t have all the answers. It’s all about how you can leverage the best team and each individual player brings their best foot forward. So on the data center side, we’ve started working with a, in the UK, a company that’s come up with a pod-like design. So traditionally, if you go to a co-location data center, you’re limited to five KBAs, that’s pretty industry standard. What that does is it limits the design because you only fill the rack a quarter full. But this company’s come up with a design of 20, so 20 KBAs, so we can actually fill out the whole rack. It’s a two-part design, so you have a rack of servers, HCI servers, and then a rack of all the data center infrastructure. That would be really well-designed for edge AI-type cases. And it can just sit in a car park. And from a cooling perspective, it’s incredibly efficient. So with air cooling, they’re at 1.3 PUE, but you could potentially put liquid cooling into this, which would bring it down further. So this is the type of innovation partnerships where the HCI form factor of our software, our design, plus a really good data center, innovative partner, could create a brilliant solution. And if you compare that to traditionally, you’re going to be looking at racks and racks to fit within the normal rules. So this is how we need to go out to the market, find the best partners, and then bring these solutions to our customers.
Steve McDowell: And the hardware guys are not ignoring this either. As Steve just said, we’re pushing liquid cooling to the edge. I’m involved in a project now that’s using two-phase emerging cooling, where we’re putting a megawatt and a half into a rack about the size of a freezer in your garage. So we’re driving that down. And to put a number on it, 20 to 25% of data center IT is for heating and cooling. So while we’re driving consolidation with intelligence software, we also need to solve the cooling problem. And we’re pushing on that from a different direction.
[Related: The Amalgamation of AI and Hybrid Cloud]
Steen Dalgas: We have a huge problem globally with legacy IT. It’s incredibly inefficient. So if you went from a legacy infrastructure to an HCI in a new data sensor, you’re going to see a 80% reduction is pretty normal. Can we get companies out there to make that plunge?
Harmail Chatha: Well, I think the other thing is, hardware providers, software companies like us can continue to push the envelope, but are the data centers keeping up well? Some of these legacy data centers don’t have enough power to support vertical growth in the rack, and don’t have enough cooling to support that. So then you’re stuck at single-digit KBAs, whereas companies now are definitely going to liquid cooling and pushing the envelope even further, but then data center providers have to do their part.
Jason Lopez: The conversation moved to environmental responsibility, and how it’s becoming a crucial component of business strategies. There’s the rising cost of energy. There’s the increasing cost of maintaining legacy hardware inside data centers, which can hamper sustainability efforts.
Harmail Chatha: All of the European data center providers are definitely pushing the envelope on this. They’re a lot more ahead of the game, I feel, than the U.S. data centers, as far as just innovative technologies, innovative design. For them, sustainability is very top of mind, versus in the U.S., we personally seek out data center providers and partners that want to minimize the environmental impact, that have innovative solutions like water reclamation, that are offering renewable energy options. And I feel like the U.S. market just hasn’t caught up, besides a couple of top-tier providers that we work with, versus the rest of the, well, especially Europe. I don’t think AsiaPAC is definitely there.
[Related: Rapid Spread of Hybrid Multicloud IT Drives Need for Simplification]
Steen Dalgas: We’ve had the energy crisis in Europe, so we’ve seen the cost of energy go up almost five times. Really focuses the mind to suddenly, so I do total cost of ownership models. Energy is now the single biggest expense item now in the IT budget when we’re looking at infrastructure. So it’s cost-driven, yeah. So another thing that we’ve seen in Europe, which is all around the same area, so climate risks are now becoming a business resilience issue. So in the U.K., you’re designed to run at a certain temperature range, based on the sort of standardized models of climate. And those climate models don’t apply anymore. So it’s been broken in the U.K. So we had a 42-degree day. The impact of that was, so Google’s data center in the south of England went down, which took down one of the Challenger banks. It also had impacts in other regions as well. And one of the big hospitals in London had a failure of its production and DR data centers. And the impact for them was, they were on paper records for two months. So you can imagine the stress it puts on the staff and the impact on the patients. And there was a big cost impact as well. And that’s because that’s a legacy design data center. And the more infrastructure you have, the bigger the physical footprint you have, the more cooling you need. Those are the types of data centers that are more susceptible. So this whole sustainability piece I’m trying to highlight is a business resiliency issue.
Jason Lopez: Next, transforming IT infrastructure with a Nutanix customer in India. Harmail Chatha outlines how HCI technology reduces costs, emissions, and complexity.
Harmail Chatha: In working with Nutanix, they’re able to reduce their cost by 43% over five years versus traditional three-tier. They’re able to reduce their data center emissions by 80%. And they’re able to reduce their data backup management by 100%. So what’s happening is, IT just needs to rethink and refocus and modernize of getting off the traditional three-tier and moving to something that’s more efficient like HCI models. And with HCI, you don’t have just the option to reduce your physical footprint on-prem, but you have so many options, whether it’s your private data center or your colo or even public clouds. For us, I mean, the ecosystem has evolved so much now. You can get away from that traditional DR strategy of having something remote in a different data center versus now we have a product called NC2. You can offload your critical VMs right back to the public cloud and have them in a hybrid mode there, sitting there versus just running infrastructure that’s doing nothing, literally sitting idle on-prem. So I think it just needs to be a refocus of not focusing too much on, this is the way we’ve always done things and this is the way we’re going to continue to do things and really go out and seek innovation and opportunities to improve. Sustainability is a great starting point, but really it’s just our entire world runs on apps and data. And when you have issues like Steve was describing in the UK where the hospital’s offline for two months, that’s very critical.
Steen Dalgas: There’s a story just to illustrate that. So in the UK, one of our customers is the 999 service. So if you have an emergency, you ring them up. And they did things the wrong way around. So they decided to modernize their data center and then once they did that, they then decided to choose their IT partner. They then built this great, huge new data center room, went to Nutanix and we were a one rack solution. So you have a huge data center with a one rack. And this is what I mean is that you’re bringing a legacy mindset to solve a problem that you’re not taking advantage of the modern innovation. You have to do it in reverse. So think about what you’re going to have in a rack and then the data center and do that together, not separately.
[Related: Creating AI to Give People Superpowers]
Steve McDowell: But there’s also a trend, too, of thinking less about the infrastructure as an IT guy. Cloud is driving this, right? We all think about cloud as someplace we can park resources. But we’re also seeing the emergence of things like HP GreenLake and Lenovo TrueScale, consumption based, where it’s in their interest, the technology providers to keep your technology current.
Chris Kanaracus: Cloud cost optimization and sustainability are linked topics, but I kind of look at it from the optimization side a little bit differently. I look at more from the IT buyer perspective of cloud services they’re buying and how they can buy them and where they can buy them. It’s a reward in a really new era. I think if the first era of cloud was about speed of adoption and using that scale and so forth, then you had all the waste and you had people finding out, ooh, I’m not using the cloud efficiently. I really think we’re in an era of cloud cost optimization really in the forefront. There’s a lot going on and I’ll give a couple of examples. One of the big pushbacks that customers have made, and we always hear from them, is from egress fees from the cloud providers. They hate paying data egress fees. Every single customer call I take, if this comes up, and have you guys heard of the Bandwidth Alliance? This is a group of companies that work with CDN providers and they kind of agree to waive or deeply discount egress fees to their joint customers, and that’s really good, and AWS is holding out. They kind of have not gone that direction yet. They need their margins to stay high and so forth, but that’s one example, but a more recent example is just more density in options for running your workloads around the world. It isn’t the big three anymore. I don’t know, Equinix on bare metal with VMC, that’s one example. Oracle’s trying to do, and it’s very new with Alloy, where they’re licensing their cloud whole stack to partners around the world, and they can rebrand it, white label it, and you own the customer relationship. Is it going to be cheaper? Possibly, because when you have more options to run your workloads, like any market, things have to go down. There’s much more work on portability. It’s just we’re in a good place for that. The problem isn’t solved, but we’re in a good era where we’ve built out this universe of cloud computing, but now people are really starting to and are able to optimize it for real.
Jason Lopez: Chris Kanaracus is Research Director of Cloud and Edge Services at IDC. Harmail Chatha is Senior Director of Global Cloud Operations at Nutanix. Steve McDowell is Principal Analyst with NAND Research, and Steen Dalgas is with Nutanix, and at the time of this recording, he served as Cloud Economist for the company. This is the Tech Barometer Podcast, produced by The Forecast. I’m Jason Lopez, thank you for listening. For more stories on sustainability or on technology in general, you can check us out at theforecastbynutanix.com. That’s www.theforecastbynutanix.com.
In this Tech Barometer podcast segment, Debojyoti “Debo” Dutta, vice president of engineering, AI at Nutanix shares his passion for computational biology and how AI will dramatically change enterprises.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Debo Dutta: If you look at what’s happening today, it’s not just because of AI, but in general because of high throughput data that can be generated out of a biological system. And the amount of data that you can generate was unimaginable even a few years ago.
Jason Lopez: In our series on MedPerf we wanted to introduce you to a computer scientist at the forefront of AI and machine learning development. Debojyoti Dutta, who goes by the nickname Debo. His work is bringing AI to IT leaders across many industries, including healthcare. This is the Tech Barometer podcast, I’m Jason Lopez.
[Related: Exploring Uses for AI in Healthcare]
Jason Lopez: When you hear about AI and how great it will be for healthcare, you might wonder, well who are the people making it happen? Debo is one of those technologists who’s working to connect the dots of computer science and medicine.
Debo Dutta: When coupled with AI, it’s going to completely change the way we design drugs, how we design antibodies, new therapeutics, I can’t even imagine all the things that we will be able to do using this iteration of AI coupled with the amount of data that we can generate out of living beings.
Jason Lopez: One area Debo thinks AI will have a profound effect is in examining medical images. For example, people with diabetes are at risk for loss of eyesight. With AI assistance, images of the inside of the eye could give doctors far earlier detection of diabetic retinopathy. Other imaging examples include detection of tumors and cancers. But another area where AI could bring a transformation…immunotherapy.
Debo Dutta: Immunotherapy in a nutshell is to program your immune system to fight bad actors in your body. The bad actors could be viruses, it could be cancer cells.
[Related: Building Infrastructure to Unlock AI’s Next Big Leap]
Jason Lopez: Our immune system can detect viruses, but sometimes cancer cells are invisible. Cancer cells can appear normal and the immune system allows them to go about wreaking havoc. In immunotherapy, the DNA of the immune system’s T-cells are changed to recognize the genetic strands of the tumor cell and destroy them.
Debo Dutta: Let’s see how AI gets into this space. So the programming, the existing T-cell can be done with gene therapy, but how do you know what to program? That’s where AI comes in. Using AI, you can rapidly design sequences. People are today looking at a lot of sequence data as well as literature, feeding them into large language models. And they are actually trying to generate candidate sequences for lab experiments.
Jason Lopez: Advances in large language models as well as computer infrastructure are cutting development times dramatically. Debo says what would have taken years might take a 10th or even a hundredth of the time.
Debo Dutta: I’m not an oncologist. I’m not a gene therapy researcher or an immunotherapy researcher, but I do believe that as a systems person, if I can help the lifecycle of the machine learning go faster, I can help them to make immunotherapy get better and better. We can cure more types of cancers and more diseases.
Jason Lopez: Debo was born in India. His mother is a retired doctor and his father a retired engineer. Those two professions are some of the most sought-after in the country and getting into a good university to pursue those professions is very competitive, and he was able to enroll in one of the top colleges in engineering where he opted to study computer science.
Debo Dutta: But I kept thinking about biology, but I didn’t do much about it.
Jason Lopez: After graduating, he came to the US to study for a PhD at the University of Southern California, and that’s when he saw another dimension to computer science.
Debo Dutta: It looks like pure science in many ways because it’s a lot of math, applied math and discrete math, and a lot of engineering too. But it can be applied to biology.
Jason Lopez: At USC he encountered a large team doing computational biology. And after his PhD, he had this thought:
Debo Dutta: No matter what I do in life, I need to spend some time in computational biology at USC before I actually get into my career and just be a researcher and learn how computer science can be applied. And that’s when I first picked up what is now known as machine learning.
Jason Lopez: What do you think about the AI boom?
Debo Dutta: Yeah, that’s a very interesting and loaded question. I could spend the entire session just talking about that.
Jason Lopez: Models are at the heart of machine learning. Data is used to train models. Which are deployed to infer from new data. And in the ChatGPT and the generative AI space, models are getting bigger.
Debo Dutta: These models can be as large as 1 trillion parameters. And typically when you see new data, you have to run this data through the model. Big models take longer time, more compute resources. And so measuring the performance will lead to more innovations in the infrastructure space.
Jason Lopez: That will make models cheaper to develop and cheaper to deploy. But, Debo points out the quality of the model still matters.
Debo Dutta: When you’re generating text, how good is the text? Is it hallucinating? Is this text believable? How was this model developed? Was it developed on open data? Was it developed on somebody’s private data? And if that is the case, what’s the liability of the model if I use that model?
Jason Lopez: When Debo did his postdoc in computational biology at USC, it was called statistical algorithms. He says he was on the right track as he explored signals in biological experiments, especially proteomics: the study of proteins.
Debo Dutta: I got to learn about machine learning as a part of understanding how the human body works.
Jason Lopez: Statistical algorithms were one of his tools at his job, later, at Cisco. He did cloud computing for a while. But then decided to investigate a new area.
Debo Dutta: And what struck me is cancer therapeutics in the US was still not advanced enough by a computer scientist standards.
Jason Lopez: One day, he found himself at a meeting at Stanford with some leading machine learning experts. That group became ML Commons. Subsequently, they began discussing what ML Commons ought to do. It wasn’t long before a medical-focused working group was formed.
Debo Dutta: And that’s when the idea of this med perf paper was born.
[Related: Alex Karargyris’s Path to Becoming a Pioneer of Medical AI]
Jason Lopez: The MedPerf paper, entitled Federated Benchmarking of Medical Artificial Intelligence with MedPerf, established the vision for the organization.
Debo Dutta: MedPerf was not even a thing. I mean, we just started Med Perf. We got together a bunch of experts from different walks of life, because problems in medicine are hard. They need expertise from all corners. So we consulted with oncologists, computer scientists, data folks, and a lot of people who knew the ins and outs of the pharmaceutical industry.
Jason Lopez: In our conversation with Debo, we did ask him specifically about Chat GPT. And he relayed what Nutanix customers are saying.
Debo Dutta: I love Chat GPT, it can do amazing things and maybe transform my business, but I have to give away my data to Chat GPT.
[Related: IT Leaders Get AI-Ready and Go]
Jason Lopez: What they want is a Chat GPT equivalent – kind of a GPT-in-a-box running on their own private infrastructure.
Debo Dutta: Nutanix is very customer-focused. So our reaction to our customer’s request is a turnkey solution, which will help our customers run generative AI models, including large language models that fuel applications like Chat GPT, on their private infrastructure.
I joined Nutanix in 2020 during the pandemic. And when I joined Nutanix, I realized that Nutanix had this amazing platform, which could host a lot of these amazing next-gen AI workloads that would change the world in ways that we don’t even know about. For example, new drugs, new antibodies. So I’m really excited by medicine and AI and infrastructure and what it could do to humankind.
Jason Lopez: Debo Dutta is vice president of engineering at Nutanix and a founding member of ML Commons. This is the Tech Barometer podcast, I’m Jason Lopez. If you like this report and want to know more about MedPerf, we’ve got a couple of other stories on the group, one focusing on the paper and another on MedPerf co-founder and the paper’s author, Alex Karargyris. You can find more at the Forecast, which produces this podcast. It’s at www.theforecastbynutanix.com.
In this Tech Barometer podcast segment, Greg Diamos tells how an early passion for computing led him to a pioneering role Baidu’s Silicon Valley AI lab, where he discovered ways to scale deep learning systems, and went on to co-found MLCommons and AI company Lamini.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Greg Diamos: I think computing is a way to give people magical abilities, like superpowers. I like to live in a world where you can give it to everyone. Like, what if every single person had superpowers? I had basically ten years with nothing to do and just a pile of computers in my garage.
Jason Johnson: Just getting the ball rolling, I was wondering, Greg, could you tell me a little bit about what it is you do?
Greg Diamos: I’m one of the people who builds the software infrastructure that’s needed to run applications like ChatGPT or Copilot. Let’s see, I think it’s helpful to start from the beginning. My last name is Diamos. It’s a Greek name. It’s kind of cut in half. About a hundred years ago, my family immigrated to the U.S. They mostly settled in the West.
Before I was born, my father, he moved to Arizona. And his goal in life was to retire and find someplace relaxing and to go and play golf most of the time. And so he moved to Carefree, Arizona. Most people, when they think of Arizona, they think of Tucson or Sedona or places that normal people would go. You go to the Grand Canyon or something. Carefree is a place where no one ever goes. It’s right in the middle of the desert. There are not a lot of people, but it has a lot of golf courses and it’s very relaxing. It’s like a spa. So it’s a good place for that, but it was a very boring and brutally hot place to be as a 10-year-old boy.
[Related: AI Reorients IT Operations]
So I was bored, bored out of my mind. My mom worked as a database administrator for IBM. IBM at the time, they had a mainframe business. And so they would basically throw away the last generation of stuff. She would just take all the machines that were headed to the dumpster, put them up in the car, drive them out and throw them in our garage because it would be such a waste if such a thing was thrown away. I had basically 10 years with nothing to do and just a pile of computers in my garage. So it took me from when I was 10 years old until when I was about 25 to kind of figure out how the machines worked. It seems, like, magical to me that you could build such a thing. You could do that as a little boy stuck in the desert. I did a PhD in computer engineering. After that, I went to Georgia Tech.
Okay, let me tell the story of this one. I really love telling the story. I actually worked at the Baidu search engine. You could think of it as the Google of China. If you go to the search bar, there’s a little microphone on it. You press the microphone, you can talk to it. It was based on the last generation of machine learning technology. It still used machine learning, but it didn’t use deep learning. This exists right now in all major search engines. Around 2014, 2015, Baidu was in the process of deploying their first deep learning system.
[Related: Alex Karargyris’s Path to Becoming a Pioneer of Medical AI]
One of the projects that we had in the Baidu Silicon Valley AI lab was to apply deep learning, which had just been invented and was just starting to work to improve that particular product. Along the way, we had a number of researchers. One of the researchers was Jesse Engel. He was a material scientist, but he was not a deep learning researcher. Actually, none of us were deep learning researchers because deep learning didn’t exist. One of the things that he did is he performed sweeps over all the parameters in the system.
One of the sweeps produced this plot that seemed to show that there was a relationship between the accuracy of the system or the quality of the system with the amount of data that went into the model and the size of the model. If you think of a neural network as just being a collection of a ton of simulated neurons, not real neurons, but simulated neurons in that system, trained on thousands and thousands of hours of recordings of people talking. It seemed like as you added more neurons or simulated neurons, and you added more recordings of people talking, the system got smarter. It didn’t just happen in an arbitrary way. It happened in a very clear relationship you could fit with a physics equation, E equals mc squared kind of equation, a one parameter equation. It was a very simple, very consistent relationship. We thought that was pretty intriguing. After that project succeeded, the team grew a lot.
[Related: IT Leaders Get AI-Ready and Go]
I inherited a pretty big group of researchers, about a 40-person group of researchers. I had to decide, what should we do? I thought that was the most interesting thing that I’d seen, so let’s see if this actually is a real thing. Let’s try to reproduce this. Let’s try to understand it better. We spent about a year trying to reproduce that experiment, and we absolutely could not break it. It was very repeatable across many different applications.
We tried it for image recognition. We tried it for different types of speech recognition, different speech recognition models. We also tried it for language models. Language models at the time were actually used in speech recognition, basically as a spell check. Essentially what came out of that was this very consistent, very repeatable effect that if you increase the size of the model according to a certain ratio, if you increase the amount of data according to a certain ratio, the quality of the system, like its ability, for example, for a language model to predict the future, like predict the next word, would get better in a very predictable way.
[Related: Seeing AI’s Impact on Enterprises]
We published this as a paper. It was called Deep Learning Scaling is Predictable Empirically. This is, I think, came out in 2016. I just thought it was so weird that you could actually predict intelligence. We tried even more to break it. We went and consulted all sorts of machine learning theory experts, and I actually finally understood why it was happening. There actually is a theoretical explanation of why this is happening. The result of all of this is basically we can’t break this thing. This is actually a real thing. This is a real relationship that’s repeatable.
It’s absolutely the most amazing thing I’ve ever seen in my life because if I try and explain what that means at an application level or a user level, it means that we have a repeatable recipe for intelligence. We have a simple equation that you can write down, and then I can just apply this recipe, and I can create intelligence. The implications of that, we understood what they were. I think, in particular, Dario Amodi, who is also a researcher in our group, really got it, what the implication of that was. He was a biologist who had done very detailed computational biology experiments. He took that and went on to put it into GPT-2. They just kept scaling it, so it kept getting smarter. GPT-2 became GPT-3. You had to have an enormous amount of computation to run this thing.
[Related: Will AI Workloads Overload IT?]
Finally, it seemed to cross a threshold around ChatGPT and GPT-4. It’s not just spell check anymore. Now it’s abilities that we think of as being very uniquely human abilities, like the ability to read and write English, the ability to reason logically, the ability to plan, the ability to write software correctly.
It’s not like these are just being produced in a research lab. We’re actually seeing them integrated into products that are deployed to all users. ChatGPT right now has more traffic than Netflix. It’s not just AI researchers who are talking about it anymore, who are playing around with these things. It’s actually pervasively available. If we project into the future, as long as we can keep feeding it with data and keep feeding it with computation, it’s going to keep getting smarter, and we’re going to see new abilities emerge out of it, many other human abilities and potentially even beyond human abilities.
Jason Lopez: Greg Diamos is co-founder of ML Commons, as well as co-founder of Lamini. He’s also a founding member of the Silicon Valley AI Lab, where he was on a team that helped develop deep speech and deep voice systems. This is the Tech Barometer podcast. Tech Barometer is produced by The Forecast, where you can find more tech stories about topics from enterprise software to the cloud revolution, AI, and digital transformation. Check us out at theforecastbynutanix.com. This is Jason Lopez. Thanks for listening.
In this Tech Barometer podcast segment, explore how a partnership between data networking giant Cisco and hybrid multicloud software company Nutanix is changing perspectives and opening opportunities for people who build and manage IT operations.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Lee Caswell: 750 million new applications in the next three years, more than the past 40 years of computing. How do you assimilate that quickly without overrunning your staff?
Jason Burns: You’re able to roll out these applications and not have to worry about how much time it might take to stand up new servers, stand up the network. All of that piece just can be more seamlessly provisioned so that you have more time to deploy applications.
Lee Caswell: Let’s say it a different way. Infrastructure doesn’t get in the way of supporting new applications. The best partnerships are customer-driven.
Jason Lopez: Those are the voices of Lee Caswell, vice president of Product and Solutions Marketing and Jason Burns, Director of Technical Marketing, both of Nutanix. This is the Tech Barometer Podcast Here, they’re in conversation about the evolving nature of network infrastructure and application deployment in the context of Nutanix’s partnership with Cisco. They chat about different perspectives and understandings that network, storage, and compute teams bring to the table, unified communications and Cisco UCS, rapid application deployment and many other facets of the partnership
[Related:Focus Shifts to Migration in Wake of Broadcom’s VMware Acquisition]
Lee Caswell: Today, for example, I was talking to a customer who’s the first Cisco customer we have in the Americas, not the first we have worldwide. And one of the things that really stuck out for them was the relationship that they have with Cisco, you know, expanding from networking into compute, has really meant that they have a level of trust there and confidence. And now that Cisco’s reselling the Nutanix offer, it’s really bringing together the networking and the, call it the infrastructure teams, in a way that we brought in the past, the storage and the compute teams together. So I’m curious on your perspective on that, Jason.
Jason Burns: From my perspective, I’ve seen the same thing. When customers are deploying a solution from Cisco, it is exactly that. Oftentimes you’ll see something with the unified communications on top of Cisco UCS and the Cisco networking piece as well. And so the combination there of being able to bring in the entire application on top of the computing system and then the storage as well is really appealing to the customers. And then having that delivered as a solution rather than something that they’re piecing together part by part.
Lee Caswell: You know, as I’m watching and talking to some of the Cisco folks, there’s some really interesting things that Nutanix does that they didn’t have access to before and now make it just easier to sell anHCI-based solution. One is, you know, the ability to have mixed nodes, for example, to be able to have nodes with different capabilities, whether it’s disk and flash or different CPU capabilities. That level of flexibility actually makes it a lot easier to sell this. And now integration, you know, support for ACI, for example, really helps from an integrated management solution. So I’m seeing those two things really set the bar as to how we’re now we’re bridging the network stack along with compute and storage.
Jason Burns: Yeah, the integration ofNutanix AHV and Cisco ACI is something that I’m personally excited about. As a former network engineer, I love to see the automation point where we can make networks inside of the network fabric and have that pushed into the compute fabric. What you get from that action is a system where you’re able to really easily deploy applications because the network substrate is already there for them. That’s part of what Cisco has done to integrate with Nutanix AHV. That’s really complemented by what Nutanix is doing on the virtualization side, both with our flow virtual networking and flow network security for virtual networks and micro-segmentation inside the hypervisor itself. So you have this physical network layer that Cisco is providing, and then you have the virtual network layer that Nutanix provides there, and that’s all being tied together.
Lee Caswell: Yeah, it’s kind of fun. I don’t know if you’re familiar with the concept of parallax, which is basically things, lines move as you move. It looks like things are moving because you’re looking at it from a different vantage point. And so in many cases, the network community is looking at things from one vantage point, where you’ve got now the storage and compute teams coming in and looking at it from a different view. For example, things like capacity utilization and performance from a storage standpoint are around IOPS, consistent low latency during failure conditions. Those are the things that a storage person cares about. And at the same time, now you’ve got all this based on the underlying network infrastructure. So the ability to have both of those lenses, I think, is really an interesting way to think about how to deploy this more seamlessly over time.
[Related:Why Hybrid Multicloud Matters]
Jason Burns: The lenses is a great point of it. The network team, rightly so, controls the network because they need to have the best performing network for their applications. They hold some of that responsibility, and therefore they hold the provisioning control as well. Same thing for the compute and storage side. But going back to that comment around lens, you get visibility from the storage side of what the network is doing. And then from the network side, you get visibility into what the compute is doing, thanks to the integration of ACI and AHV. So the solution works a bit better now that these entities are aware of each other.
Lee Caswell: You’ve also got inter-site integration, looking at how you go and view, manage, and monitor the holistic system. And so, I’m particularly excited about this because there’s over 60,000 Cisco resellers, for example, who are familiar with inter-site. And now to be able to say that inter-site can go and monitor Nutanix environments today, manage shortly, is really an exciting way to go and leverage the experience and expertise of that Cisco reseller base.
Jason Burns: The inter-site piece is also very interesting because I came from a world of deploying Cisco UCS with local UCS managers. So for me, I’m learning more about Cisco through this and learning that they have inter-site as a tool. It’s a tool that I wish I had when I was deploying UCS servers years ago. The ability to look at a fleet of servers and manage them all from that point would have been really helpful to me as an administrator back in the day.
[Related:The Spirit and Hybrid Multicloud Mindset of a Healthcare CIO]
Lee Caswell: Yeah, I was looking at some of the roadmap items we’ve been talking about. One of the things that a lot of customers have been looking for and are excited about what is coming with Nutanix and Cisco together is the ability to run on the latest blade servers that are storage-rich to be able to take that new form factor. Because certainly Cisco is known in the UCS world as having performance-oriented systems with a lot of memory access. That was the early design of UCS. And now the ability to bring storage-rich capabilities and Nutanix’s value on our HCI element makes it possible now to go and run the highest performance applications on this new joint offering.
Jason Burns: Yeah, absolutely. And I’m looking forward to seeing expansion into that blade ecosystem because that’s what I had seen a lot of deployed myself, these high-performance applications running on a blade backed by some sort of storage that might have resided outside the blade. And so looking at what we have as possible future options with Nutanix compute-only accessing the storage remotely, that to me just seems like a win-win for configuration in these blade server deployments.
Lee Caswell: Especially important, by the way, for the highest performance applications because of the licensing model, it turns out. So the ability to have a contained, let’s call it compute-only node, for example, where you can now go and have, let’s say Oracle licensing to pick one running dedicated on that node means that now you’ve got a predictable licensing expense going forward. And so that’s important because, you know, there was a risk in the early days, you could basically have licenses spread across all of the CPUs and the cores. And of course that would be prohibitively expensive. So the idea that you can contain licensing to this actually means now you can take the highest performance applications that are licensed by core and make sure that financial exposure is guarded there.
Jason Burns: Anecdotally, one of our customers who’s a service provider, they deploy a lot of different solutions. I was helping them out with a technical design I said, you know, this is how I would do it. And he said, well, Jason, about 40% of the way I design things is technical and the other 60% is driven by the licensing requirements of all the solutions I’m deploying. One solution, while I might from a technical side think it’s the right answer for licensing or financial reasons, might not be a viable solution for them to deliver that service.
[Related:Ransomware Resilience: Evolving Data Protection]
Lee Caswell: Super interesting. Even as you look at what’s next after databases right now, the number one workload on Nutanix. Analytics now from our own survey data is 49% of our customers are running analytics. And a big part of that, of course, is Splunk. So now acquired by Cisco, I see a pretty interesting opportunity to go bring together these high-performance analytics along with our Cisco partnership. Bring that all together and make that really a solution from a customer standpoint.
Jason Burns: Yeah. I’m also interested to get hands on that in the lab myself. Part of what we do is we, in the tech marketing team, we develop these lab environments for people and we try to demonstrate our own software and try to pull in realistic use cases where we can. One of those use cases is you have this Nutanix software stack. It’s generating alert data, event data. How can you send that into a tool that’s very similar to what the customer has? A lot of our customers ask us, how do I send all this data into Splunk? If I were able to, in the future, have a system that can send all that data into Splunk and then show our customers how to do that, to me, that seems like a great offering and something that customers would benefit from. So I think that’s how they deploy it in the real world.
Lee Caswell: Of course, no conversation would be complete without a discussion of generative AI. Thinking for a moment about how we’re taking GPU-enabled Cisco nodes and now being able to do our GPT in a box, for example, together with Cisco UCS. Pretty interesting, right? As a way to go and say, how can I get started? You could be training a model, probably not a large language model, which is happening in the public cloud, say, but you could certainly be modifying or tuning a model with your Cisco-enabled, GPU-enabled nodes. And then being able to take some of the value that we offer on the software side to help customers get started on their AI journey.
Jason Burns: Yeah, Lee, I see people ask that all the time, which is, how do I get started? How do I deploy this? What’s your best practice guide? And working with Cisco, what they have on their side is the Cisco validated designs. And so what I would love to see is a Cisco validated design for something like generative AI, kind of complementary to our GPT in a box solution for, okay, here is how you get from end to end a deployment with Cisco UCS servers, the Nutanix AHV hypervisor, your GPUs of choice, and how do you build that out from end to end? For me, the validated design is a great starting point because it shows customers that we’ve tested this out in the lab. And if you follow this recipe, you also can have success.
[Related:Will AI Workloads Overload IT?]
Lee Caswell: I guess it strips out both the real risk by doing predetermined testing and then also any perceived risk. So you can say, all right, if I can take the infrastructure piece out, which by the way, is what every data scientist wants. It’s like, how do I make sure the infrastructure is there responsive and fast? So we do that. And by the way, reliable and day-to operations and compliance, all the things that IT brings to the party. And then at the same time, be able to deploy new applications really quickly, whether they’re libraries like PyTorch, for example, or bringing in new applications, bringing in our support for the NVIDIA and VAI libraries. I mean, these are just ways to say, hey, we’ve got all the building blocks and can help you with putting them together.
Jason Burns: And having the validated design or whether that’s a Nutanix validated design or a Cisco validated design means that you’re really speeding up the deployment. You’re cutting out a lot of those investigatory steps and just following along a cookbook rather than inventing the wheel on your own.
Lee Caswell: I think for a lot of customers, particularly, they’re looking now at these new server-based architectures as a way to build out an architecture for the next three to five years, where you’d put all of your new applications. It’s rarely just like rip and replace, take something out. That’s why we still have Unix systems in there. It’s additive in the sense that now you’re going to take these server-based architectures, add that in, but put all the new workloads on there. Certainly that’s what happened with x86 because the economics and the simplicity of moving to a x86 architecture based on Ethernet, which is what we’re doing here. And then deprecating over time, fiber channel, SANs, switches, and even the expertise. So you can basically focus on the new stuff is how I’m viewing this market.
Jason Burns: As a practitioner, what I like is that that gives me the time to focus on the new things. If you’d asked me a few years ago if I was going to be learning about generative AI models, I would have said, no, that’s not really something. But now that the infrastructure side is more taken care of, that’s a place where I can look at these new applications and maybe learn more about how Kubernetes works and how to deploy a modern app in Kubernetes or maybe learn more about an AI application rather than spending all my time just getting the compute and storage and networking infrastructure up and running.
Lee Caswell: So this infrastructure as code transforms into everything as code. If you think about over time, how do we make this easier for you to take and basically treat AI as just the next workload? Many customers from Nutanix started off inVDI, then went todatabases, then went to analytics, and now are looking at AI, generative AI, as the next thing. And if you can assimilate that easily with the same team instead of having a separate architecture, boy, it just makes it a lot easier to get some operational leverage, particularly when you’re having trouble finding talent.
Jason Burns: That is something that I see every day, even in some of the new designs that I’m rolling out. You might do something where you have an engineer walk through and manually set something up as a proof of concept. That’s pretty time-consuming to do. Now, if you have something like infrastructure as code or your application deployment defined as code, the subsequent deployment of that can happen really fast. And so you just cut out a lot of time there for deploying that. That really is moving toward everything as code with the solution we’re showing here. So you have the Cisco ACI portion, where you have these APIs for configuring your network. You have the Nutanix compute and storage part, again, with lots of open APIs to configure. And then these modern applications on top of it, which might be deployed as a series of config files against aKubernetes cluster. You can just keep all of that code for the entire infrastructure and even application configuration in a code repository where someone can just check that in to make changes to it.
Lee Caswell: Yeah, it’s always struck me that ACI was probably one of the best acronyms in the industry, application-centric infrastructure. The idea that you’re thinking, hey, how do I make sure that applications are optimally located? And there’s a really interesting way to think of how we introduce value jointly here, because when you bring these together, these technologies, now all of a sudden you’ve got a full complement of how to make a seamless outcome for optimally locating applications and their associated data over the hybrid multi-cloud universe.
Jason Burns: And as I was seeing adoption of modern applications and containerized applications, that was the one thing that struck me the most, is that all of these apps are going to generate and use incredible amounts of data, and they’re going to need highly available storage that’s also high performance. I didn’t see on the market a dearth of those solutions. I saw that Nutanix really had a great offering in that space, that people were going to be deploying these modern apps and using Nutanix storage to back that app deployment.
Lee Caswell: Both of our companies, I think, have terrific brand loyalty, by the way, in part because of the support experience that customers have gotten. And one of the things that impressed me about the relationship that’s more than just your average partnership is how we’ve integrated the support path so that our support systems and support tickets can be follow-up and make sure that the customer experience is singular in nature. Curious on your thoughts on how you’ve seen that develop, and why is that important?
[Related:How Flash Memory is Reinventing Hybrid Cloud Storage]
Jason Burns: Working at Nutanix these last nine years, I’ve heard consistently again and again that customers value Nutanix support. And in my previous life, I was actually a Cisco support engineer long, long ago, and heard the same thing, that customers valued the support that they got from Cisco. So we have a history of two great support organizations, and being able to support our customers really is what I know that they’re looking for. It keeps them coming back. It keeps them expanding solutions on Nutanix or expanding their solutions on Cisco, because they know that when something goes wrong, they can give us a call and get routed to someone who can help them.
Lee Caswell: I have a theory on why our companies are so well suited together. So my theory is this, that architecturally, from a design point standpoint, network engineers tend to make things fast first and then reliable later, because you can always retransmit. And storage companies come at problems with exactly the opposite lens, which is that they try and make things reliable first, and only then try and make them fast. And you can certainly see that through the enhancements we’ve made over the latest versions of AOS, for example, and moving into newer flash technologies, you know, NVMe and new CPUs and everything. So I’m curious to say, how do you think about it, right, architecturally, isn’t that an interesting way to think about why the engineering teams have so much appreciation for each other?
Jason Burns: That definitely rings true to me. And I’ve seen that growth at Nutanix over time, where all of our subsequent software releases have basically worked on performance over all others, but reliability was always there, because from a storage perspective, you had to keep that data. Data corruption wasn’t really a possibility for consideration, but we really worked hard on increasing performance over time. And it seems like we’ve kind of met in the middle here between Cisco and Nutanix.
Lee Caswell: I think storage people, right, preserving the data is number one and all the data services that we have. And I think that’s a really interesting value also, because for most customers now, this is a really unpredictable environment. Trying to forecast, for example, your mix of blocks, files, objects, data, trying to forecast whether you have VMs or containers three years from now, and start to think about, you know, what you have on-premises versus the cloud. The simplifying design that Nutanix brings is the fact that you’ve got the same data services across all of those endpoints. If you go and buy different unique architectures for each, you’re going to have a different way to go and protect that data, different snapshots, different recovery mechanisms, different disaster recovery. And so it’s a really easy simplifying, you know, way to basically make this easier for customers to get operational leverage and deploy things in an unpredictable environment.
Jason Burns: Nutanix has a lot of that flexibility on the data services side, and I see Cisco having that flexibility on the compute side. The longevity of some of these Cisco UCS chassis, for example, or how long you might have a UCS deployment is pretty incredible. And that’s just something that you can keep as a long-running deployment and take out parts of it, maybe blades, maybe certain rack servers while keeping the whole of the deployment there. You get the ability to upgrade in place and really extend the possible lifetime of a deployment. And for me, that was always the beauty of the Nutanix cluster, because your AOS storage cluster could live for quite a long time, even across multiple generations of Nutanix hardware. If you are adding newer-generation servers and removing older-generation servers, you have a pretty long-lived deployment without a lift and shift.
Lee Caswell: So one way to think of this is in a highly unpredictable environment where applications are changing really fast. You don’t know necessarily if there are going to be block interfaces or file interfaces or object interfaces. By being able to buy one thing, you can actually get started. And then by having seamless licensing that allows you to go and basically deploy at will over time, you’ve got this flexibility now, along with the fact that we’re the only company that gives you a consistent way to do data protection across all three of those protocols. And by the way, across VMs, traditional VMs, and now newer container systems orchestrated by Kubernetes. So it’s a really fantastic way, I think, to go and give that flexibility for customers who actually don’t want to be storage experts, it turns out.
Jason Burns: That would describe me as well, a former network engineer who has come to the storage world, but Nutanix has made that a lot easier. Storage is not as intimidating as I had thought it was after working with Nutanix. Let me say it this way. You know, what I’m hearing from a lot of CIOs now is that they’re interested in consolidating architectures so that they can address the fact that they don’t, let me say that in a different way. Yeah, one of the things I’m hearing from CIOs recently is about trying to consolidate the number of different architectures that they have. So for example, a simple one would be like separate filers and separate SAMs, for example, bringing those together, and a different object store, bringing that all together. And so for CIOs thinking about how they do it, they’ve already done that with Cisco on the networking front. They have a single vendor on the network front that gives them everything across different architectures. And so now one of the opportunities here is by working with Cisco and Nutanix together, now you’ve got the opportunity to basically address any of the degrees of freedom you’re likely to anticipate in the future.
Jason Lopez: Lee Caswell is vice president of Product and Solutions Marketing at Nutanix. Jason Burns is director of Technical Marketing at Nutanix. This is the Tech Barometer Podcast, I’m Jason Lopez. Tech Barometer is produced by the Forecast. We have a treasure trove of tech stories at the forecast from all across the technology landscape. You can find more at:
In this Tech Barometer podcast segment, IT industry analyst Steve McDowell and Lee Caswell from Nutanix discuss the challenges and risks IT operations leaders face in the wake of Broadcom’s acquisition of VMware.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Steve McDowell: Broadcom announced quite a while ago that they’re acquiring VMware.
Lee Caswell: It’s not a light switch moment.
Steve McDowell: Because of regulatory hurdles and all sorts of other things, it stretched out for multiple quarters. That is where I think the initial wave of concern came in, because now not only do I have to wait and see, I have to wait multiple quarters to see.
Lee Caswell: Very rarely in IT do you just decommission something now instead, what you’re thinking is, all right, how do I make sure that I’m containing the risk, and then taking all the new things and putting that on the new modern infrastructure.
Jason Lopez: In the ever-evolving landscape of IT infrastructure, companies are increasingly finding themselves at a crossroads, particularly in the wake of significant industry acquisitions such as Broadcom’s purchase of VMware. This shift has ushered in concerns for VMWare’s customers.
[Related: Hedging Into Expected Broadcom Acquisition of VMware]
Lee Caswell: What happens if they’re not one of the top 2,000 customers?
Jason Lopez: Lee Caswell, Senior VP of Product and Solutions Marketing at Nutanix, says VMWare customers are worried about three major things: pricing going forward, and we’ll dive deeper into that in a few minutes, as well as support for products and the risk to personal careers.
Lee Caswell: Those customers are worried from a support standpoint. I think those customers are legitimately worried that they’re not going to get a call. Partners are worried, too, because Broadcom doesn’t have a great relationship with partners. So I think that support piece will come to be the thing that really actually unhinges them. And the third one is about personal career risk. If you can’t get support and you’re running something and you didn’t make a change, then all of a sudden it’s going to be back on you.
Steve McDowell: There’s a lot of uncertainty among the IT community about what Broadcom is going to do with VMware.
Jason Lopez: Steve McDowell is principal analyst at NAND Research.
Steve McDowell: Broadcom historically, they’ve largely acquired companies that have largely commoditized and they maintain them forward, but you don’t see a lot of continuing innovation. Are they just going to take the core VMware business and maintain that moving forward? Because the reality is a technology like VMware, or VM in particular, is very sticky, right? It’s hard to kind of rip and replace.
[Related: Broadcom’s Acquisition of VMware Stirs Uncertainty]
Lee Caswell: The way that customers are talking to me about this right now is that what they had with VMware for the past, you know, almost 20 years, right, was a very safe offering with known risks. And now what’s happened is what was the safe bet is now the risky bet. And it’s got unpredictable risks.
Steve McDowell: You know, if you have a VMware license, you’re probably not going anywhere for the life of that infrastructure, right? But where the uncertainty lives is on, you know, when I do come up to a replacement cycle or I have a greenfield project, you know, is VMware going to continue to deliver the level of innovation?
Jason Lopez: This has left many customers contemplating a strategic approach where they maintain their existing VMware infrastructure but refrain from expanding. Instead, they’re considering investing in new applications and technologies on alternative platforms based on newer architectures.
Steve McDowell: From Broadcom’s perspective, I think everything they’re doing makes a lot of sense for their investors and for maybe existing VMware customers. But where there’s, I think, going to continue to be a concern: how does the VMware technology continue to evolve, right? Am I still going to get the level of support I had? And am I still going to be paying the same amount of money? There’s also news out of Broadcom earnings, they’re re-examining kind of their subscription strategy, subscription bundle, and subscription pricing.
[Related: IT Leaders Get AI-Ready and Go]
Lee Caswell: There was a blog published by the leader of all the infrastructure products, saying some very interesting things that people had been expecting, but now they’re in print. So number one was it’s the end of any new perpetual licenses forever. That was interesting because that’s the way that most VMware customers have transacted businesses in the past. Also when those perpetual licenses came up for support and services, you’d have an SNS or support and services element, and there also no new SNS contracts as well. So those two things basically said that, hey, every customer is moving to a subscription model. Now, what you know in your personal life, right, is also true in business. When you move to a subscription model you end up paying more.
Jason Lopez: Caswell cautions that subscriptions, strictly speaking, don’t automatically equate to higher pricing. Subscriptions work when a customer maps out the long-term costs and benefits. But other factors within a subscription matter, such as bundling.
Lee Caswell: Subscription is one way where you would pay more, even if the prices were the same. But now what we’re looking at is that the bundling of products is starting to look like you may have to go and move up into higher level products where the way it’s being described is you’ll get more value. And that could be true, but the question is, it may be value that you wouldn’t have ordinarily bought. Think of it like when you have a cable TV subscription and you get 800 channels and you’re like, okay, I’m gonna watch like 20 of them. Can you give me the 20? And they say, no. And so now you’re stuck with a whole lot of stuff that you may not have originally wanted.
Jason Lopez: The immediate aftermath of the acquisition saw restructuring within VMware, in areas such as partner teams, engineering, and customer relations.
Steve McDowell: Five days after the acquisition closed, the week after Thanksgiving, they laid off 2,500, 3,500 people, I mean, a significant number of VMware employees. And these were in the partner teams, these were in engineering teams, these were in kind of customer relation teams. Not a good signal if you’re trying to build credibility with your customer base.
Lee Caswell: Publicly they just announced they laid off over 300 people in Cork, Ireland, which is the support center. They’re also closing countries that don’t have a sufficient number of customers.
Steve McDowell: First week of December, we saw them announce that they’re spinning out their desktop compute pieces. So they’re already starting to shed some of the things that are not core VMware capabilities.
[Related: How to Secure Modern Apps and Databases for Hybrid Multicloud Operations]
Jason Lopez: Today, one of the driving forces behind the way companies use and pay for enterprise software is an anticipation of a massive influx of new applications over the next few years, far exceeding the growth seen in the past four decades.
Lee Caswell: 750 million new applications coming online over the next three years, more than the past 40 years of computing. So you’re going to have this new wave of applications. And guess what? It’s all unpredictable. If you ask people what they’re going to do three years from now, they can’t tell you which applications they are. They don’t know whether they’re going to be interfacing with blocks, files, or objects, VMs, containers, on-prem, in the public cloud. And so risk right now with VMware is that you’re stalled like a deer in the headlights and you don’t know how to move forward because you don’t know what the risks are going to be over time.
Steve McDowell: Those are the kinds of things that when they’re in the air are going to lead to a certain amount of uncertainty. At the end of the day, being in IT is about de-risking your operations, right? Every business today is a digital business. And if I’m putting a piece of software that’s critical to my infrastructure it just makes sense that I’m going to look for alternatives. Not saying I’m not going to choose VMware, but I’m not going to default to VMware. So I’m going to look at Nutanix. If I’m in more in a cloud native mode, I’m going to look at the various Kubernetes things like OpenShift, Portworx, and things like that.
Steve McDowell: Broadcom’s business model is to take a commodified technology and continue to monetize that over time.
Jason Lopez: Innovation is a cornerstone of success and resilience in the tech industry. McDowell reminds us that it drives competitiveness, customer loyalty, adaptation to market changes, long-term growth, and it influences strategic business decisions.
Steve McDowell: You know, and when you’re talking about a commoditized technology, you’re not talking about a lot of continuing innovation. Now, a lot of the excitement around VMware in recent years was things that were kind of adjacent to their core infrastructure management path, like Carbon Black for endpoint security, for example. Broadcom, two weeks after their acquisition, said “We’re spinning that out.” So they’re kind of validating, I think, some of the initial concerns. That’s not to say that Broadcom’s not going to take care of existing VMware customers. I think they will. They want that revenue stream moving forward. The concern is really around new projects and replacement projects. Is the VMware technology the right technology? And I’m not saying it’s not, I’m saying it’s early to know. So we’re just going to have to wait and see. But, you know, a lot of IT projects can’t wait and see, which is going to force you to de-risk the decision by looking at alternatives.
[Related: Why Hybrid Multicloud Matters]
Jason Lopez: The market has been trying to understand the implications of this acquisition for about a year. And that limited Broadcom’s ability to articulate a strategy. This, sort of, limbo benefited competitors such as Nutanix.
Steve McDowell: Nutanix is not alone. I think everybody who competes directly with VMware in whatever space began benefiting well before the close just because of all of the uncertainty that just continued to linger. Because of where they were in the process, Broadcom, fair or unfair to them, they couldn’t respond to that, right? I can’t talk about a company I don’t own. So they would talk in generalities and that doesn’t do anything to ease concerns. So I think, you know, we’re a year into trying to grasp what this acquisition means.
Jason Lopez: Steve McDowell is principal analyst and co-founder at NAND Research. In his tech experience, he’s been at IBM, Fujitsu, and AMD among other firms. And he’s been a prominent industry analyst since 2017. Lee Caswell is Senior Vice President of Product and Solutions Marketing at Nutanix. He served two stints at VMWare and in his career worked in many roles such as at NetApp and Fusion-io as well as co-founding Pivot3 in Silicon Valley. This is the Tech Barometer podcast I’m Jason Lopez. Tech Barometer is a production of The Forecast. You can find more tech stories at theforecastbynutanix.com.
In this video, Ryan McBrearty, the senior IT infrastructure engineer at global specialty insurer Markle, tells how his team uses Nutanix software and customer services in their quest to cut costs and simplify IT operations.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
We wanted to cut down operational costs and use automation as a key focus in that. An objective was given to everyone to figure out what processes do we use on a regular basis and how can we speed up those processes and really automate them, especially in the server build space and taking a process that takes two months that has as quick as a window as possible, whether that’s two hours or four hours, beginning with we just had, we want to automate server builds so that we have consistency across that platform. So it was really taking that process and putting a workflow around it.
[Related: Forestry and Land Scotland Trailblazes Private-Public Shift to Cloud]
Automation is a key foundation, so we want to automate everything. If there’s a process that is repeated more than twice, then let’s see what we can do to automate it. So that’s how we’re going to continue to leverage Nutanix self-service. So that and the integration pieces that it has with the other tools in our environment, whether it’s networking, whether it’s security, whether it’s cloud, being able to touch all of those things. Our backup team as well, we want to work towards that software-defined data center.
So there was a lot of back and forth and things had to touch hands multiple times. Whereas once somebody puts in a request, now all of that information is gathered at the beginning, it’s put into at launch of the blueprint and then we just hit go and it just builds it. That shrinks down that timeframe from, again, two months to two hours.
The beauty of self-service is that it will bend to your whims. So if you are comfortable with writing code in a certain language, whether it’s Python or PowerShell, it will allow you to do that the way that you want. The different pieces were very complicated and very challenging to learn and manipulate, and it took a lot of time to go through and really understand how to use those tools where I think the tools today from Nutanix are a lot easier, a little bit more straightforward.
Support with Nutanix has always been great. NCM [Nutanix Cloud Manager] self-service has really been the easy button for us when it comes to automation. It’s been a great tool that has endless possibilities that we have barely begun to scratch the surface on how to use it and how to leverage it. The deeper we dive into it, the more things that we realize that we can do, and I’m excited for the future of what that looks like because again, the possibilities are endless.
In this Tech Barometer podcast segment, CIO of Delaware Valley Community Health, Isaiah Nathaniel describes his spiritual and purposeful approach to helping the healthcare provider leverage all the innovation IT can bring.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Isaiah Nathaniel: Never let anyone beat you giving. Never let anyone beat you loving. Never let anyone beat you at believing. And finally, never let anyone beat you serving.
Jason Lopez: That’s obviously a spiritual insight. But Isaiah Nathaniel has a double meaning here. It’s also about the role of IT.
Isaiah Nathaniel: You’re hitting a nerve. I come from a long line of preachers as I told you my first time, but here we are.
I am an on-prem guy.
Jason Lopez: Isaiah Nathaniel is a CIO. He works for, or as he would mean it, serves Delaware Valley Community Health, a hospital that offers medical, dental and behavioral health services in nine locations around Philadelphia. They’re noted for focusing on accessibility and affordability, regardless of a patient’s ability to pay. And that’s something which informs Nathaniel’s work leading his IT organization. He may be an on-prem guy.
Isaiah Nathaniel: But there is flexibility in the cloud if you do it the proper way. So for us, it’s really being able to be flexible to scale at the drop of a dime based upon the business vision or the business need, but then also scale back.
[Related: Why Validating Medical AI is Crucial to Improving Healthcare Outcomes]
Jason Lopez: So he says if you can afford it, you can throw things into a public cloud. But his experience has shown him, it’s not fiscally responsible to operate with a blank check.
Isaiah Nathaniel: Any fiscally responsible CIO would say that’s not the way that we want to conduct our hierarchy of our business unit. And so for me, it’s okay, let’s dip my toe in the water, but let’s also make sure it’s fiscally responsible because waste is something that I don’t like because waste takes away from patient care. It takes away from staff retention. It takes away from the ability to grow. And particularly in the non-profit space, you’re looking at that bottom line to be able to say any extra spend really does take away from truly good quality patient care, patient experience, and then staff retention, relationship, and ability to serve who we need to serve.
Isaiah Nathaniel: Nutanix saved my organization by having that infrastructure.
Jason Lopez: The pandemic forced some profound changes in the way many businesses run. Spectator sports and movie theaters basically had to shut down. Restaurants had to drop everything and shift to takeout. And it seems everyone else met online via video. And in that idea, just think of how the demand for digital services affected IT. There was an accelerated shift to remote work, forcing IT departments to quickly adapt their infrastructure. Companies on a 5 year digital transformation plan suddenly recalibrated to do it in a year or two, and budgeting went back to the drawing board. Cybersecurity and disaster recovery efforts got amped up, and automation rollouts got pushed forward. Vendors like Nutanix were key, Nathaniel says, because he had to rely more on cloud services, needing more IT agility and scalability in the Delaware Valley Community Health IT environment.
Isaiah Nathaniel: Before, we couldn’t control a lot of the things that were happening. You just had this sense of angst because you did not know what was coming next.
[Related: Alex Karargyris’s Path to Becoming a Pioneer of Medical AI]
Jason Lopez: But in looking back at the years of the pandemic, he says a lot of things he and his team launched worked and much has stayed.
Isaiah Nathaniel: Now we can say, all right, we know where we are. We know where everything can possibly be, not only from just a personnel perspective but also from an infrastructure perspective. So we can say, hey, I know where this workload is. I know if I need to migrate this workload, I can do the same thing with one simple click. But then also from a security perspective, using products like Nutanix Flow that we instituted after the pandemic started and saying, “hey, now that we’re stable, let’s get more stable. Let’s take our scalability and be able to deliver workloads where we want them to be, but also secure them so that they aren’t impacting other workloads that need the productivity that we needed to have.”
Jason Lopez: There’s a balancing act he needs to do, between on-prem and the cloud, hands on and automation, and maintaining flexibility… which he refers to as enabling.
Isaiah Nathaniel: Enabling means actually not being the no people, saying, here’s a great idea. Give me a good use case. Make sure it’s secure. Bring it in the environment. We have the scalability because of our infrastructure to be able to test things out from a development perspective. And if it goes to market, so be it. And then we’ll go back to the whole wheel of innovation from there. I call it the scalability because I can pick my flavor of the day or flavor of the week because there’s a new app popping up literally every minute. And it’s so fun because I like the development that’s happening. I like the ingenuity. I like the innovation that’s coming out of these things. It’s about where’s the business case? Where’s my business need? And then we’ll throw an application potentially into it or add to one that already exists.
[Related: University-based Medical System Innovates Healthcare with Hybrid Cloud IT]
Jason Lopez: We’ve been talking a lot about healthcare IT here on Tech Barometer over the past year and privacy and security just can’t be emphasized enough. If you ever find yourself working in healthcare IT, it’s going to be ever present at the top of your to-do list.
Isaiah Nathaniel: When we look at legislation like the 21st Century Cures Act and how that impacts data at the point of care for the patients being really truly in charge of their information, my data is no longer four walls sustainable. It actually is beyond my four walls. And so for me, it’s make sure that, one, at rest it’s properly secured. But then in transmission, it’s extra secure so that when the patient gets it or the referring hospital and or specialty gets it, they can also say at that point it was secure. Your infrastructure internal to that, under that firewall, under that brick, is where the special sauce is. But I can at least say, CIO to CIO, “hey, you can trust my data.”
Jason Lopez: We started this report with Isaiah Nathaniel recounting a spiritual guide. It’s how he thinks about his role as the CIO of Delaware Valley Community Health. But it’s a lesson he learned from his uncle, Reverend Herbert Lusk II, who died in 2022. In the 1970s, Lusk was a professional football player who played for the Philadelphia Eagles under coach Dick Vermeil.
Isaiah Nathaniel: He was part of the team that went to the Super Bowl against the Raiders. He told Dick Vermeil, I’m only going to play three years, and then I’m going to go into the ministry. I’ve got a calling on my life. He was getting ready to be the lead running back, brand new contract, and he followed his calling. And that calling took him to North Philadelphia. North Philadelphia was depleted in the 80s. It was one of the worst urban areas in the country. And he took a church that had less than $5 in the bank account and over $500,000 in structural damage. Forty two years later, he rebuilt the church, over 1,000 members, welcomed three presidents, built the first welfare to work program in the country, and he left a lasting legacy. And to make this even more poignant, where the church is, is actually across the street from my home office. So his words to all of us as his children, his nephews, nieces, were these four principles. Never let anyone beat you giving. Never let anyone beat you loving. Never let anyone beat you believing. And finally, never let anyone beat you serving. When you talk about moments like that, when you lose such a powerful figure, I get up every day with those four principles. And my job is to serve my patients through access of technology and give them what they deserve.
Jason Lopez: Isaiah Nathaniel is the Vice President and Chief Information Officer for Delaware Valley Community Health in Philadelphia. This is the Tech Barometer podcast and we’re delighted to bring you these profiles of people in tech who are doing remarkable things. If you like what we do here, check out more stories both podcast and text pieces at the theforecastbynutanix.com. I’m Jason Lopez, thank you for listening.
In this Tech Barometer podcast, Nutanix President and CEO Rajiv Ramaswami explains the challenges his hybrid multicloud customers are facing as they move their organizations into a future increasingly powered by artificial intelligence.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Rajiv Ramaswami: I am optimistic about technology and its role in the economy because regardless of where I think the economy is, I think companies are going to invest in technology. They’re going to invest in software. If you look at the rates, I mean whatever GDP growth, I think tech spending will be growing faster than that. And then software spending within tech is probably going to grow faster than that just because of the nature of how companies are going digital. It’s a business imperative. Companies struggle with getting good software talent. There isn’t enough to go around. AI talent is even harder to get. The set of tools that you need to put together AI applications and get them going to market, that’s not easy either. And then finally, on top of that, there is a shortage of hardware – GPUs – today in the market. Even if you want to do it, you’ve got everything to do it, you can’t get a hold of the hardware.
Jason Lopez: You might be wondering, didn’t the speaker start by saying he’s optimistic about technology? This is the Tech Barometer podcast. I’m Jason Lopez. What follows are comments from Rajiv Ramaswami, CEO of Nutanix. These come from a conversation captured by an audio recorder in the room. So we thought it would be interesting to whittle this down into a short podcast to hear him essentially riffing on the topic of AI in the enterprise, which has become essential for companies trying to empower workers or streamline or automate.
Rajiv Ramaswami: Whether there is automation of business processes, whether it’s customer support, whether it’s document analysis and search or processing credit card applications or market applications or what may be, or making software developers more productive through co-piloting or enabling more automated capabilities like better fraud detection, et cetera. So these are all big things that can move the needle in a very significant way.
[Related: 9 Predictions for IT in Age of AI]
Jason Lopez: Rajiv sees momentum building, at least on the development side, in the next year or two. There’s an expectation for the emergence of the first wave of generative AI applications, building on the ecosystem. But the challenge will be to overcome a few things like GPU storage, cost benefit analysis and getting higher quality results.
Rajiv Ramaswami: If you’re, for example, using some sort of a copilot to generate snippets of code automated, for example, how good is the code? Can you trust it? Can you go send it out? Whatever use case may a customer service use case or where you’re looking for document search and retrieval. So getting the accuracy to a reasonable level where you feel comfortable. That’s another thing that you have to do and you have to keep training until you get to that level before you can actually put it into production and do inferencing.
Jason Lopez: AI implementation isn’t inexpensive. The cost of compute clusters for training can be very high, and Rajiv sees companies having to really clarify the ROI and make a business case for AI adoption.
Rajiv Ramaswami: And so I think people are also going to go through that life cycle of, okay, there’s a lot of interest in AI, and then they’re going to go implement and they’re going to say it’s expensive to implement and therefore they’re going to be, again, looking at business cases like everything else. I think we’ll go through that phase as we move forward here with AI, I think there’s a lot of potential and to realize the potential, you also have to pay attention to what it’s going to take to get it done and how much it’s going to cost and make sure you’re getting a benefit. And then you’ve got to go get it done. You have to go implement it, which means putting together the team of people, figuring out how to get your data in order, how to choose the right large language model, how to train it properly, how to reduce the size of the model to what you need, and then of course, train it and get into production, get the fidelity of the data results and then put it into production.
[Related: Generative AI Propels IT Modernization]
Jason Lopez: And this presumes you have the talent on board to make it happen.
Rajiv Ramaswami: It takes data scientists, it takes AI engineers and machine learning operational engineers, and then it takes good infrastructure people along with the developers who build the app. So it takes all of these skill sets to go bring this to life.
Jason Lopez: The other challenges of AI implementation revolve mainly around data management. And as we’ve already heard, it requires high fidelity data in the right place for effective algorithm functioning.
Rajiv Ramaswami: Getting the data together in the right place itself is a massive task for many customers. And the second is you have to run the AI algorithms where your data is because data has gravity and you need to protect that data. You don’t want to give up your IP when you run a general purpose AI LLM, for example, on your data. So you have to protect that as well. So that’s the other set of considerations that emerge when people are running these AI applications. And then we hear about large language models that are in the trillions of parameters and they can do great things, but they’re also very expensive. And so the question you have to understand is, what is it that I need from my application? Do I need that big a model? Can it do a smaller model? And I think there’s a lot of optimization that has to happen there also.
[Related: Developing in the Age of AI and Multicloud]
Jason Lopez: Nutanix has gone through a process of AI implementation and uses a cloud platform known as GPT in a box. It provides an integrated solution with storage and machine learning toolkits.
Rajiv Ramaswami: So we can help our customers run their AI applications using a platform that’s close to being a turnkey platform, and it can be used wherever their data is sent. And so this is a platform that we call GPT-in-a-Box. It’s our usual cloud platform. It’s what we all use it for, running every other application. In this case, we also include files and object storage with our unified storage because all these applications need a lot of storage for the data. And then we include some commonly needed machine learning and operational toolkits as part of this model, because again, customers don’t have the where with all to go integrate everything that’s needed to run an AI application. So we try to integrate everything that’s under the covers needed to run an AI application so the customers can focus on the application itself, and they can rely on our platform to go run it wherever they’d like to run, wherever the data is present.
[Related: Generative AI Moves Beyond Hype for IT Operations]
Jason Lopez: Twenty-twenty-three was the year of large language models.
Rajiv Ramaswami: Twenty-four, I think, is going to be the year where it becomes more real. People start building applications, especially not consumer applications like chat and writing poems to your friends using ChatGPT, but real enterprise business applications that could be running. So this is probably going to be the year where people start using these for good business use cases. I think that’s the case there.
Jason Lopez: Rajiv Ramaswami is the CEO of Nutanix. This is the Tech Barometer podcast. I’m Jason Lopez. Check out another Tech Barometer podcast featuring Rajiv’s comments on the Nutanix roadmap in the story why hybrid multi-cloud matters. You can find it and other tech stories at theforecastbynutanix.com. Tech Barometer is a production of The Forecast. Thanks for listening.
In this Tech Barometer podcast segment, Nutanix President and CEO Rajiv Ramaswami discusses the challenges driving more IT leaders to develop hybrid multicloud strategies for managing across private data centers, public cloud services, edge computing sites while enabling new application development and AI capabilities.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Rajiv Ramaswami: As customers here, all of you expect to have solutions that meet your business outcomes. We solve some portions of that, but we don’t claim to solve everything. So clearly that’s why we are investing in the ecosystem here around us, the ecosystem at every level, the ecosystem in terms of our OEM partners, our cloud partnerships, our best-of-breed partners in areas that we don’t play in like security for example, in cloud native Kubernetes and public cloud providers. We all realize that we operate in this broad ecosystem and we have to come together to help you get that solution. So that’s what we are committed to doing, we’ll continue down that path and we hope to create deeper and deeper relationships with our ecosystem.
Jason Lopez: What you’re hearing is a talk Rajiv Ramaswami, CEO of Nutanix, gave to Nutanix customers at the Nutanix dot NEXT conference in 2023. He highlighted several partners, such as OEMs like HP, Dell, Lenovo, and Super Micro, a security partnership with Palo Alto Networks, cloud-native services with Red Hat, collaboration with major cloud providers like Azure and AWS, and with Citrix, particularly in VDI workloads which represents about 20% of Nutanix’s platform usage. This is the Tech Barometer podcast, I’m Jason Lopez. In this talk, Rajiv addresses hybrid multicloud, public cloud, edge technology, platform services, and a brief picture of the Nutanix roadmap. But to get back into the talk, here Rajiv touches on the company’s support of AI application development and its integration into services.
Rajiv Ramaswami: There are two parts to that role. The first part is many of you are developing new applications that do use AI, and we want to be the platform that you can run those applications on. We are also committed to open source on this. There’s a lot of open source work being done on AI. We are also working closely with Nvidia because a lot of these use GPUs and we expose DPU through our platform and help you use them in an efficient way. Clearly one whole approach around making these AI workloads work well on our platform. And some of these tend to be very industry-specific workloads like retail and manufacturing as examples that I mentioned. So that’s part one. Part two is using AI internally within our company’s offerings in terms of the products and services that you consume from us. So in fact, our Prism Pro, by the way, the R & D team for Prism Pro is actually called AI Ops because we truly believe that we can actually make operations more efficient by using machine learning and deep learning. That’s just one example of where we are starting to use some ai. Another example is we all, at least a good chunk of you actually provide telemetry data for us. We’d like to do more with the telemetry data. Of course, protecting identities, protecting privacy, of course, is very important there. But being able to look at the telemetry data, we could potentially be doing things like predictive analytics and helping you understand what needs to be changed. And so there are potentially new use cases there. And then of course when it comes to support, I want to make sure we retain our NPS there and we continue to do a great job supporting you, but there’s also AI that can be used inside to help make that process even more efficient.
Jason Lopez: Now imagine, if you will, a digital landscape, with applications and data freely roaming across multiple domains. In the middle of this, there’s the home base, the on-prem setup. There’s the edge, on the outskirts. Then there are the public clouds. In this next part of Rajiv’s talk, he hones in on creating a single, unified platform that bridges these diverse places..
Rajiv Ramaswami: The reality is yes, most of you are actually hybrid multi-cloud in the sense that you have these applications and data in multiple places. You have your on-prem, you might have your edge, you have public cloud, a, public cloud B for the most part. Each of these is different. They operate as silos. You have a different stack, you have different processes, tooling, and security to manage each of these. That’s actually what hybrid multi-cloud is today. And what we aim to do is to simplify that for you with a single platform at the infrastructure level that cuts across all of these and gives you that same experience, same tools, same processes, and complete flexibility to run your applications wherever you’d like across these environments and manage them all with a single team. That’s really, I think what we are aspiring to do, and we’ve got a lot of proof points along the way. We’ve got our offerings today on AWS on Azure with a number of managed service providers, and we are seeing an increasing number of edge opportunities in very specific verticals. Manufacturing, and retail, for example, just to name a few. And of course, defense.
Jason Lopez: Attitudes toward using public cloud services are changing. Nutanix initially embraced the cloud for certain services but eventually had to reconsider and move some of their operations back to a private data center to control costs more effectively. Here, Rajiv addresses this.
Rajiv Ramaswami: We are certainly seeing people being a lot more careful about what to do in the public cloud or what not to do because if you had asked this question three, four years ago, a lot of people in the room would just say, I’m going to the public cloud unless I’m a dark site. I’ve got some specific requirements. A lot of people would say, I can go to the public cloud. And then a couple of things happened over the last few years for those of you who have gone, I think you’ve realized that it isn’t as easy to take everything you want to the public cloud. It can be very painful for lots of applications and will need refactoring and potentially re-platforming. So not easy to take your existing apps. And for those new apps that you’re building, it’s great. It’s an easy on-ramp. But once you start running it at scale, and once you start running it continuously, the cost starts Up. And we’ve experienced that even at Nutanix. My cloud bill keeps going up every year and we keep trying to look at what we can do to optimize this. And I’ll give you one example of what we have done, on a much smaller scale. One, during COVID, we started a program called test drive. Test Drive ran on Google Cloud. Actually, it’s a nested hypervisor for those of you who want to be technical, but they didn’t have a bare metal offering at that time. And it proved to be quite popular. We didn’t charge for it because it was just an online proof of concept. And the use has continued to grow like crazy for us. And our cloud bill, therefore from Google, keeps going up every year. We said, okay, well we’ve got to now it’s starting to get serious. This is here with us to stay. We have to treat this properly and figure out how to optimize it. And so what did we do? Well, we moved back a chunk of what we call the steady state workloads back to our data center. We run that very cost-efficiently. Then, for burst capacity, we use the cloud, and it’s working out well. It’s certainly saving us some dollars when it comes to cloud costs. And what you’re going to see is a lot of companies realizing going through the same journey that we did, which is there’s an easy on-ramp to the public cloud. It’s an easy way for you to get a new app out there quickly, and if you don’t do it right, you’re going to be locked into the public cloud. At least in our case, it was portable. We could move it. It’s tempting to go use all the services, get there quickly, and build this app and run it. But then you realize that as you start scaling, at the end of the day, they have to make their margin. So you end up spending more and you can certainly, I always say a well-run private cloud infrastructure can certainly beat the public cloud in terms of pure cost. There’s no doubt about that. And I think lots of you probably have experience with that and you’ve done that work already. So we are certainly seeing that as, I don’t know if it’s maybe a little too early to call a trend, but I think what certainly we’re seeing as a trend is people being much more circumspect about what’s going to go in the public cloud. And I can’t say I’ve seen a trend in terms of everybody moving back from the public cloud.
Jason Lopez: Edge means different things to different people. But Rajiv points out its evolution has paved the way for a new generation of edge applications. New use cases demand advanced computing power, containerized applications and centralized automated management systems.
Rajiv Ramaswami: The way I would think of edges would be, let’s call it reasonably high compute edges. Some people call it near edges. And then other people say, I call it far edges where you have much lower cost, very simple solutions that are more OT type deployments. So for us, we are more focused on the compute edges. In fact, to put this in perspective, what you are deploying as a server in the data center three years ago, you can actually get more computing in a single server sitting in the edge today than you probably got in your data center a few years ago. So imagine tons and tons of compute potential available in the edge by deploying very few numbers of servers and a small number of nodes, one-node deployments, and three-node deployments. And so there’s a lot you can do with it. But more importantly for many of you, there’s a whole new set of applications that are emerging at the edge. If you’re in retail, we are talking to people about fraud detection. We are talking to people about automatic checkout manufacturing. We talked to car manufacturers who are saying, I want to have completely automated visual inspection of defects through machine learning and ai. So just to name a few here. And so there’s just a range of these new edge applications coming in. There’s a lot of data being generated at the edge as well, and you might be able to do training for some of these AI applications in the cloud, but inferencing will likely be done locally. And as you look at this, these edge use cases actually starting to get fairly compute-heavy, and we are engaged with many customers today in terms of helping our solution optimize for those specific use cases. Now, what’s common in addition to meeting these specific application needs is that most of the new applications are containerized. There’s a lot of AI being used and data management being needed, and there’s also a need for clearly centralized management, provisioning, upgrades, everything because you’re not going to be able to go out there and have people manage your edges. It has to be automated. So that’s what we are seeing today, and I’m sure this is going to continue to evolve over the next few years.
Jason Lopez: Rajiv’s talk moved on to a vision for simplifying the management of applications across platforms. He says it comes down to a platform service vision.
Rajiv Ramaswami: If you look at applications today, modern applications are being built with containers and Kubernetes, and that Kubernetes substrate is available for you everywhere. I would almost go so far as to say it’s starting to be commoditized. It’s everywhere. You can get it on-prem, you can get it in AWS, they have EKS, and you can get it in Azure. They have AKS. You can get it everywhere. Google has GKE. So that the compute substrate is available everywhere. In addition to the compute substrate, all apps also need a set of data services. Most apps, almost all apps will need databases. They’ll need messaging and streaming. They’ll need caching, they’ll need search. And this is a set of services, most of them related to data that’s available today in the public clouds. The only issue there are the public clouds, so that they tend to be siloed. It’s not easy for you to go from one to the other. It’s not easy for you to have flexibility in terms of avoiding locking in. And so what we are looking to do is to provide you with a consistent set of these data services across everywhere, right? Across all native substrates. You can run it on top of a Nutanix infrastructure, of course, wherever that’s available. But we are also going to enable these services to be available natively on AWS, Azure, and other native cloud substrates, so that you can truly then think about building an app once using this set of services. You could see how easy it is to be able to deploy that app anywhere and also not be locked in.
Jason Lopez: In this last section of Rajiv’s chat with customers, he touches on the company’s plan for enhancing their data services, especially in the context of Kubernetes and containerized applications.
Rajiv Ramaswami: So really you’ll see a range of data services for Kubernetes and containers that will essentially help you to run these modern applications and deal with containers much the same way as you deal with a VM. We always do snapshots, but now we are going to be doing snapshots and being able to store the snapshots in low-cost public cloud object stores or any SC-compatible object store for that matter that has a lot of use cases and implications. They’re going to provide you with a single console for you to look at your entire estate and manage your entire estate across on-prem public clouds and edges. And the fourth is more of this foundational vision around our future, how we can help you build these applications, modern applications in a portable way, using a consistent set of data services and being able to run them anywhere. This vision is for us to help you build portable applications. This is a five, 10 year journey for us and we are just getting started with our Nutanix database service. So I’m excited about the future of the company. I’m excited about how we can continue to meet your needs, not just for today, but also as you go forward.
Jason Lopez: Rajiv Ramaswami is the CEO of Nutanix. This was a talk he gave before customers at the Nutanix dot NEXT conference in Chicago in 2023. In May of 2024 the conference moves to Barcelona, Spain. This is the Tech Barometer podcast, I’m Jason Lopez. Tech Barometer is a production of the forecast. If you like what we do here check out more stories at theforecastbynutanix.com.
Alex Karargyris is helping a nonprofit called ML Commons develop open-source technologies that bring global standards to medical AI/ML initiatives.
Find more enterprise cloud news, features stories and profiles at The Forecast.
Transcript:
Jason Lopez:
Alex Karargyris:
Jason Lopez:
Alex Karargyris:
Jason Lopez:
Alex Karargyris:
Jason Lopez:
Alex Karargyris:
Jason Lopez:
Alex Karargyris:
Jason Lopez:
Alex Karargyris:
Jason Lopez:
Alex Karargyris:
Jason Lopez:
Alex Karargyris:
Jason Lopez:
Alex Karargyris:
Jason Lopez:
Alex Karargyris:
Jason Lopez:
From the publisher's feed