
Sign up to save your podcasts
Or
A lot of XR
Alan: Hey, everyone, it’s Alan Smithson here today. We’re speaking with Nick Cherukuri, founder of ThirdEye, about their all-in-one AR glasses hardware and software solution for enterprise in logistics, manufacturing, and engineering and how these tools are revolutionizing how we work. All coming up next on the XR for Business Podcast.
Welcome to the show, Nick.
Nick: Thanks, Alan. Glad to be
Alan: I’m really excited. You
Nick: Definitely. So just to
And augmented reality, it’s definitely considered the next major tech platform. So we’ve been developing a lot of AR hardware and software applications for the military. And a few– a couple of years ago, we decided to take some of our technical know-how, our leading engineers — we have state-of-the-art labs here in Princeton, New Jersey — and we decided to develop a commercial product. So we spun off into ThirdEye and we created– just this year, we– earlier this year, we released our X2 mixed reality glasses. So there’s just some high-level overview of the X2. We wanted to really address the customer concerns. We felt this was an optimal time to get into the commercial market. So we feel it’s too early for the consumer market right now, but the commercial AR market is definitely something that we are seeing a lot of traction happening.
So we wanted to develop a pair of
Our glasses are Android-based, so it’s really easy to make access for upgrading to Android 9 soon, so we can take advantage of features like GPS, built-in. We have about a 42-degree field of view. So a binocular field of view is something we have seen customers prefer over a monocular field of view, because it’s less eyestrain. Binocular field of view is more natural to the human experience. We have two eyes, not one eye. So we wanted to develop a binocular pair of glasses, which we did. Our brightness level, we have about 300 nits of brightness in our optic system. So this can be used both indoors and outdoors, which is not the case for some other binocular glasses, which are more indoor products. So we wanted to develop our glass in a way that can be used both indoors and outdoors. It’s lightweight, it’s less than 10 ounces. So it’s something that– it’s easy to wear for a lengthy period of time without feeling any ergonomic issues. And we added some sensors like a built-in flashlight, a 30-megapixel camera. So if you’re running a remote help application for your field workers, you can stream really high-resolution content from your field worker point of view to a remote expert hundreds of miles away.
And we also have built-in SLAM. So SLAM stands for Simultaneous Localization And Mapping. We developed our own proprietary SLAM software that runs on our glasses that’s customized for hardware, so we can do inside out six-degrees-of-freedom tracking. We can do plane detection. So, for example, you could have a hologram of a 3D engine hovering in midair and the user could walk around it. So there are only a few glasses right now that are able to do highly accurate SLAM and our SLAM is accurate. It has about a one-inch drift accuracy and can be used both indoors and outdoors. So you can move your head around rapidly and the hologram will remain fixed in place. So SLAM is something that lets enterprises do more advanced applications, not just 2D AR screens, but you can actually interact with the real world. You can tag mixed reality content onto a giant machine, and leave the room and come back. And it’s still tagged on that location very accurately. So, for example, a worker could have step one, step two, step three, mapped out onto a factory floor, and be able to do that on a daily basis.
So it’s something that allows the glasses to actually interact with the real-world environment, which is where we see the cutting edge mixed reality software development happening for enterprise. So we’re really targeting the industrial, field services, manufacturing, and healthcare sectors. Those are our four main enterprise sectors and we are involved in a lot of other sectors. We have a lot of gaming and entertainment–
Alan: I’m sorry, Nick. What were
Nick: Industrial, field services, manufacturing, and healthcare. So I’d say those are the four. And we partner with many of the leading AR and mixed reality software companies, who have their applications running on our glasses. So we want to create as wide a developer ecosystem as possible. We don’t want to have a closed system, where we only have a few apps, or make it really tough for developers to develop applications. We want to have an open-source operating system, provide a lot of documentation. We have a Unity SDK. We have an Unreal engine SDK. It’s been fairly easy for developers to port applications or create apps on our glasses.
One last point — which is also
And what we’re seeing is, whereas before it might have taken close to 12 months to escape a pilot purgatory into a larger deployment, now we’re seeing enterprises — because there have been success stories right now — deploy within three to six months. So from the initial testing phase and getting all the key players on board — from the innovation department to the business department — and then going to a larger-scale deployment. So I think right now, because there have been a lot of lessons learned from other companies as to what works well for these smartglass deployments and what doesn’t work well.
We definitely really try to incorporate
Alan: So you’ve talked about
Nick: Sure. So what we’re seeing
Another way they come at this is their
But I think right now what we’re seeing is in nearly every industry, even really narrow ones like utilities or wastewater, that’s really specialized, AR software companies who are targeting each of these industries. So I think every industry right now has some augmented reality software that is really effectively targeting like industry-specific use cases. So what we try to do is we partner with a software company. So depending on what the enterprise is, if they’re a field service company, or telecommunications, or industrial, or a visually impaired group, then we partner with the software company that has the best software that deals with that use case.
So we’re seeing a proliferation of
Alan: If you kind of put your
Nick: Definitely. And that’s a great question. And I think long term, that’s what everyone’s predicting is, this is going to replace your phone. And it’s just a matter of what technology has the right features to make consumers want to replace their phone with a pair of glasses. So what we see is there’s a couple of core challenges right now, that need to be addressed for consumer deployment. So, field of view is probably the biggest one. The natural human field of view is, I would say roughly around 210 degrees. And right now, the widest field of view glasses — that are in mass production — have between a 40 to 50, 55-degree field of view. I know there are some prototypes that have 70, 80, 90-degree field of view, but in actual mass production now, that’s the field of view that’s there. And I think for consumers, they would want a really wide field of view. As opposed to enterprise, where a narrower field of view helps achieve their ROI use case, so they don’t really need a massive field of view. But I think the field of view definitely needs to be increased, and every year it’s definitely being increased by some of these leading optics companies. And once that progresses closer to what feels like a natural human experience, I think that will really help propel this smartglass for consumer deployment.
Another important factor is the form factor. So I think for consumers, they want it to look like a cool pair of Ray-Bans or glasses. And even technical features like a battery, there needs to be way to reduce that in size. Right now, some of these consumer companies, they’re finding a way around that by having a wire that goes behind your ear to connect to your phone as a processing pack, and that’s the battery source. So that’s one way around it. But we think that consumers want it to be entirely hands-free, just like enterprises want their device to be hands-free. They don’t want to walk around with wired packs or anything, and they want it just to be a pair of nice, cool-looking Ray-Bans they can wear.
So I think the field of view, battery,
Alan: You skirted around the
Nick: Sure, I did. [laughs]
Alan: [laughs] Nobody wants to
Nick: That’s hard to predict
Alan: But here’s the thing, and
Nick: Definitely. And I think
Alan: What are some of the use cases that people are using right now that are generating the most ROI? Like, if I’m a procurement manager at a manufacturing facility, what can I do to wow my executive team by firing a couple of pairs of these glasses and starting right away? What’s the lowest hanging fruit that I can get immediate ROI, because that seems to be how these things are being unlocked. You do a pilot or a small thing, you show an amazing ROI, and then it unlocks the budget to roll this out at scale. So what is that?
Nick: I mean, there’s so many applications, but kind of the way we like to talk about it is just like computers have the Office Suite of Microsoft Word, Microsoft Excel, Microsoft PowerPoint that nearly every organization uses those applications. Similarly, for these smartglasses, there’s some overarching applications that we’re seeing are being really commonly used across industries. So that is remote assistance, so someone can see what you see. And it’s great for training new employees and providing remote help. Manufacturing checklist, QR code scanning. So if you’re in a warehouse or manufacturing center, getting step by step instructions overlaid for your specific task flow, or being able to scan QR codes with the glasses and get visual instructions. And then the other most common application is 3D twins and more mixed reality, where you have a 3D digital rendering of real-world objects. So for example, with mixed reality with SLAM, you can scan your environment into a 3D model and you can tag information, any information you want onto the real world, in this– using this virtual 3D model.
So those are the three applications that we’re seeing are being really commonly used. And I think what we envision — and based on the feedback we’re seeing is — those will kind of be the Microsoft Word/Excel/PowerPoint of AR mixed reality, where they’re just really commonly used across a lot of industries. And if you look at most of the AR software companies at the moment, most of them fall into one of those three application categories. And I think the reason is there’s such an immediate ROI it just makes so much common sense, where you’re hands-free, you don’t need to carry around a 50-page manual or use your hands. 80 percent of the global workforce use their hands while they work, so they need an entirely hands-free digital interface, while still being able to walk around and do their daily tasks. So I think those applications are seeing or having some tremendous ROI, we’re seeing close to a 40 percent savings in task time for some of these companies. And a lot of savings in training new workers. Worker safety. And you can really customize the task flow for your individual company needs. So let’s say those are the three most common applications and there’s really some really great AR software companies who are developing. That’s all four.
Alan: My last question for you,
Nick: So one personal preference of mine, and that’s the beauty of mixed reality is definitely in the healthcare space. We’re seeing some really tremendous real-world use cases. So there’s roughly a 200-million worldwide vision-impaired market, where people who can’t see properly or have some type of vision impairment. And with XR, they’re able to really change their lives. And with the addition of 5G and cellular chip directly built into glasses, they can walk around their daily lives using these glasses. And it really helps change their lives on a really personal level. These other use cases are great in terms of worker efficiency and proving KPIs. But from an actual impact in someone’s personal life on a daily basis, some of these healthcare applications — and specifically these vision-impaired community — using these mixed reality glasses is really helping change their lives in a positive way. I think so many times you hear of technology having a negative impact on the world. But I think with this XR technology and with these small streamlined glasses, we’re seeing some really positive and heartwarming use cases. And I think that’s great to see. And definitely healthcare space is a personal favorite of mine for some of these AR mixed reality glass deployments.
Alan: Well, thank you, Nick.
Nick: Sure. So you can visit our
4.5
1212 ratings
A lot of XR
Alan: Hey, everyone, it’s Alan Smithson here today. We’re speaking with Nick Cherukuri, founder of ThirdEye, about their all-in-one AR glasses hardware and software solution for enterprise in logistics, manufacturing, and engineering and how these tools are revolutionizing how we work. All coming up next on the XR for Business Podcast.
Welcome to the show, Nick.
Nick: Thanks, Alan. Glad to be
Alan: I’m really excited. You
Nick: Definitely. So just to
And augmented reality, it’s definitely considered the next major tech platform. So we’ve been developing a lot of AR hardware and software applications for the military. And a few– a couple of years ago, we decided to take some of our technical know-how, our leading engineers — we have state-of-the-art labs here in Princeton, New Jersey — and we decided to develop a commercial product. So we spun off into ThirdEye and we created– just this year, we– earlier this year, we released our X2 mixed reality glasses. So there’s just some high-level overview of the X2. We wanted to really address the customer concerns. We felt this was an optimal time to get into the commercial market. So we feel it’s too early for the consumer market right now, but the commercial AR market is definitely something that we are seeing a lot of traction happening.
So we wanted to develop a pair of
Our glasses are Android-based, so it’s really easy to make access for upgrading to Android 9 soon, so we can take advantage of features like GPS, built-in. We have about a 42-degree field of view. So a binocular field of view is something we have seen customers prefer over a monocular field of view, because it’s less eyestrain. Binocular field of view is more natural to the human experience. We have two eyes, not one eye. So we wanted to develop a binocular pair of glasses, which we did. Our brightness level, we have about 300 nits of brightness in our optic system. So this can be used both indoors and outdoors, which is not the case for some other binocular glasses, which are more indoor products. So we wanted to develop our glass in a way that can be used both indoors and outdoors. It’s lightweight, it’s less than 10 ounces. So it’s something that– it’s easy to wear for a lengthy period of time without feeling any ergonomic issues. And we added some sensors like a built-in flashlight, a 30-megapixel camera. So if you’re running a remote help application for your field workers, you can stream really high-resolution content from your field worker point of view to a remote expert hundreds of miles away.
And we also have built-in SLAM. So SLAM stands for Simultaneous Localization And Mapping. We developed our own proprietary SLAM software that runs on our glasses that’s customized for hardware, so we can do inside out six-degrees-of-freedom tracking. We can do plane detection. So, for example, you could have a hologram of a 3D engine hovering in midair and the user could walk around it. So there are only a few glasses right now that are able to do highly accurate SLAM and our SLAM is accurate. It has about a one-inch drift accuracy and can be used both indoors and outdoors. So you can move your head around rapidly and the hologram will remain fixed in place. So SLAM is something that lets enterprises do more advanced applications, not just 2D AR screens, but you can actually interact with the real world. You can tag mixed reality content onto a giant machine, and leave the room and come back. And it’s still tagged on that location very accurately. So, for example, a worker could have step one, step two, step three, mapped out onto a factory floor, and be able to do that on a daily basis.
So it’s something that allows the glasses to actually interact with the real-world environment, which is where we see the cutting edge mixed reality software development happening for enterprise. So we’re really targeting the industrial, field services, manufacturing, and healthcare sectors. Those are our four main enterprise sectors and we are involved in a lot of other sectors. We have a lot of gaming and entertainment–
Alan: I’m sorry, Nick. What were
Nick: Industrial, field services, manufacturing, and healthcare. So I’d say those are the four. And we partner with many of the leading AR and mixed reality software companies, who have their applications running on our glasses. So we want to create as wide a developer ecosystem as possible. We don’t want to have a closed system, where we only have a few apps, or make it really tough for developers to develop applications. We want to have an open-source operating system, provide a lot of documentation. We have a Unity SDK. We have an Unreal engine SDK. It’s been fairly easy for developers to port applications or create apps on our glasses.
One last point — which is also
And what we’re seeing is, whereas before it might have taken close to 12 months to escape a pilot purgatory into a larger deployment, now we’re seeing enterprises — because there have been success stories right now — deploy within three to six months. So from the initial testing phase and getting all the key players on board — from the innovation department to the business department — and then going to a larger-scale deployment. So I think right now, because there have been a lot of lessons learned from other companies as to what works well for these smartglass deployments and what doesn’t work well.
We definitely really try to incorporate
Alan: So you’ve talked about
Nick: Sure. So what we’re seeing
Another way they come at this is their
But I think right now what we’re seeing is in nearly every industry, even really narrow ones like utilities or wastewater, that’s really specialized, AR software companies who are targeting each of these industries. So I think every industry right now has some augmented reality software that is really effectively targeting like industry-specific use cases. So what we try to do is we partner with a software company. So depending on what the enterprise is, if they’re a field service company, or telecommunications, or industrial, or a visually impaired group, then we partner with the software company that has the best software that deals with that use case.
So we’re seeing a proliferation of
Alan: If you kind of put your
Nick: Definitely. And that’s a great question. And I think long term, that’s what everyone’s predicting is, this is going to replace your phone. And it’s just a matter of what technology has the right features to make consumers want to replace their phone with a pair of glasses. So what we see is there’s a couple of core challenges right now, that need to be addressed for consumer deployment. So, field of view is probably the biggest one. The natural human field of view is, I would say roughly around 210 degrees. And right now, the widest field of view glasses — that are in mass production — have between a 40 to 50, 55-degree field of view. I know there are some prototypes that have 70, 80, 90-degree field of view, but in actual mass production now, that’s the field of view that’s there. And I think for consumers, they would want a really wide field of view. As opposed to enterprise, where a narrower field of view helps achieve their ROI use case, so they don’t really need a massive field of view. But I think the field of view definitely needs to be increased, and every year it’s definitely being increased by some of these leading optics companies. And once that progresses closer to what feels like a natural human experience, I think that will really help propel this smartglass for consumer deployment.
Another important factor is the form factor. So I think for consumers, they want it to look like a cool pair of Ray-Bans or glasses. And even technical features like a battery, there needs to be way to reduce that in size. Right now, some of these consumer companies, they’re finding a way around that by having a wire that goes behind your ear to connect to your phone as a processing pack, and that’s the battery source. So that’s one way around it. But we think that consumers want it to be entirely hands-free, just like enterprises want their device to be hands-free. They don’t want to walk around with wired packs or anything, and they want it just to be a pair of nice, cool-looking Ray-Bans they can wear.
So I think the field of view, battery,
Alan: You skirted around the
Nick: Sure, I did. [laughs]
Alan: [laughs] Nobody wants to
Nick: That’s hard to predict
Alan: But here’s the thing, and
Nick: Definitely. And I think
Alan: What are some of the use cases that people are using right now that are generating the most ROI? Like, if I’m a procurement manager at a manufacturing facility, what can I do to wow my executive team by firing a couple of pairs of these glasses and starting right away? What’s the lowest hanging fruit that I can get immediate ROI, because that seems to be how these things are being unlocked. You do a pilot or a small thing, you show an amazing ROI, and then it unlocks the budget to roll this out at scale. So what is that?
Nick: I mean, there’s so many applications, but kind of the way we like to talk about it is just like computers have the Office Suite of Microsoft Word, Microsoft Excel, Microsoft PowerPoint that nearly every organization uses those applications. Similarly, for these smartglasses, there’s some overarching applications that we’re seeing are being really commonly used across industries. So that is remote assistance, so someone can see what you see. And it’s great for training new employees and providing remote help. Manufacturing checklist, QR code scanning. So if you’re in a warehouse or manufacturing center, getting step by step instructions overlaid for your specific task flow, or being able to scan QR codes with the glasses and get visual instructions. And then the other most common application is 3D twins and more mixed reality, where you have a 3D digital rendering of real-world objects. So for example, with mixed reality with SLAM, you can scan your environment into a 3D model and you can tag information, any information you want onto the real world, in this– using this virtual 3D model.
So those are the three applications that we’re seeing are being really commonly used. And I think what we envision — and based on the feedback we’re seeing is — those will kind of be the Microsoft Word/Excel/PowerPoint of AR mixed reality, where they’re just really commonly used across a lot of industries. And if you look at most of the AR software companies at the moment, most of them fall into one of those three application categories. And I think the reason is there’s such an immediate ROI it just makes so much common sense, where you’re hands-free, you don’t need to carry around a 50-page manual or use your hands. 80 percent of the global workforce use their hands while they work, so they need an entirely hands-free digital interface, while still being able to walk around and do their daily tasks. So I think those applications are seeing or having some tremendous ROI, we’re seeing close to a 40 percent savings in task time for some of these companies. And a lot of savings in training new workers. Worker safety. And you can really customize the task flow for your individual company needs. So let’s say those are the three most common applications and there’s really some really great AR software companies who are developing. That’s all four.
Alan: My last question for you,
Nick: So one personal preference of mine, and that’s the beauty of mixed reality is definitely in the healthcare space. We’re seeing some really tremendous real-world use cases. So there’s roughly a 200-million worldwide vision-impaired market, where people who can’t see properly or have some type of vision impairment. And with XR, they’re able to really change their lives. And with the addition of 5G and cellular chip directly built into glasses, they can walk around their daily lives using these glasses. And it really helps change their lives on a really personal level. These other use cases are great in terms of worker efficiency and proving KPIs. But from an actual impact in someone’s personal life on a daily basis, some of these healthcare applications — and specifically these vision-impaired community — using these mixed reality glasses is really helping change their lives in a positive way. I think so many times you hear of technology having a negative impact on the world. But I think with this XR technology and with these small streamlined glasses, we’re seeing some really positive and heartwarming use cases. And I think that’s great to see. And definitely healthcare space is a personal favorite of mine for some of these AR mixed reality glass deployments.
Alan: Well, thank you, Nick.
Nick: Sure. So you can visit our