Listen to another podcast from the team at Robohub. More podcasts from them can be found here.
Over the past decade, camera technology has made gradual, and significant improvements thanks to the mobile phone industry. This has accelerated multiple industries, including Robotics. Today, Davide Scaramuzza discusses a step-change in camera innovation that has the potential to dramatically accelerate vision-based robotics applications.
Davide Scaramuzza deep dives on Event Cameras, which operate fundamentally different from traditional cameras. Instead of sampling every pixel on an imaging sensor at a fixed frequency, the “pixels” on an event camera all operate independently, and each responds to changes in illumination.
This technology unlocks a multitude of benefits, including extremely highspeed imaging, removal of the concept of “framerate”, removal of data corruption due to having the sun in the sensor, reduced data throughput, and low power consumption. Tune in for more.
Davide Scaramuzza
Davide Scaramuzza is a Professor of Robotics and Perception at both departments of Informatics (University of Zurich) and Neuroinformatics (joint between the University of Zurich and ETH Zurich), where he directs the Robotics and Perception Group. His research lies at the intersection of robotics, computer vision, and machine learning, using standard cameras and event cameras, and aims to enable autonomous, agile, navigation of micro drones in search-and-rescue applications.
Transcript
Abate De Mey: Hey, welcome to Robohub.
Davide Scaramuzza: Hi, thank you.
Abate De Mey: So firstly, I’d like to give a little bit of background about why I reached out and invited you to the show today. So over the past few months, I’ve been working a lot with my team at fluid dev, where we’ve been building a platform, helping robotics companies scale.
And while we were working with one of the companies on that platform, we were digging into a lot of open source VSLAM algorithms. Um, and we just kept running into your name as we were doing research and reading up on this. So your name and your team at the university of Zurich. So I’m super excited to have you on today and I’d love to learn just a little bit more about yourself and what your team is doing.
Davide Scaramuzza: Thank you. It’s my honor to be here with this.
Abate De Mey: Awesome. Yeah. So could you tell me a little bit about yourself and your background.
Davide Scaramuzza: So, yeah, I am a professor of robotics and perception at the university of Zurich where I lead the, the robotics and perception group, which is actually now 10 years old. Uh, we are about 15 researchers and we do research at the intersection of robotics, computer, vision, learning and control. Our main goal is to basically understand that how we can make robots understand environment in order to navigate autonomously from a to B.
And our main uh, robotic platform is actually drones. Quadcopters, because they are super agile and they can actually do things much faster than their ground robot counterpart. And one, main characteristic of our lab is that we, we use only cameras as the main sensor modality plus inertial measurement units (IMUs).
And we use either a standard cameras or event cameras, or a combination of both
Abate De Mey: yeah. And so you’ve been with this team for quite a while. So what was your journey like when you started over there? How long ago was that? And then how did it transform to where it is today?
Davide Scaramuzza: So, yeah, when I started I was just an assistant professor. I had no PhD student, so I applied for a lot of proposals and then that’s how actually, then I was able to hire so many people. So at the moment there are like 10 PhD students and three post docs. So we started initially with the, with the drone navigation.
And then a few years later, we started working on event cameras because we realized that actually, if you want to be faster than humans in in perceiving and reacting to change...