The Amp Hour Electronics Podcast

#638 – Building AR Headsets with Aedan Cullen


Listen Later

Welcome, Aedan Cullen!

  • Chris first learned of Aedan from his 2022 Hackaday talk about building an AR system
  • AR is “Augmented Reality”, but that term is different depending on the company / headset (think “magic leap” vs “google glass”)
  • Got into AR because of robotics, he had be doing software around SLAM and CV
  • Interacting with objects in 3D space
  • The first board he was working with was the Jetson TK1
  • Magic Leap’s “Lightpack” had a Tegra in it
  • Apple’s new Vision Pro is more like VR with passthrough (and creepy eyes!)
  • Being able to wear an AR unit all day
  • Resolution matters
  • What is it worth spending power on in a headset?
  • The previous rev used the AllWinner D1 RISCV and can support one camera
  • Which way should you point a camera on a pair of glasses?
  • MIPI DSI outputs and DSP processing
  • Lots of SIPs available for high density designs
  • Octavo makes SIPs out of other companies’ silicon.
  • Jason and Robert from BeagleBoard talked about Octavo when they were on the show
  • ECX337 from Sony needs 10V
  • Torex power modules helped save space too by being stacked on top of the inductor
  • Sony uses LVDS (FPDlink) and not MIPI
  • Offloaded processing to a phone or computer
  • Power
  • Wi-Fi vs bluetooth
  • New goal is to minimize power during processing, now it’ll be efficiency around WiFi and Display
  • With OLEDs you can selectively turn on pixels
  • Goal for the battery is 8 hours for “all day”
  • What is Aedan’s “requirements space” and what’s driving it?
  • Cost has become a concern for new boards
  • Using an assembly house to have one known-good assembly board
  • What’s on the new board?
    • The new display has MIPI DSI
      • The display doesn’t support 2 lane DSI out of the box
      • Displays are sometimes configurable in terms of how many lanes with registers
      • What do the lanes refer to? Each pair (“Data lane”) is a differential pair
      • Most displays will do 4 lanes (8 conductors) at 1Gbps
      • “Giganibbles per second”
      • Silicon backplane with OLED on top
      • ViewTrix
      • The processor is the NXP iMX RT500
        • “This is design is made for Garmin”
        • Aedan is coding it in Zephyr
        • Drivers are in MCUexpresso
        • DCnano display driver in Zephyr
        • no GPU driver in Zephyr
        • 2D GPU in the chip
        • WiFi module is the same as the past rev, the Si Labs WFM200S
          • Sending compressed data over the WiFi link
          • Mechanical
            • Tweaking displays and 3D printed mounts
            • Prism
            • Flex cables
            • XReal / NReal
            • Using your brain as the combiner
            • Zach from Voidstar
            • Aedan just went to the Augmented World Expo in May. “No one was wearing an AR display around the conference”
            • Vision for the future
            • Follow Aedan online
              • GitHub
              • Twitter
              • ...more
                View all episodesView all episodes
                Download on the App Store

                The Amp Hour Electronics PodcastBy The Amp Hour (Chris Gammell and David L Jones)

                • 4.9
                • 4.9
                • 4.9
                • 4.9
                • 4.9

                4.9

                226 ratings


                More shows like The Amp Hour Electronics Podcast

                View all
                The Changelog: Software Development, Open Source by Changelog Media

                The Changelog: Software Development, Open Source

                289 Listeners

                Security Now (Audio) by TWiT

                Security Now (Audio)

                2,010 Listeners

                Accidental Tech Podcast by Marco Arment, Casey Liss, John Siracusa

                Accidental Tech Podcast

                2,141 Listeners

                Software Engineering Daily by Software Engineering Daily

                Software Engineering Daily

                625 Listeners

                LINUX Unplugged by Jupiter Broadcasting

                LINUX Unplugged

                268 Listeners

                Risky Business by Patrick Gray

                Risky Business

                374 Listeners

                The Quanta Podcast by Quanta Magazine

                The Quanta Podcast

                530 Listeners

                Embedded by Logical Elegance

                Embedded

                191 Listeners

                Late Night Linux by The Late Night Linux Family

                Late Night Linux

                164 Listeners

                Home Assistant Podcast by HK Media

                Home Assistant Podcast

                70 Listeners

                Darknet Diaries by Jack Rhysider

                Darknet Diaries

                8,041 Listeners

                Physics World Weekly Podcast by Physics World

                Physics World Weekly Podcast

                81 Listeners

                Hackaday Podcast by Hackaday

                Hackaday Podcast

                64 Listeners

                2.5 Admins by The Late Night Linux Family

                2.5 Admins

                98 Listeners

                Oxide and Friends by Oxide Computer Company

                Oxide and Friends

                62 Listeners