Long before the advent of computers, a science fiction story imagined virtual reality. Today, Stanford engineers are working to turn that vision into reality through advancements in virtual technologies for spectacles.
In the early days of augmented reality (AR), Harvard University computer scientist Ivan Sutherland created the first head-mounted display, known as the “Sword of Damocles.” This device provided users with an AR experience by overlaying 3D wireframe shapes onto their real-world view. The apparatus was suspended from the ceiling and included a head position measuring system.
Currently, Gordon Wetzstein, an associate professor of electrical engineering at Stanford University, is leading efforts to develop state-of-the-art virtual technologies for lightweight spectacles. “We’re working on not just bringing an image to your eye but bringing an experience to your eye that is indistinguishable from the real world,” said Wetzstein.
The research team has developed a compact AR headset using AI-powered holography and nanophotonics to project life-like 3D images through ordinary-looking glasses. This technology utilizes AI-driven “neural holography” to create sharper and more realistic images for virtual and augmented reality displays.
An innovative algorithm reconstructs 3D images from scattered photons, enabling vision through obstructions like fog or clouds by analyzing light bouncing off hidden objects. The team has also been working on miniature holographic displays embedded into glasses frames that manipulate light waves rather than pixels to create a seamless blend between virtual objects and the real world.
Additionally, they have developed a compact eye tracker that monitors where the eye is looking in real-time. This allows for detailed rendering only in specific areas while saving energy by reducing detail elsewhere.
“We are closer to a tiny and lightweight display system that can be embedded in the frames of eyeglasses to give users a very natural, perceptually realistic experience,” Wetzstein added.
Wetzstein is also affiliated with several institutes at Stanford University, including Bio-X, Wu Tsai Human Performance Alliance, and Wu Tsai Neurosciences Institute.
