Photo:Courtesy of Apple
Courtesy of Apple
Here’s a confession: For the past seven months I’ve been ever-so-slightly obsessed with a pixelated, virtual butterfly. More on that later.
Vision Pro is Apple’s first foray into what company CEO Tim Cook calls “spatial computing,” which the tech giant hopes will transform how we work on everyday productivity tasks, communicate with each other and enjoy movies, games and memories—in the form of videos and photos—in a completely new way.
To describe my experience with this device as mind-blowing pretty much nails it—but it still comes up woefully short.
The Vision Pro looks like a pair of old-school ski goggles, weighs about a pound and a half, and is loaded up with 23 sensors, including a dozen cameras and six mics that track eye movements, hand gestures and voice while also sensing objects located around you.
Images are streamed onto the displays eight times faster than a human eye can blink, according to Apple. The strap that holds the device on your head contains an array of speakers that deliver sound (which the company calls “spatial audio”) that makes whatever you’re hearing match the acoustics of the virtual environment in which you’re immersed.
To be honest, I wasn’t expecting much when I got my first chance to try it out. Over the years, I’ve strapped a few other of these headsets onto my noggin — and each time, I came away nauseous, headachy, and underwhelmed. If this was the future of computing, I wasn’t impressed.
But from the moment I slipped on Apple’s new device and found myself staring into its two tiny displays filled with 23 million pixels, I was fighting a losing battle to keep my mouth from hanging open and uttering, “Oh wow!. . . Whoa!. . . Ohhh!. . . No way!”
I knew that none of images being splashed in front of my eyes were actual flesh-and-blood reality, but after a few seconds I didn’t care. I felt myself transported into whatever I was looking at. I was having a bona fide experience that was richer and light years beyond what it feels like to stare at and interact with files, words and images on my MacBook Air.
During my initial hands-on road-test with the Vision Pro — which required Apple to spend half an hour recreating my prescription lenses that were inserted into the device — I simply secured the goggles to my face, making sure no light was seeping in, then pushed a button called the Digital Crown on the top right of the unit. The Vision Pro quickly came to life.
Within seconds, a grid of circular app icons was floating in the middle of the room. (Apple says over one million apps can work with the device and more than 600 apps have specifically been designed for Apple’s visionOS.)
To choose a specific app, I simply looked at it, pinched my thumb and index finger together and it opened. Holding my pinched fingers together and moving them up or down allowed me to scroll through the contents. Navigating with my eyes, hands and voice was incredibly intuitive.
Because I spend so many of my waking hours hammering away on my keyboard for work, I was jonesing to experience what that would be like using the Vision Pro. Creating a document — which I could enlarge to the size of a Mini Cooper and move around to any location in the room with my hands — did have a certainMinority Reportfeel to it. And staring at the foot-high words that I typed on the virtual keyboard (you can also connect a Bluetooth keyboard) was viscerally satisfying .
Making a video call on the device with FaceTime was even trippier. The Vision Pro cameras created my virtual 3-D doppelgänger — known as a Persona — that was displayed to the Apple rep I was chatting with on another part of the campus.
Thinking about using the headset in the room with others? In an effort to keep users from being isolated from those around them, the device also projects a digital representation of your eyes on front of the goggles, so those around you know when you are looking at them (vs. browsing the web).
Even more awe-inspiring? Watching videos on the massive screen projected in front of me. At some point, I found myself immersed in the Encounter Dinosaurs app and standing in a lava field as a massive dino wandered about in front of me. Before long it appeared to emerge out of the confines of the screen and lumber toward me as the ground beneath my feet seemed to shake. My brain and gut told me it was all fake, but it was still a tad unnerving.
Three weeks ago I was invited back to Apple’s L.A. headquarters to get some more time with the Vision Pro—and all I could think about was that damn butterfly. After putting the device through its paces and checking out some of the latest tweaks and new content, I asked my handlers if I could have one last encounter with their virtual winged insect. And sure enough, the moment it alighted upon my finger, it happened again. I could feel it.
And that’s when I realized that, of course, I was imagining the whole experience. That’s how powerful the Vision Pro is at re-creating the reality of meatspace (a.k.a the physical world). It serves up a jaw-droppingly realistic artificial world and my brain — doing what my brain always does — just filled in the gaps.
What my braincan’tdo is envision where the Vision Pro and the technology behind it will lead us — but I’m more than happy to buckle up and take the ride. In the meantime, I’ll be outside, with my index finger boldly outstretched, searching for butterflies.
source: people.com
