Skip to main content

Digital Trends may earn a commission when you buy through links on our site. Why trust us?

Apple’s ‘foundational’ Vision Pro tool was secretly built 6 years ago

Long before Apple’s Vision Pro headset made its debut, there was rampant speculation that the company’s wider augmented reality (AR) efforts were part of a larger project toward building the then-mysterious device. Now, it seems that at least one of those technologies was built with Vision Pro in mind.

I recently interviewed Susan Prescott, Apple’s vice president of Worldwide Developer Relations, and Steve Sinclair, senior director of product marketing for Apple Vision Pro, to find out how the company courted developers while prepping the headset. In the course of that interview, Sinclair shed some light on how Vision Pro intertwined with the company’s ARKit developer framework.

Apple Vision Pro provides virtual screens for your Mac.
Apple

Throughout my talk with Prescott and Sinclair, both made repeated references to ARKit, Apple’s framework for building AR experiences. Prescott said it was “foundational” for allowing people to build content for Vision Pro. When discussing how Apple adapted existing tools for its headset, Sinclair stated that “ARKit on iPhone and on iPadOS allowed us the opportunity to learn from developers and from ourselves on how best to implement these things on a platform like Vision Pro.”

Recommended Videos

Was ARKit specifically built with Vision Pro in mind, I asked, or did its development come about separately and subsequently?

Please enable Javascript to view this content

“We’ll just say in conjunction” was Sinclair’s response.

Sinclair’s answer seems to imply that, at a minimum, Vision Pro was a consideration in the development of ARKit, if not the main driving force behind its creation.

ARKit’s secret purpose

Two people playing an augmented reality game on Apple iPad.
Apple

When Apple revealed ARKit as part of iOS 11 in 2017, it explained that the tool would allow developers to “build detailed and compelling virtual content on top of real-world scenes for interactive gaming, immersive shopping experiences, industrial design and more.” Looking back, that seems like a description ripe for Vision Pro as much as it does the iPhone or iPad.

We already know that Vision Pro has been in development since at least 2007, the date Apple provisionally applied for a very early headset patent. In the intervening 16 years, there have been many other technologies that Apple ostensibly made for different devices that could also have been created with Vision Pro in mind.

LiDAR, for instance, has been heavily promoted as a way to enjoy AR experiences using an iPhone or an iPad Pro, but it also features prominently in Vision Pro. Numerous patents registered over the years, from extending a Mac’s display into virtual space to in-air MacBook keyboards, could all have been disguised Vision Pro technologies.

That’s unsurprising given Apple’s famous tight-lipped reticence, and it’s interesting to see the suggestion that ARKit has always had a secret secondary purpose. What other seemingly innocuous techs could find their way into future Apple devices? Only time will tell.

Alex Blake
Alex Blake has been working with Digital Trends since 2019, where he spends most of his time writing about Mac computers…
Apple’s co-founder left 40 years ago today, but that was just the beginning of his story
Steve Wozniak speaking at an event in Paradise Valley, Arizona.

Apple co-founder Steve Wozniak seemingly had it all: surrounded by a successful company that he helped create and with more money to his name than he knew what to do with, to outside observers it must have all looked pretty sweet.

But Wozniak wasn’t happy at Apple -- and 40 years ago today, he quit. That wasn’t the end of the road for the engineering whizz. Instead, he went on to start a set of highly consequential companies and organizations across multiple different disciplines, leaving a mark in a range of different industries.
Early days at Apple

Read more
As the Vision Pro turns one, there’s one thing Apple must do to fix it
A person wearing an Apple Vision Pro headset.

It’s just over a year since Apple first listed its Vision Pro headset for sale, and the device hasn’t exactly lit the world on fire since then. Yet after a year of reflection, there’s one thing that Apple very clearly needs to do if it’s going to get its mixed-reality headset back on track.

That thing is to launch a more affordable model, pure and simple. It goes against Apple’s preferred way of doing things -- the company is used to making the best, most premium devices it can and pricing them accordingly -- but it’s the only way the company is going to be able to make its headset go truly mainstream.
Sticker shock

Read more
Apple is no longer working on smart glasses to rival Meta
Ray-Ban Meta Wayfarer smart glasses

It's been a rumor for some time now that Apple had a pair of AR glasses in development, but a new report from Mark Gurman says the company has cancelled the project. Apple has expressed a lot of interest in the AR/VR space, but its first attempt with the Vision Pro didn't make the splash the company expected. Its over-the-top price and more professionally-focused applications led to fewer sales and a lot of excess stock.

The goal was to create a competitor to the Meta's Ray-Ban smart glasses, but Gurman says the cancellation comes in the wake of an attempt to change and improve the design of the glasses. The first version of the glasses would link with an iPhone, but its limited power meant applications were limited — and the demands of the device also had an impact on phone battery life. Apple pivoted and focused on linking the glasses with a Mac instead, but that was met with poor evaluations. The development team reportedly dealt with frequently-changing goals, adding to the difficulty, until the project was cancelled.

Read more