Skip to main content

Project Tango can remember where it's been, making AR work even when your device is distracted

Sundar Pichai stands in front of a Google logo at Google I/O 2021.
This story is part of our complete Google I/O coverage

Project Tango
Image used with permission by copyright holder
If you’re not familiar with Google’s Project Tango, it’s an image recognition platform, to put it simply. Using a special 3D camera, a Tango equipped device “looks” at the world around it, and uses that information to map a space, add in augmented reality objects, or simply track the location of a mobile device.

It has a wide variety of uses, even in its developer-oriented form, but there are some issues. For one, even the precision accelerometers and gyroscopes in mobile phones tend to have a margin of error, especially with vigorous movement. Add to that the way lighting changes, and user movement, and you might notice some drift or enlarging of objects that are supposed to stay still. Which brings us to the topic of today’s Google I/O talk by Tango team leader Wim Meeussen.

Recommended Videos

Learning its way around

The solution to object drift is area learning. Instead of constantly looking at its surroundings and calculating a new position, area learning allows a Tango device to recognize its surroundings. By building a memory of the world around it, the Tango device can recognize those spaces, and properly fit objects back into them.

Please enable Javascript to view this content

Several demos served to illustrate how well this worked. A simple app, lacking area learning, placed a virtual box on a flat surface. After turning away from the podium and shaking the Tango powered device, the box began to slide around. Eventually, it disappeared, as the device entirely lost track of where the box should be.

Turning on area learning produced entirely different results. Not only did the box stay as the device shook and looked away, but even covering the camera for several seconds didn’t affect its positioning. Granted, it sometimes took a few seconds to re-identify the space around it, but once it did, the box popped right back up.

Memory makes for better multiplayer

Area learning really opens up the possibilities of VR and AR gaming with multiple users. Google says the Tango area learning code is easy to implement (capturing a location memory takes one line of code), and sharing it with other devices even easier (also just one line of code.)

For a multiplayer game, one device can capture a location memory of the space, and then export that location memory to other devices in the area. Working from the same model of the room, the devices are able to keep even better track of each other and their surroundings.

The results speak for themselves. In a video demo two users handed back and forth a Tango enabled tablet, with their heads and the device mirrored perfectly in a virtual rendering of the space. All of this takes place without establishing any infrastructure in the area, and with minimal code alterations.

What’s next?

If the results of area learning are any indication, Tango is coming along quite nicely. Object permanence, navigation, and multiplayer components are all a big part of the equation, and they must not be far from production. In fact, Meeussen made sure to remind everyone that Lenovo would be releasing a Tango-equipped device targeted at consumers later this year.

For now, eager AR users will either need to learn to develop, or wait patiently for the first device with Google’s powerful new technology.

Brad Bourque
Former Digital Trends Contributor
Brad Bourque is a native Portlander, devout nerd, and craft beer enthusiast. He studied creative writing at Willamette…
Why I traded my MacBook Air for a laptop you’ve never heard of
Honor MagicBook Art 14 Snapdragon with screen on.

I’ve been using the M2 MacBook Air since its launch, and it has been a reliable laptop. It's not perfect though. I wish the display was better and that the laptop was lighter as I’ve had experiences where my carry-on luggage ended up being heavier than expected. And both of these are things even the M3 MacBook Air doesn't address.

What I didn't know, however, was that those wishes could come true in a more feature-packed laptop most people have never heard of. I'm talking about the Honor MagicBook Art 14, powered by the Snapdragon X.

Read more
Performance leaks for AMD’s RX 9070 XT are all over the place
RX 7900 XTX and RX 7900 XT on a pink background.

We're in that exciting period leading up to the release of some of next year's best graphics cards, and that means leaks and predictions are coming out every single day. The last few weeks have really brought into focus AMD's next-gen flagship, which is now said to be called the RX 9070 XT. But now, more than ever, we're seeing a lot of conflicting information about the kind of performance we can expect from the top RDNA 4 card. The latest leaks see it falling within a stone's throw of Nvidia's RTX 4080.

According to zhangzhonghao on the Chiphell forums (who is a frequent leaker in the CPU and GPU space), the difference between the RX 9070 XT and the RTX 4080 is just 5%. They didn't specify which card was the winner, though, and we don't know which games they were tested in.

Read more
Details leak on the upcoming RTX 5070 Ti and RTX 5070 GPUs
The back of the Nvidia RTX 4080 Super graphics card.

As we draw closer to January, leaks and speculation around Nvidia’s next-generation RTX 50-series GPUs are echoing all over the internet. The latest scoop comes from renowned leaker Kopite7kimi providing insights into Nvidia's midrange Blackwell graphics cards, the RTX 5070 Ti and GeForce RTX 5070.

As per the leaks, the RTX 5070 Ti is set to feature the GB203-300-A1 GPU, equipped with 8,960 CUDA cores, offering a substantial increase in processing power compared to its predecessor. The card is rumored to include 16GB of GDDR7 VRAM on a 256-bit memory interface, providing enhanced memory bandwidth for demanding applications such as 4K gaming and video editing.

Read more