Skip to main content

Google’s ARCore platform can now track faces, boasts improved memory

Google is continuing to improve its augmented reality platform, ARCore, and has released an update for Android and iOS that adds facial augmentation and improves the existing Cloud Anchors that allowed for AR object permanence.

That sounds complicated, but it’s less complex than it initially seems. The new addition, Augmented Faces, allows users to attach fun effects to their faces that follow their movements and react to their expressions in real time. The technology is similar to iOS’s Animojis and Memojis — except with a key difference. While iOS’s in-built AR effects require a depth-sensing camera (the TrueDepth selfie lens on the latest iPhones), ARCore’s new feature is able to recreate this effect without the need for advanced hardware. To achieve this, Augmented Faces lays a 3D mesh over your face with 468 individually tracked points — with each point corresponding to a specific point on the AR effect. Basically, think of Snapchat’s filters, but better.

The second major part of this update consists of improvements to ARCore’s Cloud Anchors. Introduced in May 2018, Cloud Anchors allow for a certain amount object permanence between devices. Essentially, draw an arrow on a wall with an Android device, and a friend on an iPhone will be able to see it. That may seem minor, but imagine being able to leave a breadcrumb trail of AR directions for a friend while you’re out, or view AR models of spacecrafts together.

Recommended Videos

This sort of social AR experience is something Google is eager to explore, and this update makes the existing cloud anchors more robust and efficient. More angles are processed when the anchor is created, making steadier and more realistic — so elements are less likely to come loose from their anchor and drift across your screen.

Please enable Javascript to view this content

Outside of exceptions like Pokémon Go or Harry Potter: Wizards Unite, it’s probably fair to say augmented reality plays little role in most people’s lives. Part of the reason for that is, well, it doesn’t really have much use yet. However, Google’s recent addition of AR directions to Google Maps — which uses your phone’s camera and screen to overlay directions on the real world — shows what’s possible with augmented reality. This update for ARCore may not be the most exciting update so far — but it’s a big step along the road to AR becoming from commonplace in our lives. If you’re eager to check out what’s currently possible in AR, check out our list of the best AR apps for Android and iOS.

Mark Jansen
Mobile Evergreen Editor
Mark Jansen is an avid follower of everything that beeps, bloops, or makes pretty lights. He has a degree in Ancient &…
I’ve used iOS 18 for months. Here are 10 reasons you should update right now
iOS 18 logo on the iPhone 16 Pro

On September 16, Apple launched the new iOS 18 update for the iPhone, and while the company always says it’s the biggest update ever, this year, that’s true. So many new iOS 18 features will delight you, but many of these are also fundamental changes to how you use your iPhone.

I’ve been using iOS 18 in beta for months and love many of the new features. They’ve breathed new life into my iPhone 15 Pro Max and will do the same for all iPhones that support the update.

Read more
Apple’s big iOS 18 update is now available for your iPhone
Siri being shown on an iPhone 15 Pro on iOS 18.

The wait is finally over -- iOS 18 is here. If you have a compatible iPhone (and the list is expansive), make sure to grab it now by simply going to Settings > General > Software Update. If you don’t see it just yet, keep checking as it continues to roll out for everyone.

iOS 18 is a big update for the iPhone, as it finally catches Apple up to competitors with Apple Intelligence, its suite of AI-powered tools. However, because of processing power, Apple Intelligence features require at least an iPhone 15 Pro or iPhone 15 Pro Max. All iPhone 16 devices, which will launch on Friday, will have access to Apple Intelligence. However, Apple has said that Apple Intelligence isn’t officially launching until iOS 18.1, which will be released in October.

Read more
You can finally try one of iOS 18’s coolest AI features
A person holding an iPhone that shows an image.

Apple Intelligence, unveiled at this year’s Worldwide Developers Conference (WWDC), is still under development nearly three months later. The only way to access some of its features before a public release is by downloading the latest iOS 18.1 developer beta and receiving an invitation from Apple.

Until now, most of Apple Intelligence's features available to individuals outside of Apple are related to writing and communication tools. With the third iOS 18.1 beta released earlier this week, Apple released a feature related to the Photos app.

Read more