Skip to main content

Google’s ARCore platform can now track faces, boasts improved memory

Google is continuing to improve its augmented reality platform, ARCore, and has released an update for Android and iOS that adds facial augmentation and improves the existing Cloud Anchors that allowed for AR object permanence.

That sounds complicated, but it’s less complex than it initially seems. The new addition, Augmented Faces, allows users to attach fun effects to their faces that follow their movements and react to their expressions in real time. The technology is similar to iOS’s Animojis and Memojis — except with a key difference. While iOS’s in-built AR effects require a depth-sensing camera (the TrueDepth selfie lens on the latest iPhones), ARCore’s new feature is able to recreate this effect without the need for advanced hardware. To achieve this, Augmented Faces lays a 3D mesh over your face with 468 individually tracked points — with each point corresponding to a specific point on the AR effect. Basically, think of Snapchat’s filters, but better.

The second major part of this update consists of improvements to ARCore’s Cloud Anchors. Introduced in May 2018, Cloud Anchors allow for a certain amount object permanence between devices. Essentially, draw an arrow on a wall with an Android device, and a friend on an iPhone will be able to see it. That may seem minor, but imagine being able to leave a breadcrumb trail of AR directions for a friend while you’re out, or view AR models of spacecrafts together.

Recommended Videos

This sort of social AR experience is something Google is eager to explore, and this update makes the existing cloud anchors more robust and efficient. More angles are processed when the anchor is created, making steadier and more realistic — so elements are less likely to come loose from their anchor and drift across your screen.

Please enable Javascript to view this content

Outside of exceptions like Pokémon Go or Harry Potter: Wizards Unite, it’s probably fair to say augmented reality plays little role in most people’s lives. Part of the reason for that is, well, it doesn’t really have much use yet. However, Google’s recent addition of AR directions to Google Maps — which uses your phone’s camera and screen to overlay directions on the real world — shows what’s possible with augmented reality. This update for ARCore may not be the most exciting update so far — but it’s a big step along the road to AR becoming from commonplace in our lives. If you’re eager to check out what’s currently possible in AR, check out our list of the best AR apps for Android and iOS.

Mark Jansen
Mobile Evergreen Editor
Mark Jansen is an avid follower of everything that beeps, bloops, or makes pretty lights. He has a degree in Ancient &…
Google Gemini arrives on iPhone as a native app
the Google extensions feature on iPhone

Google announced Thursday that it has released a new native Gemini app for iOS that will give iPhone users free, direct access to the chatbot without the need for a mobile web browser.

The Gemini mobile app has been available for Android since February, when the platform transitioned from the older Bard branding. However, iOS users could only access the AI on their phones through either the mobile Google app or via a web browser. This new app provides a more streamlined means of chatting with the bot as well as a host of new (to iOS) features.

Read more
Google Gemini is about to get a big upgrade for iPhone users
Person holding a phone with Google Gemini Live being shown.

Google Gemini, launched earlier this year for Android and iOS devices, has up until now only been available as a standalone app for Android users. In contrast, Apple users have had to access Google Gemini through the Google app. However, this situation is about to change.

As noted by 9to5Mac, at least one Apple user in the Philippines has been able to download the Google Gemini app from the App Store. However, it hasn’t appeared in other App Stores worldwide, including in the U.S.

Read more
Google may make it easier to share files between Android and iPhone
Android 14 logo on the Moto G Stylus 5G (2024).

Wish it was easier to share files between Android and iPhone? Android Authority says a file-sharing service designed for Android devices may eventually become available on Apple products.

During the Consumer Electronics Show (CES) in January, Google announced its collaboration with Samsung to introduce a new feature called Quick Share, which aims to simplify file sharing. This feature offers a unified solution for sharing files across Android devices, Chromebooks, and Windows systems, making the process seamless within these ecosystems. Think of it like AirDrop but for Android.

Read more