Wednesday, April 2, 2025

Google adds raw depth -API to enhance the spatial awareness and depth data for Android AR apps

Share

For most mainstream users, LIDAR sensors for precision depth recognition remain the exclusive domain of Apple iPhones and iPads, but Google helps Android device manufacturers to shut the deep gap on the software page via its Arcore toolkit.

After the introduction of recent AR functions for search and map and preview of the breathtaking project on the Starline 3D video conference concept during his E/A-Keynote presentation on Tuesday, Google Arkermemisch Arcore 1.24 announced that two latest API capabilities, Raere API recordings and records and reproduction API with the sooner ALLING-LID-AR experience ABS-AfL experience within the areas of lids within the errors of eyelids.

The raw depth -API builds on the prevailing depths -API by capturing additional depth data in order that apps could make realistic AR experiences via a regular smartphone camera. However, Android devices with flight time sensors for depth measurement will provide higher-quality experiences.

Tiktok

Ar Doodads

3D Live Scanner

Tiktok

Ar Doodads

3D Live Scanner

“The latest API of Arcore Roh depth comprises more detailed representations of the geometry of objects within the scene by generating 'raw' deep cards with corresponding trust images,” said Google AR product manager Ian Zhang and Zeina Owos. “These raw depth cards contain unauthorized data points, and the boldness images offer the trust of the depth estimate for each pixel within the raw cards.”

The results of the aggregated data is improved geometry detection, which implies a stronger accuracy of depth measurement and a greater understanding of the environment for the anchoring of AR content in physical environments.

One of the primary apps that use the API of the raw depth is Tiktok. The Green Screen projector effect of the app wraps objects wherein the raw depth -api has a high degree of trust with photos from the user's camera role.

Other early users are Virtual Rube Goldberg Machine Game AR Doodads, Mess App AR Connect, 3D Scan App 3D Live Scanner and TeamViewer's Lifear for Remote Support.

In addition, with the recording and playback API apps, Arcore gives the chance to record inertial measuring units (IMU) and depth data in video material. For developers, which means they’ll test AR apps without venturing into the sphere for various real environments.

https://www.youtube.com/watch?v=K905KJtrzhe

The recording and playback -API also creates a brand new variety of AR experience for end users so that you may add virtual content to videos. For example, Jumpar from SK Telecom enables users to interact with video of locations in South Korea and add AR content. Now Voxplop! Nexus Studios offers users the choice of adding videos 3D signs and sharing them with others, which they in turn can edit with AR content.

Jumpar

Voxplop!

Jumpar

Voxplop!

Google will cover these functions in greater … um … depth through the latest functions within the Arcore meeting that debuts on Wednesday.

Ironically, it was Google that first introduced deep sensors via its Tango hardware platform, but acceptance was limited to only two industrial devices. Apple reacted with ARKIT, wherein version 1.0 could recognize horizontal surfaces via a regular iPhone camera. Google planned from the hardware approach and adjusted the software from Tango in Arcore.

Now Apple has taken the mainstream of deep -sensors with its iPhone Pro and iPad Pro installations, while Google releases software to record depth data.

https://www.youtube.com/watch?v=EERBBXLT7HI

Despite the continued iterations of Arkit and Arcore, the spread of mobile AR apps has not completely conquered the world in storm. Instead, the AR platforms for Snapchat (which also supports the Arcore depth API) and Facebook/Instagram with their varied AR experiences are drawn to the eye of developers, creators and types.

Of course, the 4 firms and their respective mobile platforms are necessary public beta tests for the following era in mobile computing – smartlasses.

Cover picture on Google

Read more

Local News