Introduction to Augmented Reality
Smartphone-based augmented reality is a well-liked technology that overlays visual elements on the image of a smartphone camera. This allows users to see how furniture would look of their house, navigate maps higher, or play interactive games like Pokémon GO. However, on the subject of using augmented reality apps inside a constructing, the experience will be disappointing as a consequence of the shortage of a transparent GPS signal.
The Challenges of Indoor Augmented Reality
Researchers from Osaka University have conducted extensive experiments to know the explanations behind these problems. They found that to reinforce reality, a smartphone must know two things: its location (localization) and the way it’s moving (tracking). The smartphone uses visual sensors like cameras and LiDAR, in addition to its inertial measurement unit (IMU), to attain this. However, these systems will be unreliable in indoor environments, resulting in virtual elements "drifting" within the scene, which may cause motion sickness and reduce the sense of reality.
Experimental Findings
The research team arrange case studies, resembling a virtual classroom, and asked participants to rearrange virtual desks and chairs in an optimal way. They performed 113 hours of experiments and case studies across 316 patterns in a real-world environment, disabling some sensors and changing the environment and lighting to isolate and examine the failure modes of AR. The findings highlighted several challenges, including:
- Virtual landmarks will be difficult to search out from distant, at extreme angles, or in dark rooms
- LiDAR doesn’t at all times work well
- The IMU has errors at high and low speeds that add up over time
Potential Solutions
To address these issues, the team recommends using radio-frequency–based localization, resembling ultra-wideband (UWB)-based sensing, as a possible solution. UWB works similarly to WiFi or Bluetooth and is less affected by lighting, distance, or line of sight. This technology has the potential to be integrated with vision-based techniques, resulting in vastly improved augmented reality applications.
Experimental Setup and Results
The researchers conducted experiments in numerous environments, including a vibrant room, a dark room, and a room with various levels of clutter. They also tested different movement types, resembling walking and using a specially designed XY-stage. The results showed that the virtual objects tended to drift within the scene, resulting in motion sickness and reduced sense of reality. The team also found that the participants felt less task completion, experienced more drift, and more motion sickness at nighttime room.
Conclusion
In conclusion, augmented reality apps have the potential to revolutionize the way in which we interact with our surroundings, but they face significant challenges in indoor environments. The research conducted by the Osaka University team has highlighted the explanations behind these challenges and identified potential solutions, resembling radio-frequency–based localization. As technology continues to evolve, we are able to expect to see improved augmented reality applications that may seamlessly navigate indoor environments, opening up latest possibilities for gaming, education, and other industries.
