Introduction to Augmented Reality in Space

Even probably the most highly trained and experienced person sometimes needs a hand. For astronauts aboard the International Space Station, that helping hand comes from other crew members, experts on the bottom, and increasingly, in the shape of augmented reality (AR) and virtual reality (VR).

The First Use of AR on the Space Station

The first use of AR on station, a set of high-tech goggles called Sidekick, provided hands-free assistance to crew members using high-definition holograms that show 3D schematics or diagrams of physical objects as they accomplished tasks. It included video teleconference capability to supply the crew with direct support from flight control, payload developers, or other experts.

Expanding the Use of AR and VR

The ways by which crew members use these tools continues to expand in frequency and scope. Here are a number of the ways we use AR and VR for research aboard the space station:

Pilote Investigation

Pilote, an investigation from ESA (European Space Agency) and France’s National Center for Space Studies (CNES), tests distant operation of robotic arms and space vehicles using VR with interfaces based on haptics, or simulated touch and motion. Results could help optimize the ergonomics of workstations on the space station and future spacecraft for missions to the Moon and Mars.

Immersive Exercise

Immersive Exercise tests whether a VR environment for the station’s exercise bicycle, CEVIS, increases motivation to exercise and provides astronauts a greater experience for his or her every day training sessions. If crew members benefit from the VR experience, a headset and associated environments could turn into a everlasting fixture for exercise sessions.

T2 AR and NASA’s Cold Atom Lab

T2 AR tests using AR to assist crew members inspect and maintain the space station’s T2 Treadmill. NASA’s Cold Atom Lab (CAL) is the primary quantum science laboratory in Earth orbit, hosting experiments that explore the basic behaviors and properties of atoms. The Cold Atom Lab team successfully demonstrated using an AR headset to help astronauts with upgrade activities.

Other Investigations

Other investigations include:

• Time Perception, which examines changes in how humans perceive time during and after long-duration exposure to microgravity.
• The ISS Experience, an immersive VR series filmed over multiple months to document different crew activities.
• GRIP, an ESA investigation that studies how spaceflight affects gripping and manipulation of objects.
• VECTION, which looks at how changes in gravity affect the flexibility to manage movement and position of the body.
• GRASP, which seeks to raised understand the role that perception of gravity plays in reaching for objects.

Conclusion

The use of AR and VR on the International Space Station is expanding and becoming more frequent. These technologies are helping astronauts with a wide range of tasks, from maintenance and repair to exercise and research. The results of those investigations could have a major impact on future space missions and even profit people on Earth. As technology continues to advance, we will expect to see much more progressive uses of AR and VR in space exploration.