Introduction to Efficient Text Entry in XR Headsets
The challenge of efficient text entry stays a big barrier to seamless interaction in virtual and augmented reality (VR/AR). Composing emails, logging-in, and socializing within the metaverse all require the power to input text efficiently. To address this challenge, researchers have developed a comprehensive catalog of existing text entry techniques.
The XR TEXT Trove Initiative
The XR TEXT Trove is a research initiative that catalogs over 170 text entry techniques tailored for XR. This initiative is the results of a collaboration between researchers from the University of Birmingham, the University of Copenhagen, Arizona State University, the Max Planck Institute for Intelligent Systems, Northwestern University, and Google. The TEXT Trove is a structured repository of text entry techniques and a series of filters that aim to pick out and highlight the professionals and cons of the breadth of text input methods developed for XR in each academia and industry.
Categorization of Techniques
These techniques are categorized using a spread of 32 codes, including 13 interaction attributes similar to Input Device, Body Part (for input), Concurrency, and Haptic Feedback Modality, in addition to 14 performance metrics like Words Per Minute (WPM) and Total Error Rate (TER). This comprehensive overview provides precious insights into the state of XR text entry techniques.
Key Takeaways from the Research
Several key takeaways might be surmised from the research. Firstly, text input performance is inherently limited by the variety of inputting elements (whether fingers, controllers, or other character selectors). Only multi-finger typing can result in performance comparable to touch-typing speed with a keyboard on regular PCs. Additionally, each additional input element (or finger) adds about 5 WPM speed on top of users.
Improving Typing Performance
The research also indicates that haptic feedback, the presence of external surfaces, and fingertip-only visualization are preferable ways to enhance typing performance. For instance, typing on surfaces (as an alternative of in mid-air) contributes to a more comfortable and potentially more efficient typing experience. External surfaces also minimize sustained muscle strain, making interactions more comfortable and reducing the onset of Gorilla Arm Syndrome.
The Future of Text Entry in XR
As of today, no alternative has fully replaced the keyboard format, probably since it still delivers the best words-per-minute. However, the important path for faster typing in VR than PC might lay in the necessity to scale back travel distances on a multi-finger keyboard via Machine Learning and AI. XR needs its own ‘swipe typing’ moment, which made one-finger typing on smartphones far more efficient.
Conclusion
The XR TEXT Trove represents a big step towards a more comprehensive understanding of text input in virtual and augmented reality. By providing a structured and searchable database, researchers and developers can pave the way in which for more efficient and user-friendly text entry solutions within the immersive future. The database and associated tool can be found on the XR TEXT Trove website, making it a precious resource for the XR community. The full paper will probably be presented at the celebrated ACM CHI conference, further solidifying the importance of this research in the sector of XR.
