Bringing Real-World Objects into Virtual Reality
The world of virtual reality (VR) is becoming increasingly sophisticated, with advancements in technology allowing for the creation of highly realistic and interactive environments. One of essentially the most exciting developments on this field is the flexibility to bring real-world objects into VR as 3D assets in a matter of seconds. This is made possible by Meta’s latest SAM 3D Objects model, which sets a brand new standard for quality and opens up a world of possibilities for VR applications.
Traditional Methods vs. AI-Generated 3D Models
Traditionally, making a 3D model of a real-world object required capturing dozens of images of it from different angles using photogrammetry techniques. This process could take anywhere from 15-45 minutes of cloud processing, as seen in Epic’s RealityScan, or around 5 minutes using Apple’s on-device Object Capture API for iPhone Pro models. However, with the emergence of advanced AI models, it’s now possible to provide 3D assets from a single image in only seconds.
The Power of AI-Generated 3D Models
Over the past 12 months, AI models have rapidly improved, allowing for the creation of high-quality 3D assets from a single image. One example of that is the TripoSR model, which is utilized in the EchoTheReality app on SideQuest. This app allows users to border a real-world object, take a photograph of it, after which generate a 3D model of the article in seconds. However, the TripoSR model is nearly two years old, and a brand new state-of-the-art model has recently been released.
Introducing Meta’s SAM 3D Objects
Meta’s SAM 3D Objects is a game-changer on the planet of 3D modeling. This latest model can generate high-quality 3D assets from a single image in a matter of seconds. The model is open source, available on GitHub and Hugging Face, and will be tested totally free on the Meta AI Demos page. Simply upload a picture, select the article you must convert to a 3D model, and seconds later, you may give you the chance to view the article in 3D.
Testing SAM 3D Objects
To test SAM 3D Objects, you will need to make use of a PC, laptop, tablet, or VR headset, because the model will not be optimized for mobile screens. Additionally, the model is designed for inanimate objects only, so you will not give you the chance to generate 3D models of individuals or animals. Once you’ve got uploaded your image and chosen the article, you may give you the chance to pan across the 3D model together with your mouse or finger, getting a way of the article’s shape and texture.
Applications for SAM 3D Objects
The possibilities for SAM 3D Objects are limitless. Social VR platforms could use the model to permit users to conduct show-and-tell with objects of their real room, or decorate their virtual home space with items they’ve crafted in the actual world. While Meta has not announced plans so as to add this feature to Horizon Worlds, it looks as if a natural next step, especially with the recent launch of Hyperscape worlds.
Conclusion
The ability to bring real-world objects into VR as 3D assets in seconds is a significant breakthrough on the planet of virtual reality. With Meta’s SAM 3D Objects model, the chances for VR applications are expanding rapidly. Whether it’s used for social VR platforms, gaming, or education, this technology has the potential to revolutionize the way in which we interact with virtual environments. As the technology continues to enhance, we will expect to see much more modern applications of SAM 3D Objects in the long run.
