Meta, the company formerly known as Facebook, is making impressive strides in the field of generative AI, which could lead to the creation of immersive VR environments through simple prompts and directions. Their latest development in this area is an updated version of their DINO image recognition model, which uses self-supervised learning to better identify individual objects within image and video frames, without the need for human annotation.
Announced by Mark Zuckerberg this morning — today we're releasing DINOv2, the first method for training computer vision models that uses self-supervised learning to achieve results matching or exceeding industry standards.
— Meta AI (@MetaAI) April 17, 2023
More on this new work ➡️ https://t.co/h5exzLJsFt pic.twitter.com/2pdxdTyxC4
This new version of DINO, known as DINOv2, understands the context of visual inputs and can separate out individual elements. This will enable Meta to build new models that have a more advanced understanding of not only what an item looks like but also where it should be placed within a setting. This breakthrough could have a range of potential use cases, including improved digital backgrounds in video chats, tagging products within video content, and the creation of all-new types of AR and visual tools that could lead to more immersive Facebook functions.
DINOv2's ability to build in more context without requiring manual intervention could have specific value for VR development, which could eventually lead to AI-generated VR worlds. Such worlds would allow users to speak entire, interactive virtual environments into existence, but this is still a long way off. Nonetheless, DINOv2 is a significant step in that direction, as AI systems become more capable of understanding what's in a scene and where things should be placed contextually.
Although Meta is cautious about referencing the metaverse at this stage, this technology could truly come into its own via AI systems that can understand more about what's in a scene and where things should be placed. This new technology is exciting, and while many have cooled on the prospects for Meta's metaverse vision, it still could become the next big thing, once Meta is ready to share more of its next-level vision.