NVIDIA Announces New Omniverse Technologies to Make Developing for the Metaverse Easier

NVIDIA today announced a new range of developer frameworks, tools, apps, and plugins for NVIDIA Omniverse, the platform for building and connecting metaverse worlds based on Universal Scene Description (USD).

The Santa Clara, Calif.-based company said the expansion of Omniverse includes several AI-powered tools and features that deliver artists, developers, and engineers the power to build virtual worlds and content easier than ever, and better connect to today’s leading 3D applications including PTC Creo, SideFX Houdini, Unity, and solutions from the Siemens Xcelerator platform.

A ‘multitrillion-dollar opportunity’

Omniverse, a multi-GPU scalable computing platform for building virtual worlds, is already in use by some 700 leading companies globally to enhance architectural and product design, simplify visual effects workflows, and build digital twins of factories, cities and the planet, according to the company.

“The metaverse is a multitrillion-dollar opportunity that organizations know they can’t ignore, but many struggle to see a clear path forward for how to engage with it,” said Rev Lebaredian, vice president of Omniverse and simulation technology at NVIDIA. “NVIDIA Omniverse closes the gap between the physical and virtual worlds, and these new tools, technologies and collaborations make it possible to leap into the 3D internet today.”

NVIDIA's Universal Scene Description is an open source file format designed by Pixar. Source: NVIDIA

New Applications and Frameworks

In addition to launching the NVIDIA Omniverse Avatar Cloud Engine — a suite of cloud-native AI models and services for building and deploying lifelike virtual assistants and digital humans — the company unveiled the following platform updates:

• Omniverse Kit — a toolkit for building native Omniverse extensions and applications:
  • Major updates to PhysX in Omniverse, including real time, multi-GPU scalable soft body and particle cloth simulation, helping bring more physical accuracy to virtual worlds and objects.
  • New OmniLive Workflows — an overhaul of USD-based collaboration in Omniverse, bringing increased speed and performance to multiple app 3D workflows, and enabling non-destructive USD workflows to make collaboration between artists and developers easier than ever.
• Omniverse Audio2Face — an AI tool that can create facial animations directly from an audio file introduces a major leap in AI-driven animation with the new ability to infer and generate realistic emotions and animates all facial features.
• Omniverse Machinima — an app for easily building 3D cinematics and animated films launches hundreds of new, free 3D assets from Post Scriptum, Beyond the Wire, and Shadow Warrior 3 games, plus, a suite of new AI animation tools like Audio2Gesture - an AI that generates realistic arm and body motion from an audio file.
• Omniverse DeepSearch — now available for Omniverse Enterprise customers, DeepSearch helps teams use AI to search through massive, untagged 3D asset databases of visuals using natural language like “red, rusty barrel.” DeepSearch is a game- changing tool for game developers or VFX studios who have hundreds of thousands of untagged assets that pose an immense challenge to search through. The award-winning studio Industrial Light & Magic is leveraging DeepSearch to unlock its ever-growing library of hundreds of thousands of environment assets.

Additionally, NVIDIA Modulus, a physics machine-learning framework, is newly available as an Omniverse Extension. Delivering near-real-time performance, Modulus-trained Physics ML models are 4,000x and even 100,000x faster depending on the application, while providing accuracy closer to high-fidelity simulations. The company said. Modulus is one of the cornerstones of scientific digital twins, including NVIDIA’s Earth-2.