NVIDIA Agent Toolkit expands with new Omniverse libraries

NVIDIA announced that NVIDIA Agent Toolkit now includes NVIDIA Omniverse libraries - a collection of software components that give AI agents tools and skills to add physical AI capabilities to existing applications and prepare 3D content for simulation.

The company made the announcement as part of its presence at SIGGRAPH 2026 in Los Angeles.

Enhancing simulation capabilities with advanced 3D content

NVIDIA said that robots, factories and autonomous systems need to be designed, tested and trained in simulation before they operate in the real world. The company added that preparing 3D content for simulation takes more than realistic visuals - assets need the right structure, materials, scale, labels, sensors and physical properties.

With NVIDIA Omniverse libraries in NVIDIA Agent Toolkit, the company said that AI agents have the tools and skills to build workflows, inspect scenes, flag issues and prepare assets, helping developers move faster from 3D content to simulation-ready environments.

“The physical AI era will be built in simulation first,” said Jensen Huang, founder and CEO of NVIDIA. “NVIDIA Agent Toolkit with Omniverse libraries brings AI agents into the 3D tools developers already use, helping build the simulation-ready worlds where robots, factories and autonomous systems are trained and tested long before they reach the real world.”

NVIDIA said that software makers, including SideFX and PTC, are integrating Omniverse libraries for agent-ready sensor simulation, physics and asset validation, helping bring agentic AI into the applications and workflows developers and technical artists already use to prepare 3D content.

Omniverse libraries bring physical AI skills to NVIDIA Agent Toolkit

NVIDIA said that Agent Toolkit helps software makers build AI agents that connect tools, skills and data sources. Omniverse libraries extend those agents into 3D and physical AI workflows with callable tools for sensor simulation, GPU-accelerated physics and simulation-ready asset validation inside existing applications.

The company said that the new Omniverse libraries - including ovrtx, ovphysx and CAD-to-SimReady skills - are openly available on GitHub, giving AI agents tools to build workflows for inspecting scenes, testing changes and preparing 3D assets for simulation.

NVIDIA said that the libraries’ key capabilities include:

• NVIDIA RTX sensor simulation: ovrtx helps applications generate camera, lidar, radar and other sensor outputs from 3D scenes, so developers and AI agents can test how physical AI systems may perceive virtual environments.
• Physical behavior: ovphysx uses GPU-accelerated physics to bring realistic behavior to 3D scenes using properties such as collisions, mass, friction and motion, so teams can first test how objects and systems interact in simulation.
• Simulation-ready 3D objects: CAD-to-SimReady skills help convert CAD data to SimReady assets built on OpenUSD, giving 3D content the properties needed for physical AI simulation and virtual testing.

Software makers building with Omniverse libraries

The company said that software makers, including SideFX and PTC, as well as startups ForgeCAD, Lightwheel, Moonlake AI and Palatial, are among the first to adopt and build with Omniverse libraries, now part of NVIDIA Agent Toolkit.

NVIDIA said that SideFX is using OpenUSD workflows, as well as ovrtx and ovphysx libraries, to explore how agents can help integrate Omniverse libraries into its Houdini procedural 3D content creation workflows, giving technical artists a path to generate, test physics and prepare content for simulation.

“Procedural 3D creation is essential to building the complex, controllable worlds needed for simulation, robotics and industrial AI,” said Kim Davidson, president and CEO of SideFX. “With NVIDIA Omniverse libraries and OpenUSD, SideFX is exploring how agent-ready tools can support Houdini workflows, helping technical artists review, test and prepare procedural content for simulation while staying in control of the creative process.”

The PTC Onshape CAD and product data management (PDM) platform is using OpenUSD and ovrtx to connect cloud-native design workflows with physical simulation, helping product design content stay connected with CAD, PDM, collaboration and simulation workflows.

“Engineering teams are seeking more connected ways to design, collaborate and simulate throughout the development process,” said Neil Barua, president and CEO of PTC. “PTC’s work with NVIDIA supports that broader vision, while NVIDIA Omniverse libraries help enable simulation-ready workflows that bring validation and testing closer to where products are designed.”

To learn more about this news, including NVIDIA’s SIGGRAPH display, click here.