Nvidia Unveils Cosmos World Models for Robotics

Notably NVIDIA unveiled a powerful suite of Cosmos world foundation models WFMs and Omniverse libraries tools specifically designed to transform how AI is trained and deployed in robotics and physical environments.

Omniverse Libraries & AI Infrastructure

• Notably:NuRec 3D Gaussian Splatting is an advanced rendering technique that creates realistic digital twins from sensor data. Moreover it supports ray-traced reconstructions for simulator environments like CARLA.
• Omniverse SDK Updates: Adds integration with MuJoCo and OpenUSD. It also improves support in Isaac Sim 5.0 and Isaac Lab 2.2, easing the bridge between simulation and robotics.
• Compute Hardware: RTX PRO Blackwell Servers and DGX Cloud now power robotics workloads. They offer high-performance compute options from rack to cloud.

Real-World Impact and Adoption

Boston Dynamics has deepened its collaboration with NVIDIA particularly around its humanoid robot Atlas:

• Atlas now runs on NVIDIA’s Jetson Thor computing platform enabling it to execute complex multimodal AI models with greater efficiency and performance .
• The Isaac Lab framework built on Isaac Sim Omniverse and Cosmos facilitates simulation-based learning for Atlas helping it adapt dynamic movements and real-world task execution in virtual settings before deployment .
• These tools are also being applied to Spot their quadruped and Orbit fleet management software to enhance locomotion control and real-time hazard avoidance using foundational AI models .

Amazon Devices & Services: Manufacturing Gets Smarter

• Similarly Amazon is deploying Omniverse libraries and Cosmos tools to power advanced manufacturing solutions leveraging the synthetic data generation and simulation capabilities these platforms offer. NVIDIA Newsroom.

Figure AI & Other Innovators

Figure AI alongside Hexagon RAI Institute Lightwheel and Skild AI is actively leveraging Omniverse libraries Isaac Sim and Isaac Lab to accelerate development of AI-driven robotics systems

Infrastructure for Robotics

Nvidia is also providing a robust infrastructure to support the development and deployment of these models. This includes:

• Software Tools: A suite of software tools designed to streamline the development process.
• Hardware Acceleration: Utilizing Nvidia’s powerful GPUs to accelerate the training and inference of AI models.
• Cloud Services: Access to cloud-based resources for training and deployment.