Nvidia Unveils Cosmos World Models for Robotics
Notably NVIDIA unveiled a powerful suite of Cosmos world foundation models WFMs and Omniverse libraries tools specifically designed to transform how AI is trained and deployed in robotics and physical environments.
Omniverse Libraries & AI Infrastructure
- Notably:NuRec 3D Gaussian Splatting is an advanced rendering technique that creates realistic digital twins from sensor data. Moreover it supports ray-traced reconstructions for simulator environments like CARLA.
- Omniverse SDK Updates: Adds integration with MuJoCo and OpenUSD. It also improves support in Isaac Sim 5.0 and Isaac Lab 2.2, easing the bridge between simulation and robotics.
- Compute Hardware: RTX PRO Blackwell Servers and DGX Cloud now power robotics workloads. They offer high-performance compute options from rack to cloud.
Real-World Impact and Adoption
Boston Dynamics has deepened its collaboration with NVIDIA particularly around its humanoid robot Atlas:
- Atlas now runs on NVIDIA’s Jetson Thor computing platform enabling it to execute complex multimodal AI models with greater efficiency and performance .
- The Isaac Lab framework built on Isaac Sim Omniverse and Cosmos facilitates simulation-based learning for Atlas helping it adapt dynamic movements and real-world task execution in virtual settings before deployment .
- These tools are also being applied to Spot their quadruped and Orbit fleet management software to enhance locomotion control and real-time hazard avoidance using foundational AI models .
Amazon Devices & Services: Manufacturing Gets Smarter
- Similarly Amazon is deploying Omniverse libraries and Cosmos tools to power advanced manufacturing solutions leveraging the synthetic data generation and simulation capabilities these platforms offer. NVIDIA Newsroom.
Figure AI & Other Innovators
Figure AI alongside Hexagon RAI Institute Lightwheel and Skild AI is actively leveraging Omniverse libraries Isaac Sim and Isaac Lab to accelerate development of AI-driven robotics systems
Infrastructure for Robotics
Nvidia is also providing a robust infrastructure to support the development and deployment of these models. This includes:
- Software Tools: A suite of software tools designed to streamline the development process.
- Hardware Acceleration: Utilizing Nvidia’s powerful GPUs to accelerate the training and inference of AI models.
- Cloud Services: Access to cloud-based resources for training and deployment.
