โŒ

Reading view

How to Train a Cross-Embodiment Robot Navigation Policy with AI Agents

Navigation enables a robot to turn perception and motion into purposeful autonomy. Unlike locomotion, which produces stable movement, navigation must be used to...

Navigation enables a robot to turn perception and motion into purposeful autonomy. Unlike locomotion, which produces stable movement, navigation must be used to continuously localize the robot, interpret changing surroundings, select a route, and avoid obstacles to reach a goal safely. Moving this capability to a new robot or scene can require new data, simulation assets, robot interfacesโ€ฆ

Source

  •  

Post-Train NVIDIA Cosmos 3 Edge for On-Device Robot Control

A robot picking up a tool.Robots need policies that can adapt to their sensors, environments, and tasks while running on onboard computing hardware. World models offer a foundation for...A robot picking up a tool.

Robots need policies that can adapt to their sensors, environments, and tasks while running on onboard computing hardware. World models offer a foundation for learning physical interactions, but their size can make on-device deployment difficult. This changes with the new NVIDIA Cosmos 3 Edge. Cosmos 3 Edge is a 4B omni-model (with a 2B NVIDIA Nemotron-based reasoner) in the Cosmos 3 family.

Source

๐Ÿ’พ

  •  

Beyond VLAs: How World Action Models Reshape Robot Manipulation

A GIF of a robot following directionsโ€ with a description of the actual robot, task, objects, and motion shown.A central challenge in robotics is building policies that generalize beyond the demonstrations theyโ€™re trained on. A policy that succeeds in a training scene...A GIF of a robot following directionsโ€ with a description of the actual robot, task, objects, and motion shown.

A central challenge in robotics is building policies that generalize beyond the demonstrations theyโ€™re trained on. A policy that succeeds in a training scene often fails when object shapes, positions, or lighting change. Generalizing to these new conditions requires the policy to understand the tasks underlying physics, not just mimic the demonstrations. This ability comes from the backbone itโ€™sโ€ฆ

Source

  •  

Developing Healthcare Robotics with GPU-Native Medical Physics Simulation

A surgeon using simulation on a computer to place a catheter.Unlike autonomous driving or industrial robotics, healthcare robotics canโ€™t rely on internet-scale data collection or unlimited real-world experimentation....A surgeon using simulation on a computer to place a catheter.

Unlike autonomous driving or industrial robotics, healthcare robotics canโ€™t rely on internet-scale data collection or unlimited real-world experimentation. Every demonstration requires specialized equipment, clinical expertise, and access to patients or laboratory environments. This creates three fundamental challenges for developers. First is the data gap. Training modern robotic policiesโ€ฆ

Source

๐Ÿ’พ

  •  

Integrate NVIDIA Omniverse RTX Sensor Simulation Into Existing Apps

Developers building 3D, design, simulation, robotics, and industrial digital twin applications need ways to bring physical AI capabilities into the tools and...

Developers building 3D, design, simulation, robotics, and industrial digital twin applications need ways to bring physical AI capabilities into the tools and services they already use. Many of these workflows already depend on OpenUSD scenes, simulation-ready (SimReady) assets, Blender-based workflows, CAD pipelines, or domain-specific app stacks. The challenge is how to provide applications andโ€ฆ

Source

  •  

Post-Train NVIDIA Cosmos 3 in One Day Using Agent Skills

What if autonomous coding AI agents could push your vision reasoning models above 90% accuracy with almost no manual effort? When adapting vision reasoning...

What if autonomous coding AI agents could push your vision reasoning models above 90% accuracy with almost no manual effort? When adapting vision reasoning models to production video tasks, developers often lose days to data formatting, container setup, training scripts, baseline evaluation, and hyperparameter sweeps before they even know whether post-training improves accuracy.

Source

  •  

Optimizing a Neural Reconstruction Pipeline Using NVIDIA Nsight Developer Tools

NVIDIA Omniverse NuRec is a neural reconstruction pipeline for building high-fidelity 3D representations of real-world environments from multisensor data such...

NVIDIA Omniverse NuRec is a neural reconstruction pipeline for building high-fidelity 3D representations of real-world environments from multisensor data such as cameras and lidar. It is used to reconstruct dynamic scenes captured by autonomous vehicle (AV) and robotics platforms into simulation-ready digital environments that can be rendered, replayed, and analyzed inside NVIDIA Omniverse andโ€ฆ

Source

  •  

Accelerating BEV Pooling on NVIDIA GPUs for Physical AI Applications

An increasingly common design pattern for autonomous vehicles (AVs), robotics, and spatial AI systems is bird's-eye-view (BEV) perception. BEV models project...

An increasingly common design pattern for autonomous vehicles (AVs), robotics, and spatial AI systems is birdโ€™s-eye-view (BEV) perception. BEV models project multicamera image features into a shared top-down grid, providing downstream perception and planning modules with a common spatial layout for reasoning about lanes, vehicles, pedestrians, and free space. A key operation in this pipelineโ€ฆ

Source

  •  

Inside NVIDIA Halos for Robotics: A Full-Stack Functional Safety System for Physical AI

Physical AIโ€”robots working autonomously alongside people in factories, warehouses, hospitals, and homesโ€”is arriving faster than most expected. Traditional...

Physical AIโ€”robots working autonomously alongside people in factories, warehouses, hospitals, and homesโ€”is arriving faster than most expected. Traditional safety which was built for structured environments can not work anymore as the spaces become more unstructured and robots move out of cages. AI-driven safety is the key. Marking a major milestone in the arrival of physical AIโ€ฆ

Source

  •  
โŒ