Tutorial for ESS with Isaac Sim#

https://media.githubusercontent.com/media/NVIDIA-ISAAC-ROS/.github/release-4.0/resources/isaac_ros_docs/concepts/stereo_depth/ess/Rviz.png/

Overview#

This tutorial walks you through a graph to estimate depth with stereo images from Isaac Sim.

Tutorial Walkthrough#

  1. Install and launch Isaac Sim following the steps in the Isaac ROS Isaac Sim Setup Guide.

  2. Press Play to start publishing data from the Isaac Sim.

    https://media.githubusercontent.com/media/NVIDIA-ISAAC-ROS/.github/release-4.0/resources/isaac_ros_docs/getting_started/isaac_sim_sample_scene.png/
  3. Complete the isaac_ros_ess quickstart.

Note

Use the ess model and not the ess_light model for the quickstart.

  1. Open a second terminal and attach to the container:

    isaac-ros activate
    
  2. In the second terminal, start the isaac_ros_ess node using the launch files:

    ros2 launch isaac_ros_ess isaac_ros_ess_isaac_sim.launch.py \
       engine_file_path:=${ISAAC_ROS_WS:?}/isaac_ros_assets/models/dnn_stereo_disparity/dnn_stereo_disparity_v4.1.0_onnx_trt10.13/ess.engine \
       threshold:=0.4
    
  3. Optionally, you can run the visualizer script to visualize the disparity image.

    ros2 run isaac_ros_ess isaac_ros_ess_visualizer.py
    
    https://media.githubusercontent.com/media/NVIDIA-ISAAC-ROS/.github/release-4.0/resources/isaac_ros_docs/concepts/stereo_depth/ess/Visualizer_isaac_sim.png/