Attention

As of June 30, 2025, the Isaac ROS Buildfarm for Isaac ROS 2.1 on Ubuntu 20.04 Focal is no longer supported.

Due to an isolated infrastructure event, all ROS 2 Humble Debian packages that were previously built for Ubuntu 20.04 are no longer available in the Isaac Apt Repository. All artifacts for Isaac ROS 3.0 and later are built and maintained with a more robust pipeline.

Users are encouraged to migrate to the latest version of Isaac ROS. The source code for Isaac ROS 2.1 continues to be available on the release-2.1 branches of the Isaac ROS GitHub repositories.

The original documentation for Isaac ROS 2.1 is preserved below.

Tutorial for DNN Image Segmentation with Isaac Sim

Overview

This tutorial walks you through a graph for Image Segmentation of people using images from Isaac Sim.

Tutorial Walkthrough

1. Complete the quickstart up until step 9.

2. Launch the Docker container using the run_dev.sh script:

   cd ${ISAAC_ROS_WS}/src/isaac_ros_common && \
     ./scripts/run_dev.sh
   

3. Install and launch Isaac Sim following the steps in the Isaac ROS Isaac Sim Setup Guide.

4. Press Play to start publishing data from the Isaac Sim.

   

5. Run the following launch files to start the inferencing:

   ros2 launch isaac_ros_unet isaac_ros_unet_triton_isaac_sim.launch.py \
   model_name:=peoplesemsegnet_shuffleseg model_repository_paths:=['/tmp/models'] \
   input_binding_names:=['input_2:0'] output_binding_names:=['argmax_1'] \
   network_output_type:='argmax'
   

6. In another terminal, visualize and validate the output of the package by launching rqt_image_view:

   cd ${ISAAC_ROS_WS}/src/isaac_ros_common && \
       ./scripts/run_dev.sh
   

   Then launch rqt_image_view:

   ros2 run rqt_image_view rqt_image_view
   

   To view a colorized segmentation mask, inside the rqt_image_view GUI, change the topic to /unet/colored_segmentation_mask.

   Note

   The raw segmentation is also published to /unet/raw_segmentation_mask. However, the raw pixels correspond to the class labels and so the output is unsuitable for human visual inspection.