Isaac ROS Sensing Thor GMSL2 Camera Setup#

This guide shows how to use the Sensing TRD1 G2A Thor kit to run S56C stereo camera and SHF3L monocular cameras from Sensing through NVIDIA’s Sensor Interface Processing Library (SIPL). The kit extends a Jetson AGX Thor Developer Kit with eight-port GMSL2 camera connectivity.

Host System Compatibility#

This guide is verified with the following hardware and software:

  • Sensing TRD1 G2A Thor kit: The kit combines a Jetson AGX Thor Developer Kit, Sensing GMSL2 camera expansion hardware, and a dedicated power supply.

  • JetPack 7.2.x.

For the GMSL adapter overview and assembly details, refer to the Sensing TRD1 G2A guide.

For Sensing driver and Jetson host prerequisites for JetPack 7.2, refer to the Sensing driver package README.

Important

Sensing’s package includes boot loader pin-multiplexing files that must be applied when JetPack is installed for their Sensing TRD1 G2A Thor. A stock JetPack installation does not configure every I2C and power-control pin required by the adapter. Complete the flashing step in the Sensing driver package README before continuing. This guide starts after that installation is complete.

Hardware Requirements#

The following camera hardware is used in this guide:

  • One Sensing Astra S56C GMSL2 stereo camera.

  • Two Sensing SHF3L GMSL2 cameras.

  • A dedicated 12 V power supply for the GMSL distribution board.

  • FAKRA/coax cables for the cameras.

Connect the Cameras#

  1. Power off the Jetson and GMSL board.

  2. Follow the first connection layout in the Sensing S56C and SHF3L mixed-camera guide. Connect the S56C to CAM0 and the two SHF3L cameras to CAM2 and CAM3 as labeled in the Sensing TRD1 G2A Thor hardware guide. The link mask in this guide and the isaac_ros_sipl_camera package configuration files assume this connection layout.

  3. Connect the kit power supply, then power on the Jetson.

Install the Sensing SIPL Drivers#

  1. Verify the installed Jetson Linux release:

    head -n 1 /etc/nv_tegra_release
    

    Confirm that the release and revision match the Jetson Linux version targeted by the Sensing driver package. For example, the package name encodes the Jetson Linux version as L4TR39.2.

  2. Download the Sensing driver package for the installed Jetson Linux version as described in the Sensing driver package README.

  3. From the driver package directory, install the Sensing SIPL camera drivers, libraries, tools, and NITO file:

    chmod a+x install.sh
    ./install.sh
    

    If the Jetson nvidia-l4t-camera package is ever updated later, install this Sensing driver package again as they share installation directories and override each other.

  4. Add the new camera drivers and NITO file to the Jetson container-runtime manifest. This block verifies that the manifest and each referenced file exist. It is idempotent and appends each entry only if the exact line is not already present:

    csv=/etc/nvidia-container-runtime/host-files-for-container.d/drivers.csv
    test -f "${csv}" || { echo "Missing: ${csv}"; exit 1; }
    for file in \
       /usr/lib/nvsipl_drv/libnvuddf_s56c_cameramodule_library.so \
       /usr/lib/nvsipl_drv/libnvuddf_sgx_yuv_gmsl2_cameramodule_library.so \
       /var/nvidia/nvcam/settings/sipl/S56C.nito; do
       test -f "${file}" || { echo "Missing: ${file}"; exit 1; }
       entry="lib, ${file}"
       grep -qxF "${entry}" "${csv}" || printf '%s\n' "${entry}" | \
          sudo tee -a "${csv}" > /dev/null
    done
    

    The NVIDIA container runtime reads this manifest when it creates a container and exposes these files to containers that use the NVIDIA runtime.

  5. When using these cameras, apply the following every boot to set MAXN power mode and lock the clocks to improve capture stability when under load:

    sudo nvpmodel -m 0
    sudo jetson_clocks
    

    Reapply after changing the power mode or rebooting the Jetson.

Verify Sensing Streams in Native SIPL Capture#

  1. Go to the Sensing driver package directory:

    cd <driver-package-directory>
    
  2. Run a 40-second capture test of the S56C and both SHF3L cameras. The command displays the complete output, saves it to a log, and then prints a summary of frame rates and errors:

    SENSING_LOG=/tmp/sensing_native_capture.log
    sudo ./bin/nvsipl_camera \
       -t query/trd1_g2a/s56c_shf3l_mixed.json \
       -c S56C_1_SHF3L_2 \
       -m "0x0000 0x1101" \
       --enable-camera-hal -s -Z --mixed-yuv-output -r 40 </dev/null 2>&1 | \
       tee "${SENSING_LOG}"
    echo "Return code ${PIPESTATUS[0]}"
    grep -aE 'Frame rate|Frame captured|ERROR|FAIL' "${SENSING_LOG}"
    

    Confirm that the output shows frames or frame rates for all four configured streams and no ERROR or FAIL messages.

    This build of nvsipl_camera is provided by Sensing, not by NVIDIA.

Run the Cameras with Isaac ROS#

To build and run the cameras with Isaac ROS, refer to the Isaac ROS SIPL Camera documentation.

Troubleshooting#

If the cameras fail to initialize, check the i2c and gpio group permissions. Refer to SIPL Camera Fails to Initialize: Missing Permissions for the permission setup.