Tutorial: Running Isaac Perceptor on Nova Orin Developer Kit

To run and evaluate camera-based perception on your robot with the Nova Orin Developer Kit, please follow suggested mounting guidelines, and power on the Nova Orin Developer Kit.

Note

The Nova Orin Developer Kit has been unboxed and set up as expected by following Getting Started.

Mounting the Nova Orin Developer Kit on a Robot

To use the Nova Orin Developer Kit as the perception module on an existing robot, you must mount it on your robot. It is essential that the developer kit is mounted rigidly and cannot move.

It is recommended to mount the Nova Orin Developer Kit such that the camera’s field of views are largely unobstructed. Make sure to orient the Nova Orin Developer Kit such that the front camera is pointing to the robot’s main direction of travel, and the bottom plate is parallel to the ground.

The developer kit can be mounted using either a tripod mount or the general purpose hole pattern on its bottom. Recommended mounting hole positions can be found in the Nova Orin DevKit Quick Start Guide from Segway.

To account for the mounting location when running Isaac Perceptor, a robot URDF file needs to be provided. Otherwise the nova_developer_kit.urdf.xacro is used, which assumes that the Nova Orin Developer Kit is initialized on the ground plane.

It is recommended to follow the extrinsic calibration instructions. After the output of calibration is stored in the default location in the robot (/etc/nova/calibration/isaac_calibration.urdf), Isaac Perceptor will use it without requiring any additional arguments:

ros2 launch nova_developer_kit_bringup perceptor.launch.py

Alternatively, the Nominal values and URDF file generation section details the process to create a robot nominals URDF file (urdf_nominals_file_path). The robot nominals URDF file can then be passed with the urdf_override_file argument to Isaac Perceptor:

ros2 launch nova_developer_kit_bringup perceptor.launch.py \
    urdf_override_file:=<"urdf_nominals_file_path">

Powering On the Nova Orin Developer Kit

Use the power splitter cable to distribute power to the barrel jack ports found on the Jetson AGX Orin and GMSL Camera Board. For the input side of the splitter cable, provide a 12V (90W capable) power source. The male barrel jack input has an outer diameter of 5.5mm and inner diameter of 2.5mm. Verify that the system turns on when power is applied. Alternatively, power on the Nova Orin Developer Kit by pressing the power button (the left-most button) in the AGX Orin.

Tutorials

You are recommended to go through following tutorials to running and evaluating Isaac Perceptor on your robot equipped with the Nova Orin Developer Kit.

Visualize Sensors on the Nova Orin Developer Kit

Follow the Tutorial: Run all Sensors on the Nova Orin Developer Kit to visualize all the sensors on your Nova Orin Developer Kit.

Running Isaac Perceptor on a Robot

Follow the Tutorial: Running Camera-based 3D Perception with Isaac Perceptor with the Nova Orin Developer Kit on how to launch the application, how to visualize, and evaluate the results.