Tutorial: Running Isaac Perceptor on `Nova Orin Developer Kit` =============================================================================================== To run and evaluate camera-based perception on your robot with the `Nova Orin Developer Kit`, please follow suggested mounting guidelines, and power on the `Nova Orin Developer Kit`. .. note:: The `Nova Orin Developer Kit` has been unboxed and set up as expected by following :doc:`Getting Started `. Mounting the `Nova Orin Developer Kit` on a Robot ---------------------------------------------------- To use the `Nova Orin Developer Kit` as the perception module on an existing robot, you must mount it on your robot. It is essential that the developer kit is mounted rigidly and cannot move. It is recommended to mount the `Nova Orin Developer Kit` such that the camera's field of views are largely unobstructed. Make sure to orient the `Nova Orin Developer Kit` such that the front camera is pointing to the robot's main direction of travel, and the bottom plate is parallel to the ground. The developer kit can be mounted using either a tripod mount or the general purpose hole pattern on its bottom. Recommended mounting hole positions can be found in the `Nova Orin DevKit Quick Start Guide` from Segway. To account for the mounting location when running `Isaac Perceptor`, a robot URDF file needs to be provided. Otherwise the :ir_repo:`nova_developer_kit.urdf.xacro ` is used, which assumes that the `Nova Orin Developer Kit` is initialized on the ground plane. It is **recommended to follow the** :doc:`extrinsic calibration instructions `. After the output of calibration is stored in the default location in the robot (``/etc/nova/calibration/isaac_calibration.urdf``), `Isaac Perceptor` will use it without requiring any additional arguments: .. code:: bash ros2 launch nova_developer_kit_bringup perceptor.launch.py Alternatively, the :ref:`Nominal values and URDF file generation` section details the process to create a robot nominals URDF file (``urdf_nominals_file_path``). The robot nominals URDF file can then be passed with the `urdf_override_file` argument to `Isaac Perceptor`: .. code:: bash ros2 launch nova_developer_kit_bringup perceptor.launch.py \ urdf_override_file:=<"urdf_nominals_file_path"> Powering On the `Nova Orin Developer Kit` ------------------------------------------ Use the power splitter cable to distribute power to the barrel jack ports found on the Jetson AGX Orin and GMSL Camera Board. For the input side of the splitter cable, provide a 12V (90W capable) power source. The male barrel jack input has an outer diameter of 5.5mm and inner diameter of 2.5mm. Verify that the system turns on when power is applied. Alternatively, power on the `Nova Orin Developer Kit` by pressing the power button (the left-most button) in the AGX Orin. Tutorials --------- You are recommended to go through following tutorials to running and evaluating `Isaac Perceptor` on your robot equipped with the `Nova Orin Developer Kit`. Visualize Sensors on the `Nova Orin Developer Kit` ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Follow the :doc:`Tutorial: Run all Sensors on the Nova Orin Developer Kit ` to visualize all the sensors on your `Nova Orin Developer Kit`. Running `Isaac Perceptor` on a Robot ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Follow the :doc:`Tutorial: Running Camera-based 3D Perception with Isaac Perceptor with the Nova Orin Developer Kit ` on how to launch the application, how to visualize, and evaluate the results. Running `Isaac Perceptor` on a Robot with the Navigation Stack ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ To support running `Isaac Perceptor` with navigation stacks on your robot, we provide reference design examples for sensor mounting :doc:`Isaac Perceptor Sensor Mounting Guide`, and for software integration :doc:`Tutorial: Integrating Isaac Perceptor with Nav2 with the Nova Orin Developer Kit `. .. toctree:: :maxdepth: 1 :glob: :hidden: tutorials_on_devkit/demo_sensors.rst tutorials_on_devkit/demo_perceptor.rst tutorials_on_devkit/demo_navigation.rst