Configure Cameras for DisplayPort Insertion#
Complete Isaac ROS RealSense Setup. Connect the camera using a USB 3 port and cable, and position it so that the plug, socket, and robot workspace are visible. Avoid reflective surfaces and verify the depth image before running perception.
Note
If you already added the
realsenseimage layer to the workspace configuration file in Configure the Workspace Container and ranisaac-ros activate --build-local, skip the Docker configuration and activation steps on that page.Identify each camera’s serial number:
rs-enumerate-devices -SChoose a setup name. Copy unspecified.yaml to
<SETUP_NAME>.yamlin the same source directory and fill in the serial numbers.Follow Isaac for Manipulation Camera Calibration for each camera. Assign distinct frames, such as
camera_1_linkandcamera_2_link.In static_transforms.launch.py, add an entry named
<SETUP_NAME>tocalibrations_dict. Copy the measured translation and quaternion from the calibration result. Setparent_frameto the calibration’s robot reference frame andchild_frameto the matching camera frame. Repeat for each camera.Set
setup: <SETUP_NAME>in the DisplayPort workflow YAML. Usedepth_type: REALSENSEandenable_dnn_depth_in_realsense: 'false'so FoundationPose receives the camera’s depth stream. Rebuild the source package and source the workspace after editing the configuration:cd ${ISAAC_ROS_WS} ISAAC_ROS_SKIP_ASSET_INSTALL=1 MANIPULATOR_INSTALL_ASSETS=0 \ colcon build --symlink-install --packages-select isaac_ros_manipulation_bringup source install/setup.bash
Continue with the DisplayPort workflow for object meshes, model paths, and the plug and socket pose configuration.