Performance Summary#

The performance results of benchmarking the Isaac ROS packages on both Jetson and x86_64 platforms are below:

Node
Input Size
AGX Thor T5000
AGX Thor T4000
DGX Spark
x86_64 w/ RTX 5090
720p
2.9 ms @ 30Hz
11 ms @ 30Hz
2.4 ms @ 30Hz
2.0 ms @ 30Hz
720p
370 ms @ 30Hz
350 ms @ 30Hz
360 ms @ 30Hz
99 ms @ 30Hz
576p
8.8 ms @ 30Hz
26 ms @ 30Hz
8.2 ms @ 30Hz
5.3 ms @ 30Hz
288p
3.5 ms @ 30Hz
12 ms @ 30Hz
4.1 ms @ 30Hz
3.5 ms @ 30Hz
1080p
5.7 ms @ 30Hz
20 ms @ 30Hz
5.4 ms @ 30Hz
4.0 ms @ 30Hz
1080p
1.6 ms @ 30Hz
4.8 ms @ 30Hz
2.3 ms @ 30Hz
2.9 ms @ 30Hz
VGA
6.4 ms @ 30Hz
27 ms @ 30Hz
8.6 ms @ 30Hz
4.0 ms @ 30Hz
VGA
7.5 ms @ 30Hz
30 ms @ 30Hz
10 ms @ 30Hz
4.4 ms @ 30Hz
PeopleSemSegNet
544p
2.1 ms @ 30Hz
6.8 ms @ 30Hz
1.4 ms @ 30Hz
1.5 ms @ 30Hz
PeopleSemSegNet
544p
4.0 ms @ 30Hz
11 ms @ 30Hz
3.1 ms @ 30Hz
5.4 ms @ 30Hz
VGA
11 ms @ 30Hz
19 ms @ 30Hz
10 ms @ 30Hz
10 ms @ 30Hz
~50 sq. m
40 ms @ 30Hz
110 ms @ 30Hz
27 ms @ 30Hz
13 ms @ 30Hz
1080p
4.5 ms @ 30Hz
5.3 ms @ 30Hz
4.4 ms @ 30Hz
4.1 ms @ 30Hz
I-frame Support
1080p
2.9 ms @ 30Hz
10 ms @ 30Hz
2.7 ms @ 30Hz
3.8 ms @ 30Hz
P-frame Support
1080p
2.9 ms @ 30Hz
9.5 ms @ 30Hz
3.1 ms @ 30Hz
3.8 ms @ 30Hz
89.8 ms
23.1 ms
Graph
Input Size
AGX Thor T5000
AGX Thor T4000
DGX Spark
x86_64 w/ RTX 5090
720p
5.2 ms @ 30Hz
15 ms @ 30Hz
3.9 ms @ 30Hz
2.8 ms @ 30Hz
VGA
27 ms @ 30Hz
73 ms @ 30Hz
23 ms @ 30Hz
19 ms @ 30Hz
VGA
22 ms @ 30Hz
53 ms @ 30Hz
27 ms @ 30Hz
17 ms @ 30Hz
576p
13 ms @ 30Hz
38 ms @ 30Hz
13 ms @ 30Hz
9.9 ms @ 30Hz
288p
9.2 ms @ 30Hz
20 ms @ 30Hz
11 ms @ 30Hz
9.2 ms @ 30Hz
1080p
10 ms @ 30Hz
26 ms @ 30Hz
9.0 ms @ 30Hz
6.9 ms @ 30Hz
544p
18 ms @ 30Hz
43 ms @ 30Hz
19 ms @ 30Hz
18 ms @ 30Hz
544p
50 ms @ 30Hz
90 ms @ 30Hz
63 ms @ 30Hz
15 ms @ 30Hz
720p
12 ms @ 30Hz
35 ms @ 30Hz
12 ms @ 30Hz
11 ms @ 30Hz
PeopleSemSegNet
544p
8.1 ms @ 30Hz
19 ms @ 30Hz
6.7 ms @ 30Hz
6.3 ms @ 30Hz
720p
350 ms @ 30Hz
290 ms @ 30Hz
280 ms @ 30Hz
57 ms @ 30Hz
720p
230 ms @ 30Hz
200 ms @ 30Hz
82 ms @ 30Hz
20 ms @ 30Hz

Methodology#

The performance numbers provided above are measured using Isaac ROS Benchmark. Configuration files for reproducing results are provided in the launch scripts for each benchmark here.

Frames per second (fps) are measured using the maximum sustained framerate for the accelerated computational pipeline on each listed platforms. Performance measured includes input node → graph of nodes under performance test → output node where the publishing rate of the input node is auto-tuned to discover the peak throughput dropping <5% of the frames. Average fps computed over 5 runs, discarding minimum and maximum runs; latency measured at 30hz publishing rate matching sensor capture rate.