You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 07:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Mar 11, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20690991818,0cyclictest65850irq/126-lan22:25:202
20690991817,1cyclictest65850irq/126-lan21:16:032
20690991817,1cyclictest65850irq/126-lan20:30:042
20690991817,1cyclictest65850irq/126-lan20:30:042
20690991817,1cyclictest65850irq/126-lan19:45:162
20682991818,0cyclictest743-21snmpd22:35:141
20682991818,0cyclictest743-21snmpd21:54:221
20682991818,0cyclictest743-21snmpd00:17:501
20690991717,0cyclictest65850irq/126-lan23:00:202
20690991717,0cyclictest65850irq/126-lan21:25:162
20690991717,0cyclictest65850irq/126-lan00:00:372
20690991716,1cyclictest65850irq/126-lan23:50:122
20690991716,1cyclictest65850irq/126-lan23:35:172
20690991716,1cyclictest65850irq/126-lan23:30:172
20690991716,1cyclictest65850irq/126-lan23:25:192
20690991716,1cyclictest65850irq/126-lan22:00:182
20690991716,1cyclictest65850irq/126-lan21:06:342
20690991716,1cyclictest65850irq/126-lan20:45:122
20690991716,1cyclictest65850irq/126-lan20:25:112
20690991716,1cyclictest65850irq/126-lan19:55:212
20690991716,1cyclictest65850irq/126-lan19:30:162
20690991716,1cyclictest65850irq/126-lan00:30:182
20682991717,0cyclictest743-21snmpd22:26:241
20682991717,0cyclictest743-21snmpd21:23:571
20682991717,0cyclictest743-21snmpd19:46:331
20690991616,0cyclictest65850irq/126-lan22:56:202
20690991616,0cyclictest65850irq/126-lan22:13:122
20690991616,0cyclictest65850irq/126-lan20:35:142
20690991616,0cyclictest65850irq/126-lan19:52:132
20690991616,0cyclictest65850irq/126-lan19:10:152
20690991616,0cyclictest65850irq/126-lan00:25:122
20690991616,0cyclictest65850irq/126-lan00:05:132
20690991615,1cyclictest65850irq/126-lan22:40:172
20690991615,1cyclictest65850irq/126-lan22:35:112
20690991615,1cyclictest65850irq/126-lan22:30:122
20690991615,1cyclictest65850irq/126-lan21:35:122
20690991615,1cyclictest65850irq/126-lan19:20:162
20690991615,1cyclictest65850irq/126-lan00:15:182
20690991515,0cyclictest65850irq/126-lan23:10:142
20690991515,0cyclictest65850irq/126-lan23:05:182
20690991515,0cyclictest65850irq/126-lan21:59:192
20690991515,0cyclictest65850irq/126-lan21:45:132
20690991515,0cyclictest65850irq/126-lan00:35:172
20690991515,0cyclictest65850irq/126-lan00:10:192
20690991514,1cyclictest65850irq/126-lan22:20:152
20690991514,1cyclictest65850irq/126-lan21:50:122
20690991514,1cyclictest65850irq/126-lan21:40:172
20690991514,1cyclictest65850irq/126-lan21:10:132
20690991514,1cyclictest65850irq/126-lan00:20:122
20690991414,0cyclictest65850irq/126-lan23:15:182
20690991414,0cyclictest65850irq/126-lan21:30:122
20690991413,1cyclictest65850irq/126-lan23:20:152
20690991413,1cyclictest65850irq/126-lan22:50:142
20690991413,1cyclictest65850irq/126-lan20:50:172
20690991413,1cyclictest65850irq/126-lan20:00:132
20690991413,1cyclictest65850irq/126-lan19:15:142
20690991313,0cyclictest65850irq/126-lan23:55:152
20690991313,0cyclictest65850irq/126-lan22:05:202
20690991313,0cyclictest65850irq/126-lan20:15:172
20690991312,1cyclictest65850irq/126-lan23:45:182
20690991312,1cyclictest65850irq/126-lan22:15:172
20690991212,0cyclictest65850irq/126-lan23:40:122
20690991212,0cyclictest65850irq/126-lan22:45:132
20690991212,0cyclictest65850irq/126-lan20:20:032
20690991211,1cyclictest65850irq/126-lan21:20:122
20690991211,1cyclictest65850irq/126-lan19:40:182
20690991111,0cyclictest65850irq/126-lan21:01:182
20690991111,0cyclictest65850irq/126-lan19:35:162
20690991111,0cyclictest65850irq/126-lan19:30:002
20690991110,1cyclictest65850irq/126-lan20:55:152
2069099109,1cyclictest65850irq/126-lan20:10:212
2069099109,1cyclictest65850irq/126-lan20:05:182
206949998,1cyclictest743-21snmpd23:35:253
206829998,1cyclictest743-21snmpd20:41:541
206829998,1cyclictest244-20systemd-journal20:15:121
206749998,1cyclictest743-21snmpd23:59:500
206749998,1cyclictest743-21snmpd23:44:130
206749998,1cyclictest743-21snmpd22:29:230
206749998,1cyclictest743-21snmpd21:31:030
206749998,1cyclictest743-21snmpd19:58:380
206749998,1cyclictest741-21lldpd22:15:340
206949988,0cyclictest743-21snmpd20:54:453
206949988,0cyclictest741-21lldpd22:20:573
206949988,0cyclictest741-21lldpd21:50:513
206949988,0cyclictest741-21lldpd21:28:583
206949988,0cyclictest741-21lldpd19:48:213
206949987,1cyclictest743-21snmpd23:26:163
206949987,1cyclictest741-21lldpd21:03:543
206949986,2cyclictest743-21snmpd22:52:093
206949986,2cyclictest743-21snmpd00:07:093
206909987,1cyclictest65850irq/126-lan20:40:132
206829988,0cyclictest743-21snmpd21:32:061
206829988,0cyclictest743-21snmpd20:07:281
206829988,0cyclictest741-21lldpd23:07:061
206829988,0cyclictest741-21lldpd21:49:271
206829988,0cyclictest741-21lldpd00:06:561
206829986,2cyclictest743-21snmpd23:55:341
206829986,2cyclictest2848-21cat23:40:131
206749988,0cyclictest743-21snmpd20:11:440
206749988,0cyclictest741-21lldpd21:27:030
206749988,0cyclictest741-21lldpd21:02:120
206749988,0cyclictest741-21lldpd19:14:160
206749987,1cyclictest743-21snmpd22:01:020
206749987,1cyclictest743-21snmpd21:45:190
206749987,1cyclictest743-21snmpd21:37:400
206749987,1cyclictest743-21snmpd21:14:250
206749987,1cyclictest743-21snmpd20:20:550
206749987,1cyclictest743-21snmpd19:45:030
206749987,1cyclictest743-21snmpd19:21:390
206749987,1cyclictest743-21snmpd00:13:500
206749986,2cyclictest743-21snmpd22:23:290
206749986,2cyclictest743-21snmpd21:40:290
206749986,2cyclictest743-21snmpd21:15:420
206749986,2cyclictest743-21snmpd20:57:030
206949977,0cyclictest741-21lldpd23:47:503
206949977,0cyclictest741-21lldpd22:48:103
206949977,0cyclictest741-21lldpd22:36:453
206949977,0cyclictest741-21lldpd20:31:563
206949977,0cyclictest741-21lldpd20:31:563
206949977,0cyclictest741-21lldpd19:11:003
206949977,0cyclictest741-21lldpd00:35:183
206949977,0cyclictest741-21lldpd00:19:483
206949976,1cyclictest743-21snmpd23:34:233
206949976,1cyclictest743-21snmpd22:09:293
206949976,1cyclictest743-21snmpd20:38:093
206949976,1cyclictest743-21snmpd19:38:163
206949976,1cyclictest743-21snmpd00:33:373
206949975,2cyclictest743-21snmpd21:35:413
206949975,2cyclictest743-21snmpd00:12:113
206829977,0cyclictest743-21snmpd22:54:271
206829977,0cyclictest741-21lldpd23:36:031
206829977,0cyclictest741-21lldpd23:30:351
206829977,0cyclictest741-21lldpd22:32:421
206829977,0cyclictest741-21lldpd00:22:241
206829976,1cyclictest743-21snmpd23:12:181
206829976,1cyclictest743-21snmpd20:00:521
206829976,1cyclictest743-21snmpd19:20:051
206829976,1cyclictest743-21snmpd00:04:001
206829976,1cyclictest741-21lldpd19:32:371
206829976,1cyclictest22531-21dump-pmu-power20:35:011
206829976,1cyclictest22531-21dump-pmu-power20:35:001
206829975,2cyclictest743-21snmpd22:13:451
206829975,2cyclictest743-21snmpd21:42:291
206829975,2cyclictest743-21snmpd21:07:061
206829975,2cyclictest743-21snmpd20:56:061
206829975,2cyclictest743-21snmpd20:25:561
206829975,2cyclictest743-21snmpd19:55:201
206829975,2cyclictest743-21snmpd00:13:471
206829974,3cyclictest27700-21cat20:45:131
206749977,0cyclictest743-21snmpd21:06:000
206749977,0cyclictest743-21snmpd19:50:280
206749977,0cyclictest741-21lldpd23:24:310
206749977,0cyclictest741-21lldpd23:06:080
206749977,0cyclictest741-21lldpd22:55:520
206749977,0cyclictest741-21lldpd20:01:330
206749977,0cyclictest741-21lldpd19:33:490
206749977,0cyclictest741-21lldpd19:26:460
206749977,0cyclictest741-21lldpd19:15:010
206749977,0cyclictest741-21lldpd00:31:110
206749977,0cyclictest573-21in:imuxsock19:40:030
206749976,1cyclictest743-21snmpd20:25:520
206749976,1cyclictest743-21snmpd20:09:040
206749976,1cyclictest743-21snmpd00:00:080
206749976,1cyclictest522-21avahi-daemon00:21:590
206749975,2cyclictest743-21snmpd23:38:290
206749975,2cyclictest743-21snmpd23:31:020
206749975,2cyclictest743-21snmpd22:31:540
206749975,2cyclictest743-21snmpd20:51:470
206749975,2cyclictest743-21snmpd20:44:480
206749975,2cyclictest743-21snmpd20:38:200
206749975,2cyclictest743-21snmpd19:36:390
206749972,4cyclictest244-20systemd-journal21:24:550
206949966,0cyclictest743-21snmpd22:43:153
206949966,0cyclictest743-21snmpd22:25:153
206949966,0cyclictest743-21snmpd22:12:423
206949966,0cyclictest741-21lldpd23:51:053
206949966,0cyclictest741-21lldpd20:21:253
206949966,0cyclictest741-21lldpd00:29:153
206949965,1cyclictest743-21snmpd19:51:403
206949965,1cyclictest743-21snmpd00:04:333
206949965,1cyclictest522-21avahi-daemon22:03:583
206949965,1cyclictest511ktimers/320:10:173
206949965,1cyclictest20978-21gltestperf23:05:133
206949964,2cyclictest743-21snmpd23:24:223
206949964,2cyclictest743-21snmpd00:20:573
206949964,2cyclictest1026-21cat19:40:143
206949963,2cyclictest244-20systemd-journal19:19:403
206949963,2cyclictest20132-21sshd21:45:183
206949962,3cyclictest15240-21sed20:15:153
206829966,0cyclictest743-21snmpd20:35:231
206829966,0cyclictest741-21lldpd23:52:241
206829966,0cyclictest741-21lldpd21:35:031
206829966,0cyclictest741-21lldpd19:51:131
206829966,0cyclictest522-21avahi-daemon19:18:121
206829965,1cyclictest743-21snmpd22:07:201
206829965,1cyclictest743-21snmpd21:55:021
206829965,1cyclictest743-21snmpd20:12:531
206829964,2cyclictest743-21snmpd23:21:001
206829963,3cyclictest31118-21df_inode19:35:131
206829963,2cyclictest31557-21head22:15:151
206749966,0cyclictest741-21lldpd22:44:280
206749966,0cyclictest741-21lldpd21:57:060
206749965,1cyclictest743-21snmpd22:47:580
206749965,1cyclictest743-21snmpd22:11:060
206749965,1cyclictest7159-21gltestperf23:50:130
206749964,2cyclictest743-21snmpd23:16:070
206749964,2cyclictest743-21snmpd22:09:140
206749964,2cyclictest15143-21cat20:15:150
206749963,3cyclictest557-21NetworkManager00:15:200
206949955,0cyclictest743-21snmpd22:30:203
206949955,0cyclictest741-21lldpd23:19:453
206949955,0cyclictest741-21lldpd19:59:253
206949954,1cyclictest13354-21gltestperf21:30:123
206949953,2cyclictest0-21swapper/320:25:123
206949952,3cyclictest5796-21ntp_states21:10:173
206949952,3cyclictest557-21NetworkManager23:42:013
206949952,3cyclictest557-21NetworkManager21:24:083
206949952,2cyclictest244-20systemd-journal21:40:093
206949951,3cyclictest7807-21ntp_states21:15:183
206949950,5cyclictest557-21NetworkManager19:34:063
206949950,5cyclictest22862-21turbostat21:59:553
206829955,0cyclictest743-21snmpd23:16:251
206829955,0cyclictest743-21snmpd19:28:401
206829955,0cyclictest741-21lldpd21:27:091
206829954,1cyclictest743-21snmpd23:47:261
206829954,1cyclictest743-21snmpd21:15:211
206829954,1cyclictest21161-21cut19:10:131
206829952,2cyclictest575-21rs:main1
206829952,2cyclictest17448-21ld20:20:161
206829952,2cyclictest16823-21grep22:55:141
206829952,2cyclictest12867-21nfs4_client22:45:141
206829950,4cyclictest19049-21hddtemp_smartct23:00:131
206829950,2cyclictest2645-21kworker/1:1+mm_percpu_wq23:29:421
206749955,0cyclictest743-21snmpd23:10:150
206749955,0cyclictest522-21avahi-daemon23:27:570
206749954,1cyclictest743-21snmpd00:09:000
206749954,1cyclictest5593-21ntpq23:45:150
206749954,1cyclictest0-21swapper/022:50:230
206749953,2cyclictest244-20systemd-journal23:01:020
206749951,3cyclictest8001-21fw_forwarded_lo22:35:120
206749950,4cyclictest22281-21ntp_states00:25:160
206949943,1cyclictest741-21lldpd20:48:523
206949943,1cyclictest573-21in:imuxsock19:28:183
206949943,1cyclictest511ktimers/319:20:163
206949942,2cyclictest32047-21nvmesmart_nvme022:15:183
206949941,3cyclictest557-21NetworkManager20:01:503
206949941,2cyclictest31261-21acpi20:55:103
206949941,2cyclictest18910-21fschecks_time23:00:123
206949941,2cyclictest16681-21cpuspeed_turbos22:55:143
206949940,4cyclictest26567-21latency_hist20:45:003
206949940,4cyclictest11515-21ntpq20:05:173
206949940,3cyclictest9165-21fw_conntrack23:55:133
206949940,3cyclictest2931-21apt-get21:05:123
206829944,0cyclictest0-21swapper/121:00:091
206829944,0cyclictest0-21swapper/100:30:171
206829943,1cyclictest522-21avahi-daemon22:23:241
206829942,2cyclictest22096-21needreboot00:25:141
206829941,2cyclictest26081-21cat00:35:161
206829941,2cyclictest1046-21cat19:40:151
206829941,2cyclictest10372-21grep22:40:111
206829940,3cyclictest5704-21ntpq21:10:171
206829940,3cyclictest30018-21ntpq20:50:171
206749944,0cyclictest20848-21cpuspeed_turbos20:30:130
206749944,0cyclictest20848-21cpuspeed_turbos20:30:120
206749943,1cyclictest743-21snmpd00:35:520
206749942,2cyclictest21096-21apt21:50:110
206749940,3cyclictest27952-21ntp_192.168.11420:45:150
206949930,3cyclictest557-21NetworkManager23:10:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional