You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 20:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Wed Dec 03, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25476994545,0cyclictest21139-21fwupd11:14:042
25473991919,0cyclictest66850irq/125-lan11:15:141
25473991918,1cyclictest66850irq/125-lan12:30:141
25473991918,1cyclictest66850irq/125-lan12:12:311
25473991918,1cyclictest66850irq/125-lan12:05:231
25473991918,1cyclictest66850irq/125-lan11:50:441
25473991918,1cyclictest66850irq/125-lan11:35:131
25473991918,1cyclictest66850irq/125-lan11:21:291
25473991918,1cyclictest66850irq/125-lan10:40:191
25473991918,1cyclictest66850irq/125-lan10:02:431
25473991918,1cyclictest66850irq/125-lan09:55:191
25473991918,1cyclictest66850irq/125-lan09:09:501
25473991918,1cyclictest66850irq/125-lan08:05:201
25473991818,0cyclictest66850irq/125-lan12:36:151
25473991818,0cyclictest66850irq/125-lan11:10:181
25473991818,0cyclictest66850irq/125-lan10:34:341
25473991818,0cyclictest66850irq/125-lan10:23:181
25473991818,0cyclictest66850irq/125-lan09:15:581
25473991818,0cyclictest66850irq/125-lan08:55:201
25473991818,0cyclictest66850irq/125-lan07:35:231
25473991817,1cyclictest66850irq/125-lan12:20:181
25473991817,1cyclictest66850irq/125-lan11:59:421
25473991817,1cyclictest66850irq/125-lan11:45:401
25473991817,1cyclictest66850irq/125-lan10:15:111
25473991717,0cyclictest66850irq/125-lan12:00:221
25473991717,0cyclictest66850irq/125-lan11:34:461
25473991717,0cyclictest66850irq/125-lan11:02:471
25473991717,0cyclictest66850irq/125-lan10:55:021
25473991717,0cyclictest66850irq/125-lan10:53:201
25473991717,0cyclictest66850irq/125-lan10:46:151
25473991717,0cyclictest66850irq/125-lan09:54:421
25473991717,0cyclictest66850irq/125-lan09:49:131
25473991717,0cyclictest66850irq/125-lan09:21:011
25473991717,0cyclictest66850irq/125-lan08:35:181
25473991717,0cyclictest66850irq/125-lan07:25:131
25473991716,1cyclictest66850irq/125-lan12:25:251
25473991716,1cyclictest66850irq/125-lan12:15:161
25473991716,1cyclictest66850irq/125-lan11:41:391
25473991716,1cyclictest66850irq/125-lan11:25:171
25473991716,1cyclictest66850irq/125-lan11:05:141
25473991716,1cyclictest66850irq/125-lan10:26:401
25473991716,1cyclictest66850irq/125-lan10:10:171
25473991716,1cyclictest66850irq/125-lan09:32:321
25473991716,1cyclictest66850irq/125-lan09:11:161
25473991716,1cyclictest66850irq/125-lan08:45:121
25473991716,1cyclictest66850irq/125-lan07:15:151
25473991616,0cyclictest66850irq/125-lan09:36:171
25473991616,0cyclictest66850irq/125-lan08:40:161
25473991615,1cyclictest66850irq/125-lan10:35:001
25473991615,1cyclictest66850irq/125-lan10:08:411
25473991615,1cyclictest66850irq/125-lan09:40:211
25473991615,1cyclictest66850irq/125-lan09:25:111
25473991615,1cyclictest66850irq/125-lan08:50:131
25473991615,1cyclictest66850irq/125-lan08:00:171
25473991615,1cyclictest66850irq/125-lan07:20:141
25473991615,1cyclictest66850irq/125-lan07:10:191
25473991515,0cyclictest66850irq/125-lan07:45:201
25473991514,1cyclictest66850irq/125-lan09:00:131
25473991413,1cyclictest66850irq/125-lan07:30:181
25473991312,1cyclictest66850irq/125-lan08:30:131
25473991212,0cyclictest66850irq/125-lan08:20:131
25473991212,0cyclictest66850irq/125-lan08:15:161
25473991211,1cyclictest66850irq/125-lan07:55:121
25473991111,0cyclictest66850irq/125-lan08:25:001
25473991110,1cyclictest66850irq/125-lan07:50:111
2547399109,1cyclictest66850irq/125-lan07:40:161
25473991010,0cyclictest66850irq/125-lan08:10:131
254799998,1cyclictest771-21snmpd12:04:053
254799998,1cyclictest769-21lldpd11:00:553
254769998,1cyclictest769-21lldpd11:04:552
254689998,1cyclictest771-21snmpd11:59:580
254689998,1cyclictest771-21snmpd08:01:020
254799988,0cyclictest771-21snmpd10:18:443
254799988,0cyclictest771-21snmpd09:39:383
254799988,0cyclictest771-21snmpd08:33:063
254799988,0cyclictest771-21snmpd07:56:103
254799988,0cyclictest769-21lldpd12:06:533
254799988,0cyclictest769-21lldpd10:08:353
254799988,0cyclictest769-21lldpd09:52:213
254799988,0cyclictest769-21lldpd09:26:153
254799988,0cyclictest769-21lldpd09:07:403
254799988,0cyclictest769-21lldpd08:25:103
254799987,1cyclictest771-21snmpd10:55:563
254799987,1cyclictest769-21lldpd10:24:003
254799987,1cyclictest769-21lldpd07:45:123
254799987,1cyclictest584-21in:imuxsock12:12:343
254799986,2cyclictest771-21snmpd11:42:423
254799986,2cyclictest771-21snmpd10:45:443
254799986,2cyclictest771-21snmpd10:12:033
254799986,2cyclictest771-21snmpd07:37:103
254799986,2cyclictest14403-21cat12:20:143
254769988,0cyclictest771-21snmpd12:23:272
254769988,0cyclictest771-21snmpd10:20:222
254769988,0cyclictest771-21snmpd09:11:402
254769988,0cyclictest771-21snmpd07:10:242
254769988,0cyclictest769-21lldpd10:17:262
254769988,0cyclictest769-21lldpd07:55:182
254769987,1cyclictest771-21snmpd12:27:232
254769987,1cyclictest771-21snmpd10:58:202
254769987,1cyclictest771-21snmpd10:41:582
254769987,1cyclictest771-21snmpd08:55:372
254769987,1cyclictest769-21lldpd12:12:032
254769987,1cyclictest255-20systemd-journal09:48:412
254769987,1cyclictest25458-21cyclictest10:50:162
254769986,2cyclictest771-21snmpd10:13:392
254689988,0cyclictest771-21snmpd10:15:450
254689988,0cyclictest771-21snmpd07:51:220
254689988,0cyclictest769-21lldpd11:30:230
254689988,0cyclictest769-21lldpd11:27:070
254689988,0cyclictest769-21lldpd11:03:120
254689988,0cyclictest769-21lldpd09:57:470
254689988,0cyclictest769-21lldpd08:53:480
254689987,1cyclictest771-21snmpd11:42:570
254689987,1cyclictest771-21snmpd11:37:550
254689987,1cyclictest771-21snmpd08:23:360
254689987,1cyclictest771-21snmpd07:40:280
254689987,1cyclictest524-21avahi-daemon10:26:110
254689987,1cyclictest524-21avahi-daemon07:45:230
254689987,1cyclictest28190-21fschecks_time10:45:130
254689986,2cyclictest771-21snmpd12:09:080
254689986,2cyclictest771-21snmpd09:28:050
254689986,2cyclictest771-21snmpd09:09:460
254689986,2cyclictest771-21snmpd07:22:150
254689986,2cyclictest771-21snmpd07:10:030
254689985,3cyclictest1791-21cat07:30:150
254799977,0cyclictest771-21snmpd09:43:263
254799977,0cyclictest771-21snmpd08:24:273
254799977,0cyclictest769-21lldpd11:36:493
254799977,0cyclictest769-21lldpd08:51:483
254799977,0cyclictest769-21lldpd07:40:443
254799977,0cyclictest769-21lldpd07:25:123
254799976,1cyclictest524-21avahi-daemon12:34:283
254799976,1cyclictest524-21avahi-daemon10:01:393
254799976,1cyclictest524-21avahi-daemon09:11:553
254799976,1cyclictest28490-21cpuspeed_turbos09:30:123
254799975,2cyclictest771-21snmpd09:19:193
254799975,2cyclictest771-21snmpd08:16:593
254799975,2cyclictest771-21snmpd07:24:393
254799973,3cyclictest3780-21ssh10:54:363
254799973,3cyclictest16380-21ssh10:31:273
254769977,0cyclictest771-21snmpd11:35:002
254769977,0cyclictest771-21snmpd10:05:542
254769977,0cyclictest771-21snmpd09:00:142
254769977,0cyclictest771-21snmpd08:50:452
254769977,0cyclictest771-21snmpd07:31:292
254769977,0cyclictest771-21snmpd07:24:332
254769977,0cyclictest769-21lldpd09:27:232
254769976,1cyclictest8227-21cat09:05:132
254769976,1cyclictest771-21snmpd12:00:562
254769976,1cyclictest771-21snmpd09:53:482
254769976,1cyclictest771-21snmpd09:21:292
254769976,1cyclictest31926-21cut07:25:132
254769975,2cyclictest771-21snmpd11:29:272
254769975,2cyclictest771-21snmpd11:05:532
254769975,2cyclictest771-21snmpd10:36:402
254769975,2cyclictest771-21snmpd10:31:502
254769975,2cyclictest771-21snmpd08:18:512
254769973,3cyclictest550-21NetworkManager12:06:152
254769973,3cyclictest18107-21ssh09:19:282
254689977,0cyclictest771-21snmpd12:35:390
254689977,0cyclictest771-21snmpd12:15:400
254689977,0cyclictest771-21snmpd11:47:400
254689977,0cyclictest771-21snmpd11:06:330
254689977,0cyclictest771-21snmpd09:35:200
254689977,0cyclictest769-21lldpd10:36:510
254689977,0cyclictest769-21lldpd10:20:230
254689977,0cyclictest769-21lldpd10:11:270
254689977,0cyclictest769-21lldpd09:48:210
254689977,0cyclictest769-21lldpd09:23:310
254689977,0cyclictest769-21lldpd08:29:040
254689977,0cyclictest524-21avahi-daemon08:36:210
254689976,1cyclictest771-21snmpd10:42:400
254689976,1cyclictest771-21snmpd08:55:280
254689976,1cyclictest769-21lldpd09:42:340
254689976,1cyclictest524-21avahi-daemon12:23:450
254689976,1cyclictest517-21systemd-resolve07:15:290
254689976,1cyclictest32676-21fschecks_count10:50:130
254689975,2cyclictest771-21snmpd11:16:570
254689975,2cyclictest771-21snmpd09:11:190
254689973,3cyclictest586-21rs:main0
254799966,0cyclictest771-21snmpd09:57:573
254799966,0cyclictest769-21lldpd10:42:123
254799966,0cyclictest769-21lldpd07:52:243
254799965,1cyclictest771-21snmpd08:07:203
254799965,1cyclictest771-21snmpd07:17:333
254799965,1cyclictest769-21lldpd10:27:103
254799965,1cyclictest32380-21fschecks_time08:45:133
254799964,2cyclictest771-21snmpd11:33:163
254799964,2cyclictest771-21snmpd11:21:393
254799963,3cyclictest550-21NetworkManager11:55:343
254799963,2cyclictest23291-21ssh11:52:323
254799963,2cyclictest19520-21ssh11:48:513
254799962,3cyclictest31092-21diskstats11:25:123
254799962,3cyclictest30546-21ssh12:38:223
254799962,3cyclictest19995-21ssh12:25:333
254769966,0cyclictest771-21snmpd09:31:422
254769966,0cyclictest769-21lldpd12:36:372
254769966,0cyclictest769-21lldpd12:15:212
254769966,0cyclictest769-21lldpd08:32:072
254769966,0cyclictest769-21lldpd08:10:242
254769966,0cyclictest769-21lldpd07:44:242
254769965,1cyclictest771-21snmpd11:18:252
254769965,1cyclictest771-21snmpd07:15:402
254769965,1cyclictest769-21lldpd08:49:192
254769965,1cyclictest524-21avahi-daemon11:41:002
254769965,1cyclictest524-21avahi-daemon10:01:372
254769965,1cyclictest517-21systemd-resolve12:34:462
254769965,1cyclictest16028-21cpuspeed_turbos08:05:122
254769964,2cyclictest771-21snmpd11:55:492
254769964,2cyclictest771-21snmpd08:21:172
254769963,3cyclictest550-21NetworkManager11:45:412
254769963,3cyclictest550-21NetworkManager09:38:522
254769962,3cyclictest255-20systemd-journal11:33:132
254769962,3cyclictest23031-21sh11:52:072
254689966,0cyclictest771-21snmpd08:46:510
254689966,0cyclictest771-21snmpd08:43:060
254689966,0cyclictest771-21snmpd08:33:180
254689965,1cyclictest27108-21needreboot11:20:180
254689965,1cyclictest21749-21fschecks_time10:00:140
254689964,2cyclictest771-21snmpd09:31:030
254689964,2cyclictest771-21snmpd07:35:310
254689963,2cyclictest25708-21ssh12:32:520
254689963,2cyclictest23712-21ssh11:53:250
254689962,3cyclictest409-21sed07:25:340
254689962,3cyclictest20266-21perl08:15:130
254689960,5cyclictest255-20systemd-journal08:13:370
254799955,0cyclictest769-21lldpd10:36:443
254799955,0cyclictest524-21avahi-daemon08:04:093
254799954,1cyclictest10470-21needreboot12:15:163
254799953,2cyclictest771-21snmpd08:36:033
254799952,2cyclictest5540-21sendmail-msp09:00:003
254799952,2cyclictest30520-21if_err_lan08:40:133
254799952,2cyclictest26008-21head07:10:143
254799952,2cyclictest255-20systemd-journal07:32:193
254799952,2cyclictest22386-21ssh09:23:373
254799952,2cyclictest20644-21ssh11:13:113
254799952,2cyclictest11103-21ssh09:47:593
254799950,4cyclictest14291-21sed11:05:183
254769955,0cyclictest771-21snmpd10:26:222
254769955,0cyclictest25458-21cyclictest08:40:192
254769954,1cyclictest27230-21ntpq11:20:182
254769953,2cyclictest771-21snmpd08:36:212
254769953,2cyclictest3360-21apt-get07:35:142
254769953,2cyclictest18395-21sed09:55:232
254769952,2cyclictest24375-21cut08:25:132
254769950,4cyclictest517-21systemd-resolve08:02:352
254689955,0cyclictest524-21avahi-daemon10:06:150
254689954,1cyclictest524-21avahi-daemon12:28:370
254689953,2cyclictest550-21NetworkManager10:56:530
254689953,2cyclictest550-21NetworkManager10:30:110
254689952,3cyclictest771-21snmpd08:09:140
254689952,2cyclictest29719-21awk12:00:160
254689952,2cyclictest18637-21cut11:10:180
254689951,3cyclictest13671-21dump-pmu-power07:59:590
254799943,1cyclictest771-21snmpd08:14:293
254799941,3cyclictest21938-21sh11:15:053
254799940,4cyclictest4481-21ntpq08:55:163
254769941,2cyclictest9949-21cpuspeed_turbos07:50:112
254769941,2cyclictest7522-21cat07:45:132
254769941,2cyclictest4203-21ssh09:40:092
254769941,2cyclictest28784-21modprobe10:45:182
254689944,0cyclictest0-21swapper/009:50:120
254689940,3cyclictest6044-21perl09:00:130
254689940,3cyclictest5347-21diskstats12:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional