You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 14:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Jan 07, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11782991919,0cyclictest19624-21fwupd07:28:112
11773991918,1cyclictest65850irq/126-lan10:29:420
11773991918,1cyclictest65850irq/126-lan09:15:180
11773991818,0cyclictest65850irq/126-lan12:10:110
11773991818,0cyclictest65850irq/126-lan11:30:130
11773991818,0cyclictest65850irq/126-lan10:40:160
11773991818,0cyclictest65850irq/126-lan10:38:320
11773991818,0cyclictest65850irq/126-lan07:50:180
11773991817,1cyclictest65850irq/126-lan12:35:130
11773991817,1cyclictest65850irq/126-lan12:20:110
11773991817,1cyclictest65850irq/126-lan11:22:230
11773991717,0cyclictest743-21snmpd10:08:550
11773991717,0cyclictest743-21snmpd09:53:540
11773991717,0cyclictest743-21snmpd09:37:050
11773991717,0cyclictest65850irq/126-lan11:50:180
11773991717,0cyclictest65850irq/126-lan09:09:330
11773991717,0cyclictest14472-21cat08:35:130
11773991716,1cyclictest65850irq/126-lan12:00:160
11773991716,1cyclictest65850irq/126-lan10:55:160
11773991716,1cyclictest65850irq/126-lan08:20:130
11773991616,0cyclictest743-21snmpd11:09:050
11773991616,0cyclictest743-21snmpd10:10:000
11773991616,0cyclictest743-21snmpd09:20:430
11773991616,0cyclictest65850irq/126-lan10:45:160
11773991616,0cyclictest65850irq/126-lan09:55:210
11773991616,0cyclictest65850irq/126-lan09:30:240
11773991616,0cyclictest65850irq/126-lan08:55:120
11773991616,0cyclictest65850irq/126-lan08:45:170
11773991616,0cyclictest65850irq/126-lan08:30:160
11773991616,0cyclictest65850irq/126-lan08:10:120
11773991616,0cyclictest65850irq/126-lan07:45:120
11773991616,0cyclictest65850irq/126-lan07:24:590
11773991616,0cyclictest65850irq/126-lan07:10:210
11773991615,1cyclictest65850irq/126-lan11:40:140
11773991615,1cyclictest65850irq/126-lan08:40:210
11773991615,1cyclictest65850irq/126-lan07:20:130
11773991515,0cyclictest743-21snmpd11:55:550
11773991515,0cyclictest743-21snmpd10:30:130
11773991515,0cyclictest743-21snmpd07:44:160
11773991515,0cyclictest65850irq/126-lan10:20:140
11773991515,0cyclictest65850irq/126-lan08:53:480
11773991515,0cyclictest65850irq/126-lan08:00:200
11773991514,1cyclictest65850irq/126-lan12:30:140
11773991514,1cyclictest65850irq/126-lan12:05:120
11773991514,1cyclictest65850irq/126-lan11:00:120
11773991514,1cyclictest65850irq/126-lan09:25:190
11773991414,0cyclictest65850irq/126-lan12:25:200
11773991414,0cyclictest65850irq/126-lan11:25:160
11773991414,0cyclictest65850irq/126-lan09:45:180
11773991414,0cyclictest65850irq/126-lan09:10:130
11773991414,0cyclictest65850irq/126-lan09:00:210
11773991414,0cyclictest65850irq/126-lan08:27:170
11773991414,0cyclictest65850irq/126-lan08:15:160
11773991414,0cyclictest65850irq/126-lan07:55:210
11773991414,0cyclictest65850irq/126-lan07:17:160
11773991413,1cyclictest65850irq/126-lan10:15:210
11773991313,0cyclictest65850irq/126-lan11:45:170
11773991313,0cyclictest65850irq/126-lan11:16:470
11773991313,0cyclictest65850irq/126-lan11:10:150
11773991313,0cyclictest65850irq/126-lan09:40:120
11773991313,0cyclictest65850irq/126-lan07:36:260
11773991212,0cyclictest65850irq/126-lan12:15:140
11773991212,0cyclictest65850irq/126-lan11:35:080
11773991212,0cyclictest65850irq/126-lan07:30:190
11773991211,1cyclictest65850irq/126-lan10:00:120
11773991010,0cyclictest65850irq/126-lan08:05:150
117829998,1cyclictest743-21snmpd12:17:362
117829998,1cyclictest743-21snmpd10:55:072
117829998,1cyclictest743-21snmpd09:48:452
117829998,1cyclictest743-21snmpd07:16:072
117829998,1cyclictest741-21lldpd08:42:062
117779998,1cyclictest743-21snmpd12:27:261
117779998,1cyclictest743-21snmpd12:20:371
117869988,0cyclictest743-21snmpd10:13:403
117869988,0cyclictest743-21snmpd07:10:483
117869988,0cyclictest741-21lldpd12:36:093
117869987,1cyclictest743-21snmpd11:36:273
117869987,1cyclictest743-21snmpd10:08:093
117869986,2cyclictest743-21snmpd11:41:443
117869986,2cyclictest743-21snmpd11:31:243
117869986,2cyclictest743-21snmpd11:02:383
117869986,2cyclictest743-21snmpd10:50:503
117869986,2cyclictest743-21snmpd08:20:433
117869986,2cyclictest743-21snmpd08:06:033
117869986,2cyclictest7060-21tail10:55:153
117829988,0cyclictest743-21snmpd12:22:042
117829988,0cyclictest743-21snmpd12:09:492
117829988,0cyclictest743-21snmpd10:36:562
117829988,0cyclictest743-21snmpd09:32:332
117829988,0cyclictest743-21snmpd09:08:142
117829988,0cyclictest743-21snmpd08:26:282
117829988,0cyclictest743-21snmpd08:17:592
117829988,0cyclictest741-21lldpd08:05:102
117829987,1cyclictest743-21snmpd12:02:362
117829987,1cyclictest743-21snmpd11:52:402
117829987,1cyclictest743-21snmpd09:14:262
117829987,1cyclictest743-21snmpd09:00:132
117829986,2cyclictest743-21snmpd11:05:322
117829986,2cyclictest717-21ntpd11:48:282
117829986,2cyclictest717-21ntpd11:37:092
117829986,2cyclictest717-21ntpd08:46:592
117829986,2cyclictest717-21ntpd08:31:112
117829986,2cyclictest717-21ntpd08:00:472
117829986,2cyclictest12387-21cat07:10:152
117829986,2cyclictest1125-21cat09:20:132
117779988,0cyclictest743-21snmpd10:53:171
117779988,0cyclictest743-21snmpd10:45:441
117779988,0cyclictest743-21snmpd10:32:471
117779988,0cyclictest743-21snmpd08:03:351
117779988,0cyclictest741-21lldpd10:21:541
117779988,0cyclictest741-21lldpd08:53:181
117779988,0cyclictest741-21lldpd08:42:121
117779987,1cyclictest743-21snmpd11:34:261
117779987,1cyclictest743-21snmpd10:35:261
117779986,2cyclictest743-21snmpd12:03:181
117779986,2cyclictest743-21snmpd11:44:341
117779986,2cyclictest743-21snmpd10:27:451
117779986,2cyclictest743-21snmpd07:41:071
117779986,2cyclictest27745-21cat11:45:141
117779984,3cyclictest7198-21diskstats12:15:121
117869977,0cyclictest743-21snmpd12:34:253
117869977,0cyclictest743-21snmpd10:25:103
117869977,0cyclictest743-21snmpd09:41:183
117869977,0cyclictest743-21snmpd09:05:323
117869977,0cyclictest743-21snmpd09:02:133
117869977,0cyclictest743-21snmpd08:03:393
117869977,0cyclictest743-21snmpd07:39:503
117869977,0cyclictest741-21lldpd10:23:013
117869977,0cyclictest741-21lldpd08:35:523
117869977,0cyclictest741-21lldpd07:33:113
117869976,1cyclictest743-21snmpd12:13:463
117869976,1cyclictest743-21snmpd07:48:233
117869976,1cyclictest29202-21fschecks_time10:30:143
117869976,1cyclictest12892-21cpuspeed_turbos09:50:113
117869975,2cyclictest743-21snmpd11:51:403
117869975,2cyclictest743-21snmpd11:18:333
117869975,2cyclictest743-21snmpd11:13:083
117869975,2cyclictest743-21snmpd10:37:193
117869975,2cyclictest743-21snmpd10:03:073
117869975,2cyclictest743-21snmpd09:47:303
117869975,2cyclictest743-21snmpd09:32:593
117869975,2cyclictest743-21snmpd07:40:103
117869974,3cyclictest16848-21ntp_states07:20:163
117829977,0cyclictest743-21snmpd08:12:472
117829977,0cyclictest743-21snmpd07:24:052
117829976,1cyclictest30609-21gltestperf07:55:132
117829975,2cyclictest743-21snmpd12:32:462
117829975,2cyclictest743-21snmpd10:40:492
117829975,2cyclictest743-21snmpd07:45:372
117829975,2cyclictest743-21snmpd07:36:382
117829975,2cyclictest717-21ntpd11:21:032
117829975,2cyclictest717-21ntpd11:15:352
117829975,2cyclictest717-21ntpd10:00:042
117829975,2cyclictest717-21ntpd09:57:522
117829975,2cyclictest717-21ntpd08:51:442
117829975,2cyclictest717-21ntpd08:36:242
117829975,2cyclictest717-21ntpd07:43:562
117829973,3cyclictest2798-21df10:45:132
117779977,0cyclictest743-21snmpd11:56:311
117779977,0cyclictest743-21snmpd11:26:151
117779977,0cyclictest743-21snmpd10:44:371
117779977,0cyclictest743-21snmpd10:09:061
117779977,0cyclictest743-21snmpd07:29:131
117779977,0cyclictest743-21snmpd07:21:371
117779977,0cyclictest743-21snmpd07:19:371
117779977,0cyclictest741-21lldpd12:39:091
117779977,0cyclictest741-21lldpd11:52:531
117779977,0cyclictest741-21lldpd09:34:351
117779977,0cyclictest741-21lldpd08:13:101
117779977,0cyclictest741-21lldpd07:56:161
117779977,0cyclictest741-21lldpd07:49:181
117779976,1cyclictest743-21snmpd09:21:431
117779975,2cyclictest743-21snmpd12:06:461
117779975,2cyclictest743-21snmpd08:56:351
117779975,2cyclictest743-21snmpd08:33:121
117779975,2cyclictest743-21snmpd08:24:521
117779975,2cyclictest743-21snmpd07:31:101
117779974,3cyclictest13265-21cat09:50:131
117779972,4cyclictest557-21NetworkManager07:50:121
117739977,0cyclictest741-21lldpd10:51:380
117869966,0cyclictest743-21snmpd09:28:513
117869966,0cyclictest741-21lldpd08:44:213
117869966,0cyclictest741-21lldpd08:29:493
117869965,1cyclictest743-21snmpd10:41:133
117869965,1cyclictest743-21snmpd10:16:133
117869965,1cyclictest743-21snmpd08:53:593
117869965,1cyclictest743-21snmpd08:15:323
117869965,1cyclictest741-21lldpd11:47:013
117869964,2cyclictest743-21snmpd11:55:103
117869963,3cyclictest18317-21fw_forwarded_lo07:25:133
117869962,3cyclictest12192-21df_inode08:30:113
117829966,0cyclictest743-21snmpd09:35:412
117829966,0cyclictest741-21lldpd12:10:152
117829966,0cyclictest741-21lldpd07:54:132
117829966,0cyclictest741-21lldpd07:31:532
117829966,0cyclictest522-21avahi-daemon10:16:002
117829965,1cyclictest743-21snmpd09:27:542
117829965,1cyclictest717-21ntpd11:10:062
117829965,1cyclictest506-21systemd-resolve11:01:172
117829964,2cyclictest743-21snmpd08:20:372
117829964,2cyclictest717-21ntpd11:41:092
117829964,2cyclictest717-21ntpd10:24:132
117779966,0cyclictest743-21snmpd09:00:101
117779966,0cyclictest743-21snmpd08:16:171
117779966,0cyclictest741-21lldpd10:00:591
117779965,1cyclictest7046-21gltestperf09:35:131
117779965,1cyclictest522-21avahi-daemon10:55:001
117779965,1cyclictest22977-21cpuspeed_turbos10:15:121
117779965,1cyclictest10189-21fschecks_count08:25:141
117779962,3cyclictest9186-21sed11:00:151
117869955,0cyclictest522-21avahi-daemon09:18:553
117869955,0cyclictest522-21avahi-daemon07:18:103
117869954,1cyclictest743-21snmpd07:51:423
117869954,1cyclictest2717-21cpuspeed_turbos10:45:133
117869954,1cyclictest230702sleep308:55:163
117869953,2cyclictest743-21snmpd11:21:303
117869952,3cyclictest12263-21sed12:25:203
117869952,2cyclictest4693-21ntpq08:10:163
117869952,2cyclictest244-20systemd-journal09:10:463
117869951,3cyclictest20530-21sed11:25:203
117829954,1cyclictest717-21ntpd11:25:062
117829953,2cyclictest743-21snmpd09:51:382
117829952,3cyclictest4956-21fw_forwarded_lo10:50:142
117829952,3cyclictest32628-21grep11:55:212
117829952,3cyclictest31822-21sed09:15:212
117829952,3cyclictest19441-21memory10:05:172
117829952,3cyclictest15406-21grep12:35:132
117829952,2cyclictest9722-21pmu-power09:40:202
117829952,2cyclictest22211-21wc11:30:182
117779955,0cyclictest743-21snmpd09:45:301
117779955,0cyclictest743-21snmpd08:08:301
117779955,0cyclictest741-21lldpd09:57:071
117779955,0cyclictest522-21avahi-daemon12:30:241
117779954,1cyclictest743-21snmpd09:26:091
117779954,1cyclictest743-21snmpd08:37:131
117779954,1cyclictest522-21avahi-daemon07:38:161
117779953,2cyclictest743-21snmpd11:17:481
117779953,2cyclictest743-21snmpd08:46:451
117779952,2cyclictest22794-21ls10:14:591
117779952,2cyclictest12600-21cut07:10:161
117779951,3cyclictest9081-21fw_packets09:40:141
117869943,1cyclictest511ktimers/308:45:153
117869942,2cyclictest0-21swapper/312:05:213
117869941,3cyclictest32391-21apt-get09:20:013
117869941,2cyclictest7295-21fschecks_time12:15:123
117869941,2cyclictest30469-21expr07:55:123
117869941,2cyclictest1697-21ld12:00:163
117869940,4cyclictest9828-21ntpq12:20:173
117869940,3cyclictest7303-21memory09:35:143
117869940,3cyclictest15672-21ntpq09:55:183
117869940,3cyclictest11448-21fw_packets11:05:143
117829944,0cyclictest29047-21cpuspeed_turbos10:30:132
117829942,2cyclictest557-21NetworkManager10:14:422
117829941,2cyclictest22714-21sh08:55:132
117829940,4cyclictest27666-21ntpq10:25:172
117779943,1cyclictest26936-21gltestperf09:05:141
117779942,2cyclictest743-21snmpd11:09:411
117779941,3cyclictest19580-21kworker/1:0-events11:35:021
117779941,2cyclictest31935-21unixbench_singl09:15:231
117779941,2cyclictest28742-21expr09:10:131
117779940,3cyclictest5395-21grep12:10:131
117779940,3cyclictest17394-21diskstats11:20:131
117829930,3cyclictest11061-21/usr/sbin/munin12:25:132
117779930,3cyclictest13173-21apt11:10:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional