You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 13:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Tue Sep 15, 2026 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
188769910551050,4cyclictest8128-21kworker/3:2+events23:23:253
188769910521050,2cyclictest26873-21kworker/3:1+events00:13:023
188769910521049,3cyclictest4569-21kworker/3:2+events20:57:143
188769910521049,3cyclictest28410-21kworker/3:1+events23:42:533
188769910521049,3cyclictest26873-21kworker/3:1+events00:16:443
188769910521049,3cyclictest16698-21kworker/3:1+events21:04:293
188769910521049,3cyclictest16698-21kworker/3:1+events20:46:083
188769910511049,2cyclictest6895-21kworker/3:1+events21:16:293
188769910511049,2cyclictest16698-21kworker/3:1+events21:06:363
188769910511048,3cyclictest20794-21kworker/3:0+events19:55:213
188769910511047,3cyclictest8185-21kworker/3:2+events00:06:493
188769910501049,1cyclictest20794-21kworker/3:0+events19:18:283
188769910501048,2cyclictest8185-21kworker/3:2+events23:55:443
188769910501048,2cyclictest8185-21kworker/3:2+events00:00:443
188769910501048,2cyclictest17727-21kworker/3:2+events21:25:563
188769910501048,2cyclictest1560-21kworker/3:0+events23:48:203
188769910501046,3cyclictest6895-21kworker/3:1+events21:12:413
188769910501046,2cyclictest1560-21kworker/3:0+events23:54:233
188619910501048,2cyclictest8236-21kworker/0:1+events22:48:190
188619910501048,1cyclictest27540-21kworker/0:1+events00:26:270
188769910491045,2cyclictest4569-21kworker/3:2+events20:51:073
188769910491045,2cyclictest4569-21kworker/3:2+events20:29:033
188619910471046,1cyclictest27540-21kworker/0:1+events00:20:220
188769910451043,2cyclictest1036-21kworker/3:0+events21:20:443
188669910411037,4cyclictest19900-21turbostat00:39:541
188669910391036,3cyclictest12290-21kworker/1:1+events21:36:281
188669910341030,4cyclictest24492-21kworker/1:0+events21:32:571
188669910331030,3cyclictest23278-21kworker/1:0+events19:20:441
188669910311029,2cyclictest32586-21kworker/1:1+events23:13:201
188669910311028,3cyclictest8905-21kworker/1:2+events20:07:431
188669910301028,2cyclictest24492-21kworker/1:0+events21:40:431
188669910301027,3cyclictest12290-21kworker/1:1+events21:46:391
188669910291027,2cyclictest32586-21kworker/1:1+events23:17:141
188669910271025,2cyclictest12290-21kworker/1:1+events20:15:231
188669910271024,3cyclictest23278-21kworker/1:0+events19:28:361
188719910261025,1cyclictest19009-21kworker/2:1+events20:41:272
188669910261024,2cyclictest23278-21kworker/1:0+events19:30:451
188669910261023,3cyclictest12290-21kworker/1:1+events20:21:291
188619910261023,3cyclictest3382-21turbostat21:14:560
188669910251023,2cyclictest13961-21kworker/1:1+events19:10:431
188669910251022,3cyclictest24492-21kworker/1:0+events23:07:191
188669910251022,3cyclictest12290-21kworker/1:1+events20:14:351
188669910241022,2cyclictest13961-21kworker/1:1+events19:35:421
188619910241022,2cyclictest6861-21kworker/0:2+events21:58:210
188619910231022,1cyclictest13637-21kworker/0:0+events23:37:210
188619910201018,2cyclictest15111-21kworker/0:3+events23:29:300
188619910141013,1cyclictest4246-21kworker/0:1+events22:03:210
188619910101009,1cyclictest13462-21kworker/0:2+events22:21:080
188619910101007,1cyclictest29410-21kworker/0:0+events22:37:430
188619910091008,1cyclictest24085-21kworker/0:2+events22:31:500
188619910091008,1cyclictest17187-21kworker/0:0+events00:32:240
188619910081007,0cyclictest15111-21kworker/0:3+events23:31:080
188619910081004,3cyclictest20313-21turbostat23:04:550
188619910071006,1cyclictest4246-21kworker/0:1+events19:52:440
188619910071006,1cyclictest29410-21kworker/0:0+events22:52:330
188619910051004,1cyclictest30169-21kworker/0:0+events22:08:170
188619910041003,1cyclictest6861-21kworker/0:2+events21:51:300
188619910041002,2cyclictest1358-21turbostat21:09:560
188619910021001,1cyclictest29410-21kworker/0:0+events22:59:250
18861991000999,1cyclictest2123-21kworker/0:0+events19:48:390
1886199998997,1cyclictest24085-21kworker/0:2+events22:43:070
1887199997996,1cyclictest19009-21kworker/2:1+events20:31:302
1886199997996,1cyclictest30169-21kworker/0:0+events22:10:220
1886199996996,0cyclictest31175-21kworker/0:2+events19:40:430
1886199996995,1cyclictest30169-21kworker/0:0+events22:26:060
1886199996995,1cyclictest30169-21kworker/0:0+events22:18:040
1886199996995,1cyclictest27540-21kworker/0:1+events00:37:110
1887199994993,1cyclictest19009-21kworker/2:1+events20:38:192
1886199990989,1cyclictest4246-21kworker/0:1+events20:02:420
1886199990988,2cyclictest18755-21turbostat19:14:540
1887699985983,2cyclictest28907-21turbostat19:39:553
1887699979976,3cyclictest3120-21turbostat23:19:553
1887699977974,3cyclictest8636-21turbostat20:09:553
1886199968965,3cyclictest16722-21turbostat20:29:540
1886699959957,2cyclictest2583-21turbostat19:54:551
1887199958955,3cyclictest23423-21turbostat23:39:552
1887199941939,2cyclictest14695-21turbostat20:24:542
1886199927925,2cyclictest25251-21turbostat20:49:550
1887199925923,2cyclictest4723-21turbostat22:49:552
1887199923921,2cyclictest5849-21turbostat22:19:562
1886199918916,2cyclictest6965-21turbostat21:49:560
1886199906903,3cyclictest4595-21turbostat19:59:550
1887699889887,2cyclictest6601-21turbostat20:04:543
1886699885882,3cyclictest28506-21turbostat23:44:541
1887699868866,2cyclictest29210-21turbostat21:39:553
1887699865862,3cyclictest30467-21turbostat23:14:553
1886199864863,1cyclictest23226-21turbostat20:44:550
1887699684682,2cyclictest23226-21turbostat20:44:553
1886199677674,3cyclictest28907-21turbostat19:39:550
1887699625624,1cyclictest19900-21turbostat00:39:553
1886699611609,2cyclictest6601-21turbostat20:04:541
1886699611609,2cyclictest20814-21turbostat19:19:551
1886699610608,2cyclictest19084-21turbostat21:29:561
1887699609607,1cyclictest18755-21turbostat19:14:553
1886699592589,3cyclictest20313-21turbostat23:04:551
1887699573572,1cyclictest23423-21turbostat23:39:553
1886199572571,1cyclictest31586-21turbostat00:19:550
1887699559556,3cyclictest14695-21turbostat20:24:543
1887699544544,0cyclictest2583-21turbostat19:54:553
1886199541538,3cyclictest8196-21turbostat23:24:550
1887199523522,1cyclictest16722-21turbostat20:29:552
18866992550,254cyclictest13044-21fschecks_count21:50:121
18866992018,2cyclictest67750irq/123-lan22:53:031
18871991917,2cyclictest762-21ntpd20:05:442
18866991918,1cyclictest67750irq/123-lan22:10:001
18866991918,1cyclictest67750irq/123-lan00:20:221
18866991917,2cyclictest67750irq/123-lan23:46:321
18866991917,2cyclictest67750irq/123-lan23:20:181
18866991917,2cyclictest67750irq/123-lan22:30:151
18866991917,2cyclictest67750irq/123-lan22:00:141
18866991916,3cyclictest67750irq/123-lan21:16:131
18866991915,1cyclictest67750irq/123-lan23:59:051
18866991817,1cyclictest67750irq/123-lan23:25:141
18866991817,1cyclictest67750irq/123-lan22:35:151
18866991817,1cyclictest67750irq/123-lan22:27:511
18866991817,1cyclictest67750irq/123-lan22:20:161
18866991817,1cyclictest67750irq/123-lan21:57:071
18866991817,1cyclictest67750irq/123-lan00:25:101
18866991817,1cyclictest67750irq/123-lan00:10:131
18866991817,1cyclictest67750irq/123-lan00:05:151
18866991816,2cyclictest67750irq/123-lan23:51:561
18866991816,2cyclictest67750irq/123-lan23:35:101
18866991816,2cyclictest67750irq/123-lan22:48:011
18866991816,2cyclictest67750irq/123-lan21:12:561
18871991716,1cyclictest784-21snmpd22:01:482
18866991717,0cyclictest67750irq/123-lan22:16:531
18866991717,0cyclictest67750irq/123-lan20:46:091
18866991717,0cyclictest67750irq/123-lan00:16:541
18866991716,1cyclictest67750irq/123-lan23:30:181
18866991716,1cyclictest67750irq/123-lan22:40:121
18866991716,1cyclictest67750irq/123-lan22:09:291
18866991716,1cyclictest67750irq/123-lan21:00:211
18866991716,1cyclictest67750irq/123-lan20:30:161
18866991716,1cyclictest67750irq/123-lan00:30:311
18871991616,0cyclictest784-21snmpd23:51:462
18871991616,0cyclictest784-21snmpd21:49:242
18871991616,0cyclictest784-21snmpd20:18:232
18866991616,0cyclictest67750irq/123-lan22:55:271
18866991615,1cyclictest67750irq/123-lan00:00:131
18871991515,0cyclictest784-21snmpd23:13:272
18871991515,0cyclictest784-21snmpd23:08:142
18871991515,0cyclictest784-21snmpd22:37:162
18871991515,0cyclictest784-21snmpd21:18:132
18871991515,0cyclictest784-21snmpd19:57:022
18871991515,0cyclictest784-21snmpd19:10:082
18871991515,0cyclictest784-21snmpd00:22:292
18871991515,0cyclictest21179-21cat23:00:142
18871991515,0cyclictest13281-21cat21:50:132
18866991514,1cyclictest67750irq/123-lan21:20:181
18866991514,1cyclictest67750irq/123-lan19:55:141
18871991414,0cyclictest784-21snmpd23:41:382
18871991414,0cyclictest784-21snmpd22:34:402
18871991414,0cyclictest784-21snmpd21:56:482
18871991414,0cyclictest784-21snmpd21:43:572
18871991414,0cyclictest784-21snmpd21:23:112
18871991414,0cyclictest784-21snmpd21:07:492
18871991414,0cyclictest784-21snmpd19:39:432
18871991414,0cyclictest784-21snmpd19:24:342
18861991414,0cyclictest784-21snmpd21:43:000
18866991312,1cyclictest67750irq/123-lan21:05:201
18866991312,1cyclictest67750irq/123-lan20:40:131
18861991313,0cyclictest784-21snmpd23:48:220
18861991313,0cyclictest784-21snmpd21:23:040
18861991313,0cyclictest784-21snmpd21:17:370
18861991313,0cyclictest784-21snmpd20:56:070
18861991313,0cyclictest784-21snmpd20:51:250
18861991313,0cyclictest784-21snmpd19:17:540
18861991313,0cyclictest29349-21cat23:40:130
18861991313,0cyclictest19908-21cat21:25:150
18866991212,0cyclictest67750irq/123-lan20:55:351
18861991212,0cyclictest784-21snmpd20:23:230
18861991212,0cyclictest784-21snmpd20:16:200
18861991212,0cyclictest784-21snmpd00:06:070
18861991212,0cyclictest11341-21cat20:10:160
18871991111,0cyclictest784-21snmpd19:54:442
18866991111,0cyclictest67750irq/123-lan19:40:191
18866991110,1cyclictest67750irq/123-lan20:35:151
18866991110,1cyclictest67750irq/123-lan19:45:141
18861991111,0cyclictest16660-21cups-browsed00:00:020
18861991010,0cyclictest784-21snmpd20:39:480
188769998,1cyclictest784-21snmpd23:28:063
188769998,1cyclictest784-21snmpd21:55:363
188719998,1cyclictest784-21snmpd19:28:152
188719998,1cyclictest782-21lldpd19:31:312
188719996,3cyclictest762-21ntpd19:17:532
188669998,1cyclictest67750irq/123-lan20:51:361
188769988,0cyclictest782-21lldpd21:42:263
188769987,1cyclictest784-21snmpd22:56:023
188769987,1cyclictest782-21lldpd21:45:263
188769987,1cyclictest782-21lldpd19:45:033
188769987,1cyclictest526-21avahi-daemon22:30:563
188719988,0cyclictest784-21snmpd00:34:532
188719988,0cyclictest784-21snmpd00:07:462
188719988,0cyclictest782-21lldpd20:57:042
188719987,1cyclictest784-21snmpd22:50:022
188719987,1cyclictest784-21snmpd20:11:232
188719987,1cyclictest507-21systemd-resolve22:24:312
188719986,2cyclictest762-21ntpd20:45:332
188719986,2cyclictest762-21ntpd20:01:072
188719985,3cyclictest4670-21cat21:10:162
188719984,3cyclictest20865-21memory00:35:142
188619988,0cyclictest784-21snmpd23:06:400
188619988,0cyclictest782-21lldpd23:15:330
188619986,2cyclictest784-21snmpd23:57:490
188619986,2cyclictest762-21ntpd21:00:360
188769977,0cyclictest784-21snmpd23:30:483
188769977,0cyclictest784-21snmpd21:54:263
188769977,0cyclictest784-21snmpd00:27:293
188769977,0cyclictest782-21lldpd23:08:133
188769976,1cyclictest784-21snmpd22:38:223
188769976,1cyclictest784-21snmpd20:39:383
188769976,1cyclictest526-21avahi-daemon22:40:483
188769976,1cyclictest25314-21fschecks_count19:25:123
188769976,1cyclictest24831-21cut21:30:133
188769975,2cyclictest784-21snmpd22:07:153
188769974,3cyclictest547-21NetworkManager22:46:393
188769973,3cyclictest5503-21ssh22:14:333
188769973,3cyclictest19109-21ssh22:26:353
188769973,3cyclictest16677-21users00:30:223
188719977,0cyclictest784-21snmpd23:18:362
188719977,0cyclictest782-21lldpd23:49:182
188719977,0cyclictest782-21lldpd21:02:442
188719976,1cyclictest32758-21gltestperf22:40:132
188719975,2cyclictest784-21snmpd22:59:472
188719975,2cyclictest784-21snmpd22:27:122
188719974,3cyclictest762-21ntpd19:41:102
188719973,3cyclictest245-20systemd-journal21:36:402
188619976,1cyclictest762-21ntpd19:33:370
188619976,1cyclictest1641-21sh21:39:400
188619975,2cyclictest762-21ntpd20:05:100
188769966,0cyclictest784-21snmpd23:03:433
188769966,0cyclictest784-21snmpd00:23:143
188769966,0cyclictest782-21lldpd22:18:063
188769966,0cyclictest782-21lldpd22:01:123
188769964,2cyclictest11603-21cut22:50:183
188769963,2cyclictest28012-21ntpq19:30:173
188769962,3cyclictest20297-21ntp_states20:30:193
188719962,3cyclictest27772-21ntpq00:10:172
188719962,3cyclictest15546-21ssh23:58:492
188719960,3cyclictest29577-21kworker/u16:0+xprtiod22:05:162
188719960,3cyclictest22320-21ssh21:27:242
188619966,0cyclictest784-21snmpd21:34:380
188619964,2cyclictest784-21snmpd23:14:270
188619964,2cyclictest762-21ntpd19:20:490
188619963,2cyclictest29482-21ssh00:11:580
188769955,0cyclictest782-21lldpd19:20:313
188769953,2cyclictest547-21NetworkManager22:20:593
188769953,2cyclictest31548-21grep19:40:153
188719955,0cyclictest782-21lldpd23:31:292
188719954,1cyclictest784-21snmpd21:30:042
188719954,1cyclictest0-21swapper/200:05:002
188719953,2cyclictest547-21NetworkManager22:12:122
188719952,2cyclictest8464-21ssh23:20:012
188719952,2cyclictest14286-21grep23:25:152
188719952,2cyclictest1414-21grep19:45:142
188719952,2cyclictest11888-21ssh00:25:452
188719951,3cyclictest3720-21ssh00:19:122
188619953,2cyclictest547-21NetworkManager23:52:110
188619952,2cyclictest20601-21cat20:30:210
188769942,2cyclictest11439-21wc20:10:163
188719943,1cyclictest421ktimers/220:50:152
188669941,2cyclictest17818-21basename20:25:131
188619943,1cyclictest0-21swapper/019:25:180
188769930,3cyclictest13217-21fw_conntrack20:15:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional