You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 05:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Sep 18, 2026 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
182799910501049,1cyclictest2931-21kworker/0:0+events22:46:050
182849910491048,1cyclictest32606-21kworker/1:1+events23:24:011
182799910481047,1cyclictest23670-21kworker/0:2+events22:54:310
182799910341031,3cyclictest10069-21turbostat20:14:550
182989910311030,1cyclictest29016-21kworker/3:1+events20:29:003
182929910311028,3cyclictest20232-21turbostat19:19:552
182989910301029,1cyclictest5133-21kworker/3:2+events21:19:313
182849910241023,1cyclictest32606-21kworker/1:1+events20:00:221
182989910221021,1cyclictest27649-21kworker/3:0+events22:08:143
182799910221019,3cyclictest12434-21turbostat21:24:550
182989910181018,0cyclictest10490-21kworker/3:2+events20:31:583
182989910091007,2cyclictest1988-21turbostat19:54:543
182989910081007,1cyclictest10360-21kworker/3:0+events21:23:333
182799910081006,2cyclictest1190-21turbostat23:54:550
182989910071006,1cyclictest21118-21kworker/3:1+events21:49:353
182989910061005,1cyclictest27649-21kworker/3:0+events22:16:283
182989910051005,0cyclictest5133-21kworker/3:2+events21:27:513
182989910041003,1cyclictest4655-21kworker/3:2+events21:56:383
182989910031002,1cyclictest21118-21kworker/3:1+events21:40:433
18298991000999,1cyclictest21118-21kworker/3:1+events21:31:363
1829899999998,1cyclictest21118-21kworker/3:1+events21:39:353
1829899999998,1cyclictest10490-21kworker/3:2+events20:20:223
1829899998997,1cyclictest20261-21kworker/3:0+events20:41:283
1829899998997,1cyclictest10490-21kworker/3:2+events20:15:233
1829899997996,1cyclictest2058-21kworker/3:0+events21:09:333
1829899997996,1cyclictest15525-21kworker/3:1+events22:14:333
1829899997996,1cyclictest10490-21kworker/3:2+events20:52:343
1829899996995,1cyclictest9963-21kworker/3:0+events21:54:203
1829899996995,1cyclictest29016-21kworker/3:1+events19:21:383
1829899996995,1cyclictest10490-21kworker/3:2+events20:39:253
1829899996995,1cyclictest10490-21kworker/3:2+events20:14:113
1829899995995,0cyclictest6224-21kworker/3:2+events00:12:413
1829899995994,1cyclictest6224-21kworker/3:2+events23:57:343
1829899995994,1cyclictest10490-21kworker/3:2+events20:48:393
1829899994994,0cyclictest6130-21kworker/3:1+events00:04:313
1829899993992,1cyclictest28495-21kworker/3:0+events20:56:053
1829899992991,1cyclictest6130-21kworker/3:1+events00:09:323
1827999992989,3cyclictest17444-21turbostat21:29:540
1829899991989,2cyclictest18170-21turbostat19:14:563
1829899990989,1cyclictest28495-21kworker/3:0+events21:00:213
1829899990988,2cyclictest4296-21turbostat00:29:553
1828499990988,2cyclictest301-21turbostat21:09:541
1829899989988,1cyclictest4655-21kworker/3:2+events22:01:483
1828499989987,2cyclictest31583-21kworker/1:2+events23:32:011
1829899988987,1cyclictest5133-21kworker/3:2+events21:13:413
1829899988987,1cyclictest27649-21kworker/3:0+events22:24:423
1829299988987,1cyclictest8056-21turbostat20:09:552
1829299988987,1cyclictest20971-21kworker/2:1+events23:05:442
1829299988987,1cyclictest11210-21kworker/2:3+events00:21:272
1827999988987,1cyclictest8228-21kworker/0:1+events23:01:070
1829299986985,1cyclictest20971-21kworker/2:1+events23:11:392
1829899985982,3cyclictest30332-21turbostat19:44:553
1827999984983,1cyclictest24521-21kworker/0:0+events19:25:430
1829299983982,1cyclictest11210-21kworker/2:3+events00:25:232
1827999983982,1cyclictest23670-21kworker/0:2+events22:56:070
1827999982981,1cyclictest20494-21kworker/0:1+events22:38:170
1829299981980,1cyclictest27040-21kworker/2:0+events00:16:282
1828499981980,1cyclictest16088-21kworker/1:1+events23:50:451
1827999981980,1cyclictest23670-21kworker/0:2+events00:32:320
1827999981980,1cyclictest20494-21kworker/0:1+events19:36:500
1829299980979,1cyclictest27494-21turbostat21:39:552
1827999975974,1cyclictest20494-21kworker/0:1+events19:42:550
1828499974972,2cyclictest16088-21kworker/1:1+events23:35:221
1827999974973,1cyclictest20494-21kworker/0:1+events19:30:440
1828499973972,1cyclictest32606-21kworker/1:1+events22:28:191
1828499973972,1cyclictest32606-21kworker/1:1+events19:58:151
1827999973972,1cyclictest20494-21kworker/0:1+events19:17:440
1828499972972,0cyclictest31583-21kworker/1:2+events23:26:531
1828499970969,1cyclictest32606-21kworker/1:1+events20:07:191
1828499970969,1cyclictest16088-21kworker/1:1+events23:43:421
1828499969967,2cyclictest32606-21kworker/1:1+events22:34:151
1827999969968,1cyclictest23670-21kworker/0:2+events00:36:270
1828499968967,1cyclictest32606-21kworker/1:1+events19:47:551
1828499968967,1cyclictest20063-21kworker/1:2+events19:54:121
1829899967965,2cyclictest26013-21turbostat23:14:553
1828499967965,1cyclictest31583-21kworker/1:2+events23:47:561
1829899966964,2cyclictest18286-21turbostat22:34:553
1828499966965,1cyclictest20063-21kworker/1:2+events19:13:361
1827999965964,1cyclictest23670-21kworker/0:2+events22:41:050
1828499964962,1cyclictest32606-21kworker/1:1+events23:19:331
1827999930929,1cyclictest21252-21turbostat00:14:550
1829299926924,2cyclictest8283-21turbostat22:24:552
1827999923922,1cyclictest3216-21turbostat22:19:550
1829299921919,2cyclictest9284-21turbostat00:34:542
1829899912911,1cyclictest16006-21turbostat23:04:553
1827999912911,1cyclictest18191-21turbostat20:34:550
1828499904902,2cyclictest25208-21turbostat22:09:551
1829899901899,2cyclictest32369-21turbostat19:49:553
1828499852850,2cyclictest5151-21turbostat21:49:551
1828499668665,3cyclictest8283-21turbostat22:24:551
1829299658654,4cyclictest16006-21turbostat23:04:552
1827999610607,3cyclictest22265-21turbostat19:24:560
1829899594593,1cyclictest20232-21turbostat19:19:563
1829899584581,3cyclictest1190-21turbostat23:54:553
1829899555552,3cyclictest8056-21turbostat20:09:553
1827999525524,1cyclictest18170-21turbostat19:14:560
1827999524522,2cyclictest4296-21turbostat00:29:550
1828499514512,2cyclictest30332-21turbostat19:44:551
1829299497493,3cyclictest21252-21turbostat00:14:552
1828499497495,2cyclictest26013-21turbostat23:14:551
1827999415413,2cyclictest18286-21turbostat22:34:550
18284992019,1cyclictest67750irq/123-lan21:55:201
18284991919,0cyclictest67750irq/123-lan21:31:571
18284991918,1cyclictest67750irq/123-lan22:12:571
18284991918,1cyclictest67750irq/123-lan21:00:151
18284991818,0cyclictest67750irq/123-lan23:05:051
18284991818,0cyclictest67750irq/123-lan23:00:471
18284991818,0cyclictest67750irq/123-lan21:41:521
18284991818,0cyclictest67750irq/123-lan00:16:201
18284991817,1cyclictest67750irq/123-lan23:55:161
18284991817,1cyclictest67750irq/123-lan22:16:251
18284991817,1cyclictest67750irq/123-lan22:00:191
18284991817,1cyclictest67750irq/123-lan21:35:111
18284991817,1cyclictest67750irq/123-lan21:25:121
18284991817,1cyclictest67750irq/123-lan20:50:191
18284991817,1cyclictest67750irq/123-lan00:33:361
18284991817,1cyclictest67750irq/123-lan00:29:521
18284991817,1cyclictest67750irq/123-lan00:20:131
18284991817,1cyclictest67750irq/123-lan00:05:191
18284991817,1cyclictest67750irq/123-lan00:00:131
18284991717,0cyclictest67750irq/123-lan22:50:131
18284991717,0cyclictest67750irq/123-lan21:23:501
18284991717,0cyclictest67750irq/123-lan00:11:591
18284991716,1cyclictest67750irq/123-lan22:58:061
18284991716,1cyclictest67750irq/123-lan22:40:191
18284991716,1cyclictest67750irq/123-lan21:51:561
18284991716,1cyclictest67750irq/123-lan21:18:371
18284991716,1cyclictest67750irq/123-lan21:10:051
18284991716,1cyclictest67750irq/123-lan20:15:161
18284991716,1cyclictest67750irq/123-lan19:29:541
18284991716,1cyclictest67750irq/123-lan19:15:141
18284991716,1cyclictest67750irq/123-lan00:35:121
18284991616,0cyclictest67750irq/123-lan22:35:201
18284991616,0cyclictest67750irq/123-lan20:45:191
18284991616,0cyclictest67750irq/123-lan19:30:131
18284991615,1cyclictest67750irq/123-lan22:45:321
18284991615,1cyclictest67750irq/123-lan20:35:181
18284991615,1cyclictest67750irq/123-lan20:10:161
18284991515,0cyclictest67750irq/123-lan20:30:121
18284991514,1cyclictest67750irq/123-lan19:35:111
18284991414,0cyclictest67750irq/123-lan20:20:161
18284991413,1cyclictest67750irq/123-lan20:55:111
18298991312,1cyclictest6224-21kworker/3:2+events_freezable22:54:563
18284991313,0cyclictest67750irq/123-lan20:27:171
18298991212,0cyclictest6224-21kworker/3:2+events_freezable23:15:413
18298991212,0cyclictest6224-21kworker/3:2+events_freezable22:47:073
18284991211,1cyclictest67750irq/123-lan19:20:121
18298991110,1cyclictest6224-21kworker/3:2+events23:35:293
1829899109,1cyclictest6224-21kworker/3:2+events_freezable00:37:563
18298991010,0cyclictest784-21snmpd23:42:273
18298991010,0cyclictest6224-21kworker/3:2+events_freezable23:26:413
18298991010,0cyclictest6224-21kworker/3:2+events_freezable22:40:193
18298991010,0cyclictest6224-21kworker/3:2+events_freezable22:36:413
18298991010,0cyclictest6224-21kworker/3:2+events_freezable22:27:393
18298991010,0cyclictest6224-21kworker/3:2+events_freezable00:17:113
1828499109,1cyclictest67750irq/123-lan20:40:211
182989999,0cyclictest784-21snmpd23:33:153
182989999,0cyclictest784-21snmpd22:59:083
182989999,0cyclictest29016-21kworker/3:1+events_freezable19:39:373
182989998,1cyclictest6224-21kworker/3:2+events_freezable23:20:123
182989998,1cyclictest6224-21kworker/3:2+events_freezable23:05:163
182989998,1cyclictest526-21avahi-daemon00:32:383
182929996,3cyclictest762-21ntpd21:34:592
182929996,3cyclictest762-21ntpd21:26:392
182799998,1cyclictest507-21systemd-resolve23:19:390
182989988,0cyclictest784-21snmpd23:46:153
182929988,0cyclictest784-21snmpd19:50:192
182929987,1cyclictest782-21lldpd22:00:212
182929987,1cyclictest526-21avahi-daemon23:56:192
182929986,2cyclictest784-21snmpd22:47:432
182929986,2cyclictest784-21snmpd20:21:082
182929986,2cyclictest762-21ntpd23:46:202
182929986,2cyclictest762-21ntpd23:37:592
182929986,2cyclictest762-21ntpd23:28:492
182929986,2cyclictest762-21ntpd23:20:182
182929986,2cyclictest762-21ntpd23:17:482
182929986,2cyclictest762-21ntpd22:59:422
182929986,2cyclictest762-21ntpd22:50:102
182929986,2cyclictest762-21ntpd22:40:182
182929986,2cyclictest762-21ntpd22:38:522
182929986,2cyclictest762-21ntpd22:26:502
182929986,2cyclictest762-21ntpd22:16:322
182929986,2cyclictest762-21ntpd22:10:212
182929986,2cyclictest762-21ntpd21:45:372
182929986,2cyclictest762-21ntpd21:43:492
182929986,2cyclictest762-21ntpd21:21:512
182929986,2cyclictest762-21ntpd21:15:392
182929986,2cyclictest762-21ntpd20:10:152
182929986,2cyclictest762-21ntpd00:03:392
182929986,2cyclictest15982-21cat21:55:152
182799988,0cyclictest784-21snmpd00:03:280
182799988,0cyclictest782-21lldpd21:15:080
182799988,0cyclictest782-21lldpd21:05:400
182799987,1cyclictest784-21snmpd21:52:470
182799987,1cyclictest782-21lldpd23:56:400
182799987,1cyclictest762-21ntpd21:11:400
182799986,2cyclictest784-21snmpd21:41:170
182989977,0cyclictest6224-21kworker/3:2+events_freezable00:20:023
182989976,1cyclictest782-21lldpd19:30:183
182989976,1cyclictest29016-21kworker/3:1+events_freezable19:25:193
182989975,2cyclictest762-21ntpd19:55:233
182929977,0cyclictest784-21snmpd20:51:482
182929977,0cyclictest782-21lldpd20:47:282
182929977,0cyclictest782-21lldpd19:11:562
182929976,1cyclictest784-21snmpd20:16:082
182929976,1cyclictest762-21ntpd23:52:072
182929975,2cyclictest784-21snmpd20:40:332
182929975,2cyclictest762-21ntpd23:41:372
182929975,2cyclictest762-21ntpd23:30:132
182929975,2cyclictest762-21ntpd22:31:122
182929975,2cyclictest762-21ntpd21:54:232
182929975,2cyclictest762-21ntpd21:11:512
182929975,2cyclictest762-21ntpd00:36:142
182929975,2cyclictest762-21ntpd00:07:152
182929975,2cyclictest25651-21tr22:05:112
182799977,0cyclictest784-21snmpd23:35:480
182799977,0cyclictest784-21snmpd23:24:120
182799977,0cyclictest782-21lldpd23:47:060
182799976,1cyclictest784-21snmpd21:33:020
182799976,1cyclictest784-21snmpd19:48:100
182799976,1cyclictest782-21lldpd20:24:330
182799976,1cyclictest526-21avahi-daemon20:07:040
182799975,2cyclictest784-21snmpd21:48:080
182799975,2cyclictest784-21snmpd20:56:360
182799975,2cyclictest784-21snmpd20:28:230
182799975,2cyclictest762-21ntpd21:55:170
182799974,2cyclictest9755-21ntpq23:25:160
182799973,3cyclictest245-20systemd-journal23:42:190
182989965,1cyclictest762-21ntpd20:00:513
182929965,1cyclictest784-21snmpd19:24:422
182929965,1cyclictest526-21avahi-daemon21:03:072
182929963,2cyclictest29787-21ntpq20:55:162
182799966,0cyclictest784-21snmpd19:56:420
182799966,0cyclictest782-21lldpd21:36:240
182799966,0cyclictest526-21avahi-daemon21:03:090
182799965,1cyclictest782-21lldpd20:03:510
182799965,1cyclictest526-21avahi-daemon20:35:170
182799965,1cyclictest12461-21sh22:23:490
182799964,2cyclictest784-21snmpd20:53:570
182799964,2cyclictest784-21snmpd00:18:550
182799963,3cyclictest547-21NetworkManager20:16:040
182799963,2cyclictest15905-21ssh23:31:040
182799962,3cyclictest3968-21ssh00:24:320
182799962,3cyclictest3096-21ssh22:14:500
182799962,3cyclictest28257-21ssh23:10:590
182799962,3cyclictest25005-21awk20:45:120
182799962,3cyclictest17887-21sed00:05:230
182929955,0cyclictest507-21systemd-resolve19:41:042
182929954,1cyclictest762-21ntpd20:25:162
182929953,2cyclictest784-21snmpd19:37:122
182929953,2cyclictest762-21ntpd20:02:112
182929953,2cyclictest547-21NetworkManager20:35:172
182929952,2cyclictest27839-21sed19:30:202
182929950,4cyclictest1046-21ntpq19:45:172
182799953,2cyclictest547-21NetworkManager22:26:500
182799953,2cyclictest547-21NetworkManager22:01:270
182799952,2cyclictest24132-21ssh23:07:150
182799951,3cyclictest2704-21irqstats19:50:140
182799951,3cyclictest26316-21ld22:05:150
182799950,4cyclictest23717-21ntpq20:40:170
182929941,3cyclictest547-21NetworkManager21:06:232
182929941,3cyclictest547-21NetworkManager19:55:362
182929941,2cyclictest25328-21ld19:25:172
182929941,2cyclictest19045-21df20:30:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional