You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 19:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Fri May 29, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450550,0irq/25-eth10-21swapper/306:50:053
1402323927,0sleep20-21swapper/206:51:072
1394123724,0sleep00-21swapper/006:50:090
1427123525,0sleep10-21swapper/106:53:581
35160,0ktimersoftd/30-21swapper/309:49:063
339960,0migration/36793-21sh12:22:433
339960,0migration/323139-21sh09:12:493
339960,0migration/316427-21sh09:26:243
339960,0migration/315175-21sh11:06:073
29725060,0irq/27-eth0-tx-10040-21munin-node08:44:250
29715060,0irq/26-eth0-rx-31169-21seq11:16:013
29715060,0irq/26-eth0-rx-16002-21munin-run11:29:133
29715060,0irq/26-eth0-rx-0-21swapper/312:03:393
27160,0ktimersoftd/20-21swapper/210:57:032
143649960,0cyclictest0-21swapper/209:36:582
143649960,0cyclictest0-21swapper/209:18:312
149960,0migration/030823-21timerwakeupswit10:54:350
149960,0migration/016002-21munin-run11:29:130
339950,0migration/3885-21kthreadcore07:14:313
339950,0migration/3826-21munin-node07:59:253
339950,0migration/33733-21kthreadcore09:39:303
339950,0migration/326716-21munin-node09:54:303
339950,0migration/325768-21kthreadcore11:34:303
339950,0migration/321777-21latency_hist07:04:143
339950,0migration/319756-21kthreadcore06:54:293
339950,0migration/318529-21taskset07:43:013
339950,0migration/315841-21fschecks_time08:19:263
339950,0migration/315013-21munin-node10:04:323
339950,0migration/314889-21munin-node10:24:343
29725050,0irq/27-eth0-tx-8217-21munin-node11:24:362
29725050,0irq/27-eth0-tx-7719-21ssh10:20:532
29725050,0irq/27-eth0-tx-31258-21ssh11:37:062
29725050,0irq/27-eth0-tx-23255-21awk09:29:372
29725050,0irq/27-eth0-tx-17593-21munin-node09:49:292
29725050,0irq/27-eth0-tx-16264-21munin-node11:29:272
29725050,0irq/27-eth0-tx-15743-21sed09:24:372
29725050,0irq/27-eth0-tx-15555-21sed12:09:132
29725050,0irq/27-eth0-tx-11936-21kthreadcore11:44:302
29725050,0irq/27-eth0-tx-0-21swapper/212:21:132
29725050,0irq/27-eth0-tx-0-21swapper/210:49:282
29725050,0irq/27-eth0-tx-0-21swapper/210:45:322
29725050,0irq/27-eth0-tx-0-21swapper/210:35:302
29725050,0irq/27-eth0-tx-0-21swapper/210:30:542
29725050,0irq/27-eth0-tx-0-21swapper/008:49:280
29725050,0irq/27-eth0-tx-0-21swapper/007:04:180
29715050,0irq/26-eth0-rx-8446-21if_eth1.309:04:283
29715050,0irq/26-eth0-rx-556-21fschecks_count11:19:263
29715050,0irq/26-eth0-rx-31488-21ssh08:59:193
29715050,0irq/26-eth0-rx-27088-21kthreadcore10:54:283
29715050,0irq/26-eth0-rx-24000-21aten_r1power_fr09:14:243
29715050,0irq/26-eth0-rx-23937-21ssh09:29:533
29715050,0irq/26-eth0-rx-21932-21vmstat12:09:363
29715050,0irq/26-eth0-rx-20646-21kthreadcore07:44:303
29715050,0irq/26-eth0-rx-17668-21hostname10:49:273
29715050,0irq/26-eth0-rx-17132-21munin-node10:29:293
29715050,0irq/26-eth0-rx-15473-21ssh10:45:573
29715050,0irq/26-eth0-rx-0-21swapper/312:17:413
29715050,0irq/26-eth0-rx-0-21swapper/312:06:373
29715050,0irq/26-eth0-rx-0-21swapper/311:29:253
29715050,0irq/26-eth0-rx-0-21swapper/311:09:293
29715050,0irq/26-eth0-rx-0-21swapper/310:59:203
29715050,0irq/26-eth0-rx-0-21swapper/310:37:293
29715050,0irq/26-eth0-rx-0-21swapper/310:20:543
29715050,0irq/26-eth0-rx-0-21swapper/310:09:573
29715050,0irq/26-eth0-rx-0-21swapper/309:49:303
29715050,0irq/26-eth0-rx-0-21swapper/309:36:473
29715050,0irq/26-eth0-rx-0-21swapper/309:19:293
29715050,0irq/26-eth0-rx-0-21swapper/308:56:283
259950,0migration/2921-21latency_hist10:19:132
259950,0migration/27918-21sh09:40:322
259950,0migration/26376-21sh09:02:142
259950,0migration/25316-21kthreadcore09:19:312
259950,0migration/229129-21latency_hist07:14:142
259950,0migration/227013-21kthreadcore12:14:312
259950,0migration/226183-21kthreadcore11:14:312
259950,0migration/220528-21kthreadcore11:09:292
259950,0migration/214083-21munin-node11:04:332
249950,0watchdog/217173-21kthreadcore06:54:292
249950,0watchdog/215516-21unixbench_singl10:04:362
179950,0migration/17139-21sh09:59:351
179950,0migration/16032-21pmu-power07:59:321
179950,0migration/131810-21taskset07:52:191
179950,0migration/130398-21taskset09:15:381
179950,0migration/129611-21kthreadcore11:14:321
179950,0migration/122933-21sh11:31:141
143649955,0cyclictest0-21swapper/211:53:202
143649955,0cyclictest0-21swapper/211:39:192
143649950,0cyclictest0-21swapper/212:10:032
143649950,0cyclictest0-21swapper/210:02:492
143649950,0cyclictest0-21swapper/209:54:192
143639955,0cyclictest0-21swapper/112:04:391
143639950,0cyclictest23170-21diskmemload09:10:541
143639950,0cyclictest0-21swapper/112:00:421
143639950,0cyclictest0-21swapper/111:06:091
143639950,0cyclictest0-21swapper/110:08:181
143639950,0cyclictest0-21swapper/109:51:351
143639950,0cyclictest0-21swapper/109:00:211
143629955,0cyclictest0-21swapper/010:11:540
149950,0migration/07021-21sh11:00:410
149950,0migration/05195-21kthreadcore09:19:310
149950,0migration/05037-21netstat12:19:310
149950,0migration/04666-21kthreadcore07:59:290
149950,0migration/031326-21switchtime10:14:340
149950,0migration/030701-21kthreadcore07:14:300
149950,0migration/030271-21kthreadcore09:34:310
149950,0migration/030027-21munin-node08:34:280
149950,0migration/022438-21munin-node10:49:330
149950,0migration/021756-21latency_hist08:24:140
149950,0migration/021756-21latency_hist08:24:140
149950,0migration/021356-21missed_timers11:49:310
149950,0migration/018893-21aten_r1power_cu07:44:250
149950,0migration/01840-21fschecks_count09:59:270
149950,0migration/018356-21kthreadcore11:29:290
149950,0migration/017490-21kthreadcore08:19:290
149950,0migration/012413-21kthreadcore09:44:290
149950,0migration/010621-21kthreadcore11:04:300
8215040,0irq/24-0000:00:0-21swapper/207:59:142
339940,0migration/37675-21kthreadcore07:24:303
339940,0migration/322704-21sh11:51:293
339940,0migration/310416-21kthreadcore08:09:303
29725040,0irq/27-eth0-tx-7443-21munin-node09:04:282
29725040,0irq/27-eth0-tx-22460-21tail08:29:210
29725040,0irq/27-eth0-tx-0-21swapper/211:54:162
29725040,0irq/27-eth0-tx-0-21swapper/210:24:262
29725040,0irq/27-eth0-tx-0-21swapper/210:09:212
29725040,0irq/27-eth0-tx-0-21swapper/008:54:200
29715040,0irq/26-eth0-rx-0-21swapper/311:54:573
29715040,0irq/26-eth0-rx-0-21swapper/311:44:363
29715040,0irq/26-eth0-rx-0-21swapper/311:39:433
29715040,0irq/26-eth0-rx-0-21swapper/310:40:173
29715040,0irq/26-eth0-rx-0-21swapper/310:14:233
29715040,0irq/26-eth0-rx-0-21swapper/309:59:303
259940,0migration/26990-21runrttasks10:39:442
259940,0migration/25525-21kthreadcore08:39:302
259940,0migration/224547-21kthreadcore08:29:262
259940,0migration/215695-21taskset09:09:192
259940,0migration/21212-21irqcore11:19:282
259940,0migration/211567-21kthreadcore08:44:292
179940,0migration/17802-21df_abs09:04:251
179940,0migration/16789-21kthreadcore09:19:311
179940,0migration/15316-21kthreadcore08:39:301
179940,0migration/1338-21kthreadcore08:34:301
179940,0migration/128658-21taskset07:10:201
179940,0migration/128042-21kthreadcore12:14:311
179940,0migration/125504-21kthreadcore08:29:271
179940,0migration/12497-21kthreadcore10:19:301
179940,0migration/121577-21kthreadcore09:29:351
179940,0migration/121088-21kthreadcore10:49:311
179940,0migration/118812-21kthreadcore06:54:291
179940,0migration/117004-21cpuspeed_turbos08:49:261
179940,0migration/112770-21kthreadcore08:09:321
179940,0migration/11094-21irqrtprio11:39:281
179940,0migration/110028-21kthreadcore11:44:291
169940,0watchdog/130350-21taskset11:55:191
169940,0watchdog/122644-21sh11:09:361
169940,0watchdog/122147-21ssh12:10:111
169940,0watchdog/118809-21kthreadcore10:09:321
169940,0watchdog/1182882sleep107:40:161
169940,0watchdog/117939-21grep10:29:281
169940,0watchdog/10-21swapper/111:49:271
169940,0watchdog/10-21swapper/109:44:161
169940,0watchdog/10-21swapper/109:26:081
143649943,0cyclictest380-21awk11:59:262
143649943,0cyclictest3514-21snmpd09:44:252
143649943,0cyclictest3514-21snmpd08:34:392
143649943,0cyclictest3514-21snmpd08:25:092
143649943,0cyclictest3514-21snmpd08:25:092
143649943,0cyclictest3514-21snmpd08:19:242
143649943,0cyclictest3514-21snmpd07:44:392
143649943,0cyclictest26446-21awk07:49:282
143649943,0cyclictest24264-21awk08:54:282
143649943,0cyclictest22723-21awk07:04:292
143649943,0cyclictest17598-21awk08:49:292
143649943,0cyclictest1312-21awk10:59:262
143639944,0cyclictest0-21swapper/110:36:591
143639943,0cyclictest3514-21snmpd11:19:261
143639943,0cyclictest3514-21snmpd10:54:251
143639943,0cyclictest3514-21snmpd10:49:101
143639943,0cyclictest3514-21snmpd10:27:251
143639943,0cyclictest3514-21snmpd10:16:101
143639943,0cyclictest3514-21snmpd07:31:081
143639943,0cyclictest3514-21snmpd07:27:381
143639943,0cyclictest3241-21irqbalance12:21:111
143639943,0cyclictest30091-21awk07:14:281
143639943,0cyclictest26613-21awk09:34:281
143639943,0cyclictest25141-21awk11:34:281
143639943,0cyclictest1390-21awk10:59:261
143639943,0cyclictest10997-21awk08:44:281
143629944,0cyclictest0-21swapper/011:44:170
143629944,0cyclictest0-21swapper/009:14:120
143629943,0cyclictest465-21awk11:59:270
143629943,0cyclictest3556-21lldpd11:44:020
143629943,0cyclictest3556-21lldpd10:24:310
143629943,0cyclictest3514-21snmpd08:59:240
143629943,0cyclictest3241-21irqbalance12:09:110
143629943,0cyclictest3241-21irqbalance11:19:520
143629943,0cyclictest3241-21irqbalance10:44:220
143629943,0cyclictest3241-21irqbalance10:39:220
143629943,0cyclictest3241-21irqbalance10:39:020
143629943,0cyclictest3241-21irqbalance09:14:220
143629943,0cyclictest28289-21kworker/0:009:31:050
143629943,0cyclictest28289-21kworker/0:008:14:290
143629943,0cyclictest28289-21kworker/0:007:01:020
143629943,0cyclictest26416-21awk07:49:270
143629943,0cyclictest25414-21awk11:14:290
143629943,0cyclictest16690-21awk12:09:270
149940,0migration/05039-21kthreadcore08:39:300
149940,0migration/027997-21kthreadcore12:14:310
149940,0migration/02342-21irqrtprio10:19:300
149940,0migration/021890-21kthreadcore09:49:310
149940,0migration/014092-21kthreadcore10:04:300
149940,0migration/010946-21irqrtprio09:24:300
339930,0migration/327087-21kthreadcore07:49:293
339930,0migration/320287-21kthreadcore08:49:313
29715030,0irq/26-eth0-rx-0-21swapper/308:46:263
29715030,0irq/26-eth0-rx-0-21swapper/308:39:283
29715030,0irq/26-eth0-rx-0-21swapper/308:34:243
29715030,0irq/26-eth0-rx-0-21swapper/308:16:273
29715030,0irq/26-eth0-rx-0-21swapper/307:35:353
29715030,0irq/26-eth0-rx-0-21swapper/307:21:283
29715030,0irq/26-eth0-rx-0-21swapper/307:06:443
179930,0migration/17335-21runrttasks08:05:491
169930,0watchdog/10-21swapper/109:39:361
169930,0watchdog/10-21swapper/108:54:561
143649933,0cyclictest0-21swapper/207:34:282
143649932,0cyclictest7782-21ls08:09:142
143649932,0cyclictest5594-21kthreadcore07:24:302
143649932,0cyclictest3514-21snmpd08:14:542
143649932,0cyclictest30145-21awk07:14:282
143649930,0cyclictest0-21swapper/207:32:532
143649930,0cyclictest0-21swapper/206:59:152
143639932,0cyclictest3514-21snmpd11:25:561
143639932,0cyclictest3514-21snmpd10:40:101
143639932,0cyclictest3514-21snmpd07:46:391
143639932,0cyclictest26538-21awk09:54:281
143639932,0cyclictest12511-21awk07:34:251
143629933,0cyclictest28289-21kworker/0:011:54:170
143629933,0cyclictest28289-21kworker/0:011:34:150
143629933,0cyclictest28289-21kworker/0:011:09:150
143629933,0cyclictest28289-21kworker/0:010:29:150
143629933,0cyclictest28289-21kworker/0:009:54:150
143629933,0cyclictest28289-21kworker/0:009:39:150
143629933,0cyclictest28289-21kworker/0:009:04:150
143629933,0cyclictest28289-21kworker/0:008:09:150
143629933,0cyclictest28289-21kworker/0:008:04:170
143629933,0cyclictest28289-21kworker/0:007:54:230
143629933,0cyclictest28289-21kworker/0:007:39:440
143629933,0cyclictest28289-21kworker/0:007:34:160
143629933,0cyclictest28289-21kworker/0:007:29:160
143629933,0cyclictest28289-21kworker/0:007:19:280
143629933,0cyclictest28289-21kworker/0:007:09:180
143629933,0cyclictest28289-21kworker/0:006:54:160
143629930,0cyclictest0-21swapper/007:24:350
339920,0migration/322830-21diskstats08:29:233
29715020,0irq/26-eth0-rx-0-21swapper/308:24:153
29715020,0irq/26-eth0-rx-0-21swapper/308:24:153
29715020,0irq/26-eth0-rx-0-21swapper/308:04:503
29715020,0irq/26-eth0-rx-0-21swapper/307:54:253
29715020,0irq/26-eth0-rx-0-21swapper/307:29:153
29715020,0irq/26-eth0-rx-0-21swapper/307:09:443
249920,0watchdog/20-21swapper/207:54:162
249920,0watchdog/20-21swapper/207:39:162
249920,0watchdog/20-21swapper/207:19:322
169920,0watchdog/10-21swapper/108:14:161
169920,0watchdog/10-21swapper/107:54:161
169920,0watchdog/10-21swapper/107:19:161
143649920,0cyclictest0-21swapper/208:04:182
143639921,0cyclictest0-21swapper/108:24:141
143639921,0cyclictest0-21swapper/108:24:141
143639920,0cyclictest0-21swapper/108:19:141
143639920,0cyclictest0-21swapper/107:04:161
143639920,0cyclictest0-21swapper/106:59:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional