You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 20:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue May 05, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
180826959,0sleep20-21swapper/207:19:102
2134996060,0cyclictest11087-21md0_resync09:44:231
2133994646,0cyclictest11086-21md1_resync09:44:230
176824645,0sleep00-21swapper/007:18:400
177123826,0sleep30-21swapper/307:18:433
169522621,0sleep10-21swapper/107:17:531
8305060,0irq/26-0000:00:7380-21perl12:17:103
8305060,0irq/26-0000:00:5665-21df08:52:093
8305060,0irq/26-0000:00:31205-21kthreadcore10:57:123
8305060,0irq/26-0000:00:25015-21tr12:07:153
8305060,0irq/26-0000:00:21770-21cat07:57:083
8305060,0irq/26-0000:00:19467-21perl08:17:103
8305060,0irq/26-0000:00:18649-21irqstats09:22:133
8305060,0irq/26-0000:00:17479-21if_err_eth1.311:27:103
8305060,0irq/26-0000:00:11912-21tr10:27:093
8305060,0irq/26-0000:00:0-21swapper/311:54:203
35160,0ktimersoftd/30-21swapper/310:08:063
339960,0migration/35917-21sh09:51:483
339960,0migration/35430-21sh12:14:253
339960,0migration/332620-21switchtime09:27:203
339960,0migration/324196-21munin-node08:42:123
339960,0migration/319837-21sh12:03:083
339960,0migration/313913-21munin-node11:22:163
339960,0migration/310322-21sh09:34:023
21339966,0cyclictest11086-21md1_resync07:53:260
21339966,0cyclictest0-21swapper/010:13:260
21339966,0cyclictest0-21swapper/008:33:470
21339960,0cyclictest0-21swapper/012:48:530
21339960,0cyclictest0-21swapper/011:40:370
149960,0migration/023787-21unixbench_singl07:32:210
149960,0migration/021186-21sh11:09:060
149960,0migration/012756-21kthreadcore12:37:150
149960,0migration/011868-21sh11:02:300
8305050,0irq/26-0000:00:4157-21kthreadcore10:42:123
8305050,0irq/26-0000:00:3531-21cut07:42:133
8305050,0irq/26-0000:00:30728-21diskstats08:47:063
8305050,0irq/26-0000:00:27978-21ssh10:12:353
8305050,0irq/26-0000:00:27716-21sh09:42:363
8305050,0irq/26-0000:00:27132-21diskstats12:47:093
8305050,0irq/26-0000:00:26945-21if_eth010:37:113
8305050,0irq/26-0000:00:23562-21ssh10:32:193
8305050,0irq/26-0000:00:22511-21cut10:52:143
8305050,0irq/26-0000:00:22444-21sh11:11:573
8305050,0irq/26-0000:00:20614-21fschecks_count09:02:093
8305050,0irq/26-0000:00:19846-21kthreadcore12:42:153
8305050,0irq/26-0000:00:17649-21ssh10:03:503
8305050,0irq/26-0000:00:17200-21netstat10:47:153
8305050,0irq/26-0000:00:13951-21cpu11:07:083
8305050,0irq/26-0000:00:10686-21perl07:27:093
8305050,0irq/26-0000:00:1064-21cpuspeed_turbos08:27:073
8305050,0irq/26-0000:00:0-21swapper/312:27:073
8305050,0irq/26-0000:00:0-21swapper/309:11:453
8305050,0irq/26-0000:00:0-21swapper/308:37:133
8305050,0irq/26-0000:00:0-21swapper/308:22:143
35150,0ktimersoftd/30-21swapper/309:00:093
339950,0migration/37252-21df_abs07:47:083
339950,0migration/36955-21kthreadcore11:02:133
339950,0migration/34735-21kthreadcore11:37:143
339950,0migration/331809-21kthreadcore10:17:143
339950,0migration/324290-21kthreadcore11:47:133
339950,0migration/32330-21kthreadcore11:17:153
339950,0migration/318214-21munin-node07:32:113
339950,0migration/317967-21kthreadcore07:52:123
339950,0migration/315664-21kthreadcore09:37:153
339950,0migration/310822-21kthreadcore08:32:133
339950,0migration/310291-21idleruntime12:37:123
329950,0watchdog/36408-21kthreadcore07:22:143
329950,0watchdog/36314-21runrttasks08:02:023
329950,0watchdog/330701-21wc07:37:183
329950,0watchdog/321423-21memory12:22:153
329950,0watchdog/314546-21grep09:17:143
29815050,0irq/29-eth0-tx-29595-21if_err_eth110:57:102
29815050,0irq/29-eth0-tx-19963-21if_err_eth011:47:092
29815050,0irq/29-eth0-tx-1356-21kthreadcore12:12:132
29815050,0irq/29-eth0-tx-10824-21kthreadcore11:02:142
29815050,0irq/29-eth0-tx-0-21swapper/212:48:062
29815050,0irq/29-eth0-tx-0-21swapper/211:34:572
29815050,0irq/29-eth0-tx-0-21swapper/210:49:302
29815050,0irq/29-eth0-tx-0-21swapper/209:43:492
29815050,0irq/29-eth0-tx-0-21swapper/009:22:170
29815050,0irq/29-eth0-tx-0-21swapper/009:17:170
29805050,0irq/28-eth0-rx-26074-21cat11:32:103
29805050,0irq/28-eth0-rx-15698-21kthreadcore08:12:133
29805050,0irq/28-eth0-rx-11444-21interrupts11:42:123
29805050,0irq/28-eth0-rx-10481-21python11:57:193
29805050,0irq/28-eth0-rx-0-21swapper/309:58:313
29805050,0irq/28-eth0-rx-0-21swapper/309:52:003
259950,0migration/29317-21munin-node08:32:102
259950,0migration/23303-21taskset11:55:512
259950,0migration/231841-21kthreadcore09:47:142
259950,0migration/230851-21kthreadcore09:07:132
259950,0migration/229392-21kthreadcore09:27:122
259950,0migration/229373-21switchtime08:42:212
259950,0migration/227598-21kthreadcore10:37:132
259950,0migration/225508-21sh09:26:162
259950,0migration/224192-21sh12:42:182
259950,0migration/218817-21kthreadcore08:37:142
259950,0migration/21869-21fschecks_count11:37:102
259950,0migration/217202-21aten_r1power_po10:32:062
259950,0migration/215406-21aten_r1power_en12:22:072
259950,0migration/210705-21kthreadcore12:17:142
249950,0watchdog/212699-21perl09:37:102
249950,0watchdog/20-21swapper/212:07:152
21359954,0cyclictest3524-21snmpd08:05:262
21349955,0cyclictest0-21swapper/110:52:151
21349950,0cyclictest0-21swapper/109:57:231
21349950,0cyclictest0-21swapper/107:49:411
21339955,0cyclictest0-21swapper/011:28:000
21339950,0cyclictest0-21swapper/011:15:230
21339950,0cyclictest0-21swapper/010:53:470
21339950,0cyclictest0-21swapper/010:04:270
21339950,0cyclictest0-21swapper/007:48:040
179950,0migration/18449-21missed_timers07:22:151
179950,0migration/16570-21kthreadcore09:12:141
179950,0migration/16433-21taskset07:45:031
179950,0migration/130175-21latency_hist08:46:561
179950,0migration/128380-21fschecks_time11:52:101
179950,0migration/126293-21munin-node10:37:091
179950,0migration/125552-21sh09:26:241
179950,0migration/11888-21taskset12:49:311
179950,0migration/116860-21perf09:21:551
179950,0migration/110992-21munin-node07:27:121
169950,0watchdog/122563-21ntp_states11:27:151
169950,0watchdog/119633-21kthreadcore12:42:151
169950,0watchdog/10-21swapper/108:17:141
149950,0migration/07665-21idleruntime12:17:110
149950,0migration/07146-21sh11:21:210
149950,0migration/07059-21kthreadcore08:52:140
149950,0migration/031705-21timerwakeupswit11:32:210
149950,0migration/030286-21kthreadcore10:57:120
149950,0migration/030176-21latency_hist08:46:560
149950,0migration/028551-21kthreadcore08:22:140
149950,0migration/026368-21kthreadcore12:07:160
149950,0migration/02216-21kthreadcore08:02:130
149950,0migration/02215-21kthreadcore09:47:150
149950,0migration/021726-21kthreadcore11:47:120
149950,0migration/018876-21taskset09:37:590
149950,0migration/018619-21aten_r1power_cu08:17:070
149950,0migration/015126-21kthreadcore08:12:130
149950,0migration/013482-21kthreadcore10:47:120
149950,0migration/011209-21kthreadcore09:57:130
149950,0migration/01116-21sh09:28:510
8305040,0irq/26-0000:00:0-21swapper/312:32:143
339940,0migration/33692-21irqcore09:12:133
329940,0watchdog/30-21swapper/310:21:593
29815040,0irq/29-eth0-tx-16845-21diskmemload11:57:022
29815040,0irq/29-eth0-tx-0-21swapper/212:36:582
29815040,0irq/29-eth0-tx-0-21swapper/212:03:282
29815040,0irq/29-eth0-tx-0-21swapper/211:42:002
29815040,0irq/29-eth0-tx-0-21swapper/211:26:592
29815040,0irq/29-eth0-tx-0-21swapper/211:17:142
29815040,0irq/29-eth0-tx-0-21swapper/211:08:062
29815040,0irq/29-eth0-tx-0-21swapper/210:52:082
29815040,0irq/29-eth0-tx-0-21swapper/210:42:042
29815040,0irq/29-eth0-tx-0-21swapper/210:27:362
29815040,0irq/29-eth0-tx-0-21swapper/210:02:112
29815040,0irq/29-eth0-tx-0-21swapper/209:59:112
29815040,0irq/29-eth0-tx-0-21swapper/009:12:120
29815040,0irq/29-eth0-tx-0-21swapper/008:57:060
29815040,0irq/29-eth0-tx-0-21swapper/008:07:100
29815040,0irq/29-eth0-tx-0-21swapper/007:37:080
259940,0migration/27260-21munin-node08:27:172
259940,0migration/231712-21kthreadcore10:17:142
259940,0migration/228437-21kthreadcore12:27:142
259940,0migration/22564-21latency_hist09:31:552
259940,0migration/221983-21kthreadcore07:32:132
259940,0migration/221066-21kthreadcore10:07:142
259940,0migration/211229-21latency_hist08:11:552
249940,0watchdog/26235-21perl08:52:102
249940,0watchdog/231842-21irqstats08:47:102
249940,0watchdog/230903-21timerandwakeup07:37:222
249940,0watchdog/230549-21kthreadcore08:22:142
249940,0watchdog/222002-21cat08:17:142
249940,0watchdog/20-21swapper/212:32:152
21359944,0cyclictest11087-21md0_resync11:12:262
21359943,0cyclictest8716-21awk11:22:112
21359943,0cyclictest3573-21awk07:22:122
21359943,0cyclictest3554-21grep09:12:122
21359943,0cyclictest3524-21snmpd10:22:272
21359943,0cyclictest3524-21snmpd10:12:122
21359943,0cyclictest3524-21snmpd09:51:572
21359943,0cyclictest3524-21snmpd08:07:262
21359943,0cyclictest3524-21snmpd07:56:262
21359943,0cyclictest3524-21snmpd07:41:562
21359943,0cyclictest22666-21awk07:57:122
21359943,0cyclictest10827-21awk07:27:112
21359940,0cyclictest0-21swapper/209:19:332
21359940,0cyclictest0-21swapper/208:58:162
21349943,0cyclictest7761-21awk12:17:121
21349943,0cyclictest3524-21snmpd10:41:581
21349943,0cyclictest3524-21snmpd10:32:581
21349943,0cyclictest3524-21snmpd10:26:271
21349943,0cyclictest3524-21snmpd07:59:111
21349943,0cyclictest30025-21awk08:02:111
21349943,0cyclictest22530-21awk12:07:121
21349943,0cyclictest1917-21awk08:27:101
21349943,0cyclictest15350-21awk07:52:101
21349943,0cyclictest13909-21awk12:02:121
21339944,0cyclictest0-21swapper/007:43:200
21339943,0cyclictest3807-21awk09:32:120
21339943,0cyclictest3524-21snmpd10:44:580
21339943,0cyclictest3524-21snmpd08:51:120
21339943,0cyclictest32534-21sadc12:31:560
21339943,0cyclictest3250-21irqbalance09:10:020
21339943,0cyclictest31012-21awk10:17:120
21339943,0cyclictest21114-21awk09:02:110
21339943,0cyclictest18175-21awk10:32:090
179940,0migration/18435-21fschecks_time11:22:091
179940,0migration/18091-21kthreadcore08:52:141
179940,0migration/18048-21kthreadcore11:57:141
179940,0migration/1773-21kthreadcore11:17:141
179940,0migration/14019-21needreboot12:12:151
179940,0migration/130852-21kthreadcore09:27:131
179940,0migration/127406-21kthreadcore07:37:141
179940,0migration/126146-21kthreadcore12:27:131
179940,0migration/125758-21fschecks_time11:32:081
179940,0migration/121007-21kthreadcore12:22:141
179940,0migration/119472-21fschecks_count11:47:081
179940,0migration/11848-21taskset09:10:091
179940,0migration/117566-21munin-node07:32:081
179940,0migration/113993-21kthreadcore08:32:141
179940,0migration/113590-21kthreadcore12:37:151
179940,0migration/113500-21kthreadcore10:27:101
179940,0migration/110874-21kthreadcore11:02:141
169940,0watchdog/130548-21kthreadcore08:22:141
169940,0watchdog/1270112sleep109:05:501
169940,0watchdog/121837-21cut10:07:151
169940,0watchdog/10-21swapper/111:42:231
169940,0watchdog/10-21swapper/110:17:151
169940,0watchdog/10-21swapper/109:47:141
169940,0watchdog/10-21swapper/109:37:101
149940,0migration/030796-21kthreadcore10:37:140
149940,0migration/021654-21aten_r1power_po07:57:070
149940,0migration/014350-21kernelversion12:02:130
29815030,0irq/29-eth0-tx-840-21aten2.4-expect08:27:060
29805030,0irq/28-eth0-rx-0-21swapper/308:07:133
249930,0watchdog/20-21swapper/207:49:582
21359932,0cyclictest3524-21snmpd09:05:272
21349933,0cyclictest31436-21awk08:47:091
21349932,0cyclictest4969-21awk08:07:131
21349932,0cyclictest10935-21date10:46:561
21349930,0cyclictest27679-21grep11:12:141
21339933,0cyclictest9439-21awk10:27:070
21339933,0cyclictest14740-21kworker/0:011:22:130
21339933,0cyclictest0-21swapper/008:41:220
21339932,0cyclictest8776-21sensors07:22:180
21339932,0cyclictest4013-21munin-node11:57:170
21339932,0cyclictest3524-21snmpd12:43:150
21339932,0cyclictest3524-21snmpd10:24:590
21339932,0cyclictest21806-21sensors12:22:190
21339932,0cyclictest19286-21egrep10:07:090
21339932,0cyclictest11420-21if_eth1.311:42:120
21339932,0cyclictest10410-21grep07:27:090
21339930,0cyclictest6436-21diskmemload09:52:370
21339930,0cyclictest1316-21perl12:32:100
179930,0migration/16512-21runrttasks09:52:511
179930,0migration/12855-21kthreadcore12:32:151
169930,0watchdog/116845-21diskmemload10:02:071
169930,0watchdog/10-21swapper/111:37:151
169930,0watchdog/10-21swapper/111:07:071
169930,0watchdog/10-21swapper/110:57:071
169930,0watchdog/10-21swapper/110:11:591
169930,0watchdog/10-21swapper/109:32:101
169930,0watchdog/10-21swapper/108:37:141
169930,0watchdog/10-21swapper/108:12:301
149930,0migration/06002-21sh12:16:010
21339921,0cyclictest0-21swapper/011:51:560
169920,0watchdog/10-21swapper/108:56:581
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional