You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 18:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Thu Mar 19, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
191380,0ktimersoftd/13111-21perf07:17:521
1024123627,0sleep30-21swapper/307:17:263
1018823423,0sleep00-21swapper/007:16:420
1012923329,0sleep20-21swapper/207:16:042
339960,0migration/38306-21kthreadcore11:38:183
339960,0migration/325707-21sh11:08:473
29805060,0irq/28-eth0-rx-23557-21ssh10:49:043
29805060,0irq/28-eth0-rx-23407-21df10:33:143
27160,0ktimersoftd/20-21swapper/209:29:142
259960,0migration/212361-21latency_hist11:23:032
19160,0ktimersoftd/10-21swapper/109:29:141
179960,0migration/124804-21latency_hist07:28:021
149960,0migration/014429-21idleruntime-cro11:43:030
103729965,0cyclictest2394-21grep12:13:142
103719965,0cyclictest19553-21irqstats08:08:181
103719960,0cyclictest0-21swapper/111:04:151
103709960,0cyclictest0-21swapper/009:08:170
8305050,0irq/26-0000:00:31683-21idleruntime-cro11:53:032
339950,0migration/3580-21kthreadcore09:23:193
339950,0migration/35680-21smart_sdb10:38:253
339950,0migration/33893-21aten2.4-expect08:43:133
339950,0migration/3340-21fschecks_time11:53:163
339950,0migration/332672-21kthreadcore09:58:203
339950,0migration/332069-21latency_hist07:33:023
339950,0migration/332025-21kthreadcore08:38:193
339950,0migration/331147-21kthreadcore11:13:193
339950,0migration/330999-21kthreadcore10:53:213
339950,0migration/328068-21munin-node09:18:203
339950,0migration/327917-21sh10:14:393
339950,0migration/325323-21taskset09:53:313
339950,0migration/324213-21kthreadcore07:48:183
339950,0migration/321327-21unixbench_multi09:13:283
339950,0migration/321289-21kthreadcore07:23:203
339950,0migration/321178-21munin-node11:28:133
339950,0migration/320584-21irqrtprio12:23:183
339950,0migration/317582-21kthreadcore10:28:203
339950,0migration/314938-21diskmemload11:23:203
339950,0migration/314354-21taskset09:10:023
339950,0migration/313811-21kthreadcore08:03:183
339950,0migration/311446-21taskset11:21:003
339950,0migration/310116-21aten_r1power_po09:48:143
329950,0watchdog/34383-21df12:33:143
329950,0watchdog/33453-21cut12:13:183
329950,0watchdog/331607-21sh11:52:543
329950,0watchdog/319168-21if_eth1.308:08:173
329950,0watchdog/317164-21if_err_eth109:33:173
329950,0watchdog/315003-21expr11:43:143
329950,0watchdog/313041-21df_abs12:38:143
329950,0watchdog/31234-21kthreadcore07:53:213
329950,0watchdog/31065-21munin-node08:18:173
329950,0watchdog/310182-21ssh10:03:293
329950,0watchdog/30-21swapper/308:58:133
29815050,0irq/29-eth0-tx-4766-21perl12:33:152
29815050,0irq/29-eth0-tx-26828-21irqstats10:53:192
29815050,0irq/29-eth0-tx-21828-21tune2fs12:43:152
29815050,0irq/29-eth0-tx-21743-21munin-node08:33:140
29815050,0irq/29-eth0-tx-1741-21cpu10:58:162
29815050,0irq/29-eth0-tx-15361-21ssh11:59:302
29815050,0irq/29-eth0-tx-14852-21munin-node09:13:220
29815050,0irq/29-eth0-tx-11095-21munin-node08:48:140
29815050,0irq/29-eth0-tx-10690-21df_inode11:03:142
29815050,0irq/29-eth0-tx-0-21swapper/211:43:172
29815050,0irq/29-eth0-tx-0-21swapper/211:38:082
29815050,0irq/29-eth0-tx-0-21swapper/211:36:362
29815050,0irq/29-eth0-tx-0-21swapper/210:18:252
29815050,0irq/29-eth0-tx-0-21swapper/009:03:150
29815050,0irq/29-eth0-tx-0-21swapper/008:13:210
29815050,0irq/29-eth0-tx-0-21swapper/007:55:340
29815050,0irq/29-eth0-tx-0-21swapper/007:40:300
29805050,0irq/28-eth0-rx-5096-21ssh11:36:203
29805050,0irq/28-eth0-rx-4164-21kthreadcore09:43:183
29805050,0irq/28-eth0-rx-3669-21cut10:58:213
29805050,0irq/28-eth0-rx-31814-21yum08:13:283
29805050,0irq/28-eth0-rx-3162-21open_inodes10:18:213
29805050,0irq/28-eth0-rx-27383-21kthreadcore12:08:203
29805050,0irq/28-eth0-rx-25044-21tr12:43:193
29805050,0irq/28-eth0-rx-18447-21sshd11:07:393
29805050,0irq/28-eth0-rx-0-21swapper/312:03:213
29805050,0irq/28-eth0-rx-0-21swapper/312:00:163
29805050,0irq/28-eth0-rx-0-21swapper/310:44:383
29805050,0irq/28-eth0-rx-0-21swapper/310:24:083
29805050,0irq/28-eth0-rx-0-21swapper/310:10:033
29805050,0irq/28-eth0-rx-0-21swapper/309:33:003
259950,0migration/28063-21munin-node07:38:142
259950,0migration/25067-21kernelversion10:03:182
259950,0migration/23812-21latency_hist08:43:022
259950,0migration/232441-21kthreadcore09:58:202
259950,0migration/231611-21timerwakeupswit08:13:262
259950,0migration/227566-21sh10:13:402
259950,0migration/225745-21cpuspeed_turbos08:58:142
259950,0migration/223772-21sh12:03:512
259950,0migration/215513-21taskset08:28:152
259950,0migration/212669-21taskset10:24:052
19150,0ktimersoftd/10-21swapper/111:33:431
19150,0ktimersoftd/10-21swapper/110:04:101
179950,0migration/17679-21aten_r1power_en09:08:131
179950,0migration/14006-21kthreadcore10:38:201
179950,0migration/128182-21unixbench-2d08:33:271
179950,0migration/119783-21fschecks_count12:23:151
179950,0migration/118478-21missed_timers11:23:221
149950,0migration/06276-21timerwakeupswit07:33:270
149950,0migration/05691-21kthreadcore10:03:180
149950,0migration/031688-21idleruntime-cro11:53:030
149950,0migration/028338-21sh09:58:170
149950,0migration/026720-21irqrtprio10:53:190
149950,0migration/02507-21gltestperf10:58:180
149950,0migration/024600-21latency_hist09:38:020
149950,0migration/022877-21kthreadcore12:43:180
149950,0migration/021542-21kthreadcore12:03:210
149950,0migration/018249-21latency_hist08:53:020
149950,0migration/018096-21cpuspeed_turbos07:23:140
149950,0migration/017102-21fschecks_count10:48:140
149950,0migration/015662-21sh12:00:210
149950,0migration/010387-21timerwakeupswit11:18:260
103729955,0cyclictest0-21swapper/209:43:182
103729950,0cyclictest0-21swapper/210:43:222
103719955,0cyclictest0-21swapper/112:33:191
103719955,0cyclictest0-21swapper/111:47:551
103719955,0cyclictest0-21swapper/111:14:101
103719950,0cyclictest0-21swapper/111:28:031
103719950,0cyclictest0-21swapper/110:09:511
103709950,0cyclictest0-21swapper/011:45:090
103709950,0cyclictest0-21swapper/011:04:380
8305040,0irq/26-0000:00:0-21swapper/211:08:192
8305040,0irq/26-0000:00:0-21swapper/209:13:022
339940,0migration/37081-21taskset09:04:383
339940,0migration/310732-21kthreadcore08:23:193
329940,0watchdog/39852-21smartctl07:58:253
329940,0watchdog/315743-21irqcore08:28:173
329940,0watchdog/30-21swapper/312:20:303
329940,0watchdog/30-21swapper/308:33:133
29815040,0irq/29-eth0-tx-24802-21ssh09:38:072
29815040,0irq/29-eth0-tx-2340-21cat11:53:202
29815040,0irq/29-eth0-tx-21532-21munin-node07:48:200
29815040,0irq/29-eth0-tx-14426-21aten_r1power_en10:28:132
29815040,0irq/29-eth0-tx-13975-21kthreadcore10:08:202
29815040,0irq/29-eth0-tx-12074-21ssh12:18:192
29815040,0irq/29-eth0-tx-0-21swapper/211:29:332
29815040,0irq/29-eth0-tx-0-21swapper/210:33:382
29815040,0irq/29-eth0-tx-0-21swapper/209:54:032
29815040,0irq/29-eth0-tx-0-21swapper/209:48:092
29815040,0irq/29-eth0-tx-0-21swapper/209:33:042
29815040,0irq/29-eth0-tx-0-21swapper/009:18:100
29815040,0irq/29-eth0-tx-0-21swapper/008:08:120
29805040,0irq/28-eth0-rx-0-21swapper/312:28:193
29805040,0irq/28-eth0-rx-0-21swapper/309:38:333
259940,0migration/23661-21kthreadcore09:23:202
259940,0migration/229684-21kthreadcore12:08:212
259940,0migration/225690-21fschecks_time07:28:142
259940,0migration/225137-21kthreadcore09:18:182
259940,0migration/217430-21runrttasks07:21:342
259940,0migration/216985-21kthreadcore12:38:192
259940,0migration/216726-21aten_r1power_po10:48:122
249940,0watchdog/23955-21cpu11:18:132
249940,0watchdog/227722-21munin-node12:28:142
249940,0watchdog/227686-21cpu11:13:132
249940,0watchdog/20-21swapper/209:03:172
179940,0migration/1984-21kthreadcore07:53:211
179940,0migration/17897-21kthreadcore11:38:181
179940,0migration/14504-21kthreadcore12:13:181
179940,0migration/13671-21runrttasks07:58:131
179940,0migration/130915-21kthreadcore12:28:181
179940,0migration/126246-21kthreadcore10:33:191
179940,0migration/124172-21kthreadcore09:18:181
179940,0migration/120860-21switchtime10:28:271
179940,0migration/119179-21munin-node12:38:261
179940,0migration/117121-21fschecks_count10:48:141
179940,0migration/113169-21kthreadcore12:18:191
179940,0migration/112052-21hddtemp_smartct08:48:161
169940,0watchdog/17522-21diskstats07:38:131
169940,0watchdog/1745-21grep09:03:171
169940,0watchdog/15696-21ssh10:23:091
169940,0watchdog/132457-21ssh09:40:371
169940,0watchdog/122374-21kthreadcore09:53:211
169940,0watchdog/121850-21diskmemload11:08:051
169940,0watchdog/11510-21cpu09:43:131
169940,0watchdog/10-21swapper/111:48:541
149940,0migration/05825-21kthreadcore09:43:190
149940,0migration/031690-21sh09:23:160
149940,0migration/031254-21irqrtprio11:33:200
149940,0migration/020857-21unixbench_singl07:43:270
149940,0migration/017318-21kthreadcore11:23:210
149940,0migration/015955-21sh10:46:570
149940,0migration/015891-21kthreadcore08:03:190
149940,0migration/015267-21fschecks_time08:28:140
149940,0migration/01157-21kthreadcore10:18:180
103729943,0cyclictest8438-21awk08:23:172
103729943,0cyclictest6868-21munin-run07:38:012
103729943,0cyclictest3571-21lldpd10:39:582
103729943,0cyclictest3524-21snmpd12:23:322
103729943,0cyclictest3524-21snmpd08:33:302
103729943,0cyclictest3524-21snmpd08:18:152
103729943,0cyclictest3524-21snmpd07:46:442
103729943,0cyclictest19328-21awk08:53:172
103729943,0cyclictest11871-21awk08:03:162
103719944,0cyclictest0-21swapper/112:04:281
103719944,0cyclictest0-21swapper/111:53:541
103719944,0cyclictest0-21swapper/109:58:491
103719944,0cyclictest0-21swapper/107:48:161
103719943,0cyclictest3571-21lldpd12:02:301
103719943,0cyclictest3571-21lldpd10:15:581
103719943,0cyclictest3571-21lldpd08:56:571
103719943,0cyclictest3524-21snmpd08:28:151
103719943,0cyclictest32220-21sadc08:18:011
103719943,0cyclictest26657-21awk08:58:171
103719943,0cyclictest2623-21awk10:58:191
103719943,0cyclictest26104-21awk07:28:161
103719943,0cyclictest15960-21awk09:13:191
103719943,0cyclictest15509-21awk07:43:181
103719943,0cyclictest11181-21awk09:48:181
103709944,0cyclictest24898-21kworker/0:112:13:180
103709943,0cyclictest8004-21sadc11:58:030
103709943,0cyclictest4650-21awk07:58:160
103709943,0cyclictest3571-21lldpd08:45:570
103709943,0cyclictest32738-21awk10:38:170
103709943,0cyclictest3250-21irqbalance12:33:090
103709943,0cyclictest3250-21irqbalance12:29:290
103709943,0cyclictest3250-21irqbalance12:23:490
103709943,0cyclictest3250-21irqbalance12:22:490
103709943,0cyclictest3250-21irqbalance11:08:090
103709943,0cyclictest3250-21irqbalance10:33:090
103709943,0cyclictest3250-21irqbalance10:28:090
103709943,0cyclictest3250-21irqbalance10:23:490
103709943,0cyclictest3250-21irqbalance09:53:390
103709943,0cyclictest3250-21irqbalance09:48:090
103709943,0cyclictest3250-21irqbalance09:41:090
103709943,0cyclictest3250-21irqbalance09:32:480
103709943,0cyclictest30090-21awk08:38:170
103709943,0cyclictest13711-21awk12:38:160
103709940,0cyclictest0-21swapper/008:23:010
329930,0watchdog/30-21swapper/308:48:133
329930,0watchdog/30-21swapper/307:33:533
329930,0watchdog/30-21swapper/307:19:373
29815030,0irq/29-eth0-tx-0-21swapper/008:23:180
29815030,0irq/29-eth0-tx-0-21swapper/007:18:140
29805030,0irq/28-eth0-rx-0-21swapper/307:43:423
29805030,0irq/28-eth0-rx-0-21swapper/307:38:123
249930,0watchdog/219185-21if_eth1.308:08:172
249930,0watchdog/20-21swapper/209:08:212
249930,0watchdog/20-21swapper/207:58:172
249930,0watchdog/20-21swapper/207:53:212
169930,0watchdog/10-21swapper/111:19:371
169930,0watchdog/10-21swapper/110:53:171
169930,0watchdog/10-21swapper/110:20:171
169930,0watchdog/10-21swapper/109:33:171
169930,0watchdog/10-21swapper/108:23:131
149930,0migration/030038-21kthreadcore11:13:190
149930,0migration/027675-21sh10:13:580
103729932,0cyclictest29995-21awk08:38:162
103729932,0cyclictest22611-21awk07:48:162
103729932,0cyclictest18980-21awk07:23:182
103729932,0cyclictest12270-21awk08:48:182
103719933,0cyclictest31767-21awk09:23:171
103719933,0cyclictest12013-21awk08:03:171
103719933,0cyclictest0-21swapper/108:38:251
103719932,0cyclictest8789-21sort10:43:151
103719932,0cyclictest846-21awk07:33:181
103719932,0cyclictest3524-21snmpd07:18:131
103719932,0cyclictest26680-21awk12:08:181
103719932,0cyclictest24574-21cut12:43:191
103719932,0cyclictest1079-21awk08:18:171
103719930,0cyclictest0-21swapper/108:44:521
103709933,0cyclictest0-21swapper/008:58:150
103709932,0cyclictest3571-21lldpd11:29:300
103709932,0cyclictest3571-21lldpd07:28:270
103709932,0cyclictest3250-21irqbalance10:08:190
103709932,0cyclictest28041-21kthreadcore12:08:200
329920,0watchdog/30-21swapper/308:53:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional