You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 01:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Wed May 13, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3069824635,0sleep00-21swapper/007:20:120
3073723929,0sleep30-21swapper/307:20:353
3077623725,0sleep20-21swapper/207:21:062
3067822723,0sleep10-21swapper/107:19:571
309819973,0cyclictest3524-21snmpd11:12:462
309819973,0cyclictest21898-21awk09:07:502
309819973,0cyclictest11128-21awk11:32:512
309819973,0cyclictest10944-21awk08:37:502
309819970,0cyclictest4443-21munin-node09:37:562
309819970,0cyclictest2369-21munin-run08:32:352
309819970,0cyclictest15742-21if_eth1.212:12:502
339960,0migration/36183-21sh11:09:043
339960,0migration/33033-21sh11:46:453
339960,0migration/326448-21sh10:27:343
339960,0migration/326355-21kthreadcore08:22:543
339960,0migration/326030-21sh09:28:523
339960,0migration/323943-21latency_hist08:02:353
339960,0migration/321494-21sh10:59:563
339960,0migration/310664-21sh11:48:433
329960,0watchdog/329468-21kthreadcore08:02:543
309819963,0cyclictest9918-21diskmemload12:12:172
309819963,0cyclictest7164-21awk07:27:502
309819963,0cyclictest3742-21awk08:32:512
309819963,0cyclictest21458-21awk10:42:502
309819962,0cyclictest7499-21awk08:57:502
309819962,0cyclictest5943-21sadc08:12:352
309819962,0cyclictest5162-21sadc10:52:352
309819962,0cyclictest29098-21awk09:12:502
309819962,0cyclictest25998-21kthreadcore11:57:532
309819962,0cyclictest17598-21awk11:17:512
309819962,0cyclictest15309-21awk10:57:522
309819960,0cyclictest3524-21snmpd11:11:012
309819960,0cyclictest28749-21missed_timers11:02:532
309819960,0cyclictest16772-21latency_hist12:32:352
309819960,0cyclictest15775-21munin-node10:02:502
309819960,0cyclictest10003-21kthreadcore08:12:532
309819960,0cyclictest0-21swapper/211:48:032
309819960,0cyclictest0-21swapper/211:40:342
309819960,0cyclictest0-21swapper/211:31:122
309819960,0cyclictest0-21swapper/210:22:002
309819960,0cyclictest0-21swapper/210:12:472
309819960,0cyclictest0-21swapper/210:07:562
309819960,0cyclictest0-21swapper/209:44:502
309799960,0cyclictest0-21swapper/011:55:240
309799960,0cyclictest0-21swapper/010:02:210
29815060,0irq/29-eth0-tx-27792-21munin-node08:27:560
29805060,0irq/28-eth0-rx-6021-21irqstats09:37:513
29805060,0irq/28-eth0-rx-3834-21perl10:32:483
29805060,0irq/28-eth0-rx-11650-21kthreadcore12:07:533
149960,0migration/04500-21fschecks_time11:47:500
149960,0migration/029790-21sh11:03:540
149960,0migration/018189-21sh09:26:260
149960,0migration/015547-21ntp_offset10:17:550
339950,0migration/39882-21kthreadcore08:57:523
339950,0migration/38237-21taskset12:27:423
339950,0migration/38075-21munin-node11:28:013
339950,0migration/36287-21cpuspeed_turbos07:27:473
339950,0migration/34527-21kthreadcore07:47:523
339950,0migration/34039-21kthreadcore12:42:523
339950,0migration/332468-21runrttasks11:25:023
339950,0migration/327255-21kthreadcore12:17:533
339950,0migration/326760-21munin-node07:38:003
339950,0migration/322561-21munin-node11:17:563
339950,0migration/319610-21kthreadcore12:32:533
339950,0migration/319163-21sshd11:53:183
339950,0migration/31456-21munin-node08:27:563
339950,0migration/312363-21sh10:53:363
329950,0watchdog/317001-21iostat_ios10:02:503
329950,0watchdog/314388-21sh09:42:503
329950,0watchdog/30-21swapper/310:12:503
309819954,0cyclictest14675-21awk09:02:512
309819952,0cyclictest0-21swapper/210:37:562
309819952,0cyclictest0-21swapper/209:32:382
309819950,0cyclictest31148-21latency_hist07:22:342
309819950,0cyclictest24710-21fschecks_count08:02:492
309819950,0cyclictest22516-21df_abs09:47:492
309819950,0cyclictest22180-21kernelversion08:22:532
309819950,0cyclictest2179-21kthreadcore09:52:532
309819950,0cyclictest1955-21ssh11:43:522
309819950,0cyclictest0-21swapper/212:49:002
309819950,0cyclictest0-21swapper/212:42:362
309819950,0cyclictest0-21swapper/212:37:592
309819950,0cyclictest0-21swapper/212:27:482
309819950,0cyclictest0-21swapper/212:22:372
309819950,0cyclictest0-21swapper/212:19:042
309819950,0cyclictest0-21swapper/212:04:492
309819950,0cyclictest0-21swapper/211:53:422
309819950,0cyclictest0-21swapper/211:23:052
309819950,0cyclictest0-21swapper/210:52:562
309819950,0cyclictest0-21swapper/210:36:182
309819950,0cyclictest0-21swapper/210:27:432
309819950,0cyclictest0-21swapper/210:22:512
309819950,0cyclictest0-21swapper/210:00:272
309819950,0cyclictest0-21swapper/209:29:342
309819950,0cyclictest0-21swapper/209:23:332
309809950,0cyclictest0-21swapper/111:25:181
309809950,0cyclictest0-21swapper/110:29:481
309799955,0cyclictest0-21swapper/012:37:390
309799955,0cyclictest0-21swapper/011:32:130
309799955,0cyclictest0-21swapper/010:52:480
309799955,0cyclictest0-21swapper/010:38:180
309799955,0cyclictest0-21swapper/010:15:070
309799950,0cyclictest0-21swapper/010:24:540
309799950,0cyclictest0-21swapper/009:57:280
29815050,0irq/29-eth0-tx-13412-21munin-node08:17:590
29815050,0irq/29-eth0-tx-0-21swapper/009:19:190
29805050,0irq/28-eth0-rx-31205-21kthreadcore09:12:523
29805050,0irq/28-eth0-rx-30663-21kthreadcore10:47:513
29805050,0irq/28-eth0-rx-24542-21kthreadcore11:57:533
29805050,0irq/28-eth0-rx-21339-21gltestperf10:42:493
29805050,0irq/28-eth0-rx-17018-40yum-updatesd-he10:20:283
29805050,0irq/28-eth0-rx-16122-21ssh11:17:323
29805050,0irq/28-eth0-rx-0-21swapper/312:51:543
29805050,0irq/28-eth0-rx-0-21swapper/312:40:033
29805050,0irq/28-eth0-rx-0-21swapper/312:04:323
29805050,0irq/28-eth0-rx-0-21swapper/311:41:513
29805050,0irq/28-eth0-rx-0-21swapper/310:37:523
29805050,0irq/28-eth0-rx-0-21swapper/310:31:203
29805050,0irq/28-eth0-rx-0-21swapper/309:53:303
29805050,0irq/28-eth0-rx-0-21swapper/309:37:143
29805050,0irq/28-eth0-rx-0-21swapper/308:37:533
179950,0migration/13901-21fschecks_time10:32:481
179950,0migration/128797-21latency_hist10:47:351
179950,0migration/127653-21taskset07:42:361
179950,0migration/127445-21dump-pmu-power07:42:341
179950,0migration/125802-21cpuspeed_turbos12:37:471
179950,0migration/122443-21irqrtprio11:57:521
179950,0migration/115683-21latency_hist10:02:351
179950,0migration/113520-21aten_r1power_po08:17:451
169950,0watchdog/112070-21cut11:12:541
149950,0migration/08060-21kthreadcore08:12:520
149950,0migration/06657-21kthreadcore07:47:530
149950,0migration/06480-21taskset12:23:300
149950,0migration/06323-21cpuspeed_turbos07:27:470
149950,0migration/05428-21smart_nvme0n111:07:570
149950,0migration/04877-21kthreadcore12:42:520
149950,0migration/04559-21sh12:04:320
149950,0migration/030174-21kthreadcore10:27:520
149950,0migration/028884-21irqcore07:42:520
149950,0migration/028105-21aten_r1power_po09:12:470
149950,0migration/026782-21kthreadcore09:47:540
149950,0migration/023504-21kthreadcore07:37:520
149950,0migration/023400-21kthreadcore08:22:530
149950,0migration/021698-21kthreadcore09:27:530
149950,0migration/021602-21kthreadcore11:37:520
149950,0migration/021491-21kthreadcore12:32:530
149950,0migration/019324-21kthreadcore09:02:530
149950,0migration/018285-21kthreadcore10:57:540
149950,0migration/017751-21fschecks_time07:57:460
149950,0migration/016246-21latency_hist11:17:350
149950,0migration/01442-21kthreadcore08:07:520
149950,0migration/013421-21kthreadcore07:52:520
149950,0migration/011517-21kthreadcore08:37:520
149950,0migration/011242-21munin-node11:32:510
149950,0migration/01004-21kthreadcore08:52:530
339940,0migration/38894-21kthreadcore08:12:533
339940,0migration/35610-21kthreadcore08:32:533
339940,0migration/331410-21kthreadcore07:42:533
339940,0migration/321260-21fschecks_count09:07:483
339940,0migration/319413-21kthreadcore12:12:523
329940,0watchdog/36314-21runrttasks08:08:583
329940,0watchdog/332765-21kthreadcore07:22:533
309819943,0cyclictest3524-21snmpd09:21:002
309819943,0cyclictest3524-21snmpd08:49:002
309819943,0cyclictest3524-21snmpd08:44:452
309819943,0cyclictest3524-21snmpd07:39:002
309819943,0cyclictest3524-21snmpd07:35:302
309819943,0cyclictest32626-21awk08:52:512
309819943,0cyclictest28843-21awk07:42:522
309819943,0cyclictest14515-21awk08:17:492
309809943,0cyclictest9457-21awk12:27:501
309809943,0cyclictest7226-21awk08:12:501
309809943,0cyclictest3571-21lldpd10:37:421
309809943,0cyclictest3571-21lldpd10:17:411
309809943,0cyclictest31941-21awk09:52:511
309809943,0cyclictest30120-21awk10:47:491
309809943,0cyclictest2996-21awk12:42:501
309809943,0cyclictest28967-21awk08:27:511
309809943,0cyclictest25658-21awk10:07:511
309809943,0cyclictest19781-21awk11:37:501
309799944,0cyclictest0-21swapper/011:47:020
309799944,0cyclictest0-21swapper/011:20:240
309799944,0cyclictest0-21swapper/010:48:140
309799943,0cyclictest7029-21awk12:07:500
309799943,0cyclictest3571-21lldpd09:00:090
309799943,0cyclictest16877-21awk10:02:490
309799943,0cyclictest14317-21awk07:32:500
309799940,0cyclictest0-21swapper/008:02:490
29815040,0irq/29-eth0-tx-0-21swapper/008:32:500
29805040,0irq/28-eth0-rx-28444-21python09:47:593
29805040,0irq/28-eth0-rx-0-21swapper/312:23:553
29805040,0irq/28-eth0-rx-0-21swapper/311:36:193
29805040,0irq/28-eth0-rx-0-21swapper/311:02:373
29805040,0irq/28-eth0-rx-0-21swapper/310:07:463
29805040,0irq/28-eth0-rx-0-21swapper/309:58:013
29805040,0irq/28-eth0-rx-0-21swapper/309:23:303
29805040,0irq/28-eth0-rx-0-21swapper/307:32:523
249940,0watchdog/20-21swapper/207:47:542
179940,0migration/16077-21kthreadcore08:32:531
179940,0migration/14431-21kthreadcore11:07:531
179940,0migration/132732-21irqrtprio08:07:511
179940,0migration/129896-21latency08:02:541
179940,0migration/129458-21runrttasks09:49:351
179940,0migration/129062-21runrttasks11:02:561
179940,0migration/125177-21fschecks_time08:47:471
179940,0migration/123659-21runrttasks12:33:081
179940,0migration/123154-21kthreadcore09:27:531
179940,0migration/122727-21latency07:57:511
179940,0migration/117988-21kthreadcore09:42:531
179940,0migration/116828-21taskset08:42:201
179940,0migration/116475-21kthreadcore10:57:531
179940,0migration/114519-21taskset09:59:521
179940,0migration/112700-21kthreadcore09:22:521
179940,0migration/111160-21irqrtprio07:52:511
179940,0migration/110337-21cpuspeed_turbos11:32:481
169940,0watchdog/17609-21ssh12:26:351
169940,0watchdog/14475-21kthreadcore09:17:501
169940,0watchdog/13015-21ssh11:46:421
169940,0watchdog/121499-21ssh12:13:381
169940,0watchdog/113267-21ssh12:09:461
169940,0watchdog/112444-21aten2.4-expect11:52:461
169940,0watchdog/111797-21runrttasks09:39:221
169940,0watchdog/10-21swapper/111:47:541
169940,0watchdog/10-21swapper/111:17:501
169940,0watchdog/10-21swapper/110:55:021
169940,0watchdog/10-21swapper/110:14:541
169940,0watchdog/10-21swapper/107:47:541
149940,0migration/04335-21irqcore10:32:510
149940,0migration/027106-21kthreadcore12:17:530
149940,0migration/026444-21kthreadcore10:07:530
149940,0migration/023701-21kthreadcore10:42:530
149940,0migration/021778-21kthreadcore08:42:530
329930,0watchdog/30-21swapper/309:17:503
329930,0watchdog/30-21swapper/309:02:383
329930,0watchdog/30-21swapper/308:47:383
329930,0watchdog/30-21swapper/308:19:423
329930,0watchdog/30-21swapper/307:52:543
309819932,0cyclictest10832-21awk07:52:502
309809933,0cyclictest0-21swapper/110:23:201
309809932,0cyclictest668-21kthreadcore09:32:531
309809932,0cyclictest2897-21grep12:02:531
309809932,0cyclictest24431-21awk12:17:511
309809932,0cyclictest20619-21basename08:22:471
309809932,0cyclictest14395-21awk07:32:511
309809930,0cyclictest1981-21perl11:27:481
309809930,0cyclictest0-21swapper/109:04:311
309799933,0cyclictest0-21swapper/007:22:500
309799932,0cyclictest3571-21lldpd12:27:430
309799932,0cyclictest28962-21awk09:32:500
309799932,0cyclictest21111-21aten_r1power_po11:57:470
309799932,0cyclictest20792-21munin-node09:07:480
309799932,0cyclictest15251-21perl12:12:480
309799932,0cyclictest14528-21awk09:42:510
309799932,0cyclictest11639-21awk12:47:500
309799930,0cyclictest5255-21perl09:37:470
29815030,0irq/29-eth0-tx-0-21swapper/008:47:450
29805030,0irq/28-eth0-rx-0-21swapper/308:52:463
29805030,0irq/28-eth0-rx-0-21swapper/308:42:463
249930,0watchdog/20-21swapper/207:57:582
179930,0migration/123712-21runrttasks08:43:371
169930,0watchdog/10-21swapper/112:47:391
169930,0watchdog/10-21swapper/109:12:101
169930,0watchdog/10-21swapper/108:57:541
169930,0watchdog/10-21swapper/108:52:541
169930,0watchdog/10-21swapper/107:22:371
309809920,0cyclictest0-21swapper/109:12:351
309799920,0cyclictest0-21swapper/011:22:390
169920,0watchdog/10-21swapper/107:27:371
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional