You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 18:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Fri Mar 13, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1604523828,0sleep30-21swapper/307:16:343
1606423430,0sleep20-21swapper/207:16:492
1602423127,0sleep00-21swapper/007:16:230
1594423026,0sleep10-21swapper/107:15:281
161949975,0cyclictest27486-21diskmemload10:04:252
161949975,0cyclictest0-21swapper/212:24:442
161949973,0cyclictest3524-21snmpd11:47:262
161949973,0cyclictest32405-21awk08:57:482
161949972,0cyclictest6008-21awk11:52:512
161949972,0cyclictest27067-21sed10:12:452
161949972,0cyclictest14035-21awk09:27:472
161949972,0cyclictest10999-21sadc11:37:322
161949972,0cyclictest10705-21awk08:42:462
161949971,0cyclictest15337-21cut09:07:492
161949970,0cyclictest24071-21munin-node11:07:572
161949970,0cyclictest0-21swapper/211:57:462
161949970,0cyclictest0-21swapper/210:07:412
161939970,0cyclictest11438-21aten2.4-expect11:37:431
35160,0ktimersoftd/30-21swapper/309:32:283
339960,0migration/35691-21sh12:09:243
339960,0migration/33509-21sh10:35:273
339960,0migration/323603-21latency_hist09:52:333
339960,0migration/323603-21latency_hist09:52:333
339960,0migration/32153-21sh12:46:473
339960,0migration/311071-21aten_r1power_en10:22:423
329960,0watchdog/330456-21sh10:52:363
329960,0watchdog/31525-21ps11:30:363
29805060,0irq/28-eth0-rx-14245-21ssh12:14:143
161949962,0cyclictest6763-21awk07:32:472
161949962,0cyclictest28813-21awk09:17:462
161949962,0cyclictest27105-21seq08:30:122
161949962,0cyclictest26795-21expr12:42:452
161949962,0cyclictest26650-21grep08:52:502
161949962,0cyclictest1255-21awk09:57:472
161949962,0cyclictest0-21swapper/211:17:352
161949962,0cyclictest0-21swapper/211:04:212
161949962,0cyclictest0-21swapper/209:23:332
161949961,0cyclictest5657-21awk10:37:482
161949961,0cyclictest32489-21tr11:47:502
161949961,0cyclictest30231-21sed08:07:562
161949961,0cyclictest29051-21grep07:47:492
161949961,0cyclictest267962chrt07:44:102
161949961,0cyclictest2348-21munin-node10:17:562
161949961,0cyclictest16624-21tr10:22:492
161949961,0cyclictest0-21swapper/212:32:472
161949960,0cyclictest9511-21kthreadcore10:57:482
161949960,0cyclictest6539-21latency_hist09:42:332
161949960,0cyclictest6162-21kthreadcore11:12:502
161949960,0cyclictest30506-21munin-node10:52:482
161949960,0cyclictest25771-21cut10:47:492
161949960,0cyclictest25241-21ssh12:39:472
161949960,0cyclictest22154-21munin-node12:02:522
161949960,0cyclictest15293-21aten_r1power_en09:47:432
161949960,0cyclictest15293-21aten_r1power_en09:47:432
161949960,0cyclictest13421-21ssh12:12:542
161949960,0cyclictest1193-21fschecks_count12:27:452
161949960,0cyclictest0-21swapper/212:10:572
161949960,0cyclictest0-21swapper/211:39:282
161949960,0cyclictest0-21swapper/211:26:592
161949960,0cyclictest0-21swapper/210:43:162
161949960,0cyclictest0-21swapper/209:53:532
161949960,0cyclictest0-21swapper/209:32:522
339950,0migration/39013-21aten_r1power_po10:02:443
339950,0migration/38086-21irqcore10:57:473
339950,0migration/37781-21kthreadcore08:17:493
339950,0migration/37639-21kthreadcore07:32:493
339950,0migration/36885-21kthreadcore10:37:503
339950,0migration/36390-21kthreadcore09:22:503
339950,0migration/35632-21kthreadcore11:12:503
339950,0migration/35483-21kthreadcore12:27:493
339950,0migration/328386-21munin-node09:17:443
339950,0migration/327777-21munin-node09:32:523
339950,0migration/325919-21sh11:27:143
339950,0migration/325439-21kthreadcore07:22:483
339950,0migration/324757-21kthreadcore07:42:493
339950,0migration/323387-21munin-node12:02:493
339950,0migration/322436-21kthreadcore08:27:473
339950,0migration/320564-21taskset11:58:543
339950,0migration/318020-21kthreadcore07:17:473
339950,0migration/31746-21taskset08:33:323
339950,0migration/316802-21latency_hist08:47:323
339950,0migration/315893-21kthreadcore11:37:493
339950,0migration/315654-21kthreadcore09:07:503
339950,0migration/314647-21irqrtprio10:42:483
339950,0migration/31446-21sh09:37:503
339950,0migration/312370-21switchtime09:02:573
339950,0migration/311484-21kthreadcore07:57:483
339950,0migration/310933-21taskset11:37:233
329950,0watchdog/37099-21diskstats09:42:433
329950,0watchdog/33727-21cut10:17:473
329950,0watchdog/33500-21ssh11:49:403
329950,0watchdog/330532-21awk09:52:593
329950,0watchdog/327136-21taskset10:30:033
329950,0watchdog/317854-21iostat_ios08:02:473
329950,0watchdog/31443-21cut07:27:473
329950,0watchdog/310008-21fschecks_time12:32:483
329950,0watchdog/30-21swapper/312:21:043
329950,0watchdog/30-21swapper/310:07:473
29805050,0irq/28-eth0-rx-20967-21hwlatdetect11:42:483
29805050,0irq/28-eth0-rx-17305-21grep07:37:483
29805050,0irq/28-eth0-rx-0-21swapper/312:22:463
29805050,0irq/28-eth0-rx-0-21swapper/311:10:273
29805050,0irq/28-eth0-rx-0-21swapper/310:12:393
161949951,0cyclictest9683-21cpuspeed_turbos07:57:432
161949951,0cyclictest6055-21ls09:02:322
161949951,0cyclictest30420-21aten_r1power_po09:37:432
161949951,0cyclictest26347-21stty11:27:422
161949951,0cyclictest20667-21aten_r1power_vo09:12:432
161949951,0cyclictest19988-21expr10:27:432
161949950,0cyclictest31301-21tune2fs07:27:432
161949950,0cyclictest31127-21aten2.4-expect08:12:422
161949950,0cyclictest29873-21munin-node10:32:482
161949950,0cyclictest28473-21gltestperf08:32:472
161949950,0cyclictest2488-21aten_r1power_vo08:37:422
161949950,0cyclictest23631-21aten2.4-expect07:22:422
161949950,0cyclictest2135-21seq07:52:332
161949950,0cyclictest17085-21entropy08:02:442
161949950,0cyclictest15939-21cpuspeed_turbos12:17:442
161949950,0cyclictest13219-21munin-node08:22:432
161949950,0cyclictest12918-21basename07:37:412
161949950,0cyclictest0-21swapper/208:47:322
161949950,0cyclictest0-21swapper/208:17:452
161949950,0cyclictest0-21swapper/207:17:322
161939955,0cyclictest0-21swapper/111:07:271
161939955,0cyclictest0-21swapper/110:25:311
161939950,0cyclictest0-21swapper/110:08:481
161939950,0cyclictest0-21swapper/109:17:341
161929955,0cyclictest27486-21diskmemload12:36:470
161929955,0cyclictest0-21swapper/010:32:520
161929955,0cyclictest0-21swapper/009:32:480
161929954,0cyclictest26034-21crond11:27:320
161929950,0cyclictest0-21swapper/011:37:590
161929950,0cyclictest0-21swapper/011:17:480
149950,0migration/05089-21kthreadcore07:52:490
149950,0migration/026278-21unixbench_multi10:27:560
339940,0migration/33699-21kthreadcore08:12:493
339940,0migration/327926-21fschecks_count07:47:453
339940,0migration/326517-21sh09:12:513
329940,0watchdog/328891-21kthreadcore08:52:513
329940,0watchdog/30-21swapper/312:37:483
329940,0watchdog/30-21swapper/311:52:523
329940,0watchdog/30-21swapper/308:42:473
329940,0watchdog/30-21swapper/308:37:473
29815040,0irq/29-eth0-tx-12901-21munin-node07:37:490
29815040,0irq/29-eth0-tx-0-21swapper/009:17:440
29815040,0irq/29-eth0-tx-0-21swapper/008:57:460
29815040,0irq/29-eth0-tx-0-21swapper/008:27:470
29815040,0irq/29-eth0-tx-0-21swapper/008:07:460
29815040,0irq/29-eth0-tx-0-21swapper/007:22:450
29805040,0irq/28-eth0-rx-14887-21kthreadcore11:17:513
29805040,0irq/28-eth0-rx-0-21swapper/311:02:413
29805040,0irq/28-eth0-rx-0-21swapper/310:49:223
29805040,0irq/28-eth0-rx-0-21swapper/309:57:493
179940,0migration/113225-21kthreadcore11:17:511
161939944,0cyclictest0-21swapper/109:22:551
161939944,0cyclictest0-21swapper/108:47:361
161939943,0cyclictest7182-21awk09:02:471
161939943,0cyclictest3524-21snmpd12:46:121
161939943,0cyclictest3524-21snmpd12:37:571
161939943,0cyclictest3524-21snmpd12:33:571
161939943,0cyclictest3524-21snmpd12:22:571
161939943,0cyclictest3524-21snmpd12:14:271
161939943,0cyclictest3524-21snmpd12:04:261
161939943,0cyclictest3524-21snmpd11:52:561
161939943,0cyclictest3524-21snmpd11:45:111
161939943,0cyclictest3524-21snmpd11:36:111
161939943,0cyclictest3524-21snmpd11:27:561
161939943,0cyclictest3524-21snmpd11:26:111
161939943,0cyclictest3524-21snmpd10:20:561
161939943,0cyclictest3524-21snmpd10:03:411
161939943,0cyclictest3524-21snmpd10:00:261
161939943,0cyclictest3524-21snmpd09:50:111
161939943,0cyclictest3524-21snmpd09:50:111
161939943,0cyclictest3524-21snmpd09:45:261
161939943,0cyclictest3524-21snmpd09:36:401
161939943,0cyclictest3524-21snmpd09:31:551
161939943,0cyclictest3524-21snmpd08:57:551
161939943,0cyclictest3524-21snmpd08:53:551
161939943,0cyclictest3524-21snmpd08:47:251
161939943,0cyclictest3524-21snmpd08:38:551
161939943,0cyclictest3524-21snmpd08:27:401
161939943,0cyclictest3524-21snmpd08:24:251
161939943,0cyclictest3524-21snmpd08:20:251
161939943,0cyclictest3524-21snmpd08:07:391
161939943,0cyclictest3524-21snmpd08:06:391
161939943,0cyclictest3524-21snmpd07:59:241
161939943,0cyclictest3524-21snmpd07:33:541
161939943,0cyclictest32227-21awk08:12:471
161939943,0cyclictest30563-21sadc07:27:321
161939943,0cyclictest29652-21awk11:47:481
161939943,0cyclictest28599-21awk08:32:481
161939943,0cyclictest27207-21awk10:12:471
161939943,0cyclictest25138-21awk11:07:461
161939943,0cyclictest14681-21awk11:57:481
161939943,0cyclictest1457-21awk11:12:471
161939943,0cyclictest13301-21munin-node09:07:581
161939942,0cyclictest4737-21cpu10:37:451
161939942,0cyclictest26871-21ssh10:29:211
161939942,0cyclictest2036-21pmu-power10:32:521
161939941,0cyclictest7962-21rm12:29:381
161939941,0cyclictest31548-21munin-node09:37:481
161939941,0cyclictest31535-21perl07:27:431
161939941,0cyclictest22874-21ssh12:19:131
161939941,0cyclictest22870-21if_err_eth110:47:471
161929944,0cyclictest0-21swapper/012:03:220
161929944,0cyclictest0-21swapper/011:13:130
161929944,0cyclictest0-21swapper/009:49:490
161929944,0cyclictest0-21swapper/009:49:490
161929943,0cyclictest7095-21awk08:17:470
161929943,0cyclictest6870-21awk07:32:480
161929943,0cyclictest3571-21lldpd12:09:370
161929943,0cyclictest3571-21lldpd11:53:060
161929943,0cyclictest3571-21lldpd11:36:050
161929943,0cyclictest3571-21lldpd10:42:340
161929943,0cyclictest3571-21lldpd08:12:330
161929943,0cyclictest3524-21snmpd12:29:120
161929943,0cyclictest3524-21snmpd12:24:270
161929943,0cyclictest3524-21snmpd12:12:420
161929943,0cyclictest3524-21snmpd12:01:410
161929943,0cyclictest3524-21snmpd10:57:410
161929943,0cyclictest3524-21snmpd10:47:560
161929943,0cyclictest3524-21snmpd10:15:110
161929943,0cyclictest3524-21snmpd10:09:260
161929943,0cyclictest3524-21snmpd09:22:400
161929943,0cyclictest3524-21snmpd09:09:100
161929943,0cyclictest3524-21snmpd09:03:100
161929943,0cyclictest3524-21snmpd08:52:400
161929943,0cyclictest3524-21snmpd08:02:540
161929943,0cyclictest3524-21snmpd07:49:240
161929943,0cyclictest3524-21snmpd07:45:540
161929943,0cyclictest3524-21snmpd07:19:390
161929943,0cyclictest3443-21awk08:37:450
161929943,0cyclictest31361-21awk09:37:470
161929943,0cyclictest29708-21awk11:47:480
161929943,0cyclictest28725-21awk08:32:490
161929943,0cyclictest21584-21awk09:12:460
161929943,0cyclictest1184-21awk09:57:460
161929943,0cyclictest10501-21awk07:57:460
149940,0migration/04787-21switchtime07:27:540
149940,0migration/04671-21aten_r1power_po10:37:440
149940,0migration/029830-21kthreadcore11:07:500
149940,0migration/029341-21kthreadcore09:52:520
149940,0migration/026991-21fschecks_time11:27:460
149940,0migration/026579-21aten_r1power_fr12:42:440
149940,0migration/017466-21fschecks_count08:47:450
149940,0migration/014404-21irqrtprio09:27:490
329930,0watchdog/30-21swapper/308:57:433
329930,0watchdog/30-21swapper/307:52:433
29805030,0irq/28-eth0-rx-0-21swapper/308:22:433
161939931,0cyclictest7813-21sed10:57:461
161939931,0cyclictest30806-21awk12:07:431
161939931,0cyclictest30384-21cut10:52:321
161939931,0cyclictest27988-21tune2fs07:47:451
161939931,0cyclictest23771-21sed09:52:331
161939931,0cyclictest2206-21aten2.4-expect07:52:431
161939931,0cyclictest20501-21date09:12:321
161939931,0cyclictest20160-21telnet07:42:421
161939931,0cyclictest16335-21date07:17:321
161939931,0cyclictest13129-21ssh10:42:321
161939931,0cyclictest12816-21cat07:37:321
161929932,0cyclictest9625-21munin-node08:42:430
161929932,0cyclictest5178-21ssh10:53:510
161929932,0cyclictest3524-21snmpd10:06:110
161929932,0cyclictest3466-21awk10:17:460
161929932,0cyclictest18949-21kthreadcore11:02:500
161929931,0cyclictest0-21swapper/011:42:450
161929930,0cyclictest22001-21rt-features12:17:530
161929930,0cyclictest18331-21diskstats12:37:450
161929930,0cyclictest11747-21perl10:22:450
161929930,0cyclictest0-21swapper/008:22:440
329920,0watchdog/30-21swapper/308:07:353
161929920,0cyclictest6294-21iceccd09:42:330
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional