You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 00:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Tue Jul 14, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2224227271,0sleep10-21swapper/107:23:351
2247326056,0sleep20-21swapper/207:26:122
22672995353,0cyclictest6139-21md0_resync09:55:510
22674994949,0cyclictest83050irq/26-0000:00:09:55:512
2248124342,0sleep00-21swapper/007:26:180
1554023127,0sleep30-21swapper/307:22:413
22673991615,0cyclictest25612-21ssh09:55:511
22672991010,0cyclictest0-21swapper/009:28:050
226729988,0cyclictest3524-21snmpd12:50:310
8305060,0irq/26-0000:00:3524-21snmpd07:56:133
8305060,0irq/26-0000:00:29193-21fschecks_count08:37:503
8305060,0irq/26-0000:00:16746-21crond08:07:383
8305060,0irq/26-0000:00:15267-21iostat_ios08:27:563
339960,0migration/37976-21sh12:30:353
339960,0migration/36318-21idleruntime07:37:553
339960,0migration/329580-21kthreadcore09:57:563
339960,0migration/316057-21sh10:43:383
339960,0migration/313743-21sh12:15:213
29815060,0irq/29-eth0-tx-14068-21munin-node08:27:560
29805060,0irq/28-eth0-rx-4346-21kthreadcore09:42:593
29805060,0irq/28-eth0-rx-23094-21ssh10:31:453
29805060,0irq/28-eth0-rx-16839-21kthreadcore12:52:583
29805060,0irq/28-eth0-rx-1480-21irqcore10:37:563
29805060,0irq/28-eth0-rx-14129-21ls09:32:513
226749960,0cyclictest0-21swapper/210:06:112
226739960,0cyclictest0-21swapper/112:38:361
226739960,0cyclictest0-21swapper/110:45:431
226739960,0cyclictest0-21swapper/108:16:341
149960,0migration/08731-21sh11:37:320
149960,0migration/031974-21sh09:42:490
149960,0migration/018929-21sh11:42:550
149960,0migration/013117-21sh11:18:180
8305050,0irq/26-0000:00:8798-21aten2.4-expect09:47:502
8305050,0irq/26-0000:00:8637-21kthreadcore09:27:562
8305050,0irq/26-0000:00:7965-21ssh10:40:282
8305050,0irq/26-0000:00:7497-21sh12:29:162
8305050,0irq/26-0000:00:7083-21idleruntime12:12:552
8305050,0irq/26-0000:00:6295-21kthreadcore08:42:583
8305050,0irq/26-0000:00:417-21ntp_states11:48:002
8305050,0irq/26-0000:00:3996-21ntp_states09:23:013
8305050,0irq/26-0000:00:3524-21snmpd09:02:453
8305050,0irq/26-0000:00:31977-21kthreadcore12:07:582
8305050,0irq/26-0000:00:31694-21latency_hist09:42:392
8305050,0irq/26-0000:00:30126-21forks11:12:552
8305050,0irq/26-0000:00:29660-21telnet10:17:502
8305050,0irq/26-0000:00:29239-21kthreadcore10:52:572
8305050,0irq/26-0000:00:28193-21ssh10:14:402
8305050,0irq/26-0000:00:27859-21cut09:57:552
8305050,0irq/26-0000:00:26036-21cut12:22:562
8305050,0irq/26-0000:00:24760-21ssh10:48:112
8305050,0irq/26-0000:00:24422-21irqstats07:27:543
8305050,0irq/26-0000:00:23597-21kthreadcore08:52:563
8305050,0irq/26-0000:00:21276-21sh09:34:262
8305050,0irq/26-0000:00:20627-21chrt12:02:392
8305050,0irq/26-0000:00:18305-21cut11:02:592
8305050,0irq/26-0000:00:17835-21ssh12:37:442
8305050,0irq/26-0000:00:17146-21missed_timers08:47:593
8305050,0irq/26-0000:00:15822-21grep11:38:082
8305050,0irq/26-0000:00:15798-21unixbench_multi12:33:082
8305050,0irq/26-0000:00:12637-21aten_r1power_cu07:42:513
8305050,0irq/26-0000:00:0-21swapper/308:22:533
8305050,0irq/26-0000:00:0-21swapper/308:12:553
8305050,0irq/26-0000:00:0-21swapper/307:32:573
35150,0ktimersoftd/30-21swapper/311:34:173
339950,0migration/332603-21kthreadcore10:52:583
339950,0migration/329510-21kthreadcore12:42:583
339950,0migration/329289-21timerandwakeup09:18:043
339950,0migration/328547-21latency_hist08:37:383
339950,0migration/324268-21fschecks_count10:32:543
339950,0migration/320862-21sh12:02:513
339950,0migration/319084-21kthreadcore08:07:583
339950,0migration/319083-21kthreadcore12:17:583
339950,0migration/317130-21kthreadcore09:12:573
339950,0migration/311874-21sh11:57:443
339950,0migration/310737-21runrttasks12:49:393
329950,0watchdog/35310-21kthreadcore11:52:583
329950,0watchdog/332327-21kthreadcore12:07:583
329950,0watchdog/33220-21hwlatdetect07:57:543
329950,0watchdog/330331-21cut08:57:583
329950,0watchdog/323331-21kthreadcore10:47:583
329950,0watchdog/323184-21ssh11:07:583
329950,0watchdog/322471-21kthreadcore12:37:593
329950,0watchdog/318737-21hwlatdetect09:52:543
329950,0watchdog/31460-21rm11:49:103
329950,0watchdog/30-21swapper/311:28:463
329950,0watchdog/30-21swapper/311:02:503
29815050,0irq/29-eth0-tx-17033-21cut12:17:582
29815050,0irq/29-eth0-tx-0-21swapper/212:55:232
29815050,0irq/29-eth0-tx-0-21swapper/209:37:512
29815050,0irq/29-eth0-tx-0-21swapper/008:39:400
29815050,0irq/29-eth0-tx-0-21swapper/008:17:510
29815050,0irq/29-eth0-tx-0-21swapper/008:03:000
29815050,0irq/29-eth0-tx-0-21swapper/007:57:590
29815050,0irq/29-eth0-tx-0-21swapper/007:49:310
29815050,0irq/29-eth0-tx-0-21swapper/007:32:550
29805050,0irq/28-eth0-rx-9029-21ssh12:32:513
29805050,0irq/28-eth0-rx-6660-21tr10:57:583
29805050,0irq/28-eth0-rx-6652-21diskstats11:17:523
29805050,0irq/28-eth0-rx-6604-21sed08:22:383
29805050,0irq/28-eth0-rx-6314-21runrttasks10:12:393
29805050,0irq/28-eth0-rx-6314-21runrttasks10:12:273
29805050,0irq/28-eth0-rx-32356-21kthreadcore11:12:593
29805050,0irq/28-eth0-rx-1999-21md0_raid112:22:503
29805050,0irq/28-eth0-rx-15273-21ssh09:48:053
29805050,0irq/28-eth0-rx-0-21swapper/311:37:523
29805050,0irq/28-eth0-rx-0-21swapper/311:25:123
29805050,0irq/28-eth0-rx-0-21swapper/310:22:523
29805050,0irq/28-eth0-rx-0-21swapper/310:06:553
29805050,0irq/28-eth0-rx-0-21swapper/309:38:003
29805050,0irq/28-eth0-rx-0-21swapper/309:28:043
259950,0migration/2368-21latency12:42:592
259950,0migration/232202-21switchtime08:58:062
259950,0migration/229178-21smart_nvme0n109:18:022
259950,0migration/225507-21kthreadcore11:27:572
259950,0migration/214287-21sh10:26:452
259950,0migration/211889-21sh11:57:462
259950,0migration/210583-21sh12:49:152
249950,0watchdog/24983-21diskmemload11:54:102
249950,0watchdog/215992-21ssh10:43:262
249950,0watchdog/214956-21sh11:22:422
226749955,0cyclictest0-21swapper/211:21:142
226749955,0cyclictest0-21swapper/211:09:062
226749955,0cyclictest0-21swapper/207:42:532
226749950,0cyclictest0-21swapper/210:29:032
226749950,0cyclictest0-21swapper/209:12:352
226739955,0cyclictest0-21swapper/109:01:491
226739954,0cyclictest0-21swapper/110:52:581
226739950,0cyclictest0-21swapper/111:32:321
226739950,0cyclictest0-21swapper/110:16:231
226739950,0cyclictest0-21swapper/109:58:151
226739950,0cyclictest0-21swapper/109:46:261
226739950,0cyclictest0-21swapper/107:58:261
19150,0ktimersoftd/10-21swapper/108:24:461
179950,0migration/19359-21munin-node10:58:001
179950,0migration/17285-21kthreadcore07:37:571
179950,0migration/13801-21runrttasks08:17:561
179950,0migration/131308-21taskset10:35:111
179950,0migration/128729-21taskset08:37:401
179950,0migration/127358-21aten_r1power_fr07:52:511
179950,0migration/123804-21taskset08:09:291
179950,0migration/123578-21kthreadcore12:02:571
179950,0migration/123442-21kthreadcore07:47:561
179950,0migration/121662-21timerwakeupswit11:23:051
179950,0migration/115884-21hddtemp_smartct10:27:531
179950,0migration/114370-21kthreadcore11:57:581
179950,0migration/11100-21sh11:48:111
179950,0migration/110957-3199-raid-check10:05:441
169950,0watchdog/113449-21tune2fs07:42:541
149950,0migration/06851-21kthreadcore08:42:590
149950,0migration/031688-21taskset12:26:090
149950,0migration/031443-21sh11:30:200
149950,0migration/03061-21diskmemload10:57:460
149950,0migration/030563-21kthreadcore07:52:570
149950,0migration/029423-21kthreadcore10:33:000
149950,0migration/028554-21sh10:15:410
149950,0migration/026912-21cpuspeed_turbos10:52:510
149950,0migration/026736-21kthreadcore12:02:580
149950,0migration/026699-21munin-node11:47:510
149950,0migration/026375-21munin-node08:57:530
149950,0migration/022450-21kthreadcore08:52:550
149950,0migration/021609-21kthreadcore12:37:580
149950,0migration/021435-21kthreadcore10:47:580
149950,0migration/019573-21kthreadcore09:12:580
149950,0migration/018257-21pmu-power10:08:000
149950,0migration/018157-21taskset08:51:370
149950,0migration/015701-21timerwakeupswit10:43:060
149950,0migration/015064-21kthreadcore12:52:570
149950,0migration/014225-21sh10:26:350
149950,0migration/014201-21kthreadcore12:32:590
149950,0migration/013374-21kthreadcore09:07:580
149950,0migration/012936-21sh11:02:520
149950,0migration/011000-21kthreadcore11:37:580
8305040,0irq/26-0000:00:0-21swapper/309:07:513
339940,0migration/319218-21irqcore11:42:573
29815040,0irq/29-eth0-tx-7629-21sshd09:04:040
29815040,0irq/29-eth0-tx-4983-21diskmemload11:32:502
29815040,0irq/29-eth0-tx-0-21swapper/210:32:522
29805040,0irq/28-eth0-rx-0-21swapper/310:18:373
259940,0migration/225816-21kthreadcore08:32:582
259940,0migration/224593-21kthreadcore07:27:552
259940,0migration/219364-21fschecks_time08:52:512
259940,0migration/217937-21aten_r1power_fr11:42:512
259940,0migration/217502-21kthreadcore08:27:572
259940,0migration/214185-21kthreadcore08:47:572
259940,0migration/211853-21latency_hist10:07:392
249940,0watchdog/27626-21kthreadcore10:57:582
249940,0watchdog/23217-21wc07:57:542
249940,0watchdog/20-21swapper/209:02:582
249940,0watchdog/20-21swapper/208:42:542
226749944,0cyclictest0-21swapper/208:07:472
226749943,0cyclictest6368-21awk07:37:552
226749943,0cyclictest3571-21lldpd09:12:392
226749943,0cyclictest3524-21snmpd09:23:002
226749943,0cyclictest3524-21snmpd08:41:442
226749943,0cyclictest3524-21snmpd07:34:582
226749943,0cyclictest28364-21awk07:52:552
226749943,0cyclictest25429-21awk08:12:542
226749943,0cyclictest16753-21sadc08:07:382
226739944,0cyclictest0-21swapper/111:53:211
226739944,0cyclictest0-21swapper/109:34:171
226739944,0cyclictest0-21swapper/109:20:061
226739943,0cyclictest9805-21awk09:47:551
226739943,0cyclictest3571-21lldpd12:17:401
226739943,0cyclictest3571-21lldpd12:07:401
226739943,0cyclictest3571-21lldpd07:32:381
226739943,0cyclictest3524-21snmpd08:34:591
226739943,0cyclictest31282-21awk09:22:561
226729944,0cyclictest23509-21fschecks_count09:37:530
226729943,0cyclictest6353-21awk07:37:550
226729943,0cyclictest3571-21lldpd09:35:090
226729943,0cyclictest3524-21snmpd10:00:460
226729943,0cyclictest25501-21awk08:12:540
179940,0migration/1522-21forks12:27:541
179940,0migration/132072-21kthreadcore10:17:561
179940,0migration/12829-21kthreadcore09:02:571
179940,0migration/126116-21kthreadcore12:22:561
179940,0migration/123218-21cpuspeed_turbos09:37:521
179940,0migration/122797-21kthreadcore10:47:581
179940,0migration/120607-21turbostat.cron12:57:341
179940,0migration/118576-21aten_r1power_fr08:52:491
179940,0migration/117930-21kthreadcore09:12:571
179940,0migration/117712-21unixbench-2d08:48:061
179940,0migration/114532-21kthreadcore11:02:561
179940,0migration/112428-21kthreadcore08:02:581
179940,0migration/111168-21kthreadcore10:22:571
179940,0migration/110680-21kthreadcore12:32:581
179940,0migration/110615-21kthreadcore12:12:581
169940,0watchdog/17803-21ssh10:40:021
169940,0watchdog/131221-21cut11:12:581
169940,0watchdog/130880-21tr12:42:591
169940,0watchdog/115427-21munin-node11:38:021
169940,0watchdog/112090-21cut09:07:581
169940,0watchdog/10-21swapper/112:47:471
169940,0watchdog/10-21swapper/111:07:581
149940,0migration/07383-21sh12:28:570
149940,0migration/0548-21kthreadcore12:07:590
149940,0migration/04542-21sh11:13:560
149940,0migration/03548-21kthreadcore09:22:590
149940,0migration/021918-21diskmemload10:28:310
149940,0migration/015029-21aten_r1power_vo12:17:520
149940,0migration/010527-21sh10:04:350
8305030,0irq/26-0000:00:0-21swapper/307:47:393
29815030,0irq/29-eth0-tx-0-21swapper/008:32:520
226749933,0cyclictest0-21swapper/207:47:462
226749932,0cyclictest7761-21awk08:22:542
226749932,0cyclictest32305-21cut08:17:512
226739933,0cyclictest13033-21awk10:07:541
226739932,0cyclictest7175-21cut09:27:551
226739932,0cyclictest23443-21grep11:42:591
226739932,0cyclictest11035-21cut11:17:581
226729933,0cyclictest0-21swapper/011:53:430
226729933,0cyclictest0-21swapper/009:47:540
226729932,0cyclictest3524-21snmpd08:09:340
226729932,0cyclictest27998-21cut12:42:570
226729932,0cyclictest23935-21awk09:17:540
226729932,0cyclictest13557-21head07:42:540
226729932,0cyclictest13005-21awk11:57:560
226729932,0cyclictest12157-21grep12:12:590
226729930,0cyclictest348-21kthreadcore10:17:570
226729930,0cyclictest20748-21latency_hist11:07:400
226729930,0cyclictest19603-21cut11:22:570
226729930,0cyclictest0-21swapper/007:27:500
179930,0migration/132528-21sh11:32:421
169930,0watchdog/10-21swapper/108:42:541
149930,0migration/08301-21sh10:41:230
226739920,0cyclictest0-21swapper/107:27:381
226729920,0cyclictest6645-21latency_hist08:22:380
169920,0watchdog/10-21swapper/108:27:421
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional