You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 04:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sun May 24, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2860224432,0sleep10-21swapper/119:21:341
2867924233,0sleep30-21swapper/319:22:283
2849123127,0sleep00-21swapper/019:20:170
2850322920,0sleep20-21swapper/219:20:272
35160,0ktimersoftd/30-21swapper/300:29:243
339960,0migration/38335-21sh22:36:503
339960,0migration/35308-21unixbench_singl23:28:553
339960,0migration/326170-21ntp_offset23:03:473
339960,0migration/324373-21pmu-power23:58:503
339960,0migration/317877-21sh21:44:323
339960,0migration/315392-21sh00:33:443
339960,0migration/314688-21sh21:24:093
339960,0migration/31200-21sh00:04:043
29805060,0irq/28-eth0-rx-6064-21sshd00:44:343
19160,0ktimersoftd/10-21swapper/122:03:481
149960,0migration/027709-21sh21:52:280
4150,0ktimersoftd/00-21swapper/023:39:320
35150,0ktimersoftd/30-21swapper/321:18:283
339950,0migration/38370-21fschecks_time20:38:403
339950,0migration/38223-21fschecks_time23:33:413
339950,0migration/3699-21latency_hist23:48:283
339950,0migration/35383-21df_abs23:13:403
339950,0migration/33983-21latency_hist20:13:263
339950,0migration/332052-21kthreadcore19:23:433
339950,0migration/331454-21runrttasks19:43:463
339950,0migration/329932-21kthreadcore22:28:463
339950,0migration/328642-21taskset20:48:563
339950,0migration/326748-21kthreadcore22:08:453
339950,0migration/326420-21taskset22:48:313
339950,0migration/325380-21taskset20:28:103
339950,0migration/325289-21kthreadcore00:38:463
339950,0migration/325148-21kthreadcore23:23:443
339950,0migration/320225-21kthreadcore21:28:463
339950,0migration/318220-21latency_hist19:38:263
339950,0migration/31803-21latency_hist21:38:273
339950,0migration/314992-21munin-node19:58:413
339950,0migration/314855-21latency_hist20:43:273
339950,0migration/314046-21kthreadcore23:53:463
339950,0migration/310748-21taskset19:31:583
329950,0watchdog/33877-21cat20:33:463
329950,0watchdog/33411-21sh23:10:023
329950,0watchdog/326043-21cut23:43:463
329950,0watchdog/324153-21python22:43:503
329950,0watchdog/323618-21ssh22:27:383
329950,0watchdog/321253-21ssh22:07:183
329950,0watchdog/310414-21kthreadcore00:48:463
29815050,0irq/29-eth0-tx-7073-21ssh00:47:182
29815050,0irq/29-eth0-tx-13859-21unixbench-2d23:33:522
29815050,0irq/29-eth0-tx-13061-21iostat_ios00:13:442
29815050,0irq/29-eth0-tx-0-21swapper/223:32:012
29815050,0irq/29-eth0-tx-0-21swapper/223:06:552
29815050,0irq/29-eth0-tx-0-21swapper/021:23:280
29815050,0irq/29-eth0-tx-0-21swapper/019:58:470
29805050,0irq/28-eth0-rx-6859-21cut20:58:443
29805050,0irq/28-eth0-rx-6665-21sh22:18:273
29805050,0irq/28-eth0-rx-27711-21kthreadcore21:33:443
29805050,0irq/28-eth0-rx-17617-21python21:03:503
29805050,0irq/28-eth0-rx-15529-21python22:38:513
29805050,0irq/28-eth0-rx-12694-21tune2fs00:13:423
29805050,0irq/28-eth0-rx-12475-21munin-node22:58:453
29805050,0irq/28-eth0-rx-0-21swapper/323:41:373
29805050,0irq/28-eth0-rx-0-21swapper/322:54:353
29805050,0irq/28-eth0-rx-0-21swapper/321:58:423
29805050,0irq/28-eth0-rx-0-21swapper/321:50:523
29805050,0irq/28-eth0-rx-0-21swapper/300:25:343
29805050,0irq/28-eth0-rx-0-21swapper/300:20:143
288359955,0cyclictest0-21swapper/200:39:062
288359950,0cyclictest0-21swapper/223:42:392
288359950,0cyclictest0-21swapper/222:49:512
288349955,0cyclictest0-21swapper/123:52:341
288349955,0cyclictest0-21swapper/123:08:441
288349955,0cyclictest0-21swapper/122:37:031
288349950,0cyclictest0-21swapper/123:36:391
288349950,0cyclictest0-21swapper/122:31:131
288349950,0cyclictest0-21swapper/122:12:371
288349950,0cyclictest0-21swapper/100:50:161
288339950,0cyclictest0-21swapper/023:02:290
27150,0ktimersoftd/20-21swapper/222:03:482
259950,0migration/26297-21kernelversion21:58:472
259950,0migration/224359-21timerwakeupswit22:43:532
259950,0migration/222008-21kthreadcore21:48:442
259950,0migration/221698-21kthreadcore21:08:442
259950,0migration/217790-21sh23:58:062
259950,0migration/217365-21switchtime21:43:522
249950,0watchdog/24643-21tr22:33:462
19150,0ktimersoftd/10-21swapper/122:45:241
19150,0ktimersoftd/10-21swapper/122:22:331
19150,0ktimersoftd/10-21swapper/100:46:101
179950,0migration/17514-21taskset21:21:481
179950,0migration/13832-21kthreadcore20:33:461
179950,0migration/126538-21needreboot00:18:471
179950,0migration/125533-21taskset21:13:121
179950,0migration/121977-21switchtime22:23:511
179950,0migration/120723-21sh23:19:411
179950,0migration/120098-21sh23:03:381
179950,0migration/120073-21kthreadcore23:58:461
179950,0migration/118182-21munin-node00:13:511
179950,0migration/117452-21sh23:57:101
179950,0migration/117053-21munin-node21:43:471
179950,0migration/113208-21kthreadcore22:58:471
169950,0watchdog/126937-21cut20:03:451
149950,0migration/09066-21kthreadcore00:28:470
149950,0migration/08718-21kthreadcore00:08:460
149950,0migration/08103-21kthreadcore22:53:450
149950,0migration/07841-21munin-node00:48:400
149950,0migration/06918-21kthreadcore20:13:450
149950,0migration/05132-21aten2.4-expect23:13:390
149950,0migration/05102-21gltestperf20:58:410
149950,0migration/03285-21kthreadcore20:33:450
149950,0migration/032167-21kthreadcore21:53:450
149950,0migration/031281-21kthreadcore19:23:420
149950,0migration/031084-21kthreadcore23:08:450
149950,0migration/029523-21cpuspeed_turbos20:53:380
149950,0migration/029145-21taskset20:08:340
149950,0migration/026762-21irqcore19:43:430
149950,0migration/026458-21kthreadcore00:38:460
149950,0migration/026355-21fschecks_count21:13:390
149950,0migration/025305-21munin-node22:28:430
149950,0migration/025052-21kthreadcore22:08:450
149950,0migration/024311-21missed_timers20:23:450
149950,0migration/022276-21latency_hist23:23:280
149950,0migration/021887-21kthreadcore23:58:470
149950,0migration/02181-21taskset22:52:460
149950,0migration/021197-21kthreadcore22:23:450
149950,0migration/021059-21taskset23:20:370
149950,0migration/02077-21kthreadcore00:43:460
149950,0migration/020429-21latency_hist00:18:270
149950,0migration/01973-21kthreadcore00:23:470
149950,0migration/018699-21aten_r1power_po21:08:380
149950,0migration/018590-21kthreadcore22:03:450
149950,0migration/018239-21munin-node21:28:450
149950,0migration/017766-21runrttasks19:35:050
149950,0migration/016272-21irqcore20:43:420
149950,0migration/016112-21kthreadcore00:33:460
149950,0migration/015138-21sh22:22:580
149950,0migration/014194-21kthreadcore21:03:440
149950,0migration/014022-21kthreadcore22:38:470
149950,0migration/013223-21irqcore00:13:450
149950,0migration/011105-21aten_r1power_po21:43:380
149950,0migration/010712-21missed_timers21:58:500
149950,0migration/010333-21sh21:42:340
8305040,0irq/26-0000:00:0-21swapper/319:53:423
8305040,0irq/26-0000:00:0-21swapper/222:13:272
35140,0ktimersoftd/30-21swapper/320:12:343
339940,0migration/332116-21timerandwakeup21:13:503
339940,0migration/331412-21kthreadcore20:53:453
339940,0migration/325466-21taskset21:12:243
339940,0migration/317359-21kthreadcore23:18:453
329940,0watchdog/33508-21ssh21:56:023
329940,0watchdog/317944-21taskset19:37:093
329940,0watchdog/30-21swapper/322:18:463
329940,0watchdog/30-21swapper/320:28:463
329940,0watchdog/30-21swapper/320:03:453
29815040,0irq/29-eth0-tx-32411-21ssh21:34:192
29815040,0irq/29-eth0-tx-26843-21munin-node00:03:542
29815040,0irq/29-eth0-tx-2586-21ssh23:08:502
29815040,0irq/29-eth0-tx-19271-21ssh23:58:442
29815040,0irq/29-eth0-tx-0-21swapper/223:48:372
29815040,0irq/29-eth0-tx-0-21swapper/223:23:382
29815040,0irq/29-eth0-tx-0-21swapper/223:20:552
29815040,0irq/29-eth0-tx-0-21swapper/222:38:562
29815040,0irq/29-eth0-tx-0-21swapper/222:18:462
29815040,0irq/29-eth0-tx-0-21swapper/222:08:472
29815040,0irq/29-eth0-tx-0-21swapper/221:53:382
29815040,0irq/29-eth0-tx-0-21swapper/221:38:322
29815040,0irq/29-eth0-tx-0-21swapper/200:18:442
29815040,0irq/29-eth0-tx-0-21swapper/021:18:390
29815040,0irq/29-eth0-tx-0-21swapper/020:38:410
29805040,0irq/28-eth0-rx-0-21swapper/300:09:363
288359943,0cyclictest8872-21awk00:48:442
288359943,0cyclictest4342-21awk00:08:442
288359943,0cyclictest3571-21lldpd22:29:572
288359943,0cyclictest3571-21lldpd21:01:252
288359943,0cyclictest3571-21lldpd20:44:252
288359943,0cyclictest3571-21lldpd19:45:522
288359943,0cyclictest3524-21snmpd23:43:392
288359943,0cyclictest3250-21irqbalance23:13:342
288359943,0cyclictest3250-21irqbalance21:23:332
288359943,0cyclictest3250-21irqbalance21:18:432
288359943,0cyclictest3250-21irqbalance19:33:332
288359943,0cyclictest3250-21irqbalance19:28:332
288359943,0cyclictest3250-21irqbalance19:24:232
288359943,0cyclictest3250-21irqbalance00:28:342
288359943,0cyclictest19510-21awk20:23:412
288359943,0cyclictest12507-21awk22:58:452
288359940,0cyclictest2744-21munin-node22:53:492
288349944,0cyclictest0-21swapper/122:48:431
288349944,0cyclictest0-21swapper/121:58:351
288349943,0cyclictest5092-21awk19:28:431
288349943,0cyclictest3524-21snmpd21:48:381
288349943,0cyclictest32118-21awk23:28:451
288349943,0cyclictest27913-21awk00:03:431
288349943,0cyclictest23250-21awk20:48:421
288349943,0cyclictest15839-21awk19:58:441
288349943,0cyclictest12531-21awk21:03:431
288339944,0cyclictest0-21swapper/023:44:060
288339944,0cyclictest0-21swapper/022:33:480
288339943,0cyclictest3524-21snmpd21:33:530
288339943,0cyclictest31765-21awk22:13:440
288339943,0cyclictest27943-21awk00:03:430
288339943,0cyclictest10886-21sadc19:33:260
288339940,0cyclictest0-21swapper/020:21:450
259940,0migration/27669-21latency_hist20:38:272
259940,0migration/228566-21kthreadcore21:13:432
259940,0migration/215087-21cpuspeed_turbos19:58:412
259940,0migration/214466-21kthreadcore21:03:442
259940,0migration/211304-21taskset20:18:372
259940,0migration/21049-21fschecks_time19:48:402
249940,0watchdog/230040-21perl00:23:422
249940,0watchdog/22317-21kthreadcore20:53:462
249940,0watchdog/217641-21smartctl21:28:422
249940,0watchdog/211218-21kthreadcore19:53:452
249940,0watchdog/20-21swapper/222:23:382
249940,0watchdog/20-21swapper/220:33:422
249940,0watchdog/20-21swapper/200:33:342
179940,0migration/17086-21kthreadcore22:53:441
179940,0migration/15857-21taskset22:16:141
179940,0migration/15614-21irqrtprio20:58:441
179940,0migration/131505-21kthreadcore00:23:461
179940,0migration/130221-21if_eth1.319:23:411
179940,0migration/130185-21if_err_eth020:08:421
179940,0migration/129663-21kthreadcore21:33:451
179940,0migration/125979-21kthreadcore23:23:451
179940,0migration/124608-21kthreadcore00:38:461
179940,0migration/120900-21kthreadcore21:28:461
179940,0migration/118669-21kthreadcore23:38:451
179940,0migration/117376-21switchtime19:33:511
179940,0migration/111750-21fschecks_count20:18:391
169940,0watchdog/13524-21snmpd00:09:021
169940,0watchdog/12318-21kthreadcore20:53:461
169940,0watchdog/112391-21ssh23:15:461
169940,0watchdog/110607-21ssh21:43:101
169940,0watchdog/110096-21perl22:38:421
169940,0watchdog/10-21swapper/120:13:461
169940,0watchdog/10-21swapper/119:53:531
149940,0migration/08044-21sh23:50:000
149940,0migration/022480-21kthreadcore22:43:450
329930,0watchdog/30-21swapper/320:19:343
29815030,0irq/29-eth0-tx-0-21swapper/020:48:370
29815030,0irq/29-eth0-tx-0-21swapper/020:03:390
29805030,0irq/28-eth0-rx-0-21swapper/319:48:393
288359932,0cyclictest3524-21snmpd19:40:522
288359932,0cyclictest29151-21munin-node20:08:502
288359930,0cyclictest26800-21if_eth1.320:28:442
288349933,0cyclictest15394-21awk00:33:441
288349932,0cyclictest8943-21sort21:23:421
288349932,0cyclictest8880-21awk20:38:421
288349932,0cyclictest7366-21kthreadcore00:28:471
288349932,0cyclictest3524-21snmpd19:48:371
288349932,0cyclictest3524-21snmpd19:43:371
288349932,0cyclictest23261-21kthreadcore19:38:441
288349932,0cyclictest19387-21expr20:23:391
288349931,0cyclictest17422-21kthreadcore20:43:431
288349930,0cyclictest25130-21cut23:43:431
288339933,0cyclictest20804-21kworker/0:023:33:440
288339932,0cyclictest7028-21sadc23:33:280
288339932,0cyclictest3524-21snmpd20:33:190
288339932,0cyclictest1294-21awk19:48:420
288339932,0cyclictest10664-21awk23:53:440
288339930,0cyclictest20010-21sh23:03:310
288339930,0cyclictest19491-21iostat_ios19:38:430
249930,0watchdog/20-21swapper/220:48:382
249930,0watchdog/20-21swapper/220:13:462
249930,0watchdog/20-21swapper/220:03:452
179930,0migration/125919-21aten_r1power_po21:13:371
169930,0watchdog/10-21swapper/121:55:061
169930,0watchdog/10-21swapper/120:28:461
288339920,0cyclictest0-21swapper/019:53:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional