You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 10:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Sun Jan 11, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1184923927,0sleep20-21swapper/219:11:562
1176023626,0sleep30-21swapper/319:10:533
1163423420,0sleep00-21swapper/019:09:260
1158123425,0sleep10-21swapper/119:08:471
11962991616,0cyclictest4630-21sensors22:12:501
339960,0migration/3479-21sh21:32:583
339960,0migration/33182-21sh21:54:073
339960,0migration/324492-21sh22:07:443
339960,0migration/31777-21munin-node22:32:433
339960,0migration/316720-21sh23:55:253
339960,0migration/315133-21munin-node20:17:513
339960,0migration/31324-21sh22:50:033
329960,0watchdog/310002-21perl21:02:413
29815060,0irq/29-eth0-tx-23001-21munin-node19:42:440
29815060,0irq/29-eth0-tx-16430-21munin-node21:07:470
29815060,0irq/29-eth0-tx-15822-21munin-node19:37:460
29805060,0irq/28-eth0-rx-6004-21ssh22:15:423
29805060,0irq/28-eth0-rx-21022-21iostat00:17:433
29805060,0irq/28-eth0-rx-15427-21kthreadcore23:17:453
149960,0migration/025626-21sh21:31:460
119639965,0cyclictest6582-21latency_hist23:32:272
119639960,0cyclictest0-21swapper/221:31:112
119619960,0cyclictest0-21swapper/020:12:540
339950,0migration/38986-21kthreadcore20:37:443
339950,0migration/38762-21aten_r1power_po21:22:383
339950,0migration/36592-21kthreadcore23:12:443
339950,0migration/36272-21irqrtprio21:57:433
339950,0migration/331618-21taskset22:29:593
339950,0migration/328780-21runrttasks23:23:133
339950,0migration/328370-21kthreadcore00:02:443
339950,0migration/327928-21kthreadcore20:27:453
339950,0migration/327780-21kthreadcore19:42:453
339950,0migration/325416-21kthreadcore00:37:463
339950,0migration/325372-21kthreadcore20:47:483
339950,0migration/325313-21taskset00:00:273
339950,0migration/32344-21idleruntime19:27:413
339950,0migration/320519-21sh00:34:013
339950,0migration/319578-21kthreadcore22:42:453
339950,0migration/314554-21kthreadcore22:57:443
339950,0migration/313620-21gltestperf20:42:413
339950,0migration/312969-21fschecks_count19:57:413
339950,0migration/31253-21taskset20:11:473
339950,0migration/311635-21kthreadcore23:32:463
329950,0watchdog/329266-21perl23:07:423
329950,0watchdog/327749-21iostat_ios19:22:413
329950,0watchdog/322327-21ssh22:23:063
329950,0watchdog/311363-21python19:52:493
329950,0watchdog/30-21swapper/320:22:453
329950,0watchdog/30-21swapper/319:37:373
329950,0watchdog/30-21swapper/300:27:463
29815050,0irq/29-eth0-tx-30245-21munin-node19:47:460
29815050,0irq/29-eth0-tx-26432-21ssh00:02:382
29815050,0irq/29-eth0-tx-23422-21diskmemload23:37:032
29815050,0irq/29-eth0-tx-1539-21ssh22:50:402
29815050,0irq/29-eth0-tx-0-21swapper/223:57:432
29815050,0irq/29-eth0-tx-0-21swapper/222:41:182
29815050,0irq/29-eth0-tx-0-21swapper/021:13:110
29815050,0irq/29-eth0-tx-0-21swapper/020:57:290
29815050,0irq/29-eth0-tx-0-21swapper/020:02:270
29805050,0irq/28-eth0-rx-7913-21python20:12:533
29805050,0irq/28-eth0-rx-536-21ssh21:17:393
29805050,0irq/28-eth0-rx-536-21ssh21:17:393
29805050,0irq/28-eth0-rx-26684-21ssh21:48:203
29805050,0irq/28-eth0-rx-2643-21cut00:07:393
29805050,0irq/28-eth0-rx-24140-21ssh21:27:583
29805050,0irq/28-eth0-rx-0-21swapper/323:47:403
29805050,0irq/28-eth0-rx-0-21swapper/322:52:403
29805050,0irq/28-eth0-rx-0-21swapper/322:37:463
29805050,0irq/28-eth0-rx-0-21swapper/322:20:493
29805050,0irq/28-eth0-rx-0-21swapper/321:37:463
29805050,0irq/28-eth0-rx-0-21swapper/321:12:373
29805050,0irq/28-eth0-rx-0-21swapper/300:22:383
29805050,0irq/28-eth0-rx-0-21swapper/300:12:373
259950,0migration/227534-21hwlatdetect19:22:392
259950,0migration/223745-21aten_r1power_fr21:12:372
259950,0migration/22127-21fschecks_count20:12:422
259950,0migration/219155-21sh21:46:202
259950,0migration/215390-21munin-node23:52:482
259950,0migration/21276-21kthreadcore22:12:452
259950,0migration/210918-21latency_hist22:57:262
179950,0migration/17577-21missed_timers20:12:481
179950,0migration/16037-21gltestperf19:52:391
179950,0migration/14736-21kthreadcore19:27:441
179950,0migration/121641-21munin-node22:22:451
179950,0migration/117698-21munin-node22:42:391
179950,0migration/111397-21unixbench_singl23:12:541
179950,0migration/110910-21ntp_offset00:27:491
169950,0watchdog/132325-21cpuspeed_turbos21:17:371
169950,0watchdog/132325-21cpuspeed_turbos21:17:371
149950,0migration/09794-21fschecks_count21:02:410
149950,0migration/08612-21taskset19:32:290
149950,0migration/06479-21unixbench_singl21:17:510
149950,0migration/06479-21unixbench_singl21:17:510
149950,0migration/04169-21kthreadcore22:52:430
149950,0migration/031816-21irqcore23:27:430
149950,0migration/02991-21taskset23:08:300
149950,0migration/028458-21timerandwakeup22:07:520
149950,0migration/027691-21sh21:51:110
149950,0migration/019015-21kthreadcore22:02:450
149950,0migration/018935-21kthreadcore23:37:430
149950,0migration/018087-21taskset22:58:280
149950,0migration/017945-21sh00:12:580
149950,0migration/015521-21sh22:22:310
149950,0migration/015008-21kernelversion00:32:440
149950,0migration/013135-21latency_hist22:02:260
149950,0migration/013083-21munin-node22:17:480
149950,0migration/011683-21taskset23:13:340
119639955,0cyclictest0-21swapper/223:10:032
119639955,0cyclictest0-21swapper/221:55:572
119639950,0cyclictest0-21swapper/223:38:062
119639950,0cyclictest0-21swapper/222:58:132
119639950,0cyclictest0-21swapper/221:52:192
119639950,0cyclictest0-21swapper/221:18:162
119639950,0cyclictest0-21swapper/221:18:162
119619955,0cyclictest0-21swapper/000:25:470
119619954,0cyclictest24430-21awk20:27:420
119619954,0cyclictest10292-21tr20:17:440
119619953,0cyclictest8180-21kworker/0:123:54:320
119619950,0cyclictest0-21swapper/019:22:270
8305040,0irq/26-0000:00:19313-21latency_hist19:17:263
339940,0migration/3535-21kthreadcore19:47:443
329940,0watchdog/322639-21cut20:02:453
329940,0watchdog/30-21swapper/323:42:463
329940,0watchdog/30-21swapper/323:39:303
329940,0watchdog/30-21swapper/322:02:453
29815040,0irq/29-eth0-tx-29026-21ssh22:08:472
29815040,0irq/29-eth0-tx-17696-21munin-node22:42:422
29815040,0irq/29-eth0-tx-11847-21ssh23:14:022
29815040,0irq/29-eth0-tx-0-21swapper/223:47:452
29815040,0irq/29-eth0-tx-0-21swapper/223:42:312
29815040,0irq/29-eth0-tx-0-21swapper/222:22:312
29815040,0irq/29-eth0-tx-0-21swapper/222:19:492
29815040,0irq/29-eth0-tx-0-21swapper/221:57:272
29815040,0irq/29-eth0-tx-0-21swapper/221:37:412
29815040,0irq/29-eth0-tx-0-21swapper/200:37:482
29815040,0irq/29-eth0-tx-0-21swapper/200:27:392
29815040,0irq/29-eth0-tx-0-21swapper/200:17:492
29815040,0irq/29-eth0-tx-0-21swapper/200:12:442
29815040,0irq/29-eth0-tx-0-21swapper/200:08:122
29805040,0irq/28-eth0-rx-3783-21crond19:36:263
29805040,0irq/28-eth0-rx-0-21swapper/323:27:453
29805040,0irq/28-eth0-rx-0-21swapper/323:03:003
29805040,0irq/28-eth0-rx-0-21swapper/321:43:143
259940,0migration/25025-21runrttasks20:35:162
259940,0migration/227973-21kthreadcore22:27:452
259940,0migration/227171-21sh20:52:372
259940,0migration/226823-21aten_r1power_fr20:07:382
259940,0migration/226741-21runrttasks20:50:572
259940,0migration/223409-21df_abs19:42:392
259940,0migration/221933-21aten_r1power_cu23:22:382
259940,0migration/21631-21cpuspeed_turbos19:27:382
259940,0migration/21330-21kthreadcore19:47:452
259940,0migration/212373-21runrttasks20:41:202
249940,0watchdog/232763-21munin-node22:32:462
249940,0watchdog/229505-21basename00:22:422
249940,0watchdog/228344-21tr20:27:452
249940,0watchdog/219129-21ksmtuned20:00:412
249940,0watchdog/219038-21kthreadcore23:17:462
249940,0watchdog/20-21swapper/221:32:412
179940,0migration/1920-21taskset20:07:571
179940,0migration/131851-21kthreadcore00:02:451
179940,0migration/131232-21fschecks_time20:32:391
179940,0migration/130396-21kthreadcore23:07:461
179940,0migration/128915-21kthreadcore20:52:431
179940,0migration/127155-21sh23:04:431
179940,0migration/12661-21fschecks_time20:57:391
179940,0migration/121976-21kthreadcore19:17:421
179940,0migration/121240-21irqcore20:47:461
179940,0migration/120976-21kthreadcore21:27:451
179940,0migration/120324-21taskset00:33:281
179940,0migration/119991-21unixbench_singl23:17:541
179940,0migration/117251-21kthreadcore23:37:431
179940,0migration/115203-21kthreadcore19:57:451
179940,0migration/114875-21munin-node21:22:481
179940,0migration/113459-21kthreadcore22:57:441
179940,0migration/113357-21kthreadcore21:42:431
179940,0migration/110421-21taskset20:17:441
169940,0watchdog/14242-21ssh21:56:571
169940,0watchdog/130155-21ssh22:11:581
169940,0watchdog/126228-21ssh22:47:301
169940,0watchdog/12604-21rm22:52:381
169940,0watchdog/123001-21munin-node19:42:491
169940,0watchdog/120170-21ssh22:03:051
169940,0watchdog/118958-21ssh00:15:501
169940,0watchdog/110785-21kthreadcore21:02:451
169940,0watchdog/110719-21ssh21:41:491
169940,0watchdog/10-21swapper/121:36:131
149940,0migration/031835-21sh23:45:390
149940,0migration/02114-21kthreadcore22:12:450
119639944,0cyclictest0-21swapper/200:32:582
119639943,0cyclictest9731-21awk19:32:422
119639943,0cyclictest6180-21awk19:52:412
119639943,0cyclictest3571-21lldpd21:23:272
119639943,0cyclictest3571-21lldpd20:58:572
119639943,0cyclictest3571-21lldpd20:42:282
119639943,0cyclictest3571-21lldpd20:22:272
119639943,0cyclictest3571-21lldpd19:16:572
119639943,0cyclictest20834-21awk23:02:412
119639943,0cyclictest14541-21awk22:02:432
119639943,0cyclictest10392-21awk21:02:442
119629943,0cyclictest9755-21awk19:32:421
119629943,0cyclictest3571-21lldpd23:59:021
119629943,0cyclictest3571-21lldpd23:42:321
119629943,0cyclictest3571-21lldpd23:33:321
119629943,0cyclictest3571-21lldpd22:27:301
119629943,0cyclictest3571-21lldpd22:18:001
119629943,0cyclictest3571-21lldpd21:57:291
119629943,0cyclictest3571-21lldpd19:51:271
119629943,0cyclictest3571-21lldpd00:18:321
119629943,0cyclictest3571-21lldpd00:10:021
119629943,0cyclictest3524-21snmpd23:50:481
119629943,0cyclictest3524-21snmpd20:39:011
119629943,0cyclictest29562-21awk00:22:421
119629943,0cyclictest23098-21awk23:22:431
119629943,0cyclictest17516-21awk21:07:421
119629943,0cyclictest10297-21awk23:52:431
119619944,0cyclictest0-21swapper/021:42:270
119619944,0cyclictest0-21swapper/000:42:110
119619943,0cyclictest9750-21awk21:22:420
119619943,0cyclictest6601-21awk20:37:420
119619943,0cyclictest3524-21snmpd23:19:330
119619943,0cyclictest29635-21awk21:52:430
119619943,0cyclictest20906-21awk00:17:420
119619943,0cyclictest19365-21munin-node19:17:470
119619943,0cyclictest19138-21idleruntime-cro19:17:260
119619943,0cyclictest19137-21irqrtprio22:42:450
119619943,0cyclictest17249-21awk20:22:430
8305030,0irq/26-0000:00:0-21swapper/319:13:113
8305030,0irq/26-0000:00:0-21swapper/221:07:572
329930,0watchdog/30-21swapper/320:57:293
329930,0watchdog/30-21swapper/320:52:373
29815030,0irq/29-eth0-tx-0-21swapper/020:47:270
29815030,0irq/29-eth0-tx-0-21swapper/019:52:360
29805030,0irq/28-eth0-rx-0-21swapper/321:10:233
29805030,0irq/28-eth0-rx-0-21swapper/320:32:363
259930,0migration/220281-21fschecks_time20:02:412
249930,0watchdog/20-21swapper/219:37:372
179930,0migration/123236-21kthreadcore21:47:441
179930,0migration/12112-21kthreadcore22:32:431
179930,0migration/116318-21kthreadcore19:12:441
169930,0watchdog/125617-21kthreadcore00:37:461
169930,0watchdog/10-21swapper/121:13:131
169930,0watchdog/10-21swapper/120:42:451
169930,0watchdog/10-21swapper/120:22:451
169930,0watchdog/10-21swapper/119:37:291
119639932,0cyclictest3571-21lldpd19:17:272
119639932,0cyclictest10524-21grep20:17:452
119629933,0cyclictest24493-21awk20:27:431
119629932,0cyclictest3571-21lldpd20:03:271
119629932,0cyclictest3524-21snmpd22:37:481
119629932,0cyclictest31634-21awk23:27:411
119629930,0cyclictest0-21swapper/119:26:311
119619933,0cyclictest9866-21kworker/0:122:32:320
119619933,0cyclictest9866-21kworker/0:122:27:280
119619933,0cyclictest9866-21kworker/0:121:37:300
119619933,0cyclictest9866-21kworker/0:121:32:320
119619933,0cyclictest9866-21kworker/0:120:42:390
119619933,0cyclictest9866-21kworker/0:120:32:370
119619933,0cyclictest8180-21kworker/0:123:57:320
119619933,0cyclictest8180-21kworker/0:100:07:280
119619933,0cyclictest20789-21kworker/0:000:27:320
119619933,0cyclictest17026-21kworker/0:219:57:430
119619933,0cyclictest17026-21kworker/0:219:27:310
119619933,0cyclictest1335-21kworker/0:023:47:360
119619933,0cyclictest1335-21kworker/0:023:32:280
119619933,0cyclictest1335-21kworker/0:023:02:340
119619933,0cyclictest1335-21kworker/0:022:47:280
119619933,0cyclictest1335-21kworker/0:022:37:320
119619932,0cyclictest3571-21lldpd00:02:320
119619932,0cyclictest30548-21cut20:07:440
119619932,0cyclictest23024-21awk23:22:430
119619930,0cyclictest0-21swapper/020:53:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional