You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 04:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Wed Sep 23, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2966026563,0sleep10-21swapper/119:29:411
2979624435,0sleep20-21swapper/219:31:182
2995523928,0sleep00-21swapper/019:33:080
2992023727,0sleep30-21swapper/319:32:433
30053991313,0cyclictest3524-21snmpd00:23:381
300529970,0cyclictest27960-21expr23:18:410
339960,0migration/38113-21kthreadcore00:58:453
339960,0migration/37101-21munin-node00:18:473
339960,0migration/33280-21runrttasks23:22:323
339960,0migration/331664-21sh22:41:503
339960,0migration/319025-21sh00:46:183
339960,0migration/318154-21sh23:11:283
339960,0migration/317289-21sh21:37:403
339960,0migration/313749-21sh22:29:263
300549966,0cyclictest28669-40yum-updatesd-he23:36:372
300549960,0cyclictest0-21swapper/222:40:492
300539960,0cyclictest6302-21ssh22:43:531
29805060,0irq/28-eth0-rx-21762-21latency_hist22:18:263
29805060,0irq/28-eth0-rx-20474-21diskstats00:48:403
179960,0migration/116922-21sh21:36:481
149960,0migration/04545-21kthreadcore21:28:460
149960,0migration/027018-21sh21:59:080
339950,0migration/39811-21munin-node23:23:463
339950,0migration/39137-21munin-node20:48:373
339950,0migration/3523-21munin-node19:53:503
339950,0migration/33940-21kthreadcore22:23:473
339950,0migration/331906-21kthreadcore19:33:503
339950,0migration/331436-21kthreadcore22:03:423
339950,0migration/331410-21gltestperf20:18:403
339950,0migration/330523-21kthreadcore21:23:443
339950,0migration/324522-21kthreadcore19:48:443
339950,0migration/32364-21munin-node21:28:423
339950,0migration/316132-21fschecks_time22:33:463
339950,0migration/315113-21munin-node23:48:413
339950,0migration/313531-21idleruntime23:28:433
339950,0migration/312530-21latency_hist20:28:263
339950,0migration/311727-21munin-node21:08:513
339950,0migration/311540-21timerwakeupswit19:38:513
339950,0migration/310549-21kthreadcore00:03:433
329950,0watchdog/37578-21cut22:08:453
329950,0watchdog/328100-21cut00:33:463
329950,0watchdog/316972-21fschecks_time00:08:423
329950,0watchdog/311237-21memory20:23:453
329950,0watchdog/310346-21ssh21:50:493
329950,0watchdog/30-21swapper/321:13:533
329950,0watchdog/30-21swapper/319:58:413
300549955,0cyclictest0-21swapper/223:56:012
300549955,0cyclictest0-21swapper/223:38:312
300549955,0cyclictest0-21swapper/222:49:012
300549955,0cyclictest0-21swapper/200:44:062
300549950,0cyclictest0-21swapper/223:32:502
300549950,0cyclictest0-21swapper/223:09:212
300549950,0cyclictest0-21swapper/222:44:552
300549950,0cyclictest0-21swapper/222:32:372
300549950,0cyclictest0-21swapper/222:24:252
300549950,0cyclictest0-21swapper/219:33:312
300539955,0cyclictest0-21swapper/123:13:501
300539955,0cyclictest0-21swapper/122:36:281
300539955,0cyclictest0-21swapper/100:48:161
300539950,0cyclictest0-21swapper/123:53:061
300539950,0cyclictest0-21swapper/121:46:011
300539950,0cyclictest0-21swapper/100:36:461
300539950,0cyclictest0-21swapper/100:03:021
300529955,0cyclictest0-21swapper/023:48:290
300529950,0cyclictest0-21swapper/023:13:000
300529950,0cyclictest0-21swapper/023:06:140
300529950,0cyclictest0-21swapper/022:57:330
300529950,0cyclictest0-21swapper/022:21:080
29815050,0irq/29-eth0-tx-0-21swapper/020:28:470
29815050,0irq/29-eth0-tx-0-21swapper/019:38:410
29805050,0irq/28-eth0-rx-681-21timerwakeupswit21:43:533
29805050,0irq/28-eth0-rx-3524-21snmpd22:18:383
29805050,0irq/28-eth0-rx-29284-21kthreadcore00:13:463
29805050,0irq/28-eth0-rx-2871-21munin-node00:38:413
29805050,0irq/28-eth0-rx-27842-21seq22:01:353
29805050,0irq/28-eth0-rx-27012-21load23:33:513
29805050,0irq/28-eth0-rx-25902-21grep20:58:423
29805050,0irq/28-eth0-rx-24841-21ksmtuned21:39:283
29805050,0irq/28-eth0-rx-24255-21cut23:53:423
29805050,0irq/28-eth0-rx-24084-21grep20:13:413
29805050,0irq/28-eth0-rx-17842-21kthreadcore20:53:453
29805050,0irq/28-eth0-rx-1544-21tr23:58:443
29805050,0irq/28-eth0-rx-0-21swapper/323:38:453
29805050,0irq/28-eth0-rx-0-21swapper/323:01:233
29805050,0irq/28-eth0-rx-0-21swapper/322:54:293
29805050,0irq/28-eth0-rx-0-21swapper/322:48:393
29805050,0irq/28-eth0-rx-0-21swapper/321:56:533
29805050,0irq/28-eth0-rx-0-21swapper/321:18:403
29805050,0irq/28-eth0-rx-0-21swapper/300:23:463
259950,0migration/29421-21fschecks_count20:03:402
249950,0watchdog/28604-21kthreadcore23:23:462
179950,0migration/15854-21munin-node21:08:421
179950,0migration/131072-21kthreadcore22:03:421
179950,0migration/126403-21munin-node00:48:501
179950,0migration/123256-21latency_hist20:58:251
179950,0migration/122717-21munin-node00:08:531
179950,0migration/120973-21sh23:33:281
179950,0migration/117361-21kthreadcore21:53:441
179950,0migration/113296-21latency_hist22:13:261
179950,0migration/111941-21munin-node20:23:521
169950,0watchdog/18605-21kthreadcore23:23:461
169950,0watchdog/17827-21ps19:58:491
149950,0migration/0976-21sh21:44:070
149950,0migration/09311-21aten_r1power_en21:33:420
149950,0migration/08812-21kthreadcore00:58:450
149950,0migration/0843-21fschecks_time22:43:460
149950,0migration/08354-21kthreadcore20:23:430
149950,0migration/06803-21kthreadcore21:48:450
149950,0migration/06019-21idleruntime22:08:430
149950,0migration/05754-21latency_hist23:43:270
149950,0migration/05275-21taskset22:24:430
149950,0migration/04559-21switchtime21:03:510
149950,0migration/030999-21sh22:39:540
149950,0migration/030385-21kthreadcore22:03:420
149950,0migration/030086-21sh23:55:140
149950,0migration/029731-21switchtime20:58:490
149950,0migration/02815-21sh00:38:290
149950,0migration/023504-21taskset00:10:400
149950,0migration/023066-21kthreadcore00:28:450
149950,0migration/022899-21kthreadcore21:18:440
149950,0migration/020525-21sh23:32:480
149950,0migration/019450-21latency_hist19:48:260
149950,0migration/018332-21kthreadcore20:08:430
149950,0migration/016594-21if_eth1.222:33:480
149950,0migration/014266-21fschecks_time22:13:400
149950,0migration/013711-21kthreadcore20:48:440
149950,0migration/011551-21kthreadcore00:23:460
149950,0migration/011393-21latency_hist00:43:270
8305040,0irq/26-0000:00:2633-21switchtime00:53:522
4140,0ktimersoftd/00-21swapper/023:18:040
339940,0migration/35600-21kthreadcore20:43:453
339940,0migration/319504-21irqcore00:28:433
339940,0migration/314807-21needreboot20:03:463
339940,0migration/312625-21cpuspeed_turbos19:43:383
329940,0watchdog/36314-21runrttasks21:05:013
329940,0watchdog/30-21swapper/320:33:453
300549944,0cyclictest0-21swapper/221:48:382
300549943,0cyclictest6601-21awk21:08:452
300549943,0cyclictest6390-21awk20:23:412
300549943,0cyclictest3571-21lldpd22:35:372
300549943,0cyclictest3571-21lldpd20:52:052
300549943,0cyclictest3571-21lldpd01:02:082
300549943,0cyclictest3524-21snmpd23:03:542
300549943,0cyclictest3524-21snmpd21:24:372
300549943,0cyclictest3524-21snmpd21:20:072
300549943,0cyclictest3524-21snmpd20:55:072
300549943,0cyclictest3524-21snmpd19:58:362
300549943,0cyclictest3524-21snmpd19:51:212
300549943,0cyclictest29811-21awk22:03:402
300549943,0cyclictest27869-21awk19:53:412
300549943,0cyclictest26710-21munin-node00:33:412
300549943,0cyclictest24309-21pmu-power00:28:482
300549943,0cyclictest17171-21awk20:08:412
300549943,0cyclictest12126-21sadc19:43:262
300549943,0cyclictest10682-21awk00:23:442
300539944,0cyclictest0-21swapper/121:23:381
300539943,0cyclictest9880-21awk22:48:431
300539943,0cyclictest4025-21awk21:48:431
300539943,0cyclictest3571-21lldpd22:39:071
300539943,0cyclictest3571-21lldpd22:32:071
300539943,0cyclictest3571-21lldpd21:31:061
300539943,0cyclictest3571-21lldpd19:46:051
300539943,0cyclictest28792-21awk23:18:441
300539943,0cyclictest2839-21awk20:43:421
300539943,0cyclictest27893-21awk19:53:411
300539943,0cyclictest23178-21awk22:18:411
300539943,0cyclictest20990-21awk20:33:421
300539943,0cyclictest19309-21awk00:28:431
300539943,0cyclictest18952-21awk21:38:431
300539943,0cyclictest11755-21awk23:08:441
300529944,0cyclictest32364-21kworker/0:221:53:430
300529944,0cyclictest0-21swapper/000:54:040
300529943,0cyclictest8746-21awk00:03:400
300529943,0cyclictest7901-21awk22:28:410
300529943,0cyclictest5088-21awk23:23:430
300529943,0cyclictest3571-21lldpd00:49:070
300529943,0cyclictest3571-21lldpd00:35:380
300529943,0cyclictest3524-21snmpd00:21:400
300529943,0cyclictest3250-21irqbalance22:59:030
300529943,0cyclictest3250-21irqbalance21:24:020
300529943,0cyclictest3250-21irqbalance21:09:220
300529943,0cyclictest3250-21irqbalance19:34:120
300529943,0cyclictest28023-21awk20:38:410
300529943,0cyclictest22137-21awk23:33:480
300529943,0cyclictest20848-21awk20:33:410
300529943,0cyclictest19098-21awk21:38:440
300529943,0cyclictest13883-21awk21:13:440
29815040,0irq/29-eth0-tx-8983-21diskmemload22:53:392
29815040,0irq/29-eth0-tx-27696-21munin-node23:18:422
29815040,0irq/29-eth0-tx-27516-21tune2fs21:43:422
29815040,0irq/29-eth0-tx-22050-21munin-node22:18:522
29815040,0irq/29-eth0-tx-16246-21munin-node00:08:432
29815040,0irq/29-eth0-tx-16064-21kthreadcore23:48:452
29815040,0irq/29-eth0-tx-13793-21ssh23:47:192
29815040,0irq/29-eth0-tx-0-21swapper/223:02:532
29815040,0irq/29-eth0-tx-0-21swapper/222:14:502
29815040,0irq/29-eth0-tx-0-21swapper/221:58:442
29815040,0irq/29-eth0-tx-0-21swapper/221:53:412
29815040,0irq/29-eth0-tx-0-21swapper/200:49:592
29815040,0irq/29-eth0-tx-0-21swapper/200:13:352
29815040,0irq/29-eth0-tx-0-21swapper/200:06:582
29815040,0irq/29-eth0-tx-0-21swapper/020:45:180
29805040,0irq/28-eth0-rx-0-21swapper/323:43:303
29805040,0irq/28-eth0-rx-0-21swapper/323:13:383
29805040,0irq/28-eth0-rx-0-21swapper/323:03:433
29805040,0irq/28-eth0-rx-0-21swapper/322:43:293
29805040,0irq/28-eth0-rx-0-21swapper/300:53:403
259940,0migration/23114-21cpuspeed_turbos00:38:402
259940,0migration/219910-21fschecks_time23:13:402
259940,0migration/217906-21aten_r1power_cu21:38:392
249940,0watchdog/28097-21ssh00:19:582
249940,0watchdog/26030-21ssh23:59:302
249940,0watchdog/219115-21ls21:13:532
249940,0watchdog/20-21swapper/222:08:452
249940,0watchdog/20-21swapper/221:33:492
249940,0watchdog/20-21swapper/220:18:452
249940,0watchdog/20-21swapper/220:13:452
179940,0migration/18678-21hwlatdetect00:03:401
179940,0migration/17700-21kthreadcore00:38:461
179940,0migration/17278-21kthreadcore00:58:451
179940,0migration/14986-21kthreadcore00:18:451
179940,0migration/13988-21kthreadcore22:23:471
179940,0migration/130598-21kthreadcore00:53:451
179940,0migration/130225-21kthreadcore20:38:441
179940,0migration/121004-21fschecks_time21:58:401
179940,0migration/119348-21kthreadcore20:08:431
179940,0migration/111768-21runrttasks19:39:201
179940,0migration/110263-21kthreadcore23:43:451
169940,0watchdog/124367-21irqrtprio23:53:421
169940,0watchdog/123704-21grep20:58:371
169940,0watchdog/119404-21ssh23:29:301
169940,0watchdog/118386-21ls20:28:451
169940,0watchdog/118129-21fschecks_time22:53:411
169940,0watchdog/10-21swapper/123:03:451
149940,0migration/06363-21kthreadcore19:58:460
149940,0migration/032146-21kthreadcore20:18:440
149940,0migration/030770-21if_eth1.223:38:430
149940,0migration/029832-21kthreadcore00:13:460
149940,0migration/010049-21irqcore22:48:440
329930,0watchdog/30-21swapper/320:38:293
329930,0watchdog/30-21swapper/320:08:373
300549933,0cyclictest3571-21lldpd20:40:352
300549932,0cyclictest3524-21snmpd21:05:072
300549932,0cyclictest3524-21snmpd19:43:512
300549932,0cyclictest3075-21awk21:28:442
300549932,0cyclictest20811-21sort20:33:412
300549932,0cyclictest13793-21awk20:28:432
300539933,0cyclictest3571-21lldpd21:22:361
300539932,0cyclictest3571-21lldpd20:48:351
300539932,0cyclictest20645-21awk19:48:411
300539932,0cyclictest14588-21awk22:13:411
300539930,0cyclictest2961-21grep21:03:441
300539930,0cyclictest10937-21grep20:03:441
300529932,0cyclictest3571-21lldpd00:02:080
300529932,0cyclictest27798-21awk19:53:410
300529930,0cyclictest19984-21diskstats19:48:390
300529930,0cyclictest17090-21perl20:53:410
29815030,0irq/29-eth0-tx-0-21swapper/020:13:430
259930,0migration/21845-21aten_r1power_fr20:43:382
249930,0watchdog/20-21swapper/220:58:372
179930,0migration/1352-21runrttasks22:59:491
169930,0watchdog/13230-21kthreadcore20:18:451
169930,0watchdog/129670-21kthreadcore00:13:461
169930,0watchdog/10-21swapper/123:38:381
169930,0watchdog/10-21swapper/121:13:531
169930,0watchdog/10-21swapper/120:13:411
169930,0watchdog/10-21swapper/119:33:451
300529921,0cyclictest0-21swapper/020:03:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional