You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 16:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Mon May 25, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3100424334,0sleep10-21swapper/107:22:271
3073523526,0sleep20-21swapper/207:19:192
3082923329,0sleep00-21swapper/007:20:260
3080223026,0sleep30-21swapper/307:20:043
8305060,0irq/26-0000:00:10261-21sa109:23:342
4160,0ktimersoftd/07598-21kthreadcore11:48:510
339960,0migration/35201-21sh10:53:303
339960,0migration/33603-21sh09:36:483
339960,0migration/328274-21sh12:00:333
339960,0migration/328077-21munin-node10:28:493
339960,0migration/326928-21sh09:31:393
339960,0migration/322359-21irqcore09:08:503
339960,0migration/322044-21sh12:15:533
339960,0migration/319288-21sh11:54:303
339960,0migration/31729-21latency09:13:533
339960,0migration/315801-21kernelversion10:58:513
339960,0migration/314976-21kthreadcore10:38:523
339960,0migration/314976-21kthreadcore10:38:523
339960,0migration/31028-21sh12:42:503
339960,0migration/310032-21munin-node07:53:453
329960,0watchdog/32954-21taskset08:33:413
311919960,0cyclictest0-21swapper/207:58:592
311869960,0cyclictest0-21swapper/108:22:001
311789960,0cyclictest0-21swapper/008:43:460
29815060,0irq/29-eth0-tx-7292-21cut10:53:512
29815060,0irq/29-eth0-tx-28367-21munin-node09:13:590
29815060,0irq/29-eth0-tx-2693-21munin-node07:48:500
29805060,0irq/28-eth0-rx-11738-21iostat_ios09:23:513
29805060,0irq/28-eth0-rx-0-21swapper/309:53:013
249960,0watchdog/228041-21munin-node09:34:012
149960,0migration/08856-21sh10:17:320
149960,0migration/030917-21kthreadcore08:28:520
149960,0migration/025718-21timerwakeupswit09:29:010
149960,0migration/021119-21fschecks_count10:43:480
149960,0migration/013529-21sh12:11:110
339950,0migration/38664-21kthreadcore08:13:513
339950,0migration/38326-21kthreadcore10:53:523
339950,0migration/37929-21kthreadcore07:48:523
339950,0migration/36087-21kthreadcore09:18:523
339950,0migration/35854-21munin-node12:23:563
339950,0migration/34701-21taskset09:53:543
339950,0migration/330545-21munin-node10:08:533
339950,0migration/324366-21munin-node10:23:553
339950,0migration/322827-21kthreadcore08:43:523
339950,0migration/32158-21kthreadcore12:03:523
339950,0migration/321430-21fschecks_count08:23:473
339950,0migration/314560-21fschecks_count09:03:493
339950,0migration/313126-21kthreadcore12:48:533
339950,0migration/311506-21kthreadcore08:58:523
339950,0migration/310167-21kthreadcore11:13:523
329950,0watchdog/330185-21sleep12:19:383
329950,0watchdog/327572-21aten_r1power_vo11:43:463
329950,0watchdog/325088-21fschecks_time08:03:493
329950,0watchdog/319239-21df_abs11:38:463
329950,0watchdog/311164-21cut09:58:533
329950,0watchdog/310170-21sh11:33:383
329950,0watchdog/30-21swapper/307:38:533
329950,0watchdog/30-21swapper/307:23:493
311919955,0cyclictest10809-21ps09:58:532
311869955,0cyclictest10267-21diskmemload11:23:271
311869955,0cyclictest0-21swapper/112:51:261
311869955,0cyclictest0-21swapper/112:16:261
311869955,0cyclictest0-21swapper/109:49:201
311869954,0cyclictest26614-21grep11:23:511
311869950,0cyclictest0-21swapper/110:52:331
311869950,0cyclictest0-21swapper/110:01:191
29815050,0irq/29-eth0-tx-9069-21ssh12:45:562
29815050,0irq/29-eth0-tx-24384-21munin-node08:03:480
29815050,0irq/29-eth0-tx-15481-21chrt11:16:292
29815050,0irq/29-eth0-tx-1351-21ssh11:43:562
29815050,0irq/29-eth0-tx-13160-21ssh10:38:512
29815050,0irq/29-eth0-tx-13160-21ssh10:38:512
29815050,0irq/29-eth0-tx-11346-21perl09:23:480
29815050,0irq/29-eth0-tx-0-21swapper/212:03:552
29815050,0irq/29-eth0-tx-0-21swapper/211:34:232
29815050,0irq/29-eth0-tx-0-21swapper/211:07:582
29815050,0irq/29-eth0-tx-0-21swapper/211:00:342
29815050,0irq/29-eth0-tx-0-21swapper/210:29:382
29815050,0irq/29-eth0-tx-0-21swapper/210:24:032
29815050,0irq/29-eth0-tx-0-21swapper/210:18:472
29815050,0irq/29-eth0-tx-0-21swapper/210:11:112
29815050,0irq/29-eth0-tx-0-21swapper/210:03:552
29815050,0irq/29-eth0-tx-0-21swapper/209:43:072
29815050,0irq/29-eth0-tx-0-21swapper/209:30:352
29815050,0irq/29-eth0-tx-0-21swapper/009:21:270
29805050,0irq/28-eth0-rx-7316-21cut10:33:533
29805050,0irq/28-eth0-rx-16963-21df_inode11:18:483
29805050,0irq/28-eth0-rx-10153-21kthreadcore09:38:523
29805050,0irq/28-eth0-rx-0-21swapper/312:28:523
29805050,0irq/28-eth0-rx-0-21swapper/311:53:113
29805050,0irq/28-eth0-rx-0-21swapper/311:32:403
29805050,0irq/28-eth0-rx-0-21swapper/311:25:103
29805050,0irq/28-eth0-rx-0-21swapper/311:08:513
29805050,0irq/28-eth0-rx-0-21swapper/311:03:523
29805050,0irq/28-eth0-rx-0-21swapper/310:43:463
29805050,0irq/28-eth0-rx-0-21swapper/310:18:503
29805050,0irq/28-eth0-rx-0-21swapper/310:18:203
29805050,0irq/28-eth0-rx-0-21swapper/310:03:533
29805050,0irq/28-eth0-rx-0-21swapper/309:45:423
259950,0migration/225837-21sh11:39:562
259950,0migration/224639-21cpuspeed_turbos08:03:482
259950,0migration/224290-21idleruntime12:18:492
259950,0migration/221466-21fschecks_count08:23:472
259950,0migration/215695-21idleruntime12:13:492
259950,0migration/212758-21sh12:09:042
259950,0migration/212720-21switchtime08:13:592
259950,0migration/212298-21latency_hist11:53:342
249950,0watchdog/22694-21kthreadcore08:08:492
249950,0watchdog/221292-21cpuspeed_turbos11:58:462
249950,0watchdog/213876-21df_inode09:43:452
19150,0ktimersoftd/10-21swapper/110:53:591
19150,0ktimersoftd/10-21swapper/109:42:051
179950,0migration/1782-21aten_r1power_en10:13:461
179950,0migration/14095-21kthreadcore11:28:511
179950,0migration/130894-21kthreadcore09:33:531
179950,0migration/127588-21sh09:33:121
179950,0migration/123749-21kthreadcore11:38:511
179950,0migration/122318-21kthreadcore08:43:521
179950,0migration/120620-21sh09:45:061
179950,0migration/116911-21idleruntime10:03:501
179950,0migration/11514-21taskset10:30:001
179950,0migration/113333-21munin-node08:59:001
179950,0migration/112915-21fschecks_count11:53:481
169950,0watchdog/14576-21kthreadcore08:33:491
169950,0watchdog/129720-21kthreadcore08:48:531
169950,0watchdog/125376-21ssh10:25:171
169950,0watchdog/10-21swapper/111:43:461
149950,0migration/08279-21vmstat11:29:000
149950,0migration/07716-21needreboot12:43:540
149950,0migration/05446-21kthreadcore08:33:490
149950,0migration/04795-21kthreadcore08:53:510
149950,0migration/0399-21kthreadcore10:48:520
149950,0migration/032606-21kthreadcore09:53:510
149950,0migration/029891-21kthreadcore09:33:530
149950,0migration/024270-21hwlatdetect12:18:490
149950,0migration/024259-21latency_hist08:03:340
149950,0migration/023683-21fschecks_time11:03:480
149950,0migration/020129-21sendmail_mailst09:03:570
149950,0migration/018757-21latency_hist11:38:340
149950,0migration/018352-21kthreadcore09:43:510
149950,0migration/018119-21kernelversion11:18:530
149950,0migration/015031-21taskset11:15:120
149950,0migration/015016-21fschecks_time10:58:470
149950,0migration/014269-21taskset09:59:560
149950,0migration/01308-21kthreadcore12:23:510
149950,0migration/011275-21kthreadcore07:28:510
149950,0migration/010692-21ntp_kernel_err09:38:540
149950,0migration/010323-21aten2.4-expect11:33:470
4140,0ktimersoftd/00-21swapper/010:34:070
339940,0migration/34029-21kthreadcore12:43:523
339940,0migration/331316-21taskset08:49:593
339940,0migration/330924-21kthreadcore07:43:513
339940,0migration/317802-21kthreadcore08:18:533
329940,0watchdog/311814-21kthreadcore08:38:533
329940,0watchdog/30-21swapper/308:28:533
329940,0watchdog/30-21swapper/308:08:493
311919943,0cyclictest3802-21awk07:48:492
311919943,0cyclictest3524-21snmpd09:11:552
311919943,0cyclictest3524-21snmpd08:59:252
311919943,0cyclictest3524-21snmpd08:33:402
311919943,0cyclictest3524-21snmpd07:39:542
311919943,0cyclictest21691-21awk10:43:502
311919943,0cyclictest18542-21awk08:43:492
311919943,0cyclictest14749-21awk08:18:502
311919943,0cyclictest13982-21uniq07:33:472
311919940,0cyclictest0-21swapper/207:28:522
311869944,0cyclictest0-21swapper/111:50:351
311869944,0cyclictest0-21swapper/111:35:451
311869944,0cyclictest0-21swapper/108:38:421
311869943,0cyclictest7371-21awk07:28:481
311869943,0cyclictest3818-21awk07:48:491
311869943,0cyclictest29493-21awk09:13:501
311869943,0cyclictest21747-21awk07:38:501
311869943,0cyclictest15416-21awk10:58:501
311869943,0cyclictest11711-21awk09:23:511
311869940,0cyclictest17282-40yum-updatesd-he10:21:561
311789944,0cyclictest0-21swapper/011:53:540
311789944,0cyclictest0-21swapper/011:09:450
311789944,0cyclictest0-21swapper/010:25:270
311789943,0cyclictest3571-21lldpd12:04:570
311789943,0cyclictest3571-21lldpd10:21:560
311789943,0cyclictest3571-21lldpd08:48:530
311789943,0cyclictest3524-21snmpd12:43:110
311789943,0cyclictest2859-21sadc10:33:350
311789943,0cyclictest21803-21awk07:38:500
311789943,0cyclictest11421-21awk08:38:510
29815040,0irq/29-eth0-tx-0-21swapper/212:38:532
29815040,0irq/29-eth0-tx-0-21swapper/212:24:532
29815040,0irq/29-eth0-tx-0-21swapper/211:48:532
29815040,0irq/29-eth0-tx-0-21swapper/211:29:362
29815040,0irq/29-eth0-tx-0-21swapper/211:23:342
29815040,0irq/29-eth0-tx-0-21swapper/211:18:512
29815040,0irq/29-eth0-tx-0-21swapper/210:33:432
29815040,0irq/29-eth0-tx-0-21swapper/209:55:062
29815040,0irq/29-eth0-tx-0-21swapper/209:49:062
29815040,0irq/29-eth0-tx-0-21swapper/008:13:460
29815040,0irq/29-eth0-tx-0-21swapper/008:08:430
29805040,0irq/28-eth0-rx-0-21swapper/312:33:433
29805040,0irq/28-eth0-rx-0-21swapper/312:09:033
259940,0migration/2393-21irqcore11:08:502
259940,0migration/232579-21kthreadcore10:48:522
259940,0migration/231839-21latency_hist08:53:342
259940,0migration/230050-21kthreadcore09:13:512
259940,0migration/21932-21if_eth1.210:13:502
259940,0migration/21794-21kthreadcore07:23:512
259940,0migration/216615-21kthreadcore09:03:522
259940,0migration/216050-21latency08:38:542
259940,0migration/214700-21kthreadcore09:23:532
259940,0migration/210315-21aten_r1power_cu12:48:462
249940,0watchdog/29231-21idleruntime12:28:502
249940,0watchdog/229721-21kthreadcore08:48:532
249940,0watchdog/222625-21tr12:33:542
179940,0migration/18287-21kthreadcore12:08:511
179940,0migration/17784-21latency_hist11:13:341
179940,0migration/16654-21kthreadcore12:43:531
179940,0migration/16609-21aten_r1power_vo08:13:451
179940,0migration/131135-21diskmemload12:22:201
179940,0migration/130293-21fschecks_count12:03:481
179940,0migration/128125-21taskset07:43:461
179940,0migration/127048-21missed_timers09:08:531
179940,0migration/126824-21kthreadcore10:08:521
179940,0migration/125952-21fschecks_count12:38:481
179940,0migration/125434-21kthreadcore11:03:521
179940,0migration/121787-21fschecks_time11:58:471
179940,0migration/121352-21fschecks_count08:23:471
179940,0migration/120049-21kthreadcore07:58:511
179940,0migration/119018-21kthreadcore12:33:531
179940,0migration/116303-21kthreadcore10:38:521
179940,0migration/116303-21kthreadcore10:38:521
169940,0watchdog/16763-21ssh12:25:261
169940,0watchdog/16559-21ssh11:10:491
169940,0watchdog/15708-21ssh09:55:131
169940,0watchdog/10-21swapper/109:03:531
169940,0watchdog/10-21swapper/108:08:491
169940,0watchdog/10-21swapper/108:03:491
149940,0migration/032433-21diskmemload10:12:190
149940,0migration/028259-21latency_hist09:13:340
149940,0migration/027051-21kthreadcore11:23:510
149940,0migration/023925-21kthreadcore08:23:510
149940,0migration/023587-21runrttasks10:06:430
149940,0migration/020766-21ntp_states12:13:550
149940,0migration/019402-21kthreadcore08:18:530
149940,0migration/014154-21kthreadcore10:38:520
149940,0migration/014154-21kthreadcore10:38:520
339930,0migration/36307-21runrttasks07:28:353
329930,0watchdog/30-21swapper/308:53:493
311919932,0cyclictest3524-21snmpd08:28:402
311919932,0cyclictest31106-21grep07:43:512
311919930,0cyclictest0-21swapper/207:53:572
311869932,0cyclictest434-21awk08:53:481
311869932,0cyclictest3524-21snmpd09:20:251
311789933,0cyclictest22123-21awk11:58:490
311789932,0cyclictest9294-21awk12:28:500
311789932,0cyclictest6613-21awk10:53:490
311789932,0cyclictest32115-21tune2fs07:23:470
311789932,0cyclictest23289-21awk09:48:490
311789932,0cyclictest13537-21munin-node07:33:470
311789932,0cyclictest11465-21awk12:48:510
311789930,0cyclictest27808-21latency_hist07:43:340
311789930,0cyclictest23021-21proc_pri12:33:570
311789930,0cyclictest1135-21munin-node11:43:540
311789930,0cyclictest10751-21perl07:53:470
29815030,0irq/29-eth0-tx-0-21swapper/008:58:450
29805030,0irq/28-eth0-rx-0-21swapper/307:58:553
29805030,0irq/28-eth0-rx-0-21swapper/307:33:463
179930,0migration/126240-21kthreadcore10:43:531
179930,0migration/115870-21kthreadcore07:33:511
169930,0watchdog/10-21swapper/112:28:501
169930,0watchdog/10-21swapper/110:33:531
169930,0watchdog/10-21swapper/108:28:531
169930,0watchdog/10-21swapper/107:23:491
311869920,0cyclictest9953-21latency_hist07:53:341
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional