You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-31 - 15:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Mon Aug 31, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2561424536,0sleep10-21swapper/107:29:001
2553724029,0sleep20-21swapper/207:28:052
2573423626,0sleep30-21swapper/307:30:263
1892823531,0sleep00-21swapper/007:26:470
27170,0ktimersoftd/22585-21sed08:21:522
27170,0ktimersoftd/22585-21sed08:21:522
339960,0migration/39845-21sh12:02:183
339960,0migration/39442-21idleruntime08:26:493
339960,0migration/38692-21sh10:09:563
339960,0migration/36293-21sh11:22:143
339960,0migration/35103-21sh12:38:213
339960,0migration/34916-21sh11:03:233
339960,0migration/331810-21kernelversion09:26:523
339960,0migration/326638-21latency_hist11:56:363
339960,0migration/319549-21sh12:11:053
339960,0migration/314648-21munin-node09:11:553
29815060,0irq/29-eth0-tx-17180-21ssh11:48:532
29815060,0irq/29-eth0-tx-0-21swapper/210:05:422
29815060,0irq/29-eth0-tx-0-21swapper/009:19:550
29805060,0irq/28-eth0-rx-31496-21python11:37:023
29805060,0irq/28-eth0-rx-26612-21tr12:51:533
29805060,0irq/28-eth0-rx-23312-21perl09:41:463
29805060,0irq/28-eth0-rx-0-21swapper/312:27:303
259169963,0cyclictest13091-21kworker/0:109:41:460
259169960,0cyclictest0-21swapper/011:08:530
149960,0migration/09843-21kthreadcore07:41:520
149960,0migration/032741-21latency11:56:550
149960,0migration/030202-21latency_hist12:36:360
149960,0migration/027151-21sh10:39:270
149960,0migration/023758-21missed_timers10:16:550
149960,0migration/020254-21unixbench-2d09:37:000
149960,0migration/01678-21latency10:41:550
8305050,0irq/26-0000:00:583-21ssh12:56:492
8305050,0irq/26-0000:00:11976-21kthreadcore10:11:522
339950,0migration/38951-21diskmemload11:26:493
339950,0migration/38109-21sh11:42:153
339950,0migration/37693-21unixbench_multi08:22:003
339950,0migration/37693-21unixbench_multi08:22:003
339950,0migration/37631-21aten_r1power_fr09:51:453
339950,0migration/34641-21kthreadcore09:46:533
339950,0migration/33716-21munin-node08:41:573
339950,0migration/332514-21timerwakeupswit07:32:003
339950,0migration/332371-21kthreadcore12:16:543
339950,0migration/33135-21kthreadcore09:06:533
339950,0migration/329911-21runrttasks12:36:243
339950,0migration/327094-21kthreadcore10:01:523
339950,0migration/325923-21kthreadcore07:51:533
339950,0migration/321452-21munin-node12:47:023
339950,0migration/318692-21gltestperf10:16:493
339950,0migration/318092-21sendmail_mailst08:06:573
339950,0migration/317798-21kthreadcore09:36:533
339950,0migration/312796-21kthreadcore10:11:523
339950,0migration/312717-21runrttasks09:34:563
339950,0migration/311992-21kthreadcore11:06:553
339950,0migration/311382-21irqrtprio11:46:563
329950,0watchdog/3773-21if_eth112:56:513
329950,0watchdog/34938-21basename08:46:463
329950,0watchdog/34705-21aten2.4-expect08:01:463
329950,0watchdog/332405-21kthreadcore10:41:543
329950,0watchdog/331949-21grep08:16:543
329950,0watchdog/327519-21iostat10:21:503
329950,0watchdog/320905-21perl12:11:513
329950,0watchdog/319117-21kthreadcore07:46:543
329950,0watchdog/317200-21fschecks_count11:31:473
29815050,0irq/29-eth0-tx-6138-21sed11:06:352
29815050,0irq/29-eth0-tx-4888-21munin-node08:47:020
29815050,0irq/29-eth0-tx-26312-21munin-node08:16:490
29815050,0irq/29-eth0-tx-1835-21ssh11:59:092
29815050,0irq/29-eth0-tx-0-21swapper/210:47:342
29815050,0irq/29-eth0-tx-0-21swapper/009:31:350
29815050,0irq/29-eth0-tx-0-21swapper/009:24:240
29815050,0irq/29-eth0-tx-0-21swapper/009:11:550
29805050,0irq/28-eth0-rx-23647-21df_abs11:16:493
29805050,0irq/28-eth0-rx-20584-21ssh10:36:483
29805050,0irq/28-eth0-rx-18424-40yum-updatesd-he10:33:503
29805050,0irq/28-eth0-rx-16073-21irqcore11:11:533
29805050,0irq/28-eth0-rx-10089-21cut12:21:543
29805050,0irq/28-eth0-rx-0-21swapper/312:44:403
29805050,0irq/28-eth0-rx-0-21swapper/310:26:513
29805050,0irq/28-eth0-rx-0-21swapper/307:56:583
27150,0ktimersoftd/20-21swapper/212:49:252
259289955,0cyclictest0-21swapper/212:43:502
259289955,0cyclictest0-21swapper/212:05:122
259289955,0cyclictest0-21swapper/211:10:582
259289950,0cyclictest0-21swapper/212:28:042
259289950,0cyclictest0-21swapper/210:57:342
259289950,0cyclictest0-21swapper/209:02:012
259249955,0cyclictest0-21swapper/110:16:491
259249950,0cyclictest0-21swapper/111:34:421
259169955,0cyclictest0-21swapper/012:18:530
259169953,0cyclictest16235-21kworker/0:112:41:510
259169953,0cyclictest16235-21kworker/0:112:31:490
259169953,0cyclictest16235-21kworker/0:112:29:270
259169953,0cyclictest16235-21kworker/0:111:55:190
259169953,0cyclictest13091-21kworker/0:110:11:390
259169953,0cyclictest13091-21kworker/0:110:08:170
259169953,0cyclictest13091-21kworker/0:109:52:200
259169952,0cyclictest4364-21kworker/0:211:01:570
259169950,0cyclictest0-21swapper/010:53:070
259950,0migration/231950-21fschecks_time09:46:482
259950,0migration/213366-21kthreadcore10:31:522
249950,0watchdog/221763-21runrttasks11:12:512
249950,0watchdog/219118-21kthreadcore07:46:542
19150,0ktimersoftd/10-21swapper/112:49:251
179950,0migration/1873-21taskset10:22:481
179950,0migration/16719-21munin-node11:06:491
179950,0migration/1569-21munin-node11:56:571
179950,0migration/131175-21gltestperf09:26:481
179950,0migration/127947-21munin-node12:31:581
179950,0migration/125016-21unixbench_singl11:52:021
179950,0migration/120240-21fschecks_count10:36:481
179950,0migration/118479-21taskset08:07:081
179950,0migration/116977-21munin-node09:16:521
179950,0migration/116971-21kthreadcore11:11:541
179950,0migration/115998-21latency_hist09:56:351
179950,0migration/113723-21kthreadcore12:06:531
179950,0migration/113144-21kthreadcore11:26:541
179950,0migration/111947-21sh12:23:401
169950,0watchdog/129510-21ssh09:42:501
149950,0migration/07773-21kthreadcore08:01:530
149950,0migration/07613-21sh11:41:570
149950,0migration/07464-21kthreadcore12:21:540
149950,0migration/0644-21sh10:22:180
149950,0migration/05878-21munin-node12:56:560
149950,0migration/03767-21fschecks_time12:01:500
149950,0migration/032312-21kthreadcore09:26:520
149950,0migration/031093-21sh12:54:310
149950,0migration/028949-21kthreadcore11:16:550
149950,0migration/028800-21sh10:58:340
149950,0migration/027308-21kthreadcore10:01:520
149950,0migration/025805-21kthreadcore12:11:560
149950,0migration/025139-21munin-node08:11:570
149950,0migration/023391-21kthreadcore08:56:520
149950,0migration/019080-21taskset08:56:270
149950,0migration/017600-21kthreadcore11:11:540
149950,0migration/017460-21munin-node12:06:540
149950,0migration/016476-21fschecks_time08:31:490
149950,0migration/016143-21fschecks_time07:46:490
149950,0migration/015082-21aten_r1power_en12:46:480
149950,0migration/014932-21kthreadcore10:31:530
149950,0migration/01431-21kthreadcore07:56:540
149950,0migration/013978-21kthreadcore08:06:530
149950,0migration/012799-21kthreadcore11:46:570
149950,0migration/010951-21kthreadcore08:26:520
339940,0migration/36536-21kthreadcore07:36:553
339940,0migration/328431-21kernelversion11:56:533
339940,0migration/316204-21diskmemload09:56:403
339940,0migration/31007-21taskset09:05:383
329940,0watchdog/314768-21kthreadcore10:51:543
329940,0watchdog/30-21swapper/310:57:543
329940,0watchdog/30-21swapper/310:47:023
29815040,0irq/29-eth0-tx-944-21head10:06:472
29815040,0irq/29-eth0-tx-23495-21ssh12:51:402
29815040,0irq/29-eth0-tx-19625-21ssh10:36:422
29815040,0irq/29-eth0-tx-10952-21ssh12:21:572
29815040,0irq/29-eth0-tx-0-21swapper/212:11:502
29815040,0irq/29-eth0-tx-0-21swapper/210:22:292
29815040,0irq/29-eth0-tx-0-21swapper/209:56:432
29815040,0irq/29-eth0-tx-0-21swapper/209:52:532
29815040,0irq/29-eth0-tx-0-21swapper/209:41:412
29815040,0irq/29-eth0-tx-0-21swapper/009:01:470
29815040,0irq/29-eth0-tx-0-21swapper/008:43:050
29805040,0irq/28-eth0-rx-0-21swapper/309:26:053
29805040,0irq/28-eth0-rx-0-21swapper/308:11:483
29805040,0irq/28-eth0-rx-0-21swapper/307:42:433
259289944,0cyclictest0-21swapper/211:51:582
259289943,0cyclictest3571-21lldpd11:32:482
259289943,0cyclictest3571-21lldpd10:41:462
259289943,0cyclictest3524-21snmpd09:08:022
259289943,0cyclictest3524-21snmpd08:13:022
259289943,0cyclictest3524-21snmpd08:01:012
259289943,0cyclictest3524-21snmpd07:54:012
259289943,0cyclictest3524-21snmpd07:42:162
259289943,0cyclictest3250-21irqbalance09:31:422
259289943,0cyclictest3250-21irqbalance09:21:422
259289943,0cyclictest3250-21irqbalance09:12:322
259289943,0cyclictest31433-21awk12:36:522
259289943,0cyclictest29781-21sh08:41:352
259289943,0cyclictest29690-21awk12:16:522
259289943,0cyclictest24483-21awk11:16:522
259289943,0cyclictest22808-21awk12:31:522
259289943,0cyclictest1220-21munin-node11:41:542
259289940,0cyclictest25134-21munin-node11:36:492
259249944,0cyclictest0-21swapper/109:48:271
259249943,0cyclictest3571-21lldpd08:41:441
259249943,0cyclictest3524-21snmpd12:56:201
259249943,0cyclictest3524-21snmpd12:44:351
259249943,0cyclictest3524-21snmpd12:12:491
259249943,0cyclictest3524-21snmpd10:05:181
259249943,0cyclictest3524-21snmpd09:22:331
259249943,0cyclictest3524-21snmpd08:36:471
259249943,0cyclictest3524-21snmpd08:34:471
259249943,0cyclictest3524-21snmpd08:29:471
259249943,0cyclictest3524-21snmpd07:46:311
259249943,0cyclictest27648-21awk09:01:511
259249943,0cyclictest23801-21awk07:51:521
259249943,0cyclictest2356-21awk11:41:511
259249943,0cyclictest21445-21sadc12:31:361
259249943,0cyclictest17417-21awk09:56:521
259249943,0cyclictest10992-21awk11:46:551
259249943,0cyclictest10588-21awk10:11:491
259249942,0cyclictest2454-21sed07:36:531
259169944,0cyclictest0-21swapper/011:36:480
259169944,0cyclictest0-21swapper/011:23:140
259169943,0cyclictest3704-21awk10:26:500
259169943,0cyclictest3524-21snmpd07:41:160
259169943,0cyclictest29778-21sadc08:41:350
259169943,0cyclictest2186-21awk08:21:500
259169943,0cyclictest2186-21awk08:21:500
259169942,0cyclictest4364-21kworker/0:210:47:010
259169942,0cyclictest21930-21kworker/0:011:31:490
259169942,0cyclictest21930-21kworker/0:011:27:010
259169942,0cyclictest13091-21kworker/0:109:58:010
259169940,0cyclictest1331-21munin-node09:07:010
259940,0migration/24538-21kthreadcore10:26:512
259940,0migration/23662-21munin-node08:41:562
259940,0migration/229524-21kthreadcore08:16:532
259940,0migration/224474-21kthreadcore08:56:532
259940,0migration/222050-21kthreadcore10:16:532
259940,0migration/217640-21kthreadcore08:31:522
259940,0migration/216932-21kthreadcore09:36:522
259940,0migration/216845-21kthreadcore12:06:542
259940,0migration/212200-21kthreadcore08:26:522
249940,0watchdog/24939-21aten_r1power_en08:46:462
249940,0watchdog/231877-21aten_r1power_en11:21:472
249940,0watchdog/217249-21kthreadcore08:51:542
249940,0watchdog/214948-21ssh11:27:312
249940,0watchdog/20-21swapper/210:51:542
249940,0watchdog/20-21swapper/209:16:542
249940,0watchdog/20-21swapper/208:01:462
249940,0watchdog/20-21swapper/207:36:542
179940,0migration/18258-21latency_hist08:26:351
179940,0migration/18258-21latency_hist08:26:351
179940,0migration/13976-21kthreadcore09:06:541
179940,0migration/13949-21gltestperf12:01:501
179940,0migration/132614-21fschecks_count12:56:481
179940,0migration/132048-21kthreadcore10:41:541
179940,0migration/131902-21kthreadcore12:36:531
179940,0migration/131436-21irqcore11:01:531
179940,0migration/126266-21aten_r1power_vo07:31:461
179940,0migration/121489-21kthreadcore08:11:541
179940,0migration/120523-21sh09:37:211
179940,0migration/114309-21irqcore10:51:541
179940,0migration/11065-21aten_r1power_vo10:06:481
169940,0watchdog/14588-21telnet10:46:461
169940,0watchdog/12962-21ssh12:17:311
169940,0watchdog/127798-21cut11:16:551
169940,0watchdog/11831-21kthreadcore07:56:541
169940,0watchdog/118183-21ssh10:33:061
169940,0watchdog/10-21swapper/111:36:551
169940,0watchdog/10-21swapper/110:28:181
169940,0watchdog/10-21swapper/109:31:541
169940,0watchdog/10-21swapper/108:16:541
169940,0watchdog/10-21swapper/107:46:541
149940,0migration/023275-21fschecks_time07:51:490
1027240,0sleep10-21swapper/111:21:541
329930,0watchdog/30-21swapper/309:16:423
329930,0watchdog/30-21swapper/308:36:423
329930,0watchdog/30-21swapper/308:31:383
29805030,0irq/28-eth0-rx-0-21swapper/308:56:463
29805030,0irq/28-eth0-rx-0-21swapper/308:51:483
259289932,0cyclictest3524-21snmpd08:08:012
259289932,0cyclictest3250-21irqbalance09:27:122
259289932,0cyclictest26377-21grep07:31:462
259249932,0cyclictest9681-21awk09:11:501
259249932,0cyclictest3524-21snmpd08:49:471
259249932,0cyclictest27873-21wc10:56:571
259169933,0cyclictest5527-21kworker/0:007:31:380
259169931,0cyclictest13091-21kworker/0:109:47:000
179930,0migration/114533-21kthreadcore08:51:531
169930,0watchdog/10-21swapper/108:56:461
169930,0watchdog/10-21swapper/108:01:461
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional