You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 14:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Tue Apr 14, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
635128584,0sleep00-21swapper/007:18:460
644528079,0sleep10-21swapper/107:19:511
6551994242,0cyclictest9110-21md0_resync08:49:372
6549994141,0cyclictest9108-21md1_resync08:49:360
647723026,0sleep30-21swapper/307:20:093
623422925,0sleep20-21swapper/207:17:282
6551991515,0cyclictest83050irq/26-0000:00:09:34:532
6551991010,0cyclictest83050irq/26-0000:00:12:06:202
65519999,0cyclictest83050irq/26-0000:00:11:45:312
65519999,0cyclictest83050irq/26-0000:00:11:29:242
65519988,0cyclictest83050irq/26-0000:00:12:05:012
8305070,0irq/26-0000:00:0-21swapper/209:42:392
65519977,0cyclictest83050irq/26-0000:00:12:31:312
65519977,0cyclictest83050irq/26-0000:00:12:11:552
65519977,0cyclictest83050irq/26-0000:00:11:35:592
65519977,0cyclictest83050irq/26-0000:00:11:12:102
65519977,0cyclictest83050irq/26-0000:00:10:59:112
65519977,0cyclictest83050irq/26-0000:00:10:15:572
65499970,0cyclictest18864-21cut11:45:280
27170,0ktimersoftd/20-21swapper/210:09:462
8305060,0irq/26-0000:00:7482-21perl07:20:243
8305060,0irq/26-0000:00:5223-21grep10:20:392
8305060,0irq/26-0000:00:28543-21grep08:40:303
8305060,0irq/26-0000:00:26207-21diskstats07:55:243
8305060,0irq/26-0000:00:13931-21munin-node10:25:382
8305060,0irq/26-0000:00:0-21swapper/209:51:002
65519966,0cyclictest83050irq/26-0000:00:12:48:022
65519966,0cyclictest83050irq/26-0000:00:12:28:402
65519966,0cyclictest83050irq/26-0000:00:12:19:512
65519966,0cyclictest83050irq/26-0000:00:10:41:402
65519966,0cyclictest83050irq/26-0000:00:10:37:012
65519966,0cyclictest83050irq/26-0000:00:09:46:002
65519960,0cyclictest0-21swapper/208:03:572
65509966,0cyclictest21121-21diskmemload12:17:051
65509960,0cyclictest0-21swapper/111:04:241
65499965,0cyclictest2091-21cut10:40:270
65499960,0cyclictest0-21swapper/010:30:250
339960,0migration/324673-21sh12:42:133
339960,0migration/32277-21sh11:53:223
339960,0migration/318064-21munin-node08:55:263
339960,0migration/311529-21kthreadcore09:30:313
29805060,0irq/28-eth0-rx-8292-21tr12:15:313
29805060,0irq/28-eth0-rx-1744-21cut12:30:303
29805060,0irq/28-eth0-rx-10864-21grep12:35:303
149960,0migration/031113-21kthreadcore10:00:290
149960,0migration/018271-21kthreadcore08:30:310
149960,0migration/013085-21kthreadcore09:50:310
149960,0migration/01031-21sh09:44:500
8305050,0irq/26-0000:00:4592-21cut08:00:283
8305050,0irq/26-0000:00:4337-21fschecks_count07:40:253
8305050,0irq/26-0000:00:31169-21perl11:15:252
8305050,0irq/26-0000:00:25959-21kthreadcore11:30:312
8305050,0irq/26-0000:00:21146-21runrttasks07:29:423
8305050,0irq/26-0000:00:20264-21ssh11:07:252
8305050,0irq/26-0000:00:19167-21ssh09:55:172
8305050,0irq/26-0000:00:16335-21sh11:40:552
8305050,0irq/26-0000:00:12718-21kthreadcore07:45:303
8305050,0irq/26-0000:00:11873-21kthreadcore08:50:293
8305050,0irq/26-0000:00:0-21swapper/309:10:243
8305050,0irq/26-0000:00:0-21swapper/308:05:293
65519955,0cyclictest83050irq/26-0000:00:10:45:212
65519955,0cyclictest83050irq/26-0000:00:09:26:352
65519955,0cyclictest0-21swapper/210:50:362
65519955,0cyclictest0-21swapper/207:32:252
65519950,0cyclictest0-21swapper/209:00:142
65519950,0cyclictest0-21swapper/208:56:082
65509955,0cyclictest0-21swapper/112:44:211
65509955,0cyclictest0-21swapper/111:45:231
65509955,0cyclictest0-21swapper/110:14:061
65509954,0cyclictest31366-21awk09:25:281
65509954,0cyclictest11170-21awk10:45:281
65509950,0cyclictest0-21swapper/112:32:411
65509950,0cyclictest0-21swapper/111:31:591
65509950,0cyclictest0-21swapper/111:23:191
65509950,0cyclictest0-21swapper/107:38:391
65499950,0cyclictest0-21swapper/010:36:150
339950,0migration/37328-21kthreadcore08:25:303
339950,0migration/36405-21taskset09:09:373
339950,0migration/36023-21kthreadcore11:55:303
339950,0migration/35355-21taskset11:17:093
339950,0migration/33805-21timerwakeupswit12:10:373
339950,0migration/33511-21latency_hist07:40:113
339950,0migration/331208-21idleruntime09:25:273
339950,0migration/325661-21kthreadcore07:30:293
339950,0migration/325322-21cpuspeed_turbos09:40:233
339950,0migration/323974-21kthreadcore10:50:313
339950,0migration/321177-21kthreadcore08:10:303
339950,0migration/320189-21kthreadcore12:20:293
339950,0migration/320011-21fschecks_time09:55:263
339950,0migration/319198-21munin-node11:45:303
339950,0migration/315629-21taskset11:25:253
339950,0migration/315183-21kthreadcore11:40:353
339950,0migration/314026-3199-raid-check09:15:173
339950,0migration/311641-21munin-node09:50:303
329950,0watchdog/33177-21cut08:45:263
329950,0watchdog/3298732sleep308:19:103
329950,0watchdog/325106-21unixbench_singl07:50:383
329950,0watchdog/31922-21diskstats09:45:263
329950,0watchdog/30-21swapper/310:36:113
329950,0watchdog/30-21swapper/310:10:263
29815050,0irq/29-eth0-tx-8167-21munin-node08:05:360
29815050,0irq/29-eth0-tx-7472-21tune2fs11:20:262
29815050,0irq/29-eth0-tx-1374-21ssh11:50:492
29815050,0irq/29-eth0-tx-0-21swapper/212:21:352
29815050,0irq/29-eth0-tx-0-21swapper/210:30:162
29815050,0irq/29-eth0-tx-0-21swapper/210:02:042
29815050,0irq/29-eth0-tx-0-21swapper/009:20:210
29815050,0irq/29-eth0-tx-0-21swapper/008:40:350
29805050,0irq/28-eth0-rx-8125-21perl10:25:263
29805050,0irq/28-eth0-rx-806-21df11:35:263
29805050,0irq/28-eth0-rx-4655-21munin-node10:20:323
29805050,0irq/28-eth0-rx-25958-21ssh12:45:123
29805050,0irq/28-eth0-rx-20119-21cpu08:35:223
29805050,0irq/28-eth0-rx-14479-21kthreadcore08:30:303
29805050,0irq/28-eth0-rx-0-21swapper/312:05:293
29805050,0irq/28-eth0-rx-0-21swapper/312:02:513
29805050,0irq/28-eth0-rx-0-21swapper/311:10:373
29805050,0irq/28-eth0-rx-0-21swapper/311:00:293
29805050,0irq/28-eth0-rx-0-21swapper/310:55:233
29805050,0irq/28-eth0-rx-0-21swapper/310:45:153
29805050,0irq/28-eth0-rx-0-21swapper/310:44:193
29805050,0irq/28-eth0-rx-0-21swapper/310:33:073
29805050,0irq/28-eth0-rx-0-21swapper/310:07:013
29805050,0irq/28-eth0-rx-0-21swapper/309:35:403
29805050,0irq/28-eth0-rx-0-21swapper/309:21:493
259950,0migration/23784-21fschecks_count11:55:262
259950,0migration/229005-21munin-node08:15:322
259950,0migration/219466-21idleruntime07:50:262
259950,0migration/212867-21kthreadcore12:35:302
249950,0watchdog/220087-21kthreadcore12:40:312
249950,0watchdog/213912-21fschecks_time10:10:262
19150,0ktimersoftd/10-21swapper/109:44:371
179950,0migration/16689-21latency_hist07:20:111
179950,0migration/13787-21kthreadcore11:15:301
179950,0migration/132621-21kthreadcore11:50:331
179950,0migration/127475-21munin-node12:05:381
179950,0migration/126946-21kthreadcore08:15:291
179950,0migration/124756-21kthreadcore08:35:281
179950,0migration/122949-21sh09:35:531
169950,0watchdog/12759-21cut09:05:301
169950,0watchdog/125107-21unixbench_singl07:50:381
169950,0watchdog/113156-21cut10:25:311
149950,0migration/09942-21kthreadcore07:20:280
149950,0migration/08585-21irqcore10:25:290
149950,0migration/04735-21taskset09:25:390
149950,0migration/03117-21kthreadcore12:30:310
149950,0migration/028911-21kthreadcore09:00:300
149950,0migration/027214-21kthreadcore07:30:300
149950,0migration/023509-21munin-node08:35:280
149950,0migration/022988-21taskset12:24:490
149950,0migration/022349-21fschecks_time11:10:250
149950,0migration/020422-21kthreadcore08:10:300
149950,0migration/018790-21latency11:05:310
149950,0migration/018561-21kthreadcore10:10:310
149950,0migration/017847-21taskset07:46:100
149950,0migration/017278-21kthreadcore12:00:300
8305040,0irq/26-0000:00:24844-21kthreadcore09:20:292
8305040,0irq/26-0000:00:0-21swapper/309:00:253
8305040,0irq/26-0000:00:0-21swapper/308:20:243
8305040,0irq/26-0000:00:0-21swapper/211:00:302
65519944,0cyclictest0-21swapper/207:43:562
65519943,0cyclictest3571-21lldpd08:30:042
65519943,0cyclictest3524-21snmpd09:05:242
65519943,0cyclictest3524-21snmpd07:20:542
65519943,0cyclictest26867-21awk07:55:262
65509944,0cyclictest0-21swapper/112:24:291
65509944,0cyclictest0-21swapper/107:48:261
65509943,0cyclictest9059-21sadc11:40:121
65509943,0cyclictest3524-21snmpd11:41:411
65509943,0cyclictest3524-21snmpd11:10:261
65509943,0cyclictest3524-21snmpd10:05:101
65509943,0cyclictest3524-21snmpd09:23:101
65509943,0cyclictest3524-21snmpd09:11:091
65509943,0cyclictest22500-21awk07:30:271
65509943,0cyclictest16640-21awk08:10:271
65499944,0cyclictest0-21swapper/009:48:100
65499944,0cyclictest0-21swapper/007:30:040
65499943,0cyclictest4417-21awk11:55:280
65499943,0cyclictest3571-21lldpd12:39:070
65499943,0cyclictest30575-21awk12:10:270
65499943,0cyclictest28011-21awk11:50:300
65499943,0cyclictest26822-21awk07:55:260
65499943,0cyclictest2055-21sadc12:50:120
65499943,0cyclictest1598-21awk11:35:290
65499943,0cyclictest15142-21awk09:15:280
65499943,0cyclictest11103-21awk10:45:280
65499943,0cyclictest10837-21awk08:50:270
65499943,0cyclictest10447-21awk11:40:310
339940,0migration/331581-21sh11:32:173
339940,0migration/327811-21kthreadcore10:15:303
329940,0watchdog/30-21swapper/312:25:153
329940,0watchdog/30-21swapper/311:05:273
29815040,0irq/29-eth0-tx-6870-21telnet09:10:230
29815040,0irq/29-eth0-tx-18452-21munin-node07:50:280
29815040,0irq/29-eth0-tx-0-21swapper/008:20:250
29815040,0irq/29-eth0-tx-0-21swapper/008:00:260
29805040,0irq/28-eth0-rx-0-21swapper/311:20:273
29805040,0irq/28-eth0-rx-0-21swapper/310:00:293
259940,0migration/229307-21kthreadcore08:40:302
259940,0migration/217347-21kthreadcore09:15:302
259940,0migration/216774-21fschecks_time09:35:262
259940,0migration/216459-21runrttasks08:10:262
259940,0migration/212904-21kthreadcore08:05:292
259940,0migration/212651-21aten_r1power_en08:30:232
249940,0watchdog/20-21swapper/208:20:302
249940,0watchdog/20-21swapper/207:45:302
179940,0migration/1914-21kthreadcore12:10:291
179940,0migration/14045-21kthreadcore09:45:311
179940,0migration/13785-21aten_r1power_en07:40:231
179940,0migration/131022-21taskset12:27:461
179940,0migration/130740-21fschecks_count08:20:251
179940,0migration/127390-21kthreadcore10:35:301
179940,0migration/127295-21kthreadcore10:15:301
179940,0migration/126646-21sh09:57:211
179940,0migration/126525-21kthreadcore09:00:291
179940,0migration/126450-21df_abs12:45:271
179940,0migration/119038-21cpuspeed_turbos10:50:251
179940,0migration/118421-21kthreadcore10:30:281
179940,0migration/11666-21fschecks_count10:40:271
179940,0migration/116252-21fschecks_time11:25:261
179940,0migration/11423-21kthreadcore10:20:301
179940,0migration/113456-21irqcore12:00:281
179940,0migration/112560-21kthreadcore09:50:311
179940,0migration/110224-21kthreadcore08:05:281
169940,0watchdog/17206-21grep08:25:301
169940,0watchdog/16314-21runrttasks10:59:191
169940,0watchdog/1326552chrt07:57:261
169940,0watchdog/118997-21cut09:15:301
169940,0watchdog/116533-21kthreadcore07:25:261
169940,0watchdog/116073-21kthreadcore08:30:301
169940,0watchdog/10-21swapper/109:30:261
169940,0watchdog/10-21swapper/108:45:301
149940,0migration/08570-21kthreadcore10:05:300
149940,0migration/06621-21fschecks_time12:15:270
149940,0migration/027931-21runrttasks12:06:430
149940,0migration/025045-21kthreadcore10:15:290
149940,0migration/023519-21runrttasks11:29:080
65519933,0cyclictest3571-21lldpd09:12:342
65519932,0cyclictest29851-21awk07:35:272
65519932,0cyclictest21111-21awk08:35:262
65519932,0cyclictest10774-21awk08:50:272
65509933,0cyclictest9703-21awk12:35:281
65509932,0cyclictest4881-21cut10:05:251
65509932,0cyclictest3524-21snmpd08:55:391
65509932,0cyclictest12745-21cut11:05:121
65509930,0cyclictest30890-21kthreadcore08:40:311
65509930,0cyclictest1312-21fschecks_count08:00:241
65499932,0cyclictest982-21kthreadcore07:35:300
65499932,0cyclictest6749-21cut07:40:290
65499932,0cyclictest6364-21awk08:25:290
65499932,0cyclictest498-21tr11:15:290
65499932,0cyclictest3524-21snmpd12:44:560
65499932,0cyclictest31881-21awk10:20:280
65499932,0cyclictest28675-21awk10:55:280
65499932,0cyclictest25448-21cat12:25:300
65499932,0cyclictest25039-21grep11:30:280
65499932,0cyclictest23725-21cut09:55:310
65499932,0cyclictest23169-21df08:15:240
65499932,0cyclictest21035-21cut08:55:290
65499932,0cyclictest20395-21kthreadcore10:50:300
65499932,0cyclictest15969-21ssh09:35:170
65499932,0cyclictest13403-21wc11:20:380
65499932,0cyclictest12928-21kthreadcore09:30:310
65499930,0cyclictest32433-21perl09:05:260
249930,0watchdog/20-21swapper/207:25:222
179930,0migration/112736-21kthreadcore08:50:291
169930,0watchdog/10-21swapper/111:56:071
65499921,0cyclictest0-21swapper/011:00:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional