You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 00:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Tue Jun 02, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31612997171,0cyclictest8847-21md0_resync09:34:412
3133926261,0sleep10-21swapper/107:21:581
31610996161,0cyclictest8846-21md1_resync09:34:410
3117525049,0sleep00-21swapper/007:20:090
3139523228,0sleep30-21swapper/307:22:363
3122322826,0sleep20-21swapper/207:20:392
8305070,0irq/26-0000:00:0-21swapper/311:54:293
316129970,0cyclictest0-21swapper/209:42:452
8305060,0irq/26-0000:00:8735-21munin-plugin-st09:39:133
8305060,0irq/26-0000:00:3874-21chrt07:49:223
8305060,0irq/26-0000:00:32285-21diskstats09:14:273
8305060,0irq/26-0000:00:30442-21kthreadcore09:49:313
8305060,0irq/26-0000:00:29247-21python11:19:413
8305060,0irq/26-0000:00:25710-21fschecks_time12:34:273
8305060,0irq/26-0000:00:22695-21rm09:28:353
8305060,0irq/26-0000:00:18393-21ps12:48:293
8305060,0irq/26-0000:00:15383-21grep10:34:403
4160,0ktimersoftd/00-21swapper/008:16:380
339960,0migration/328226-21sh10:06:273
339960,0migration/317672-21irqrtprio12:29:303
339960,0migration/310135-21sh11:48:203
316129964,0cyclictest3524-21snmpd11:44:112
316119960,0cyclictest0-21swapper/111:51:181
316119960,0cyclictest0-21swapper/111:17:051
316119960,0cyclictest0-21swapper/107:54:301
316109960,0cyclictest0-21swapper/012:44:580
316109960,0cyclictest0-21swapper/012:14:330
29805060,0irq/28-eth0-rx-6152-21ssh09:54:313
29805060,0irq/28-eth0-rx-0-21swapper/311:34:373
19160,0ktimersoftd/10-21swapper/111:09:501
149960,0migration/03988-21sh12:02:590
149960,0migration/024996-21sh11:38:340
149960,0migration/019778-21sh10:59:090
8305050,0irq/26-0000:00:9331-21cpuspeed_turbos09:39:253
8305050,0irq/26-0000:00:8744-21sed10:49:343
8305050,0irq/26-0000:00:8704-21iostat12:24:313
8305050,0irq/26-0000:00:8591-21cut09:19:293
8305050,0irq/26-0000:00:5205-21cut11:09:143
8305050,0irq/26-0000:00:4988-21kthreadcore12:39:303
8305050,0irq/26-0000:00:3858-21irqcore08:54:313
8305050,0irq/26-0000:00:31593-21aten_r1power_fr11:24:243
8305050,0irq/26-0000:00:28381-21gltestperf08:49:273
8305050,0irq/26-0000:00:27407-21cut11:39:313
8305050,0irq/26-0000:00:24263-21perl10:24:273
8305050,0irq/26-0000:00:23141-21aten_r1power_vo08:24:233
8305050,0irq/26-0000:00:20279-21netstat07:34:323
8305050,0irq/26-0000:00:19438-21ssh10:01:103
8305050,0irq/26-0000:00:1862-21tr12:19:323
8305050,0irq/26-0000:00:11761-21sensors08:34:333
8305050,0irq/26-0000:00:0-21swapper/311:59:303
8305050,0irq/26-0000:00:0-21swapper/310:19:163
8305050,0irq/26-0000:00:0-21swapper/307:54:323
8305050,0irq/26-0000:00:0-21swapper/307:29:263
339950,0migration/38487-21kthreadcore10:14:313
339950,0migration/330345-3199-raid-check08:29:163
339950,0migration/32876-21rt-features11:04:363
339950,0migration/326986-21fschecks_time10:44:263
339950,0migration/326070-21aten_r1power_vo08:04:263
339950,0migration/325898-21kthreadcore09:29:323
339950,0migration/325476-21kthreadcore12:14:313
339950,0migration/324728-21kthreadcore08:44:313
339950,0migration/324728-21kthreadcore08:44:313
339950,0migration/320185-21munin-node12:49:313
339950,0migration/319772-21kthreadcore10:39:323
339950,0migration/318675-21irqrtprio09:04:303
329950,0watchdog/34911-21kthreadcore07:24:323
329950,0watchdog/34865-21kthreadcore10:29:333
329950,0watchdog/325734-21irqcore09:09:323
329950,0watchdog/313443-21tune2fs08:39:283
329950,0watchdog/30-21swapper/310:54:253
316129955,0cyclictest0-21swapper/212:48:572
316129955,0cyclictest0-21swapper/211:07:532
316129955,0cyclictest0-21swapper/211:02:322
316129955,0cyclictest0-21swapper/210:19:292
316129955,0cyclictest0-21swapper/210:10:112
316129955,0cyclictest0-21swapper/209:29:402
316129955,0cyclictest0-21swapper/208:56:522
316129954,0cyclictest3524-21snmpd09:12:252
316129950,0cyclictest0-21swapper/212:20:532
316129950,0cyclictest0-21swapper/212:15:032
316129950,0cyclictest0-21swapper/210:28:472
316129950,0cyclictest0-21swapper/208:28:582
316119955,0cyclictest0-21swapper/112:32:361
316119955,0cyclictest0-21swapper/112:15:061
316119955,0cyclictest0-21swapper/111:02:161
316119955,0cyclictest0-21swapper/110:23:201
316119950,0cyclictest0-21swapper/112:28:491
316119950,0cyclictest0-21swapper/112:08:011
316119950,0cyclictest0-21swapper/111:39:381
316119950,0cyclictest0-21swapper/110:00:281
316119950,0cyclictest0-21swapper/108:00:481
316119950,0cyclictest0-21swapper/107:40:471
316109955,0cyclictest0-21swapper/012:24:570
316109955,0cyclictest0-21swapper/012:07:270
316109955,0cyclictest0-21swapper/011:50:440
316109955,0cyclictest0-21swapper/010:38:040
316109950,0cyclictest0-21swapper/011:49:140
316109950,0cyclictest0-21swapper/008:55:440
29815050,0irq/29-eth0-tx-3524-21snmpd08:06:060
29815050,0irq/29-eth0-tx-0-21swapper/009:04:260
29815050,0irq/29-eth0-tx-0-21swapper/008:11:070
29805050,0irq/28-eth0-rx-16291-21kthreadcore11:49:333
29805050,0irq/28-eth0-rx-14753-21kthreadcore08:59:323
29805050,0irq/28-eth0-rx-0-21swapper/312:09:233
29805050,0irq/28-eth0-rx-0-21swapper/312:04:273
29805050,0irq/28-eth0-rx-0-21swapper/311:29:253
29805050,0irq/28-eth0-rx-0-21swapper/311:14:203
29805050,0irq/28-eth0-rx-0-21swapper/310:59:183
29805050,0irq/28-eth0-rx-0-21swapper/310:09:273
27150,0ktimersoftd/20-21swapper/210:57:102
19150,0ktimersoftd/10-21swapper/110:45:141
179950,0migration/18026-21if_eth109:19:281
179950,0migration/132383-21fschecks_count09:14:271
179950,0migration/130159-21fschecks_count10:09:271
179950,0migration/123573-21switchtime09:04:391
179950,0migration/119305-21timerwakeupswit08:39:401
179950,0migration/117605-21pmu-power10:54:341
179950,0migration/113247-21kthreadcore08:59:321
169950,0watchdog/15944-21fschecks_count08:34:241
169950,0watchdog/126990-21ntp_states10:04:321
169950,0watchdog/115741-21aten2.4-expect08:19:241
149950,0migration/09102-21kthreadcore09:19:300
149950,0migration/08765-21sh12:41:040
149950,0migration/07099-21taskset11:27:370
149950,0migration/06693-21kthreadcore10:49:330
149950,0migration/03409-21kthreadcore12:19:320
149950,0migration/030510-21aten_r1power_vo08:29:250
149950,0migration/028317-21sh10:06:410
149950,0migration/027423-21kthreadcore10:24:310
149950,0migration/025476-21sh09:46:170
149950,0migration/02509-21needreboot07:44:320
149950,0migration/024204-21kthreadcore07:59:300
149950,0migration/023810-21fschecks_count09:29:280
149950,0migration/023526-21kthreadcore12:49:330
149950,0migration/021555-21irqrtprio10:59:320
149950,0migration/020229-21needreboot07:34:320
149950,0migration/01661-21kthreadcore10:29:320
149950,0migration/015775-21kthreadcore08:39:320
149950,0migration/015353-21taskset09:24:300
149950,0migration/012210-21sh07:54:290
149950,0migration/01153-21latency_hist12:39:140
149950,0migration/010244-21munin-node09:39:290
8305040,0irq/26-0000:00:28220-21munin-node07:39:403
8305040,0irq/26-0000:00:15427-21munin-run08:19:133
8305040,0irq/26-0000:00:0-21swapper/309:44:143
8305040,0irq/26-0000:00:0-21swapper/308:19:303
339940,0migration/330494-21kthreadcore07:44:303
329940,0watchdog/35648-21kthreadcore08:09:323
316129944,0cyclictest0-21swapper/212:30:022
316129943,0cyclictest963-21awk10:29:302
316129943,0cyclictest9503-21awk08:14:292
316129943,0cyclictest5014-21awk07:49:292
316129943,0cyclictest3571-21lldpd10:53:372
316129943,0cyclictest3571-21lldpd10:41:072
316129943,0cyclictest3571-21lldpd09:19:352
316129943,0cyclictest3571-21lldpd08:59:342
316129943,0cyclictest3524-21snmpd11:19:412
316129943,0cyclictest3250-21irqbalance10:44:202
316129943,0cyclictest3250-21irqbalance08:46:002
316129943,0cyclictest3250-21irqbalance08:46:002
316129943,0cyclictest3250-21irqbalance08:01:492
316129943,0cyclictest28630-21awk08:49:302
316129943,0cyclictest28047-21awk09:49:292
316129943,0cyclictest13811-21awk08:39:302
316129940,0cyclictest1298-21munin-node12:39:262
316129940,0cyclictest0-21swapper/212:04:262
316119944,0cyclictest0-21swapper/112:34:201
316119944,0cyclictest0-21swapper/111:57:081
316119944,0cyclictest0-21swapper/109:39:011
316119944,0cyclictest0-21swapper/108:57:051
316119943,0cyclictest428-21awk07:24:291
316119943,0cyclictest3524-21snmpd11:31:411
316119943,0cyclictest28533-21awk08:49:291
316119943,0cyclictest27091-21awk08:04:301
316119943,0cyclictest19972-21sort12:49:291
316119943,0cyclictest14608-21awk12:09:301
316109944,0cyclictest0-21swapper/011:15:160
316109944,0cyclictest0-21swapper/010:45:190
316109944,0cyclictest0-21swapper/010:17:530
316109944,0cyclictest0-21swapper/010:03:510
316109944,0cyclictest0-21swapper/009:53:080
316109943,0cyclictest6462-21awk08:34:260
316109943,0cyclictest3571-21lldpd12:30:090
316109943,0cyclictest3571-21lldpd11:22:380
316109943,0cyclictest3571-21lldpd11:12:380
316109943,0cyclictest3571-21lldpd11:07:370
316109943,0cyclictest16763-21awk08:19:280
316109943,0cyclictest16375-21ps10:19:310
316109943,0cyclictest14641-21awk12:09:310
29815040,0irq/29-eth0-tx-26007-21ssh12:34:282
29815040,0irq/29-eth0-tx-20818-21munin-node10:04:362
29815040,0irq/29-eth0-tx-19505-21munin-node11:54:342
29815040,0irq/29-eth0-tx-18927-21ssh12:49:212
29815040,0irq/29-eth0-tx-14952-21open_inodes10:34:352
29815040,0irq/29-eth0-tx-0-21swapper/211:49:322
29815040,0irq/29-eth0-tx-0-21swapper/211:46:222
29815040,0irq/29-eth0-tx-0-21swapper/211:15:142
29815040,0irq/29-eth0-tx-0-21swapper/211:09:532
29815040,0irq/29-eth0-tx-0-21swapper/210:04:132
29815040,0irq/29-eth0-tx-0-21swapper/009:11:160
29815040,0irq/29-eth0-tx-0-21swapper/008:49:330
29815040,0irq/29-eth0-tx-0-21swapper/008:24:230
29815040,0irq/29-eth0-tx-0-21swapper/007:29:280
29805040,0irq/28-eth0-rx-0-21swapper/307:59:303
259940,0migration/232675-21kthreadcore11:59:322
259940,0migration/221778-21munin-node08:19:332
259940,0migration/218259-21irqrtprio11:34:312
259940,0migration/213606-21missed_timers12:24:342
259940,0migration/210185-21kthreadcore10:14:322
249940,0watchdog/28931-21gltestperf11:29:292
249940,0watchdog/26974-21aten_r1power_po07:29:242
249940,0watchdog/24909-21kthreadcore07:24:322
249940,0watchdog/231362-21idleruntime08:29:282
249940,0watchdog/22830-21python07:44:362
249940,0watchdog/223091-21latency09:04:322
249940,0watchdog/22028-21md1_raid107:34:282
249940,0watchdog/21808-21hddtemp_smartct08:09:282
249940,0watchdog/216926-21kthreadcore12:09:332
249940,0watchdog/211511-21ssh09:58:282
249940,0watchdog/20-21swapper/211:25:052
249940,0watchdog/20-21swapper/209:14:322
249940,0watchdog/20-21swapper/208:34:242
179940,0migration/17015-21kthreadcore09:54:321
179940,0migration/16100-21kthreadcore07:49:311
179940,0migration/14791-21taskset08:30:101
179940,0migration/132318-21kthreadcore11:59:311
179940,0migration/132026-21kthreadcore07:44:311
179940,0migration/131042-21aten_r1power_cu12:19:251
179940,0migration/129805-21gltestperf11:04:281
179940,0migration/12949-21idleruntime11:44:291
179940,0migration/128730-21kthreadcore09:49:301
179940,0migration/126224-21kthreadcore11:19:351
179940,0migration/126131-21missed_timers08:44:321
179940,0migration/126131-21missed_timers08:44:321
179940,0migration/118979-21kthreadcore11:34:321
179940,0migration/11706-21kthreadcore10:29:321
179940,0migration/115334-21munin-node09:24:301
179940,0migration/114874-21fschecks_time07:34:261
179940,0migration/112369-21kthreadcore08:14:311
169940,0watchdog/18973-21ssh09:39:161
169940,0watchdog/18382-21ssh12:40:011
169940,0watchdog/17951-21awk07:29:281
169940,0watchdog/16128-21kthreadcore10:49:331
169940,0watchdog/125824-21irqcore09:09:321
169940,0watchdog/124112-21perl09:29:281
169940,0watchdog/116384-21ssh10:37:051
169940,0watchdog/111872-21tr10:14:321
169940,0watchdog/10-21swapper/110:39:411
169940,0watchdog/10-21swapper/108:24:321
169940,0watchdog/10-21swapper/108:09:281
149940,0migration/09263-21kthreadcore07:49:320
149940,0migration/02965-21kthreadcore09:14:320
149940,0migration/027022-21diskmemload11:56:330
149940,0migration/026003-21latency08:44:320
149940,0migration/026003-21latency08:44:320
149940,0migration/014945-21kthreadcore08:59:320
149940,0migration/01217-21kthreadcore07:24:310
149940,0migration/011220-21sh09:57:410
316129932,0cyclictest3250-21irqbalance08:04:192
316129932,0cyclictest15320-21awk09:24:302
316129932,0cyclictest12304-21awk07:54:302
316129930,0cyclictest27621-21munin-node07:39:322
316129930,0cyclictest18039-21munin-node09:44:272
316119933,0cyclictest24627-21awk10:24:291
316119932,0cyclictest3524-21snmpd12:45:411
316119932,0cyclictest3524-21snmpd11:26:411
316119932,0cyclictest18913-21perl09:44:271
316109933,0cyclictest0-21swapper/010:11:250
316109932,0cyclictest3524-21snmpd11:32:260
316109932,0cyclictest3524-21snmpd10:42:400
316109932,0cyclictest25945-21sed11:39:270
316109932,0cyclictest22581-21awk07:39:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional