You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 16:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Wed Mar 11, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1380123928,0sleep00-21swapper/007:14:470
1366923828,0sleep30-21swapper/307:13:143
1393123728,0sleep10-21swapper/107:16:161
1383022723,0sleep20-21swapper/207:15:052
149970,0migration/031678-21sh09:17:440
8305060,0irq/26-0000:00:32146-21turbostat07:57:173
339960,0migration/328294-21sh10:51:243
339960,0migration/327395-21latency08:07:413
339960,0migration/325982-21irqcore12:42:393
339960,0migration/324371-21sh11:27:003
339960,0migration/320739-21sh11:03:063
339960,0migration/320705-21sh09:48:353
339960,0migration/316663-21sh10:23:583
339960,0migration/313547-21sh11:02:103
339960,0migration/312557-21sh09:44:553
29815060,0irq/29-eth0-tx-7275-21munin-node07:57:480
29805060,0irq/28-eth0-rx-7789-21munin-node09:22:423
29805060,0irq/28-eth0-rx-25218-21diskstats11:27:363
29805060,0irq/28-eth0-rx-16095-21kthreadcore10:42:413
140949960,0cyclictest25265-21diskmemload10:44:091
140949960,0cyclictest0-21swapper/108:42:361
149960,0migration/030473-21sh09:56:410
149960,0migration/015000-21kthreadcore11:57:430
339950,0migration/37838-21cpuspeed_turbos11:17:353
339950,0migration/37201-21latency_hist07:57:223
339950,0migration/33987-21cpuspeed_turbos08:17:343
339950,0migration/332161-21kthreadcore10:52:403
339950,0migration/328097-21taskset07:22:513
339950,0migration/325209-21aten_r1power_cu07:47:343
339950,0migration/324695-21kthreadcore12:22:393
339950,0migration/323860-21missed_timers07:42:423
339950,0migration/323064-21irqcore08:52:383
339950,0migration/318846-21sh11:58:293
339950,0migration/318743-21fschecks_count08:27:353
339950,0migration/317433-21sh11:40:333
339950,0migration/316465-21fschecks_count10:07:353
339950,0migration/316150-21kthreadcore09:07:403
339950,0migration/313363-21munin-node08:42:423
339950,0migration/311325-21fschecks_count09:27:353
329950,0watchdog/35506-21cut07:32:413
329950,0watchdog/330689-21munin-node12:07:383
329950,0watchdog/326871-21aten_r1power_vo10:32:343
329950,0watchdog/326454-21ssh10:32:223
329950,0watchdog/325912-21python09:32:453
329950,0watchdog/322963-21df_inode11:07:343
329950,0watchdog/320669-21python08:02:453
329950,0watchdog/320494-21rm12:02:303
329950,0watchdog/314920-21sh12:34:423
329950,0watchdog/30-21swapper/312:37:383
29815050,0irq/29-eth0-tx-28109-21chrt12:05:212
29815050,0irq/29-eth0-tx-19756-21ssh10:46:432
29815050,0irq/29-eth0-tx-17070-21if_eth110:07:372
29815050,0irq/29-eth0-tx-0-21swapper/212:37:392
29815050,0irq/29-eth0-tx-0-21swapper/212:14:142
29815050,0irq/29-eth0-tx-0-21swapper/212:10:482
29815050,0irq/29-eth0-tx-0-21swapper/210:03:062
29815050,0irq/29-eth0-tx-0-21swapper/210:02:192
29805050,0irq/28-eth0-rx-6002-21ssh11:13:583
29805050,0irq/28-eth0-rx-3991-21smartctl10:37:353
29805050,0irq/28-eth0-rx-29972-21cut11:47:413
29805050,0irq/28-eth0-rx-12213-21ssh12:13:083
29805050,0irq/28-eth0-rx-0-21swapper/312:28:183
29805050,0irq/28-eth0-rx-0-21swapper/312:17:363
29805050,0irq/28-eth0-rx-0-21swapper/311:42:593
29805050,0irq/28-eth0-rx-0-21swapper/310:17:153
29805050,0irq/28-eth0-rx-0-21swapper/310:02:383
29805050,0irq/28-eth0-rx-0-21swapper/309:57:473
29805050,0irq/28-eth0-rx-0-21swapper/309:53:493
259950,0migration/25734-21kthreadcore10:37:382
259950,0migration/24873-21munin-node09:02:372
259950,0migration/229847-21gltestperf10:52:362
259950,0migration/227006-21munin-node10:47:482
259950,0migration/226548-21sh11:47:002
259950,0migration/220166-21timerandwakeup09:47:482
259950,0migration/217074-21kthreadcore11:57:432
259950,0migration/212476-21kthreadcore11:37:392
259950,0migration/212158-21kthreadcore12:32:402
259950,0migration/211571-21unixbench-2d09:42:462
259950,0migration/21126-21kthreadcore09:37:402
259950,0migration/210626-21latency_hist07:37:222
249950,0watchdog/2641-21ssh11:32:142
249950,0watchdog/221782-21ssh11:06:022
140959955,0cyclictest0-21swapper/212:29:072
140959950,0cyclictest0-21swapper/210:22:502
140949950,0cyclictest0-21swapper/111:47:131
140949950,0cyclictest0-21swapper/110:03:281
140949950,0cyclictest0-21swapper/109:21:321
140939950,0cyclictest0-21swapper/009:44:220
149950,0migration/05666-21kthreadcore08:17:400
149950,0migration/04752-21latency11:12:440
149950,0migration/0352-21kthreadcore12:07:390
149950,0migration/032476-21aten_r1power_po07:52:310
149950,0migration/032044-21taskset11:29:160
149950,0migration/026787-21kthreadcore12:42:400
149950,0migration/025296-21kthreadcore12:22:400
149950,0migration/024652-21kthreadcore08:07:400
149950,0migration/024360-21pmu-power09:12:460
149950,0migration/022021-21fschecks_count07:22:350
149950,0migration/021818-21irqcore12:02:390
149950,0migration/019112-21kthreadcore12:37:380
149950,0migration/019111-21fschecks_time11:42:350
149950,0migration/01899-21if_eth010:17:380
149950,0migration/018900-21kthreadcore11:22:420
149950,0migration/017245-21kthreadcore09:47:410
149950,0migration/016730-21kthreadcore08:02:400
149950,0migration/016097-21irqrtprio08:47:380
149950,0migration/016021-21timerandwakeup10:22:470
149950,0migration/015465-21kthreadcore10:42:410
149950,0migration/014445-21taskset10:03:580
149950,0migration/012960-21kthreadcore08:22:390
149950,0migration/012864-21taskset11:00:160
149950,0migration/012382-21kthreadcore11:17:410
8305040,0irq/26-0000:00:0-21swapper/209:07:232
339940,0migration/331170-21kthreadcore07:27:403
339940,0migration/32245-21irqrtprio10:17:393
339940,0migration/319619-21irqcore09:12:413
339940,0migration/318817-21kthreadcore08:47:403
329940,0watchdog/331292-21ntpq08:32:413
329940,0watchdog/30-21swapper/309:37:333
329940,0watchdog/30-21swapper/309:17:333
29815040,0irq/29-eth0-tx-4155-21kthreadcore10:17:402
29815040,0irq/29-eth0-tx-3460-21ssh11:52:352
29815040,0irq/29-eth0-tx-10669-21ssh09:27:262
29815040,0irq/29-eth0-tx-0-21swapper/211:47:362
29815040,0irq/29-eth0-tx-0-21swapper/211:22:332
29815040,0irq/29-eth0-tx-0-21swapper/211:08:132
29815040,0irq/29-eth0-tx-0-21swapper/210:32:562
29815040,0irq/29-eth0-tx-0-21swapper/210:28:272
29815040,0irq/29-eth0-tx-0-21swapper/210:12:312
29815040,0irq/29-eth0-tx-0-21swapper/209:52:322
29815040,0irq/29-eth0-tx-0-21swapper/209:32:412
29815040,0irq/29-eth0-tx-0-21swapper/008:32:340
29815040,0irq/29-eth0-tx-0-21swapper/007:32:490
29805040,0irq/28-eth0-rx-0-21swapper/311:52:463
29805040,0irq/28-eth0-rx-0-21swapper/311:32:333
29805040,0irq/28-eth0-rx-0-21swapper/308:37:393
259940,0migration/24838-21missed_timers11:12:442
259940,0migration/230766-21kthreadcore07:27:402
259940,0migration/22543-21ntp_offset08:57:412
259940,0migration/221045-21kthreadcore09:12:422
259940,0migration/213345-21kthreadcore11:17:412
249940,0watchdog/22690-21gltestperf09:22:372
249940,0watchdog/223764-21latency07:42:412
249940,0watchdog/222752-21aten_r1power_po12:22:342
249940,0watchdog/20-21swapper/209:17:332
249940,0watchdog/20-21swapper/208:02:412
249940,0watchdog/20-21swapper/207:52:372
179940,0migration/16611-21sh12:12:381
179940,0migration/15891-21taskset09:59:121
179940,0migration/14967-21kthreadcore10:17:401
179940,0migration/14515-21gltestperf07:32:371
179940,0migration/13816-21munin-node11:52:361
179940,0migration/13488-21idleruntime-cro08:17:221
179940,0migration/132129-21ksmtuned08:35:511
179940,0migration/130804-21kthreadcore08:57:381
179940,0migration/128448-21kthreadcore12:42:401
179940,0migration/127894-21switchtime08:07:471
179940,0migration/123876-21irqcore12:22:391
179940,0migration/120216-21latency_hist10:47:221
179940,0migration/12018-21kthreadcore12:27:401
179940,0migration/118288-21aten_r1power_vo10:27:331
179940,0migration/116514-21fschecks_count10:07:351
179940,0migration/114230-21fschecks_count09:47:371
179940,0migration/111849-21munin-node09:07:361
179940,0migration/110837-21latency_hist08:22:221
179940,0migration/110640-21ksmtuned08:21:511
169940,0watchdog/1574-21perl07:52:331
169940,0watchdog/129482-21grep07:47:411
169940,0watchdog/12689-21gltestperf09:22:371
169940,0watchdog/124599-21ssh10:12:331
169940,0watchdog/117710-21irqstats11:22:421
169940,0watchdog/117703-21ssh11:02:421
169940,0watchdog/10-21swapper/110:57:181
169940,0watchdog/10-21swapper/110:32:341
169940,0watchdog/10-21swapper/108:02:411
140959943,0cyclictest6315-21awk10:57:362
140959943,0cyclictest3571-21lldpd08:43:252
140959943,0cyclictest3571-21lldpd07:59:542
140959943,0cyclictest3571-21lldpd07:48:552
140959943,0cyclictest3524-21snmpd12:17:552
140959943,0cyclictest3524-21snmpd08:32:082
140959943,0cyclictest29921-21awk08:12:372
140959943,0cyclictest25891-21awk12:42:382
140959943,0cyclictest2477-21grep11:32:392
140959943,0cyclictest22844-21awk08:52:372
140959943,0cyclictest22733-21awk08:07:372
140959943,0cyclictest11793-21ls07:37:362
140949944,0cyclictest0-21swapper/112:17:571
140949944,0cyclictest0-21swapper/111:59:211
140949944,0cyclictest0-21swapper/111:19:091
140949944,0cyclictest0-21swapper/110:59:361
140949943,0cyclictest8590-21awk12:32:381
140949943,0cyclictest4186-21awk10:37:371
140949943,0cyclictest3571-21lldpd11:12:571
140949943,0cyclictest3571-21lldpd11:07:571
140949943,0cyclictest3571-21lldpd10:23:271
140949943,0cyclictest3571-21lldpd09:36:571
140949943,0cyclictest3571-21lldpd09:02:251
140949943,0cyclictest3524-21snmpd12:08:101
140949943,0cyclictest3524-21snmpd11:27:391
140949943,0cyclictest3524-21snmpd08:40:381
140949943,0cyclictest3524-21snmpd07:37:221
140949943,0cyclictest3250-21irqbalance12:05:291
140949943,0cyclictest3250-21irqbalance08:52:391
140949943,0cyclictest3250-21irqbalance08:47:391
140949943,0cyclictest29573-21awk09:37:381
140949943,0cyclictest28120-21awk11:47:391
140949943,0cyclictest23458-21awk09:52:381
140949943,0cyclictest2215-21awk11:32:381
140949943,0cyclictest10842-21awk11:37:361
140939944,0cyclictest0-21swapper/010:50:440
140939943,0cyclictest8697-21awk12:32:380
140939943,0cyclictest3571-21lldpd10:28:570
140939943,0cyclictest30049-21awk10:52:380
140939943,0cyclictest29621-21awk09:37:380
140939943,0cyclictest26328-21awk07:47:390
140939943,0cyclictest19210-21awk08:27:380
140939943,0cyclictest13724-21sadc12:17:230
140939943,0cyclictest11973-21awk07:37:370
140939940,0cyclictest2683-21munin-run10:37:220
140939940,0cyclictest0-21swapper/011:35:210
149940,0migration/04609-21kthreadcore10:37:380
149940,0migration/031636-21df_abs12:27:350
149940,0migration/03151-21irqcore09:22:400
149940,0migration/02202-21kthreadcore09:57:400
149940,0migration/021842-21kthreadcore07:42:400
149940,0migration/01701-21kthreadcore08:57:390
149940,0migration/015262-21gltestperf07:17:360
149940,0migration/014026-21aten_r1power_po11:02:340
339930,0migration/318285-21kthreadcore07:17:403
329930,0watchdog/3298050irq/28-eth0-rx-08:22:333
329930,0watchdog/30-21swapper/309:02:493
329930,0watchdog/30-21swapper/308:59:093
29815030,0irq/29-eth0-tx-0-21swapper/007:27:400
29805030,0irq/28-eth0-rx-0-21swapper/308:12:423
29805030,0irq/28-eth0-rx-0-21swapper/307:37:323
249930,0watchdog/20-21swapper/208:47:452
169930,0watchdog/10-21swapper/109:42:291
169930,0watchdog/10-21swapper/109:27:411
140959933,0cyclictest15433-21awk07:17:382
140959932,0cyclictest4055-21df_abs08:17:352
140959932,0cyclictest3571-21lldpd08:37:252
140959932,0cyclictest3571-21lldpd08:22:252
140959932,0cyclictest26365-21awk08:32:362
140959932,0cyclictest22559-21awk07:22:372
140949933,0cyclictest3571-21lldpd07:57:251
140949933,0cyclictest3571-21lldpd07:17:251
140949932,0cyclictest3571-21lldpd12:37:291
140949932,0cyclictest3524-21snmpd09:14:041
140949932,0cyclictest19060-21awk07:42:381
140949930,0cyclictest19667-21irqstats08:27:391
140949930,0cyclictest0-21swapper/107:24:431
140939933,0cyclictest28069-21awk11:47:390
140939932,0cyclictest4363-21awk11:52:380
140939932,0cyclictest22931-21awk08:52:370
140939932,0cyclictest16040-21grep09:07:400
140939932,0cyclictest15069-21awk12:17:380
140939932,0cyclictest10858-21awk11:37:360
140939931,0cyclictest3646-21kthreadcore08:37:390
140939931,0cyclictest16308-21df_abs10:07:340
140939930,0cyclictest0-21swapper/009:02:250
149930,0migration/029626-21fschecks_time08:12:350
149930,0migration/020576-21sh09:32:370
149930,0migration/018887-21sh09:31:240
140949920,0cyclictest0-21swapper/107:27:221
140939921,0cyclictest7488-21basename08:42:340
140939921,0cyclictest6314-21runrttasks10:12:300
140939920,0cyclictest0-21swapper/011:07:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional