You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 18:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sun Apr 26, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1460224635,0sleep00-21swapper/007:19:150
1448923627,0sleep10-21swapper/107:18:001
1445123627,0sleep30-21swapper/307:17:303
1458322817,0sleep20-21swapper/207:19:052
148349983,0cyclictest9887-21awk11:21:271
148349983,0cyclictest15748-21awk09:51:271
148389975,0cyclictest0-21swapper/211:25:272
148389973,0cyclictest5788-21awk11:56:282
148389973,0cyclictest5273-21awk10:41:272
148389973,0cyclictest3524-21snmpd09:10:392
148389973,0cyclictest29183-21sadc07:31:102
148389972,0cyclictest1816-21awk07:56:262
148389970,0cyclictest7928-21latency_hist08:01:102
148389970,0cyclictest7589-21sh11:18:502
148389970,0cyclictest25320-21ntp_kernel_err10:31:292
148389970,0cyclictest21493-21munin-node10:51:232
148389970,0cyclictest12867-21munin-node09:11:242
148389970,0cyclictest11688-21munin-node09:31:342
148389970,0cyclictest0-21swapper/212:22:502
148389970,0cyclictest0-21swapper/211:41:122
148349973,0cyclictest21632-21awk09:36:261
148349972,0cyclictest16154-21awk07:21:261
35160,0ktimersoftd/30-21swapper/312:11:253
339960,0migration/36788-21sh11:16:373
339960,0migration/3559-21sh10:18:313
339960,0migration/33671-21timerwakeupswit08:16:383
339960,0migration/331385-21sh11:14:113
339960,0migration/330348-21latency_hist12:11:113
339960,0migration/327700-21taskset09:37:413
339960,0migration/324599-21sh11:27:593
339960,0migration/316432-21sh10:10:353
29815060,0irq/29-eth0-tx-11889-21munin-node09:11:300
29805060,0irq/28-eth0-rx-6942-21python12:31:363
29805060,0irq/28-eth0-rx-3435-21perl09:26:263
29805060,0irq/28-eth0-rx-22749-21ssh09:55:333
148389964,0cyclictest0-21swapper/208:51:342
148389962,0cyclictest7491-21awk11:01:282
148389962,0cyclictest24036-21cut08:56:282
148389962,0cyclictest18599-21grep08:06:282
148389962,0cyclictest16606-21cut12:01:292
148389962,0cyclictest15343-21cut09:51:252
148389962,0cyclictest12975-21cpu10:46:242
148389962,0cyclictest0-21swapper/211:51:322
148389961,0cyclictest30807-21awk08:16:292
148389961,0cyclictest22466-21kthreadcore09:16:282
148389961,0cyclictest17337-21kthreadcore07:21:272
148389961,0cyclictest10738-21irqrtprio12:36:282
148389961,0cyclictest0-21swapper/209:41:242
148389960,0cyclictest8366-21grep09:26:302
148389960,0cyclictest7494-21irqstats09:46:282
148389960,0cyclictest4985-21ssh10:58:032
148389960,0cyclictest3933-21kthreadcore11:36:292
148389960,0cyclictest31361-21tune2fs12:11:262
148389960,0cyclictest29073-21cut11:31:302
148389960,0cyclictest28567-21cut10:36:262
148389960,0cyclictest23537-21kernelversion12:06:292
148389960,0cyclictest21497-21kthreadcore10:11:282
148389960,0cyclictest20596-21gltestperf11:46:262
148389960,0cyclictest19807-21gltestperf08:31:252
148389960,0cyclictest1931-21kthreadcore09:01:312
148389960,0cyclictest1667-21sort10:21:112
148389960,0cyclictest1408-21ssh09:23:492
148389960,0cyclictest13016-21kthreadcore10:06:292
148389960,0cyclictest12786-21if_eth008:26:282
148389960,0cyclictest10513-21munin-node08:21:312
148389960,0cyclictest0-21swapper/212:46:382
148389960,0cyclictest0-21swapper/212:43:172
148389960,0cyclictest0-21swapper/212:26:232
148389960,0cyclictest0-21swapper/211:14:512
148389960,0cyclictest0-21swapper/210:26:362
148389960,0cyclictest0-21swapper/210:01:192
148389960,0cyclictest0-21swapper/209:56:322
148349962,0cyclictest3524-21snmpd09:58:271
148349962,0cyclictest3524-21snmpd09:18:191
148349962,0cyclictest31250-21awk10:56:281
148349962,0cyclictest29279-21grep12:46:291
148349962,0cyclictest14436-21sensors08:46:321
148349962,0cyclictest12627-21awk07:41:251
148349960,0cyclictest29710-21kthreadcore07:51:301
148349960,0cyclictest25192-21kthreadcore12:06:291
148349960,0cyclictest22698-21if_eth1.310:51:261
148349960,0cyclictest18988-21sh09:32:531
148339965,0cyclictest31751-21ps10:56:300
148339960,0cyclictest0-21swapper/010:40:240
149960,0migration/05862-21sh12:14:010
149960,0migration/021652-21sh09:52:310
149960,0migration/019525-21taskset09:34:100
339950,0migration/37051-21kthreadcore10:41:293
339950,0migration/37046-21kthreadcore11:56:293
339950,0migration/35807-21kthreadcore08:41:293
339950,0migration/34778-21aten_r1power_fr09:06:233
339950,0migration/3419-21kthreadcore07:31:283
339950,0migration/33607-21irqcore11:36:283
339950,0migration/332573-21kthreadcore10:36:303
339950,0migration/332394-21fschecks_count10:01:253
339950,0migration/332377-21ntp_offset09:21:313
339950,0migration/331133-21kthreadcore07:51:313
339950,0migration/328026-21irqrtprio12:46:283
339950,0migration/32623-21fschecks_time10:21:253
339950,0migration/326020-21latency_hist08:36:113
339950,0migration/325383-21kthreadcore08:56:293
339950,0migration/322252-21kthreadcore08:31:293
339950,0migration/322231-21ksmtuned07:26:123
339950,0migration/318686-21idleruntime-cro08:31:103
339950,0migration/313835-21kthreadcore09:11:263
339950,0migration/312387-21irqcore11:41:293
339950,0migration/310893-21timerwakeupswit08:21:363
339950,0migration/310213-21gltestperf12:36:253
329950,0watchdog/330864-21fschecks_time10:56:263
329950,0watchdog/319349-21cut12:01:303
329950,0watchdog/315631-21rm11:22:143
329950,0watchdog/312829-21kthreadcore12:16:303
329950,0watchdog/30-21swapper/312:26:303
29815050,0irq/29-eth0-tx-11523-21munin-node07:41:260
29805050,0irq/28-eth0-rx-6418-21ssh11:01:233
29805050,0irq/28-eth0-rx-32120-21kthreadcore11:51:293
29805050,0irq/28-eth0-rx-29580-21python09:56:353
29805050,0irq/28-eth0-rx-18954-21sh09:32:473
29805050,0irq/28-eth0-rx-0-21swapper/312:41:293
29805050,0irq/28-eth0-rx-0-21swapper/311:33:303
29805050,0irq/28-eth0-rx-0-21swapper/311:08:473
29805050,0irq/28-eth0-rx-0-21swapper/310:46:293
29805050,0irq/28-eth0-rx-0-21swapper/310:34:273
29805050,0irq/28-eth0-rx-0-21swapper/310:30:463
29805050,0irq/28-eth0-rx-0-21swapper/310:14:143
29805050,0irq/28-eth0-rx-0-21swapper/309:44:063
29805050,0irq/28-eth0-rx-0-21swapper/309:06:113
148389950,0cyclictest827-21cut08:41:112
148389950,0cyclictest8150-21cat08:46:112
148389950,0cyclictest6832-21sed12:16:112
148389950,0cyclictest29375-21sed07:31:102
148389950,0cyclictest26045-21sed08:36:112
148389950,0cyclictest22359-21sed08:11:102
148389950,0cyclictest20433-21cat09:36:112
148389950,0cyclictest18616-21latency_hist07:46:102
148389950,0cyclictest1780-21grep10:21:112
148389950,0cyclictest17300-21sh11:26:132
148389950,0cyclictest15123-21munin-node11:06:222
148389950,0cyclictest11440-21cat07:41:102
148389950,0cyclictest0-21swapper/212:31:112
148389950,0cyclictest0-21swapper/207:51:122
148389950,0cyclictest0-21swapper/207:36:112
148349955,0cyclictest0-21swapper/112:40:051
148349955,0cyclictest0-21swapper/111:56:441
148349955,0cyclictest0-21swapper/111:46:481
148349955,0cyclictest0-21swapper/111:41:261
148349952,0cyclictest7321-21cut09:46:281
148349952,0cyclictest24221-21sensors12:41:341
148349952,0cyclictest12923-21awk09:11:241
148349951,0cyclictest9378-21awk10:06:261
148349950,0cyclictest3440-21kthreadcore12:11:311
148349950,0cyclictest31708-21munin-node10:16:311
148349950,0cyclictest19371-21munin-node10:31:211
148349950,0cyclictest1317-21fschecks_count07:56:241
148349950,0cyclictest0-21swapper/111:28:281
148339950,0cyclictest0-21swapper/012:38:570
148339950,0cyclictest0-21swapper/012:27:550
149950,0migration/06702-21unixbench_multi11:16:360
149950,0migration/06538-21kthreadcore10:21:290
149950,0migration/06306-21kthreadcore07:36:300
149950,0migration/06262-21latency_hist11:01:110
149950,0migration/05552-21kthreadcore07:56:280
149950,0migration/03832-21irqrtprio11:36:280
149950,0migration/03650-21kthreadcore10:01:300
149950,0migration/03570-21fschecks_time09:26:260
149950,0migration/031767-21kthreadcore11:51:280
149950,0migration/030092-21sh09:57:020
149950,0migration/029345-21sh10:54:470
149950,0migration/027797-21irqcore12:46:280
149950,0migration/027268-21kthreadcore11:11:290
149950,0migration/026714-21sh10:33:450
149950,0migration/022634-21kthreadcore08:31:290
149950,0migration/019535-21latency_hist11:46:120
149950,0migration/017664-21cpuspeed_turbos11:26:240
149950,0migration/017351-21sh11:41:370
149950,0migration/016307-21irqcore07:21:270
149950,0migration/013961-21fschecks_count12:01:250
149950,0migration/013632-21kthreadcore08:46:280
149950,0migration/012116-21pmu-power09:46:330
149950,0migration/011231-21taskset08:23:480
149950,0migration/010050-21kthreadcore10:06:280
339940,0migration/326319-21kthreadcore08:11:283
339940,0migration/324562-21kthreadcore11:46:303
339940,0migration/321401-21sensors_fan08:06:333
339940,0migration/310655-21kthreadcore08:46:273
329940,0watchdog/35896-21kthreadcore07:36:293
329940,0watchdog/311648-21kthreadcore08:01:293
329940,0watchdog/30-21swapper/312:21:303
329940,0watchdog/30-21swapper/310:52:103
329940,0watchdog/30-21swapper/307:57:133
329940,0watchdog/30-21swapper/307:21:213
29815040,0irq/29-eth0-tx-0-21swapper/009:21:190
29815040,0irq/29-eth0-tx-0-21swapper/009:08:180
29815040,0irq/29-eth0-tx-0-21swapper/008:11:210
29805040,0irq/28-eth0-rx-0-21swapper/309:46:293
29805040,0irq/28-eth0-rx-0-21swapper/308:51:233
169940,0watchdog/10-21swapper/107:36:291
169940,0watchdog/10-21swapper/107:26:291
148349944,0cyclictest0-21swapper/112:23:231
148349944,0cyclictest0-21swapper/112:16:551
148349944,0cyclictest0-21swapper/110:30:491
148349943,0cyclictest9206-21awk08:01:281
148349943,0cyclictest8455-21sadc11:21:111
148349943,0cyclictest507-21awk10:01:271
148349943,0cyclictest3571-21lldpd11:37:431
148349943,0cyclictest3571-21lldpd11:13:121
148349943,0cyclictest3571-21lldpd10:38:111
148349943,0cyclictest3571-21lldpd10:15:111
148349943,0cyclictest3571-21lldpd09:46:101
148349943,0cyclictest3571-21lldpd09:26:091
148349943,0cyclictest3571-21lldpd08:51:381
148349943,0cyclictest3524-21snmpd09:05:391
148349943,0cyclictest3524-21snmpd09:00:391
148349943,0cyclictest3524-21snmpd08:12:241
148349943,0cyclictest3524-21snmpd07:32:541
148349943,0cyclictest3043-21awk10:21:271
148349941,0cyclictest27241-21awk11:31:281
148349940,0cyclictest14039-21perl12:01:251
148349940,0cyclictest0-21swapper/108:29:531
148339944,0cyclictest0-21swapper/011:06:530
148339944,0cyclictest0-21swapper/010:42:170
148339944,0cyclictest0-21swapper/009:36:420
148339944,0cyclictest0-21swapper/008:41:120
148339943,0cyclictest4237-21sadc08:21:100
148339943,0cyclictest3524-21snmpd10:27:100
148339943,0cyclictest3250-21irqbalance12:21:280
148339943,0cyclictest30299-21sadc12:11:110
149940,0migration/027151-21irqrtprio10:16:290
149940,0migration/026078-21sh12:45:450
149940,0migration/026073-21kthreadcore08:56:290
149940,0migration/018271-21irqcore10:11:270
149940,0migration/016915-21kthreadcore08:06:280
149940,0migration/013164-21irqrtprio08:26:290
29815030,0irq/29-eth0-tx-0-21swapper/008:01:240
29805030,0irq/28-eth0-rx-0-21swapper/309:17:343
29805030,0irq/28-eth0-rx-0-21swapper/307:46:223
29805030,0irq/28-eth0-rx-0-21swapper/307:41:313
148349932,0cyclictest5242-21if_err_eth1.210:41:271
148349932,0cyclictest5210-21perl08:21:241
148349932,0cyclictest3571-21lldpd08:17:351
148349932,0cyclictest3524-21snmpd07:50:241
148349932,0cyclictest30631-21sensors12:26:341
148349932,0cyclictest19945-21awk08:31:261
148349932,0cyclictest19170-21sh10:46:341
148349932,0cyclictest16360-21awk08:06:271
148349932,0cyclictest16295-21awk11:06:271
148349930,0cyclictest6861-21cut09:06:281
148349930,0cyclictest4816-21cut12:31:301
148349930,0cyclictest4328-21irqrtprio09:26:291
148349930,0cyclictest28211-21latency_hist11:51:111
148349930,0cyclictest26534-21diskstats08:36:251
148349930,0cyclictest2121-21interrupts08:41:271
148349930,0cyclictest11392-21kthreadcore11:01:311
148339933,0cyclictest29302-21kworker/0:012:31:290
148339933,0cyclictest29302-21kworker/0:012:17:250
148339933,0cyclictest14032-21kworker/0:111:31:140
148339933,0cyclictest14032-21kworker/0:111:21:120
148339933,0cyclictest14032-21kworker/0:110:46:220
148339933,0cyclictest14032-21kworker/0:107:51:160
148339933,0cyclictest14032-21kworker/0:107:46:120
148339933,0cyclictest14032-21kworker/0:107:31:220
148339933,0cyclictest14032-21kworker/0:107:26:220
148339932,0cyclictest31704-21kthreadcore09:41:270
148339932,0cyclictest30597-21tune2fs09:01:260
148339932,0cyclictest25289-21sensors09:16:330
148339932,0cyclictest11007-21sensors11:56:340
148339930,0cyclictest26533-21diskstats08:36:250
148339930,0cyclictest15442-21munin-node08:51:310
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional