You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 07:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Wed Apr 15, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
919624130,0sleep00-21swapper/019:16:190
942624030,0sleep20-21swapper/219:19:012
937223927,0sleep30-21swapper/319:18:223
918723725,0sleep10-21swapper/119:16:121
339960,0migration/332389-21sh00:12:113
339960,0migration/324533-21latency_hist21:00:143
339960,0migration/320264-21sh22:30:383
339960,0migration/319453-21sh00:41:573
339960,0migration/318826-21sh23:25:493
339960,0migration/317013-21sh21:53:143
339960,0migration/315899-21sh22:50:133
339960,0migration/31491-21aten_r1power_po00:15:293
339960,0migration/314629-21munin-node23:45:263
329960,0watchdog/34301-21grep23:55:333
29815060,0irq/29-eth0-tx-20741-21munin-node19:50:310
29805060,0irq/28-eth0-rx-0-21swapper/323:23:173
29805060,0irq/28-eth0-rx-0-21swapper/300:03:093
149960,0migration/09872-21sh22:06:050
149960,0migration/028532-21sh21:22:290
149960,0migration/021886-21sh22:34:100
96059955,0cyclictest0-21swapper/223:20:282
96059955,0cyclictest0-21swapper/200:30:282
96059950,0cyclictest0-21swapper/222:06:312
96049955,0cyclictest0-21swapper/123:55:011
96049950,0cyclictest0-21swapper/122:15:511
96049950,0cyclictest0-21swapper/121:47:001
96049950,0cyclictest0-21swapper/100:21:311
8305050,0irq/26-0000:00:3206-17auditd23:15:142
35150,0ktimersoftd/30-21swapper/320:10:293
339950,0migration/37484-21fschecks_time21:10:283
339950,0migration/34533-21kthreadcore20:00:303
339950,0migration/3387-21kthreadcore23:35:313
339950,0migration/331150-21taskset19:35:033
339950,0migration/32787-21latency_hist20:45:143
339950,0migration/325433-21kthreadcore22:15:323
339950,0migration/32377-21kthreadcore21:25:343
339950,0migration/32325-21kthreadcore19:35:313
339950,0migration/323228-21taskset21:38:413
339950,0migration/319959-21munin-node19:45:393
339950,0migration/312929-21timerwakeupswit21:30:393
339950,0migration/31076-21pmu-power00:30:363
339950,0migration/310279-21fschecks_count23:05:283
329950,0watchdog/35654-21munin-node23:40:253
329950,0watchdog/35518-21python20:20:373
329950,0watchdog/328150-21kthreadcore22:55:333
329950,0watchdog/325268-21kthreadcore20:35:333
329950,0watchdog/322532-21python22:50:373
329950,0watchdog/320043-21kthreadcore00:05:333
329950,0watchdog/30-21swapper/322:40:333
329950,0watchdog/30-21swapper/321:24:053
329950,0watchdog/30-21swapper/321:15:293
29815050,0irq/29-eth0-tx-16666-21cpu00:05:282
29815050,0irq/29-eth0-tx-12340-21munin-node00:40:312
29815050,0irq/29-eth0-tx-0-21swapper/021:17:130
29815050,0irq/29-eth0-tx-0-21swapper/019:45:300
29805050,0irq/28-eth0-rx-7246-21timerwakeupswit21:45:393
29805050,0irq/28-eth0-rx-3867-21ssh22:05:283
29805050,0irq/28-eth0-rx-30028-21if_eth022:20:273
29805050,0irq/28-eth0-rx-23358-21fschecks_time22:35:273
29805050,0irq/28-eth0-rx-21588-21kthreadcore21:55:333
29805050,0irq/28-eth0-rx-12880-21ps22:10:313
29805050,0irq/28-eth0-rx-10633-21ssh00:36:193
29805050,0irq/28-eth0-rx-0-21swapper/323:11:583
29805050,0irq/28-eth0-rx-0-21swapper/322:26:483
29805050,0irq/28-eth0-rx-0-21swapper/322:00:173
29805050,0irq/28-eth0-rx-0-21swapper/321:41:193
29805050,0irq/28-eth0-rx-0-21swapper/300:47:273
29805050,0irq/28-eth0-rx-0-21swapper/300:25:323
29805050,0irq/28-eth0-rx-0-21swapper/300:22:573
259950,0migration/28203-21fschecks_count22:45:272
259950,0migration/232273-21kthreadcore22:00:322
259950,0migration/224949-21fschecks_time21:40:292
249950,0watchdog/229079-21ssh21:23:532
249950,0watchdog/218228-21ssh23:25:372
249950,0watchdog/217896-21fschecks_time19:25:282
249950,0watchdog/210879-21tr20:25:332
179950,0migration/19468-21aten_r1power_fr21:50:251
179950,0migration/15831-21kthreadcore23:20:321
179950,0migration/1312-21kthreadcore21:25:331
179950,0migration/130227-21kthreadcore23:15:321
179950,0migration/127758-21sh23:31:351
179950,0migration/125780-21kthreadcore21:40:331
179950,0migration/117607-21kthreadcore23:25:351
179950,0migration/116320-21idleruntime21:35:291
179950,0migration/116201-21kthreadcore22:10:321
169950,0watchdog/17350-21seq23:59:531
169950,0watchdog/13637-21cut22:40:331
149950,0migration/09442-21taskset20:01:310
149950,0migration/07875-21kthreadcore19:40:310
149950,0migration/07384-21sh00:00:000
149950,0migration/06698-21taskset22:43:390
149950,0migration/0655-21kthreadcore00:30:330
149950,0migration/05391-21kthreadcore00:35:320
149950,0migration/05169-21sh23:39:430
149950,0migration/04328-21taskset22:23:320
149950,0migration/032066-21fschecks_time19:35:270
149950,0migration/031584-21taskset22:55:530
149950,0migration/031405-21kthreadcore19:55:320
149950,0migration/028633-21kthreadcore23:50:320
149950,0migration/028084-21kthreadcore21:00:320
149950,0migration/026046-21kthreadcore22:35:310
149950,0migration/025526-21df_abs00:10:280
149950,0migration/024773-21fschecks_count19:30:270
149950,0migration/021556-21fschecks_time23:30:280
149950,0migration/021298-21kthreadcore20:10:320
149950,0migration/021134-21fschecks_time22:15:270
149950,0migration/020324-21irqrtprio00:25:310
149950,0migration/020145-21kthreadcore22:50:320
149950,0migration/018659-21smart_sdb00:40:390
149950,0migration/015828-21kthreadcore23:25:340
149950,0migration/010106-21sh00:20:190
149950,0migration/010097-21kthreadcore22:45:310
96059943,0cyclictest7395-21awk19:40:292
96059943,0cyclictest3571-21lldpd00:46:152
96059943,0cyclictest3524-21snmpd21:50:162
96059943,0cyclictest3524-21snmpd21:06:452
96059943,0cyclictest3524-21snmpd20:46:452
96059943,0cyclictest3524-21snmpd20:03:152
96059943,0cyclictest3250-21irqbalance22:25:202
96059943,0cyclictest3250-21irqbalance22:20:202
96059943,0cyclictest3250-21irqbalance22:10:302
96059943,0cyclictest31057-21awk21:25:322
96059943,0cyclictest30466-21awk23:35:292
96059943,0cyclictest29015-21awk19:55:302
96059943,0cyclictest20508-21sadc19:50:142
96059943,0cyclictest19915-21awk00:25:302
96059943,0cyclictest18478-21awk20:55:312
96059943,0cyclictest17327-21awk22:50:302
96059943,0cyclictest11109-21awk20:05:292
96059940,0cyclictest0-21swapper/220:16:592
96049944,0cyclictest0-21swapper/122:36:021
96049944,0cyclictest0-21swapper/100:09:511
96049943,0cyclictest25242-21awk19:30:291
96049943,0cyclictest2483-21awk00:15:331
96049943,0cyclictest2467-21sadc20:00:141
96049943,0cyclictest22078-21awk20:35:311
96049943,0cyclictest13489-21awk00:40:311
96039943,0cyclictest7851-21awk21:10:300
96039943,0cyclictest3571-21lldpd21:41:140
96039943,0cyclictest3524-21snmpd00:46:020
96039943,0cyclictest27727-21awk22:00:290
96039943,0cyclictest24420-21munin-node20:15:320
96039943,0cyclictest18493-21awk20:55:310
96039940,0cyclictest0-21swapper/021:34:140
96039940,0cyclictest0-21swapper/021:25:530
8305040,0irq/26-0000:00:0-21swapper/223:40:142
8305040,0irq/26-0000:00:0-21swapper/221:15:142
339940,0migration/323083-21kthreadcore19:50:323
339940,0migration/311375-21kthreadcore19:40:323
329940,0watchdog/31692-21sensors_volt19:55:363
329940,0watchdog/30-21swapper/323:50:493
329940,0watchdog/30-21swapper/323:30:333
329940,0watchdog/30-21swapper/323:00:253
329940,0watchdog/30-21swapper/321:02:413
329940,0watchdog/30-21swapper/320:50:333
329940,0watchdog/30-21swapper/320:45:333
329940,0watchdog/30-21swapper/320:25:333
329940,0watchdog/30-21swapper/320:05:253
29815040,0irq/29-eth0-tx-3615-21munin-node00:35:342
29815040,0irq/29-eth0-tx-31480-21munin-node23:55:372
29815040,0irq/29-eth0-tx-29542-21cat23:15:322
29815040,0irq/29-eth0-tx-27464-21ssh23:30:472
29815040,0irq/29-eth0-tx-0-21swapper/223:53:442
29815040,0irq/29-eth0-tx-0-21swapper/223:00:282
29815040,0irq/29-eth0-tx-0-21swapper/222:35:532
29815040,0irq/29-eth0-tx-0-21swapper/222:31:522
29815040,0irq/29-eth0-tx-0-21swapper/222:15:262
29815040,0irq/29-eth0-tx-0-21swapper/221:56:232
29815040,0irq/29-eth0-tx-0-21swapper/221:30:342
29815040,0irq/29-eth0-tx-0-21swapper/200:20:212
29815040,0irq/29-eth0-tx-0-21swapper/200:15:192
29815040,0irq/29-eth0-tx-0-21swapper/020:30:250
29815040,0irq/29-eth0-tx-0-21swapper/020:29:200
29815040,0irq/29-eth0-tx-0-21swapper/020:20:310
29815040,0irq/29-eth0-tx-0-21swapper/019:25:290
29805040,0irq/28-eth0-rx-0-21swapper/323:17:093
29805040,0irq/28-eth0-rx-0-21swapper/320:30:273
259940,0migration/231951-21diskmemload00:11:012
259940,0migration/231106-21latency_hist22:40:142
259940,0migration/225609-21fschecks_time22:55:292
259940,0migration/225265-21fschecks_count21:00:282
259940,0migration/220887-21latency_hist20:35:142
259940,0migration/22080-21kthreadcore20:20:312
259940,0migration/216744-21kthreadcore23:45:312
249940,0watchdog/219605-21missed_timers20:30:332
249940,0watchdog/216576-21chrt19:22:562
249940,0watchdog/210834-21chrt23:05:292
249940,0watchdog/20-21swapper/221:45:292
249940,0watchdog/20-21swapper/221:36:012
249940,0watchdog/20-21swapper/221:15:292
249940,0watchdog/20-21swapper/220:40:252
249940,0watchdog/20-21swapper/200:00:292
179940,0migration/17973-21irqrtprio20:25:311
179940,0migration/16861-21kthreadcore20:00:301
179940,0migration/16438-21cpu19:40:261
179940,0migration/132308-21kthreadcore00:30:331
179940,0migration/131967-21munin-node21:05:261
179940,0migration/130137-21kthreadcore22:00:321
179940,0migration/127309-21switchtime00:45:391
179940,0migration/125270-21taskset23:11:061
179940,0migration/12348-21kthreadcore19:35:311
179940,0migration/122946-21kthreadcore19:50:321
179940,0migration/120531-21taskset21:15:421
179940,0migration/120167-21irqcore00:25:311
179940,0migration/119299-21kthreadcore20:55:331
179940,0migration/116199-21kthreadcore23:45:311
169940,0watchdog/19775-21ssh22:05:491
169940,0watchdog/131767-21kthreadcore22:20:291
169940,0watchdog/130473-21kthreadcore00:10:331
169940,0watchdog/130260-21cut21:00:331
169940,0watchdog/128314-21cpu20:40:251
169940,0watchdog/128151-21kthreadcore22:55:331
169940,0watchdog/125471-21if_err_eth1.220:15:291
169940,0watchdog/123647-21kthreadcore21:55:331
169940,0watchdog/123416-21python20:10:371
169940,0watchdog/111138-21kthreadcore22:25:331
169940,0watchdog/10-21swapper/121:30:291
169940,0watchdog/10-21swapper/120:30:331
169940,0watchdog/10-21swapper/100:00:291
149940,0migration/032318-21fschecks_count21:05:270
149940,0migration/031369-21kthreadcore20:40:300
149940,0migration/021324-21kthreadcore00:05:340
149940,0migration/01463-21fschecks_time21:45:280
149940,0migration/014052-21kthreadcore22:10:310
10003240,0sleep00-21swapper/000:00:300
96059932,0cyclictest21918-21awk19:50:302
96059932,0cyclictest18310-21awk20:10:292
96059932,0cyclictest13023-21cut20:50:322
96059932,0cyclictest0-21swapper/219:35:282
96049932,0cyclictest8318-21kthreadcore21:10:321
96049932,0cyclictest7860-21cpuspeed_turbos22:45:261
96049932,0cyclictest5616-21cut00:35:321
96049932,0cyclictest22311-21awk21:20:311
96049932,0cyclictest15012-21awk22:30:301
96049932,0cyclictest10137-21tr19:20:251
96049930,0cyclictest14369-21perl19:45:281
96049930,0cyclictest0-21swapper/123:00:271
96039933,0cyclictest0-21swapper/021:50:380
96039933,0cyclictest0-21swapper/000:17:060
96039932,0cyclictest6725-21awk23:40:290
96039932,0cyclictest6314-21runrttasks23:01:190
96039932,0cyclictest3524-21snmpd20:48:150
96039932,0cyclictest25260-21kthreadcore20:35:330
96039932,0cyclictest21463-21kthreadcore23:10:320
96039932,0cyclictest15473-21awk23:45:290
96039932,0cyclictest11301-21awk20:50:300
96039932,0cyclictest10836-21idleruntime23:05:290
96039932,0cyclictest10006-21munin-node20:05:330
96039930,0cyclictest31799-21kthreadcore23:15:320
96039930,0cyclictest21160-21cut21:35:320
96039930,0cyclictest0-21swapper/022:25:310
329930,0watchdog/325472-21if_err_eth1.220:15:293
329930,0watchdog/30-21swapper/321:05:173
329930,0watchdog/30-21swapper/319:25:283
329930,0watchdog/30-21swapper/319:21:003
29815030,0irq/29-eth0-tx-0-21swapper/019:20:240
259930,0migration/225104-21gltestperf19:30:282
179930,0migration/16641-21hddtemp_smartct23:40:291
169930,0watchdog/10-21swapper/123:35:251
169930,0watchdog/10-21swapper/123:05:291
169930,0watchdog/10-21swapper/122:50:371
169930,0watchdog/10-21swapper/120:50:331
169930,0watchdog/10-21swapper/120:45:171
169930,0watchdog/10-21swapper/120:05:251
169930,0watchdog/10-21swapper/119:25:321
149930,0migration/025093-21sh21:56:370
96049921,0cyclictest31569-21latency_hist20:20:141
96039920,0cyclictest0-21swapper/023:20:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional