You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 11:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Sun Jun 14, 2026 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
318062209194,11sleep10-21swapper/119:09:321
315762193175,13sleep00-21swapper/019:06:340
315892192175,12sleep30-21swapper/319:06:463
31652211179,12sleep20-21swapper/219:07:322
87032540,0sleep00-21swapper/021:15:490
227442520,0sleep10-21swapper/123:45:141
191282470,0sleep10-21swapper/123:59:531
54762430,0sleep00-21swapper/023:52:420
310312430,0sleep10-21swapper/122:14:441
247172110,0sleep20-21swapper/221:40:022
3202099102,4cyclictest19601-21awk22:25:010
320309985,1cyclictest40-21ksoftirqd/322:50:143
320309980,1cyclictest14953-21ntp_states23:25:173
320209982,3cyclictest15774-21munin-run00:30:000
320209981,3cyclictest14390-21perf21:35:010
320309975,0cyclictest40-21ksoftirqd/321:50:013
320309966,0cyclictest40-21ksoftirqd/323:30:113
320309963,0cyclictest40-21ksoftirqd/300:05:133
320309961,0cyclictest81rcu_preempt23:55:123
320309961,0cyclictest81rcu_preempt20:00:093
320309961,0cyclictest81rcu_preempt19:25:123
320309960,2cyclictest40-21ksoftirqd/323:40:003
320309960,1cyclictest40-21ksoftirqd/322:40:003
320309960,1cyclictest40-21ksoftirqd/319:45:133
320209960,3cyclictest11149-21perf23:40:000
320309955,0cyclictest40-21ksoftirqd/322:50:013
320309955,0cyclictest40-21ksoftirqd/322:30:013
320309955,0cyclictest40-21ksoftirqd/321:05:163
320309955,0cyclictest40-21ksoftirqd/300:00:103
320309955,0cyclictest0-21swapper/322:41:413
320309954,1cyclictest40-21ksoftirqd/300:30:103
320309953,0cyclictest40-21ksoftirqd/323:50:193
320309953,0cyclictest40-21ksoftirqd/323:05:113
320309953,0cyclictest40-21ksoftirqd/319:15:013
320309953,0cyclictest40-21ksoftirqd/300:25:183
320309950,5cyclictest0-21swapper/323:45:173
320309950,5cyclictest0-21swapper/300:23:583
320309950,3cyclictest81rcu_preempt20:50:123
320309950,3cyclictest40-21ksoftirqd/323:20:133
320309950,2cyclictest40-21ksoftirqd/321:25:123
320309950,0cyclictest81rcu_preempt22:20:003
320309950,0cyclictest23579-21kworker/u8:021:40:163
320269954,1cyclictest5221-21ssh22:01:262
320269954,1cyclictest0-21swapper/221:42:142
320269950,5cyclictest32415-21ssh23:18:142
320269950,0cyclictest0-21swapper/222:44:202
320249951,2cyclictest0-21swapper/121:25:111
320249951,2cyclictest0-21swapper/120:20:131
320249950,5cyclictest0-21swapper/122:00:031
320249950,5cyclictest0-21swapper/121:15:501
320249950,0cyclictest0-21swapper/123:32:541
320209950,5cyclictest0-21swapper/019:16:530
320209950,4cyclictest30028-21apt-get22:30:000
320209950,1cyclictest11098-21munin-run22:05:010
320309944,0cyclictest40-21ksoftirqd/323:10:013
320309944,0cyclictest40-21ksoftirqd/322:20:183
320309944,0cyclictest40-21ksoftirqd/322:10:093
320309944,0cyclictest40-21ksoftirqd/321:55:203
320309944,0cyclictest40-21ksoftirqd/321:50:133
320309944,0cyclictest40-21ksoftirqd/321:35:103
320309944,0cyclictest40-21ksoftirqd/321:30:033
320309944,0cyclictest40-21ksoftirqd/321:00:013
320309944,0cyclictest40-21ksoftirqd/319:40:183
320309944,0cyclictest40-21ksoftirqd/319:40:003
320309944,0cyclictest40-21ksoftirqd/319:15:013
320309944,0cyclictest14178-21kworker/3:020:29:323
320309944,0cyclictest14178-21kworker/3:019:33:333
320309944,0cyclictest0-21swapper/322:56:403
320309943,1cyclictest11817-21tr22:05:123
320309943,0cyclictest40-21ksoftirqd/322:00:133
320309943,0cyclictest40-21ksoftirqd/300:10:163
320309942,1cyclictest40-21ksoftirqd/319:20:103
320309942,0cyclictest40-21ksoftirqd/322:25:033
320309942,0cyclictest40-21ksoftirqd/320:15:113
320309940,4cyclictest16003-21rm23:41:453
320309940,4cyclictest0-21swapper/323:01:253
320309940,4cyclictest0-21swapper/321:15:133
320309940,4cyclictest0-21swapper/320:10:113
320309940,4cyclictest0-21swapper/300:15:103
320309940,3cyclictest24236-21python21:00:203
320309940,3cyclictest16199-21ssh21:20:113
320309940,3cyclictest16119-21hddtemp_smartct20:45:133
320309940,3cyclictest15179-21cat20:45:003
320309940,3cyclictest10328-21apt-get20:35:123
320309940,1cyclictest27332-21ssh23:15:203
320309940,1cyclictest24215-21ntp_states19:55:173
320309940,0cyclictest81rcu_preempt00:35:143
320309940,0cyclictest40-21ksoftirqd/321:10:223
320269944,0cyclictest0-21swapper/222:52:122
320269944,0cyclictest0-21swapper/221:11:322
320269943,1cyclictest3920-21ssh21:45:142
320269943,1cyclictest16599-21tr00:30:112
320269943,1cyclictest16194-21grep23:10:122
320269941,2cyclictest0-21swapper/219:40:112
320269941,1cyclictest0-21swapper/200:10:152
320269941,0cyclictest0-21swapper/200:25:102
320269940,4cyclictest24904-21ssh23:45:572
320269940,4cyclictest0-21swapper/223:55:122
320269940,4cyclictest0-21swapper/223:05:112
320269940,4cyclictest0-21swapper/222:49:492
320269940,4cyclictest0-21swapper/222:30:132
320269940,4cyclictest0-21swapper/222:21:302
320269940,4cyclictest0-21swapper/221:50:132
320269940,4cyclictest0-21swapper/221:30:112
320269940,4cyclictest0-21swapper/220:40:222
320269940,4cyclictest0-21swapper/200:35:112
320269940,4cyclictest0-21swapper/200:07:432
320269940,3cyclictest8942-21hddtemp_smartct19:25:132
320269940,3cyclictest5435-21apt-get19:20:112
320269940,3cyclictest30893-21df20:10:132
320269940,3cyclictest28432-21diskstats20:05:132
320269940,3cyclictest27422-21latency_hist21:10:022
320269940,3cyclictest21890-21sh23:29:132
320269940,3cyclictest19204-21irqstats00:15:162
320269940,3cyclictest18259-21awk22:40:002
320269940,3cyclictest1647-21users23:50:212
320269940,3cyclictest1497-21apt-get23:35:122
320269940,3cyclictest12716-21irqstats23:40:142
320269940,3cyclictest0-21swapper/220:00:092
320269940,1cyclictest4831-21ntp_states23:20:172
320269940,1cyclictest22715-21/usr/sbin/munin21:00:172
320269940,1cyclictest20225-21/usr/sbin/munin20:55:132
320269940,1cyclictest18004-21/usr/sbin/munin19:45:122
320269940,1cyclictest17491-21sed21:20:162
320269940,1cyclictest15317-21tr20:45:102
320269940,0cyclictest0-21swapper/222:09:172
320269940,0cyclictest0-21swapper/200:23:532
320249944,0cyclictest0-21swapper/122:44:271
320249944,0cyclictest0-21swapper/122:16:311
320249941,2cyclictest0-21swapper/122:30:121
320249941,2cyclictest0-21swapper/122:25:111
320249941,2cyclictest0-21swapper/121:40:111
320249941,2cyclictest0-21swapper/120:45:111
320249941,2cyclictest0-21swapper/120:05:121
320249940,4cyclictest0-21swapper/121:46:321
320249940,4cyclictest0-21swapper/120:59:571
320249940,4cyclictest0-21swapper/100:21:551
320249940,2cyclictest0-21swapper/100:25:121
320249940,2cyclictest0-21swapper/100:15:101
320249940,0cyclictest0-21swapper/100:08:411
320209944,0cyclictest0-21swapper/023:55:410
320209942,1cyclictest19961-21ssh00:00:060
320209941,2cyclictest0-21swapper/021:20:120
320209941,2cyclictest0-21swapper/020:40:120
320209941,2cyclictest0-21swapper/019:35:130
320209941,1cyclictest0-21swapper/020:50:120
320209940,4cyclictest570-21ssh22:46:310
320209940,4cyclictest27648-21sed00:35:170
320209940,4cyclictest23715-21apt-get23:30:110
320209940,4cyclictest19522-21python19:45:200
320209940,4cyclictest0-21swapper/023:27:080
320209940,4cyclictest0-21swapper/023:18:160
320209940,4cyclictest0-21swapper/023:00:110
320209940,4cyclictest0-21swapper/022:41:290
320209940,4cyclictest0-21swapper/022:39:000
320209940,4cyclictest0-21swapper/022:25:010
320209940,4cyclictest0-21swapper/022:11:470
320209940,4cyclictest0-21swapper/022:05:110
320209940,4cyclictest0-21swapper/021:40:110
320209940,4cyclictest0-21swapper/021:00:130
320209940,4cyclictest0-21swapper/020:55:120
320209940,4cyclictest0-21swapper/020:30:110
320209940,4cyclictest0-21swapper/019:55:110
320209940,4cyclictest0-21swapper/000:15:100
320209940,4cyclictest0-21swapper/000:10:160
320209940,3cyclictest3415-21ssh23:20:120
320209940,3cyclictest324-21cut20:15:000
320209940,3cyclictest27910-21ntp_states21:25:180
320209940,3cyclictest23767-21ssh00:33:420
320209940,3cyclictest23571-21ssh21:55:150
320209940,3cyclictest22112-21ssh23:13:120
320209940,3cyclictest2117-21date19:15:000
320209940,3cyclictest17509-21ssh23:42:400
320209940,0cyclictest0-21swapper/021:52:360
320309930,3cyclictest20532-21wget19:50:133
320309930,3cyclictest0-21swapper/320:30:113
320309930,3cyclictest0-21swapper/320:20:123
320309930,3cyclictest0-21swapper/320:05:133
320269932,1cyclictest5734-21ssh21:15:082
320269932,1cyclictest10930-21tr19:30:132
320269931,1cyclictest0-21swapper/220:50:122
320269931,1cyclictest0-21swapper/219:55:112
320269930,3cyclictest7857-21apt20:30:102
320269930,3cyclictest776-21cut20:15:132
320269930,3cyclictest2911-21memory19:15:022
320269930,3cyclictest23452-21sh23:30:012
320269930,3cyclictest0-21swapper/222:25:122
320269930,3cyclictest0-21swapper/222:15:122
320269930,3cyclictest0-21swapper/222:10:062
320269930,3cyclictest0-21swapper/220:35:072
320269930,3cyclictest0-21swapper/220:20:142
320269930,3cyclictest0-21swapper/219:50:142
320269930,3cyclictest0-21swapper/219:35:122
320269930,3cyclictest0-21swapper/219:10:112
320269930,3cyclictest0-21swapper/200:00:012
320269930,1cyclictest5388-21/usr/sbin/munin20:25:132
320269930,1cyclictest0-21swapper/221:55:022
320269930,1cyclictest0-21swapper/221:25:032
320269930,0cyclictest17282-21cut22:55:122
320249933,0cyclictest0-21swapper/122:35:081
320249933,0cyclictest0-21swapper/121:24:251
320249933,0cyclictest0-21swapper/120:00:001
320249931,2cyclictest0-21swapper/120:15:111
320249931,1cyclictest0-21swapper/123:50:111
320249931,1cyclictest0-21swapper/123:35:131
320249931,1cyclictest0-21swapper/123:25:111
320249931,1cyclictest0-21swapper/123:20:121
320249931,1cyclictest0-21swapper/123:15:111
320249931,1cyclictest0-21swapper/123:00:111
320249931,1cyclictest0-21swapper/122:50:131
320249931,1cyclictest0-21swapper/122:20:121
320249931,1cyclictest0-21swapper/122:05:111
320249931,1cyclictest0-21swapper/121:55:141
320249931,1cyclictest0-21swapper/121:50:191
320249931,1cyclictest0-21swapper/121:30:111
320249931,1cyclictest0-21swapper/120:50:131
320249931,1cyclictest0-21swapper/120:35:111
320249931,1cyclictest0-21swapper/120:25:121
320249931,1cyclictest0-21swapper/119:45:121
320249931,1cyclictest0-21swapper/119:35:121
320249931,1cyclictest0-21swapper/119:30:131
320249931,1cyclictest0-21swapper/119:25:111
320249931,1cyclictest0-21swapper/119:10:111
320249931,1cyclictest0-21swapper/100:35:111
320249931,1cyclictest0-21swapper/100:30:111
320249931,1cyclictest0-21swapper/100:00:111
320249930,2cyclictest37332sleep122:48:261
320249930,2cyclictest0-21swapper/121:35:101
320249930,2cyclictest0-21swapper/121:05:131
320249930,2cyclictest0-21swapper/119:20:101
320249930,2cyclictest0-21swapper/100:10:151
320249930,1cyclictest0-21swapper/123:40:101
320209932,1cyclictest2800-21ssh21:45:040
320209932,1cyclictest27773-21ssh21:10:050
320209931,1cyclictest0-21swapper/020:35:110
320209931,1cyclictest0-21swapper/020:00:100
320209930,3cyclictest61-21kswapd023:45:110
320209930,3cyclictest28045-21ssh00:20:030
320209930,3cyclictest14832-21apt-get21:35:100
320209930,3cyclictest0-21swapper/023:05:110
320209930,3cyclictest0-21swapper/022:55:070
320209930,3cyclictest0-21swapper/022:50:130
320209930,3cyclictest0-21swapper/022:15:120
320209930,3cyclictest0-21swapper/021:05:130
320209930,3cyclictest0-21swapper/020:45:100
320209930,3cyclictest0-21swapper/020:25:150
320209930,3cyclictest0-21swapper/020:20:120
320209930,3cyclictest0-21swapper/020:15:100
320209930,3cyclictest0-21swapper/020:05:130
320209930,3cyclictest0-21swapper/019:50:100
320209930,3cyclictest0-21swapper/019:40:120
320209930,3cyclictest0-21swapper/019:30:120
320209930,3cyclictest0-21swapper/019:25:100
320209930,3cyclictest0-21swapper/019:20:110
320209930,3cyclictest0-21swapper/000:05:050
27059230,2sleep20-21swapper/223:00:062
320249921,1cyclictest0-21swapper/123:05:121
320249921,1cyclictest0-21swapper/121:10:131
320249921,1cyclictest0-21swapper/121:00:121
320249921,1cyclictest0-21swapper/119:40:111
320249921,1cyclictest0-21swapper/119:15:101
320249920,1cyclictest0-21swapper/123:10:011
320249920,1cyclictest0-21swapper/122:55:001
320249920,1cyclictest0-21swapper/120:40:121
320249920,1cyclictest0-21swapper/120:30:101
320249920,1cyclictest0-21swapper/120:10:101
320249920,1cyclictest0-21swapper/119:55:011
320249920,1cyclictest0-21swapper/119:50:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional