You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 04:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Sat Dec 20, 2025 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
207952239224,11sleep10-21swapper/119:05:421
208532195162,29sleep30-21swapper/319:06:253
208132181165,12sleep00-21swapper/019:05:530
209242179162,13sleep20-21swapper/219:07:202
51182510,0sleep30-21swapper/300:00:133
2130699112,3cyclictest40-21ksoftirqd/319:45:123
186982110,1sleep00-21swapper/022:15:170
255232100,1sleep02129299cyclictest20:20:150
213069986,0cyclictest40-21ksoftirqd/320:55:023
213069982,1cyclictest40-21ksoftirqd/321:30:013
213069970,6cyclictest0-21swapper/300:10:123
212929970,4cyclictest9750-21munin-run00:10:010
212929970,4cyclictest7066-21munin-run19:45:000
213069964,2cyclictest0-21swapper/320:30:153
213069960,4cyclictest0-21swapper/300:35:123
213069955,0cyclictest40-21ksoftirqd/323:35:013
213069955,0cyclictest40-21ksoftirqd/323:20:003
213069955,0cyclictest40-21ksoftirqd/322:25:013
213069955,0cyclictest40-21ksoftirqd/321:30:013
213069955,0cyclictest40-21ksoftirqd/320:50:003
213069955,0cyclictest40-21ksoftirqd/320:25:103
213069955,0cyclictest40-21ksoftirqd/319:20:093
213069955,0cyclictest40-21ksoftirqd/300:30:143
213069953,1cyclictest0-21swapper/321:05:123
213069953,0cyclictest40-21ksoftirqd/323:55:093
213069952,2cyclictest0-21swapper/323:20:123
213069952,1cyclictest81rcu_preempt20:55:013
213069951,0cyclictest81rcu_preempt19:15:013
213069950,5cyclictest3434-21kworker/3:121:10:203
213069950,4cyclictest0-21swapper/322:55:133
213069950,4cyclictest0-21swapper/322:00:113
213069950,4cyclictest0-21swapper/319:30:123
213069950,1cyclictest40-21ksoftirqd/321:35:183
213019950,1cyclictest29979-21tr19:25:132
212979951,2cyclictest0-21swapper/122:35:131
212979951,2cyclictest0-21swapper/121:35:131
212979950,5cyclictest0-21swapper/120:00:211
212979950,2cyclictest0-21swapper/120:05:131
212979950,1cyclictest0-21swapper/120:30:131
212929951,2cyclictest0-21swapper/021:35:130
212929951,2cyclictest0-21swapper/021:00:130
212929951,2cyclictest0-21swapper/020:10:120
212929951,2cyclictest0-21swapper/020:05:120
212929951,2cyclictest0-21swapper/019:10:100
212929951,2cyclictest0-21swapper/000:00:120
212929950,4cyclictest0-21swapper/020:30:130
212929950,1cyclictest24923-21/usr/sbin/munin22:30:140
213069944,0cyclictest40-21ksoftirqd/323:35:113
213069944,0cyclictest40-21ksoftirqd/323:25:193
213069944,0cyclictest40-21ksoftirqd/321:55:003
213069944,0cyclictest40-21ksoftirqd/319:50:113
213069944,0cyclictest40-21ksoftirqd/319:15:013
213069943,1cyclictest40-21ksoftirqd/323:00:143
213069943,1cyclictest23205-21grep22:25:153
213069942,1cyclictest774-21snmpd21:59:113
213069941,2cyclictest0-21swapper/323:45:133
213069941,2cyclictest0-21swapper/320:35:123
213069941,0cyclictest81rcu_preempt21:20:183
213069940,4cyclictest0-21swapper/323:05:113
213069940,4cyclictest0-21swapper/322:15:123
213069940,4cyclictest0-21swapper/320:20:133
213069940,4cyclictest0-21swapper/300:25:123
213069940,4cyclictest0-21swapper/300:20:133
213069940,3cyclictest81rcu_preempt22:40:133
213069940,3cyclictest7057-21latency_hist19:45:013
213069940,3cyclictest3559-21ntp_states20:40:153
213069940,3cyclictest3114-21perl22:50:133
213069940,3cyclictest15264-21fschecks_count20:00:143
213069940,3cyclictest12424-21chrt00:15:023
213069940,3cyclictest0-21swapper/323:10:123
213069940,3cyclictest0-21swapper/321:45:133
213069940,1cyclictest81rcu_preempt19:25:123
213069940,1cyclictest40-21ksoftirqd/321:16:173
213069940,1cyclictest40-21ksoftirqd/321:01:173
213069940,1cyclictest27361-21apt-get23:40:133
213069940,1cyclictest2109-21idleruntime-cro23:55:013
213069940,1cyclictest0-21swapper/321:40:113
213069940,0cyclictest81rcu_preempt22:05:183
213069940,0cyclictest81rcu_preempt19:35:143
213069940,0cyclictest7505-21apt-get00:05:123
213019944,0cyclictest31-21ksoftirqd/200:00:012
213019943,1cyclictest31-21ksoftirqd/219:10:102
213019940,4cyclictest7362-21apt21:55:012
213019940,4cyclictest0-21swapper/223:40:192
213019940,4cyclictest0-21swapper/223:30:122
213019940,4cyclictest0-21swapper/223:15:142
213019940,4cyclictest0-21swapper/222:55:012
213019940,4cyclictest0-21swapper/222:50:112
213019940,4cyclictest0-21swapper/222:20:122
213019940,4cyclictest0-21swapper/222:15:112
213019940,4cyclictest0-21swapper/222:10:132
213019940,4cyclictest0-21swapper/222:05:112
213019940,4cyclictest0-21swapper/221:25:062
213019940,4cyclictest0-21swapper/220:15:132
213019940,4cyclictest0-21swapper/219:30:112
213019940,3cyclictest3811-21python20:40:172
213019940,3cyclictest22884-21cstates21:20:122
213019940,3cyclictest19243-21users00:25:212
213019940,3cyclictest0-21swapper/219:15:012
213019940,3cyclictest0-21swapper/200:25:012
213019940,3cyclictest0-21swapper/200:05:122
213019940,1cyclictest4739-21sed19:40:012
212979944,0cyclictest0-21swapper/123:22:191
212979944,0cyclictest0-21swapper/122:55:241
212979941,2cyclictest0-21swapper/122:00:111
212979941,2cyclictest0-21swapper/121:45:131
212979941,2cyclictest0-21swapper/119:30:121
212979941,2cyclictest0-21swapper/119:15:131
212979941,2cyclictest0-21swapper/100:00:121
212979941,1cyclictest0-21swapper/123:25:121
212979941,1cyclictest0-21swapper/123:10:121
212979941,1cyclictest0-21swapper/121:20:101
212979941,1cyclictest0-21swapper/100:15:121
212979940,4cyclictest0-21swapper/123:41:491
212979940,4cyclictest0-21swapper/120:20:121
212979940,2cyclictest0-21swapper/119:10:101
212929943,1cyclictest4865-21/usr/sbin/munin22:55:160
212929943,1cyclictest2535-21cut19:35:150
212929943,1cyclictest16713-21sed00:20:220
212929942,1cyclictest0-21swapper/021:55:120
212929941,2cyclictest0-21swapper/023:50:110
212929941,2cyclictest0-21swapper/023:30:120
212929941,2cyclictest0-21swapper/023:25:130
212929941,2cyclictest0-21swapper/022:40:130
212929941,2cyclictest0-21swapper/022:35:130
212929941,2cyclictest0-21swapper/022:00:110
212929941,2cyclictest0-21swapper/021:50:130
212929941,2cyclictest0-21swapper/019:15:120
212929941,1cyclictest0-21swapper/022:05:110
212929941,1cyclictest0-21swapper/019:30:120
212929940,4cyclictest0-21swapper/023:35:110
212929940,4cyclictest0-21swapper/020:55:130
212929940,4cyclictest0-21swapper/020:15:130
212929940,4cyclictest0-21swapper/020:00:120
212929940,4cyclictest0-21swapper/000:35:120
212929940,4cyclictest0-21swapper/000:30:140
212929940,3cyclictest5739-21modprobe20:45:140
212929940,3cyclictest15280-21df23:15:160
212929940,3cyclictest0-21swapper/020:35:120
212929940,2cyclictest0-21swapper/023:10:110
212929940,2cyclictest0-21swapper/021:25:130
212929940,2cyclictest0-21swapper/021:20:110
212929940,1cyclictest32348-21/usr/sbin/munin22:45:200
212929940,1cyclictest27288-21/usr/sbin/munin20:25:180
212929940,1cyclictest2648-21/usr/sbin/munin21:45:180
212929940,1cyclictest22451-21/usr/sbin/munin22:25:140
213069933,0cyclictest40-21ksoftirqd/322:10:133
213069931,1cyclictest40-21ksoftirqd/320:10:123
213069931,0cyclictest22331-21apt-get20:15:133
213069930,3cyclictest16955-21apt-get20:05:003
213069930,3cyclictest0-21swapper/322:45:123
213069930,3cyclictest0-21swapper/322:35:133
213069930,3cyclictest0-21swapper/322:30:123
213069930,3cyclictest0-21swapper/319:55:133
213019932,1cyclictest774-21snmpd21:05:142
213019932,1cyclictest774-21snmpd19:50:122
213019932,1cyclictest7640-21cpuspeed_turbos19:45:142
213019932,1cyclictest25607-21tune2fs22:30:152
213019932,1cyclictest10773-21tune2fs22:00:132
213019931,1cyclictest0-21swapper/221:40:112
213019931,1cyclictest0-21swapper/220:50:102
213019931,1cyclictest0-21swapper/220:35:112
213019931,1cyclictest0-21swapper/219:55:132
213019930,3cyclictest2949-21tr21:45:142
213019930,3cyclictest25657-21hddtemp_smartct20:20:162
213019930,3cyclictest17253-21apt-get23:20:112
213019930,3cyclictest0-21swapper/223:50:112
213019930,3cyclictest0-21swapper/223:45:132
213019930,3cyclictest0-21swapper/223:35:122
213019930,3cyclictest0-21swapper/223:25:132
213019930,3cyclictest0-21swapper/223:10:012
213019930,3cyclictest0-21swapper/223:05:052
213019930,3cyclictest0-21swapper/223:00:052
213019930,3cyclictest0-21swapper/222:45:122
213019930,3cyclictest0-21swapper/222:40:012
213019930,3cyclictest0-21swapper/222:35:052
213019930,3cyclictest0-21swapper/222:25:132
213019930,3cyclictest0-21swapper/221:55:102
213019930,3cyclictest0-21swapper/221:35:052
213019930,3cyclictest0-21swapper/221:30:062
213019930,3cyclictest0-21swapper/221:15:132
213019930,3cyclictest0-21swapper/221:00:132
213019930,3cyclictest0-21swapper/220:55:012
213019930,3cyclictest0-21swapper/220:30:122
213019930,3cyclictest0-21swapper/220:25:112
213019930,3cyclictest0-21swapper/220:10:112
213019930,3cyclictest0-21swapper/220:05:012
213019930,3cyclictest0-21swapper/220:00:122
213019930,3cyclictest0-21swapper/219:40:102
213019930,3cyclictest0-21swapper/219:20:102
213019930,3cyclictest0-21swapper/200:30:142
213019930,3cyclictest0-21swapper/200:15:052
213019930,3cyclictest0-21swapper/200:10:122
213019930,3cyclictest0-21swapper/200:00:122
213019930,2cyclictest4762-21/usr/sbin/munin20:45:142
213019930,2cyclictest17451-21gpgv21:10:012
213019930,0cyclictest22341-21apt-get00:35:122
212979931,1cyclictest0-21swapper/123:35:021
212979931,1cyclictest0-21swapper/123:15:141
212979931,1cyclictest0-21swapper/122:05:111
212979931,1cyclictest0-21swapper/121:55:121
212979931,1cyclictest0-21swapper/121:05:131
212979931,1cyclictest0-21swapper/121:00:121
212979931,1cyclictest0-21swapper/120:50:101
212979931,1cyclictest0-21swapper/120:15:131
212979931,1cyclictest0-21swapper/119:50:111
212979931,1cyclictest0-21swapper/100:10:111
212979930,3cyclictest0-21swapper/122:40:421
212979930,3cyclictest0-21swapper/100:20:401
212979930,2cyclictest4156-21taskset20:40:211
212979930,2cyclictest27032-21chrt21:27:551
212979930,2cyclictest119642sleep123:08:571
212979930,2cyclictest0-21swapper/121:50:131
212979930,2cyclictest0-21swapper/120:10:121
212979930,2cyclictest0-21swapper/119:45:131
212979930,2cyclictest0-21swapper/100:30:131
212979930,1cyclictest0-21swapper/123:50:111
212979930,1cyclictest0-21swapper/123:30:121
212979930,1cyclictest0-21swapper/121:30:131
212979930,1cyclictest0-21swapper/120:45:111
212979930,1cyclictest0-21swapper/100:35:121
212929933,0cyclictest0-21swapper/023:05:120
212929932,1cyclictest30142-21diskstats19:25:140
212929931,1cyclictest17776-21cat00:25:130
212929931,1cyclictest0-21swapper/000:10:120
212929930,3cyclictest30821-21irqstats23:45:170
212929930,3cyclictest2394-21apt-get22:50:090
212929930,3cyclictest2340-21apt-get23:55:090
212929930,3cyclictest21050-21sed21:15:180
212929930,3cyclictest12993-21grep19:55:150
212929930,3cyclictest0-21swapper/023:40:130
212929930,3cyclictest0-21swapper/023:00:130
212929930,3cyclictest0-21swapper/022:20:100
212929930,3cyclictest0-21swapper/022:10:120
212929930,3cyclictest0-21swapper/021:40:110
212929930,3cyclictest0-21swapper/021:30:020
212929930,3cyclictest0-21swapper/021:10:010
212929930,3cyclictest0-21swapper/021:05:120
212929930,3cyclictest0-21swapper/020:50:100
212929930,3cyclictest0-21swapper/020:40:050
212929930,3cyclictest0-21swapper/019:50:110
212929930,3cyclictest0-21swapper/019:45:120
212929930,3cyclictest0-21swapper/019:20:100
212929930,3cyclictest0-21swapper/000:15:110
212929930,1cyclictest0-21swapper/023:20:120
212979921,1cyclictest150012chrt22:10:021
212979921,1cyclictest0-21swapper/123:55:101
212979921,1cyclictest0-21swapper/121:15:131
212979921,1cyclictest0-21swapper/120:55:021
212979921,1cyclictest0-21swapper/119:35:131
212979921,0cyclictest0-21swapper/119:20:101
212979920,2cyclictest68722sleep119:42:491
212979920,1cyclictest13495-21chrt19:55:171
212979920,1cyclictest0-21swapper/123:00:131
212979920,1cyclictest0-21swapper/122:45:121
212979920,1cyclictest0-21swapper/122:30:131
212979920,1cyclictest0-21swapper/122:20:091
212979920,1cyclictest0-21swapper/121:40:101
212979920,1cyclictest0-21swapper/121:10:021
212979920,1cyclictest0-21swapper/120:35:121
212979920,1cyclictest0-21swapper/120:25:111
212979920,1cyclictest0-21swapper/100:25:121
212979920,1cyclictest0-21swapper/100:05:121
212979920,0cyclictest0-21swapper/122:54:401
212979920,0cyclictest0-21swapper/122:25:131
212979910,1cyclictest0-21swapper/123:45:011
212979910,1cyclictest0-21swapper/122:15:011
212979910,1cyclictest0-21swapper/119:25:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional