You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 12:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Thu Dec 18, 2025 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
274852240225,11sleep10-21swapper/119:05:261
274822202167,30sleep30-21swapper/319:05:243
274992186169,12sleep00-21swapper/019:05:370
275882156138,13sleep20-21swapper/219:06:482
280199992,3cyclictest26147-21perf20:10:010
280199992,3cyclictest1044-21munin-run22:35:000
280199971,3cyclictest11102-21munin-run23:59:590
280199970,6cyclictest0-21swapper/000:15:110
280269960,5cyclictest0-21swapper/322:55:113
280209961,3cyclictest0-21swapper/123:45:111
280209961,3cyclictest0-21swapper/122:20:111
280199960,3cyclictest16028-21apt-get19:50:010
280269950,4cyclictest16448-21apt-get19:50:023
280209952,2cyclictest0-21swapper/122:25:111
280209952,2cyclictest0-21swapper/120:25:111
280209951,3cyclictest0-21swapper/123:10:101
280209951,3cyclictest0-21swapper/120:35:121
280209951,2cyclictest0-21swapper/122:55:111
280209951,2cyclictest0-21swapper/122:10:111
280209951,2cyclictest0-21swapper/121:15:111
280209951,2cyclictest0-21swapper/121:00:131
280209951,2cyclictest0-21swapper/119:50:121
280209950,5cyclictest0-21swapper/123:04:041
280209950,4cyclictest0-21swapper/120:10:091
280269944,0cyclictest28826-21cut19:10:093
280269943,1cyclictest11043-21idleruntime-cro20:45:003
280269941,1cyclictest0-21swapper/322:15:113
280269940,4cyclictest0-21swapper/322:05:123
280269940,4cyclictest0-21swapper/321:55:103
280269940,4cyclictest0-21swapper/321:00:133
280269940,4cyclictest0-21swapper/320:55:123
280269940,4cyclictest0-21swapper/320:15:183
280269940,4cyclictest0-21swapper/319:35:013
280269940,3cyclictest3766-21latency_hist21:35:003
280269940,3cyclictest31294-21wc23:35:013
280269940,3cyclictest17084-21perl22:00:153
280269940,3cyclictest13704-21sed00:05:003
280269940,3cyclictest11093-21latency_hist23:59:593
280269940,3cyclictest0-21swapper/323:10:023
280269940,3cyclictest0-21swapper/300:10:113
280269940,1cyclictest6245-21munin-run21:40:013
280269940,1cyclictest28688-21munin-run23:30:013
280269940,1cyclictest1192-21latency_hist23:40:003
280229943,1cyclictest19171-21cpuspeed19:55:112
280229942,1cyclictest26885-21diskstats20:10:102
280229941,2cyclictest774-21snmpd23:15:132
280229941,2cyclictest0-21swapper/221:20:122
280229941,1cyclictest1-21systemd20:00:122
280229941,1cyclictest0-21swapper/221:10:112
280229940,4cyclictest17300-21hddtemp_smartct19:50:142
280229940,4cyclictest0-21swapper/223:55:112
280229940,4cyclictest0-21swapper/223:21:322
280229940,4cyclictest0-21swapper/222:50:152
280229940,3cyclictest4415-21df19:25:122
280229940,3cyclictest3067-21timerandwakeup23:40:182
280229940,3cyclictest26555-21cstates00:30:132
280229940,3cyclictest16799-21df00:10:132
280229940,3cyclictest1484-21sed21:30:012
280229940,3cyclictest0-21swapper/221:30:122
280229940,1cyclictest32653-21ntp_states23:35:192
280209944,0cyclictest0-21swapper/122:44:161
280209942,1cyclictest0-21swapper/122:45:111
280209941,2cyclictest0-21swapper/123:55:111
280209941,2cyclictest0-21swapper/123:50:091
280209941,2cyclictest0-21swapper/123:30:111
280209941,2cyclictest0-21swapper/123:25:101
280209941,2cyclictest0-21swapper/123:20:141
280209941,2cyclictest0-21swapper/123:15:121
280209941,2cyclictest0-21swapper/123:05:111
280209941,2cyclictest0-21swapper/122:35:121
280209941,2cyclictest0-21swapper/121:55:101
280209941,2cyclictest0-21swapper/121:40:101
280209941,2cyclictest0-21swapper/121:30:121
280209941,2cyclictest0-21swapper/121:10:121
280209941,2cyclictest0-21swapper/120:45:101
280209941,2cyclictest0-21swapper/120:20:121
280209941,2cyclictest0-21swapper/120:15:111
280209941,2cyclictest0-21swapper/120:05:131
280209941,2cyclictest0-21swapper/120:00:121
280209941,2cyclictest0-21swapper/119:35:121
280209941,2cyclictest0-21swapper/100:10:101
280209941,1cyclictest0-21swapper/120:30:111
280209941,1cyclictest0-21swapper/119:45:111
280209940,4cyclictest0-21swapper/122:07:451
280209940,3cyclictest0-21swapper/120:40:111
280209940,2cyclictest0-21swapper/121:25:121
280209940,2cyclictest0-21swapper/121:20:111
280209940,2cyclictest0-21swapper/119:55:091
280209940,2cyclictest0-21swapper/119:40:121
280199943,1cyclictest3767-21apt-get22:40:120
280199943,1cyclictest30210-21grep21:20:170
280199943,1cyclictest28721-21tr00:35:120
280199943,1cyclictest1272-21/usr/sbin/munin22:35:150
280199940,4cyclictest6909-21diskstats23:50:120
280199940,4cyclictest12465-21irqstats20:45:130
280199940,4cyclictest0-21swapper/023:30:120
280199940,4cyclictest0-21swapper/023:10:010
280199940,4cyclictest0-21swapper/022:45:120
280199940,4cyclictest0-21swapper/022:28:310
280199940,4cyclictest0-21swapper/022:05:110
280199940,4cyclictest0-21swapper/021:30:170
280199940,4cyclictest0-21swapper/019:35:110
280199940,3cyclictest7759-21ntp_states21:40:170
280199940,3cyclictest6153-21apt23:50:010
280199940,3cyclictest5086-21memory21:35:170
280199940,3cyclictest27043-21diskstats21:15:130
280199940,3cyclictest25952-21latency_hist00:30:000
280199940,3cyclictest2262-21hddtemp_smartct19:20:150
280199940,3cyclictest14395-21diskstats23:00:140
280199940,3cyclictest10225-21ntp_states21:45:170
280199940,1cyclictest8905-21/usr/sbin/munin22:50:160
280199940,1cyclictest27117-21hddtemp_smartct22:20:150
280199940,1cyclictest23963-21/usr/sbin/munin23:20:150
280199940,1cyclictest16331-21/usr/sbin/munin23:05:130
280269932,1cyclictest3820-21wget22:40:123
280269932,1cyclictest27394-21cat22:20:173
280269932,1cyclictest21483-21basename23:15:123
280269931,2cyclictest0-21swapper/322:25:123
280269931,1cyclictest18748-21/usr/sbin/munin00:15:113
280269931,1cyclictest0-21swapper/322:35:123
280269931,1cyclictest0-21swapper/321:45:113
280269931,1cyclictest0-21swapper/321:10:123
280269931,1cyclictest0-21swapper/320:10:093
280269931,1cyclictest0-21swapper/320:00:113
280269930,3cyclictest8060-21sed23:50:193
280269930,3cyclictest30999-21expr19:15:003
280269930,3cyclictest1943-21expr23:40:123
280269930,3cyclictest13811-21/usr/sbin/munin00:05:133
280269930,3cyclictest0-21swapper/323:45:023
280269930,3cyclictest0-21swapper/323:24:183
280269930,3cyclictest0-21swapper/323:05:123
280269930,3cyclictest0-21swapper/322:50:023
280269930,3cyclictest0-21swapper/322:45:123
280269930,3cyclictest0-21swapper/322:30:103
280269930,3cyclictest0-21swapper/322:10:113
280269930,3cyclictest0-21swapper/321:40:113
280269930,3cyclictest0-21swapper/321:25:113
280269930,3cyclictest0-21swapper/321:20:123
280269930,3cyclictest0-21swapper/321:15:123
280269930,3cyclictest0-21swapper/321:05:123
280269930,3cyclictest0-21swapper/320:50:113
280269930,3cyclictest0-21swapper/320:45:003
280269930,3cyclictest0-21swapper/320:35:133
280269930,3cyclictest0-21swapper/320:30:113
280269930,3cyclictest0-21swapper/320:25:103
280269930,3cyclictest0-21swapper/320:20:123
280269930,3cyclictest0-21swapper/320:05:123
280269930,3cyclictest0-21swapper/319:55:103
280269930,3cyclictest0-21swapper/319:45:113
280269930,3cyclictest0-21swapper/319:35:053
280269930,3cyclictest0-21swapper/319:25:113
280269930,3cyclictest0-21swapper/319:20:123
280269930,3cyclictest0-21swapper/300:35:123
280269930,3cyclictest0-21swapper/300:30:113
280269930,3cyclictest0-21swapper/300:25:123
280269930,3cyclictest0-21swapper/300:20:113
280269930,2cyclictest13871-21latency_hist21:55:003
280269930,1cyclictest0-21swapper/323:00:123
280229932,1cyclictest774-21snmpd22:10:102
280229932,1cyclictest6833-21expr19:30:132
280229932,1cyclictest15000-21cat20:50:152
280229930,3cyclictest774-21snmpd00:05:012
280229930,3cyclictest7325-21memory22:45:172
280229930,3cyclictest4410-21tune2fs20:30:122
280229930,3cyclictest29652-21irqstats00:35:162
280229930,3cyclictest29355-21df20:15:142
280229930,3cyclictest28910-21apt-get23:30:122
280229930,3cyclictest28789-21tune2fs19:10:102
280229930,3cyclictest27211-21perl21:15:142
280229930,3cyclictest24242-21diskstats00:25:132
280229930,3cyclictest24053-21grep20:05:132
280229930,3cyclictest21903-21diskstats21:05:152
280229930,3cyclictest1647-21tr19:20:122
280229930,3cyclictest16397-21sshd20:55:012
280229930,3cyclictest14324-21df_inode19:45:122
280229930,3cyclictest1374-21apt-get20:25:112
280229930,3cyclictest0-21swapper/223:50:102
280229930,3cyclictest0-21swapper/223:45:092
280229930,3cyclictest0-21swapper/223:25:072
280229930,3cyclictest0-21swapper/223:10:102
280229930,3cyclictest0-21swapper/223:05:052
280229930,3cyclictest0-21swapper/223:00:112
280229930,3cyclictest0-21swapper/222:40:122
280229930,3cyclictest0-21swapper/222:35:112
280229930,3cyclictest0-21swapper/222:30:012
280229930,3cyclictest0-21swapper/222:25:122
280229930,3cyclictest0-21swapper/222:20:122
280229930,3cyclictest0-21swapper/222:15:042
280229930,3cyclictest0-21swapper/222:05:052
280229930,3cyclictest0-21swapper/222:00:122
280229930,3cyclictest0-21swapper/221:55:042
280229930,3cyclictest0-21swapper/221:50:102
280229930,3cyclictest0-21swapper/221:45:122
280229930,3cyclictest0-21swapper/221:40:112
280229930,3cyclictest0-21swapper/221:35:112
280229930,3cyclictest0-21swapper/221:00:312
280229930,3cyclictest0-21swapper/220:45:002
280229930,3cyclictest0-21swapper/220:40:042
280229930,3cyclictest0-21swapper/220:20:032
280229930,3cyclictest0-21swapper/219:40:032
280229930,3cyclictest0-21swapper/219:35:122
280229930,3cyclictest0-21swapper/219:15:012
280229930,3cyclictest0-21swapper/200:20:012
280229930,3cyclictest0-21swapper/200:15:002
280229930,2cyclictest11413-21aten2_r5power_p00:00:112
280229930,1cyclictest0-21swapper/222:55:102
280229930,0cyclictest6317-21apt-get20:35:132
280209933,0cyclictest0-21swapper/123:36:301
280209933,0cyclictest0-21swapper/122:01:381
280209933,0cyclictest0-21swapper/100:32:131
280209931,1cyclictest0-21swapper/122:50:121
280209931,1cyclictest0-21swapper/122:30:111
280209931,1cyclictest0-21swapper/122:15:111
280209931,1cyclictest0-21swapper/121:50:111
280209931,1cyclictest0-21swapper/121:35:121
280209931,1cyclictest0-21swapper/120:50:111
280209931,1cyclictest0-21swapper/119:30:111
280209931,1cyclictest0-21swapper/119:25:121
280209931,1cyclictest0-21swapper/119:20:121
280209931,1cyclictest0-21swapper/119:15:121
280209931,1cyclictest0-21swapper/100:25:121
280209930,2cyclictest0-21swapper/121:45:121
280209930,2cyclictest0-21swapper/121:05:131
280209930,2cyclictest0-21swapper/120:55:111
280209930,2cyclictest0-21swapper/100:20:111
280209930,2cyclictest0-21swapper/100:15:121
280199933,0cyclictest18931-21apt-get19:55:100
280199932,1cyclictest11325-21/usr/sbin/munin19:40:160
280199930,3cyclictest8805-21apt-get20:40:100
280199930,3cyclictest31489-21dpkg21:25:110
280199930,3cyclictest24525-21cut22:15:140
280199930,3cyclictest21905-21expr23:15:130
280199930,3cyclictest21501-21basename20:00:120
280199930,3cyclictest1963-21df23:40:120
280199930,3cyclictest12258-21hddtemp_smartct21:50:130
280199930,3cyclictest11377-21apt-get22:55:110
280199930,3cyclictest0-21swapper/023:35:120
280199930,3cyclictest0-21swapper/023:25:110
280199930,3cyclictest0-21swapper/022:10:100
280199930,3cyclictest0-21swapper/022:00:120
280199930,3cyclictest0-21swapper/021:55:010
280199930,3cyclictest0-21swapper/021:10:020
280199930,3cyclictest0-21swapper/021:05:130
280199930,3cyclictest0-21swapper/021:00:120
280199930,3cyclictest0-21swapper/020:50:110
280199930,3cyclictest0-21swapper/020:35:130
280199930,3cyclictest0-21swapper/020:30:110
280199930,3cyclictest0-21swapper/020:25:030
280199930,3cyclictest0-21swapper/020:20:110
280199930,3cyclictest0-21swapper/019:50:010
280199930,3cyclictest0-21swapper/019:30:120
280199930,3cyclictest0-21swapper/019:25:050
280199930,3cyclictest0-21swapper/019:15:100
280199930,3cyclictest0-21swapper/019:10:070
280199930,3cyclictest0-21swapper/000:30:110
280199930,3cyclictest0-21swapper/000:20:010
280199930,3cyclictest0-21swapper/000:10:110
280199930,3cyclictest0-21swapper/000:00:080
280199930,2cyclictest16458-21aten2_r5power_e20:55:120
280199930,1cyclictest28836-21/usr/sbin/munin20:15:150
280199930,1cyclictest27591-21sshd20:10:140
280199930,0cyclictest0-21swapper/000:05:140
280269920,1cyclictest11057-21cron19:40:003
280209921,0cyclictest0-21swapper/123:40:101
280209920,1cyclictest0-21swapper/119:10:081
280209920,1cyclictest0-21swapper/100:35:121
280209920,1cyclictest0-21swapper/100:05:121
280209920,1cyclictest0-21swapper/100:00:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional