You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 20:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Mon Dec 15, 2025 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21652203187,11sleep10-21swapper/107:07:341
21642197181,12sleep00-21swapper/007:07:330
20072182164,13sleep30-21swapper/307:05:323
22582174159,11sleep20-21swapper/207:08:472
312452460,0sleep30-21swapper/308:05:123
282742440,1sleep228276-21munin-run09:05:012
120462440,0sleep20-21swapper/208:30:132
118092130,0sleep1201rcuc/109:35:151
160802110,0sleep10-21swapper/107:35:121
25329981,3cyclictest30824-21munin-run12:25:000
25329980,4cyclictest13305-21munin-run11:50:010
870270,0sleep10-21swapper/112:30:001
31950260,0sleep10-21swapper/111:20:151
25429965,1cyclictest0-21swapper/309:25:103
25379960,5cyclictest0-21swapper/211:35:102
25379960,5cyclictest0-21swapper/210:05:102
25339962,2cyclictest0-21swapper/107:10:061
25339961,4cyclictest0-21swapper/112:30:101
25339961,3cyclictest0-21swapper/108:45:111
25339961,2cyclictest0-21swapper/108:00:101
25329962,4cyclictest30694-21basename11:20:000
25329960,3cyclictest3216-21perf11:30:010
25429955,0cyclictest0-21swapper/311:55:193
25429950,5cyclictest0-21swapper/309:00:113
25379955,0cyclictest31-21ksoftirqd/211:05:092
25379951,4cyclictest31288-21cat08:05:122
25379951,1cyclictest31-21ksoftirqd/210:10:112
25339952,2cyclictest0-21swapper/112:00:101
25339951,3cyclictest0-21swapper/110:20:101
25339951,3cyclictest0-21swapper/110:10:111
25339951,3cyclictest0-21swapper/108:40:101
25339951,2cyclictest0-21swapper/111:45:111
25339951,2cyclictest0-21swapper/108:35:091
25339951,2cyclictest0-21swapper/107:50:091
25339950,5cyclictest0-21swapper/111:05:131
25429941,2cyclictest0-21swapper/312:10:013
25429941,1cyclictest0-21swapper/310:35:103
25429941,0cyclictest0-21swapper/309:05:113
25429940,4cyclictest0-21swapper/311:40:093
25429940,4cyclictest0-21swapper/310:45:103
25429940,4cyclictest0-21swapper/310:10:123
25429940,4cyclictest0-21swapper/310:05:103
25429940,4cyclictest0-21swapper/309:55:103
25429940,4cyclictest0-21swapper/308:50:093
25429940,4cyclictest0-21swapper/308:20:003
25429940,4cyclictest0-21swapper/307:18:243
25429940,3cyclictest863-21/usr/sbin/munin08:10:103
25429940,3cyclictest4030-21df09:20:123
25429940,3cyclictest25248-21grep11:05:193
25429940,3cyclictest24106-21uniq07:50:113
25429940,3cyclictest2280-21ntp_states09:15:153
25429940,3cyclictest20961-21latency_hist08:50:003
25429940,3cyclictest19191-21perl07:40:123
25429940,3cyclictest10901-21date10:40:003
25429940,3cyclictest0-21swapper/312:00:093
25429940,3cyclictest0-21swapper/309:50:093
25379944,0cyclictest31-21ksoftirqd/207:15:142
25379943,1cyclictest31-21ksoftirqd/209:40:012
25379943,1cyclictest2753-21grep10:20:182
25379942,1cyclictest0-21swapper/208:20:092
25379941,2cyclictest18223-21latency_hist07:40:002
25379941,2cyclictest0-21swapper/209:30:102
25379940,4cyclictest19348-21perl08:45:142
25379940,4cyclictest11448-21diskstats10:40:122
25379940,4cyclictest0-21swapper/212:15:162
25379940,4cyclictest0-21swapper/210:30:122
25379940,4cyclictest0-21swapper/210:15:022
25379940,4cyclictest0-21swapper/207:25:102
25379940,3cyclictest28298-21cat08:00:002
25379940,3cyclictest19223-21hddtemp_smartct09:50:122
25379940,3cyclictest15619-21latency_hist10:50:002
25379940,1cyclictest25002-21mailstats08:55:182
25379940,1cyclictest0-21swapper/212:00:002
25339944,0cyclictest0-21swapper/109:45:551
25339944,0cyclictest0-21swapper/109:07:211
25339944,0cyclictest0-21swapper/107:25:121
25339943,1cyclictest0-21swapper/108:15:061
25339942,1cyclictest0-21swapper/112:10:101
25339941,2cyclictest0-21swapper/112:20:091
25339941,2cyclictest0-21swapper/111:30:091
25339941,2cyclictest0-21swapper/110:50:011
25339941,2cyclictest0-21swapper/110:30:111
25339941,2cyclictest0-21swapper/110:15:111
25339941,2cyclictest0-21swapper/109:50:091
25339941,2cyclictest0-21swapper/109:15:111
25339941,2cyclictest0-21swapper/109:00:111
25339941,2cyclictest0-21swapper/108:20:011
25339941,2cyclictest0-21swapper/107:55:091
25339941,2cyclictest0-21swapper/107:45:091
25339941,1cyclictest0-21swapper/112:15:101
25339941,1cyclictest0-21swapper/111:25:081
25339941,1cyclictest0-21swapper/108:55:111
25339940,4cyclictest0-21swapper/111:12:031
25339940,4cyclictest0-21swapper/110:06:171
25339940,4cyclictest0-21swapper/109:23:131
25339940,4cyclictest0-21swapper/108:30:581
25339940,3cyclictest0-21swapper/111:15:111
25339940,3cyclictest0-21swapper/110:35:111
25339940,2cyclictest0-21swapper/111:00:091
25339940,2cyclictest0-21swapper/108:10:091
25339940,2cyclictest0-21swapper/107:40:101
25329944,0cyclictest0-21swapper/010:15:020
25329944,0cyclictest0-21swapper/007:40:210
25329943,1cyclictest19211-21gltestperf09:50:110
25329942,2cyclictest2473-21which10:20:160
25329941,3cyclictest9370-21awk09:30:130
25329941,3cyclictest774-21snmpd08:53:180
25329941,3cyclictest7596-21sensors_temp07:15:180
25329941,3cyclictest14882-21cut09:40:170
25329941,2cyclictest0-21swapper/008:45:110
25329941,1cyclictest0-21swapper/008:15:100
25329940,4cyclictest24885-21ntp_states12:10:160
25329940,4cyclictest13233-21awk08:35:000
25329940,4cyclictest0-21swapper/012:05:130
25329940,4cyclictest0-21swapper/011:58:550
25329940,4cyclictest0-21swapper/011:00:090
25329940,4cyclictest0-21swapper/010:50:230
25329940,3cyclictest30594-21latency_hist08:05:000
25329940,3cyclictest26477-21diskstats11:10:110
25329940,3cyclictest23538-21/usr/sbin/munin08:55:110
25329940,3cyclictest0-21swapper/010:00:170
25329940,1cyclictest863-21/usr/sbin/munin08:10:120
25329940,1cyclictest29543-21ntp_states10:10:160
25329940,1cyclictest26026-21/usr/sbin/munin09:00:130
25429932,1cyclictest31628-21tune2fs09:10:123
25429931,0cyclictest0-21swapper/308:25:103
25429930,3cyclictest9846-21ntp_states07:20:143
25429930,3cyclictest8448-21apt-get09:30:093
25429930,3cyclictest6658-21perl10:30:133
25429930,3cyclictest26098-21basename12:15:113
25429930,3cyclictest19110-21tune2fs10:55:133
25429930,3cyclictest16802-21grep07:35:143
25429930,3cyclictest16283-21grep09:45:103
25429930,3cyclictest14214-21grep09:40:123
25429930,3cyclictest11561-21df07:25:123
25429930,3cyclictest0-21swapper/312:30:103
25429930,3cyclictest0-21swapper/312:25:023
25429930,3cyclictest0-21swapper/312:20:083
25429930,3cyclictest0-21swapper/312:05:023
25429930,3cyclictest0-21swapper/311:50:103
25429930,3cyclictest0-21swapper/311:45:123
25429930,3cyclictest0-21swapper/311:35:103
25429930,3cyclictest0-21swapper/311:30:093
25429930,3cyclictest0-21swapper/311:25:093
25429930,3cyclictest0-21swapper/311:20:103
25429930,3cyclictest0-21swapper/311:15:023
25429930,3cyclictest0-21swapper/311:10:103
25429930,3cyclictest0-21swapper/311:00:093
25429930,3cyclictest0-21swapper/310:50:003
25429930,3cyclictest0-21swapper/310:25:103
25429930,3cyclictest0-21swapper/310:20:093
25429930,3cyclictest0-21swapper/310:15:013
25429930,3cyclictest0-21swapper/310:00:103
25429930,3cyclictest0-21swapper/309:35:103
25429930,3cyclictest0-21swapper/308:55:013
25429930,3cyclictest0-21swapper/308:40:103
25429930,3cyclictest0-21swapper/308:35:093
25429930,3cyclictest0-21swapper/308:30:093
25429930,3cyclictest0-21swapper/308:15:013
25429930,3cyclictest0-21swapper/308:00:103
25429930,3cyclictest0-21swapper/307:55:103
25429930,3cyclictest0-21swapper/307:45:083
25429930,3cyclictest0-21swapper/307:30:093
25429930,3cyclictest0-21swapper/307:10:063
25429930,1cyclictest5812-21latency_hist12:40:003
25379933,0cyclictest31-21ksoftirqd/210:25:122
25379933,0cyclictest31-21ksoftirqd/208:15:092
25379933,0cyclictest31-21ksoftirqd/208:10:082
25379932,1cyclictest774-21snmpd07:10:022
25379931,1cyclictest81rcu_preempt09:05:112
25379931,1cyclictest0-21swapper/212:00:092
25379931,1cyclictest0-21swapper/210:35:102
25379931,1cyclictest0-21swapper/207:45:082
25379930,3cyclictest8589-21apt-get11:40:102
25379930,3cyclictest7245-21ntp_states09:25:152
25379930,3cyclictest3942-21df11:30:112
25379930,3cyclictest23863-21df10:00:112
25379930,3cyclictest23187-21apt-get12:10:012
25379930,3cyclictest21372-21df09:55:112
25379930,3cyclictest21012-21apt-get11:00:092
25379930,3cyclictest16657-21perl08:40:122
25379930,3cyclictest0-21swapper/212:35:112
25379930,3cyclictest0-21swapper/212:30:022
25379930,3cyclictest0-21swapper/212:25:092
25379930,3cyclictest0-21swapper/212:20:082
25379930,3cyclictest0-21swapper/212:05:102
25379930,3cyclictest0-21swapper/211:50:042
25379930,3cyclictest0-21swapper/211:45:022
25379930,3cyclictest0-21swapper/211:25:022
25379930,3cyclictest0-21swapper/211:20:102
25379930,3cyclictest0-21swapper/211:10:112
25379930,3cyclictest0-21swapper/210:55:112
25379930,3cyclictest0-21swapper/210:50:132
25379930,3cyclictest0-21swapper/209:45:092
25379930,3cyclictest0-21swapper/209:40:092
25379930,3cyclictest0-21swapper/209:20:022
25379930,3cyclictest0-21swapper/209:15:102
25379930,3cyclictest0-21swapper/209:10:102
25379930,3cyclictest0-21swapper/208:50:092
25379930,3cyclictest0-21swapper/208:35:002
25379930,3cyclictest0-21swapper/208:25:092
25379930,3cyclictest0-21swapper/208:00:202
25379930,3cyclictest0-21swapper/207:50:092
25379930,3cyclictest0-21swapper/207:40:112
25379930,3cyclictest0-21swapper/207:30:092
25379930,3cyclictest0-21swapper/207:20:082
25379930,1cyclictest81rcu_preempt11:15:112
25339931,2cyclictest0-21swapper/110:00:101
25339931,1cyclictest0-21swapper/112:35:101
25339931,1cyclictest0-21swapper/111:55:111
25339931,1cyclictest0-21swapper/111:35:011
25339931,1cyclictest0-21swapper/110:55:121
25339931,1cyclictest0-21swapper/110:45:111
25339931,1cyclictest0-21swapper/108:25:091
25339931,0cyclictest0-21swapper/109:25:091
25339930,2cyclictest529-21chrt09:12:121
25339930,2cyclictest20939-21chrt12:05:021
25339930,2cyclictest0-21swapper/110:40:111
25339930,2cyclictest0-21swapper/107:20:081
25339930,2cyclictest0-21swapper/107:15:111
25339930,1cyclictest0-21swapper/109:40:091
25339930,1cyclictest0-21swapper/108:05:111
25339930,0cyclictest0-21swapper/110:26:391
25329933,0cyclictest0-21swapper/008:40:000
25329932,1cyclictest13649-21expr10:45:110
25329931,1cyclictest0-21swapper/012:30:100
25329931,1cyclictest0-21swapper/010:40:110
25329931,1cyclictest0-21swapper/007:50:090
25329930,3cyclictest3507-21/usr/sbin/munin09:20:150
25329930,3cyclictest31329-21cat12:25:100
25329930,3cyclictest25811-21apt-get10:05:090
25329930,3cyclictest20855-21apt-get09:55:100
25329930,3cyclictest13556-21/usr/sbin/munin11:50:100
25329930,3cyclictest10913-21/usr/sbin/munin09:35:130
25329930,3cyclictest0-21swapper/012:35:100
25329930,3cyclictest0-21swapper/012:00:090
25329930,3cyclictest0-21swapper/011:40:000
25329930,3cyclictest0-21swapper/011:35:000
25329930,3cyclictest0-21swapper/011:30:090
25329930,3cyclictest0-21swapper/011:20:100
25329930,3cyclictest0-21swapper/011:05:090
25329930,3cyclictest0-21swapper/010:55:110
25329930,3cyclictest0-21swapper/010:35:100
25329930,3cyclictest0-21swapper/010:30:020
25329930,3cyclictest0-21swapper/010:25:130
25329930,3cyclictest0-21swapper/009:45:090
25329930,3cyclictest0-21swapper/009:25:090
25329930,3cyclictest0-21swapper/009:15:010
25329930,3cyclictest0-21swapper/009:10:100
25329930,3cyclictest0-21swapper/008:35:100
25329930,3cyclictest0-21swapper/008:25:090
25329930,3cyclictest0-21swapper/008:20:000
25329930,3cyclictest0-21swapper/008:05:110
25329930,3cyclictest0-21swapper/007:55:090
25329930,3cyclictest0-21swapper/007:45:080
25329930,3cyclictest0-21swapper/007:35:110
25329930,3cyclictest0-21swapper/007:30:010
25329930,3cyclictest0-21swapper/007:25:100
25329930,3cyclictest0-21swapper/007:20:080
25329930,2cyclictest0-21swapper/012:15:100
25329930,1cyclictest28495-21/usr/sbin/munin09:05:120
25329930,0cyclictest0-21swapper/007:10:080
25339921,1cyclictest0-21swapper/111:50:101
25339921,1cyclictest0-21swapper/109:55:111
25339921,1cyclictest0-21swapper/107:30:091
25339920,2cyclictest0-21swapper/108:50:101
25339920,1cyclictest0-21swapper/111:40:091
25339920,1cyclictest0-21swapper/109:30:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional