You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 11:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Mon Dec 15, 2025 00:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
258932200184,11sleep10-21swapper/119:05:461
259972186171,11sleep30-21swapper/319:07:083
260652179161,13sleep00-21swapper/019:07:580
260212175157,13sleep20-21swapper/219:07:282
20431290,0sleep30-21swapper/321:05:143
28206280,0sleep028208-21kernelversion20:15:150
264349980,4cyclictest1937-21munin-run21:35:010
264379970,7cyclictest0-21swapper/219:25:112
264419965,1cyclictest0-21swapper/320:05:123
264419965,1cyclictest0-21swapper/320:05:113
264349960,5cyclictest0-21swapper/020:30:090
264419952,2cyclictest0-21swapper/321:35:153
264419950,4cyclictest0-21swapper/320:40:113
264419950,0cyclictest0-21swapper/321:30:193
264359952,2cyclictest0-21swapper/119:50:111
264359951,3cyclictest0-21swapper/123:10:121
264359951,3cyclictest0-21swapper/121:05:111
264359951,3cyclictest0-21swapper/100:30:111
264359951,3cyclictest0-21swapper/100:25:091
264359951,2cyclictest0-21swapper/120:25:111
264359951,2cyclictest0-21swapper/119:45:111
264349950,4cyclictest6974-21apt-get23:55:010
264419943,1cyclictest24532-21tr21:15:123
264419943,1cyclictest21655-21turbostat.cron23:20:013
264419941,2cyclictest0-21swapper/300:00:103
264419940,4cyclictest26844-21apt-get23:30:113
264419940,4cyclictest19311-21munin-run21:05:003
264419940,4cyclictest0-21swapper/323:00:123
264419940,4cyclictest0-21swapper/322:20:123
264419940,4cyclictest0-21swapper/321:52:443
264419940,4cyclictest0-21swapper/320:54:183
264419940,4cyclictest0-21swapper/320:20:173
264419940,4cyclictest0-21swapper/320:00:103
264419940,4cyclictest0-21swapper/319:15:093
264419940,3cyclictest8255-21ntp_states23:55:173
264419940,3cyclictest6556-21latency_hist23:55:013
264419940,3cyclictest5962-21ntp_states20:35:223
264419940,3cyclictest32546-21fschecks_time23:40:123
264419940,3cyclictest24387-21latency_hist22:20:023
264419940,3cyclictest22040-21apt-get00:25:103
264419940,3cyclictest22012-21date22:15:013
264419940,3cyclictest2053-21cat22:40:023
264419940,3cyclictest15138-21df_inode00:10:123
264419940,3cyclictest14472-21/usr/sbin/munin23:05:123
264419940,1cyclictest31564-21latency_hist23:40:013
264419940,1cyclictest19356-21munin-run20:00:003
264419940,0cyclictest4525-21munin-run19:30:003
264379944,0cyclictest0-21swapper/223:15:152
264379944,0cyclictest0-21swapper/219:23:452
264379941,3cyclictest20480-21gltestperf22:10:152
264379941,3cyclictest17937-21gltestperf19:55:132
264379941,1cyclictest0-21swapper/220:30:092
264379941,1cyclictest0-21swapper/220:05:112
264379941,1cyclictest0-21swapper/220:05:112
264379940,4cyclictest8049-21hddtemp_smartct19:35:142
264379940,4cyclictest20864-21ntp_states20:00:152
264379940,4cyclictest12048-21/usr/sbin/munin21:55:172
264379940,4cyclictest0-21swapper/220:20:132
264379940,4cyclictest0-21swapper/219:45:112
264379940,3cyclictest7057-21sed21:45:012
264379940,3cyclictest29313-21/usr/sbin/munin23:35:142
264379940,3cyclictest14532-21sed00:10:002
264379940,3cyclictest11964-21chrt00:05:002
264379940,2cyclictest0-21swapper/200:25:092
264379940,1cyclictest32705-21diskstats20:25:132
264379940,1cyclictest31585-21users19:15:182
264379940,0cyclictest0-21swapper/200:15:212
264359941,2cyclictest0-21swapper/123:50:111
264359941,2cyclictest0-21swapper/122:20:121
264359941,2cyclictest0-21swapper/121:55:111
264359941,2cyclictest0-21swapper/121:45:121
264359941,2cyclictest0-21swapper/121:25:111
264359941,2cyclictest0-21swapper/120:45:091
264359941,2cyclictest0-21swapper/119:15:091
264359940,2cyclictest0-21swapper/122:40:111
264349944,0cyclictest14475-21apt-get23:05:100
264349944,0cyclictest0-21swapper/021:40:110
264349943,1cyclictest9636-21/usr/sbin/munin20:45:110
264349943,1cyclictest0-21swapper/021:26:480
264349942,1cyclictest12664-21df00:05:130
264349942,1cyclictest0-21swapper/020:05:120
264349942,1cyclictest0-21swapper/020:05:110
264349941,2cyclictest0-21swapper/022:45:100
264349941,2cyclictest0-21swapper/019:55:110
264349941,2cyclictest0-21swapper/000:35:130
264349941,1cyclictest0-21swapper/000:15:100
264349940,4cyclictest26503-21/usr/sbin/munin19:10:140
264349940,4cyclictest22003-21/usr/sbin/munin21:10:160
264349940,4cyclictest0-21swapper/023:50:110
264349940,4cyclictest0-21swapper/023:15:110
264349940,4cyclictest0-21swapper/021:46:530
264349940,4cyclictest0-21swapper/020:00:160
264349940,4cyclictest0-21swapper/019:40:100
264349940,4cyclictest0-21swapper/019:19:300
264349940,4cyclictest0-21swapper/000:30:100
264349940,4cyclictest0-21swapper/000:27:480
264349940,3cyclictest8142-21memory22:50:160
264349940,3cyclictest31550-21users20:20:200
264349940,3cyclictest29800-21expr23:35:110
264349940,3cyclictest27159-21dpkg21:20:010
264349940,3cyclictest24349-21sed23:25:020
264349940,3cyclictest0-21swapper/022:15:120
264349940,1cyclictest9695-21aten2_r5power_v21:50:130
264349940,1cyclictest2162-21/usr/sbin/munin21:35:220
264349940,1cyclictest19571-21/usr/sbin/munin00:20:170
264349940,1cyclictest17063-21/usr/sbin/munin21:00:120
264349940,1cyclictest14575-21/usr/sbin/munin20:55:190
20053240,0sleep10-21swapper/122:10:141
264419931,0cyclictest0-21swapper/322:45:103
264419930,3cyclictest8803-21sed19:35:193
264419930,3cyclictest8318-21grep22:50:173
264419930,3cyclictest5702-21cat19:30:143
264419930,3cyclictest4647-21apt-get21:40:103
264419930,3cyclictest30561-21/usr/sbin/munin22:30:163
264419930,3cyclictest2196-21cut23:45:133
264419930,3cyclictest15149-21cat19:50:123
264419930,3cyclictest12173-21apt-get19:45:123
264419930,3cyclictest0-21swapper/323:20:113
264419930,3cyclictest0-21swapper/323:10:093
264419930,3cyclictest0-21swapper/322:55:103
264419930,3cyclictest0-21swapper/322:40:113
264419930,3cyclictest0-21swapper/322:25:053
264419930,3cyclictest0-21swapper/322:05:213
264419930,3cyclictest0-21swapper/322:00:013
264419930,3cyclictest0-21swapper/321:55:033
264419930,3cyclictest0-21swapper/321:45:053
264419930,3cyclictest0-21swapper/321:25:113
264419930,3cyclictest0-21swapper/321:20:013
264419930,3cyclictest0-21swapper/321:10:043
264419930,3cyclictest0-21swapper/320:55:123
264419930,3cyclictest0-21swapper/320:45:093
264419930,3cyclictest0-21swapper/320:30:093
264419930,3cyclictest0-21swapper/320:25:123
264419930,3cyclictest0-21swapper/320:15:103
264419930,3cyclictest0-21swapper/320:10:013
264419930,3cyclictest0-21swapper/319:40:023
264419930,3cyclictest0-21swapper/319:20:143
264419930,3cyclictest0-21swapper/319:10:013
264419930,3cyclictest0-21swapper/300:35:133
264419930,3cyclictest0-21swapper/300:30:073
264419930,3cyclictest0-21swapper/300:20:073
264419930,3cyclictest0-21swapper/300:15:053
264419930,3cyclictest0-21swapper/300:05:123
264419930,0cyclictest0-21swapper/323:25:153
264379931,1cyclictest426-21tail21:30:132
264379930,3cyclictest5406-21memory23:50:162
264379930,3cyclictest27108-21/usr/sbin/munin22:25:122
264379930,3cyclictest27034-21diskstats19:10:092
264379930,3cyclictest25740-21ntp_states21:15:182
264379930,3cyclictest24369-21apt23:25:112
264379930,3cyclictest2370-21expr22:40:122
264379930,3cyclictest2227-21basename21:35:162
264379930,3cyclictest22178-21grep23:20:112
264379930,3cyclictest16017-21gunzip20:55:182
264379930,3cyclictest12110-21apt-get20:50:112
264379930,3cyclictest10231-21diskstats19:40:122
264379930,3cyclictest0-21swapper/223:55:012
264379930,3cyclictest0-21swapper/223:45:122
264379930,3cyclictest0-21swapper/223:40:102
264379930,3cyclictest0-21swapper/223:30:112
264379930,3cyclictest0-21swapper/223:10:112
264379930,3cyclictest0-21swapper/223:05:072
264379930,3cyclictest0-21swapper/223:00:212
264379930,3cyclictest0-21swapper/222:55:112
264379930,3cyclictest0-21swapper/222:50:122
264379930,3cyclictest0-21swapper/222:45:102
264379930,3cyclictest0-21swapper/222:35:052
264379930,3cyclictest0-21swapper/222:30:122
264379930,3cyclictest0-21swapper/222:20:122
264379930,3cyclictest0-21swapper/222:15:122
264379930,3cyclictest0-21swapper/222:05:222
264379930,3cyclictest0-21swapper/222:00:112
264379930,3cyclictest0-21swapper/221:50:122
264379930,3cyclictest0-21swapper/221:45:052
264379930,3cyclictest0-21swapper/221:25:062
264379930,3cyclictest0-21swapper/221:10:102
264379930,3cyclictest0-21swapper/221:05:062
264379930,3cyclictest0-21swapper/221:00:092
264379930,3cyclictest0-21swapper/220:45:052
264379930,3cyclictest0-21swapper/220:40:112
264379930,3cyclictest0-21swapper/220:35:152
264379930,3cyclictest0-21swapper/220:15:052
264379930,3cyclictest0-21swapper/220:10:112
264379930,3cyclictest0-21swapper/219:50:112
264379930,3cyclictest0-21swapper/219:30:102
264379930,3cyclictest0-21swapper/200:35:022
264379930,3cyclictest0-21swapper/200:30:112
264379930,3cyclictest0-21swapper/200:20:122
264379930,3cyclictest0-21swapper/200:10:072
264379930,1cyclictest27699-21df_inode21:20:132
264359933,0cyclictest0-21swapper/122:54:221
264359933,0cyclictest0-21swapper/121:40:441
264359931,2cyclictest0-21swapper/100:35:131
264359931,2cyclictest0-21swapper/100:10:101
264359931,1cyclictest0-21swapper/123:40:101
264359931,1cyclictest0-21swapper/123:30:101
264359931,1cyclictest0-21swapper/123:05:101
264359931,1cyclictest0-21swapper/123:00:111
264359931,1cyclictest0-21swapper/122:55:111
264359931,1cyclictest0-21swapper/122:45:101
264359931,1cyclictest0-21swapper/122:30:121
264359931,1cyclictest0-21swapper/122:05:221
264359931,1cyclictest0-21swapper/122:00:111
264359931,1cyclictest0-21swapper/121:50:121
264359931,1cyclictest0-21swapper/121:30:111
264359931,1cyclictest0-21swapper/121:15:111
264359931,1cyclictest0-21swapper/121:10:101
264359931,1cyclictest0-21swapper/120:55:121
264359931,1cyclictest0-21swapper/120:35:151
264359931,1cyclictest0-21swapper/120:30:091
264359931,1cyclictest0-21swapper/120:20:111
264359931,1cyclictest0-21swapper/120:00:101
264359931,1cyclictest0-21swapper/119:55:111
264359931,1cyclictest0-21swapper/119:35:131
264359931,1cyclictest0-21swapper/119:25:111
264359931,1cyclictest0-21swapper/119:25:001
264359931,1cyclictest0-21swapper/100:15:101
264359931,1cyclictest0-21swapper/100:05:111
264359930,3cyclictest0-21swapper/121:22:501
264359930,2cyclictest240702sleep122:16:141
264359930,2cyclictest0-21swapper/123:15:111
264359930,2cyclictest0-21swapper/122:25:091
264359930,2cyclictest0-21swapper/121:35:151
264359930,2cyclictest0-21swapper/100:20:121
264359930,0cyclictest0-21swapper/123:25:381
264349931,1cyclictest0-21swapper/023:40:110
264349931,1cyclictest0-21swapper/023:30:110
264349931,1cyclictest0-21swapper/023:00:110
264349931,1cyclictest0-21swapper/022:55:110
264349931,1cyclictest0-21swapper/021:55:110
264349931,1cyclictest0-21swapper/021:05:110
264349931,1cyclictest0-21swapper/020:10:110
264349931,1cyclictest0-21swapper/019:45:110
264349930,3cyclictest8011-21hddtemp_smartct20:40:140
264349930,3cyclictest636-21hddtemp_smartct19:20:160
264349930,3cyclictest24635-21/usr/sbin/munin22:20:130
264349930,3cyclictest18029-21memory23:10:150
264349930,3cyclictest15519-21head22:00:140
264349930,3cyclictest14609-21/usr/sbin/munin00:10:120
264349930,3cyclictest0-21swapper/023:45:060
264349930,3cyclictest0-21swapper/023:25:120
264349930,3cyclictest0-21swapper/022:40:110
264349930,3cyclictest0-21swapper/022:35:120
264349930,3cyclictest0-21swapper/022:30:010
264349930,3cyclictest0-21swapper/022:25:090
264349930,3cyclictest0-21swapper/022:10:120
264349930,3cyclictest0-21swapper/022:05:010
264349930,3cyclictest0-21swapper/021:15:110
264349930,3cyclictest0-21swapper/020:50:110
264349930,3cyclictest0-21swapper/020:35:150
264349930,3cyclictest0-21swapper/020:25:050
264349930,3cyclictest0-21swapper/019:50:020
264349930,3cyclictest0-21swapper/019:35:120
264349930,3cyclictest0-21swapper/019:30:100
264349930,3cyclictest0-21swapper/019:25:110
264349930,3cyclictest0-21swapper/000:00:020
264359921,1cyclictest0-21swapper/120:10:011
264359921,1cyclictest0-21swapper/120:05:111
264359921,1cyclictest0-21swapper/120:05:111
264359921,0cyclictest0-21swapper/119:40:101
264359920,1cyclictest4742-21chrt19:30:081
264359920,1cyclictest0-21swapper/123:55:021
264359920,1cyclictest0-21swapper/123:45:121
264359920,1cyclictest0-21swapper/123:35:101
264359920,1cyclictest0-21swapper/123:20:101
264359920,1cyclictest0-21swapper/122:35:111
264359920,1cyclictest0-21swapper/121:00:111
264359920,1cyclictest0-21swapper/120:50:111
264359920,1cyclictest0-21swapper/120:40:111
264359920,1cyclictest0-21swapper/120:15:101
264359920,1cyclictest0-21swapper/119:10:071
264359920,1cyclictest0-21swapper/100:00:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional