You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 08:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Tue Dec 30, 2025 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
180882235219,11sleep10-21swapper/119:08:151
179172215189,21sleep30-21swapper/319:06:033
181542186170,12sleep00-21swapper/019:09:050
18002210992,12sleep20-21swapper/219:07:072
167392500,0sleep20-21swapper/221:15:012
245992120,0sleep10-21swapper/122:35:151
184129994,1cyclictest21732-21apt-get21:25:153
184129993,1cyclictest27270-21which22:40:163
184129992,2cyclictest1191-21/usr/sbin/munin22:55:013
183999992,3cyclictest21327-21apt-get20:20:000
184129985,2cyclictest6376-21apt-get23:05:113
184129985,2cyclictest26440-21munin-run21:35:003
184129985,2cyclictest19005-21/usr/sbin/munin22:25:133
184129982,4cyclictest2388-21perl21:50:143
184129982,4cyclictest12245-21if_eth400:20:173
184129976,1cyclictest11662-21apt-get20:00:113
184129975,2cyclictest8557-21apt00:15:003
184129975,2cyclictest26162-21perf23:45:023
184129974,2cyclictest29155-21apt-get21:40:133
184129974,2cyclictest28847-21/usr/sbin/munin23:50:173
184129974,2cyclictest2087-21sort00:00:153
184129974,2cyclictest16601-21apt-get20:10:143
184129974,2cyclictest16328-21munin-run21:15:003
184129974,2cyclictest13558-21apt-get23:20:023
184129974,2cyclictest10356-21/usr/sbin/munin22:05:203
184129974,2cyclictest0-21swapper/323:10:123
184129973,1cyclictest4604-21perl23:00:143
184129973,1cyclictest11566-21apt-get22:10:123
184129972,3cyclictest12281-21if_eth423:15:163
184129972,2cyclictest9704-21cut21:00:183
184129972,2cyclictest4876-21wc00:05:163
184129972,2cyclictest17280-21df_inode21:15:143
183999971,3cyclictest26451-21basename21:35:010
184129965,1cyclictest9172-21apt-get19:55:123
184129965,1cyclictest6702-21apt-get19:50:113
184129965,1cyclictest4139-21apt-get21:55:143
184129965,1cyclictest31622-21apt-get21:45:103
184129965,1cyclictest26710-21apt-get20:30:103
184129965,1cyclictest18698-21apt-get00:35:153
184129965,1cyclictest1761-21apt-get19:40:113
184129965,1cyclictest1718-21apt-get20:45:133
184129965,1cyclictest14034-21apt-get22:15:103
184129964,2cyclictest7186-21diskstats20:55:133
184129964,2cyclictest28606-21cron23:50:003
184129964,2cyclictest23949-21apt-get22:35:123
184129964,2cyclictest22167-21perl23:35:143
184129964,2cyclictest19796-21smartctl23:30:163
184129964,2cyclictest18799-21cat22:25:013
184129964,2cyclictest16378-21munin-run20:10:003
184129964,2cyclictest15265-21python00:25:203
184129964,2cyclictest1488-21munin-run20:44:593
184129964,1cyclictest31703-21apt-get19:35:133
184129964,1cyclictest24298-21apt-get19:20:143
184129964,1cyclictest18517-21apt-get19:10:133
184129963,3cyclictest5925-21ls19:45:203
184129963,3cyclictest3042-21timerandwakeup22:55:213
184129963,3cyclictest29274-21basename19:30:133
184129963,3cyclictest24000-21cron20:25:003
184129963,2cyclictest29171-21chrt20:35:063
184129963,2cyclictest28964-21cut22:45:123
184129963,2cyclictest27584-21sed19:25:173
184129963,2cyclictest24406-21/usr/sbin/munin20:25:133
184129963,2cyclictest21488-21turbostat.cron21:25:003
184129963,2cyclictest21466-21chrt22:30:043
184129963,2cyclictest16746-21/usr/sbin/munin00:30:143
184129963,2cyclictest11637-21cut21:05:143
184129962,1cyclictest8791-21apt-get00:15:133
184129962,1cyclictest21032-21ntp_states19:15:013
184129961,1cyclictest4622-21cstates20:50:133
184129954,1cyclictest20352-21ntp_states20:15:183
184129953,2cyclictest26662-21chrt21:35:133
184129953,2cyclictest16588-21egrep23:25:103
184129952,2cyclictest758-21runrttasks22:00:023
184129952,2cyclictest31318-21seq23:55:123
184089950,5cyclictest0-21swapper/221:30:162
184089950,4cyclictest0-21swapper/223:20:012
184039953,1cyclictest0-21swapper/100:05:111
184039952,2cyclictest0-21swapper/120:15:131
184039951,3cyclictest0-21swapper/119:15:131
183999954,1cyclictest0-21swapper/019:55:140
183999950,4cyclictest0-21swapper/021:35:140
183999950,1cyclictest31428-21munin-run20:39:590
183999950,1cyclictest17062-21diskstats22:20:160
184089943,1cyclictest30702-21head22:45:212
184089943,1cyclictest27478-21grep20:30:122
184089942,2cyclictest26470-21cron20:29:592
184089942,1cyclictest774-21snmpd22:05:152
184089941,3cyclictest774-21snmpd21:00:172
184089941,3cyclictest32329-21cat22:50:162
184089941,2cyclictest0-21swapper/222:25:142
184089940,4cyclictest0-21swapper/222:30:132
184089940,4cyclictest0-21swapper/222:00:132
184089940,4cyclictest0-21swapper/221:40:142
184089940,4cyclictest0-21swapper/220:35:132
184089940,4cyclictest0-21swapper/220:20:132
184089940,4cyclictest0-21swapper/200:35:152
184089940,3cyclictest9626-21hddtemp_smartct00:15:162
184089940,3cyclictest32424-21perl19:35:162
184089940,3cyclictest23869-21sort23:40:012
184089940,3cyclictest22935-21tail19:15:182
184089940,3cyclictest22262-21diskstats21:25:162
184089940,3cyclictest2198-21diskstats21:50:132
184089940,3cyclictest21475-21apt-config20:20:022
184089940,3cyclictest14660-21diskstats20:05:132
184089940,3cyclictest0-21swapper/223:05:122
184089940,2cyclictest0-21swapper/200:25:112
184089940,0cyclictest0-21swapper/220:40:132
184039942,1cyclictest0-21swapper/120:10:131
184039941,2cyclictest0-21swapper/123:30:151
184039941,2cyclictest0-21swapper/123:15:131
184039941,2cyclictest0-21swapper/123:05:111
184039941,2cyclictest0-21swapper/122:50:131
184039941,2cyclictest0-21swapper/121:30:121
184039941,2cyclictest0-21swapper/119:45:111
184039941,2cyclictest0-21swapper/119:40:111
184039941,2cyclictest0-21swapper/119:20:131
184039941,2cyclictest0-21swapper/100:20:121
184039941,1cyclictest0-21swapper/123:40:121
184039940,4cyclictest0-21swapper/123:51:381
184039940,4cyclictest0-21swapper/123:00:521
184039940,4cyclictest0-21swapper/122:56:211
184039940,2cyclictest0-21swapper/119:55:121
184039940,0cyclictest0-21swapper/100:27:521
183999944,0cyclictest0-21swapper/020:00:020
183999943,1cyclictest3904-21/usr/sbin/munin23:00:120
183999943,1cyclictest19254-21apt-get21:20:100
183999941,2cyclictest0-21swapper/022:45:120
183999941,2cyclictest0-21swapper/022:00:120
183999941,1cyclictest0-21swapper/000:15:130
183999940,4cyclictest26710-21apt-get20:30:110
183999940,4cyclictest22751-21ntp_states22:30:180
183999940,4cyclictest0-21swapper/022:50:080
183999940,4cyclictest0-21swapper/022:35:130
183999940,4cyclictest0-21swapper/000:30:130
183999940,3cyclictest7588-21ntp_states00:10:180
183999940,3cyclictest698-21awk19:35:200
183999940,3cyclictest4714-21df_inode20:50:150
183999940,3cyclictest27214-21hddtemp_smartct23:45:130
183999940,3cyclictest26439-21dpkg22:40:120
183999940,3cyclictest20964-21munin-node19:15:020
183999940,3cyclictest20758-21latency_hist19:15:010
183999940,3cyclictest19997-21irqstats22:25:170
183999940,3cyclictest18840-21sed23:30:010
183999940,3cyclictest12575-21if_eth421:05:180
183999940,3cyclictest0-21swapper/020:25:010
183999940,1cyclictest7973-21ntp_states19:50:170
183999940,1cyclictest29607-21cat21:40:140
183999940,1cyclictest28847-21/usr/sbin/munin23:50:150
184089932,1cyclictest774-21snmpd23:10:022
184089932,1cyclictest2036-21cut22:55:152
184089932,1cyclictest0-21swapper/223:30:142
184089932,0cyclictest0-21swapper/221:45:102
184089931,1cyclictest4733-21fschecks_count20:50:142
184089931,1cyclictest3855-21apt-get00:05:112
184089931,1cyclictest209-21systemd-journal19:50:012
184089931,1cyclictest0-21swapper/223:40:122
184089931,1cyclictest0-21swapper/222:40:122
184089931,1cyclictest0-21swapper/220:55:122
184089930,3cyclictest4436-21diskstats23:00:132
184089930,3cyclictest29033-21cpuspeed23:50:122
184089930,3cyclictest26902-21df23:45:132
184089930,3cyclictest24825-21diskstats19:20:152
184089930,3cyclictest16989-21df23:25:122
184089930,3cyclictest16768-21sort00:30:162
184089930,3cyclictest14034-21apt-get22:15:102
184089930,3cyclictest12115-21hddtemp_smartct00:20:162
184089930,3cyclictest0-21swapper/223:55:092
184089930,3cyclictest0-21swapper/223:15:132
184089930,3cyclictest0-21swapper/222:35:092
184089930,3cyclictest0-21swapper/222:20:142
184089930,3cyclictest0-21swapper/222:10:122
184089930,3cyclictest0-21swapper/221:55:132
184089930,3cyclictest0-21swapper/221:35:052
184089930,3cyclictest0-21swapper/221:20:122
184089930,3cyclictest0-21swapper/221:10:122
184089930,3cyclictest0-21swapper/221:05:142
184089930,3cyclictest0-21swapper/220:45:132
184089930,3cyclictest0-21swapper/220:10:082
184089930,3cyclictest0-21swapper/220:00:112
184089930,3cyclictest0-21swapper/219:55:132
184089930,3cyclictest0-21swapper/219:45:102
184089930,3cyclictest0-21swapper/219:40:062
184089930,3cyclictest0-21swapper/219:30:132
184089930,3cyclictest0-21swapper/219:25:082
184089930,3cyclictest0-21swapper/219:10:132
184089930,3cyclictest0-21swapper/200:10:142
184089930,3cyclictest0-21swapper/200:00:102
184039933,0cyclictest0-21swapper/121:50:361
184039933,0cyclictest0-21swapper/121:44:021
184039933,0cyclictest0-21swapper/120:39:511
184039933,0cyclictest0-21swapper/120:06:151
184039933,0cyclictest0-21swapper/120:04:401
184039932,1cyclictest0-21swapper/122:40:121
184039931,2cyclictest0-21swapper/123:20:121
184039931,1cyclictest0-21swapper/123:55:151
184039931,1cyclictest0-21swapper/123:10:121
184039931,1cyclictest0-21swapper/122:20:141
184039931,1cyclictest0-21swapper/122:15:101
184039931,1cyclictest0-21swapper/121:45:101
184039931,1cyclictest0-21swapper/121:35:131
184039931,1cyclictest0-21swapper/121:15:011
184039931,1cyclictest0-21swapper/121:10:121
184039931,1cyclictest0-21swapper/120:55:121
184039931,1cyclictest0-21swapper/120:50:121
184039931,1cyclictest0-21swapper/120:40:121
184039931,1cyclictest0-21swapper/120:30:091
184039931,1cyclictest0-21swapper/120:25:131
184039931,1cyclictest0-21swapper/119:35:131
184039931,1cyclictest0-21swapper/119:30:121
184039931,1cyclictest0-21swapper/100:15:141
184039931,1cyclictest0-21swapper/100:00:121
184039930,2cyclictest28753-21chrt19:27:031
184039930,2cyclictest209282sleep122:26:101
184039930,2cyclictest0-21swapper/123:45:111
184039930,2cyclictest0-21swapper/123:25:091
184039930,2cyclictest0-21swapper/122:30:141
184039930,2cyclictest0-21swapper/121:55:131
184039930,2cyclictest0-21swapper/120:45:141
184039930,1cyclictest0-21swapper/121:20:101
184039930,1cyclictest0-21swapper/121:00:151
184039930,0cyclictest0-21swapper/122:45:091
183999932,1cyclictest774-21snmpd20:40:040
183999932,1cyclictest774-21snmpd20:05:080
183999932,1cyclictest14453-21cstates21:10:140
183999931,1cyclictest0-21swapper/022:55:130
183999931,1cyclictest0-21swapper/021:00:150
183999930,3cyclictest9100-21apt-get22:05:140
183999930,3cyclictest6973-21tr20:55:130
183999930,3cyclictest24816-21df19:20:160
183999930,3cyclictest2184-21df21:50:130
183999930,3cyclictest214222sleep023:35:100
183999930,3cyclictest19011-21wget23:30:140
183999930,3cyclictest14737-21irqstats00:25:150
183999930,3cyclictest11835-21df23:15:150
183999930,3cyclictest0-21swapper/023:55:140
183999930,3cyclictest0-21swapper/023:40:120
183999930,3cyclictest0-21swapper/023:20:010
183999930,3cyclictest0-21swapper/023:10:120
183999930,3cyclictest0-21swapper/023:05:110
183999930,3cyclictest0-21swapper/022:15:110
183999930,3cyclictest0-21swapper/022:10:120
183999930,3cyclictest0-21swapper/021:55:100
183999930,3cyclictest0-21swapper/021:45:050
183999930,3cyclictest0-21swapper/021:15:130
183999930,3cyclictest0-21swapper/020:45:130
183999930,3cyclictest0-21swapper/020:25:120
183999930,3cyclictest0-21swapper/020:10:070
183999930,3cyclictest0-21swapper/019:45:050
183999930,3cyclictest0-21swapper/019:40:100
183999930,3cyclictest0-21swapper/019:30:060
183999930,3cyclictest0-21swapper/019:25:010
183999930,3cyclictest0-21swapper/000:35:150
183999930,3cyclictest0-21swapper/000:20:110
183999930,3cyclictest0-21swapper/000:05:040
183999930,1cyclictest21713-21taskset21:25:020
183999930,1cyclictest1773-21ls00:00:140
184039922,0cyclictest0-21swapper/119:52:431
184039921,1cyclictest0-21swapper/122:10:131
184039921,0cyclictest0-21swapper/121:05:151
184039920,2cyclictest20872-21taskset00:39:291
184039920,1cyclictest0-21swapper/123:35:121
184039920,1cyclictest0-21swapper/122:05:141
184039920,1cyclictest0-21swapper/122:00:121
184039920,1cyclictest0-21swapper/121:25:151
184039920,1cyclictest0-21swapper/120:20:011
184039920,1cyclictest0-21swapper/119:10:141
184039920,1cyclictest0-21swapper/100:30:131
184039920,1cyclictest0-21swapper/100:10:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional