You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 02:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Mon Dec 29, 2025 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122292229212,12sleep10-21swapper/119:07:381
121352198181,12sleep30-21swapper/319:06:273
123602186171,11sleep00-21swapper/019:09:220
123522175159,12sleep20-21swapper/219:09:162
189542480,0sleep20-21swapper/223:40:132
60482420,0sleep10-21swapper/122:10:011
15492120,0sleep10-21swapper/123:05:141
108342100,0sleep00-21swapper/022:20:010
125949981,5cyclictest0-21swapper/000:35:150
125949970,3cyclictest5739-21munin-run21:05:000
126119962,3cyclictest0-21swapper/319:15:123
126119960,6cyclictest0-21swapper/323:35:123
126119960,6cyclictest0-21swapper/321:20:133
126039960,6cyclictest0-21swapper/221:25:142
125999962,2cyclictest0-21swapper/123:35:111
125999962,2cyclictest0-21swapper/119:15:131
125999961,3cyclictest0-21swapper/121:25:141
125999961,3cyclictest0-21swapper/120:45:131
125999961,3cyclictest0-21swapper/120:40:111
125999961,3cyclictest0-21swapper/120:00:121
125949960,6cyclictest0-21swapper/021:50:130
31060250,0sleep10-21swapper/123:00:011
126119955,0cyclictest27148-21kworker/3:122:18:393
126119955,0cyclictest27148-21kworker/3:121:11:303
126119955,0cyclictest27148-21kworker/3:120:49:053
126119955,0cyclictest27148-21kworker/3:119:41:553
126119955,0cyclictest27148-21kworker/3:119:30:433
126119955,0cyclictest27148-21kworker/3:100:32:583
126119955,0cyclictest0-21swapper/322:30:203
126119951,4cyclictest27148-21kworker/3:120:25:223
126119951,3cyclictest29842-21ntpq00:00:173
126119951,3cyclictest0-21swapper/300:05:103
126119950,5cyclictest0-21swapper/321:15:253
126119950,5cyclictest0-21swapper/321:00:143
126119950,4cyclictest18545-21apt-get21:30:133
126119950,4cyclictest0-21swapper/323:10:133
126119950,4cyclictest0-21swapper/321:25:013
126119950,0cyclictest0-21swapper/323:00:013
126039950,5cyclictest0-21swapper/222:45:212
125999952,2cyclictest0-21swapper/120:20:151
125999951,3cyclictest0-21swapper/122:20:121
125999951,3cyclictest0-21swapper/122:05:121
125999951,2cyclictest0-21swapper/123:20:131
125999951,2cyclictest0-21swapper/121:20:131
125999951,2cyclictest0-21swapper/121:05:161
125999951,2cyclictest0-21swapper/119:55:131
125999950,4cyclictest0-21swapper/120:50:101
125949952,3cyclictest28486-21/usr/sbin/munin20:45:180
3806240,0sleep2291rcuc/200:15:112
126119944,0cyclictest27148-21kworker/3:123:25:503
126119944,0cyclictest27148-21kworker/3:122:29:513
126119944,0cyclictest27148-21kworker/3:120:37:523
126119944,0cyclictest27148-21kworker/3:120:04:173
126119944,0cyclictest27148-21kworker/3:119:53:063
126119944,0cyclictest0-21swapper/320:05:163
126119944,0cyclictest0-21swapper/300:36:213
126119941,3cyclictest774-21snmpd21:48:213
126119940,4cyclictest459-21dbus-daemon19:15:003
126119940,4cyclictest23612-21apt-get23:50:153
126119940,4cyclictest0-21swapper/323:55:123
126119940,4cyclictest0-21swapper/323:40:113
126119940,4cyclictest0-21swapper/323:05:123
126119940,4cyclictest0-21swapper/322:55:163
126119940,4cyclictest0-21swapper/322:02:323
126119940,4cyclictest0-21swapper/320:40:003
126119940,4cyclictest0-21swapper/320:10:003
126119940,3cyclictest3417-21cut21:00:003
126119940,3cyclictest32076-21ntp_states19:45:183
126119940,3cyclictest28443-21/usr/sbin/munin21:50:143
126119940,3cyclictest26122-21/usr/sbin/munin22:50:103
126119940,3cyclictest21107-21sed22:40:003
126119940,3cyclictest19264-21hddtemp_smartct19:20:143
126039943,1cyclictest16880-21grep22:30:142
126039943,1cyclictest14207-21grep00:35:162
126039940,4cyclictest8276-21apt-get20:05:112
126039940,4cyclictest0-21swapper/223:35:112
126039940,4cyclictest0-21swapper/223:30:152
126039940,4cyclictest0-21swapper/223:15:122
126039940,4cyclictest0-21swapper/222:05:132
126039940,4cyclictest0-21swapper/221:50:142
126039940,4cyclictest0-21swapper/221:35:142
126039940,4cyclictest0-21swapper/221:20:132
126039940,4cyclictest0-21swapper/221:10:132
126039940,4cyclictest0-21swapper/220:55:152
126039940,4cyclictest0-21swapper/220:30:152
126039940,4cyclictest0-21swapper/220:15:152
126039940,4cyclictest0-21swapper/219:55:132
126039940,4cyclictest0-21swapper/219:25:122
126039940,3cyclictest32179-21ntp_states21:55:172
126039940,3cyclictest29691-21memory22:55:222
126039940,3cyclictest20967-21cat21:35:002
126039940,3cyclictest15069-21munin-node19:15:012
126039940,1cyclictest27168-21memory23:55:172
126039940,1cyclictest1504-21diskstats22:00:152
125999944,0cyclictest0-21swapper/123:45:041
125999944,0cyclictest0-21swapper/119:54:331
125999941,2cyclictest0-21swapper/123:30:141
125999941,2cyclictest0-21swapper/122:25:121
125999941,2cyclictest0-21swapper/122:15:131
125999941,2cyclictest0-21swapper/121:40:111
125999941,2cyclictest0-21swapper/121:30:131
125999941,2cyclictest0-21swapper/120:30:101
125999941,2cyclictest0-21swapper/119:40:141
125999941,2cyclictest0-21swapper/119:35:111
125999941,2cyclictest0-21swapper/119:25:111
125999941,2cyclictest0-21swapper/100:30:131
125999941,2cyclictest0-21swapper/100:00:111
125999941,1cyclictest0-21swapper/119:45:121
125999940,2cyclictest0-21swapper/123:50:141
125999940,2cyclictest0-21swapper/123:40:121
125999940,2cyclictest0-21swapper/122:45:121
125999940,2cyclictest0-21swapper/122:30:111
125999940,2cyclictest0-21swapper/100:15:111
125999940,2cyclictest0-21swapper/100:10:131
125949944,0cyclictest0-21swapper/022:55:190
125949943,1cyclictest23366-21/usr/sbin/munin19:30:120
125949942,1cyclictest774-21snmpd23:25:220
125949942,1cyclictest774-21snmpd20:22:590
125949942,1cyclictest26915-21hddtemp_smartct23:55:160
125949942,1cyclictest20945-21latency_hist22:40:010
125949942,1cyclictest18669-21/usr/sbin/munin23:40:190
125949941,1cyclictest0-21swapper/000:15:110
125949940,4cyclictest25497-21/usr/sbin/munin22:45:220
125949940,4cyclictest23328-21apt-get20:35:130
125949940,4cyclictest22155-21ntp_offset19:25:170
125949940,4cyclictest14180-21head21:20:150
125949940,4cyclictest0-21swapper/023:30:150
125949940,4cyclictest0-21swapper/022:20:120
125949940,4cyclictest0-21swapper/000:30:120
125949940,4cyclictest0-21swapper/000:09:580
125949940,3cyclictest8270-21cron00:24:590
125949940,3cyclictest7340-21ntp_states23:15:170
125949940,3cyclictest6686-21perl21:05:170
125949940,3cyclictest3295-21cut19:55:010
125949940,3cyclictest31945-21irqstats20:50:140
125949940,3cyclictest31324-21df_inode19:45:140
125949940,3cyclictest28363-21latency_hist22:55:000
125949940,3cyclictest2249-21/usr/sbin/munin22:00:190
125949940,3cyclictest17216-21irqstats22:30:140
125949940,3cyclictest13311-21cut20:15:000
125949940,1cyclictest995-21/usr/sbin/munin20:55:160
125949940,1cyclictest906-21perf23:05:010
125949940,1cyclictest28866-21diskstats19:40:160
126119932,1cyclictest21346-21grep22:40:133
126119931,1cyclictest0-21swapper/319:25:123
126119930,3cyclictest9035-21df00:25:143
126119930,3cyclictest33062sleep319:55:073
126119930,3cyclictest24331-21grep21:40:143
126119930,3cyclictest23659-21apt-get22:45:133
126119930,3cyclictest21542-21expr23:45:163
126119930,3cyclictest13994-21cat23:30:163
126119930,3cyclictest0-21swapper/323:20:123
126119930,3cyclictest0-21swapper/323:15:113
126119930,3cyclictest0-21swapper/322:20:123
126119930,3cyclictest0-21swapper/322:10:133
126119930,3cyclictest0-21swapper/322:05:133
126119930,3cyclictest0-21swapper/321:55:063
126119930,3cyclictest0-21swapper/321:35:133
126119930,3cyclictest0-21swapper/321:05:043
126119930,3cyclictest0-21swapper/320:50:103
126119930,3cyclictest0-21swapper/320:30:113
126119930,3cyclictest0-21swapper/320:20:143
126119930,3cyclictest0-21swapper/320:15:043
126119930,3cyclictest0-21swapper/319:35:103
126119930,3cyclictest0-21swapper/300:20:133
126119930,3cyclictest0-21swapper/300:15:053
126119930,3cyclictest0-21swapper/300:10:133
126039932,1cyclictest23844-21df20:35:142
126039932,1cyclictest19788-21head19:20:172
126039931,2cyclictest0-21swapper/219:30:112
126039931,1cyclictest774-21snmpd22:25:042
126039931,1cyclictest0-21swapper/223:00:152
126039931,1cyclictest0-21swapper/220:25:112
126039931,1cyclictest0-21swapper/200:30:132
126039931,1cyclictest0-21swapper/200:00:112
126039930,3cyclictest8865-21grep22:15:132
126039930,3cyclictest6572-21df_inode00:20:152
126039930,3cyclictest5966-21apt-get21:05:162
126039930,3cyclictest28336-21apt-get19:40:132
126039930,3cyclictest1608-21diskstats00:10:142
126039930,3cyclictest15403-21irqstats19:15:002
126039930,3cyclictest10903-21apt-get21:15:132
126039930,3cyclictest0-21swapper/223:50:132
126039930,3cyclictest0-21swapper/223:45:142
126039930,3cyclictest0-21swapper/223:25:112
126039930,3cyclictest0-21swapper/223:20:012
126039930,3cyclictest0-21swapper/223:10:132
126039930,3cyclictest0-21swapper/223:05:112
126039930,3cyclictest0-21swapper/222:51:442
126039930,3cyclictest0-21swapper/222:40:112
126039930,3cyclictest0-21swapper/222:35:122
126039930,3cyclictest0-21swapper/222:10:012
126039930,3cyclictest0-21swapper/221:45:152
126039930,3cyclictest0-21swapper/221:40:122
126039930,3cyclictest0-21swapper/221:00:142
126039930,3cyclictest0-21swapper/220:50:092
126039930,3cyclictest0-21swapper/220:45:032
126039930,3cyclictest0-21swapper/220:40:002
126039930,3cyclictest0-21swapper/220:20:152
126039930,3cyclictest0-21swapper/220:10:132
126039930,3cyclictest0-21swapper/220:00:122
126039930,3cyclictest0-21swapper/219:50:122
126039930,3cyclictest0-21swapper/219:45:042
126039930,3cyclictest0-21swapper/219:35:112
126039930,3cyclictest0-21swapper/200:25:122
126039930,3cyclictest0-21swapper/200:05:052
126039930,0cyclictest10818-21apt-get22:20:002
125999931,2cyclictest0-21swapper/122:40:121
125999931,1cyclictest0-21swapper/123:00:161
125999931,1cyclictest0-21swapper/122:50:101
125999931,1cyclictest0-21swapper/122:35:121
125999931,1cyclictest0-21swapper/121:55:121
125999931,1cyclictest0-21swapper/121:50:141
125999931,1cyclictest0-21swapper/121:15:121
125999931,1cyclictest0-21swapper/121:10:141
125999931,1cyclictest0-21swapper/120:15:151
125999931,1cyclictest0-21swapper/120:10:121
125999931,1cyclictest0-21swapper/119:20:111
125999931,1cyclictest0-21swapper/119:10:121
125999930,3cyclictest0-21swapper/123:29:561
125999930,2cyclictest81022sleep100:22:551
125999930,2cyclictest0-21swapper/123:55:111
125999930,2cyclictest0-21swapper/123:15:121
125999930,2cyclictest0-21swapper/123:10:121
125999930,2cyclictest0-21swapper/122:00:121
125999930,2cyclictest0-21swapper/121:35:131
125949933,0cyclictest0-21swapper/020:00:430
125949932,1cyclictest774-21snmpd21:30:070
125949932,1cyclictest774-21snmpd20:05:090
125949932,1cyclictest23362-21cron23:50:000
125949932,1cyclictest14335-21cat20:15:170
125949931,1cyclictest774-21snmpd19:20:090
125949931,1cyclictest25946-21dpkg20:39:590
125949931,1cyclictest0-21swapper/023:05:130
125949931,1cyclictest0-21swapper/022:05:130
125949931,0cyclictest0-21swapper/019:35:100
125949930,3cyclictest8470-21basename21:10:150
125949930,3cyclictest3949-21fschecks_time19:55:150
125949930,3cyclictest29265-21perl00:00:130
125949930,3cyclictest21014-21apt-get21:35:130
125949930,3cyclictest16709-21diskstats23:35:120
125949930,3cyclictest15180-21cat19:15:010
125949930,3cyclictest0-21swapper/023:45:150
125949930,3cyclictest0-21swapper/023:20:020
125949930,3cyclictest0-21swapper/023:10:150
125949930,3cyclictest0-21swapper/022:40:060
125949930,3cyclictest0-21swapper/022:25:130
125949930,3cyclictest0-21swapper/022:10:010
125949930,3cyclictest0-21swapper/021:55:120
125949930,3cyclictest0-21swapper/021:45:040
125949930,3cyclictest0-21swapper/021:40:120
125949930,3cyclictest0-21swapper/021:25:000
125949930,3cyclictest0-21swapper/021:15:130
125949930,3cyclictest0-21swapper/020:25:050
125949930,3cyclictest0-21swapper/019:10:120
125949930,3cyclictest0-21swapper/000:20:130
125949930,3cyclictest0-21swapper/000:10:130
125949930,2cyclictest20853-21/usr/sbin/munin20:30:120
125999921,1cyclictest0-21swapper/121:45:151
125999921,1cyclictest0-21swapper/121:00:141
125999921,1cyclictest0-21swapper/120:25:121
125999921,1cyclictest0-21swapper/119:30:011
125999921,1cyclictest0-21swapper/100:35:151
125999921,1cyclictest0-21swapper/100:05:111
125999921,0cyclictest0-21swapper/120:55:121
125999920,2cyclictest8271-21taskset20:05:111
125999920,2cyclictest0-21swapper/120:35:121
125999920,1cyclictest0-21swapper/100:25:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional