You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 03:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Thu Dec 11, 2025 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
260032201185,11sleep10-21swapper/119:07:231
260252188155,28sleep30-21swapper/319:07:413
258592181166,11sleep00-21swapper/019:05:340
258512178161,13sleep20-21swapper/219:05:272
88202470,0sleep30-21swapper/323:12:533
303672450,0sleep00-21swapper/023:23:510
247172440,0sleep10-21swapper/123:05:001
7732430,0sleep10-21swapper/121:30:551
33522430,0sleep10-21swapper/122:05:151
152562430,0sleep215258-21fschecks_count00:05:172
149222350,0sleep10-21swapper/120:55:161
136672120,1sleep013664-21ssh23:15:160
60472100,0sleep10-21swapper/123:11:081
10827290,0sleep30-21swapper/300:19:443
263659981,6cyclictest0-21swapper/322:20:123
263539982,3cyclictest6851-21awk23:45:010
263539981,3cyclictest14166-21munin-run20:55:000
263659970,6cyclictest0-21swapper/322:30:113
263539965,1cyclictest22044-21grep21:25:210
263539960,1cyclictest20112-21sh22:13:400
263659955,0cyclictest0-21swapper/323:16:223
263659954,1cyclictest20540-21irqstats21:05:153
263659953,1cyclictest29721-21/usr/sbin/munin19:15:143
263659953,1cyclictest14876-21grep00:05:163
263659950,5cyclictest10122-21/usr/sbin/munin23:30:183
263659950,4cyclictest29507-21apt-get20:20:103
263659950,4cyclictest0-21swapper/321:30:153
263659950,4cyclictest0-21swapper/320:40:113
263659950,1cyclictest16884-21ntp_states21:55:193
263609953,2cyclictest17787-21kworker/2:121:45:292
263609951,2cyclictest0-21swapper/221:20:142
263609950,4cyclictest17704-21apt-get22:45:012
263609950,0cyclictest81rcu_preempt00:35:132
263549951,3cyclictest0-21swapper/123:15:121
263549951,2cyclictest0-21swapper/123:45:101
263549951,2cyclictest0-21swapper/121:35:131
263549951,2cyclictest0-21swapper/120:40:101
263549950,5cyclictest0-21swapper/122:29:421
263549950,5cyclictest0-21swapper/122:14:091
263549950,5cyclictest0-21swapper/100:00:481
263539950,5cyclictest0-21swapper/022:27:460
263539950,5cyclictest0-21swapper/000:18:550
263659944,0cyclictest0-21swapper/323:01:223
263659944,0cyclictest0-21swapper/300:37:073
263659943,1cyclictest742-21fschecks_time21:15:143
263659943,1cyclictest29559-21wc21:45:183
263659943,1cyclictest25431-21/usr/sbin/munin22:00:153
263659943,1cyclictest25431-21/usr/sbin/munin22:00:153
263659943,1cyclictest14884-21tr19:50:103
263659942,1cyclictest808-21snmpd20:07:223
263659941,3cyclictest808-21snmpd21:40:583
263659941,3cyclictest56750irq/130-eth021:00:193
263659940,4cyclictest8011-21ssh23:28:583
263659940,4cyclictest7533-21apt-get22:40:013
263659940,4cyclictest24944-21ssh00:26:033
263659940,4cyclictest2456-21diskmemload22:37:043
263659940,4cyclictest0-21swapper/323:45:113
263659940,4cyclictest0-21swapper/323:22:383
263659940,4cyclictest0-21swapper/322:48:023
263659940,4cyclictest0-21swapper/322:10:023
263659940,4cyclictest0-21swapper/321:24:013
263659940,4cyclictest0-21swapper/321:10:123
263659940,4cyclictest0-21swapper/320:35:123
263659940,4cyclictest0-21swapper/320:00:223
263659940,4cyclictest0-21swapper/300:20:123
263659940,4cyclictest0-21swapper/300:10:133
263659940,3cyclictest5397-21ssh00:00:133
263659940,3cyclictest5170-21ssh22:05:283
263659940,3cyclictest4737-21apt-get19:30:123
263659940,3cyclictest4434-21rm22:54:433
263659940,3cyclictest31673-21sh00:30:113
263659940,3cyclictest28311-21memory23:55:153
263659940,3cyclictest27611-21sh23:38:533
263659940,3cyclictest27012-21/usr/sbin/munin20:15:133
263659940,3cyclictest25269-21sh23:05:113
263659940,3cyclictest23650-21hddtemp_smartct22:15:153
263659940,3cyclictest10203-21sh22:25:113
263659940,1cyclictest9696-21/usr/sbin/munin19:40:223
263659940,1cyclictest8356-21df21:35:143
263659940,1cyclictest6264-21tail21:50:183
263659940,1cyclictest29918-21/usr/sbin/munin23:40:143
263659940,1cyclictest2267-21/usr/sbin/munin19:25:203
263659940,1cyclictest2023-21/usr/sbin/munin20:30:153
263659940,1cyclictest17295-21/usr/sbin/munin23:50:173
263609944,0cyclictest0-21swapper/223:14:012
263609944,0cyclictest0-21swapper/220:36:252
263609944,0cyclictest0-21swapper/220:15:382
263609944,0cyclictest0-21swapper/200:27:132
263609943,1cyclictest479-21systemd-logind19:35:182
263609943,1cyclictest30163-21cpuspeed23:40:132
263609943,1cyclictest10501-21kworker/2:220:48:452
263609942,2cyclictest17787-21kworker/2:122:55:422
263609942,2cyclictest10501-21kworker/2:221:26:452
263609942,1cyclictest4614-21ssh00:00:112
263609942,1cyclictest23384-21ssh21:10:172
263609941,2cyclictest0-21swapper/220:25:142
263609940,4cyclictest24977-21ssh23:37:122
263609940,4cyclictest23839-21ssh23:04:262
263609940,4cyclictest21491-21ssh21:57:522
263609940,4cyclictest0-21swapper/223:50:152
263609940,4cyclictest0-21swapper/223:20:132
263609940,4cyclictest0-21swapper/223:06:522
263609940,4cyclictest0-21swapper/222:30:072
263609940,4cyclictest0-21swapper/222:20:112
263609940,4cyclictest0-21swapper/222:10:132
263609940,4cyclictest0-21swapper/222:05:022
263609940,4cyclictest0-21swapper/222:05:022
263609940,4cyclictest0-21swapper/221:40:122
263609940,4cyclictest0-21swapper/221:35:062
263609940,4cyclictest0-21swapper/221:15:122
263609940,4cyclictest0-21swapper/220:09:122
263609940,4cyclictest0-21swapper/200:30:112
263609940,4cyclictest0-21swapper/200:10:122
263609940,3cyclictest7796-21/usr/sbin/munin22:40:192
263609940,3cyclictest7507-21df_inode20:40:132
263609940,3cyclictest6042-21cut21:50:162
263609940,3cyclictest4877-21ssh23:26:592
263609940,3cyclictest12599-21sh00:20:162
263609940,3cyclictest0-21swapper/222:25:132
263609940,1cyclictest30303-21ssh21:30:142
263549944,0cyclictest0-21swapper/122:51:231
263549944,0cyclictest0-21swapper/100:33:591
263549944,0cyclictest0-21swapper/100:29:281
263549942,1cyclictest0-21swapper/120:00:141
263549941,3cyclictest0-21swapper/119:15:101
263549941,2cyclictest0-21swapper/123:55:111
263549941,2cyclictest0-21swapper/123:50:141
263549941,2cyclictest0-21swapper/123:35:121
263549941,2cyclictest0-21swapper/123:05:141
263549941,2cyclictest0-21swapper/121:55:121
263549941,2cyclictest0-21swapper/121:50:131
263549941,2cyclictest0-21swapper/121:40:131
263549941,2cyclictest0-21swapper/121:15:131
263549941,2cyclictest0-21swapper/121:10:121
263549941,2cyclictest0-21swapper/121:05:111
263549941,2cyclictest0-21swapper/120:45:111
263549941,2cyclictest0-21swapper/120:10:111
263549941,2cyclictest0-21swapper/119:45:141
263549941,2cyclictest0-21swapper/100:15:121
263549941,2cyclictest0-21swapper/100:10:121
263549941,2cyclictest0-21swapper/100:05:141
263549940,4cyclictest0-21swapper/122:56:371
263549940,4cyclictest0-21swapper/122:36:251
263549940,2cyclictest0-21swapper/123:20:131
263549940,2cyclictest0-21swapper/122:45:121
263549940,0cyclictest0-21swapper/100:24:561
263539944,0cyclictest0-21swapper/022:32:080
263539944,0cyclictest0-21swapper/021:31:110
263539942,2cyclictest8353-21kworker/0:120:40:130
263539942,1cyclictest22708-21ssh23:03:420
263539942,1cyclictest21755-21ssh00:25:120
263539941,2cyclictest808-21snmpd20:10:030
263539941,1cyclictest0-21swapper/023:55:100
263539941,1cyclictest0-21swapper/022:05:130
263539940,4cyclictest6781-21ntp_states21:50:210
263539940,4cyclictest3540-21perl23:10:150
263539940,4cyclictest32732-21apt-get22:20:120
263539940,4cyclictest29270-21munin-run20:20:000
263539940,4cyclictest10698-21df_inode23:30:120
263539940,4cyclictest0-21swapper/022:50:190
263539940,4cyclictest0-21swapper/021:11:040
263539940,4cyclictest0-21swapper/000:01:050
263539940,3cyclictest980-21ls00:30:190
263539940,3cyclictest9208-21ssh00:35:140
263539940,3cyclictest530-21irqstats20:25:170
263539940,3cyclictest405-21ssh22:35:460
263539940,3cyclictest31566-21users19:15:200
263539940,3cyclictest2789-21df19:25:140
263539940,3cyclictest27807-21ssh21:45:110
263539940,3cyclictest19451-21cat21:05:010
263539940,3cyclictest18366-21df_inode21:40:140
263539940,3cyclictest17884-21ssh23:50:150
263539940,3cyclictest17615-21gpg-connect-age22:45:010
263539940,3cyclictest1357-21ntp_states21:15:180
263539940,3cyclictest1066-21ntp_states19:20:190
263539940,1cyclictest29397-21sendmail-msp23:40:010
263539940,1cyclictest17270-21munin-run22:45:010
263539940,1cyclictest0-21swapper/021:55:220
263539940,0cyclictest0-21swapper/023:05:440
263539940,0cyclictest0-21swapper/022:15:070
20327240,0sleep10-21swapper/122:30:121
263659932,1cyclictest9818-21grep20:45:123
263659931,2cyclictest808-21snmpd19:35:003
263659931,2cyclictest17120-21aten2_r5power_c19:55:123
263659930,3cyclictest24522-21taskset20:10:033
263659930,3cyclictest0-21swapper/322:55:043
263659930,3cyclictest0-21swapper/321:25:133
263659930,3cyclictest0-21swapper/320:50:123
263659930,3cyclictest0-21swapper/319:45:153
263659930,3cyclictest0-21swapper/319:20:143
263659930,3cyclictest0-21swapper/319:10:123
263659930,2cyclictest149212df_inode20:55:153
263659930,2cyclictest0-21swapper/320:25:143
263609933,0cyclictest10501-21kworker/2:220:10:102
263609933,0cyclictest10501-21kworker/2:219:10:052
263609931,2cyclictest0-21swapper/223:45:102
263609931,1cyclictest29889-21ssh22:35:032
263609931,1cyclictest0-21swapper/219:20:142
263609930,3cyclictest29676-21sort20:20:122
263609930,3cyclictest2925-21apt-get22:05:122
263609930,3cyclictest29037-21hddtemp_smartct19:15:012
263609930,3cyclictest27623-21ssh22:50:012
263609930,3cyclictest27183-21aten2_r5power_p23:55:122
263609930,3cyclictest1838-21ssh00:15:102
263609930,3cyclictest0-21swapper/223:30:022
263609930,3cyclictest0-21swapper/222:15:112
263609930,3cyclictest0-21swapper/221:05:012
263609930,3cyclictest0-21swapper/221:00:122
263609930,3cyclictest0-21swapper/220:55:042
263609930,3cyclictest0-21swapper/220:50:122
263609930,3cyclictest0-21swapper/220:30:112
263609930,3cyclictest0-21swapper/220:00:132
263609930,3cyclictest0-21swapper/219:55:122
263609930,3cyclictest0-21swapper/219:50:102
263609930,3cyclictest0-21swapper/219:45:052
263609930,3cyclictest0-21swapper/219:40:132
263609930,3cyclictest0-21swapper/219:30:122
263609930,3cyclictest0-21swapper/219:25:052
263609930,2cyclictest12596-21ssh23:15:002
263549933,0cyclictest0-21swapper/122:23:441
263549932,1cyclictest0-21swapper/123:30:121
263549932,1cyclictest0-21swapper/119:10:121
263549931,1cyclictest0-21swapper/123:40:131
263549931,1cyclictest0-21swapper/123:25:121
263549931,1cyclictest0-21swapper/122:40:111
263549931,1cyclictest0-21swapper/122:00:141
263549931,1cyclictest0-21swapper/122:00:131
263549931,1cyclictest0-21swapper/121:48:021
263549931,1cyclictest0-21swapper/120:35:121
263549931,1cyclictest0-21swapper/120:25:151
263549931,1cyclictest0-21swapper/120:20:111
263549931,1cyclictest0-21swapper/120:05:111
263549931,1cyclictest0-21swapper/119:25:131
263549931,1cyclictest0-21swapper/119:20:131
263549930,2cyclictest290752sleep120:17:521
263549930,2cyclictest16188-21chrt00:38:311
263549930,2cyclictest0-21swapper/120:50:131
263549930,2cyclictest0-21swapper/119:50:091
263549930,1cyclictest0-21swapper/119:55:131
263549930,1cyclictest0-21swapper/119:40:131
263539932,1cyclictest808-21snmpd20:36:550
263539932,1cyclictest808-21snmpd19:52:330
263539932,1cyclictest7771-21cat23:45:130
263539931,1cyclictest14328-21ssh00:05:050
263539931,1cyclictest0-21swapper/019:35:110
263539930,3cyclictest9982-21diskstats20:45:130
263539930,3cyclictest6523-21if_eth422:55:160
263539930,3cyclictest3292-21ntp_states20:30:180
263539930,3cyclictest27009-21df19:10:140
263539930,3cyclictest20686-21memory20:00:190
263539930,3cyclictest17872-21irqstats21:00:170
263539930,3cyclictest10221-21df_inode19:40:160
263539930,3cyclictest0-21swapper/023:25:070
263539930,3cyclictest0-21swapper/022:00:020
263539930,3cyclictest0-21swapper/022:00:020
263539930,3cyclictest0-21swapper/021:35:130
263539930,3cyclictest0-21swapper/020:55:140
263539930,3cyclictest0-21swapper/020:20:100
263539930,3cyclictest0-21swapper/020:05:120
263539930,3cyclictest0-21swapper/019:55:120
263539930,3cyclictest0-21swapper/019:45:140
263539930,3cyclictest0-21swapper/019:30:000
263539930,3cyclictest0-21swapper/000:10:120
263539930,2cyclictest798-21runrttasks00:20:000
263539930,2cyclictest0-21swapper/021:20:030
263549921,1cyclictest0-21swapper/119:35:111
263549920,2cyclictest16876-21chrt21:00:071
263549920,1cyclictest0-21swapper/122:15:111
263549920,1cyclictest0-21swapper/121:25:121
263549920,1cyclictest0-21swapper/121:20:031
263549920,1cyclictest0-21swapper/120:30:111
263549920,1cyclictest0-21swapper/119:30:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional