You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 15:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Mon Nov 17, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1690599350,34cyclictest21789-21cron19:20:003
1690599340,28cyclictest0-21swapper/323:25:133
1690599310,30cyclictest0-21swapper/320:35:143
1690599300,29cyclictest303-21systemd-journal23:05:013
16896993027,2cyclictest22370-21cron20:30:001
1689699300,29cyclictest14499-21lockfile-create23:40:011
1689299300,29cyclictest25081-21cron21:45:000
1690599290,28cyclictest0-21swapper/320:45:123
1690599290,1cyclictest15366-21cron20:15:023
16901992926,2cyclictest23617-21sh22:50:002
16896992928,1cyclictest8693-21apt-get20:00:171
1689699290,1cyclictest28993-21munin-run00:10:021
16892992927,1cyclictest609-21dbus-daemon21:30:010
1689299290,1cyclictest1232-21munin-run00:20:010
1689299290,1cyclictest10725-21dump-pmu-power20:05:000
16905992828,0cyclictest0-21swapper/322:05:153
1690599280,0cyclictest0-21swapper/320:15:143
16901992827,1cyclictest25502-21sshd00:00:182
16896992828,0cyclictest0-21swapper/123:05:171
1689699280,27cyclictest0-21swapper/100:35:151
1689299280,28cyclictest0-21swapper/020:45:120
1689299280,27cyclictest14795-21apt-get23:40:120
1689299280,0cyclictest29252-21apt-get00:10:150
1689299280,0cyclictest20340-21apt-get20:25:140
16905992727,0cyclictest0-21swapper/319:40:023
1690599270,27cyclictest0-21swapper/321:20:153
1690599270,0cyclictest0-21swapper/321:45:023
16901992727,0cyclictest0-21swapper/223:50:132
16901992727,0cyclictest0-21swapper/221:30:132
16901992727,0cyclictest0-21swapper/220:15:142
16896992727,0cyclictest22665-21apt-get20:30:121
16896992727,0cyclictest0-21swapper/122:25:131
16896992727,0cyclictest0-21swapper/119:45:151
1689699270,0cyclictest0-21swapper/120:10:141
16892992727,0cyclictest16848-21apt-get22:35:130
16905992626,0cyclictest0-21swapper/300:10:163
16905992625,1cyclictest611-21avahi-daemon19:35:023
16905992624,1cyclictest6926-21cron22:15:013
16905992624,1cyclictest2839-21awk23:15:003
16901992626,0cyclictest28577-21apt-get23:00:132
16901992626,0cyclictest0-21swapper/222:00:142
16901992626,0cyclictest0-21swapper/220:00:162
16901992625,1cyclictest31570-21apt-get00:15:152
16896992626,0cyclictest7800-21apt-get23:25:141
16896992626,0cyclictest4899-21apt-get22:10:131
16896992626,0cyclictest0-21swapper/100:15:151
16896992624,1cyclictest303-21systemd-journal20:25:001
16892992626,0cyclictest0-21swapper/023:45:170
16892992626,0cyclictest0-21swapper/021:45:130
16905992525,0cyclictest0-21swapper/319:50:143
16905992525,0cyclictest0-21swapper/300:35:163
1690599250,25cyclictest0-21swapper/319:20:163
16901992525,0cyclictest22105-21apt-get19:20:122
16901992525,0cyclictest18051-21perf21:30:002
16901992525,0cyclictest0-21swapper/223:10:152
16901992525,0cyclictest0-21swapper/220:45:112
16901992525,0cyclictest0-21swapper/200:05:142
16901992523,1cyclictest303-21systemd-journal21:55:002
16896992525,0cyclictest4127-21apt-get00:25:131
16896992525,0cyclictest0-21swapper/121:10:141
16896992524,1cyclictest1500-21apt-get00:20:171
16892992525,0cyclictest14524-21apt-get22:30:150
16892992525,0cyclictest0-21swapper/023:00:130
16892992525,0cyclictest0-21swapper/022:40:120
16892992525,0cyclictest0-21swapper/022:10:140
16892992525,0cyclictest0-21swapper/021:25:010
16905992424,0cyclictest0-21swapper/322:00:153
16905992423,1cyclictest14258-21perf22:30:003
16901992424,0cyclictest21514-21apt-get23:55:012
16896992424,0cyclictest30327-21apt-get21:55:161
16896992424,0cyclictest0-21swapper/121:40:141
16896992423,1cyclictest32038-21apt-get20:50:141
16892992424,0cyclictest8995-21apt-get21:10:140
16892992424,0cyclictest5477-21apt-get23:20:130
16892992424,0cyclictest11318-21apt-get21:15:160
16905992323,0cyclictest0-21swapper/319:10:023
16905992320,3cyclictest0-21swapper/321:00:143
16901992323,0cyclictest0-21swapper/220:20:142
16901992323,0cyclictest0-21swapper/219:10:022
16896992323,0cyclictest0-21swapper/123:45:161
16896992323,0cyclictest0-21swapper/120:40:151
16896992323,0cyclictest0-21swapper/119:30:141
16892992323,0cyclictest0-21swapper/023:55:150
16892992323,0cyclictest0-21swapper/023:30:150
16892992323,0cyclictest0-21swapper/020:50:130
16905992222,0cyclictest0-21swapper/322:20:123
16905992220,1cyclictest16588-21munin-run22:35:003
16905992219,3cyclictest0-21swapper/323:20:133
1690599220,21cyclictest0-21swapper/300:05:143
16901992222,0cyclictest0-21swapper/223:40:132
16901992222,0cyclictest0-21swapper/223:30:162
16896992222,0cyclictest0-21swapper/122:35:131
16892992222,0cyclictest21525-21apt-get22:45:120
16905992121,0cyclictest0-21swapper/322:55:153
16905992121,0cyclictest0-21swapper/321:50:143
16905992120,1cyclictest6457-21apt-get00:30:183
16896992121,0cyclictest0-21swapper/122:50:141
1690599207,0cyclictest0-21swapper/320:06:093
16905992020,0cyclictest0-21swapper/323:15:143
16905992018,1cyclictest8481-21apt.systemd.dai21:07:543
16901992020,0cyclictest0-21swapper/222:25:122
16901992018,1cyclictest3761-21munin-run19:50:012
16905991919,0cyclictest0-21swapper/320:30:123
16905991919,0cyclictest0-21swapper/300:00:133
16905991915,3cyclictest0-21swapper/322:15:123
1690599190,18cyclictest0-21swapper/323:40:133
16901991919,0cyclictest0-21swapper/221:45:022
16901991919,0cyclictest0-21swapper/200:10:172
16901991917,1cyclictest1643-21cron20:55:012
16896991919,0cyclictest6946-21apt-get22:15:031
16896991919,0cyclictest31790-21apt-get19:40:161
16896991917,1cyclictest19454-21cron19:15:011
16892991919,0cyclictest0-21swapper/019:10:170
16905991818,0cyclictest0-21swapper/321:30:123
16901991818,0cyclictest0-21swapper/221:15:152
16896991818,0cyclictest11014-21apt-get20:05:161
16892991818,0cyclictest0-21swapper/022:50:140
16892991818,0cyclictest0-21swapper/020:55:120
16892991816,1cyclictest9558-21sh22:20:010
16905991717,0cyclictest0-21swapper/300:20:173
16905991713,3cyclictest0-21swapper/300:25:023
16901991715,1cyclictest609-21dbus-daemon20:00:002
16896991717,0cyclictest22707-21perf21:40:011
16896991717,0cyclictest0-21swapper/123:00:131
16896991716,1cyclictest19454-21apt-get23:50:131
1689299172,4cyclictest0-21swapper/020:30:130
16892991715,1cyclictest26670-21perf00:05:010
16905991616,0cyclictest0-21swapper/323:05:163
16905991616,0cyclictest0-21swapper/319:55:133
16905991614,1cyclictest0-21swapper/321:10:183
16901991616,0cyclictest0-21swapper/220:35:142
16901991616,0cyclictest0-21swapper/219:35:142
16901991616,0cyclictest0-21swapper/219:35:142
16901991614,1cyclictest7469-21echo22:15:012
16901991613,2cyclictest16547-21cron22:35:012
16896991616,0cyclictest15986-21apt-get21:25:151
16896991616,0cyclictest0-21swapper/123:55:141
16896991615,0cyclictest0-21swapper/121:45:131
16896991614,1cyclictest28308-21perf23:00:011
16892991616,0cyclictest0-21swapper/000:05:150
16892991614,1cyclictest24221-21perf19:25:000
16892991613,2cyclictest303-21systemd-journal22:10:010
1689299160,2cyclictest6980-21sed19:55:160
1689299160,15cyclictest2598-21memory19:45:190
16905991513,1cyclictest2998-21ntp_states20:55:173
1690599150,1cyclictest22258-21grep21:35:243
1690599150,1cyclictest0-21swapper/320:54:543
1690599150,15cyclictest0-21swapper/323:54:003
1690599150,15cyclictest0-21swapper/323:34:213
1690599150,14cyclictest0-21swapper/320:40:193
1690599150,14cyclictest0-21swapper/320:20:243
1690599150,14cyclictest0-21swapper/320:00:183
16901991515,0cyclictest0-21swapper/200:20:172
16901991514,0cyclictest0-21swapper/223:45:072
16901991514,0cyclictest0-21swapper/220:05:222
16901991513,1cyclictest31414-21cut23:05:182
16901991513,1cyclictest0-21swapper/222:50:192
16901991513,1cyclictest0-21swapper/222:25:002
16901991513,1cyclictest0-21swapper/221:05:152
1690199150,1cyclictest5214-21/usr/sbin/munin23:20:002
1690199150,1cyclictest28791-21timerandwakeup20:40:222
1690199150,14cyclictest0-21swapper/220:30:122
16896991515,0cyclictest0-21swapper/122:30:151
1689699150,1cyclictest3554-21head20:55:211
1689699150,1cyclictest29139-21apt-get19:35:141
1689699150,1cyclictest29139-21apt-get19:35:141
1689699150,14cyclictest0-21swapper/122:00:171
1689699150,14cyclictest0-21swapper/119:58:171
16892991515,0cyclictest12451-21apt-get23:35:130
16892991513,1cyclictest20281-21tune2fs19:15:140
16892991513,1cyclictest1860-21ntp_states23:10:210
1689299150,14cyclictest11462-21sed22:20:200
16905991414,0cyclictest0-21swapper/319:35:153
16905991414,0cyclictest0-21swapper/319:35:143
16905991413,1cyclictest0-21swapper/321:26:333
1690599140,14cyclictest0-21swapper/323:58:553
1690599140,14cyclictest0-21swapper/321:17:233
1690599140,14cyclictest0-21swapper/320:25:143
1690599140,14cyclictest0-21swapper/319:48:393
1690599140,14cyclictest0-21swapper/319:25:033
1690599140,0cyclictest0-21swapper/323:45:173
1690599140,0cyclictest0-21swapper/323:36:403
1690599140,0cyclictest0-21swapper/322:41:303
1690599140,0cyclictest0-21swapper/300:15:433
16901991414,0cyclictest0-21swapper/222:35:142
16901991414,0cyclictest0-21swapper/200:39:522
1690199140,14cyclictest0-21swapper/223:36:522
1690199140,14cyclictest0-21swapper/223:20:052
1690199140,14cyclictest0-21swapper/222:44:132
1690199140,14cyclictest0-21swapper/222:06:342
1690199140,14cyclictest0-21swapper/221:57:272
1690199140,14cyclictest0-21swapper/221:43:162
1690199140,14cyclictest0-21swapper/221:38:542
1690199140,14cyclictest0-21swapper/221:20:332
1690199140,14cyclictest0-21swapper/221:10:302
1690199140,14cyclictest0-21swapper/220:25:492
1690199140,14cyclictest0-21swapper/219:54:112
1690199140,14cyclictest0-21swapper/219:40:482
1690199140,14cyclictest0-21swapper/219:32:072
1690199140,14cyclictest0-21swapper/219:15:032
1690199140,14cyclictest0-21swapper/200:30:062
1690199140,0cyclictest0-21swapper/222:58:102
1690199140,0cyclictest0-21swapper/220:55:592
16896991414,0cyclictest0-21swapper/122:40:121
16896991414,0cyclictest0-21swapper/121:19:201
16896991414,0cyclictest0-21swapper/121:05:141
16896991414,0cyclictest0-21swapper/121:00:231
16896991414,0cyclictest0-21swapper/119:20:121
16896991414,0cyclictest0-21swapper/100:30:291
16896991414,0cyclictest0-21swapper/100:01:551
1689699140,14cyclictest0-21swapper/123:41:051
1689699140,14cyclictest0-21swapper/123:20:141
1689699140,14cyclictest0-21swapper/123:14:081
1689699140,14cyclictest0-21swapper/122:48:411
1689699140,14cyclictest0-21swapper/122:20:041
1689699140,14cyclictest0-21swapper/121:33:501
1689699140,14cyclictest0-21swapper/121:20:041
1689699140,14cyclictest0-21swapper/119:15:011
1689699140,0cyclictest4019-21apt-get19:50:151
1689699140,0cyclictest0-21swapper/123:30:211
1689699140,0cyclictest0-21swapper/123:18:151
1689699140,0cyclictest0-21swapper/121:54:001
1689699140,0cyclictest0-21swapper/120:45:051
1689699140,0cyclictest0-21swapper/120:35:141
1689699140,0cyclictest0-21swapper/120:17:101
1689699140,0cyclictest0-21swapper/119:25:121
1689699140,0cyclictest0-21swapper/100:12:201
16892991414,0cyclictest0-21swapper/020:20:060
16892991414,0cyclictest0-21swapper/019:50:150
16892991414,0cyclictest0-21swapper/000:35:280
16892991414,0cyclictest0-21swapper/000:30:030
1689299140,14cyclictest8003-21find21:05:210
1689299140,14cyclictest0-21swapper/023:25:580
1689299140,14cyclictest0-21swapper/023:16:050
1689299140,14cyclictest0-21swapper/022:00:580
1689299140,14cyclictest0-21swapper/021:58:000
1689299140,14cyclictest0-21swapper/021:50:090
1689299140,14cyclictest0-21swapper/021:31:050
1689299140,14cyclictest0-21swapper/020:16:060
1689299140,14cyclictest0-21swapper/019:41:080
1689299140,14cyclictest0-21swapper/019:36:100
1689299140,14cyclictest0-21swapper/019:36:100
1689299140,14cyclictest0-21swapper/019:30:040
1689299140,14cyclictest0-21swapper/000:28:520
1689299140,14cyclictest0-21swapper/000:22:000
1689299140,0cyclictest0-21swapper/023:51:100
1689299140,0cyclictest0-21swapper/023:05:170
1689299140,0cyclictest0-21swapper/022:58:370
1689299140,0cyclictest0-21swapper/022:26:550
1689299140,0cyclictest0-21swapper/021:01:260
1689299140,0cyclictest0-21swapper/020:43:370
1689299140,0cyclictest0-21swapper/020:37:340
1689299140,0cyclictest0-21swapper/020:11:000
1689299140,0cyclictest0-21swapper/019:25:250
16905991313,0cyclictest0-21swapper/322:51:443
16905991313,0cyclictest0-21swapper/322:45:063
16905991313,0cyclictest0-21swapper/322:40:013
16905991313,0cyclictest0-21swapper/321:56:293
1690599130,13cyclictest0-21swapper/321:41:173
16901991313,0cyclictest0-21swapper/223:25:382
16901991313,0cyclictest0-21swapper/220:10:092
1690199130,0cyclictest0-21swapper/222:10:312
1690199130,0cyclictest0-21swapper/221:00:122
16896991313,0cyclictest0-21swapper/122:05:311
16892991313,0cyclictest0-21swapper/021:35:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional