You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-13 - 04:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Tue May 13, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2695399300,29cyclictest16817-21idleruntime-cro22:15:002
26952993028,1cyclictest609-21dbus-daemon20:35:001
26951993028,1cyclictest26632-21cron23:45:010
2695199300,29cyclictest3004-21cron22:55:000
26954992927,1cyclictest27414-21cron20:20:013
26953992928,1cyclictest5951-21apt-get23:00:162
26953992928,1cyclictest17626-21apt-get23:25:152
26953992927,1cyclictest5422-21apt-get21:50:112
2695399290,1cyclictest8505-21munin-run19:40:022
2695299290,28cyclictest0-21swapper/119:45:131
2695199290,28cyclictest0-21swapper/019:50:150
2695199290,28cyclictest0-21swapper/000:15:140
26954992828,0cyclictest0-21swapper/321:35:143
26954992826,1cyclictest303-21systemd-journal19:25:013
2695499280,27cyclictest12906-21apt-get23:15:163
2695499280,27cyclictest0-21swapper/300:25:153
26953992828,0cyclictest13252-21apt-get00:25:152
26953992828,0cyclictest0-21swapper/222:50:132
26953992826,2cyclictest28274-21munin-run21:30:002
26953992825,2cyclictest303-21systemd-journal23:40:002
2695399280,28cyclictest0-21swapper/200:10:152
26952992828,0cyclictest0-21swapper/122:40:131
2695299280,28cyclictest0-21swapper/123:50:131
2695299280,28cyclictest0-21swapper/119:30:131
2695299280,0cyclictest0-21swapper/123:10:151
26951992828,0cyclictest8268-21apt-get23:05:150
2695199280,0cyclictest0-21swapper/021:05:140
2695199280,0cyclictest0-21swapper/020:05:130
26954992727,0cyclictest27730-21apt-get20:20:143
26954992727,0cyclictest17100-21apt-get22:15:133
26954992727,0cyclictest0-21swapper/323:40:133
26954992727,0cyclictest0-21swapper/321:25:013
26954992727,0cyclictest0-21swapper/320:50:143
26954992726,1cyclictest22268-21apt-get23:35:163
26954992725,1cyclictest0-21swapper/321:05:013
2695499270,27cyclictest0-21swapper/319:55:123
2695499270,0cyclictest0-21swapper/300:10:153
26953992727,0cyclictest0-21swapper/223:40:132
26953992727,0cyclictest0-21swapper/221:15:022
2695399270,0cyclictest29529-21apt-get19:15:152
2695399270,0cyclictest0-21swapper/222:40:132
26952992727,0cyclictest0-21swapper/122:35:141
26952992727,0cyclictest0-21swapper/122:10:161
26952992727,0cyclictest0-21swapper/119:50:151
26952992727,0cyclictest0-21swapper/119:25:121
26951992727,0cyclictest0-21swapper/023:50:130
26951992727,0cyclictest0-21swapper/022:10:150
26951992727,0cyclictest0-21swapper/021:20:130
26951992725,1cyclictest697-21munin-run22:50:000
26954992626,0cyclictest0-21swapper/322:55:133
26954992626,0cyclictest0-21swapper/320:55:113
26954992626,0cyclictest0-21swapper/320:55:113
26954992624,1cyclictest0-21swapper/319:35:013
26953992626,0cyclictest10791-21apt-get19:45:012
26953992626,0cyclictest0-21swapper/222:05:142
26953992626,0cyclictest0-21swapper/221:35:142
26953992626,0cyclictest0-21swapper/221:00:002
26953992626,0cyclictest0-21swapper/221:00:002
26953992626,0cyclictest0-21swapper/200:00:152
26952992626,0cyclictest15304-21apt-get23:20:151
26951992626,0cyclictest0-21swapper/021:25:120
26954992525,0cyclictest0-21swapper/323:00:163
26954992525,0cyclictest0-21swapper/300:20:153
26953992525,0cyclictest0-21swapper/221:10:122
26952992525,0cyclictest4619-21apt-get20:40:131
26952992525,0cyclictest0-21swapper/120:45:141
26951992525,0cyclictest0-21swapper/022:35:140
26951992525,0cyclictest0-21swapper/021:45:130
26951992525,0cyclictest0-21swapper/021:40:130
26954992424,0cyclictest0-21swapper/319:25:123
26953992424,0cyclictest0-21swapper/223:15:172
26951992424,0cyclictest27207-21apt-get19:10:120
26951992424,0cyclictest0-21swapper/021:10:120
26951992424,0cyclictest0-21swapper/020:25:150
26951992423,1cyclictest0-21swapper/020:00:140
26954992323,0cyclictest0-21swapper/323:45:133
26954992321,1cyclictest0-21swapper/322:10:003
26954992321,1cyclictest0-21swapper/300:10:013
26953992323,0cyclictest10586-21apt-get23:10:152
26953992323,0cyclictest0-21swapper/222:45:132
26953992322,1cyclictest6675-21perf20:45:002
26952992323,0cyclictest24083-21apt-get22:30:131
26952992323,0cyclictest0-21swapper/121:00:111
26952992323,0cyclictest0-21swapper/120:25:151
26952992323,0cyclictest0-21swapper/119:25:021
26952992323,0cyclictest0-21swapper/100:10:161
26951992323,0cyclictest6420-21apt-get19:35:130
26951992323,0cyclictest0-21swapper/022:30:140
26951992323,0cyclictest0-21swapper/021:50:110
26951992323,0cyclictest0-21swapper/021:00:120
26951992323,0cyclictest0-21swapper/020:45:150
26954992222,0cyclictest14782-21apt-get22:10:143
26954992219,2cyclictest21972-21sh23:35:003
26953992222,0cyclictest10085-21apt-get22:00:122
26953992220,1cyclictest0-21swapper/200:00:022
26952992222,0cyclictest0-21swapper/122:45:131
26952992222,0cyclictest0-21swapper/122:00:121
26952992222,0cyclictest0-21swapper/119:35:131
26951992222,0cyclictest0-21swapper/022:00:130
26954992120,0cyclictest1586-21apt-get00:00:143
26953992121,0cyclictest0-21swapper/222:15:142
26953992121,0cyclictest0-21swapper/219:25:122
26953992120,0cyclictest0-21swapper/223:45:132
26952992121,0cyclictest0-21swapper/123:55:131
26952992119,1cyclictest626-21gdbus21:55:011
26951992121,0cyclictest0-21swapper/019:40:130
26951992120,1cyclictest0-21swapper/020:30:140
2695499204,12cyclictest123932sleep319:45:203
26954992020,0cyclictest970-21apt-get22:50:133
26954992020,0cyclictest28754-21apt-get22:40:133
26953992019,1cyclictest3602-21apt-get22:55:132
26952992018,1cyclictest0-21swapper/121:15:011
26951992020,0cyclictest0-21swapper/023:55:130
26951992020,0cyclictest0-21swapper/023:25:150
26951992020,0cyclictest0-21swapper/022:40:130
26951992020,0cyclictest0-21swapper/000:30:150
26954991919,0cyclictest0-21swapper/321:50:103
26953991919,0cyclictest30053-21apt-get20:25:152
26953991919,0cyclictest0-21swapper/200:20:142
26952991919,0cyclictest0-21swapper/123:25:141
26953991818,0cyclictest0-21swapper/221:20:132
26953991817,1cyclictest20481-21perf20:05:012
26953991815,2cyclictest10301-21cron23:10:012
26953991717,0cyclictest768-21apt-get21:40:132
26952991717,0cyclictest0-21swapper/121:40:131
26952991716,1cyclictest22803-21perf20:10:021
26952991715,1cyclictest15362-21munin-run00:30:011
26952991715,1cyclictest0-21swapper/123:05:001
26951991717,0cyclictest0-21swapper/021:55:150
26954991616,0cyclictest2280-21apt-get20:35:153
26954991613,2cyclictest11218-21head22:00:183
2695499160,15cyclictest3719-21sed21:45:173
26953991616,0cyclictest31875-21apt-get19:20:162
26953991616,0cyclictest21764-21apt-get22:25:152
26953991616,0cyclictest0-21swapper/223:20:142
26953991616,0cyclictest0-21swapper/219:50:152
26953991614,1cyclictest21549-21munin-run22:25:012
2695399160,15cyclictest28494-21perf22:40:012
26952991616,0cyclictest3951-21apt-get00:05:141
26952991614,1cyclictest0-21swapper/121:20:161
26952991614,1cyclictest0-21swapper/120:10:201
26952991614,1cyclictest0-21swapper/120:10:191
26952991613,2cyclictest19624-21grep22:20:131
2695299160,15cyclictest4610-21grep22:55:171
26951991616,0cyclictest0-21swapper/023:20:150
2695199160,15cyclictest22881-21grep23:35:180
26954991513,1cyclictest0-21swapper/320:30:003
2695499150,1cyclictest7679-21modprobe20:45:183
2695499150,1cyclictest0-21swapper/322:25:193
2695499150,1cyclictest0-21swapper/321:10:143
2695499150,1cyclictest0-21swapper/319:50:243
2695499150,14cyclictest0-21swapper/320:40:193
2695499150,14cyclictest0-21swapper/300:30:183
26953991512,2cyclictest10324-21sed19:40:222
2695399150,1cyclictest0-21swapper/200:15:162
2695399150,14cyclictest6146-21turbostat.cron19:35:012
2695399150,14cyclictest0-21swapper/220:40:002
26952991513,1cyclictest30184-21users21:30:221
26952991513,1cyclictest0-21swapper/120:20:201
2695299150,1cyclictest0-21swapper/119:40:191
2695199155,7cyclictest4592-21/usr/sbin/munin00:05:170
2695199154,4cyclictest15094-21perf23:20:010
26951991515,0cyclictest0-21swapper/019:45:130
2695199150,1cyclictest303-21systemd-journal20:20:010
2695199150,1cyclictest0-21swapper/022:25:170
2695199150,1cyclictest0-21swapper/020:55:140
2695199150,1cyclictest0-21swapper/020:55:140
26954991414,0cyclictest31075-21apt-get22:45:133
26954991412,1cyclictest23303-21munin-run21:20:003
26954991412,1cyclictest0-21swapper/319:35:223
2695499140,14cyclictest24807-21ps21:20:213
2695499140,14cyclictest0-21swapper/323:26:503
2695499140,14cyclictest0-21swapper/323:20:573
2695499140,14cyclictest0-21swapper/323:06:273
2695499140,14cyclictest0-21swapper/322:35:203
2695499140,14cyclictest0-21swapper/321:56:443
2695499140,14cyclictest0-21swapper/321:42:473
2695499140,14cyclictest0-21swapper/321:32:223
2695499140,14cyclictest0-21swapper/321:05:183
2695499140,14cyclictest0-21swapper/320:32:343
2695499140,14cyclictest0-21swapper/320:09:503
2695499140,14cyclictest0-21swapper/319:40:133
2695499140,14cyclictest0-21swapper/319:15:393
2695499140,14cyclictest0-21swapper/319:11:333
2695499140,14cyclictest0-21swapper/300:35:143
2695499140,14cyclictest0-21swapper/300:15:213
2695499140,10cyclictest0-21swapper/322:20:283
2695499140,0cyclictest24083-21apt-get22:30:133
2695499140,0cyclictest0-21swapper/323:51:423
2695499140,0cyclictest0-21swapper/323:10:063
2695499140,0cyclictest0-21swapper/320:01:083
26953991412,1cyclictest29255-21apt-get23:50:132
2695399140,14cyclictest0-21swapper/223:30:202
2695399140,14cyclictest0-21swapper/222:30:132
2695399140,14cyclictest0-21swapper/221:55:452
2695399140,14cyclictest0-21swapper/221:49:502
2695399140,14cyclictest0-21swapper/221:34:142
2695399140,14cyclictest0-21swapper/221:06:572
2695399140,14cyclictest0-21swapper/221:02:462
2695399140,14cyclictest0-21swapper/220:17:182
2695399140,14cyclictest0-21swapper/219:55:072
2695399140,14cyclictest0-21swapper/200:36:102
2695399140,14cyclictest0-21swapper/200:31:332
2695399140,14cyclictest0-21swapper/200:05:202
2695399140,0cyclictest0-21swapper/220:06:122
2695399140,0cyclictest0-21swapper/219:12:562
26952991414,0cyclictest0-21swapper/123:31:131
26952991414,0cyclictest0-21swapper/122:50:151
26952991414,0cyclictest0-21swapper/121:45:091
26952991414,0cyclictest0-21swapper/100:30:151
2695299140,14cyclictest0-21swapper/123:43:231
2695299140,14cyclictest0-21swapper/123:37:121
2695299140,14cyclictest0-21swapper/123:17:531
2695299140,14cyclictest0-21swapper/122:25:301
2695299140,14cyclictest0-21swapper/122:07:261
2695299140,14cyclictest0-21swapper/121:17:231
2695299140,14cyclictest0-21swapper/120:52:571
2695299140,14cyclictest0-21swapper/120:36:451
2695299140,14cyclictest0-21swapper/120:15:181
2695299140,14cyclictest0-21swapper/120:01:561
2695299140,14cyclictest0-21swapper/119:11:251
2695299140,14cyclictest0-21swapper/100:35:581
2695299140,14cyclictest0-21swapper/100:15:221
2695299140,0cyclictest0-21swapper/123:05:021
2695299140,0cyclictest0-21swapper/122:15:211
2695299140,0cyclictest0-21swapper/121:56:401
2695299140,0cyclictest0-21swapper/121:37:011
2695299140,0cyclictest0-21swapper/121:29:451
2695299140,0cyclictest0-21swapper/121:06:261
2695299140,0cyclictest0-21swapper/119:55:361
2695299140,0cyclictest0-21swapper/100:21:251
26951991414,0cyclictest0-21swapper/023:31:360
26951991414,0cyclictest0-21swapper/021:38:400
26951991414,0cyclictest0-21swapper/021:17:040
2695199140,14cyclictest0-21swapper/023:11:300
2695199140,14cyclictest0-21swapper/020:53:220
2695199140,14cyclictest0-21swapper/020:40:150
2695199140,14cyclictest0-21swapper/020:37:000
2695199140,14cyclictest0-21swapper/020:12:240
2695199140,14cyclictest0-21swapper/020:12:240
2695199140,14cyclictest0-21swapper/019:58:540
2695199140,14cyclictest0-21swapper/019:30:220
2695199140,14cyclictest0-21swapper/019:27:560
2695199140,14cyclictest0-21swapper/019:15:380
2695199140,14cyclictest0-21swapper/000:35:570
2695199140,14cyclictest0-21swapper/000:21:300
2695199140,14cyclictest0-21swapper/000:12:020
2695199140,0cyclictest31875-21apt-get19:20:160
2695199140,0cyclictest0-21swapper/022:21:290
2695199140,0cyclictest0-21swapper/022:15:120
2695199140,0cyclictest0-21swapper/022:07:100
2695199140,0cyclictest0-21swapper/020:20:190
2695199140,0cyclictest0-21swapper/000:27:300
26954991313,0cyclictest0-21swapper/323:55:243
26954991313,0cyclictest0-21swapper/320:11:243
26954991313,0cyclictest0-21swapper/320:11:243
26953991313,0cyclictest0-21swapper/220:51:232
26953991313,0cyclictest0-21swapper/220:20:182
26953991311,1cyclictest0-21swapper/220:45:212
2695399130,0cyclictest0-21swapper/220:10:342
2695399130,0cyclictest0-21swapper/220:10:342
26952991313,0cyclictest0-21swapper/123:46:021
26952991313,0cyclictest0-21swapper/120:57:131
26952991313,0cyclictest0-21swapper/120:57:131
26952991313,0cyclictest0-21swapper/119:15:061
26952991313,0cyclictest0-21swapper/100:01:561
26951991313,0cyclictest0-21swapper/021:31:090
26951991313,0cyclictest0-21swapper/000:01:270
26951991212,0cyclictest0-21swapper/023:48:160
26951991212,0cyclictest0-21swapper/023:02:520
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional