You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 08:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Tue Nov 18, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1163399310,30cyclictest31407-21cron22:10:013
11630993027,3cyclictest0-21swapper/023:00:140
11630993027,2cyclictest303-21systemd-journal00:25:010
1163399290,28cyclictest0-21swapper/323:15:133
11632992928,0cyclictest31703-21apt-get22:10:132
11632992927,1cyclictest10402-21apt-get20:15:132
1163299290,28cyclictest31229-21munin-run00:25:012
1163299290,28cyclictest0-21swapper/223:35:122
1163299290,28cyclictest0-21swapper/223:15:142
1163299290,28cyclictest0-21swapper/220:20:122
1163299290,1cyclictest31420-21cron22:10:002
1163299290,1cyclictest0-21swapper/222:30:012
1163199290,28cyclictest5159-21apt-get20:05:141
1163199290,28cyclictest31418-21awk22:10:011
1163199290,28cyclictest1352-21apt-get21:05:131
1163099290,28cyclictest3698-21munin-run22:20:010
1163099290,28cyclictest25655-21perf19:40:010
1163099290,1cyclictest16221-21apt-get22:45:170
1163099290,1cyclictest15928-21awk22:45:010
11633992828,0cyclictest0-21swapper/320:20:133
11633992827,1cyclictest0-21swapper/322:10:123
11632992828,0cyclictest0-21swapper/200:30:132
11632992827,0cyclictest0-21swapper/222:40:162
11632992826,1cyclictest18541-21apt-get22:50:122
11631992828,0cyclictest0-21swapper/123:15:141
11631992827,0cyclictest25335-21munin-run23:05:011
1163199280,27cyclictest7784-21apt-get20:10:141
11630992828,0cyclictest31454-21apt-get21:00:140
11630992828,0cyclictest0-21swapper/023:25:150
11630992825,2cyclictest303-21systemd-journal00:40:010
11630992825,2cyclictest303-21systemd-journal00:40:000
1163099280,28cyclictest0-21swapper/023:35:120
1163099280,0cyclictest4261-21apt-get22:20:120
1163099280,0cyclictest0-21swapper/000:25:140
11633992727,0cyclictest0-21swapper/320:15:143
11633992727,0cyclictest0-21swapper/300:30:133
11633992726,1cyclictest0-21swapper/322:40:163
1163399270,27cyclictest0-21swapper/300:25:003
1163299270,27cyclictest0-21swapper/219:50:152
1163299270,0cyclictest0-21swapper/223:05:002
11631992727,0cyclictest7140-21apt-get23:35:121
11631992727,0cyclictest12760-21apt-get20:20:131
1163199270,0cyclictest0-21swapper/100:15:141
11630992727,0cyclictest16810-21apt-get23:55:020
11630992727,0cyclictest0-21swapper/020:15:140
11630992727,0cyclictest0-21swapper/020:10:030
11630992725,2cyclictest0-21swapper/000:10:120
1163099270,0cyclictest0-21swapper/020:40:120
11633992625,1cyclictest31485-21apt-get00:25:143
11633992624,2cyclictest29960-21sh23:15:003
11632992626,0cyclictest0-21swapper/223:45:132
11632992626,0cyclictest0-21swapper/219:40:162
11631992626,0cyclictest0-21swapper/122:40:151
11631992626,0cyclictest0-21swapper/122:10:131
11631992626,0cyclictest0-21swapper/120:15:141
11631992626,0cyclictest0-21swapper/119:50:151
11631992626,0cyclictest0-21swapper/100:30:131
11630992626,0cyclictest8358-21apt-get21:20:130
11630992626,0cyclictest0-21swapper/020:45:130
11630992626,0cyclictest0-21swapper/020:20:130
11630992626,0cyclictest0-21swapper/019:40:150
11630992625,1cyclictest12122-21apt-get23:45:130
11633992525,0cyclictest0-21swapper/323:45:133
11633992525,0cyclictest0-21swapper/322:50:133
11633992525,0cyclictest0-21swapper/322:15:163
11633992525,0cyclictest0-21swapper/319:40:163
11633992525,0cyclictest0-21swapper/319:30:123
11633992524,0cyclictest2493-21apt-get23:25:163
11632992525,0cyclictest4032-21apt-get00:35:162
11632992525,0cyclictest4032-21apt-get00:35:162
11632992525,0cyclictest0-21swapper/223:25:162
11632992525,0cyclictest0-21swapper/222:15:172
11632992525,0cyclictest0-21swapper/219:30:132
11632992525,0cyclictest0-21swapper/200:25:142
11632992524,1cyclictest609-21dbus-daemon23:15:012
11631992524,1cyclictest25937-21apt-get19:40:161
11631992524,1cyclictest1608-21apt-get22:15:171
11631992523,1cyclictest29959-21basename23:15:011
11630992525,0cyclictest2834-21apt-get20:00:140
11630992525,0cyclictest0-21swapper/021:10:150
11633992424,0cyclictest0-21swapper/320:10:153
11633992424,0cyclictest0-21swapper/300:35:163
11633992424,0cyclictest0-21swapper/300:35:163
11633992422,1cyclictest20939-21perf19:30:003
11632992424,0cyclictest0-21swapper/220:10:142
11631992424,0cyclictest0-21swapper/123:45:121
11631992424,0cyclictest0-21swapper/122:50:131
11631992424,0cyclictest0-21swapper/119:30:131
11631992424,0cyclictest0-21swapper/100:25:141
11630992424,0cyclictest0-21swapper/021:45:120
11630992424,0cyclictest0-21swapper/021:05:130
11630992424,0cyclictest0-21swapper/020:55:160
11630992423,0cyclictest0-21swapper/022:30:130
11633992323,0cyclictest6587-21apt-get22:25:143
11633992323,0cyclictest0-21swapper/323:00:143
11633992323,0cyclictest0-21swapper/319:50:153
11633992322,0cyclictest0-21swapper/323:55:133
11632992323,0cyclictest0-21swapper/221:10:152
11632992322,1cyclictest30313-21perf19:50:012
11631992323,0cyclictest0-21swapper/123:25:161
11631992323,0cyclictest0-21swapper/100:35:161
11631992323,0cyclictest0-21swapper/100:35:161
11631992321,2cyclictest20950-21munin-run19:30:011
11631992321,1cyclictest17376-21apt-get23:55:131
1163199230,22cyclictest5732-21latency_hist21:15:011
11630992323,0cyclictest0-21swapper/023:10:130
11630992323,0cyclictest0-21swapper/019:15:130
11633992222,0cyclictest0-21swapper/321:10:163
11633992222,0cyclictest0-21swapper/319:50:013
11633992222,0cyclictest0-21swapper/319:20:153
11633992221,1cyclictest20008-21apt-get21:45:113
11632992222,0cyclictest16560-21apt-get19:20:142
11632992222,0cyclictest0-21swapper/223:55:122
11632992222,0cyclictest0-21swapper/219:30:012
11631992222,0cyclictest0-21swapper/122:25:141
11630992222,0cyclictest0-21swapper/021:40:120
11633992121,0cyclictest0-21swapper/320:25:123
11633992120,1cyclictest0-21swapper/323:50:163
11632992121,0cyclictest9792-21apt-get23:40:172
11632992121,0cyclictest0-21swapper/223:50:162
11632992121,0cyclictest0-21swapper/221:45:112
11632992121,0cyclictest0-21swapper/220:30:122
11632992121,0cyclictest0-21swapper/220:25:132
11632992119,1cyclictest0-21swapper/221:45:012
11631992121,0cyclictest0-21swapper/119:20:151
11630992121,0cyclictest0-21swapper/019:10:140
11630992120,1cyclictest19809-21apt-get00:00:130
11633992020,0cyclictest23535-21apt-get19:35:143
11633992020,0cyclictest0-21swapper/323:40:173
11633992020,0cyclictest0-21swapper/320:30:113
11633992020,0cyclictest0-21swapper/300:15:133
11632992020,0cyclictest0-21swapper/219:35:142
11632992020,0cyclictest0-21swapper/200:15:142
11631992020,0cyclictest15086-21apt-get20:25:131
11631992020,0cyclictest0-21swapper/121:45:101
11631992020,0cyclictest0-21swapper/119:50:011
11630992020,0cyclictest30579-21apt-get19:50:130
11630992020,0cyclictest26784-21apt-get20:50:120
11630992020,0cyclictest0-21swapper/019:20:150
11633991919,0cyclictest0-21swapper/323:35:123
11633991918,1cyclictest0-21swapper/322:45:173
11633991918,0cyclictest0-21swapper/321:45:013
11632991918,1cyclictest0-21swapper/222:45:172
11631991919,0cyclictest14752-21apt-get23:50:151
11631991919,0cyclictest0-21swapper/123:40:171
11631991919,0cyclictest0-21swapper/120:30:121
11631991919,0cyclictest0-21swapper/119:35:141
11631991817,1cyclictest19752-21perf21:45:011
11631991816,1cyclictest11887-21apt-get19:10:131
11630991818,0cyclictest0-21swapper/022:10:130
11633991717,0cyclictest0-21swapper/319:10:143
11632991717,0cyclictest0-21swapper/219:10:142
11632991716,1cyclictest0-21swapper/221:05:002
11631991717,0cyclictest0-21swapper/122:45:161
11630991717,0cyclictest0-21swapper/022:00:000
11630991717,0cyclictest0-21swapper/021:50:150
11630991713,3cyclictest17412-21apt-get20:30:120
11633991616,0cyclictest0-21swapper/320:55:163
11633991615,1cyclictest24714-21apt-get21:55:143
1163299166,9cyclictest20161-21snmpd22:56:282
11632991616,0cyclictest22169-21apt-get00:05:122
11632991616,0cyclictest0-21swapper/221:55:132
11632991616,0cyclictest0-21swapper/220:55:162
11632991614,1cyclictest0-21swapper/200:10:162
11631991615,1cyclictest29111-21apt-get20:55:151
11630991616,0cyclictest21209-21apt-get19:30:130
11630991614,1cyclictest0-21swapper/022:00:180
1163099160,0cyclictest0-21swapper/021:38:370
11633991515,0cyclictest0-21swapper/321:05:003
11633991515,0cyclictest0-21swapper/300:05:133
1163399150,1cyclictest22716-21grep20:40:153
11632991513,1cyclictest0-21swapper/221:55:002
11632991512,2cyclictest1618-21timerandwakeup23:20:222
1163299150,1cyclictest0-21swapper/220:46:572
11631991514,1cyclictest1085-21perf21:04:591
1163199150,1cyclictest27858-21irqstats22:00:161
1163199150,1cyclictest22720-21head20:40:151
1163199150,14cyclictest0-21swapper/120:46:571
11630991513,1cyclictest31280-21ntp_states23:15:200
1163099150,15cyclictest0-21swapper/022:54:320
1163099150,15cyclictest0-21swapper/019:46:300
1163099150,0cyclictest0-21swapper/021:19:140
11633991414,0cyclictest0-21swapper/323:09:103
11633991414,0cyclictest0-21swapper/321:20:123
11633991414,0cyclictest0-21swapper/320:05:543
11633991413,1cyclictest32549-21/usr/sbin/munin23:20:223
11633991412,1cyclictest0-21swapper/320:35:223
1163399140,14cyclictest0-21swapper/323:30:433
1163399140,14cyclictest0-21swapper/322:35:273
1163399140,14cyclictest0-21swapper/322:20:393
1163399140,14cyclictest0-21swapper/322:01:373
1163399140,14cyclictest0-21swapper/321:32:163
1163399140,14cyclictest0-21swapper/320:50:533
1163399140,14cyclictest0-21swapper/320:45:273
1163399140,14cyclictest0-21swapper/320:01:513
1163399140,14cyclictest0-21swapper/319:15:483
1163399140,14cyclictest0-21swapper/300:10:073
1163399140,0cyclictest0-21swapper/322:57:253
1163399140,0cyclictest0-21swapper/322:30:153
1163399140,0cyclictest0-21swapper/321:51:253
1163399140,0cyclictest0-21swapper/321:37:253
1163399140,0cyclictest0-21swapper/321:25:123
1163399140,0cyclictest0-21swapper/321:18:593
1163399140,0cyclictest0-21swapper/321:07:003
1163399140,0cyclictest0-21swapper/319:55:323
1163399140,0cyclictest0-21swapper/300:02:533
11632991414,0cyclictest0-21swapper/220:01:432
11632991413,1cyclictest6748-21modprobe21:15:152
1163299140,14cyclictest0-21swapper/223:30:092
1163299140,14cyclictest0-21swapper/223:05:292
1163299140,14cyclictest0-21swapper/222:35:272
1163299140,14cyclictest0-21swapper/222:24:542
1163299140,14cyclictest0-21swapper/222:01:472
1163299140,14cyclictest0-21swapper/221:36:582
1163299140,14cyclictest0-21swapper/221:20:062
1163299140,14cyclictest0-21swapper/221:06:042
1163299140,14cyclictest0-21swapper/220:50:442
1163299140,14cyclictest0-21swapper/220:41:042
1163299140,14cyclictest0-21swapper/220:38:262
1163299140,14cyclictest0-21swapper/220:05:542
1163299140,14cyclictest0-21swapper/219:55:492
1163299140,14cyclictest0-21swapper/219:18:172
1163299140,14cyclictest0-21swapper/200:01:472
1163299140,0cyclictest0-21swapper/221:32:162
11631991414,0cyclictest0-21swapper/123:30:431
11631991414,0cyclictest0-21swapper/122:35:501
11631991414,0cyclictest0-21swapper/122:30:151
11631991414,0cyclictest0-21swapper/121:55:141
11631991414,0cyclictest0-21swapper/121:20:141
11631991414,0cyclictest0-21swapper/119:15:471
11631991414,0cyclictest0-21swapper/100:20:071
11631991414,0cyclictest0-21swapper/100:10:081
11631991414,0cyclictest0-21swapper/100:05:131
11631991413,0cyclictest0-21swapper/123:20:221
11631991412,1cyclictest13013-21apt-get21:30:121
1163199140,14cyclictest0-21swapper/123:08:031
1163199140,14cyclictest0-21swapper/122:56:001
1163199140,14cyclictest0-21swapper/122:20:191
1163199140,14cyclictest0-21swapper/121:51:231
1163199140,14cyclictest0-21swapper/121:36:361
1163199140,14cyclictest0-21swapper/121:25:421
1163199140,14cyclictest0-21swapper/121:15:431
1163199140,14cyclictest0-21swapper/120:36:021
1163199140,14cyclictest0-21swapper/100:00:131
1163199140,0cyclictest0-21swapper/120:50:301
1163199140,0cyclictest0-21swapper/120:03:011
1163199140,0cyclictest0-21swapper/119:56:251
11630991414,0cyclictest1385-21apt-get00:30:120
11630991414,0cyclictest0-21swapper/020:25:190
11630991414,0cyclictest0-21swapper/020:06:530
11630991413,1cyclictest0-21swapper/023:07:460
11630991413,1cyclictest0-21swapper/022:25:350
11630991413,1cyclictest0-21swapper/022:06:270
11630991413,1cyclictest0-21swapper/000:05:260
1163099140,14cyclictest0-21swapper/023:50:580
1163099140,14cyclictest0-21swapper/023:22:030
1163099140,14cyclictest0-21swapper/022:56:370
1163099140,14cyclictest0-21swapper/022:37:080
1163099140,14cyclictest0-21swapper/021:30:170
1163099140,14cyclictest0-21swapper/021:25:490
1163099140,14cyclictest0-21swapper/020:35:500
1163099140,14cyclictest0-21swapper/019:55:540
1163099140,14cyclictest0-21swapper/000:19:240
1163099140,0cyclictest0-21swapper/023:41:540
1163099140,0cyclictest0-21swapper/023:31:410
1163099140,0cyclictest0-21swapper/019:25:160
11632991313,0cyclictest0-21swapper/221:25:162
1163299130,0cyclictest0-21swapper/222:30:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional