You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 09:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Tue Dec 02, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
232699310,30cyclictest1719-21cron21:25:012
2331993028,1cyclictest25880-21lockfile-create20:00:023
232299300,29cyclictest23242-21sh23:20:001
232299300,29cyclictest1118-21apt-get20:15:141
2331992927,1cyclictest27661-21cron22:20:013
232699290,28cyclictest0-21swapper/220:45:132
2322992928,1cyclictest613-21in:imuxsock00:35:011
2322992928,1cyclictest0-21swapper/100:15:131
2322992927,1cyclictest609-21dbus-daemon00:30:011
231799290,28cyclictest17752-21apt-get20:50:140
231799290,1cyclictest20510-21kworker/0:121:30:000
2331992827,1cyclictest6928-21sh19:20:023
2331992827,0cyclictest26876-21apt-get00:35:143
2331992826,1cyclictest25592-21awk23:25:013
233199280,1cyclictest13404-21perf21:50:003
233199280,0cyclictest0-21swapper/322:20:143
2326992828,0cyclictest0-21swapper/221:00:132
2326992828,0cyclictest0-21swapper/219:45:132
2326992827,1cyclictest0-21swapper/222:55:142
232699280,0cyclictest10455-21apt-get20:35:122
2322992827,1cyclictest16564-21apt-get23:05:141
232299280,28cyclictest0-21swapper/120:55:161
232299280,0cyclictest0-21swapper/119:35:021
231799280,1cyclictest21963-21munin-run00:25:000
2331992727,0cyclictest19627-21perf00:20:013
2331992727,0cyclictest0-21swapper/319:50:143
2331992727,0cyclictest0-21swapper/319:50:143
2331992725,1cyclictest2274-21cron22:35:013
2326992727,0cyclictest0-21swapper/221:45:132
2326992725,1cyclictest8755-21munin-run21:40:002
2322992727,0cyclictest0-21swapper/122:55:141
2322992727,0cyclictest0-21swapper/122:30:121
2322992726,0cyclictest0-21swapper/123:25:141
232299270,27cyclictest0-21swapper/120:30:001
2317992727,0cyclictest0-21swapper/022:10:110
233199269,4cyclictest17956-21cut19:40:193
2331992626,0cyclictest0-21swapper/322:05:113
2331992626,0cyclictest0-21swapper/321:20:123
2326992626,0cyclictest9566-21apt-get22:50:122
2326992626,0cyclictest0-21swapper/200:25:122
2326992624,1cyclictest0-21swapper/223:20:012
2322992626,0cyclictest0-21swapper/123:10:121
2317992626,0cyclictest4340-21apt-get21:30:120
2317992626,0cyclictest27955-21apt-get22:20:130
2317992626,0cyclictest0-21swapper/021:50:010
2317992626,0cyclictest0-21swapper/000:30:120
2326992525,0cyclictest0-21swapper/223:40:132
2326992525,0cyclictest0-21swapper/219:40:142
2322992525,0cyclictest28208-21apt-get23:30:141
2322992525,0cyclictest11874-21apt-get19:30:151
2322992525,0cyclictest0-21swapper/122:05:011
2322992525,0cyclictest0-21swapper/121:40:141
2322992525,0cyclictest0-21swapper/119:55:141
2317992525,0cyclictest0-21swapper/021:40:150
2317992523,1cyclictest303-21systemd-journal22:20:000
233199247,7cyclictest0-21swapper/320:35:133
2326992424,0cyclictest0-21swapper/219:35:012
2326992424,0cyclictest0-21swapper/200:15:142
2326992422,1cyclictest7871-21munin-run20:30:012
2326992422,1cyclictest6964-21munin-run19:20:012
2322992424,0cyclictest0-21swapper/123:50:131
2322992424,0cyclictest0-21swapper/123:35:131
2322992424,0cyclictest0-21swapper/123:00:151
2322992424,0cyclictest0-21swapper/121:30:111
2317992424,0cyclictest0-21swapper/020:35:110
2317992422,1cyclictest6906-21cron19:20:010
2317992422,1cyclictest25878-21cron20:00:020
2317992422,1cyclictest19629-21munin-run00:20:000
2326992323,0cyclictest0-21swapper/220:15:142
2322992323,0cyclictest0-21swapper/119:40:141
2317992321,1cyclictest25583-21cron23:25:000
2331992222,0cyclictest0-21swapper/322:10:123
2331992221,1cyclictest0-21swapper/322:50:123
2331992220,1cyclictest31809-21cron21:20:013
2331992220,1cyclictest26805-21perf21:10:003
2326992222,0cyclictest0-21swapper/221:15:122
2326992222,0cyclictest0-21swapper/220:55:152
2326992221,1cyclictest26591-21cron00:35:012
2322992222,0cyclictest0-21swapper/121:55:151
2322992222,0cyclictest0-21swapper/119:45:131
2322992222,0cyclictest0-21swapper/119:25:141
2317992222,0cyclictest21496-21apt-get19:50:130
2317992222,0cyclictest21496-21apt-get19:50:130
2317992222,0cyclictest20654-21apt-get22:05:110
2317992222,0cyclictest0-21swapper/000:35:140
2317992221,1cyclictest32100-21apt-get21:20:110
2317992220,1cyclictest2281-21cron22:35:010
2331992121,0cyclictest28525-21perf20:05:013
2331992121,0cyclictest0-21swapper/319:45:123
2331992121,0cyclictest0-21swapper/319:25:143
2331992120,1cyclictest25880-21apt-get23:25:143
2326992121,0cyclictest0-21swapper/221:40:142
2326992120,0cyclictest0-21swapper/222:30:122
2322992121,0cyclictest0-21swapper/121:20:111
2322992121,0cyclictest0-21swapper/121:15:111
2331992020,0cyclictest0-21swapper/320:50:133
2331992020,0cyclictest0-21swapper/320:05:173
2326992020,0cyclictest0-21swapper/223:25:142
2326992020,0cyclictest0-21swapper/223:05:152
2326992019,1cyclictest0-21swapper/223:10:132
2326992018,1cyclictest20399-21munin-run22:05:012
2322992020,0cyclictest0-21swapper/120:00:151
232299200,7cyclictest0-21swapper/120:45:131
2331991919,0cyclictest0-21swapper/323:15:143
2331991917,1cyclictest7840-21cron20:30:013
2326991918,1cyclictest30586-21apt-get23:35:132
232299193,15cyclictest22-21ksoftirqd/122:50:001
2322991919,0cyclictest0-21swapper/121:10:131
2331991816,1cyclictest8722-21sendmail-msp21:40:013
2331991816,1cyclictest4656-21munin-run22:40:013
2326991818,0cyclictest4340-21apt-get21:30:112
2326991818,0cyclictest0-21swapper/223:30:142
2326991818,0cyclictest0-21swapper/223:00:152
2326991818,0cyclictest0-21swapper/219:55:142
2326991818,0cyclictest0-21swapper/219:30:142
2326991816,1cyclictest9549-21apt-get19:25:142
2322991818,0cyclictest0-21swapper/123:40:131
2322991818,0cyclictest0-21swapper/121:05:131
2322991817,0cyclictest0-21swapper/122:35:141
2317991816,1cyclictest28535-21munin-run20:05:020
2331991717,0cyclictest9274-21perf19:25:013
2331991716,0cyclictest28208-21apt-get23:30:143
2331991715,1cyclictest9019-21apt-get21:40:143
233199170,13cyclictest0-21swapper/321:32:173
2326991717,0cyclictest0-21swapper/223:50:122
2317991716,1cyclictest19168-21apt-get19:45:120
2331991616,0cyclictest20081-21apt-get20:55:143
2331991614,1cyclictest303-21systemd-journal19:35:003
2331991614,1cyclictest0-21swapper/323:45:013
2326991616,0cyclictest15991-21sshd21:55:152
2326991614,1cyclictest0-21swapper/221:25:162
2322991616,0cyclictest0-21swapper/123:50:011
2322991616,0cyclictest0-21swapper/120:30:131
2322991614,1cyclictest17180-21dpkg00:15:001
2322991614,1cyclictest0-21swapper/123:25:001
2317991616,0cyclictest0-21swapper/022:50:130
2317991616,0cyclictest0-21swapper/019:25:150
2317991615,1cyclictest31781-21cron21:20:000
2317991614,1cyclictest0-21swapper/020:20:000
231799160,15cyclictest3196-21gltestperf22:35:170
231799160,15cyclictest0-21swapper/023:40:150
2331991515,0cyclictest0-21swapper/300:25:133
2331991513,1cyclictest30762-21grep23:35:153
233199150,1cyclictest853-21munin-run20:15:003
233199150,1cyclictest0-21swapper/321:10:143
233199150,14cyclictest0-21swapper/322:00:093
233199150,14cyclictest0-21swapper/320:45:173
233199150,14cyclictest0-21swapper/300:30:193
2326991513,1cyclictest18394-21hddtemp_smartct20:50:152
2326991513,1cyclictest14448-21users20:40:212
232699150,14cyclictest20161-21snmpd20:15:002
232699150,14cyclictest19894-21apt-get00:20:122
232699150,14cyclictest0-21swapper/221:05:182
232699150,14cyclictest0-21swapper/219:50:152
232699150,14cyclictest0-21swapper/219:50:142
232699150,14cyclictest0-21swapper/200:00:192
2322991513,1cyclictest0-21swapper/100:05:221
232299150,1cyclictest0-21swapper/121:25:151
2317991515,0cyclictest0-21swapper/023:25:130
2317991515,0cyclictest0-21swapper/021:10:000
2317991515,0cyclictest0-21swapper/020:05:180
2317991513,1cyclictest8271-21ntp_states19:20:190
2317991513,1cyclictest0-21swapper/021:10:140
231799150,14cyclictest5825-21memory22:40:180
231799150,14cyclictest0-21swapper/023:10:010
2331991414,0cyclictest0-21swapper/322:55:123
2331991414,0cyclictest0-21swapper/320:20:293
2331991414,0cyclictest0-21swapper/300:11:113
2331991412,1cyclictest15293-21ntp_states23:00:203
233199140,14cyclictest0-21swapper/323:56:553
233199140,14cyclictest0-21swapper/323:50:443
233199140,14cyclictest0-21swapper/323:48:473
233199140,14cyclictest0-21swapper/322:48:073
233199140,14cyclictest0-21swapper/322:44:403
233199140,14cyclictest0-21swapper/322:25:163
233199140,14cyclictest0-21swapper/321:55:513
233199140,14cyclictest0-21swapper/321:51:313
233199140,14cyclictest0-21swapper/321:26:183
233199140,14cyclictest0-21swapper/320:30:183
233199140,14cyclictest0-21swapper/319:35:443
233199140,14cyclictest0-21swapper/300:05:143
233199140,14cyclictest0-21swapper/300:02:063
233199140,0cyclictest0-21swapper/323:09:203
233199140,0cyclictest0-21swapper/321:00:043
233199140,0cyclictest0-21swapper/320:40:163
233199140,0cyclictest0-21swapper/320:15:043
233199140,0cyclictest0-21swapper/319:13:183
2326991414,0cyclictest0-21swapper/222:40:152
232699140,14cyclictest0-21swapper/223:55:322
232699140,14cyclictest0-21swapper/223:22:432
232699140,14cyclictest0-21swapper/222:36:092
232699140,14cyclictest0-21swapper/222:20:032
232699140,14cyclictest0-21swapper/222:18:152
232699140,14cyclictest0-21swapper/222:11:092
232699140,14cyclictest0-21swapper/222:05:112
232699140,14cyclictest0-21swapper/221:53:372
232699140,14cyclictest0-21swapper/220:31:492
232699140,14cyclictest0-21swapper/220:20:392
232699140,14cyclictest0-21swapper/220:05:452
232699140,14cyclictest0-21swapper/220:00:072
232699140,14cyclictest0-21swapper/219:21:352
232699140,14cyclictest0-21swapper/200:39:282
232699140,14cyclictest0-21swapper/200:07:182
232699140,0cyclictest0-21swapper/222:48:142
232699140,0cyclictest0-21swapper/222:26:562
232699140,0cyclictest0-21swapper/221:10:272
232699140,0cyclictest0-21swapper/200:10:482
2322991414,0cyclictest0-21swapper/122:20:281
2322991414,0cyclictest0-21swapper/120:52:071
2322991414,0cyclictest0-21swapper/120:12:111
2322991414,0cyclictest0-21swapper/120:05:231
2322991414,0cyclictest0-21swapper/100:00:051
2322991412,1cyclictest0-21swapper/100:20:161
232299140,14cyclictest0-21swapper/122:25:261
232299140,14cyclictest0-21swapper/122:11:031
232299140,14cyclictest0-21swapper/122:05:091
232299140,14cyclictest0-21swapper/121:51:271
232299140,14cyclictest0-21swapper/121:45:421
232299140,14cyclictest0-21swapper/121:00:371
232299140,14cyclictest0-21swapper/120:35:191
232299140,14cyclictest0-21swapper/120:20:161
232299140,14cyclictest0-21swapper/119:20:351
232299140,14cyclictest0-21swapper/119:15:041
232299140,14cyclictest0-21swapper/119:11:391
232299140,14cyclictest0-21swapper/100:35:041
232299140,0cyclictest0-21swapper/123:55:051
232299140,0cyclictest0-21swapper/122:50:191
232299140,0cyclictest0-21swapper/122:41:101
232299140,0cyclictest0-21swapper/122:15:191
232299140,0cyclictest0-21swapper/121:37:501
232299140,0cyclictest0-21swapper/120:40:111
232299140,0cyclictest0-21swapper/119:51:171
232299140,0cyclictest0-21swapper/119:51:171
2317991414,0cyclictest0-21swapper/023:15:130
2317991414,0cyclictest0-21swapper/022:26:010
2317991414,0cyclictest0-21swapper/021:55:260
2317991414,0cyclictest0-21swapper/000:05:000
231799140,14cyclictest16172-21ntp_states20:45:190
231799140,14cyclictest0-21swapper/023:46:160
231799140,14cyclictest0-21swapper/023:36:450
231799140,14cyclictest0-21swapper/023:31:240
231799140,14cyclictest0-21swapper/023:12:320
231799140,14cyclictest0-21swapper/022:45:510
231799140,14cyclictest0-21swapper/022:02:000
231799140,14cyclictest0-21swapper/021:37:560
231799140,14cyclictest0-21swapper/020:40:580
231799140,14cyclictest0-21swapper/020:30:030
231799140,14cyclictest0-21swapper/020:25:010
231799140,14cyclictest0-21swapper/020:10:050
231799140,14cyclictest0-21swapper/019:35:320
231799140,14cyclictest0-21swapper/000:25:330
231799140,14cyclictest0-21swapper/000:00:170
231799140,0cyclictest0-21swapper/023:53:560
231799140,0cyclictest0-21swapper/021:52:100
231799140,0cyclictest0-21swapper/021:00:050
231799140,0cyclictest0-21swapper/020:56:460
231799140,0cyclictest0-21swapper/020:20:190
231799140,0cyclictest0-21swapper/019:41:140
231799140,0cyclictest0-21swapper/019:30:090
231799140,0cyclictest0-21swapper/019:13:030
231799140,0cyclictest0-21swapper/000:11:020
2331991313,0cyclictest0-21swapper/300:21:003
233199130,0cyclictest0-21swapper/323:13:263
2326991313,0cyclictest0-21swapper/219:12:022
2317991313,0cyclictest0-21swapper/023:01:530
2326991212,0cyclictest0-21swapper/223:47:512
2317991212,0cyclictest0-21swapper/022:55:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional