You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-19 - 05:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Fri Sep 19, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2386999320,3cyclictest303-21systemd-journal00:00:010
23879993027,2cyclictest28202-21cron21:40:003
23871993028,1cyclictest0-21swapper/123:50:131
2387199300,29cyclictest609-21dbus-daemon22:30:001
2387199300,29cyclictest28261-21munin-run21:40:001
2387999290,28cyclictest18636-21apt-get23:35:163
23875992927,1cyclictest0-21swapper/223:05:012
2387599290,28cyclictest30583-21perf21:45:002
2387599290,1cyclictest0-21swapper/221:50:132
2387199290,28cyclictest0-21swapper/123:10:151
2387199290,28cyclictest0-21swapper/119:35:141
23869992927,1cyclictest0-21swapper/021:40:000
2386999290,28cyclictest31446-21apt-get19:25:140
2386999290,0cyclictest0-21swapper/023:45:150
23879992828,0cyclictest28524-21apt-get21:40:133
2387999280,0cyclictest6387-21apt-get23:10:143
2387999280,0cyclictest23306-21apt-get23:45:153
2387999280,0cyclictest12196-21apt-get21:05:133
23875992825,3cyclictest0-21swapper/219:20:152
2387599280,0cyclictest5492-21cron22:00:012
23871992828,0cyclictest0-21swapper/120:50:121
23871992827,0cyclictest0-21swapper/122:15:121
23871992827,0cyclictest0-21swapper/120:15:121
23871992826,1cyclictest17384-21cron20:05:011
2387199280,27cyclictest0-21swapper/119:45:011
2387199280,0cyclictest0-21swapper/121:55:131
23869992828,0cyclictest0-21swapper/000:30:130
23869992828,0cyclictest0-21swapper/000:25:150
23869992826,1cyclictest8089-21munin-run19:45:010
23869992826,1cyclictest19516-21cron22:30:000
2386999280,28cyclictest0-21swapper/021:05:130
2386999280,27cyclictest0-21swapper/023:10:140
2386999280,0cyclictest3684-21apt-get19:35:140
23879992727,0cyclictest0-21swapper/323:05:133
23879992727,0cyclictest0-21swapper/321:55:133
23879992726,1cyclictest8095-21perf19:45:013
23879992726,1cyclictest19511-21sh22:30:003
23879992725,1cyclictest25635-21apt-get23:50:133
2387999270,27cyclictest0-21swapper/300:20:153
23875992727,0cyclictest8114-21apt-get22:05:172
23875992727,0cyclictest0-21swapper/222:40:132
23871992727,0cyclictest0-21swapper/123:15:131
23871992727,0cyclictest0-21swapper/122:55:131
23871992727,0cyclictest0-21swapper/100:25:161
23871992727,0cyclictest0-21swapper/100:15:141
2387199270,27cyclictest0-21swapper/119:25:141
23869992727,0cyclictest7336-21apt-get00:20:160
23869992727,0cyclictest0-21swapper/021:40:130
23869992726,1cyclictest0-21swapper/021:55:130
2386999270,0cyclictest0-21swapper/023:20:140
23879992626,0cyclictest0-21swapper/320:00:143
23879992626,0cyclictest0-21swapper/319:35:143
23879992626,0cyclictest0-21swapper/319:25:143
23875992626,0cyclictest0-21swapper/221:25:152
23875992626,0cyclictest0-21swapper/219:40:152
23875992625,0cyclictest13684-21apt-get23:25:142
23875992624,1cyclictest0-21swapper/222:40:012
23871992626,0cyclictest0-21swapper/123:45:151
23871992626,0cyclictest0-21swapper/122:50:131
23869992626,0cyclictest4063-21apt-get23:05:130
23869992624,1cyclictest0-21swapper/023:50:130
23879992525,0cyclictest5783-21apt-get22:00:123
23879992525,0cyclictest5783-21apt-get22:00:123
23879992525,0cyclictest12804-21apt-get22:15:133
23879992525,0cyclictest0-21swapper/322:55:133
23879992525,0cyclictest0-21swapper/320:50:123
23879992524,1cyclictest9657-21apt-get00:25:163
23879992524,1cyclictest0-21swapper/323:15:133
23879992523,1cyclictest609-21dbus-daemon20:20:013
23875992525,0cyclictest0-21swapper/223:40:132
23875992525,0cyclictest0-21swapper/223:30:042
23875992525,0cyclictest0-21swapper/220:25:122
23875992525,0cyclictest0-21swapper/200:05:142
23871992525,0cyclictest0-21swapper/123:05:141
23871992525,0cyclictest0-21swapper/121:30:141
23871992525,0cyclictest0-21swapper/120:35:021
23871992525,0cyclictest0-21swapper/119:15:131
23871992523,2cyclictest23558-21cron21:30:011
23869992525,0cyclictest0-21swapper/022:00:120
23869992525,0cyclictest0-21swapper/022:00:120
23869992525,0cyclictest0-21swapper/020:00:140
23869992524,0cyclictest0-21swapper/022:55:130
23869992523,1cyclictest4985-21apt-get00:15:140
23869992523,1cyclictest0-21swapper/020:20:010
23879992424,0cyclictest0-21swapper/320:30:013
23879992424,0cyclictest0-21swapper/300:15:143
23879992423,1cyclictest29431-21apt-get22:50:133
23875992424,0cyclictest0-21swapper/223:55:162
23875992423,1cyclictest1084-21perf19:30:012
23871992424,0cyclictest0-21swapper/119:45:151
23869992424,0cyclictest0-21swapper/022:15:130
23869992424,0cyclictest0-21swapper/020:50:120
23869992424,0cyclictest0-21swapper/020:30:010
23879992323,0cyclictest26420-21apt-get19:15:133
23879992321,1cyclictest23555-21cron21:30:013
23875992323,0cyclictest17478-21apt-get22:25:132
23875992323,0cyclictest0-21swapper/200:25:162
23871992323,0cyclictest0-21swapper/119:10:131
23871992322,0cyclictest0-21swapper/122:00:121
23871992322,0cyclictest0-21swapper/122:00:121
23869992323,0cyclictest0-21swapper/023:15:130
23869992323,0cyclictest0-21swapper/022:50:130
23879992222,0cyclictest0-21swapper/321:30:143
23879992222,0cyclictest0-21swapper/320:35:023
23875992222,0cyclictest0-21swapper/219:55:152
23871992222,0cyclictest0-21swapper/120:30:011
23869992222,0cyclictest31732-21apt-get20:35:020
23869992222,0cyclictest0-21swapper/021:30:130
23869992222,0cyclictest0-21swapper/019:15:130
23869992221,1cyclictest21524-21apt-get21:25:150
23879992121,0cyclictest0-21swapper/319:45:153
23879992120,1cyclictest24096-21apt-get19:10:133
23875992121,0cyclictest0-21swapper/222:10:142
23875992121,0cyclictest0-21swapper/221:45:012
23875992118,2cyclictest303-21systemd-journal19:55:012
23871992119,1cyclictest609-21dbus-daemon20:25:001
23869992121,0cyclictest8353-21apt-get19:45:150
23875992020,0cyclictest0-21swapper/200:35:122
23871992020,0cyclictest0-21swapper/123:20:151
23875991919,0cyclictest0-21swapper/200:00:132
23875991918,1cyclictest25354-21cron23:50:012
23871991919,0cyclictest0-21swapper/100:25:011
23871991919,0cyclictest0-21swapper/100:10:131
23871991918,1cyclictest0-21swapper/123:35:161
23869991919,0cyclictest0-21swapper/019:10:120
23875991816,1cyclictest609-21dbus-daemon23:10:002
23875991816,1cyclictest0-21swapper/219:35:012
23871991817,0cyclictest0-21swapper/100:30:131
23879991717,0cyclictest0-21swapper/323:20:153
23879991716,1cyclictest26717-21cron20:25:003
23875991717,0cyclictest0-21swapper/221:20:132
23869991715,1cyclictest303-21systemd-journal20:25:000
23875991616,0cyclictest14526-21apt-get21:10:132
2387599160,15cyclictest15967-21sed20:00:162
23871991616,0cyclictest26538-21perf22:45:011
23871991616,0cyclictest0-21swapper/122:30:131
23871991615,1cyclictest0-21swapper/121:05:131
23871991614,1cyclictest303-21systemd-journal19:25:001
2387199160,4cyclictest0-21swapper/100:05:181
2387199160,15cyclictest19250-21awk20:05:241
23869991614,1cyclictest2661-21apt-get00:10:130
23869991614,1cyclictest0-21swapper/019:50:130
23869991614,1cyclictest0-21swapper/000:35:160
2386999160,15cyclictest3038-21irqstats20:40:180
2386999160,15cyclictest30071-21head19:20:200
2386999160,15cyclictest21962-21/usr/sbin/munin22:35:010
23879991515,0cyclictest0-21swapper/300:10:133
2387999150,1cyclictest18376-21perf23:35:003
2387999150,1cyclictest0-21swapper/300:35:143
2387999150,14cyclictest20225-21df_inode22:30:153
2387999150,14cyclictest17567-21if_enp1s0.821:15:173
23875991515,0cyclictest0-21swapper/221:05:132
23875991514,1cyclictest24677-21apt-get20:20:162
2387599150,1cyclictest31775-21gpgv20:35:002
23871991513,1cyclictest18911-21turbostat21:20:001
23869991513,1cyclictest26550-21munin-run22:45:010
23879991414,0cyclictest11977-21apt-get00:30:133
23879991414,0cyclictest0-21swapper/323:25:203
23879991414,0cyclictest0-21swapper/323:00:233
23879991414,0cyclictest0-21swapper/321:45:083
2387999140,14cyclictest0-21swapper/323:55:183
2387999140,14cyclictest0-21swapper/323:40:303
2387999140,14cyclictest0-21swapper/322:48:383
2387999140,14cyclictest0-21swapper/322:23:473
2387999140,14cyclictest0-21swapper/322:09:593
2387999140,14cyclictest0-21swapper/321:51:533
2387999140,14cyclictest0-21swapper/321:10:313
2387999140,14cyclictest0-21swapper/320:57:093
2387999140,14cyclictest0-21swapper/320:48:313
2387999140,14cyclictest0-21swapper/320:40:463
2387999140,14cyclictest0-21swapper/320:29:063
2387999140,14cyclictest0-21swapper/320:14:013
2387999140,14cyclictest0-21swapper/320:06:083
2387999140,14cyclictest0-21swapper/319:50:133
2387999140,14cyclictest0-21swapper/319:21:423
2387999140,0cyclictest0-21swapper/322:35:413
2387999140,0cyclictest0-21swapper/321:22:293
2387999140,0cyclictest0-21swapper/319:56:533
2387999140,0cyclictest0-21swapper/319:31:293
2387999140,0cyclictest0-21swapper/300:06:593
2387999140,0cyclictest0-21swapper/300:02:123
23875991414,0cyclictest0-21swapper/223:50:592
23875991414,0cyclictest0-21swapper/220:15:132
23875991412,1cyclictest7440-21ntp_states23:10:202
2387599140,14cyclictest0-21swapper/223:36:432
2387599140,14cyclictest0-21swapper/223:24:382
2387599140,14cyclictest0-21swapper/222:52:042
2387599140,14cyclictest0-21swapper/222:49:482
2387599140,14cyclictest0-21swapper/222:30:072
2387599140,14cyclictest0-21swapper/222:00:062
2387599140,14cyclictest0-21swapper/222:00:062
2387599140,14cyclictest0-21swapper/221:35:162
2387599140,14cyclictest0-21swapper/221:33:112
2387599140,14cyclictest0-21swapper/221:19:182
2387599140,14cyclictest0-21swapper/221:00:582
2387599140,14cyclictest0-21swapper/220:45:372
2387599140,14cyclictest0-21swapper/220:37:142
2387599140,14cyclictest0-21swapper/219:48:082
2387599140,14cyclictest0-21swapper/219:16:152
2387599140,14cyclictest0-21swapper/219:11:212
2387599140,14cyclictest0-21swapper/200:33:062
2387599140,14cyclictest0-21swapper/200:15:292
2387599140,0cyclictest0-21swapper/223:18:372
2387599140,0cyclictest0-21swapper/220:40:302
2387599140,0cyclictest0-21swapper/220:09:512
2387599140,0cyclictest0-21swapper/219:39:402
2387599140,0cyclictest0-21swapper/200:21:272
2387199142,11cyclictest607-21irqbalance20:46:021
23871991414,0cyclictest0-21swapper/123:31:141
23871991414,0cyclictest0-21swapper/123:26:421
23871991414,0cyclictest0-21swapper/120:25:121
23871991414,0cyclictest0-21swapper/119:50:121
23871991414,0cyclictest0-21swapper/100:35:551
2387199140,14cyclictest0-21swapper/123:42:301
2387199140,14cyclictest0-21swapper/122:45:271
2387199140,14cyclictest0-21swapper/122:35:191
2387199140,14cyclictest0-21swapper/122:10:061
2387199140,14cyclictest0-21swapper/122:05:221
2387199140,14cyclictest0-21swapper/121:46:121
2387199140,14cyclictest0-21swapper/121:20:571
2387199140,14cyclictest0-21swapper/120:40:061
2387199140,14cyclictest0-21swapper/120:10:161
2387199140,14cyclictest0-21swapper/119:30:091
2387199140,14cyclictest0-21swapper/100:00:001
2387199140,0cyclictest0-21swapper/123:59:211
2387199140,0cyclictest0-21swapper/123:00:241
2387199140,0cyclictest0-21swapper/121:52:131
2387199140,0cyclictest0-21swapper/121:43:401
2387199140,0cyclictest0-21swapper/121:02:111
2387199140,0cyclictest0-21swapper/120:55:191
23869991414,0cyclictest0-21swapper/023:40:300
23869991414,0cyclictest0-21swapper/023:35:160
23869991414,0cyclictest0-21swapper/023:30:350
23869991414,0cyclictest0-21swapper/021:51:530
23869991414,0cyclictest0-21swapper/019:30:070
23869991412,1cyclictest0-21swapper/020:10:160
2386999140,14cyclictest0-21swapper/023:25:290
2386999140,14cyclictest0-21swapper/022:20:580
2386999140,14cyclictest0-21swapper/022:12:390
2386999140,14cyclictest0-21swapper/022:05:200
2386999140,14cyclictest0-21swapper/021:45:050
2386999140,14cyclictest0-21swapper/021:10:030
2386999140,14cyclictest0-21swapper/020:55:430
2386999140,14cyclictest0-21swapper/020:45:560
2386999140,14cyclictest0-21swapper/019:59:090
2386999140,0cyclictest0-21swapper/022:46:330
2386999140,0cyclictest0-21swapper/021:15:170
2386999140,0cyclictest0-21swapper/020:28:520
2386999140,0cyclictest0-21swapper/020:05:180
2386999140,0cyclictest0-21swapper/000:05:460
23879991313,0cyclictest0-21swapper/321:00:313
2387999130,13cyclictest0-21swapper/322:41:313
23875991313,0cyclictest0-21swapper/222:56:192
23875991313,0cyclictest0-21swapper/222:20:452
23875991313,0cyclictest0-21swapper/222:16:382
23875991313,0cyclictest0-21swapper/220:55:002
23875991313,0cyclictest0-21swapper/220:50:422
2387599130,13cyclictest0-21swapper/200:13:172
2387599130,0cyclictest0-21swapper/220:14:522
23871991313,0cyclictest0-21swapper/121:14:401
23871991313,0cyclictest0-21swapper/119:55:591
23869991313,0cyclictest0-21swapper/023:00:230
23869991313,0cyclictest0-21swapper/021:22:380
23869991313,0cyclictest0-21swapper/021:00:310
23869991313,0cyclictest0-21swapper/000:03:170
23879991212,0cyclictest0-21swapper/322:10:063
23871991212,0cyclictest0-21swapper/122:20:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional