You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 06:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Mon Dec 01, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21607993027,2cyclictest27362-21dump-pmu-power21:40:012
21609992927,1cyclictest5179-21cron23:10:013
2160999290,28cyclictest4172-21cron00:20:003
2160999290,1cyclictest17109-21apt-get23:35:143
2160799290,28cyclictest4488-21apt-get00:20:112
2160799290,28cyclictest10386-21apt-get19:55:122
2160299290,28cyclictest14176-21apt-get22:20:111
2160299290,1cyclictest31976-21munin-run00:10:011
2160299290,1cyclictest1-21systemd19:55:011
21599992927,1cyclictest29394-21apt-get20:35:140
2159999290,28cyclictest0-21swapper/021:40:120
2159999290,28cyclictest0-21swapper/000:00:130
21609992828,0cyclictest0-21swapper/322:50:153
21609992827,1cyclictest24743-21apt-get20:25:133
2160999280,28cyclictest0-21swapper/319:45:123
2160999280,0cyclictest0-21swapper/320:40:133
21607992827,1cyclictest12448-21apt-get20:00:022
2160799280,28cyclictest0-21swapper/222:00:132
2160799280,27cyclictest24165-21apt-get19:15:142
2160799280,1cyclictest13320-21perf21:10:002
2160799280,0cyclictest0-21swapper/223:20:132
2160799280,0cyclictest0-21swapper/222:40:132
2160799280,0cyclictest0-21swapper/222:30:132
21602992828,0cyclictest0-21swapper/121:20:111
21602992827,0cyclictest13597-21apt-get21:10:121
21602992826,1cyclictest626-21gdbus21:05:011
21602992826,1cyclictest26807-21munin-run20:30:001
2160299280,28cyclictest0-21swapper/123:35:141
21599992827,1cyclictest13-21ksoftirqd/000:10:010
21599992826,1cyclictest6011-21cron20:55:000
21599992825,2cyclictest303-21systemd-journal23:30:010
21599992825,2cyclictest22692-21cron21:30:000
2159999280,28cyclictest0-21swapper/023:15:130
2159999280,0cyclictest0-21swapper/022:15:150
2159999280,0cyclictest0-21swapper/021:15:130
21609992727,0cyclictest0-21swapper/321:40:123
21609992727,0cyclictest0-21swapper/320:35:143
2160999270,27cyclictest0-21swapper/300:20:113
2160999270,0cyclictest27068-21apt-get20:30:133
21607992727,0cyclictest2136-21apt-get00:15:092
21607992727,0cyclictest0-21swapper/222:10:112
21607992727,0cyclictest0-21swapper/219:45:122
21607992725,1cyclictest0-21swapper/220:40:002
2160799270,27cyclictest1374-21perf20:45:002
21599992727,0cyclictest0-21swapper/022:35:150
21599992727,0cyclictest0-21swapper/021:05:140
21599992727,0cyclictest0-21swapper/019:55:120
21609992626,0cyclictest6818-21apt-get00:25:133
21609992626,0cyclictest12455-21apt-get23:25:133
21609992626,0cyclictest0-21swapper/323:00:133
21609992626,0cyclictest0-21swapper/322:00:133
21609992626,0cyclictest0-21swapper/300:10:093
21607992625,1cyclictest31161-21apt-get19:30:132
21602992626,0cyclictest0-21swapper/123:05:141
21602992626,0cyclictest0-21swapper/121:45:131
21602992626,0cyclictest0-21swapper/120:35:141
21599992626,0cyclictest30280-21apt-get21:45:130
21599992626,0cyclictest25883-21apt-get22:45:130
21599992626,0cyclictest20062-21apt-get20:15:130
21599992626,0cyclictest0-21swapper/023:20:130
21599992626,0cyclictest0-21swapper/023:05:140
21599992624,1cyclictest0-21swapper/000:25:130
21609992525,0cyclictest0-21swapper/320:15:133
21609992524,0cyclictest0-21swapper/323:55:133
21607992525,0cyclictest5464-21apt-get23:10:142
21607992525,0cyclictest0-21swapper/220:30:132
21607992525,0cyclictest0-21swapper/200:25:122
21602992525,0cyclictest7786-21apt-get23:15:131
21602992525,0cyclictest15922-21apt-get21:15:131
21602992525,0cyclictest0-21swapper/121:40:121
21599992525,0cyclictest8943-21apt-get21:00:120
21599992525,0cyclictest0-21swapper/023:35:140
21599992525,0cyclictest0-21swapper/019:10:140
21599992523,1cyclictest6297-21apt-get20:55:140
21607992424,0cyclictest0-21swapper/223:10:012
21602992424,0cyclictest0-21swapper/120:05:121
21602992424,0cyclictest0-21swapper/119:10:141
21599992424,0cyclictest0-21swapper/019:40:140
21609992323,0cyclictest0-21swapper/322:20:113
21607992323,0cyclictest32603-21apt-get21:50:122
21607992323,0cyclictest0-21swapper/223:25:132
21602992323,0cyclictest0-21swapper/120:55:141
21602992323,0cyclictest0-21swapper/100:10:091
21602992322,0cyclictest3970-21apt-get20:50:131
21609992222,0cyclictest0-21swapper/322:55:133
21609992222,0cyclictest0-21swapper/319:30:133
21607992222,0cyclictest28211-21apt-get22:50:142
21607992222,0cyclictest20648-21apt-get21:25:132
21607992222,0cyclictest0-21swapper/200:05:022
21602992222,0cyclictest0-21swapper/122:25:131
21599992222,0cyclictest0-21swapper/023:35:000
21599992222,0cyclictest0-21swapper/023:10:130
21599992221,1cyclictest2136-21apt-get00:15:090
21599992221,1cyclictest141rcuc/023:45:010
21609992121,0cyclictest0-21swapper/322:40:133
21609992121,0cyclictest0-21swapper/321:10:123
21609992121,0cyclictest0-21swapper/320:20:153
21609992121,0cyclictest0-21swapper/319:35:133
21607992121,0cyclictest27954-21apt-get21:40:122
21607992121,0cyclictest0-21swapper/220:17:522
21607992121,0cyclictest0-21swapper/219:20:152
21607992119,1cyclictest23878-21cron23:50:012
21602992121,0cyclictest0-21swapper/119:20:151
21599992121,0cyclictest0-21swapper/023:55:130
21599992121,0cyclictest0-21swapper/020:05:120
21599992119,1cyclictest609-21dbus-daemon21:15:000
21609992020,0cyclictest26515-21apt-get19:20:153
21609992020,0cyclictest0-21swapper/321:15:133
21609992020,0cyclictest0-21swapper/319:55:123
21609992020,0cyclictest0-21swapper/319:15:143
21607992020,0cyclictest32227-21apt-get00:10:092
21607992020,0cyclictest0-21swapper/220:20:152
21607992018,1cyclictest0-21swapper/200:35:152
21602992020,0cyclictest28925-21apt-get00:00:131
21602992020,0cyclictest0-21swapper/122:15:151
21602992020,0cyclictest0-21swapper/100:15:091
21599992020,0cyclictest0-21swapper/000:10:090
21609991919,0cyclictest0-21swapper/320:55:143
21607991919,0cyclictest0-21swapper/223:50:142
21607991918,1cyclictest16239-21perf22:25:012
21599991919,0cyclictest8067-21apt-get19:50:150
2160999185,13cyclictest34-21ksoftirqd/300:38:243
21609991818,0cyclictest10133-21apt-get23:20:133
21609991816,1cyclictest0-21swapper/321:35:003
21607991818,0cyclictest2516-21apt-get21:55:152
21607991818,0cyclictest0-21swapper/200:30:152
21602991818,0cyclictest0-21swapper/122:35:151
21602991818,0cyclictest0-21swapper/121:05:141
21602991816,1cyclictest609-21dbus-daemon21:30:001
21602991816,1cyclictest14487-21cron23:30:011
2160299181,4cyclictest0-21swapper/122:50:141
21599991818,0cyclictest0-21swapper/022:55:130
21599991817,1cyclictest30886-21perf19:30:010
21607991717,0cyclictest22982-21apt-get21:30:132
21602991717,0cyclictest0-21swapper/123:20:131
21602991717,0cyclictest0-21swapper/120:15:131
21602991717,0cyclictest0-21swapper/119:55:121
21599991717,0cyclictest0-21swapper/022:55:000
21609991616,0cyclictest0-21swapper/322:30:133
21607991616,0cyclictest1061-21apt-get19:35:132
21607991615,1cyclictest808-21chrt23:00:132
21607991614,1cyclictest16817-21cron23:35:002
21602991616,0cyclictest0-21swapper/122:45:131
21602991616,0cyclictest0-21swapper/100:25:131
21602991614,1cyclictest0-21swapper/122:45:001
21602991614,1cyclictest0-21swapper/100:35:011
2160299160,2cyclictest20996-21latency_hist22:35:011
21599991616,0cyclictest25308-21apt-get21:35:130
21609991515,0cyclictest0-21swapper/319:50:153
21609991513,1cyclictest0-21swapper/300:30:253
2160999150,1cyclictest0-21swapper/321:00:013
2160999150,14cyclictest29877-21ntp_states19:25:163
21607991515,0cyclictest30280-21apt-get21:45:122
21607991515,0cyclictest0-21swapper/223:55:132
21607991513,2cyclictest0-21swapper/219:28:152
21607991513,1cyclictest18155-21ntp_states23:35:192
2160799150,1cyclictest18379-21taskset22:28:072
21602991515,0cyclictest0-21swapper/119:40:151
21602991514,1cyclictest24330-21switchtime21:30:211
21602991513,1cyclictest4136-21sed21:55:231
21602991513,1cyclictest20553-21ntp_states23:40:181
21602991513,1cyclictest0-21swapper/119:25:131
2160299150,1cyclictest0-21swapper/122:55:061
21599991513,1cyclictest0-21swapper/000:40:010
2159999150,14cyclictest5534-21ntp_states00:20:160
2159999150,14cyclictest25788-21ntp_states20:25:180
2159999150,14cyclictest18270-21apt-get21:20:110
21609991414,0cyclictest0-21swapper/322:19:343
21609991414,0cyclictest0-21swapper/321:50:143
21609991414,0cyclictest0-21swapper/321:20:403
2160999140,14cyclictest0-21swapper/323:51:183
2160999140,14cyclictest0-21swapper/323:40:153
2160999140,14cyclictest0-21swapper/323:17:133
2160999140,14cyclictest0-21swapper/322:48:043
2160999140,14cyclictest0-21swapper/322:28:523
2160999140,14cyclictest0-21swapper/322:11:033
2160999140,14cyclictest0-21swapper/322:05:473
2160999140,14cyclictest0-21swapper/321:56:173
2160999140,14cyclictest0-21swapper/321:45:323
2160999140,14cyclictest0-21swapper/321:35:373
2160999140,14cyclictest0-21swapper/321:26:393
2160999140,14cyclictest0-21swapper/321:05:123
2160999140,14cyclictest0-21swapper/320:51:073
2160999140,14cyclictest0-21swapper/320:45:023
2160999140,14cyclictest0-21swapper/320:12:013
2160999140,14cyclictest0-21swapper/320:05:273
2160999140,14cyclictest0-21swapper/320:01:153
2160999140,14cyclictest0-21swapper/319:40:253
2160999140,14cyclictest0-21swapper/319:12:593
2160999140,14cyclictest0-21swapper/300:08:363
2160999140,14cyclictest0-21swapper/300:01:193
2160999140,0cyclictest0-21swapper/323:46:343
2160999140,0cyclictest0-21swapper/323:30:373
2160999140,0cyclictest0-21swapper/322:37:223
21607991414,0cyclictest30268-21apt-get22:55:012
2160799140,14cyclictest0-21swapper/223:40:532
2160799140,14cyclictest0-21swapper/222:36:142
2160799140,14cyclictest0-21swapper/222:16:582
2160799140,14cyclictest0-21swapper/221:22:292
2160799140,14cyclictest0-21swapper/221:11:402
2160799140,14cyclictest0-21swapper/221:01:242
2160799140,14cyclictest0-21swapper/220:55:262
2160799140,14cyclictest0-21swapper/220:50:412
2160799140,14cyclictest0-21swapper/220:47:202
2160799140,14cyclictest0-21swapper/220:11:272
2160799140,14cyclictest0-21swapper/220:07:232
2160799140,14cyclictest0-21swapper/219:53:422
2160799140,14cyclictest0-21swapper/219:42:562
2160799140,14cyclictest0-21swapper/219:12:282
2160799140,0cyclictest0-21swapper/223:16:182
2160799140,0cyclictest0-21swapper/222:45:502
2160799140,0cyclictest0-21swapper/222:05:012
2160799140,0cyclictest0-21swapper/221:15:542
2160799140,0cyclictest0-21swapper/220:26:442
2160799140,0cyclictest0-21swapper/200:00:142
21602991414,0cyclictest0-21swapper/121:51:141
21602991414,0cyclictest0-21swapper/120:21:141
21602991414,0cyclictest0-21swapper/120:11:261
21602991414,0cyclictest0-21swapper/120:00:191
2160299140,14cyclictest0-21swapper/123:55:141
2160299140,14cyclictest0-21swapper/123:11:521
2160299140,14cyclictest0-21swapper/122:10:411
2160299140,14cyclictest0-21swapper/122:05:541
2160299140,14cyclictest0-21swapper/120:45:021
2160299140,14cyclictest0-21swapper/120:32:451
2160299140,14cyclictest0-21swapper/119:35:581
2160299140,14cyclictest0-21swapper/119:15:181
2160299140,14cyclictest0-21swapper/100:20:541
2160299140,0cyclictest0-21swapper/123:50:191
2160299140,0cyclictest0-21swapper/123:45:431
2160299140,0cyclictest0-21swapper/123:30:531
2160299140,0cyclictest0-21swapper/123:00:261
2160299140,0cyclictest0-21swapper/121:35:411
2160299140,0cyclictest0-21swapper/120:40:051
2160299140,0cyclictest0-21swapper/119:45:281
2160299140,0cyclictest0-21swapper/119:34:561
21599991414,0cyclictest0-21swapper/022:30:230
21599991414,0cyclictest0-21swapper/021:51:420
21599991414,0cyclictest0-21swapper/020:12:450
21599991414,0cyclictest0-21swapper/019:30:510
21599991412,1cyclictest0-21swapper/022:20:130
2159999140,14cyclictest0-21swapper/023:51:550
2159999140,14cyclictest0-21swapper/023:46:430
2159999140,14cyclictest0-21swapper/023:00:100
2159999140,14cyclictest0-21swapper/022:40:150
2159999140,14cyclictest0-21swapper/022:05:240
2159999140,14cyclictest0-21swapper/021:31:380
2159999140,14cyclictest0-21swapper/020:45:050
2159999140,14cyclictest0-21swapper/020:30:070
2159999140,14cyclictest0-21swapper/020:20:120
2159999140,14cyclictest0-21swapper/019:45:470
2159999140,14cyclictest0-21swapper/019:20:190
2159999140,14cyclictest0-21swapper/019:16:000
2159999140,0cyclictest0-21swapper/022:25:090
2159999140,0cyclictest0-21swapper/022:10:150
2159999140,0cyclictest0-21swapper/022:01:020
2159999140,0cyclictest0-21swapper/021:55:110
2159999140,0cyclictest0-21swapper/020:40:450
2159999140,0cyclictest0-21swapper/020:00:340
2159999140,0cyclictest0-21swapper/019:36:020
2159999140,0cyclictest0-21swapper/000:30:500
21609991313,0cyclictest0-21swapper/323:10:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional