You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 07:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Thu Nov 20, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
891099433,2cyclictest892-21cron22:50:001
891099310,30cyclictest6561-21chrt00:10:131
891199300,29cyclictest1323-21pachectl00:00:002
891399290,28cyclictest609-21dbus-daemon22:40:003
891399290,28cyclictest25443-21apt-get20:15:133
890999290,28cyclictest3239-21cron22:55:000
8913992828,0cyclictest0-21swapper/322:10:103
891399280,0cyclictest0-21swapper/323:00:123
891399280,0cyclictest0-21swapper/322:15:133
8911992827,1cyclictest20534-21munin-run20:05:002
8911992826,1cyclictest19612-21latency_hist23:30:022
891199280,27cyclictest24295-21apt-get22:30:122
891199280,0cyclictest0-21swapper/222:50:122
8910992828,0cyclictest14297-21apt-get19:50:201
8910992826,1cyclictest0-21swapper/119:15:001
891099280,27cyclictest0-21swapper/121:20:101
890999280,28cyclictest0-21swapper/023:10:120
890999280,1cyclictest10176-21perf19:20:010
890999280,0cyclictest31546-21apt-get23:55:130
8913992727,0cyclictest13295-21perf00:25:003
8913992727,0cyclictest0-21swapper/322:45:133
8913992727,0cyclictest0-21swapper/321:40:103
891399270,0cyclictest0-21swapper/320:00:153
8911992727,0cyclictest0-21swapper/223:15:122
8911992727,0cyclictest0-21swapper/223:15:122
8911992727,0cyclictest0-21swapper/222:00:142
8911992727,0cyclictest0-21swapper/221:20:002
891199270,27cyclictest0-21swapper/200:25:132
891199270,0cyclictest0-21swapper/223:35:122
891199270,0cyclictest0-21swapper/222:10:092
8910992727,0cyclictest0-21swapper/123:45:171
8910992727,0cyclictest0-21swapper/123:40:101
8910992727,0cyclictest0-21swapper/123:05:111
8910992727,0cyclictest0-21swapper/120:10:151
8910992727,0cyclictest0-21swapper/119:55:081
8909992727,0cyclictest0-21swapper/000:25:120
8913992624,1cyclictest609-21dbus-daemon19:35:023
8911992626,0cyclictest8886-21apt-get00:15:132
8911992626,0cyclictest0-21swapper/223:20:112
8911992626,0cyclictest0-21swapper/222:15:122
8911992626,0cyclictest0-21swapper/220:35:112
8911992626,0cyclictest0-21swapper/219:50:202
8911992624,1cyclictest1562-21apt-get00:00:112
8910992626,0cyclictest0-21swapper/122:30:131
8910992626,0cyclictest0-21swapper/100:35:131
8910992625,1cyclictest22223-21apt-get23:35:121
8910992625,1cyclictest1189-21apt-get22:50:121
8909992626,0cyclictest8191-21apt-get23:05:120
8909992626,0cyclictest27314-21apt-get20:17:540
8909992626,0cyclictest0-21swapper/023:50:160
8909992626,0cyclictest0-21swapper/023:00:130
8909992626,0cyclictest0-21swapper/021:50:130
8909992626,0cyclictest0-21swapper/019:55:080
8909992626,0cyclictest0-21swapper/000:10:130
8913992525,0cyclictest0-21swapper/320:50:133
8910992524,1cyclictest6300-21munin-run00:10:011
8909992525,0cyclictest3526-21apt-get22:55:140
8909992525,0cyclictest0-21swapper/023:40:090
8909992524,1cyclictest18215-21apt-get00:35:130
8909992524,0cyclictest0-21swapper/020:10:020
8913992424,0cyclictest0-21swapper/321:35:113
8913992424,0cyclictest0-21swapper/321:15:113
8913992424,0cyclictest0-21swapper/321:10:143
8913992423,1cyclictest15634-21munin-run00:30:003
8911992422,1cyclictest623-21polkitd19:40:022
8910992424,0cyclictest21088-21apt-get21:15:101
8910992424,0cyclictest20794-21apt-get20:05:131
8910992424,0cyclictest0-21swapper/123:20:111
8910992424,0cyclictest0-21swapper/122:05:111
8910992424,0cyclictest0-21swapper/121:10:131
8910992424,0cyclictest0-21swapper/120:55:011
8910992424,0cyclictest0-21swapper/100:25:131
8909992424,0cyclictest0-21swapper/023:35:110
8909992424,0cyclictest0-21swapper/022:30:130
8909992424,0cyclictest0-21swapper/000:15:130
8913992323,0cyclictest0-21swapper/322:25:103
8911992323,0cyclictest24567-21apt-get23:40:102
8911992323,0cyclictest23120-21apt-get20:10:142
8911992323,0cyclictest0-21swapper/221:50:132
8910992323,0cyclictest0-21swapper/123:50:151
8913992222,0cyclictest0-21swapper/320:30:153
8913992222,0cyclictest0-21swapper/300:30:173
8911992222,0cyclictest0-21swapper/220:05:122
8911992221,0cyclictest0-21swapper/221:40:012
8910992222,0cyclictest0-21swapper/121:35:111
8910992221,1cyclictest0-21swapper/121:29:591
8909992222,0cyclictest14943-21apt-get22:10:080
8913992121,0cyclictest0-21swapper/323:25:143
8913992121,0cyclictest0-21swapper/322:05:123
8913992121,0cyclictest0-21swapper/321:00:123
891199210,9cyclictest0-21swapper/221:30:112
8910992121,0cyclictest0-21swapper/122:00:141
8909992120,1cyclictest9973-21apt-get22:00:130
8909992120,0cyclictest0-21swapper/020:05:010
8913992020,0cyclictest0-21swapper/323:45:173
8913992020,0cyclictest0-21swapper/321:25:153
8913992019,1cyclictest4233-21apt-get00:05:143
8913992019,1cyclictest0-21swapper/321:30:113
8913992018,1cyclictest11433-21sh19:30:003
8910992020,0cyclictest0-21swapper/100:15:131
8910992019,0cyclictest12846-21apt-get23:15:131
8910992019,0cyclictest12846-21apt-get23:15:131
8910992018,1cyclictest0-21swapper/100:00:011
8909992020,0cyclictest23154-21perf21:19:590
8909992020,0cyclictest0-21swapper/023:15:130
8909992020,0cyclictest0-21swapper/023:15:130
8909992020,0cyclictest0-21swapper/019:50:210
8909992018,1cyclictest303-21systemd-journal23:30:010
8913991919,0cyclictest14981-21perf23:20:003
8913991919,0cyclictest14981-21perf23:20:003
8911991919,0cyclictest0-21swapper/219:55:072
8910991919,0cyclictest19645-21apt-get22:20:111
8910991919,0cyclictest0-21swapper/123:35:011
8910991919,0cyclictest0-21swapper/122:25:111
8910991919,0cyclictest0-21swapper/100:00:121
8909991919,0cyclictest17297-21apt-get22:15:130
8909991918,1cyclictest2394-21apt-get20:35:120
8913991818,0cyclictest0-21swapper/323:10:123
8913991818,0cyclictest0-21swapper/320:45:113
8913991818,0cyclictest0-21swapper/320:40:133
8913991816,1cyclictest18169-21sh20:00:013
8910991818,0cyclictest0-21swapper/122:10:091
8910991818,0cyclictest0-21swapper/120:40:121
8910991817,0cyclictest10523-21apt-get23:10:111
8909991818,0cyclictest15246-21apt-get23:20:110
8913991717,0cyclictest19900-21apt-get23:30:123
8913991717,0cyclictest0-21swapper/320:55:093
8913991715,1cyclictest10246-21latency_hist23:10:013
891399170,16cyclictest5584-21latency_hist23:00:013
8911991717,0cyclictest0-21swapper/223:50:162
8911991717,0cyclictest0-21swapper/222:05:122
8911991717,0cyclictest0-21swapper/221:20:112
8910991717,0cyclictest0-21swapper/119:20:011
890999174,11cyclictest303-21systemd-journal00:10:020
8909991717,0cyclictest0-21swapper/000:05:010
8913991616,0cyclictest20794-21apt-get20:05:123
8913991616,0cyclictest0-21swapper/320:35:133
8913991613,2cyclictest8521-21memory21:55:153
8913991613,2cyclictest24023-21memory20:10:183
8911991614,1cyclictest0-21swapper/223:15:002
8910991616,0cyclictest0-21swapper/100:20:131
8910991614,1cyclictest31033-21munin-run22:45:011
890999166,6cyclictest12133-21df_inode20:55:110
8909991616,0cyclictest0-21swapper/020:10:150
8909991614,1cyclictest12714-21sendmail19:40:010
890999160,15cyclictest607-21irqbalance21:02:240
8913991513,1cyclictest5007-21cron21:50:003
8913991513,1cyclictest25203-21gltestperf23:40:123
891399150,1cyclictest0-21swapper/323:55:203
8911991515,0cyclictest0-21swapper/222:55:142
8911991515,0cyclictest0-21swapper/221:05:132
8911991515,0cyclictest0-21swapper/200:35:142
8911991515,0cyclictest0-21swapper/200:10:122
8910991514,1cyclictest5293-21apt-get21:50:131
8910991514,1cyclictest14275-21cstates21:00:131
8910991513,1cyclictest1125-21ntpq20:30:201
890999150,14cyclictest16086-21cpuspeed_turbos00:30:170
8913991414,0cyclictest0-21swapper/323:20:013
8913991414,0cyclictest0-21swapper/320:20:153
8913991414,0cyclictest0-21swapper/300:36:563
8913991413,1cyclictest20161-21snmpd19:50:073
8913991413,1cyclictest0-21swapper/300:15:193
891399140,14cyclictest10607-21gltestperf22:00:173
891399140,14cyclictest0-21swapper/323:51:373
891399140,14cyclictest0-21swapper/323:36:003
891399140,14cyclictest0-21swapper/322:30:393
891399140,14cyclictest0-21swapper/322:20:393
891399140,14cyclictest0-21swapper/320:25:243
891399140,14cyclictest0-21swapper/319:46:183
891399140,14cyclictest0-21swapper/319:42:093
891399140,14cyclictest0-21swapper/319:36:223
891399140,14cyclictest0-21swapper/319:21:133
891399140,14cyclictest0-21swapper/319:15:333
891399140,14cyclictest0-21swapper/319:13:373
891399140,14cyclictest0-21swapper/300:04:153
891399140,0cyclictest0-21swapper/322:41:263
891399140,0cyclictest0-21swapper/321:50:303
891399140,0cyclictest0-21swapper/321:09:033
891399140,0cyclictest0-21swapper/300:10:363
8911991414,0cyclictest0-21swapper/223:00:112
8911991414,0cyclictest0-21swapper/220:20:542
8911991414,0cyclictest0-21swapper/220:15:142
8911991414,0cyclictest0-21swapper/200:24:472
8911991412,1cyclictest31928-21gltestperf22:45:152
891199140,14cyclictest0-21swapper/223:30:302
891199140,14cyclictest0-21swapper/222:42:552
891199140,14cyclictest0-21swapper/222:39:012
891199140,14cyclictest0-21swapper/221:45:032
891199140,14cyclictest0-21swapper/221:38:122
891199140,14cyclictest0-21swapper/221:25:192
891199140,14cyclictest0-21swapper/220:59:022
891199140,14cyclictest0-21swapper/220:50:112
891199140,14cyclictest0-21swapper/220:45:332
891199140,14cyclictest0-21swapper/220:40:462
891199140,14cyclictest0-21swapper/220:30:272
891199140,14cyclictest0-21swapper/219:46:522
891199140,14cyclictest0-21swapper/219:25:562
891199140,14cyclictest0-21swapper/219:20:522
891199140,14cyclictest0-21swapper/219:16:382
891199140,14cyclictest0-21swapper/219:12:132
891199140,14cyclictest0-21swapper/200:34:182
891199140,14cyclictest0-21swapper/200:07:052
891199140,0cyclictest0-21swapper/223:45:532
891199140,0cyclictest0-21swapper/221:10:142
891199140,0cyclictest0-21swapper/221:02:382
891199140,0cyclictest0-21swapper/220:27:252
891199140,0cyclictest0-21swapper/219:40:222
891199140,0cyclictest0-21swapper/219:31:432
8910991414,0cyclictest0-21swapper/122:35:531
8910991414,0cyclictest0-21swapper/121:05:191
8910991414,0cyclictest0-21swapper/120:56:131
8910991414,0cyclictest0-21swapper/120:35:091
8910991414,0cyclictest0-21swapper/120:00:451
8910991414,0cyclictest0-21swapper/119:30:071
8910991414,0cyclictest0-21swapper/119:26:091
8910991413,1cyclictest18916-21sed22:15:201
891099140,14cyclictest0-21swapper/123:25:311
891099140,14cyclictest0-21swapper/122:55:081
891099140,14cyclictest0-21swapper/121:56:261
891099140,14cyclictest0-21swapper/121:44:201
891099140,14cyclictest0-21swapper/121:30:111
891099140,14cyclictest0-21swapper/120:45:031
891099140,14cyclictest0-21swapper/120:26:311
891099140,14cyclictest0-21swapper/120:20:041
891099140,14cyclictest0-21swapper/120:15:341
891099140,14cyclictest0-21swapper/119:45:341
891099140,14cyclictest0-21swapper/119:40:121
891099140,14cyclictest0-21swapper/119:37:261
891099140,14cyclictest0-21swapper/119:20:131
891099140,0cyclictest0-21swapper/123:04:211
891099140,0cyclictest0-21swapper/121:45:051
891099140,0cyclictest0-21swapper/100:32:261
8909991414,0cyclictest0-21swapper/022:43:400
8909991414,0cyclictest0-21swapper/021:40:020
8909991414,0cyclictest0-21swapper/020:51:320
8909991414,0cyclictest0-21swapper/020:45:200
8909991414,0cyclictest0-21swapper/020:25:000
8909991414,0cyclictest0-21swapper/019:30:460
8909991414,0cyclictest0-21swapper/019:11:490
8909991413,0cyclictest0-21swapper/000:20:150
890999140,14cyclictest0-21swapper/023:45:050
890999140,14cyclictest0-21swapper/023:31:060
890999140,14cyclictest0-21swapper/022:25:200
890999140,14cyclictest0-21swapper/021:57:500
890999140,14cyclictest0-21swapper/021:38:280
890999140,14cyclictest0-21swapper/021:28:080
890999140,14cyclictest0-21swapper/020:41:160
890999140,14cyclictest0-21swapper/020:30:130
890999140,14cyclictest0-21swapper/020:21:150
890999140,14cyclictest0-21swapper/019:45:090
890999140,14cyclictest0-21swapper/019:25:240
890999140,14cyclictest0-21swapper/019:21:360
890999140,0cyclictest28988-21memory21:30:150
890999140,0cyclictest0-21swapper/022:49:140
890999140,0cyclictest0-21swapper/022:35:100
890999140,0cyclictest0-21swapper/022:20:300
890999140,0cyclictest0-21swapper/021:46:170
890999140,0cyclictest0-21swapper/021:24:030
890999140,0cyclictest0-21swapper/021:12:110
890999140,0cyclictest0-21swapper/021:07:450
890999140,0cyclictest0-21swapper/019:41:150
8913991313,0cyclictest0-21swapper/322:51:023
8911991313,0cyclictest0-21swapper/223:07:322
8911991313,0cyclictest0-21swapper/222:25:542
8911991313,0cyclictest0-21swapper/222:20:182
8911991313,0cyclictest0-21swapper/221:55:202
8909991313,0cyclictest0-21swapper/022:08:420
8913991212,0cyclictest0-21swapper/321:20:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional