You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-26 - 18:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5.osadl.org (updated Tue Aug 26, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2290099310,30cyclictest18766-21cron08:10:012
22901993028,1cyclictest18762-21cron08:10:023
2290199300,29cyclictest3865-21awk11:05:013
2290199300,29cyclictest1-21systemd10:25:013
2290099300,29cyclictest626-21gdbus07:25:012
2290099300,1cyclictest303-21systemd-journal11:05:012
2289499300,29cyclictest11770-21cron07:55:011
22901992927,2cyclictest30116-21awk07:25:023
22901992927,1cyclictest626-21gdbus10:40:003
2290199290,28cyclictest0-21swapper/308:40:013
22900992928,0cyclictest18123-21apt-get11:35:142
22900992927,1cyclictest11138-21munin-run12:30:002
2290099290,28cyclictest0-21swapper/212:15:122
2290099290,28cyclictest0-21swapper/210:30:182
2290099290,28cyclictest0-21swapper/209:35:122
22894992927,1cyclictest25856-21munin-run08:25:001
2289499290,28cyclictest27250-21apt-get10:45:141
2289499290,28cyclictest19631-21munin-run10:30:001
2289499290,1cyclictest1790-21awk12:10:011
2289299290,28cyclictest673-21apt-get08:40:110
2289299290,28cyclictest673-21apt-get08:40:110
2289299290,28cyclictest16736-21apt-get08:05:150
2289299290,28cyclictest0-21swapper/009:20:130
22901992826,1cyclictest0-21swapper/308:50:013
22900992827,0cyclictest13465-21apt-get11:25:122
22900992826,1cyclictest303-21systemd-journal11:35:002
22900992825,2cyclictest13427-21cron12:35:012
2290099280,0cyclictest0-21swapper/208:35:132
2290099280,0cyclictest0-21swapper/208:25:122
22894992827,1cyclictest27503-21apt-get11:55:121
22894992827,0cyclictest12342-21apt-get09:05:171
22894992824,4cyclictest0-21swapper/108:05:141
22894992823,5cyclictest626-21gdbus09:30:001
2289499280,0cyclictest32731-21apt-get07:30:121
2289499280,0cyclictest22276-21apt-get10:35:171
22892992828,0cyclictest0-21swapper/007:35:130
22892992827,0cyclictest0-21swapper/008:30:120
2289299280,27cyclictest0-21swapper/008:45:120
22901992727,0cyclictest32170-21apt-get12:05:133
22901992727,0cyclictest0-21swapper/312:15:133
22901992727,0cyclictest0-21swapper/310:30:183
22901992727,0cyclictest0-21swapper/309:35:133
22901992727,0cyclictest0-21swapper/309:10:153
22901992727,0cyclictest0-21swapper/308:55:003
22900992727,0cyclictest14668-21apt-get09:10:162
22900992727,0cyclictest0-21swapper/211:15:142
2290099270,27cyclictest0-21swapper/207:55:152
22894992727,0cyclictest11143-21apt-get11:20:121
22894992727,0cyclictest0-21swapper/112:30:161
22894992726,0cyclictest15240-21apt-get10:20:121
22894992725,1cyclictest0-21swapper/110:35:011
2289499270,0cyclictest0-21swapper/111:35:151
2289499270,0cyclictest0-21swapper/107:30:001
22892992727,0cyclictest14413-21apt-get08:00:150
22892992727,0cyclictest10569-21apt-get10:10:130
22892992727,0cyclictest0-21swapper/011:55:120
22901992626,0cyclictest0-21swapper/311:35:143
22901992626,0cyclictest0-21swapper/308:30:123
22901992626,0cyclictest0-21swapper/307:55:153
22901992625,1cyclictest11135-21perf12:30:013
22901992625,1cyclictest0-21swapper/308:25:113
22900992626,0cyclictest0-21swapper/210:55:142
22900992626,0cyclictest0-21swapper/210:35:162
22900992626,0cyclictest0-21swapper/209:20:142
22900992625,1cyclictest4148-21apt-get11:05:122
22900992624,1cyclictest0-21swapper/208:45:012
22900992624,1cyclictest0-21swapper/208:45:002
22894992626,0cyclictest0-21swapper/108:30:131
22894992626,0cyclictest0-21swapper/108:00:131
22894992624,1cyclictest303-21systemd-journal07:45:011
22894992624,1cyclictest0-21swapper/109:00:011
22892992626,0cyclictest3581-21apt-get09:55:150
22892992626,0cyclictest0-21swapper/011:15:140
22892992626,0cyclictest0-21swapper/008:55:140
22901992525,0cyclictest0-21swapper/311:25:133
22901992525,0cyclictest0-21swapper/311:15:153
22901992524,1cyclictest609-21dbus-daemon11:35:003
22900992525,0cyclictest0-21swapper/210:00:142
22900992524,1cyclictest9458-21dump-pmu-power07:50:012
22900992523,1cyclictest10569-21apt-get10:10:142
22894992525,0cyclictest0-21swapper/111:50:131
22892992525,0cyclictest0-21swapper/011:35:150
22892992525,0cyclictest0-21swapper/009:50:120
22892992525,0cyclictest0-21swapper/009:15:120
22892992525,0cyclictest0-21swapper/009:10:140
22892992518,6cyclictest29072-21needreboot07:20:200
22901992424,0cyclictest0-21swapper/309:20:143
22901992423,1cyclictest13438-21sh12:35:013
22900992424,0cyclictest0-21swapper/211:20:122
22900992424,0cyclictest0-21swapper/207:10:132
22900992422,1cyclictest16477-21munin-run08:05:012
22894992424,0cyclictest19643-21apt-get09:20:131
22894992424,0cyclictest0-21swapper/110:55:131
22894992424,0cyclictest0-21swapper/107:35:141
22892992424,0cyclictest0-21swapper/010:35:170
22892992422,1cyclictest25836-21cron08:25:000
22901992323,0cyclictest0-21swapper/311:05:123
22901992323,0cyclictest0-21swapper/310:00:133
22901992322,1cyclictest9457-21turbostat.cron07:50:013
22900992323,0cyclictest0-21swapper/211:40:122
22900992323,0cyclictest0-21swapper/210:05:142
22894992323,0cyclictest4137-21perf12:15:001
22892992320,2cyclictest8503-21cron11:15:010
22901992222,0cyclictest0-21swapper/311:20:133
22901992222,0cyclictest0-21swapper/308:45:013
22901992222,0cyclictest0-21swapper/308:45:013
22901992222,0cyclictest0-21swapper/307:10:133
22894992222,0cyclictest0-21swapper/107:55:131
22892992222,0cyclictest0-21swapper/009:05:160
22901992121,0cyclictest0-21swapper/311:40:123
22901992121,0cyclictest0-21swapper/310:10:143
22901992121,0cyclictest0-21swapper/310:05:143
2290199210,9cyclictest0-21swapper/309:50:113
22900992121,0cyclictest0-21swapper/209:15:132
22900992120,0cyclictest0-21swapper/210:25:112
22900992119,1cyclictest23498-21sendmail-msp08:20:002
22892992121,0cyclictest19062-21apt-get08:10:150
22901992020,0cyclictest0-21swapper/308:05:023
22900992020,0cyclictest0-21swapper/212:35:132
22900992020,0cyclictest0-21swapper/211:50:132
22900992018,1cyclictest31887-21cron12:05:022
22901991919,0cyclictest0-21swapper/309:15:133
22901991917,1cyclictest23496-21cron08:20:003
22900991918,0cyclictest9740-21apt-get07:50:132
22900991917,1cyclictest26422-21munin-run09:35:002
22894991919,0cyclictest0-21swapper/111:15:141
22894991919,0cyclictest0-21swapper/110:05:131
22892991919,0cyclictest5345-21apt-get08:50:140
22892991919,0cyclictest2083-21apt-get12:10:160
22892991917,1cyclictest15530-21munin-run11:30:010
22901991818,0cyclictest0-21swapper/312:35:133
22901991818,0cyclictest0-21swapper/310:25:113
22901991816,1cyclictest31885-21idleruntime-cro12:05:023
22900991818,0cyclictest3315-21perf09:55:002
22900991818,0cyclictest0-21swapper/212:05:132
22900991816,1cyclictest0-21swapper/207:30:112
22894991818,0cyclictest0-21swapper/109:30:171
22894991818,0cyclictest0-21swapper/109:10:161
22892991818,0cyclictest0-21swapper/011:00:000
22892991817,1cyclictest11403-21apt-get12:30:180
22892991817,1cyclictest0-21swapper/011:25:000
22900991716,1cyclictest0-21swapper/211:10:152
22900991715,1cyclictest303-21systemd-journal07:40:012
22901991614,1cyclictest0-21swapper/309:05:243
22901991614,1cyclictest0-21swapper/308:55:143
22901991613,2cyclictest4777-21cron07:40:003
22900991614,1cyclictest0-21swapper/207:25:142
22894991616,0cyclictest1832-21apt-get11:00:151
2289499160,15cyclictest32004-21munin-run12:05:011
22892991616,0cyclictest23408-21apt-get07:10:120
22892991614,1cyclictest24924-21munin-run11:50:000
2289299160,15cyclictest29657-21gltestperf09:40:160
2289299160,15cyclictest27673-21diskstats10:45:150
22901991515,0cyclictest32731-21apt-get07:30:123
22901991515,0cyclictest0-21swapper/309:35:013
22901991515,0cyclictest0-21swapper/307:50:133
22900991513,1cyclictest25089-21grep08:20:192
22900991513,1cyclictest0-21swapper/208:45:152
2290099150,14cyclictest0-21swapper/209:05:252
2289499150,1cyclictest21426-21memory11:40:181
2289499150,14cyclictest0-21swapper/111:25:211
22892991515,0cyclictest0-21swapper/010:05:130
22892991515,0cyclictest0-21swapper/007:55:130
22892991514,1cyclictest0-21swapper/011:30:150
22892991513,1cyclictest1824-21munin-run12:10:010
22892991513,1cyclictest0-21swapper/007:55:010
2289299150,1cyclictest811-21runrttasks09:00:210
2289299150,1cyclictest0-21swapper/012:35:220
2289299150,14cyclictest9443-21cron07:50:000
22901991414,0cyclictest0-21swapper/312:24:173
22901991414,0cyclictest0-21swapper/311:10:153
2290199140,14cyclictest0-21swapper/310:50:363
2290199140,14cyclictest0-21swapper/310:49:443
2290199140,14cyclictest0-21swapper/310:40:183
2290199140,14cyclictest0-21swapper/310:18:403
2290199140,14cyclictest0-21swapper/309:41:383
2290199140,14cyclictest0-21swapper/309:03:273
2290199140,14cyclictest0-21swapper/308:23:203
2290199140,14cyclictest0-21swapper/307:15:293
2290199140,0cyclictest0-21swapper/312:11:373
2290199140,0cyclictest0-21swapper/309:58:373
2290199140,0cyclictest0-21swapper/309:46:103
2290199140,0cyclictest0-21swapper/307:26:213
22900991414,0cyclictest0-21swapper/209:41:152
22900991412,1cyclictest22748-21awk09:25:162
2290099140,14cyclictest0-21swapper/212:10:132
2290099140,14cyclictest0-21swapper/211:48:232
2290099140,14cyclictest0-21swapper/210:52:222
2290099140,14cyclictest0-21swapper/209:45:502
2290099140,14cyclictest0-21swapper/209:00:272
2290099140,14cyclictest0-21swapper/208:50:092
2290099140,14cyclictest0-21swapper/208:30:202
2290099140,14cyclictest0-21swapper/208:10:192
2290099140,14cyclictest0-21swapper/207:43:462
2290099140,14cyclictest0-21swapper/207:15:062
2290099140,0cyclictest0-21swapper/212:22:352
2290099140,0cyclictest0-21swapper/209:55:212
22894991414,0cyclictest26117-21apt-get08:25:121
22894991414,0cyclictest0-21swapper/112:16:031
22894991414,0cyclictest0-21swapper/111:05:111
22894991414,0cyclictest0-21swapper/110:52:111
22894991414,0cyclictest0-21swapper/110:15:171
22894991414,0cyclictest0-21swapper/110:03:231
22894991414,0cyclictest0-21swapper/109:55:541
22894991414,0cyclictest0-21swapper/109:46:181
22894991414,0cyclictest0-21swapper/108:50:121
22894991414,0cyclictest0-21swapper/108:43:031
22894991414,0cyclictest0-21swapper/108:43:031
22894991414,0cyclictest0-21swapper/107:16:561
22894991414,0cyclictest0-21swapper/107:12:301
22894991413,1cyclictest24338-21apt-get10:40:021
22894991412,1cyclictest24505-21users11:45:271
22894991412,1cyclictest10652-21cut09:00:151
2289499140,14cyclictest0-21swapper/112:38:411
2289499140,14cyclictest0-21swapper/112:25:171
2289499140,14cyclictest0-21swapper/112:20:201
2289499140,14cyclictest0-21swapper/110:10:411
2289499140,14cyclictest0-21swapper/109:53:211
2289499140,14cyclictest0-21swapper/109:40:461
2289499140,14cyclictest0-21swapper/108:36:261
2289499140,14cyclictest0-21swapper/108:16:141
2289499140,14cyclictest0-21swapper/107:46:041
2289499140,0cyclictest0-21swapper/111:32:081
2289499140,0cyclictest0-21swapper/109:35:081
2289499140,0cyclictest0-21swapper/109:15:411
2289499140,0cyclictest0-21swapper/107:20:231
22892991414,0cyclictest0-21swapper/011:01:410
22892991414,0cyclictest0-21swapper/009:35:540
22892991414,0cyclictest0-21swapper/008:25:120
22892991414,0cyclictest0-21swapper/008:15:590
22892991414,0cyclictest0-21swapper/007:31:430
22892991414,0cyclictest0-21swapper/007:15:090
2289299140,14cyclictest0-21swapper/012:25:290
2289299140,14cyclictest0-21swapper/012:20:230
2289299140,14cyclictest0-21swapper/012:19:010
2289299140,14cyclictest0-21swapper/010:16:290
2289299140,14cyclictest0-21swapper/009:30:470
2289299140,14cyclictest0-21swapper/009:25:330
2289299140,0cyclictest0-21swapper/012:03:150
2289299140,0cyclictest0-21swapper/011:54:070
2289299140,0cyclictest0-21swapper/011:40:220
2289299140,0cyclictest0-21swapper/011:05:450
2289299140,0cyclictest0-21swapper/010:53:420
2289299140,0cyclictest0-21swapper/010:41:140
2289299140,0cyclictest0-21swapper/007:40:010
2289299140,0cyclictest0-21swapper/007:25:040
22901991313,0cyclictest0-21swapper/311:45:573
22901991313,0cyclictest0-21swapper/309:25:153
22901991313,0cyclictest0-21swapper/308:10:193
22901991313,0cyclictest0-21swapper/307:41:263
2290199130,0cyclictest0-21swapper/311:56:173
22900991313,0cyclictest0-21swapper/211:55:232
22900991313,0cyclictest0-21swapper/210:45:272
22900991313,0cyclictest0-21swapper/208:55:082
2290099130,0cyclictest0-21swapper/210:41:352
2290099130,0cyclictest0-21swapper/210:16:212
22894991313,0cyclictest0-21swapper/111:10:201
22894991313,0cyclictest0-21swapper/108:10:491
22892991313,0cyclictest0-21swapper/010:31:130
22892991313,0cyclictest0-21swapper/010:25:380
22892991313,0cyclictest0-21swapper/010:20:450
22892991313,0cyclictest0-21swapper/010:02:280
22900991212,0cyclictest0-21swapper/210:20:472
22894991212,0cyclictest0-21swapper/108:46:351
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional