You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 18:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Wed Nov 26, 2025 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1248599340,29cyclictest1-21systemd07:25:012
12485993126,4cyclictest609-21dbus-daemon08:55:002
12490993028,1cyclictest31480-21awk11:15:013
1249099300,29cyclictest303-21systemd-journal07:30:013
12477993028,1cyclictest26788-21cron07:40:000
1247799301,1cyclictest63250irq/126-eno108:45:120
1249099290,28cyclictest6692-21apt-get08:05:133
1249099290,28cyclictest0-21swapper/311:55:133
1249099290,28cyclictest0-21swapper/308:30:123
1249099290,28cyclictest0-21swapper/307:45:133
1249099290,1cyclictest8454-21perf11:35:003
12485992927,1cyclictest32319-21cron09:00:002
12485992927,1cyclictest22444-21awk12:05:012
1248599290,28cyclictest3190-21munin-run10:15:002
1248099290,28cyclictest3766-21munin-run11:25:021
1248099290,28cyclictest20973-21apt-get08:35:101
1248099290,1cyclictest609-21dbus-daemon09:25:011
1248099290,1cyclictest27376-21apt-get12:15:141
12477992929,0cyclictest0-21swapper/010:04:020
12490992828,0cyclictest24652-21apt-get07:35:123
1249099280,0cyclictest17383-21apt-get07:20:143
12485992826,1cyclictest31788-21munin-run12:25:002
12485992826,1cyclictest1682-21cron07:55:012
12485992825,3cyclictest0-21swapper/207:35:122
1248599280,27cyclictest0-21swapper/210:40:012
1248599280,27cyclictest0-21swapper/209:15:122
1248599280,1cyclictest20129-21munin-run12:00:012
1248599280,1cyclictest0-21swapper/210:20:002
1248599280,0cyclictest0-21swapper/209:40:132
12480992828,0cyclictest0-21swapper/111:40:131
12480992828,0cyclictest0-21swapper/110:20:131
12480992826,1cyclictest15438-21cron11:50:001
1248099280,28cyclictest0-21swapper/108:10:131
1248099280,0cyclictest20405-21apt-get12:00:121
1247799280,28cyclictest0-21swapper/011:30:110
1247799280,27cyclictest0-21swapper/010:45:120
1247799280,0cyclictest25053-21apt-get12:10:130
1247799280,0cyclictest14605-21apt-get09:30:110
12490992727,0cyclictest0-21swapper/311:40:133
12490992727,0cyclictest0-21swapper/311:35:133
12490992727,0cyclictest0-21swapper/310:35:133
12490992727,0cyclictest0-21swapper/310:20:123
12485992727,0cyclictest1968-21apt-get07:55:132
12485992727,0cyclictest0-21swapper/212:35:122
12485992727,0cyclictest0-21swapper/208:40:152
12485992726,1cyclictest27670-21cron08:50:002
12480992727,0cyclictest0-21swapper/112:25:121
12480992727,0cyclictest0-21swapper/109:55:121
12480992727,0cyclictest0-21swapper/109:45:141
12480992727,0cyclictest0-21swapper/109:25:151
12480992726,1cyclictest23322-21apt-get08:40:141
1248099270,0cyclictest4279-21apt-get12:35:121
1248099270,0cyclictest0-21swapper/107:55:121
12477992727,0cyclictest0-21swapper/010:35:120
12477992727,0cyclictest0-21swapper/008:05:140
12477992727,0cyclictest0-21swapper/007:50:120
12477992725,1cyclictest22158-21cron10:55:000
12490992626,0cyclictest0-21swapper/310:00:113
12490992625,1cyclictest20127-21apt-get10:50:123
12485992626,0cyclictest5848-21apt-get10:20:132
12485992626,0cyclictest0-21swapper/211:20:122
12485992626,0cyclictest0-21swapper/210:05:112
12485992624,1cyclictest31472-21cron07:50:022
12480992626,0cyclictest0-21swapper/112:10:121
12477992626,0cyclictest0-21swapper/011:50:130
12477992626,0cyclictest0-21swapper/007:30:120
12490992525,0cyclictest0-21swapper/310:10:123
12490992525,0cyclictest0-21swapper/309:08:033
12490992525,0cyclictest0-21swapper/308:25:123
12485992525,0cyclictest9644-21apt-get09:20:112
12485992525,0cyclictest0-21swapper/212:30:122
12485992525,0cyclictest0-21swapper/211:35:132
12485992525,0cyclictest0-21swapper/210:50:122
12480992525,0cyclictest0-21swapper/109:50:121
12480992525,0cyclictest0-21swapper/107:20:141
12480992523,1cyclictest0-21swapper/109:45:011
12477992525,0cyclictest21902-21apt-get09:45:140
12477992525,0cyclictest0-21swapper/011:25:140
12477992525,0cyclictest0-21swapper/010:40:140
12477992525,0cyclictest0-21swapper/010:30:140
12490992424,0cyclictest0-21swapper/312:05:133
12490992424,0cyclictest0-21swapper/311:05:113
12490992424,0cyclictest0-21swapper/308:10:123
12490992423,0cyclictest0-21swapper/307:15:143
12485992424,0cyclictest0-21swapper/212:10:122
12485992424,0cyclictest0-21swapper/209:45:142
12485992424,0cyclictest0-21swapper/208:35:112
12485992422,1cyclictest14033-21apt-get09:30:022
12480992424,0cyclictest0-21swapper/110:10:141
12480992424,0cyclictest0-21swapper/109:15:131
12480992424,0cyclictest0-21swapper/108:05:131
12480992424,0cyclictest0-21swapper/107:40:131
12480992424,0cyclictest0-21swapper/107:35:131
12477992424,0cyclictest0-21swapper/010:25:120
12477992424,0cyclictest0-21swapper/010:15:120
12477992424,0cyclictest0-21swapper/008:30:120
12477992422,1cyclictest14052-21http09:30:000
12490992323,0cyclictest0-21swapper/311:20:123
12490992323,0cyclictest0-21swapper/309:15:133
12490992323,0cyclictest0-21swapper/308:45:133
12490992321,1cyclictest303-21systemd-journal10:45:013
12485992323,0cyclictest27105-21apt-get07:40:142
12485992323,0cyclictest0-21swapper/212:05:122
12485992323,0cyclictest0-21swapper/210:00:112
12485992323,0cyclictest0-21swapper/208:15:122
12485992321,1cyclictest15474-21munin-run11:50:002
12480992323,0cyclictest0-21swapper/112:05:131
12480992323,0cyclictest0-21swapper/108:45:121
12480992323,0cyclictest0-21swapper/108:25:131
12477992323,0cyclictest0-21swapper/011:55:130
12490992222,0cyclictest0-21swapper/311:00:123
12485992222,0cyclictest0-21swapper/209:50:122
12485992222,0cyclictest0-21swapper/209:05:102
12480992222,0cyclictest24799-21apt-get11:00:111
12480992222,0cyclictest0-21swapper/107:25:021
12477992222,0cyclictest24222-21apt-get09:50:120
12490992120,1cyclictest0-21swapper/309:10:133
12490992119,1cyclictest24479-21cron11:00:003
12477992121,0cyclictest0-21swapper/009:00:100
12490992020,0cyclictest0-21swapper/312:20:123
12490992020,0cyclictest0-21swapper/311:55:023
12477992020,0cyclictest0-21swapper/007:45:130
12477992018,1cyclictest18060-21dump-pmu-power08:30:000
12490991917,1cyclictest0-21swapper/307:55:123
12480991919,0cyclictest30289-21apt-get08:55:121
12480991919,0cyclictest0-21swapper/110:50:121
1249099185,0cyclictest0-21swapper/312:02:293
12490991818,0cyclictest0-21swapper/308:40:143
12490991816,1cyclictest820-21sh10:10:003
12480991818,0cyclictest0-21swapper/110:05:111
12480991817,1cyclictest609-21dbus-daemon09:05:001
12477991818,0cyclictest0-21swapper/011:05:120
12477991817,1cyclictest17228-21apt-get09:35:110
12490991717,0cyclictest0-21swapper/310:45:133
12480991717,0cyclictest0-21swapper/112:30:121
12477991717,0cyclictest29723-21apt-get12:20:120
12477991717,0cyclictest0-21swapper/011:15:120
12477991717,0cyclictest0-21swapper/007:40:130
12477991716,1cyclictest0-21swapper/008:20:140
12490991614,1cyclictest28630-21munin-run10:00:003
12485991616,0cyclictest0-21swapper/210:55:122
12480991616,0cyclictest14883-21cron10:40:011
12480991616,0cyclictest0-21swapper/109:30:011
12480991615,1cyclictest10779-21sendmail-msp11:40:001
12477991616,0cyclictest27963-21apt-get08:50:110
12477991614,1cyclictest0-21swapper/012:05:160
12490991515,0cyclictest0-21swapper/312:25:123
12490991515,0cyclictest0-21swapper/309:30:013
12490991513,1cyclictest27121-21munin-run12:15:013
12490991513,1cyclictest0-21swapper/309:45:233
1249099150,1cyclictest0-21swapper/308:00:213
12485991515,0cyclictest0-21swapper/208:25:112
12485991513,1cyclictest10637-21unixbench_singl08:10:202
1248599150,1cyclictest16655-21apt-get09:35:012
1248599150,1cyclictest0-21swapper/207:20:012
1248599150,14cyclictest22966-21cut07:30:142
12480991514,1cyclictest3444-21apt-get10:15:131
1248099150,1cyclictest8218-21/usr/sbin/munin10:25:121
1248099150,1cyclictest0-21swapper/112:20:221
12477991515,0cyclictest0-21swapper/010:55:130
12477991515,0cyclictest0-21swapper/008:00:140
12477991514,1cyclictest0-21swapper/009:20:010
12477991513,1cyclictest5324-21ntp_states12:35:170
12477991513,1cyclictest0-21swapper/008:40:190
12490991414,0cyclictest0-21swapper/311:18:333
12490991414,0cyclictest0-21swapper/310:30:573
12490991414,0cyclictest0-21swapper/309:50:173
12490991414,0cyclictest0-21swapper/307:30:123
12490991413,1cyclictest0-21swapper/309:00:123
1249099140,14cyclictest0-21swapper/312:30:133
1249099140,14cyclictest0-21swapper/311:26:223
1249099140,14cyclictest0-21swapper/310:25:573
1249099140,14cyclictest0-21swapper/310:15:183
1249099140,14cyclictest0-21swapper/309:21:233
1249099140,14cyclictest0-21swapper/308:37:163
1249099140,14cyclictest0-21swapper/308:20:413
1249099140,14cyclictest0-21swapper/307:41:363
1249099140,0cyclictest0-21swapper/312:38:303
1249099140,0cyclictest0-21swapper/312:16:453
1249099140,0cyclictest0-21swapper/311:45:213
1249099140,0cyclictest0-21swapper/309:37:473
1249099140,0cyclictest0-21swapper/308:56:023
1249099140,0cyclictest0-21swapper/308:51:453
1249099140,0cyclictest0-21swapper/308:15:123
1249099140,0cyclictest0-21swapper/307:52:323
1249099140,0cyclictest0-21swapper/307:12:433
12485991414,0cyclictest20002-21apt-get07:25:102
12485991414,0cyclictest0-21swapper/207:10:142
1248599140,14cyclictest0-21swapper/211:53:512
1248599140,14cyclictest0-21swapper/211:40:332
1248599140,14cyclictest0-21swapper/211:30:232
1248599140,14cyclictest0-21swapper/211:25:432
1248599140,14cyclictest0-21swapper/211:19:292
1248599140,14cyclictest0-21swapper/211:10:222
1248599140,14cyclictest0-21swapper/211:09:472
1248599140,14cyclictest0-21swapper/210:40:512
1248599140,14cyclictest0-21swapper/210:33:362
1248599140,14cyclictest0-21swapper/210:25:182
1248599140,14cyclictest0-21swapper/209:55:212
1248599140,14cyclictest0-21swapper/209:25:562
1248599140,14cyclictest0-21swapper/208:31:312
1248599140,14cyclictest0-21swapper/208:23:052
1248599140,14cyclictest0-21swapper/208:09:452
1248599140,14cyclictest0-21swapper/208:00:252
1248599140,0cyclictest0-21swapper/212:28:572
1248599140,0cyclictest0-21swapper/212:15:132
1248599140,0cyclictest0-21swapper/211:03:212
1248599140,0cyclictest0-21swapper/210:45:202
1248599140,0cyclictest0-21swapper/209:12:462
12480991414,0cyclictest0-21swapper/110:55:081
12480991414,0cyclictest0-21swapper/110:30:101
12480991414,0cyclictest0-21swapper/109:35:011
12480991414,0cyclictest0-21swapper/109:12:221
12480991414,0cyclictest0-21swapper/107:30:391
12480991411,2cyclictest30484-21ntp_states07:45:181
1248099140,14cyclictest15032-21apt-get07:15:141
1248099140,14cyclictest0-21swapper/111:58:431
1248099140,14cyclictest0-21swapper/111:32:031
1248099140,14cyclictest0-21swapper/111:26:591
1248099140,14cyclictest0-21swapper/111:17:131
1248099140,14cyclictest0-21swapper/111:10:131
1248099140,14cyclictest0-21swapper/110:45:111
1248099140,14cyclictest0-21swapper/110:01:531
1248099140,14cyclictest0-21swapper/108:30:401
1248099140,14cyclictest0-21swapper/108:20:151
1248099140,14cyclictest0-21swapper/108:16:251
1248099140,14cyclictest0-21swapper/107:50:021
1248099140,14cyclictest0-21swapper/107:12:121
1248099140,0cyclictest0-21swapper/111:52:111
1248099140,0cyclictest0-21swapper/110:41:361
1248099140,0cyclictest0-21swapper/109:08:211
1248099140,0cyclictest0-21swapper/108:50:371
1248099140,0cyclictest0-21swapper/108:00:201
12477991414,0cyclictest0-21swapper/011:41:240
12477991414,0cyclictest0-21swapper/009:10:140
12477991414,0cyclictest0-21swapper/009:07:500
12477991414,0cyclictest0-21swapper/008:15:120
12477991414,0cyclictest0-21swapper/008:10:370
12477991414,0cyclictest0-21swapper/007:11:410
12477991413,1cyclictest0-21swapper/009:55:180
1247799140,14cyclictest0-21swapper/012:31:160
1247799140,14cyclictest0-21swapper/012:16:570
1247799140,14cyclictest0-21swapper/011:38:010
1247799140,14cyclictest0-21swapper/011:10:130
1247799140,14cyclictest0-21swapper/010:21:340
1247799140,14cyclictest0-21swapper/010:05:270
1247799140,14cyclictest0-21swapper/009:44:380
1247799140,14cyclictest0-21swapper/008:55:060
1247799140,14cyclictest0-21swapper/008:37:220
1247799140,0cyclictest0-21swapper/012:25:160
1247799140,0cyclictest0-21swapper/011:48:570
1247799140,0cyclictest0-21swapper/011:21:000
1247799140,0cyclictest0-21swapper/011:00:330
1247799140,0cyclictest0-21swapper/010:10:100
1247799140,0cyclictest0-21swapper/009:20:320
1247799140,0cyclictest0-21swapper/007:55:010
1247799140,0cyclictest0-21swapper/007:27:130
1247799140,0cyclictest0-21swapper/007:20:370
1247799140,0cyclictest0-21swapper/007:15:060
12490991313,0cyclictest0-21swapper/309:44:323
1249099130,0cyclictest0-21swapper/309:25:383
12477991313,0cyclictest0-21swapper/012:00:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional