You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-24 - 00:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5.osadl.org (updated Thu Oct 23, 2025 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3006993028,1cyclictest0-21swapper/311:55:013
3006992926,2cyclictest21749-21awk07:50:003
300699290,28cyclictest15915-21munin-run09:55:013
300699290,28cyclictest0-21swapper/312:35:133
300699290,28cyclictest0-21swapper/308:10:133
300699290,28cyclictest0-21swapper/308:10:133
300699290,1cyclictest0-21swapper/308:05:133
300199290,28cyclictest24362-21apt-get07:55:142
2997992927,1cyclictest303-21systemd-journal09:05:001
299799290,28cyclictest2693-21apt-get10:35:111
299299290,29cyclictest0-21swapper/010:45:250
299299290,1cyclictest7985-21apt-get11:55:120
3006992827,1cyclictest17321-21awk12:15:013
3001992828,0cyclictest0-21swapper/207:25:142
3001992826,1cyclictest4735-21cron10:40:012
3001992826,1cyclictest31349-21apt-get08:10:132
3001992826,1cyclictest31349-21apt-get08:10:132
300199280,27cyclictest0-21swapper/211:35:122
300199280,0cyclictest0-21swapper/212:25:142
300199280,0cyclictest0-21swapper/210:40:142
2997992828,0cyclictest0-21swapper/109:15:141
299799280,27cyclictest16747-21apt-get11:05:141
299799280,0cyclictest7430-21apt-get10:45:161
299799280,0cyclictest28695-21apt-get11:30:131
299799280,0cyclictest0-21swapper/110:20:131
2992992826,1cyclictest4195-21sh09:30:000
299299280,28cyclictest30205-21perf10:25:000
299299280,27cyclictest0-21swapper/009:00:100
299299280,0cyclictest18521-21apt-get10:00:120
299299280,0cyclictest0-21swapper/010:55:150
299299280,0cyclictest0-21swapper/007:15:130
3006992727,0cyclictest0-21swapper/311:10:173
3006992727,0cyclictest0-21swapper/309:05:123
3006992727,0cyclictest0-21swapper/307:40:133
3006992727,0cyclictest0-21swapper/307:25:133
3006992726,1cyclictest5937-21apt-get08:25:133
3006992726,1cyclictest29299-21cron09:15:013
300699270,0cyclictest0-21swapper/310:45:173
3001992727,0cyclictest0-21swapper/211:15:142
3001992725,1cyclictest7691-21munin-run07:20:012
3001992725,1cyclictest28105-21cron11:30:022
2997992727,0cyclictest11132-21sshd12:00:171
2997992727,0cyclictest0-21swapper/111:55:111
2997992727,0cyclictest0-21swapper/110:55:141
2997992727,0cyclictest0-21swapper/110:35:011
2997992726,1cyclictest19960-21apt-get12:20:151
299799270,27cyclictest0-21swapper/109:50:131
2992992727,0cyclictest26067-21apt-get11:25:130
2992992727,0cyclictest0-21swapper/011:00:120
2992992727,0cyclictest0-21swapper/008:35:120
2992992727,0cyclictest0-21swapper/008:30:110
2992992727,0cyclictest0-21swapper/008:20:120
2992992727,0cyclictest0-21swapper/007:50:140
299299270,0cyclictest0-21swapper/011:30:020
299299270,0cyclictest0-21swapper/010:30:120
299299270,0cyclictest0-21swapper/010:10:140
299299270,0cyclictest0-21swapper/008:55:110
3006992626,0cyclictest22611-21apt-get09:00:103
3006992626,0cyclictest0-21swapper/310:30:123
3006992626,0cyclictest0-21swapper/307:50:153
3001992626,0cyclictest4476-21apt-get09:30:122
3001992626,0cyclictest10334-21apt-get12:00:132
3001992626,0cyclictest0-21swapper/211:30:132
3001992626,0cyclictest0-21swapper/207:10:162
3001992624,1cyclictest8878-21cron09:40:002
2997992626,0cyclictest0-21swapper/111:45:001
2997992626,0cyclictest0-21swapper/110:05:121
2997992626,0cyclictest0-21swapper/107:45:141
2992992626,0cyclictest0-21swapper/012:20:150
3006992525,0cyclictest0-21swapper/312:30:143
3006992525,0cyclictest0-21swapper/311:25:133
3006992525,0cyclictest0-21swapper/310:15:153
3006992524,1cyclictest11235-21cron09:45:003
2997992525,0cyclictest0-21swapper/109:55:121
2997992524,0cyclictest0-21swapper/109:20:121
2992992525,0cyclictest0-21swapper/012:10:010
2992992525,0cyclictest0-21swapper/009:20:110
2992992525,0cyclictest0-21swapper/008:45:020
2992992525,0cyclictest0-21swapper/008:10:140
2992992525,0cyclictest0-21swapper/008:10:130
2992992523,1cyclictest19664-21cron12:20:010
3001992424,0cyclictest0-21swapper/212:05:132
3001992423,1cyclictest29587-21apt-get09:15:152
2997992424,0cyclictest15024-21perf12:10:021
2997992424,0cyclictest0-21swapper/109:25:131
2997992424,0cyclictest0-21swapper/108:15:141
2997992423,1cyclictest15026-21apt-get08:45:011
2992992423,1cyclictest15282-21apt-get12:10:120
3006992323,0cyclictest12602-21apt-get07:30:123
3006992322,1cyclictest942-21apt-get11:40:133
2997992323,0cyclictest29026-21apt-get08:05:131
2997992323,0cyclictest0-21swapper/110:50:121
2997992323,0cyclictest0-21swapper/109:30:111
2997992321,1cyclictest16480-21perf11:05:001
2992992321,1cyclictest3345-21perf08:20:010
2992992321,1cyclictest12400-21munin-run12:05:010
3006992222,0cyclictest0-21swapper/308:15:133
3006992221,1cyclictest22327-21turbostat.cron09:00:003
2997992222,0cyclictest0-21swapper/112:35:131
2997992222,0cyclictest0-21swapper/112:30:131
2992992222,0cyclictest13844-21apt-get09:50:130
3006992121,0cyclictest0-21swapper/311:05:143
3006992121,0cyclictest0-21swapper/310:05:123
3001992121,0cyclictest0-21swapper/210:50:122
3001992121,0cyclictest0-21swapper/210:25:122
3001992121,0cyclictest0-21swapper/207:45:142
3001992121,0cyclictest0-21swapper/207:35:112
2997992121,0cyclictest17385-21apt-get07:40:121
2997992121,0cyclictest0-21swapper/109:35:111
2997992120,1cyclictest11265-21munin-run09:45:011
2997992020,0cyclictest0-21swapper/111:25:131
2992992020,0cyclictest0-21swapper/011:10:170
2992992020,0cyclictest0-21swapper/010:25:160
3006991919,0cyclictest10061-21perf12:00:013
3006991918,1cyclictest6234-21cut10:40:223
3001991919,0cyclictest0-21swapper/211:45:132
3001991919,0cyclictest0-21swapper/210:00:012
3001991919,0cyclictest0-21swapper/208:25:142
3001991919,0cyclictest0-21swapper/208:00:162
3001991917,1cyclictest24061-21cron07:55:012
3001991917,1cyclictest0-21swapper/211:25:022
3001991917,1cyclictest0-21swapper/209:00:002
2997991919,0cyclictest0-21swapper/108:50:121
2992991919,0cyclictest0-21swapper/011:40:120
2992991919,0cyclictest0-21swapper/008:05:130
3006991818,0cyclictest0-21swapper/311:50:003
3006991815,3cyclictest0-21swapper/312:15:153
3001991818,0cyclictest5609-21apt-get11:50:132
3001991818,0cyclictest0-21swapper/211:40:122
2997991818,0cyclictest22038-21apt-get07:50:141
2992991818,0cyclictest21779-21perf07:50:000
2992991818,0cyclictest0-21swapper/010:05:120
3006991717,0cyclictest0-21swapper/310:55:153
3001991717,0cyclictest0-21swapper/211:00:122
3001991717,0cyclictest0-21swapper/208:40:112
2992991717,0cyclictest0-21swapper/011:05:150
3006991616,0cyclictest0-21swapper/312:05:023
3006991616,0cyclictest0-21swapper/310:50:123
3006991616,0cyclictest0-21swapper/310:25:123
3006991614,1cyclictest0-21swapper/308:20:163
300699160,15cyclictest12748-21latency_hist08:40:013
3001991616,0cyclictest0-21swapper/211:00:002
3001991614,1cyclictest27564-21apt-get10:20:012
3001991614,1cyclictest0-21swapper/209:10:202
2997991616,0cyclictest0-21swapper/108:10:131
2997991616,0cyclictest0-21swapper/108:10:131
2997991615,1cyclictest7702-21awk11:55:011
299799160,15cyclictest15370-21cat08:45:001
2992991614,1cyclictest22470-21tr12:25:140
299299160,15cyclictest24553-21expr07:55:140
299299160,15cyclictest0-21swapper/010:50:180
3006991515,0cyclictest0-21swapper/309:20:123
3006991515,0cyclictest0-21swapper/309:15:153
300699150,14cyclictest25086-21if_enp1s0.807:55:173
300699150,14cyclictest0-21swapper/311:20:193
300199150,1cyclictest9938-21mii-tool09:40:142
300199150,1cyclictest0-21swapper/208:45:122
2997991514,1cyclictest16268-21cat07:35:191
2997991513,1cyclictest31508-21ntp_states10:25:171
2997991513,1cyclictest29287-21cron09:15:001
299799150,1cyclictest12817-21munin-run08:40:001
2992991515,0cyclictest0-21swapper/012:30:130
2992991515,0cyclictest0-21swapper/010:35:110
2992991514,1cyclictest0-21swapper/011:40:000
299299150,1cyclictest17353-21/usr/sbin/munin07:40:180
299299150,1cyclictest10802-21tune2fs07:25:160
299299150,1cyclictest0-21swapper/011:50:000
299299150,14cyclictest30633-21ntp_states09:15:200
3006991414,0cyclictest17395-21ps09:55:193
3006991414,0cyclictest0-21swapper/309:30:483
3006991412,1cyclictest32471-21sed11:35:213
300699140,14cyclictest0-21swapper/312:21:513
300699140,14cyclictest0-21swapper/311:30:153
300699140,14cyclictest0-21swapper/311:00:123
300699140,14cyclictest0-21swapper/310:23:093
300699140,14cyclictest0-21swapper/310:12:153
300699140,14cyclictest0-21swapper/309:45:513
300699140,14cyclictest0-21swapper/309:35:433
300699140,14cyclictest0-21swapper/308:51:333
300699140,14cyclictest0-21swapper/308:40:223
300699140,14cyclictest0-21swapper/307:37:173
300699140,14cyclictest0-21swapper/307:11:283
300699140,0cyclictest0-21swapper/312:25:123
300699140,0cyclictest0-21swapper/311:15:193
300699140,0cyclictest0-21swapper/308:45:013
300699140,0cyclictest0-21swapper/308:30:283
300699140,0cyclictest0-21swapper/308:02:573
300699140,0cyclictest0-21swapper/307:24:243
300699140,0cyclictest0-21swapper/307:19:303
3001991414,0cyclictest0-21swapper/209:45:202
3001991414,0cyclictest0-21swapper/209:05:132
3001991414,0cyclictest0-21swapper/207:40:142
300199140,14cyclictest0-21swapper/212:32:542
300199140,14cyclictest0-21swapper/211:59:222
300199140,14cyclictest0-21swapper/211:06:322
300199140,14cyclictest0-21swapper/210:45:042
300199140,14cyclictest0-21swapper/210:30:372
300199140,14cyclictest0-21swapper/210:17:432
300199140,14cyclictest0-21swapper/210:13:392
300199140,14cyclictest0-21swapper/210:07:592
300199140,14cyclictest0-21swapper/210:01:442
300199140,14cyclictest0-21swapper/209:23:332
300199140,14cyclictest0-21swapper/208:15:152
300199140,14cyclictest0-21swapper/208:05:462
300199140,0cyclictest0-21swapper/212:35:122
300199140,0cyclictest0-21swapper/212:20:312
300199140,0cyclictest0-21swapper/212:10:152
300199140,0cyclictest0-21swapper/209:03:362
300199140,0cyclictest0-21swapper/208:38:112
300199140,0cyclictest0-21swapper/207:20:192
2997991414,0cyclictest10279-21apt-get07:25:131
2997991414,0cyclictest0-21swapper/111:20:221
2997991414,0cyclictest0-21swapper/108:30:191
2997991414,0cyclictest0-21swapper/108:28:041
2997991412,1cyclictest13404-21irqstats07:30:171
299799140,14cyclictest0-21swapper/112:15:401
299799140,14cyclictest0-21swapper/112:11:351
299799140,14cyclictest0-21swapper/111:36:151
299799140,14cyclictest0-21swapper/111:10:521
299799140,14cyclictest0-21swapper/110:40:091
299799140,14cyclictest0-21swapper/110:15:101
299799140,14cyclictest0-21swapper/110:10:331
299799140,14cyclictest0-21swapper/109:45:041
299799140,14cyclictest0-21swapper/108:21:461
299799140,14cyclictest0-21swapper/108:01:111
299799140,14cyclictest0-21swapper/107:55:131
299799140,14cyclictest0-21swapper/107:21:121
299799140,14cyclictest0-21swapper/107:15:071
299799140,0cyclictest0-21swapper/112:25:581
299799140,0cyclictest0-21swapper/111:45:241
299799140,0cyclictest0-21swapper/111:18:301
299799140,0cyclictest0-21swapper/110:00:521
299799140,0cyclictest0-21swapper/109:05:101
299799140,0cyclictest0-21swapper/107:12:051
2992991414,0cyclictest0-21swapper/009:05:140
2992991414,0cyclictest0-21swapper/007:30:390
2992991414,0cyclictest0-21swapper/007:24:110
2992991412,1cyclictest5671-21cut10:40:170
299299140,14cyclictest9196-21apt-get09:40:100
299299140,14cyclictest0-21swapper/011:50:170
299299140,14cyclictest0-21swapper/011:24:540
299299140,14cyclictest0-21swapper/011:15:280
299299140,14cyclictest0-21swapper/008:52:370
299299140,14cyclictest0-21swapper/008:40:010
299299140,14cyclictest0-21swapper/008:01:130
299299140,14cyclictest0-21swapper/007:35:180
299299140,14cyclictest0-21swapper/007:11:330
299299140,0cyclictest0-21swapper/012:35:580
299299140,0cyclictest0-21swapper/010:15:380
299299140,0cyclictest0-21swapper/009:45:180
299299140,0cyclictest0-21swapper/009:37:410
299299140,0cyclictest0-21swapper/009:14:490
299299140,0cyclictest0-21swapper/008:26:040
3006991313,0cyclictest0-21swapper/310:00:463
3006991313,0cyclictest0-21swapper/309:25:093
300699130,13cyclictest0-21swapper/312:02:123
300699130,13cyclictest0-21swapper/310:36:463
3001991313,0cyclictest0-21swapper/212:17:422
3001991313,0cyclictest0-21swapper/209:51:212
3001991313,0cyclictest0-21swapper/209:25:012
3001991313,0cyclictest0-21swapper/208:52:562
3001991313,0cyclictest0-21swapper/208:31:372
3001991313,0cyclictest0-21swapper/207:30:472
300199130,13cyclictest0-21swapper/211:10:052
300199130,13cyclictest0-21swapper/208:20:532
2997991313,0cyclictest0-21swapper/108:55:141
299299130,0cyclictest0-21swapper/009:34:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional