You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-06 - 16:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5.osadl.org (updated Thu Nov 06, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3060899340,30cyclictest1379-21/usr/sbin/munin08:25:150
30611993029,1cyclictest613-21in:imuxsock08:59:593
3060899300,29cyclictest609-21dbus-daemon11:55:010
30611992927,1cyclictest0-21swapper/312:30:003
3061199290,28cyclictest7788-21apt-get07:30:113
3061199290,28cyclictest16590-21awk11:15:013
3061199290,28cyclictest0-21swapper/311:15:133
3061199290,28cyclictest0-21swapper/310:45:123
30610992928,1cyclictest20419-21apt-get09:05:142
30610992927,1cyclictest0-21swapper/207:35:012
3061099290,28cyclictest489-21apt-get10:40:152
30609992927,1cyclictest21278-21perf11:25:001
30609992927,1cyclictest0-21swapper/109:19:591
3060999290,28cyclictest1080-21apt-get11:50:121
3060999290,28cyclictest0-21swapper/107:45:011
3060999290,1cyclictest21900-21munin-run12:35:011
30608992927,1cyclictest609-21dbus-daemon09:50:000
3060899290,28cyclictest29153-21apt-get08:15:110
3060899290,28cyclictest15745-21apt-get08:55:120
30611992828,0cyclictest0-21swapper/310:30:103
30611992827,1cyclictest0-21swapper/308:20:123
3061199280,0cyclictest0-21swapper/311:05:133
30610992828,0cyclictest0-21swapper/208:15:102
30610992827,1cyclictest626-21gdbus11:50:012
30610992827,0cyclictest0-21swapper/211:15:132
3061099280,27cyclictest0-21swapper/212:20:142
3061099280,27cyclictest0-21swapper/209:25:132
3061099280,27cyclictest0-21swapper/209:25:122
3060999280,28cyclictest0-21swapper/108:35:121
3060899280,0cyclictest0-21swapper/012:15:150
3060899280,0cyclictest0-21swapper/008:10:140
30611992727,0cyclictest0-21swapper/310:55:133
3061199270,27cyclictest0-21swapper/307:35:133
3061199270,0cyclictest0-21swapper/307:10:153
30610992727,0cyclictest23623-21apt-get10:20:112
30610992727,0cyclictest19230-21apt-get11:20:152
30610992727,0cyclictest0-21swapper/212:25:122
30610992727,0cyclictest0-21swapper/209:55:152
3061099270,27cyclictest0-21swapper/210:00:122
3061099270,0cyclictest0-21swapper/210:25:132
3061099270,0cyclictest0-21swapper/209:15:122
30609992727,0cyclictest12232-21apt-get11:05:131
30609992727,0cyclictest0-21swapper/109:30:121
3060999270,27cyclictest0-21swapper/107:10:141
30608992727,0cyclictest9045-21apt-get09:50:000
30608992727,0cyclictest21550-21apt-get11:25:120
30608992727,0cyclictest0-21swapper/010:45:120
30608992727,0cyclictest0-21swapper/010:40:150
3060899270,0cyclictest22160-21apt-get12:35:140
30610992613,13cyclictest0-21swapper/210:30:102
30609992626,0cyclictest0-21swapper/109:35:121
30609992626,0cyclictest0-21swapper/108:20:121
30609992625,1cyclictest20162-21munin-run09:05:001
30609992625,1cyclictest17517-21apt-get07:50:101
30609992624,1cyclictest16335-21cron10:05:001
30609992624,1cyclictest0-21swapper/110:40:001
30608992626,0cyclictest3413-21apt-get11:55:120
30608992626,0cyclictest0-21swapper/011:35:150
30608992626,0cyclictest0-21swapper/011:30:120
30608992626,0cyclictest0-21swapper/011:15:130
30608992626,0cyclictest0-21swapper/007:45:130
30608992625,1cyclictest10540-21munin-run08:45:010
30611992525,0cyclictest0-21swapper/309:00:133
30610992525,0cyclictest0-21swapper/209:45:122
30610992525,0cyclictest0-21swapper/208:10:142
30609992525,0cyclictest0-21swapper/110:55:131
30609992525,0cyclictest0-21swapper/110:15:121
30608992525,0cyclictest0-21swapper/012:05:120
30608992525,0cyclictest0-21swapper/009:15:120
30608992523,1cyclictest626-21gdbus07:55:010
30611992424,0cyclictest0-21swapper/311:50:023
30611992424,0cyclictest0-21swapper/310:10:133
30611992422,1cyclictest31193-21cron08:20:003
30610992424,0cyclictest0-21swapper/208:55:122
30609992424,0cyclictest0-21swapper/107:55:101
30611992323,0cyclictest0-21swapper/309:40:143
30611992323,0cyclictest0-21swapper/307:45:123
30610992323,0cyclictest8137-21apt-get12:05:112
30610992323,0cyclictest0-21swapper/211:10:122
30610992323,0cyclictest0-21swapper/208:30:122
30610992321,1cyclictest7851-21awk12:05:012
30609992323,0cyclictest0-21swapper/112:10:121
30609992323,0cyclictest0-21swapper/110:50:131
30609992323,0cyclictest0-21swapper/107:25:101
30608992323,0cyclictest0-21swapper/012:30:120
30608992322,1cyclictest18668-21cron10:10:010
30611992220,1cyclictest2794-21cron07:20:013
30610992222,0cyclictest0-21swapper/210:35:142
30610992222,0cyclictest0-21swapper/209:50:112
30610992222,0cyclictest0-21swapper/208:05:142
30609992222,0cyclictest0-21swapper/109:25:001
30609992220,1cyclictest16620-21munin-run11:15:011
30608992222,0cyclictest0-21swapper/011:10:130
30608992222,0cyclictest0-21swapper/010:50:120
30608992222,0cyclictest0-21swapper/009:20:120
30611992121,0cyclictest0-21swapper/311:45:123
30611992119,1cyclictest0-21swapper/311:45:013
30610992121,0cyclictest0-21swapper/212:15:152
30610992121,0cyclictest0-21swapper/209:20:122
30610992121,0cyclictest0-21swapper/207:20:132
30610992120,0cyclictest0-21swapper/207:45:022
30609992121,0cyclictest0-21swapper/110:45:121
30609992121,0cyclictest0-21swapper/109:10:111
30609992121,0cyclictest0-21swapper/108:05:021
30609992119,1cyclictest14014-21sendmail-msp10:00:001
30608992121,0cyclictest0-21swapper/010:20:120
30608992121,0cyclictest0-21swapper/009:55:150
30608992121,0cyclictest0-21swapper/008:20:120
30608992120,1cyclictest8213-21munin-run08:40:000
30611992020,0cyclictest0-21swapper/308:35:133
30610992020,0cyclictest0-21swapper/211:30:122
30610992020,0cyclictest0-21swapper/208:40:122
30610992020,0cyclictest0-21swapper/207:40:122
30609992020,0cyclictest0-21swapper/112:00:121
30609992020,0cyclictest0-21swapper/107:30:121
30609992019,1cyclictest5500-21cron12:00:011
30608992020,0cyclictest0-21swapper/012:25:120
30608992020,0cyclictest0-21swapper/008:35:000
30611991919,0cyclictest0-21swapper/312:10:123
30611991917,1cyclictest25661-21sh10:25:013
30611991917,1cyclictest0-21swapper/309:25:003
30609991919,0cyclictest0-21swapper/111:45:121
30609991919,0cyclictest0-21swapper/111:40:131
30608991919,0cyclictest19230-21apt-get11:20:140
30608991919,0cyclictest0-21swapper/009:40:140
30608991918,1cyclictest12499-21cron12:15:010
30611991818,0cyclictest0-21swapper/309:50:123
30610991818,0cyclictest0-21swapper/211:35:152
30610991818,0cyclictest0-21swapper/209:40:142
30609991818,0cyclictest0-21swapper/110:05:141
30608991816,1cyclictest21021-21munin-run10:15:010
30611991717,0cyclictest0-21swapper/311:55:123
30611991717,0cyclictest0-21swapper/311:35:153
30611991717,0cyclictest0-21swapper/309:05:143
30611991714,2cyclictest303-21systemd-journal08:45:003
30610991717,0cyclictest0-21swapper/207:50:112
30608991717,0cyclictest29736-21apt-get09:25:130
30608991717,0cyclictest29736-21apt-get09:25:130
3061199160,15cyclictest11975-21munin-run11:05:013
3061199160,15cyclictest11975-21munin-run11:05:013
30609991614,1cyclictest28017-21idleruntime-cro10:30:011
3060999160,15cyclictest9096-21sed08:40:141
30608991616,0cyclictest7883-21munin-run12:05:010
30608991616,0cyclictest0-21swapper/010:25:130
30611991513,1cyclictest27139-21munin-run09:20:003
3061199150,1cyclictest22713-21tune2fs08:00:173
3061199150,14cyclictest658-21awk09:30:163
30610991513,1cyclictest0-21swapper/208:35:182
3061099150,1cyclictest1598-21cpuspeed_turbos08:25:122
3061099150,1cyclictest1230-21awk09:30:202
3061099150,14cyclictest0-21swapper/211:05:152
30609991515,0cyclictest13419-21apt-get08:50:101
30609991515,0cyclictest0-21swapper/107:35:131
30609991513,1cyclictest8327-21cut12:05:131
3060999150,1cyclictest0-21swapper/108:45:141
3060999150,14cyclictest14875-21munin-run12:20:011
30608991515,0cyclictest0-21swapper/012:20:130
3060899150,1cyclictest0-21swapper/010:31:120
3060899150,14cyclictest0-21swapper/007:15:210
30611991414,0cyclictest0-21swapper/310:35:103
30611991414,0cyclictest0-21swapper/310:05:153
3061199140,14cyclictest0-21swapper/312:36:353
3061199140,14cyclictest0-21swapper/312:15:343
3061199140,14cyclictest0-21swapper/312:06:303
3061199140,14cyclictest0-21swapper/312:00:203
3061199140,14cyclictest0-21swapper/311:30:253
3061199140,14cyclictest0-21swapper/311:25:263
3061199140,14cyclictest0-21swapper/311:22:303
3061199140,14cyclictest0-21swapper/310:54:123
3061199140,14cyclictest0-21swapper/310:42:293
3061199140,14cyclictest0-21swapper/310:28:413
3061199140,14cyclictest0-21swapper/309:45:353
3061199140,14cyclictest0-21swapper/309:11:053
3061199140,14cyclictest0-21swapper/308:51:033
3061199140,14cyclictest0-21swapper/308:46:003
3061199140,14cyclictest0-21swapper/308:25:103
3061199140,14cyclictest0-21swapper/308:11:163
3061199140,14cyclictest0-21swapper/307:50:043
3061199140,14cyclictest0-21swapper/307:40:113
3061199140,0cyclictest0-21swapper/312:30:573
3061199140,0cyclictest0-21swapper/312:20:563
3061199140,0cyclictest0-21swapper/310:15:533
3061199140,0cyclictest0-21swapper/310:01:183
3061199140,0cyclictest0-21swapper/309:56:483
3061199140,0cyclictest0-21swapper/309:26:433
3061199140,0cyclictest0-21swapper/309:26:433
3061199140,0cyclictest0-21swapper/307:25:133
3061199140,0cyclictest0-21swapper/307:20:063
3061099141,8cyclictest24295-21perf12:40:012
30610991414,0cyclictest0-21swapper/211:57:262
30610991414,0cyclictest0-21swapper/210:51:592
30610991414,0cyclictest0-21swapper/210:17:592
3061099140,14cyclictest10897-21strings11:00:142
3061099140,14cyclictest10897-21strings11:00:142
3061099140,14cyclictest0-21swapper/212:32:422
3061099140,14cyclictest0-21swapper/212:11:262
3061099140,14cyclictest0-21swapper/211:52:102
3061099140,14cyclictest0-21swapper/211:40:292
3061099140,14cyclictest0-21swapper/210:11:172
3061099140,14cyclictest0-21swapper/210:07:092
3061099140,14cyclictest0-21swapper/209:35:412
3061099140,14cyclictest0-21swapper/209:12:112
3061099140,14cyclictest0-21swapper/208:50:272
3061099140,14cyclictest0-21swapper/208:46:522
3061099140,14cyclictest0-21swapper/208:02:232
3061099140,14cyclictest0-21swapper/207:36:412
3061099140,14cyclictest0-21swapper/207:25:182
3061099140,14cyclictest0-21swapper/207:13:532
3061099140,0cyclictest0-21swapper/210:47:392
3061099140,0cyclictest0-21swapper/209:03:062
3061099140,0cyclictest0-21swapper/207:15:392
30609991414,0cyclictest0-21swapper/112:20:031
30609991414,0cyclictest0-21swapper/109:25:591
30609991414,0cyclictest0-21swapper/109:25:591
3060999140,14cyclictest0-21swapper/112:35:321
3060999140,14cyclictest0-21swapper/112:25:231
3060999140,14cyclictest0-21swapper/111:31:031
3060999140,14cyclictest0-21swapper/111:01:381
3060999140,14cyclictest0-21swapper/111:01:371
3060999140,14cyclictest0-21swapper/110:20:511
3060999140,14cyclictest0-21swapper/109:53:521
3060999140,14cyclictest0-21swapper/109:46:521
3060999140,14cyclictest0-21swapper/109:43:161
3060999140,14cyclictest0-21swapper/108:55:011
3060999140,14cyclictest0-21swapper/108:05:191
3060999140,14cyclictest0-21swapper/107:45:271
3060999140,14cyclictest0-21swapper/107:15:091
3060999140,0cyclictest0-21swapper/111:35:011
3060999140,0cyclictest0-21swapper/111:26:481
3060999140,0cyclictest0-21swapper/111:15:131
3060999140,0cyclictest0-21swapper/110:41:221
3060999140,0cyclictest0-21swapper/110:30:021
3060999140,0cyclictest0-21swapper/110:10:141
3060999140,0cyclictest0-21swapper/108:30:241
3060999140,0cyclictest0-21swapper/108:25:171
3060999140,0cyclictest0-21swapper/108:15:271
3060999140,0cyclictest0-21swapper/108:14:121
3060999140,0cyclictest0-21swapper/107:23:571
30608991414,0cyclictest30599-21apt-get10:35:140
30608991414,0cyclictest0-21swapper/010:57:530
30608991414,0cyclictest0-21swapper/009:02:510
30608991414,0cyclictest0-21swapper/008:06:470
30608991414,0cyclictest0-21swapper/007:35:190
30608991414,0cyclictest0-21swapper/007:33:370
3060899140,14cyclictest0-21swapper/011:45:050
3060899140,14cyclictest0-21swapper/011:05:310
3060899140,14cyclictest0-21swapper/011:01:550
3060899140,14cyclictest0-21swapper/011:01:550
3060899140,14cyclictest0-21swapper/010:15:240
3060899140,14cyclictest0-21swapper/010:00:570
3060899140,14cyclictest0-21swapper/009:31:520
3060899140,14cyclictest0-21swapper/009:05:330
3060899140,14cyclictest0-21swapper/008:50:370
3060899140,14cyclictest0-21swapper/008:45:470
3060899140,14cyclictest0-21swapper/007:40:470
3060899140,14cyclictest0-21swapper/007:25:160
3060899140,14cyclictest0-21swapper/007:12:320
3060899140,0cyclictest0-21swapper/011:41:060
3060899140,0cyclictest0-21swapper/009:35:500
3060899140,0cyclictest0-21swapper/009:10:130
3060899140,0cyclictest0-21swapper/008:00:260
3060899140,0cyclictest0-21swapper/007:57:530
3060899140,0cyclictest0-21swapper/007:22:040
30611991313,0cyclictest0-21swapper/309:35:083
30611991313,0cyclictest0-21swapper/308:05:523
30611991313,0cyclictest0-21swapper/307:55:023
3061199130,0cyclictest0-21swapper/308:30:013
30610991313,0cyclictest0-21swapper/210:56:112
30610991313,0cyclictest0-21swapper/208:23:482
30610991311,1cyclictest0-21swapper/211:25:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional