You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 17:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5.osadl.org (updated Thu Sep 18, 2025 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2261899310,30cyclictest23253-21cron11:45:010
22621993028,1cyclictest24990-21cron10:40:013
2262199300,29cyclictest615-21rs:main3
2261999300,2cyclictest30212-21cron12:00:011
2261999300,29cyclictest8961-21cron07:50:001
2261999300,29cyclictest609-21dbus-daemon07:35:011
2261899300,29cyclictest303-21systemd-journal09:35:000
2261899300,1cyclictest303-21systemd-journal07:20:010
22621992928,1cyclictest626-21gdbus11:45:013
22621992927,1cyclictest0-21swapper/309:05:013
2262199290,1cyclictest626-21gdbus09:19:593
22620992927,1cyclictest0-21swapper/207:45:012
22620992927,1cyclictest0-21swapper/207:20:002
2262099290,28cyclictest27627-21apt-get10:45:122
2262099290,28cyclictest15674-21apt-get10:20:162
22619992927,1cyclictest29096-21apt-get09:40:141
2261899290,28cyclictest0-21swapper/009:35:140
2261899290,28cyclictest0-21swapper/009:35:130
2261899290,28cyclictest0-21swapper/008:10:130
22621992828,0cyclictest0-21swapper/310:00:123
22621992827,1cyclictest1-21systemd07:20:003
22621992826,2cyclictest28779-21cron09:40:013
22621992826,2cyclictest28779-21cron09:40:013
22621992826,1cyclictest609-21dbus-daemon09:35:013
2262199280,27cyclictest0-21swapper/312:35:193
2262099280,27cyclictest0-21swapper/208:10:142
2262099280,1cyclictest21535-21http09:25:002
2262099280,0cyclictest0-21swapper/211:45:132
2262099280,0cyclictest0-21swapper/207:35:122
22619992826,1cyclictest11284-21cron07:55:011
2261999280,0cyclictest7210-21apt-get11:10:131
2261999280,0cyclictest0-21swapper/112:00:121
2261999280,0cyclictest0-21swapper/110:55:161
22618992828,0cyclictest0-21swapper/012:25:140
22618992827,0cyclictest9255-21apt-get07:50:130
22618992826,1cyclictest22876-21taskset07:10:120
2261899280,0cyclictest14470-21apt-get12:35:190
22621992727,0cyclictest22091-21apt-get09:25:123
22621992727,0cyclictest0-21swapper/312:10:123
22621992726,1cyclictest0-21swapper/311:30:133
22620992727,0cyclictest0-21swapper/212:25:142
22620992727,0cyclictest0-21swapper/210:15:012
22620992725,1cyclictest22671-21cron10:35:012
2262099270,27cyclictest0-21swapper/208:15:132
2262099270,0cyclictest0-21swapper/211:50:132
22619992727,0cyclictest19464-21apt-get09:20:131
22619992726,1cyclictest12133-21apt-get12:30:111
2261999270,0cyclictest0-21swapper/109:25:131
22618992727,0cyclictest0-21swapper/011:50:130
22621992626,0cyclictest0-21swapper/308:10:143
22621992625,0cyclictest0-21swapper/307:50:133
22620992625,1cyclictest28187-21apt-get11:55:142
22620992625,0cyclictest2813-21apt-get12:10:122
22619992625,1cyclictest21204-21apt-get11:40:141
22619992624,1cyclictest303-21systemd-journal11:10:011
22618992626,0cyclictest0-21swapper/011:10:130
22618992626,0cyclictest0-21swapper/009:50:120
22618992626,0cyclictest0-21swapper/009:45:090
22618992626,0cyclictest0-21swapper/007:25:160
22618992624,1cyclictest4296-21awk11:05:010
22618992624,1cyclictest32334-21apt-get10:55:160
2262199253,6cyclictest0-21swapper/307:25:163
22621992525,0cyclictest0-21swapper/308:25:093
22620992525,0cyclictest0-21swapper/211:05:132
22620992525,0cyclictest0-21swapper/209:50:132
22620992525,0cyclictest0-21swapper/209:45:082
22620992525,0cyclictest0-21swapper/208:20:132
22620992522,2cyclictest27940-21munin-run08:29:592
22619992525,0cyclictest0-21swapper/109:35:131
22619992525,0cyclictest0-21swapper/109:35:131
22618992523,1cyclictest303-21systemd-journal12:20:000
22618992522,2cyclictest303-21systemd-journal09:15:000
22621992424,0cyclictest0-21swapper/312:25:143
22621992424,0cyclictest0-21swapper/311:50:123
22621992424,0cyclictest0-21swapper/307:35:123
22621992423,1cyclictest7210-21apt-get11:10:123
22620992424,0cyclictest4909-21perf08:50:012
22620992424,0cyclictest14470-21apt-get12:35:182
22620992424,0cyclictest0-21swapper/210:15:212
22620992424,0cyclictest0-21swapper/207:10:112
22620992423,1cyclictest2257-21apt-get11:00:122
22619992424,0cyclictest14791-21apt-get09:10:121
22619992424,0cyclictest0-21swapper/111:15:131
22619992423,1cyclictest16533-21apt-get11:30:121
22618992424,0cyclictest0-21swapper/010:25:120
22618992424,0cyclictest0-21swapper/009:40:140
22618992424,0cyclictest0-21swapper/008:05:140
22621992323,0cyclictest0-21swapper/309:50:113
22621992323,0cyclictest0-21swapper/307:10:123
22621992322,1cyclictest31467-21apt-get09:45:093
22620992323,0cyclictest9255-21apt-get07:50:122
22620992323,0cyclictest26750-21apt-get09:35:142
22620992323,0cyclictest26750-21apt-get09:35:142
22620992323,0cyclictest0-21swapper/211:35:122
22620992323,0cyclictest0-21swapper/210:55:162
22620992321,1cyclictest609-21dbus-daemon07:30:022
22619992323,0cyclictest27544-21apt-get07:20:121
22619992323,0cyclictest22872-21apt-get07:10:111
22619992323,0cyclictest0-21swapper/108:45:131
22619992323,0cyclictest0-21swapper/107:35:121
22618992323,0cyclictest0-21swapper/012:10:110
22618992323,0cyclictest0-21swapper/007:20:130
22621992221,1cyclictest0-21swapper/311:05:003
22621992221,1cyclictest0-21swapper/309:40:143
22620992222,0cyclictest0-21swapper/208:55:122
22620992222,0cyclictest0-21swapper/207:20:132
22619992222,0cyclictest0-21swapper/110:30:011
22619992222,0cyclictest0-21swapper/109:55:131
22619992221,1cyclictest27905-21cron11:55:011
22618992221,0cyclictest0-21swapper/011:55:140
22621992120,0cyclictest0-21swapper/310:55:153
22620992121,0cyclictest24149-21perf09:30:012
22620992119,1cyclictest303-21systemd-journal10:05:002
22619992121,0cyclictest0-21swapper/112:10:121
22619992121,0cyclictest0-21swapper/109:45:091
22618992121,0cyclictest0-21swapper/009:15:160
22618992119,1cyclictest9576-21munin-run09:00:000
22618992119,1cyclictest626-21gdbus08:55:000
22621992020,0cyclictest0-21swapper/310:25:123
22621992020,0cyclictest0-21swapper/308:05:143
22621992020,0cyclictest0-21swapper/307:20:123
22621992019,1cyclictest611-21avahi-daemon12:20:013
22621992018,1cyclictest16830-21cron09:15:003
22620992020,0cyclictest0-21swapper/211:10:132
22619992020,0cyclictest0-21swapper/112:05:161
22619992020,0cyclictest0-21swapper/110:00:131
22619992019,1cyclictest17994-21apt-get10:25:111
22618992020,0cyclictest0-21swapper/011:30:130
22618992020,0cyclictest0-21swapper/008:40:000
22619991918,1cyclictest609-21dbus-daemon12:30:001
22618991919,0cyclictest0-21swapper/008:30:110
22621991816,1cyclictest32646-21perf08:39:593
2261999183,12cyclictest20161-21snmpd11:00:471
22619991818,0cyclictest0-21swapper/107:15:111
22618991818,0cyclictest0-21swapper/010:30:020
22621991717,0cyclictest0-21swapper/311:55:133
22621991716,0cyclictest0-21swapper/309:00:013
22621991715,1cyclictest0-21swapper/308:55:013
22620991717,0cyclictest0-21swapper/209:55:132
22620991714,2cyclictest303-21systemd-journal11:35:012
22619991717,0cyclictest1675-21apt-get09:50:131
22619991717,0cyclictest0-21swapper/108:20:131
22619991716,1cyclictest0-21swapper/108:10:021
22619991714,3cyclictest0-21swapper/111:20:211
22618991717,0cyclictest0-21swapper/012:30:120
22621991615,1cyclictest0-21swapper/308:30:113
22621991614,1cyclictest0-21swapper/311:35:203
22621991614,1cyclictest0-21swapper/311:25:223
2262199160,2cyclictest25185-21grep08:20:233
22620991616,0cyclictest0-21swapper/209:30:152
22620991614,1cyclictest0-21swapper/207:55:212
2262099160,15cyclictest8835-21sed12:20:242
22619991616,0cyclictest0-21swapper/109:15:161
22619991614,1cyclictest0-21swapper/110:50:131
2261999160,15cyclictest9200-21perl10:05:171
22618991614,1cyclictest10770-21sed09:00:120
2262199150,1cyclictest7982-21ntp_states07:45:183
22620991512,2cyclictest32071-21sed08:35:202
22619991514,1cyclictest28960-21switchtime10:45:211
2261999150,1cyclictest16096-21head12:35:281
2261999150,15cyclictest19476-21gltestperf11:35:131
22618991515,0cyclictest18857-21apt-get11:35:120
22618991514,0cyclictest23538-21apt-get11:45:140
22621991414,0cyclictest0-21swapper/312:30:123
22621991414,0cyclictest0-21swapper/312:04:103
22621991414,0cyclictest0-21swapper/310:30:023
22621991414,0cyclictest0-21swapper/307:43:593
2262199140,14cyclictest0-21swapper/311:08:203
2262199140,14cyclictest0-21swapper/310:47:403
2262199140,14cyclictest0-21swapper/310:23:343
2262199140,14cyclictest0-21swapper/310:11:073
2262199140,14cyclictest0-21swapper/309:56:023
2262199140,14cyclictest0-21swapper/308:49:503
2262199140,14cyclictest0-21swapper/308:17:093
2262199140,14cyclictest0-21swapper/307:55:363
2262199140,14cyclictest0-21swapper/307:30:513
2262199140,0cyclictest0-21swapper/312:06:343
2262199140,0cyclictest0-21swapper/311:45:143
2262199140,0cyclictest0-21swapper/311:21:113
2262199140,0cyclictest0-21swapper/310:40:133
2262199140,0cyclictest0-21swapper/309:20:383
2262199140,0cyclictest0-21swapper/309:09:323
2262199140,0cyclictest0-21swapper/308:01:043
22620991413,1cyclictest30497-21/usr/sbin/munin12:00:202
22620991413,1cyclictest0-21swapper/208:30:162
2262099140,14cyclictest0-21swapper/212:33:022
2262099140,14cyclictest0-21swapper/212:05:592
2262099140,14cyclictest0-21swapper/211:25:242
2262099140,14cyclictest0-21swapper/210:53:302
2262099140,14cyclictest0-21swapper/210:42:302
2262099140,14cyclictest0-21swapper/210:07:382
2262099140,14cyclictest0-21swapper/209:41:372
2262099140,14cyclictest0-21swapper/209:15:032
2262099140,14cyclictest0-21swapper/209:11:572
2262099140,14cyclictest0-21swapper/209:08:232
2262099140,14cyclictest0-21swapper/209:00:162
2262099140,14cyclictest0-21swapper/208:50:302
2262099140,14cyclictest0-21swapper/208:42:102
2262099140,14cyclictest0-21swapper/208:07:522
2262099140,14cyclictest0-21swapper/207:45:212
2262099140,0cyclictest0-21swapper/212:15:562
2262099140,0cyclictest0-21swapper/211:23:312
2262099140,0cyclictest0-21swapper/211:17:082
2262099140,0cyclictest0-21swapper/210:37:352
2262099140,0cyclictest0-21swapper/208:02:192
22619991414,0cyclictest10135-21apt-get09:00:091
22619991414,0cyclictest0-21swapper/112:15:171
22619991414,0cyclictest0-21swapper/110:35:251
22619991414,0cyclictest0-21swapper/110:22:411
22619991414,0cyclictest0-21swapper/109:05:061
2261999140,14cyclictest0-21swapper/111:26:081
2261999140,14cyclictest0-21swapper/110:19:071
2261999140,14cyclictest0-21swapper/110:10:011
2261999140,14cyclictest0-21swapper/108:50:161
2261999140,14cyclictest0-21swapper/108:40:091
2261999140,14cyclictest0-21swapper/108:30:331
2261999140,14cyclictest0-21swapper/108:25:331
2261999140,14cyclictest0-21swapper/108:17:151
2261999140,14cyclictest0-21swapper/107:55:021
2261999140,14cyclictest0-21swapper/107:40:301
2261999140,14cyclictest0-21swapper/107:25:091
2261999140,0cyclictest0-21swapper/111:47:161
2261999140,0cyclictest0-21swapper/110:43:291
2261999140,0cyclictest0-21swapper/109:30:391
2261999140,0cyclictest0-21swapper/108:55:081
2261999140,0cyclictest0-21swapper/108:36:391
2261999140,0cyclictest0-21swapper/108:11:011
2261999140,0cyclictest0-21swapper/108:01:501
22618991414,0cyclictest0-21swapper/011:20:150
22618991414,0cyclictest0-21swapper/010:24:290
22618991413,1cyclictest0-21swapper/010:00:200
2261899140,14cyclictest0-21swapper/012:06:080
2261899140,14cyclictest0-21swapper/012:04:110
2261899140,14cyclictest0-21swapper/011:15:410
2261899140,14cyclictest0-21swapper/010:45:130
2261899140,14cyclictest0-21swapper/010:43:400
2261899140,14cyclictest0-21swapper/010:36:290
2261899140,14cyclictest0-21swapper/010:17:240
2261899140,14cyclictest0-21swapper/010:10:200
2261899140,14cyclictest0-21swapper/009:25:230
2261899140,14cyclictest0-21swapper/009:20:440
2261899140,14cyclictest0-21swapper/009:05:220
2261899140,14cyclictest0-21swapper/008:46:190
2261899140,14cyclictest0-21swapper/008:40:060
2261899140,14cyclictest0-21swapper/008:26:180
2261899140,14cyclictest0-21swapper/008:20:150
2261899140,14cyclictest0-21swapper/008:16:050
2261899140,14cyclictest0-21swapper/007:55:520
2261899140,14cyclictest0-21swapper/007:45:230
2261899140,14cyclictest0-21swapper/007:40:370
2261899140,14cyclictest0-21swapper/007:39:250
2261899140,0cyclictest0-21swapper/012:23:100
2261899140,0cyclictest0-21swapper/011:29:400
2261899140,0cyclictest0-21swapper/011:07:260
2261899140,0cyclictest0-21swapper/009:58:380
2261899140,0cyclictest0-21swapper/007:32:180
22621991313,0cyclictest0-21swapper/310:53:563
22621991313,0cyclictest0-21swapper/310:15:263
22621991313,0cyclictest0-21swapper/310:05:503
22621991313,0cyclictest0-21swapper/308:40:203
2262199130,0cyclictest0-21swapper/312:24:303
22620991313,0cyclictest0-21swapper/211:40:202
22620991313,0cyclictest0-21swapper/210:25:082
22620991313,0cyclictest0-21swapper/207:30:072
22618991313,0cyclictest0-21swapper/010:51:250
22618991313,0cyclictest0-21swapper/010:05:310
22619991212,0cyclictest0-21swapper/112:20:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional