You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-25 - 09:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8.osadl.org (updated Sat Oct 25, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
320892292236,17sleep10-21swapper/119:09:531
320812273240,20sleep30-21swapper/319:09:473
320752262227,23sleep20-21swapper/219:09:422
320622255221,22sleep00-21swapper/019:09:320
178792620,1sleep10-21swapper/121:50:171
196542610,0sleep30-21swapper/300:05:193
96032600,0sleep20-21swapper/221:22:512
209632570,0sleep020961-21sh22:36:090
219092560,0sleep20-21swapper/221:53:232
326932550,0sleep10-21swapper/122:22:131
296182200,0sleep10-21swapper/121:36:031
37962180,0sleep00-21swapper/023:31:190
7122170,0sleep20-21swapper/222:22:382
256032160,0sleep30-21swapper/323:02:033
42822150,0sleep012-21ksoftirqd/022:03:300
316642150,0sleep10-21swapper/122:44:161
22742150,0sleep20-21swapper/200:17:022
204942130,0sleep00-21swapper/022:14:310
224582120,0sleep20-21swapper/223:00:142
322209994,3cyclictest19982-21systemd-journal21:08:022
322209994,3cyclictest19982-21systemd-journal00:00:012
322209992,4cyclictest24734-21awk00:10:002
322119997,1cyclictest12-21ksoftirqd/000:00:000
322119994,3cyclictest19982-21systemd-journal20:56:220
322119994,3cyclictest19982-21systemd-journal20:07:090
2398290,0sleep22400-21cstates21:40:142
322249984,3cyclictest502-21systemd-logind21:25:343
322249983,3cyclictest7661-21lldpd23:59:263
322249983,3cyclictest19982-21systemd-journal23:07:193
322249983,3cyclictest19982-21systemd-journal21:54:223
322209985,2cyclictest28-21ksoftirqd/219:45:002
322209985,2cyclictest11736-21in:imuxsock21:58:322
322209984,3cyclictest508-21dbus-daemon21:14:432
322209983,3cyclictest19982-21systemd-journal23:39:042
322209983,3cyclictest19982-21systemd-journal22:46:312
322169983,3cyclictest502-21systemd-logind20:25:541
322169983,3cyclictest19982-21systemd-journal00:02:511
322169982,3cyclictest17999-21cron00:30:001
322119987,1cyclictest12-21ksoftirqd/000:20:000
322119984,2cyclictest19982-21systemd-journal20:30:220
322119983,3cyclictest19982-21systemd-journal23:36:340
322119983,3cyclictest19982-21systemd-journal22:31:290
322119983,3cyclictest19982-21systemd-journal21:48:310
322119983,3cyclictest19982-21systemd-journal19:38:460
322119980,7cyclictest1006-21sh21:16:460
21388280,0chrt0-21swapper/000:06:270
322249974,2cyclictest5164-21ntpd23:21:243
322249974,2cyclictest50712sleep319:20:123
322249974,2cyclictest34-21ksoftirqd/319:35:003
322249974,2cyclictest23795-21cat21:10:173
322249974,2cyclictest19982-21systemd-journal00:29:583
322249974,2cyclictest19116-21gdbus00:20:013
322249973,3cyclictest508-21dbus-daemon23:34:293
322249973,3cyclictest508-21dbus-daemon20:37:103
322249973,3cyclictest31762-21avahi-daemon23:40:003
322249973,3cyclictest30654-21snmpd19:56:523
322249973,3cyclictest30345-21cron00:40:003
322249973,3cyclictest0-21swapper/322:40:543
322249973,2cyclictest19982-21systemd-journal19:48:233
322249973,1cyclictest0-21swapper/323:29:433
322249973,1cyclictest0-21swapper/322:35:063
322249973,1cyclictest0-21swapper/322:27:413
322249973,1cyclictest0-21swapper/322:17:353
322249973,1cyclictest0-21swapper/322:05:043
322249972,4cyclictest0-21swapper/319:26:473
322249970,3cyclictest300552ssh21:15:043
322209975,1cyclictest32096-21rm22:44:372
322209974,2cyclictest508-21dbus-daemon22:10:012
322209974,2cyclictest30654-21snmpd21:49:442
322209973,3cyclictest7661-21lldpd21:36:432
322209973,3cyclictest508-21dbus-daemon21:00:192
322209973,3cyclictest22257-21cat22:15:172
322209973,3cyclictest19982-21systemd-journal23:41:352
322209973,3cyclictest0-21swapper/222:56:452
322209973,3cyclictest0-21swapper/200:25:342
322209973,1cyclictest0-21swapper/222:38:052
322209973,1cyclictest0-21swapper/200:30:442
322209973,1cyclictest0-21swapper/200:30:442
322209972,3cyclictest7661-21lldpd20:50:122
322209972,3cyclictest19982-21systemd-journal23:48:152
322209971,4cyclictest19982-21systemd-journal00:02:512
322209970,4cyclictest1969-21perf19:15:002
322169974,2cyclictest502-21systemd-logind23:21:331
322169974,2cyclictest30344-21cron00:40:011
322169974,2cyclictest11736-21in:imuxsock21:48:311
322169973,3cyclictest30654-21snmpd22:18:291
322169973,3cyclictest30654-21snmpd19:33:541
322169973,1cyclictest0-21swapper/123:00:111
322169973,1cyclictest0-21swapper/122:00:481
322169972,3cyclictest25261-21munin-run20:05:011
322169972,3cyclictest19982-21systemd-journal20:34:151
322169972,3cyclictest19982-21systemd-journal19:17:011
322169971,3cyclictest16009-21apt-get19:45:001
322169971,2cyclictest19982-21systemd-journal21:10:001
322169971,1cyclictest10685-21munin-run22:30:011
322169970,4cyclictest20258-21munin-run21:05:001
322169970,3cyclictest21616-21dump-pmu-power23:00:011
322119975,1cyclictest26690-21munin-plugin-st21:35:000
322119975,1cyclictest12-21ksoftirqd/020:25:010
322119974,2cyclictest508-21dbus-daemon21:11:490
322119974,2cyclictest11736-21in:imuxsock20:43:510
322119973,3cyclictest508-21dbus-daemon23:53:400
322119973,3cyclictest508-21dbus-daemon20:02:580
322119973,3cyclictest30654-21snmpd00:37:380
322119973,3cyclictest30646-21cat20:15:160
322119973,3cyclictest19982-21systemd-journal23:42:250
322119973,3cyclictest13420-21tr00:25:220
322119973,3cyclictest10897-21cron23:15:000
322119973,1cyclictest0-21swapper/000:34:540
322119973,1cyclictest0-21swapper/000:34:540
322249966,0cyclictest0-21swapper/321:46:273
322249963,2cyclictest508-21dbus-daemon19:50:193
322249963,2cyclictest4837-21/usr/sbin/munin20:30:183
322249963,2cyclictest32540-21ntpq00:15:183
322249963,2cyclictest29995-21ntpq22:20:193
322249963,2cyclictest24022-21cat20:00:163
322249963,2cyclictest18845-21gltestperf21:00:143
322249963,2cyclictest16116-21cat23:40:153
322249963,2cyclictest1-21systemd22:46:313
322249963,1cyclictest0-21swapper/323:48:313
322249962,3cyclictest5266-21ls21:20:143
322249962,3cyclictest5164-21ntpd20:25:173
322249962,3cyclictest4428-21seq19:15:363
322249962,3cyclictest30849-21cat23:50:163
322249962,3cyclictest30654-21snmpd21:57:143
322249962,3cyclictest30654-21snmpd20:55:053
322249962,3cyclictest30654-21snmpd20:53:563
322249962,3cyclictest30654-21snmpd20:45:243
322249962,3cyclictest30654-21snmpd20:12:013
322249962,3cyclictest30654-21snmpd20:06:433
322249962,3cyclictest30654-21snmpd19:13:123
322249962,3cyclictest2836-21cat21:40:163
322249962,3cyclictest21186-21cat21:05:163
322249962,3cyclictest1775-21seq20:21:423
322249962,3cyclictest15225-21sshd23:17:203
322249962,3cyclictest15156-21df_inode22:55:133
322249962,3cyclictest12794-21cat00:00:143
322249962,3cyclictest11452-21expr22:30:143
322249962,3cyclictest0-21swapper/323:10:263
322249962,3cyclictest0-21swapper/322:10:223
322249962,3cyclictest0-21swapper/321:30:283
322249962,2cyclictest19982-21systemd-journal19:36:163
322249962,1cyclictest0-21swapper/322:50:093
322249961,2cyclictest20551-21ssh00:31:023
322249961,2cyclictest20551-21ssh00:31:023
322249960,6cyclictest0-21swapper/300:10:123
322249960,5cyclictest632-21/usr/sbin/munin22:00:213
322249960,3cyclictest27106-21ssh21:35:113
322249960,2cyclictest14548-21perl19:40:173
322209966,0cyclictest0-21swapper/223:15:242
322209963,2cyclictest8507-21systemctl19:25:182
322209963,2cyclictest6326-21tail20:30:212
322209963,2cyclictest508-21dbus-daemon20:48:262
322209963,2cyclictest508-21dbus-daemon20:17:092
322209963,2cyclictest31264-21awk21:15:182
322209963,2cyclictest27965-21rm00:37:192
322209963,2cyclictest27267-21sensors23:25:162
322209963,2cyclictest25226-21chrt20:04:552
322209963,2cyclictest21341-21expr19:55:102
322209963,2cyclictest12044-21sh22:08:522
322209963,2cyclictest11738-21rs:main2
322209963,2cyclictest11736-21in:imuxsock23:30:002
322209963,2cyclictest10575-21pmu-power19:30:202
322209962,3cyclictest30654-21snmpd22:25:022
322209962,3cyclictest30654-21snmpd20:57:112
322209962,3cyclictest30654-21snmpd20:35:332
322209962,3cyclictest30654-21snmpd19:50:372
322209962,3cyclictest28157-21cut20:10:152
322209962,3cyclictest19982-21systemd-journal23:50:232
322209962,3cyclictest19982-21systemd-journal19:21:472
322209962,3cyclictest18463-21date23:20:002
322209962,3cyclictest12735-21expr21:25:142
322209962,3cyclictest1093-21seq20:20:182
322209962,3cyclictest10009-21cat20:40:182
322209962,3cyclictest0-21swapper/222:50:342
322209962,1cyclictest141rcu_preempt00:20:102
322209962,1cyclictest0-21swapper/223:13:402
322209962,1cyclictest0-21swapper/222:30:122
322209962,1cyclictest0-21swapper/222:02:192
322209962,1cyclictest0-21swapper/221:31:472
322209962,1cyclictest0-21swapper/200:11:142
322209961,1cyclictest29741-11brltty20:07:582
322209960,6cyclictest0-21swapper/223:05:182
322169966,0cyclictest0-21swapper/121:31:481
322169963,2cyclictest508-21dbus-daemon20:15:051
322169963,2cyclictest3562-21ssh22:46:321
322169963,2cyclictest31681-21cut00:15:141
322169963,2cyclictest30654-21snmpd22:50:481
322169963,2cyclictest30654-21snmpd19:37:331
322169963,2cyclictest30654-21snmpd19:24:271
322169963,2cyclictest25653-21tune2fs00:10:141
322169963,2cyclictest23274-21expr21:10:141
322169963,2cyclictest2320-21cat21:40:131
322169963,2cyclictest1497-21cat20:20:211
322169962,3cyclictest5861-21cat21:20:161
322169962,3cyclictest508-21dbus-daemon23:05:171
322169962,3cyclictest30654-21snmpd22:11:531
322169962,3cyclictest30654-21snmpd21:57:051
322169962,3cyclictest30654-21snmpd20:57:471
322169962,3cyclictest30654-21snmpd19:11:091
322169962,3cyclictest21720-21irqstats19:55:131
322169962,3cyclictest20882-21grep19:55:011
322169962,3cyclictest19982-21systemd-journal21:15:331
322169962,3cyclictest18256-21sshd19:46:501
322169962,3cyclictest0-21swapper/123:55:091
322169962,3cyclictest0-21swapper/123:44:361
322169962,3cyclictest0-21swapper/123:31:231
322169962,1cyclictest0-21swapper/123:35:501
322169962,1cyclictest0-21swapper/100:06:031
322169961,3cyclictest502-21systemd-logind23:15:181
322169961,3cyclictest19982-21systemd-journal20:06:511
322169960,6cyclictest0-21swapper/123:50:221
322169960,6cyclictest0-21swapper/123:27:091
322169960,6cyclictest0-21swapper/100:22:221
322169960,5cyclictest8974-21sshd19:26:231
322169960,4cyclictest24124-21munin-plugin-st00:35:001
322169960,4cyclictest24124-21munin-plugin-st00:35:001
322169960,4cyclictest19982-21systemd-journal20:40:301
322169960,3cyclictest8773-21rm22:05:551
322169960,3cyclictest3975-21rm23:10:061
322169960,3cyclictest23154-21rm23:45:141
322169960,3cyclictest21134-21rm22:36:181
322169960,3cyclictest12888-21ssh21:25:151
322169960,2cyclictest7069-21/usr/sbin/munin20:35:111
322169960,0cyclictest0-21swapper/122:30:381
322119964,1cyclictest21516-21/usr/sbin/munin22:15:140
322119963,2cyclictest508-21dbus-daemon22:00:010
322119963,2cyclictest30654-21snmpd21:00:110
322119963,2cyclictest28443-21sh23:48:560
322119963,2cyclictest24950-21ssh00:10:010
322119963,2cyclictest2441-21expr21:40:130
322119963,2cyclictest16831-21ssh21:50:110
322119963,2cyclictest16011-21turbostat.cron19:49:550
322119963,2cyclictest11552-21sh22:52:270
322119963,2cyclictest10266-21uname19:30:170
322119963,2cyclictest0-21swapper/023:17:360
322119962,3cyclictest782-21cat22:45:120
322119962,3cyclictest6668-21sshd19:20:230
322119962,3cyclictest508-21dbus-daemon19:12:540
322119962,3cyclictest3305-21cat20:25:150
322119962,3cyclictest30654-21snmpd23:20:310
322119962,3cyclictest30654-21snmpd22:56:060
322119962,3cyclictest30654-21snmpd22:40:030
322119962,3cyclictest30654-21snmpd22:26:440
322119962,3cyclictest30654-21snmpd22:05:050
322119962,3cyclictest30654-21snmpd21:35:420
322119962,3cyclictest30654-21snmpd20:37:470
322119962,3cyclictest30654-21snmpd19:42:030
322119962,3cyclictest30654-21snmpd00:20:110
322119962,3cyclictest30654-21snmpd00:01:590
322119962,3cyclictest19116-21gdbus19:50:060
322119962,3cyclictest14480-21cat20:50:170
322119962,1cyclictest0-21swapper/023:25:450
322119962,1cyclictest0-21swapper/021:20:280
322119961,4cyclictest29663-21cat22:20:180
322119961,2cyclictest12265-21ssh21:25:030
322119960,6cyclictest0-21swapper/023:05:020
322119960,6cyclictest0-21swapper/023:00:350
322119960,6cyclictest0-21swapper/019:15:170
322119960,4cyclictest19982-21systemd-journal20:45:310
322119960,3cyclictest22480-21munin-run21:10:000
322119960,2cyclictest7304-21/usr/sbin/munin19:25:150
322249953,1cyclictest9481-21cpuspeed_turbos20:40:163
322249952,2cyclictest29953-21basename20:15:123
322209952,2cyclictest12466-21cat19:35:172
322209951,3cyclictest32496-21gdbus20:25:012
322209950,4cyclictest3224-21df19:15:162
322169952,2cyclictest14740-21awk20:50:191
322169951,3cyclictest28402-21if_err_enp4s020:10:161
322169951,3cyclictest12061-21fschecks_time20:45:161
322119952,2cyclictest21457-21fschecks_count19:55:120
322119951,3cyclictest28129-21/usr/sbin/munin20:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional