You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 14:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Tue Dec 02, 2025 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23982290254,21sleep20-21swapper/219:07:332
22902273240,22sleep10-21swapper/119:06:151
23292269234,22sleep30-21swapper/319:06:453
22502262234,18sleep00-21swapper/019:05:460
269212640,1sleep30-21swapper/323:38:343
40202630,0sleep30-21swapper/321:37:173
143112630,0sleep20-21swapper/221:44:292
153242620,0sleep10-21swapper/122:48:311
126652600,0sleep00-21swapper/021:22:200
258752590,0sleep20-21swapper/222:34:272
134952570,0sleep20-21swapper/221:23:022
284822530,0sleep10-21swapper/122:35:221
164662190,0sleep00-21swapper/020:50:130
281742180,0sleep30-21swapper/323:18:163
90822140,0sleep30-21swapper/319:20:193
240142140,0sleep10-21swapper/123:58:061
155612130,0sleep10-21swapper/120:45:211
27319994,3cyclictest19982-21systemd-journal23:53:393
27279994,3cyclictest19982-21systemd-journal19:57:422
27279991,5cyclictest2820-21grep20:20:012
6340280,0sleep00-21swapper/022:00:130
28123280,1sleep328122-21ntp_states22:35:203
27319984,3cyclictest508-21dbus-daemon23:32:103
27319983,3cyclictest508-21dbus-daemon20:05:383
27319983,3cyclictest19982-21systemd-journal20:57:223
27319980,1cyclictest12411-21ssh21:22:073
27279984,3cyclictest508-21dbus-daemon23:26:192
27279984,3cyclictest508-21dbus-daemon23:16:442
27279984,3cyclictest19982-21systemd-journal19:43:572
27279983,3cyclictest19982-21systemd-journal19:32:372
27279983,3cyclictest19982-21systemd-journal00:04:172
27239985,2cyclictest11736-21in:imuxsock22:08:191
27239984,3cyclictest508-21dbus-daemon00:20:001
27239984,3cyclictest19982-21systemd-journal20:28:151
27239980,5cyclictest503-21apt21:15:001
27199985,2cyclictest11736-21in:imuxsock22:37:310
27199984,1cyclictest23756-21turbostat21:30:000
27319974,2cyclictest34-21ksoftirqd/319:35:003
27319974,2cyclictest26358-21cups-browsed00:00:393
27319974,2cyclictest19982-21systemd-journal20:26:553
27319974,2cyclictest11736-21in:imuxsock21:25:143
27319973,3cyclictest7354-21cron23:05:013
27319973,3cyclictest7132-21ntp_kernel_err23:25:183
27319973,3cyclictest13747-21sshd00:37:463
27319973,3cyclictest0-21swapper/323:12:233
27319973,1cyclictest0-21swapper/323:00:233
27319973,1cyclictest0-21swapper/322:16:023
27319973,1cyclictest0-21swapper/300:21:473
27319972,3cyclictest19982-21systemd-journal22:13:173
27319972,3cyclictest19982-21systemd-journal20:13:593
27319971,4cyclictest19982-21systemd-journal23:41:453
27319970,6cyclictest24516-21awk22:55:013
27279975,1cyclictest30960-21apt-get23:20:122
27279974,2cyclictest508-21dbus-daemon22:36:412
27279973,3cyclictest508-21dbus-daemon22:58:222
27279973,3cyclictest19116-21gdbus22:10:012
27279973,3cyclictest13285-21smart_sda22:25:202
27279973,3cyclictest0-21swapper/223:59:582
27279973,1cyclictest0-21swapper/222:12:462
27279973,1cyclictest0-21swapper/221:50:332
27279973,1cyclictest0-21swapper/200:07:482
27279972,3cyclictest19982-21systemd-journal21:16:592
27279972,3cyclictest19982-21systemd-journal20:30:012
27279972,3cyclictest19982-21systemd-journal20:10:012
27279971,4cyclictest19982-21systemd-journal21:11:332
27239974,2cyclictest508-21dbus-daemon21:26:101
27239973,3cyclictest508-21dbus-daemon22:21:401
27239973,3cyclictest508-21dbus-daemon21:43:171
27239973,3cyclictest508-21dbus-daemon21:30:001
27239973,3cyclictest508-21dbus-daemon19:56:281
27239973,3cyclictest24011-21ntpq21:50:181
27239973,3cyclictest19982-21systemd-journal19:27:341
27239973,3cyclictest17784-21grep19:40:161
27239973,3cyclictest15811-21cron21:25:001
27239972,4cyclictest11736-21in:imuxsock20:59:021
27239972,3cyclictest19982-21systemd-journal23:00:021
27239972,3cyclictest19982-21systemd-journal22:42:241
27239972,3cyclictest19982-21systemd-journal22:42:241
27239970,7cyclictest8953-1kworker/u9:100:12:321
27199974,2cyclictest508-21dbus-daemon21:55:230
27199974,2cyclictest4681-21sshd19:12:340
27199973,3cyclictest9482-21awk21:40:240
27199973,3cyclictest7661-21lldpd00:32:290
27199973,3cyclictest508-21dbus-daemon22:12:290
27199973,3cyclictest30654-21snmpd23:27:240
27199973,3cyclictest30654-21snmpd19:58:120
27199973,3cyclictest19982-21systemd-journal23:15:280
27199973,3cyclictest19982-21systemd-journal19:35:000
27199973,3cyclictest19982-21systemd-journal00:21:230
27199973,3cyclictest1529-21cat21:35:190
27199973,3cyclictest0-21swapper/021:53:480
27199973,3cyclictest0-21swapper/000:19:420
27199973,2cyclictest19982-21systemd-journal22:22:300
27199973,1cyclictest0-21swapper/023:23:050
27199972,4cyclictest30654-21snmpd23:32:100
27199972,3cyclictest7661-21lldpd20:48:340
27199972,3cyclictest19982-21systemd-journal20:44:260
27199972,2cyclictest19982-21systemd-journal21:13:020
27199971,3cyclictest3804-21perf22:20:010
27199971,3cyclictest25387-21rm22:33:590
27319964,1cyclictest11583-21unixbench_singl22:45:213
27319963,2cyclictest956-21ssh21:56:093
27319963,2cyclictest8658-21sh23:47:203
27319963,2cyclictest7661-21lldpd22:31:083
27319963,2cyclictest7114-21cut22:00:193
27319963,2cyclictest3307-21df_inode19:10:143
27319963,2cyclictest30654-21snmpd19:38:003
27319963,2cyclictest27880-21ssh22:56:103
27319963,2cyclictest25038-21tune2fs21:30:143
27319963,2cyclictest23666-21cat21:50:163
27319963,2cyclictest22361-21ssh23:56:383
27319963,2cyclictest1203-21sh23:21:113
27319962,3cyclictest9348-21open_files00:10:193
27319962,3cyclictest9228-21cat21:40:233
27319962,3cyclictest6290-21fschecks_time19:15:153
27319962,3cyclictest508-21dbus-daemon20:02:183
27319962,3cyclictest30654-21snmpd22:25:143
27319962,3cyclictest30654-21snmpd22:20:053
27319962,3cyclictest30654-21snmpd21:02:323
27319962,3cyclictest30654-21snmpd20:42:283
27319962,3cyclictest30654-21snmpd20:37:563
27319962,3cyclictest30654-21snmpd20:30:043
27319962,3cyclictest30654-21snmpd20:17:133
27319962,3cyclictest30654-21snmpd00:30:113
27319962,3cyclictest2796-21tune2fs22:40:153
27319962,3cyclictest2796-21tune2fs22:40:153
27319962,3cyclictest2584-21switchtime00:05:203
27319962,3cyclictest24703-21cut19:55:173
27319962,3cyclictest16732-21expr20:50:143
27319962,3cyclictest15994-21expr21:45:163
27319962,1cyclictest0-21swapper/300:26:083
27319961,3cyclictest19982-21systemd-journal21:10:433
27319961,3cyclictest19982-21systemd-journal20:20:143
27319960,6cyclictest0-21swapper/321:15:453
27319960,2cyclictest16185-21tune2fs00:15:143
27319960,0cyclictest0-21swapper/322:05:043
27279966,0cyclictest0-21swapper/222:22:232
27279963,2cyclictest8531-21ssh23:05:182
27279963,2cyclictest4591-21seq22:40:532
27279963,2cyclictest4591-21seq22:40:532
27279963,2cyclictest4189-21cat19:10:202
27279963,2cyclictest32459-21/usr/sbin/munin21:35:162
27279963,2cyclictest23696-21ntpq00:20:162
27279963,2cyclictest19982-21systemd-journal21:02:482
27279963,2cyclictest1163-21sh21:56:192
27279962,3cyclictest6249-21expr22:00:132
27279962,3cyclictest508-21dbus-daemon21:31:352
27279962,3cyclictest3142-21sshd20:20:142
27279962,3cyclictest30654-21snmpd20:50:052
27279962,3cyclictest30654-21snmpd20:45:042
27279962,3cyclictest30654-21snmpd19:51:092
27279962,3cyclictest30654-21snmpd19:21:142
27279962,3cyclictest30654-21snmpd19:19:292
27279962,3cyclictest30654-21snmpd00:30:592
27279962,3cyclictest29505-21cat00:25:142
27279962,3cyclictest23879-21entropy21:05:142
27279962,3cyclictest20497-21ntp_offset19:45:172
27279962,3cyclictest16101-21df00:15:142
27279962,3cyclictest16097-21cat21:45:172
27279962,3cyclictest15313-21cpuspeed23:10:122
27279962,3cyclictest10894-21cut20:35:192
27279962,1cyclictest0-21swapper/223:52:382
27279962,1cyclictest0-21swapper/223:35:122
27279962,1cyclictest0-21swapper/223:33:412
27279962,1cyclictest0-21swapper/223:02:232
27279962,1cyclictest0-21swapper/222:45:172
27279962,1cyclictest0-21swapper/200:10:142
27279961,3cyclictest502-21systemd-logind20:55:172
27279961,3cyclictest19982-21systemd-journal23:41:202
27279961,3cyclictest19982-21systemd-journal20:00:382
27279961,3cyclictest19982-21systemd-journal19:25:102
27279961,3cyclictest19982-21systemd-journal00:35:012
27279961,1cyclictest0-21swapper/222:50:172
27279960,6cyclictest0-21swapper/223:45:012
27279960,5cyclictest6675-21expr20:25:222
27239966,0cyclictest0-21swapper/120:40:141
27239963,2cyclictest31399-21rm22:59:181
27239963,2cyclictest30654-21snmpd20:21:251
27239963,2cyclictest29168-21sh23:40:021
27239963,2cyclictest24836-21ssh00:20:541
27239963,2cyclictest18965-21sort22:50:201
27239963,2cyclictest15436-21fschecks_count19:35:151
27239963,2cyclictest12587-21grep22:25:161
27239963,2cyclictest12310-21tr23:50:121
27239963,2cyclictest10541-21expr00:35:131
27239963,1cyclictest0-21swapper/123:16:351
27239962,3cyclictest9633-21seq19:20:401
27239962,3cyclictest508-21dbus-daemon19:11:241
27239962,3cyclictest30654-21snmpd23:30:251
27239962,3cyclictest30654-21snmpd23:21:571
27239962,3cyclictest30654-21snmpd22:33:261
27239962,3cyclictest30654-21snmpd22:15:441
27239962,3cyclictest30654-21snmpd21:45:251
27239962,3cyclictest30654-21snmpd21:35:091
27239962,3cyclictest30654-21snmpd21:15:501
27239962,3cyclictest30654-21snmpd21:06:321
27239962,3cyclictest30654-21snmpd20:01:511
27239962,3cyclictest30654-21snmpd19:31:481
27239962,3cyclictest29563-21cat00:25:151
27239962,3cyclictest19982-21systemd-journal23:45:051
27239962,3cyclictest19982-21systemd-journal21:55:151
27239962,3cyclictest19982-21systemd-journal21:02:071
27239962,3cyclictest19982-21systemd-journal19:16:251
27239962,1cyclictest0-21swapper/123:37:131
27239962,1cyclictest0-21swapper/123:26:291
27239962,1cyclictest0-21swapper/123:11:451
27239962,1cyclictest0-21swapper/122:12:591
27239962,1cyclictest0-21swapper/122:00:091
27239962,1cyclictest0-21swapper/100:30:251
27239962,1cyclictest0-21swapper/100:00:171
27239961,3cyclictest19982-21systemd-journal20:38:111
27239961,3cyclictest19982-21systemd-journal20:05:061
27239961,3cyclictest19982-21systemd-journal00:06:221
27239960,5cyclictest7636-21seq20:30:151
27239960,4cyclictest19982-21systemd-journal19:46:271
27199963,2cyclictest9713-21ssh22:45:020
27199963,2cyclictest3894-21cat20:20:180
27199963,2cyclictest30654-21snmpd19:26:170
27199963,2cyclictest29227-21seq00:25:120
27199963,2cyclictest25455-21diskmemload23:06:360
27199963,2cyclictest25455-21diskmemload21:45:040
27199963,2cyclictest22174-21entropy19:50:150
27199963,2cyclictest2054-21memory00:05:150
27199963,2cyclictest20440-21cut19:45:170
27199963,2cyclictest19862-21systemctl20:55:210
27199963,2cyclictest17036-21sh22:06:480
27199963,2cyclictest0-21swapper/023:11:040
27199962,3cyclictest9834-21cat00:10:220
27199962,3cyclictest701-21grep23:00:160
27199962,3cyclictest6291-21fw_packets19:15:150
27199962,3cyclictest30654-21snmpd23:55:070
27199962,3cyclictest30654-21snmpd22:26:170
27199962,3cyclictest30654-21snmpd21:15:410
27199962,3cyclictest30654-21snmpd00:35:440
27199962,3cyclictest29741-11brltty20:39:260
27199962,3cyclictest29456-21cat20:05:200
27199962,3cyclictest22067-21if_enp4s023:35:170
27199962,3cyclictest19982-21systemd-journal22:57:150
27199962,3cyclictest18438-21grep19:40:200
27199962,3cyclictest15281-21expr19:35:140
27199962,3cyclictest0-21swapper/022:51:160
27199962,3cyclictest0-21swapper/000:04:330
27199961,3cyclictest19982-21systemd-journal21:06:080
27199961,3cyclictest19982-21systemd-journal21:00:180
27199961,3cyclictest19982-21systemd-journal20:11:540
27199961,2cyclictest31516-21ssh23:40:430
27199960,4cyclictest19982-21systemd-journal20:15:140
27199960,3cyclictest2839-21grep22:40:150
27199960,3cyclictest2839-21grep22:40:150
27199960,3cyclictest10297-21rm23:48:460
24357260,0sleep00-21swapper/021:30:050
10029260,1sleep010023-21perf19:25:000
27319953,1cyclictest668-21runrttasks19:45:033
27319952,2cyclictest14523-21cat20:45:143
27319952,2cyclictest10500-21cp19:25:013
27319951,3cyclictest30654-21snmpd19:50:033
27319951,3cyclictest30654-21snmpd19:40:033
27319950,3cyclictest19982-21systemd-journal21:05:013
27279952,2cyclictest28956-21cut20:05:182
27279952,2cyclictest15575-21tr19:35:152
27279952,2cyclictest12006-21taskset20:40:122
27279951,3cyclictest508-21dbus-daemon21:25:002
27279951,3cyclictest29049-21ssh22:15:132
27239952,2cyclictest31398-21expr20:10:141
27239952,2cyclictest30654-21snmpd23:05:031
27239952,2cyclictest21949-21cut19:50:141
27239952,2cyclictest16619-21cut20:50:141
27239952,2cyclictest1022-21expr20:15:141
27199952,2cyclictest7982-21fschecks_count20:30:160
27199952,2cyclictest5725-21grep20:25:160
27199952,2cyclictest26491-21cp20:00:010
27199950,3cyclictest11975-21sh23:50:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional