You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 09:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Sat Nov 29, 2025 00:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3182328295,21sleep20-21swapper/219:08:542
3702304232,20sleep10-21swapper/119:09:341
326072266234,20sleep00-21swapper/019:06:480
325232259224,22sleep30-21swapper/319:05:493
238322640,1sleep30-21swapper/322:15:143
326762630,0sleep00-21swapper/022:43:060
115152620,0sleep30-21swapper/321:23:363
122972600,0sleep20-21swapper/221:24:192
3332590,0sleep30-21swapper/323:27:223
293382590,0sleep10-21swapper/122:19:171
264632580,0sleep10-21swapper/121:11:051
177152580,0sleep00-21swapper/000:25:100
222132530,0sleep00-21swapper/022:14:320
65002190,0sleep30-21swapper/323:10:133
32752190,3sleep122-21ksoftirqd/100:13:571
246082150,2sleep3331rcuc/320:00:113
183842150,0sleep10-21swapper/119:45:161
133682140,0sleep00-21swapper/020:45:170
173672110,1sleep30-21swapper/300:25:013
113342110,3sleep228-21ksoftirqd/219:30:162
5279994,3cyclictest19982-21systemd-journal22:22:421
5279994,3cyclictest19982-21systemd-journal21:29:261
5169994,3cyclictest19982-21systemd-journal23:09:100
5169990,6cyclictest7296-21apt-get20:35:000
30060290,0sleep00-21swapper/022:19:570
5359983,3cyclictest19982-21systemd-journal00:15:013
5319984,3cyclictest508-21dbus-daemon22:26:112
5319984,3cyclictest19982-21systemd-journal23:17:232
5319983,3cyclictest19982-21systemd-journal20:48:582
5319982,3cyclictest19982-21systemd-journal23:22:362
5279984,3cyclictest19982-21systemd-journal21:36:591
5279983,3cyclictest19982-21systemd-journal19:57:021
5279983,3cyclictest19982-21systemd-journal19:18:011
5279983,2cyclictest508-21dbus-daemon23:40:011
5279982,3cyclictest16850-21grep20:55:001
5169985,2cyclictest11738-21rs:main0
5169984,3cyclictest508-21dbus-daemon19:38:520
5169984,3cyclictest19982-21systemd-journal20:15:280
5169983,3cyclictest19982-21systemd-journal22:39:070
2211280,0sleep20-21swapper/200:13:032
1758280,1sleep00-21swapper/019:10:190
1280280,0sleep10-21swapper/121:16:061
5359974,2cyclictest508-21dbus-daemon22:10:013
5359974,2cyclictest26079-21/usr/sbin/munin23:45:193
5359974,2cyclictest11736-21in:imuxsock00:15:043
5359973,3cyclictest508-21dbus-daemon20:11:003
5359973,3cyclictest19982-21systemd-journal20:47:123
5359973,3cyclictest18019-21df_inode19:45:143
5359973,3cyclictest0-21swapper/322:38:113
5359973,1cyclictest0-21swapper/323:04:193
5359972,3cyclictest19982-21systemd-journal22:54:093
5359972,3cyclictest19982-21systemd-journal22:54:093
5359972,3cyclictest19982-21systemd-journal21:19:253
5359972,3cyclictest19982-21systemd-journal20:16:453
5359972,3cyclictest19982-21systemd-journal19:54:203
5359972,3cyclictest19982-21systemd-journal19:31:483
5359971,3cyclictest19982-21systemd-journal21:10:143
5319974,3cyclictest11736-21in:imuxsock21:37:472
5319974,2cyclictest31932-21sh22:42:282
5319973,3cyclictest7661-21lldpd22:46:362
5319973,3cyclictest4185-21tune2fs21:40:152
5319973,3cyclictest21611-21df_inode21:30:132
5319973,3cyclictest19982-21systemd-journal22:06:592
5319973,3cyclictest0-21swapper/222:32:432
5319973,1cyclictest0-21swapper/223:48:152
5319973,1cyclictest0-21swapper/221:45:252
5319973,1cyclictest0-21swapper/200:38:092
5319972,2cyclictest28-21ksoftirqd/223:40:002
5319970,3cyclictest31949-21ssh23:05:132
5279975,1cyclictest22-21ksoftirqd/123:30:011
5279975,1cyclictest1-21systemd21:31:321
5279973,3cyclictest508-21dbus-daemon21:00:381
5279973,3cyclictest30654-21snmpd20:03:201
5279973,3cyclictest19982-21systemd-journal19:41:481
5279973,3cyclictest14110-21ntpq19:35:161
5279973,3cyclictest0-21swapper/123:47:371
5279973,3cyclictest0-21swapper/100:28:511
5279973,2cyclictest19982-21systemd-journal23:27:311
5279973,1cyclictest0-21swapper/123:53:421
5279973,1cyclictest0-21swapper/123:19:001
5279973,1cyclictest0-21swapper/122:48:311
5279973,1cyclictest0-21swapper/100:03:281
5279972,3cyclictest19982-21systemd-journal23:44:121
5279971,5cyclictest0-21swapper/122:12:251
5279971,4cyclictest19982-21systemd-journal23:59:371
5279970,3cyclictest6191-21ssh22:03:321
5279970,1cyclictest52050irq/138-enp4s0-21:46:581
5169974,2cyclictest19982-21systemd-journal21:50:430
5169973,3cyclictest7661-21lldpd20:13:000
5169973,3cyclictest3777-21awk21:40:130
5169973,3cyclictest23548-21diskmemload21:35:180
5169973,3cyclictest21269-21awk21:30:110
5169973,3cyclictest0-21swapper/000:00:280
5169973,1cyclictest2842-21ls20:25:000
5169973,1cyclictest0-21swapper/021:56:370
5169973,1cyclictest0-21swapper/021:24:370
5169972,4cyclictest30654-21snmpd22:31:010
5169972,3cyclictest19982-21systemd-journal22:27:290
5359966,0cyclictest0-21swapper/323:56:243
5359966,0cyclictest0-21swapper/323:51:283
5359964,1cyclictest2838-21munin-run20:25:003
5359963,2cyclictest6385-21rm21:41:123
5359963,2cyclictest6308-21ssh23:30:413
5359963,2cyclictest30654-21snmpd20:42:193
5359963,2cyclictest28374-21taskset20:07:593
5359963,2cyclictest21601-21df21:30:123
5359963,2cyclictest18400-21sh22:11:093
5359963,2cyclictest16660-21sh00:00:203
5359963,2cyclictest12988-21ssh22:30:093
5359963,2cyclictest1268-21sh22:00:143
5359963,2cyclictest11831-21ssh23:35:133
5359962,3cyclictest9970-21date20:40:003
5359962,3cyclictest508-21dbus-daemon19:40:593
5359962,3cyclictest508-21dbus-daemon00:35:563
5359962,3cyclictest30654-21snmpd22:40:033
5359962,3cyclictest30654-21snmpd21:52:193
5359962,3cyclictest30654-21snmpd20:25:183
5359962,3cyclictest30654-21snmpd19:35:083
5359962,3cyclictest30654-21snmpd19:29:053
5359962,3cyclictest30654-21snmpd19:10:523
5359962,3cyclictest29389-21cat21:35:163
5359962,3cyclictest24931-21cat00:30:163
5359962,3cyclictest19982-21systemd-journal19:16:563
5359962,3cyclictest18434-21smart_sda22:55:223
5359962,3cyclictest0-21swapper/321:25:063
5359962,1cyclictest0-21swapper/323:40:493
5359962,1cyclictest0-21swapper/323:20:243
5359961,4cyclictest23553-21turbostat21:10:003
5359961,4cyclictest0-21swapper/323:06:133
5359961,3cyclictest502-21systemd-logind22:29:313
5359961,3cyclictest19982-21systemd-journal22:46:383
5359961,3cyclictest19982-21systemd-journal20:33:063
5359961,2cyclictest19982-21systemd-journal21:57:003
5359960,5cyclictest0-21swapper/321:45:193
5359960,3cyclictest18047-21/usr/sbin/munin20:55:183
5359960,2cyclictest31820-21grep22:20:193
5359960,2cyclictest22919-21diskstats00:05:133
5359960,2cyclictest22474-21df19:55:123
5359960,0cyclictest0-21swapper/323:15:593
5319963,2cyclictest8509-21cat19:25:132
5319963,2cyclictest668-21runrttasks22:10:212
5319963,2cyclictest6345-21wc00:15:192
5319963,2cyclictest6299-21grep19:20:152
5319963,2cyclictest27507-21grep20:05:162
5319963,2cyclictest26084-21sh00:30:322
5319963,2cyclictest16833-21apt20:55:012
5319963,2cyclictest1-21systemd19:10:072
5319963,2cyclictest11736-21in:imuxsock20:15:002
5319962,3cyclictest9711-21grep23:55:202
5319962,3cyclictest3422-21apt-get23:30:002
5319962,3cyclictest30654-21snmpd22:01:012
5319962,3cyclictest30654-21snmpd21:00:162
5319962,3cyclictest30654-21snmpd20:55:042
5319962,3cyclictest30654-21snmpd20:36:402
5319962,3cyclictest30654-21snmpd20:25:072
5319962,3cyclictest30654-21snmpd20:15:232
5319962,3cyclictest30654-21snmpd19:54:082
5319962,3cyclictest22754-21cat19:55:142
5319962,3cyclictest22698-21grep00:05:132
5319962,3cyclictest20433-21apt-get22:35:132
5319962,3cyclictest19982-21systemd-journal22:20:272
5319962,3cyclictest18805-21ntpq00:25:182
5319962,3cyclictest14536-21cat21:25:142
5319962,3cyclictest0-21swapper/221:56:422
5319962,1cyclictest0-21swapper/223:40:122
5319962,1cyclictest0-21swapper/223:27:492
5319962,1cyclictest0-21swapper/223:14:322
5319962,1cyclictest0-21swapper/223:03:502
5319962,1cyclictest0-21swapper/222:58:132
5319962,1cyclictest0-21swapper/222:15:032
5319962,1cyclictest0-21swapper/221:15:172
5319962,1cyclictest0-21swapper/221:13:132
5319962,1cyclictest0-21swapper/200:20:442
5319962,1cyclictest0-21swapper/200:03:382
5319961,3cyclictest19982-21systemd-journal20:43:082
5319960,5cyclictest17616-21/usr/sbin/munin19:45:132
5319960,4cyclictest19982-21systemd-journal23:51:182
5319960,0cyclictest0-21swapper/222:53:052
5319960,0cyclictest0-21swapper/222:53:052
5319960,0cyclictest0-21swapper/221:50:322
5319960,0cyclictest0-21swapper/219:35:112
5279963,2cyclictest9164-21ls22:05:151
5279963,2cyclictest8728-21ssh00:17:251
5279963,2cyclictest7003-21sshd20:31:461
5279963,2cyclictest6406-21sh23:10:071
5279963,2cyclictest508-21dbus-daemon20:30:011
5279963,2cyclictest29741-11brltty21:41:081
5279963,2cyclictest29470-21if_err_enp4s020:10:161
5279963,2cyclictest23619-21cut00:05:171
5279963,2cyclictest23264-21sshd21:06:521
5279963,2cyclictest1-21systemd21:51:581
5279963,2cyclictest11736-21in:imuxsock20:05:341
5279962,3cyclictest5974-21expr22:25:131
5279962,3cyclictest508-21dbus-daemon19:15:021
5279962,3cyclictest31748-21cstates23:05:131
5279962,3cyclictest30654-21snmpd23:21:491
5279962,3cyclictest30654-21snmpd20:46:211
5279962,3cyclictest30654-21snmpd20:19:151
5279962,3cyclictest30654-21snmpd19:31:341
5279962,3cyclictest30654-21snmpd19:25:071
5279962,3cyclictest24288-21cat00:30:121
5279962,3cyclictest19982-21systemd-journal20:40:261
5279962,3cyclictest1272-21awk20:20:171
5279962,3cyclictest0-21swapper/123:00:271
5279962,1cyclictest0-21swapper/122:42:241
5279962,1cyclictest0-21swapper/122:32:281
5279962,1cyclictest0-21swapper/100:23:081
5279960,6cyclictest0-21swapper/122:35:131
5279960,4cyclictest29349-21sshd21:56:551
5279960,0cyclictest16906-21ssh22:55:031
5169964,1cyclictest17857-21irqstats22:55:170
5169963,2cyclictest668-21runrttasks19:30:070
5169963,2cyclictest5513-21sensors_temp23:30:190
5169963,2cyclictest29741-11brltty00:31:210
5169963,2cyclictest26558-21cat20:05:120
5169963,2cyclictest24261-21ssh23:43:430
5169963,2cyclictest16014-21cat20:50:180
5169963,2cyclictest1021-21grep22:00:130
5169963,1cyclictest0-21swapper/023:35:120
5169963,1cyclictest0-21swapper/022:54:110
5169963,1cyclictest0-21swapper/022:54:110
5169962,3cyclictest6375-21ssh23:10:070
5169962,3cyclictest508-21dbus-daemon19:48:040
5169962,3cyclictest508-21dbus-daemon19:18:510
5169962,3cyclictest4892-21apt00:15:110
5169962,3cyclictest31056-21sh21:15:080
5169962,3cyclictest30654-21snmpd21:01:320
5169962,3cyclictest30654-21snmpd20:26:540
5169962,3cyclictest30625-21cat22:20:130
5169962,3cyclictest29741-11brltty19:42:380
5169962,3cyclictest29194-21df23:25:140
5169962,3cyclictest2824-21apt22:45:110
5169962,3cyclictest24743-21kernelversion21:10:150
5169962,3cyclictest24026-21sed00:05:190
5169962,3cyclictest19116-21gdbus19:25:000
5169962,3cyclictest0-21swapper/000:10:200
5169962,1cyclictest0-21swapper/023:45:240
5169962,1cyclictest0-21swapper/023:17:030
5169962,1cyclictest0-21swapper/000:20:400
5169961,4cyclictest0-21swapper/021:46:590
5169961,3cyclictest19982-21systemd-journal23:22:060
5169961,3cyclictest19982-21systemd-journal19:55:350
5169960,5cyclictest31488-21awk00:35:170
5169960,5cyclictest2340-21switchtime23:50:190
5169960,5cyclictest17479-21df_inode20:55:140
5169960,4cyclictest8106-21/usr/sbin/munin23:55:130
5169960,3cyclictest26645-21rm23:00:510
5169960,3cyclictest26323-21munin-run20:05:010
5169960,3cyclictest13297-21rm22:08:140
5359952,2cyclictest30654-21snmpd00:25:053
5359951,3cyclictest30654-21snmpd19:20:083
5359951,2cyclictest19982-21systemd-journal20:50:143
5359950,2cyclictest19326-21/usr/sbin/munin21:00:143
5319952,2cyclictest1029-21cpuspeed_turbos20:20:152
5319951,3cyclictest6003-21cat20:30:182
5319951,3cyclictest2880-21munin-node19:15:032
5319951,3cyclictest24411-21cat20:00:112
5319951,3cyclictest21577-21apt21:05:112
5319951,3cyclictest15491-21cpuspeed19:40:102
5279953,1cyclictest30422-21sh00:35:041
5279952,2cyclictest9882-21ssh22:50:071
5279952,2cyclictest9882-21ssh22:50:071
5279952,2cyclictest7615-21apt-key20:35:001
5279952,2cyclictest30654-21snmpd19:20:191
5279952,2cyclictest20254-21/usr/sbin/munin19:50:141
5279952,2cyclictest17867-21cat20:55:161
5279951,3cyclictest0-21swapper/121:20:031
5169952,2cyclictest8119-21expr20:35:140
5169952,2cyclictest6059-21cstates19:20:130
5169952,2cyclictest19868-21cat19:50:140
5169952,2cyclictest10186-21dpkg20:40:000
5169950,3cyclictest19982-21systemd-journal21:05:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional