You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 12:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8.osadl.org (updated Wed Nov 26, 2025 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
136712277244,22sleep00-21swapper/019:08:270
134252276241,19sleep30-21swapper/319:05:373
135052271242,18sleep10-21swapper/119:06:401
135552261226,23sleep20-21swapper/219:06:572
287412620,1sleep00-21swapper/019:40:140
209832620,0sleep30-21swapper/300:08:543
307682560,0sleep00-21swapper/022:16:350
14922550,0sleep20-21swapper/222:19:502
279372530,0sleep20-21swapper/223:02:022
294782180,0sleep00-21swapper/023:27:110
238122180,0sleep30-21swapper/300:37:363
44592140,0sleep10-21swapper/123:32:521
44592140,0sleep10-21swapper/123:32:521
244072140,0sleep20-21swapper/222:35:232
163622140,0sleep10-21swapper/122:30:141
148592130,0sleep30-21swapper/322:29:203
176792110,0sleep30-21swapper/322:55:063
145192100,1sleep20-21swapper/200:04:052
139009994,3cyclictest19982-21systemd-journal20:56:261
138969994,3cyclictest19982-21systemd-journal00:35:000
138969993,3cyclictest1347-21munin-run21:05:000
21997280,0sleep20-21swapper/223:21:282
139099986,2cyclictest34-21ksoftirqd/321:45:023
139099984,3cyclictest30654-21snmpd19:38:363
139099984,2cyclictest19982-21systemd-journal22:53:413
139099983,3cyclictest19982-21systemd-journal19:13:243
139059985,2cyclictest508-21dbus-daemon22:02:212
139059984,3cyclictest19982-21systemd-journal23:15:472
139059983,3cyclictest7661-21lldpd20:31:102
139059983,3cyclictest19982-21systemd-journal21:10:372
139059983,3cyclictest19982-21systemd-journal00:09:372
139059982,3cyclictest24137-21sendmail23:00:012
139059980,7cyclictest19686-21ssh22:09:212
139009986,1cyclictest0-21swapper/122:49:341
139009984,3cyclictest19982-21systemd-journal23:46:401
139009983,3cyclictest19982-21systemd-journal22:15:181
138969986,1cyclictest333-21ntp_offset21:30:170
138969986,1cyclictest31675-21ssh23:52:360
138969983,3cyclictest19982-21systemd-journal20:32:030
138969982,3cyclictest2471-21munin-run00:20:000
138969981,4cyclictest13347-21munin-run20:20:000
31318270,0sleep30-21swapper/323:05:153
17962270,1sleep30-21swapper/300:32:523
139099976,1cyclictest34-21ksoftirqd/300:00:003
139099976,0cyclictest0-21swapper/322:02:343
139099974,2cyclictest508-21dbus-daemon23:33:183
139099974,2cyclictest508-21dbus-daemon23:33:183
139099974,2cyclictest508-21dbus-daemon19:15:293
139099974,2cyclictest34-21ksoftirqd/323:45:013
139099973,3cyclictest30654-21snmpd23:21:113
139099973,3cyclictest29741-11brltty22:37:003
139099973,3cyclictest21614-21ntpq23:45:173
139099973,3cyclictest19982-21systemd-journal22:47:503
139099973,3cyclictest19982-21systemd-journal00:29:553
139099973,1cyclictest0-21swapper/322:18:013
139099973,1cyclictest0-21swapper/322:06:323
139099972,3cyclictest19982-21systemd-journal23:38:193
139099972,3cyclictest19982-21systemd-journal20:37:053
139059974,2cyclictest508-21dbus-daemon19:55:182
139059974,2cyclictest26695-21ssh22:14:162
139059974,2cyclictest1-21systemd23:05:212
139059973,3cyclictest8079-21sed23:35:182
139059973,3cyclictest508-21dbus-daemon22:27:242
139059973,3cyclictest19982-21systemd-journal20:27:392
139059973,3cyclictest11736-21in:imuxsock21:19:482
139059973,3cyclictest0-21swapper/221:58:552
139059973,3cyclictest0-21swapper/221:42:472
139059973,3cyclictest0-21swapper/221:29:242
139059973,3cyclictest0-21swapper/200:39:332
139059973,3cyclictest0-21swapper/200:11:032
139059973,1cyclictest0-21swapper/223:52:102
139059973,1cyclictest0-21swapper/221:50:162
139059973,1cyclictest0-21swapper/221:39:472
139059973,1cyclictest0-21swapper/200:15:542
139059972,3cyclictest19982-21systemd-journal00:20:402
139059971,4cyclictest19982-21systemd-journal23:43:452
139059970,4cyclictest22290-21cron20:40:002
139009975,1cyclictest29741-11brltty20:51:261
139009974,2cyclictest508-21dbus-daemon20:31:241
139009973,3cyclictest508-21dbus-daemon00:18:221
139009973,3cyclictest30654-21snmpd19:44:171
139009973,3cyclictest19982-21systemd-journal23:37:411
139009973,3cyclictest19982-21systemd-journal22:04:271
139009973,3cyclictest19982-21systemd-journal20:17:141
139009973,1cyclictest0-21swapper/123:43:491
139009973,1cyclictest0-21swapper/122:57:431
139009973,1cyclictest0-21swapper/121:50:521
139009972,4cyclictest0-21swapper/121:11:471
139009972,3cyclictest8876-21turbostat20:10:001
139009972,3cyclictest3538-21idleruntime-cro22:45:011
139009972,3cyclictest19982-21systemd-journal20:05:011
138969974,2cyclictest508-21dbus-daemon21:54:260
138969974,2cyclictest508-21dbus-daemon21:21:030
138969974,2cyclictest11736-21in:imuxsock19:14:140
138969973,3cyclictest7661-21lldpd22:23:140
138969973,3cyclictest508-21dbus-daemon00:20:020
138969973,3cyclictest3673-21sed21:10:000
138969973,3cyclictest30654-21snmpd23:02:050
138969973,3cyclictest23707-21systemctl00:10:190
138969973,3cyclictest19982-21systemd-journal00:05:000
138969973,3cyclictest1-21systemd19:35:060
138969973,1cyclictest20140-21perf23:45:010
138969972,3cyclictest14061-21dump-pmu-power00:30:000
138969971,4cyclictest19982-21systemd-journal23:19:080
138969970,6cyclictest6028-21cstates23:10:130
139099964,1cyclictest6632-21needreboot23:10:173
139099963,2cyclictest8805-21chrt20:09:193
139099963,2cyclictest668-21runrttasks19:30:103
139099963,2cyclictest508-21dbus-daemon20:15:333
139099963,2cyclictest508-21dbus-daemon19:27:103
139099963,2cyclictest3052-21cut00:20:133
139099963,2cyclictest28594-21sh21:51:103
139099963,2cyclictest28280-21cat23:50:143
139099963,2cyclictest24722-21rm21:25:053
139099963,2cyclictest20753-21ssh22:10:013
139099963,2cyclictest19347-21ssh21:45:093
139099963,2cyclictest13588-21/usr/sbin/munin20:20:173
139099963,2cyclictest0-21swapper/323:15:093
139099963,1cyclictest0-21swapper/321:15:543
139099962,3cyclictest7281-21/usr/sbin/munin21:35:233
139099962,3cyclictest5164-21ntpd00:10:173
139099962,3cyclictest508-21dbus-daemon21:05:373
139099962,3cyclictest4308-21expr21:10:133
139099962,3cyclictest352-21uname21:30:193
139099962,3cyclictest31069-21cat19:45:163
139099962,3cyclictest30654-21snmpd23:25:283
139099962,3cyclictest30654-21snmpd20:41:493
139099962,3cyclictest30520-21ntpq20:55:173
139099962,3cyclictest2634-21cat22:20:143
139099962,3cyclictest26023-21ntpq20:45:183
139099962,3cyclictest19982-21systemd-journal20:32:063
139099962,3cyclictest16546-21head22:30:143
139099962,3cyclictest16046-21cat20:25:143
139099962,3cyclictest1396-21ntp_kernel_err21:55:173
139099962,2cyclictest29861-21sshd19:41:553
139099962,1cyclictest0-21swapper/323:02:483
139099962,1cyclictest0-21swapper/322:40:243
139099962,1cyclictest0-21swapper/321:24:013
139099961,3cyclictest19982-21systemd-journal00:15:023
139099960,4cyclictest19982-21systemd-journal20:03:533
139059965,1cyclictest28-21ksoftirqd/200:00:002
139059963,2cyclictest6750-21open_inodes23:10:172
139059963,2cyclictest29741-11brltty21:06:022
139059963,2cyclictest25421-21anacron19:32:202
139059963,2cyclictest24121-21ssh23:47:152
139059962,3cyclictest7091-21cstates20:05:122
139059962,3cyclictest5644-21open_files20:00:192
139059962,3cyclictest508-21dbus-daemon19:46:212
139059962,3cyclictest30654-21snmpd23:30:572
139059962,3cyclictest30654-21snmpd23:30:572
139059962,3cyclictest30654-21snmpd23:25:412
139059962,3cyclictest30654-21snmpd22:41:252
139059962,3cyclictest30654-21snmpd22:21:492
139059962,3cyclictest30654-21snmpd20:56:002
139059962,3cyclictest30654-21snmpd20:20:512
139059962,3cyclictest30654-21snmpd20:10:152
139059962,3cyclictest30654-21snmpd19:21:472
139059962,3cyclictest29954-21seq19:42:512
139059962,3cyclictest28650-21ls20:50:212
139059962,3cyclictest1-21systemd21:20:132
139059962,3cyclictest11778-21fschecks_count20:15:152
139059962,3cyclictest0-21swapper/200:26:252
139059962,1cyclictest0-21swapper/222:50:402
139059962,1cyclictest0-21swapper/222:46:592
139059962,1cyclictest0-21swapper/200:30:392
139059961,4cyclictest27049-21cron20:50:002
139059961,3cyclictest19982-21systemd-journal21:30:142
139059961,3cyclictest19982-21systemd-journal21:02:112
139059961,3cyclictest19982-21systemd-journal19:11:492
139059960,6cyclictest0-21swapper/219:35:162
139059960,5cyclictest15882-21/usr/sbin/munin22:30:152
139059960,4cyclictest23428-21idleruntime-cro19:30:012
139059960,0cyclictest0-21swapper/221:45:402
139059960,0cyclictest0-21swapper/219:15:022
139009966,0cyclictest0-21swapper/121:25:501
139009964,1cyclictest508-21dbus-daemon19:29:401
139009963,2cyclictest8650-21seq23:11:411
139009963,2cyclictest668-21runrttasks00:10:161
139009963,2cyclictest5230-21rm00:21:151
139009963,2cyclictest508-21dbus-daemon22:10:011
139009963,2cyclictest31071-21cat19:45:151
139009963,2cyclictest30654-21snmpd23:15:411
139009963,2cyclictest30654-21snmpd21:35:171
139009963,2cyclictest24334-21if_enp4s019:30:161
139009963,2cyclictest19982-21systemd-journal23:20:231
139009963,2cyclictest19982-21systemd-journal20:14:551
139009963,2cyclictest15815-21sh21:41:471
139009963,2cyclictest14185-21cat19:10:141
139009963,2cyclictest1222-21ssh23:06:081
139009963,1cyclictest19982-21systemd-journal22:06:071
139009962,3cyclictest516-21expr19:50:131
139009962,3cyclictest30654-21snmpd21:01:521
139009962,3cyclictest30654-21snmpd20:49:061
139009962,3cyclictest30654-21snmpd20:28:331
139009962,3cyclictest30654-21snmpd19:59:091
139009962,3cyclictest30654-21snmpd00:35:251
139009962,3cyclictest27876-21expr23:50:121
139009962,3cyclictest19982-21systemd-journal20:40:001
139009962,3cyclictest16517-21cat19:15:021
139009962,3cyclictest16018-21unixbench_singl00:30:191
139009962,3cyclictest13573-21date20:20:001
139009962,3cyclictest0-21swapper/123:55:071
139009962,3cyclictest0-21swapper/123:26:091
139009962,3cyclictest0-21swapper/122:51:401
139009962,1cyclictest0-21swapper/123:00:421
139009962,1cyclictest0-21swapper/122:37:431
139009962,1cyclictest0-21swapper/122:22:421
139009962,1cyclictest0-21swapper/121:58:321
139009962,1cyclictest0-21swapper/121:46:041
139009962,1cyclictest0-21swapper/121:20:091
139009962,1cyclictest0-21swapper/121:15:091
139009962,1cyclictest0-21swapper/100:25:121
139009962,1cyclictest0-21swapper/100:06:331
139009962,1cyclictest0-21swapper/100:01:391
139009961,4cyclictest0-21swapper/121:34:071
139009961,2cyclictest14132-21ssh22:28:371
138969963,2cyclictest668-21runrttasks20:10:070
138969963,2cyclictest30654-21snmpd19:45:180
138969963,2cyclictest30214-21sh22:40:160
138969963,2cyclictest2629-21cstates19:55:130
138969963,2cyclictest25880-21ntp_states21:25:160
138969963,2cyclictest23156-21ssh00:36:530
138969963,2cyclictest21397-21sh23:20:550
138969963,2cyclictest19982-21systemd-journal20:50:110
138969963,2cyclictest15131-21sh22:05:190
138969963,2cyclictest14501-21ssh21:40:270
138969963,2cyclictest11736-21in:imuxsock19:29:150
138969963,2cyclictest11467-21df21:15:130
138969963,2cyclictest0-21swapper/023:35:380
138969963,2cyclictest0-21swapper/022:36:200
138969962,3cyclictest5583-21cat21:10:210
138969962,3cyclictest30654-21snmpd21:57:370
138969962,3cyclictest30654-21snmpd20:42:220
138969962,3cyclictest30654-21snmpd20:25:200
138969962,3cyclictest29741-11brltty22:01:320
138969962,3cyclictest20180-21if_err_enp4s021:45:170
138969962,3cyclictest19982-21systemd-journal21:37:170
138969962,3cyclictest1874-21unixbench-2d23:30:210
138969962,3cyclictest1874-21unixbench-2d23:30:210
138969962,3cyclictest16414-21fschecks_time22:30:140
138969962,3cyclictest1215-21ls19:50:180
138969962,3cyclictest0-21swapper/023:55:160
138969962,3cyclictest0-21swapper/022:55:030
138969962,3cyclictest0-21swapper/022:11:160
138969962,3cyclictest0-21swapper/020:22:420
138969962,3cyclictest0-21swapper/000:05:020
138969961,3cyclictest30654-21snmpd23:45:060
138969961,3cyclictest19982-21systemd-journal22:50:210
138969961,3cyclictest19982-21systemd-journal20:55:360
138969961,3cyclictest19982-21systemd-journal20:48:560
138969960,3cyclictest8679-21rm22:48:170
138969960,3cyclictest4848-21rm23:09:560
138969960,2cyclictest10172-21ntp_states22:25:170
139099953,1cyclictest32619-21acpi19:50:123
139099952,2cyclictest31958-21tr21:00:143
139099952,2cyclictest2644-21expr19:55:133
139099951,3cyclictest9136-21/usr/sbin/munin20:10:153
139099951,3cyclictest27322-21apt-get20:50:133
139099951,3cyclictest19895-21cat19:20:143
139099950,3cyclictest19982-21systemd-journal00:00:003
139059952,2cyclictest490-21cat19:50:132
139059952,2cyclictest23018-21tr20:40:132
139009952,2cyclictest25997-21cat19:35:141
139009952,2cyclictest20451-21expr20:35:131
139009951,2cyclictest19982-21systemd-journal21:05:121
139009951,2cyclictest19982-21systemd-journal19:20:051
138969952,2cyclictest6975-21cpuspeed20:05:120
138969952,2cyclictest4639-21taskset20:00:070
138969952,2cyclictest24018-21expr19:30:130
138969952,2cyclictest19421-21cat19:20:130
138969952,2cyclictest17188-21cat19:15:110
138969951,3cyclictest20545-21cat20:35:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional