You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-16 - 07:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Tue Sep 16, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
230312303270,20sleep20-21swapper/219:08:572
227562285224,49sleep30-21swapper/319:05:453
229032258225,21sleep00-21swapper/019:07:330
228042257223,22sleep10-21swapper/119:06:221
282512640,0sleep20-21swapper/222:08:352
11072640,0sleep00-21swapper/000:12:030
260882620,0sleep10-21swapper/122:06:261
180452590,0sleep10-21swapper/100:00:141
70322580,0sleep10-21swapper/120:55:131
93382560,0sleep20-21swapper/223:05:212
148882560,0sleep10-21swapper/123:57:251
84502550,0sleep30-21swapper/323:29:403
83302220,0sleep30-21swapper/322:17:013
190122200,0sleep30-21swapper/321:38:053
190122200,0sleep30-21swapper/321:38:043
316132180,0sleep2271rcuc/222:10:192
130342150,0sleep00-21swapper/022:20:190
277872140,0sleep20-21swapper/219:15:202
2322299105,3cyclictest19982-21systemd-journal22:58:020
225642100,0sleep00-21swapper/022:27:440
232259997,1cyclictest0-21swapper/120:14:541
232259995,3cyclictest508-21dbus-daemon21:07:281
8675280,0sleep30-21swapper/323:53:163
232339986,1cyclictest34-21ksoftirqd/321:15:013
232339984,3cyclictest19982-21systemd-journal19:28:113
232339984,3cyclictest11736-21in:imuxsock23:08:043
232339983,3cyclictest19982-21systemd-journal20:52:033
232339983,3cyclictest19982-21systemd-journal20:11:593
232339983,3cyclictest19982-21systemd-journal00:26:543
232309985,2cyclictest28-21ksoftirqd/223:50:012
232309984,3cyclictest508-21dbus-daemon22:40:072
232309984,3cyclictest27434-21cron20:30:002
232309984,3cyclictest24707-21diskstats00:05:142
232309983,3cyclictest19982-21systemd-journal21:42:582
232309983,3cyclictest19982-21systemd-journal20:01:082
232309983,3cyclictest19982-21systemd-journal00:29:492
232259984,3cyclictest508-21dbus-daemon19:44:281
232259984,3cyclictest19982-21systemd-journal22:58:101
232259984,2cyclictest19982-21systemd-journal20:49:081
232259983,3cyclictest19982-21systemd-journal22:23:131
232259980,7cyclictest13212-21diskmemload23:01:301
232229984,3cyclictest7661-21lldpd21:40:430
232229984,3cyclictest19982-21systemd-journal22:33:070
232229983,3cyclictest19982-21systemd-journal21:19:350
232229983,3cyclictest19982-21systemd-journal20:59:240
7016270,0sleep10-21swapper/100:16:481
232339974,2cyclictest34-21ksoftirqd/322:25:003
232339974,2cyclictest12350-21gunzip23:55:193
232339973,3cyclictest508-21dbus-daemon20:59:583
232339973,3cyclictest0-21swapper/300:06:093
232339973,1cyclictest0-21swapper/322:30:453
232339973,1cyclictest0-21swapper/321:22:483
232339973,1cyclictest0-21swapper/300:10:023
232339972,3cyclictest7661-21lldpd00:38:543
232339972,3cyclictest19982-21systemd-journal22:50:013
232339972,3cyclictest19982-21systemd-journal20:27:513
232309974,2cyclictest30654-21snmpd19:58:332
232309974,2cyclictest22950-21cron20:20:002
232309974,2cyclictest17365-21sshd21:36:242
232309974,2cyclictest17365-21sshd21:36:242
232309973,3cyclictest508-21dbus-daemon21:50:012
232309973,3cyclictest30654-21snmpd23:15:132
232309973,3cyclictest19982-21systemd-journal22:28:102
232309973,3cyclictest19982-21systemd-journal19:23:362
232309973,3cyclictest0-21swapper/222:20:262
232309973,2cyclictest19982-21systemd-journal22:16:192
232309973,1cyclictest17405-21awk00:00:012
232309972,3cyclictest19982-21systemd-journal21:15:002
232309972,3cyclictest19982-21systemd-journal19:45:022
232259975,1cyclictest0-21swapper/122:38:331
232259974,2cyclictest508-21dbus-daemon21:35:011
232259974,2cyclictest22-21ksoftirqd/119:35:021
232259973,3cyclictest508-21dbus-daemon00:13:081
232259973,3cyclictest29232-21cron23:45:011
232259973,3cyclictest27776-21ntpq21:20:171
232259973,3cyclictest21712-21sensors_temp21:15:231
232259973,3cyclictest19116-21gdbus00:35:001
232259973,3cyclictest0-21swapper/121:44:261
232259973,3cyclictest0-21swapper/100:05:311
232259973,1cyclictest0-21swapper/123:51:171
232259973,1cyclictest0-21swapper/122:47:341
232259973,1cyclictest0-21swapper/121:59:291
232259972,3cyclictest19982-21systemd-journal19:45:241
232229974,2cyclictest32701-21sshd21:48:070
232229974,2cyclictest31586-21cron22:39:550
232229974,2cyclictest29741-11brltty23:49:460
232229974,2cyclictest28323-21grep21:20:200
232229973,3cyclictest4829-21smartctl20:50:180
232229973,3cyclictest30993-21cat19:25:150
232229973,3cyclictest26351-21df00:35:140
232229973,3cyclictest22457-21sh23:15:190
232229973,3cyclictest19982-21systemd-journal20:26:360
232229973,3cyclictest17605-21awk23:35:210
232229973,3cyclictest1-21systemd20:23:160
232229973,3cyclictest1-21systemd00:19:240
232229973,3cyclictest10482-21if_enp4s019:50:150
232229973,2cyclictest19982-21systemd-journal23:43:270
232229973,2cyclictest19982-21systemd-journal22:19:560
232229972,3cyclictest7661-21lldpd19:14:480
232229972,3cyclictest19982-21systemd-journal23:03:020
232229972,3cyclictest19982-21systemd-journal20:17:250
232229972,1cyclictest0-21swapper/023:05:150
232229970,6cyclictest8608-21cut19:45:180
232229970,6cyclictest31636-21sh23:22:190
232229970,2cyclictest15529-21munin-run00:25:000
232229970,1cyclictest0-21swapper/023:50:200
232339963,2cyclictest6348-21ssh00:16:003
232339963,2cyclictest5191-21rm21:51:103
232339963,2cyclictest3465-21tail20:45:213
232339963,2cyclictest34-21ksoftirqd/321:05:013
232339963,2cyclictest29790-21cpuspeed_turbos23:45:123
232339963,2cyclictest29741-11brltty23:30:093
232339963,2cyclictest25212-21idleruntime-cro20:25:003
232339963,2cyclictest24027-21sed22:05:153
232339963,2cyclictest18269-21df00:00:153
232339963,2cyclictest16103-21latency_hist22:00:023
232339963,2cyclictest13045-21ssh21:57:043
232339963,2cyclictest0-21swapper/323:16:263
232339962,3cyclictest508-21dbus-daemon19:36:573
232339962,3cyclictest30654-21snmpd21:30:163
232339962,3cyclictest30654-21snmpd20:41:303
232339962,3cyclictest30654-21snmpd20:31:483
232339962,3cyclictest30654-21snmpd20:05:033
232339962,3cyclictest30654-21snmpd20:01:213
232339962,3cyclictest30654-21snmpd19:50:513
232339962,3cyclictest30654-21snmpd19:45:153
232339962,3cyclictest30654-21snmpd19:30:173
232339962,3cyclictest30654-21snmpd19:15:163
232339962,3cyclictest30654-21snmpd00:30:023
232339962,3cyclictest30654-21snmpd00:20:593
232339962,3cyclictest29276-21expr19:20:163
232339962,3cyclictest23721-21cat19:10:143
232339962,3cyclictest20406-21cat22:50:153
232339962,3cyclictest14017-21cron20:00:023
232339962,3cyclictest0-21swapper/323:00:583
232339962,3cyclictest0-21swapper/322:26:293
232339962,3cyclictest0-21swapper/321:26:133
232339962,1cyclictest0-21swapper/322:10:093
232339961,4cyclictest28953-21sort21:45:173
232339961,3cyclictest19982-21systemd-journal23:10:093
232339961,3cyclictest19982-21systemd-journal22:55:583
232339960,6cyclictest0-21swapper/321:16:073
232339960,5cyclictest23282-21/usr/sbin/munin23:40:153
232339960,5cyclictest23045-21sed21:40:223
232339960,5cyclictest17040-21ntpq23:35:183
232339960,4cyclictest19982-21systemd-journal22:41:213
232339960,4cyclictest19982-21systemd-journal20:15:443
232339960,3cyclictest1014-21cat22:35:223
232309965,1cyclictest28571-21ssh00:36:442
232309964,2cyclictest11736-21in:imuxsock00:15:382
232309964,1cyclictest31949-21sendmail20:40:012
232309963,2cyclictest9832-21ssh21:30:552
232309963,2cyclictest6505-21sshd21:52:252
232309963,2cyclictest508-21dbus-daemon20:51:132
232309963,2cyclictest4920-21rm21:27:472
232309963,2cyclictest3791-21sshd20:48:002
232309963,2cyclictest20333-21sh00:01:082
232309963,2cyclictest13717-21fschecks_count22:45:152
232309963,2cyclictest12793-21rm00:21:312
232309963,2cyclictest11736-21in:imuxsock21:14:592
232309962,3cyclictest7024-21cron19:45:032
232309962,3cyclictest30654-21snmpd21:06:162
232309962,3cyclictest30654-21snmpd21:03:162
232309962,3cyclictest30654-21snmpd19:26:372
232309962,3cyclictest27354-21tail21:20:142
232309962,3cyclictest19982-21systemd-journal22:36:212
232309962,3cyclictest11450-21seq19:51:072
232309962,1cyclictest0-21swapper/223:51:172
232309962,1cyclictest0-21swapper/223:42:062
232309962,1cyclictest0-21swapper/223:38:062
232309962,1cyclictest0-21swapper/223:27:552
232309962,1cyclictest0-21swapper/223:23:112
232309962,1cyclictest0-21swapper/223:00:332
232309962,1cyclictest0-21swapper/221:56:422
232309962,1cyclictest0-21swapper/200:10:122
232309961,3cyclictest502-21systemd-logind00:30:392
232309961,3cyclictest19982-21systemd-journal23:30:102
232309961,3cyclictest19982-21systemd-journal20:05:192
232309961,3cyclictest19982-21systemd-journal19:12:202
232309961,1cyclictest0-21swapper/222:30:212
232309960,4cyclictest19982-21systemd-journal20:57:492
232309960,3cyclictest4791-21dump-pmu-power19:40:022
232309960,3cyclictest20733-21munin-run20:15:002
232309960,3cyclictest1746-21basename20:45:012
232259966,0cyclictest0-21swapper/121:35:021
232259966,0cyclictest0-21swapper/121:35:011
232259964,1cyclictest7160-21grep22:40:171
232259964,1cyclictest18750irq/134-ahci[0020:30:011
232259963,2cyclictest508-21dbus-daemon21:52:071
232259963,2cyclictest508-21dbus-daemon19:58:131
232259963,2cyclictest4834-21sed20:50:181
232259963,2cyclictest30654-21snmpd23:45:141
232259963,2cyclictest30654-21snmpd21:25:441
232259963,2cyclictest30654-21snmpd20:20:551
232259963,2cyclictest28091-21df_inode20:30:111
232259963,2cyclictest20750-21sh23:38:261
232259963,2cyclictest19982-21systemd-journal22:17:011
232259963,2cyclictest18500-21sh22:00:351
232259962,3cyclictest508-21dbus-daemon00:20:141
232259962,3cyclictest31554-21sed19:25:181
232259962,3cyclictest31030-21perl22:10:161
232259962,3cyclictest30654-21snmpd23:26:381
232259962,3cyclictest30654-21snmpd23:20:171
232259962,3cyclictest30654-21snmpd23:05:001
232259962,3cyclictest30654-21snmpd22:50:241
232259962,3cyclictest30654-21snmpd21:11:461
232259962,3cyclictest30654-21snmpd19:23:051
232259962,3cyclictest30654-21snmpd00:25:091
232259962,3cyclictest26841-21sed22:30:221
232259962,3cyclictest19982-21systemd-journal20:37:451
232259962,3cyclictest14895-21expr23:10:151
232259962,3cyclictest1-21systemd20:01:081
232259962,3cyclictest1120-21date20:40:211
232259962,2cyclictest19982-21systemd-journal19:15:401
232259962,1cyclictest0-21swapper/123:15:111
232259962,1cyclictest0-21swapper/122:28:361
232259962,1cyclictest0-21swapper/100:35:181
232259961,3cyclictest19982-21systemd-journal19:38:381
232259960,2cyclictest28548-21df_inode21:45:141
232229963,2cyclictest962-21tr21:25:130
232229963,2cyclictest9170-21/usr/sbin/munin23:30:130
232229963,2cyclictest8709-21apt-get21:00:130
232229963,2cyclictest785-21cstates19:30:140
232229963,2cyclictest6633-21vmstat19:40:220
232229963,2cyclictest4022-21swap19:35:190
232229963,2cyclictest3545-21load21:50:170
232229963,2cyclictest30182-21cat20:35:140
232229963,2cyclictest19283-21gltestperf20:10:180
232229963,2cyclictest18154-21expr00:00:140
232229963,2cyclictest14989-21expr23:10:160
232229963,2cyclictest13778-21chrt19:57:220
232229963,2cyclictest10127-21rm21:55:190
232229963,2cyclictest0-21swapper/022:11:300
232229963,2cyclictest0-21swapper/021:35:430
232229963,2cyclictest0-21swapper/021:35:430
232229962,4cyclictest51950irq/137-enp4s0-22:00:180
232229962,3cyclictest909-21cat20:40:180
232229962,3cyclictest8340-21cat21:30:160
232229962,3cyclictest30654-21snmpd23:26:080
232229962,3cyclictest30654-21snmpd22:51:180
232229962,3cyclictest30654-21snmpd22:40:150
232229962,3cyclictest30654-21snmpd19:20:590
232229962,3cyclictest30654-21snmpd19:17:410
232229962,3cyclictest19982-21systemd-journal20:03:380
232229962,3cyclictest16149-21cstates00:25:130
232229962,3cyclictest13765-21cut21:10:130
232229962,3cyclictest0-21swapper/022:47:040
232229962,3cyclictest0-21swapper/000:06:150
232229962,1cyclictest0-21swapper/023:55:050
232229962,1cyclictest0-21swapper/022:05:170
232229962,1cyclictest0-21swapper/000:30:250
232229961,3cyclictest19982-21systemd-journal20:47:520
232229961,3cyclictest19982-21systemd-journal20:07:250
232229960,2cyclictest19982-21systemd-journal21:05:230
16875260,0sleep20-21swapper/223:10:572
232339952,2cyclictest5591-21tail19:40:153
232339952,2cyclictest30307-21expr20:35:143
232339951,3cyclictest11186-21gdbus21:05:013
232339950,1cyclictest27985-21/usr/sbin/munin23:20:123
232309953,1cyclictest20164-21sh22:50:142
232309952,2cyclictest30654-21snmpd20:30:042
232309952,2cyclictest27309-21cat22:55:142
232309952,2cyclictest23845-21hddtemp_smartct20:20:142
232309951,3cyclictest0-21swapper/222:00:012
232309951,2cyclictest19982-21systemd-journal19:34:232
232259953,1cyclictest0-21swapper/123:30:061
232259952,2cyclictest9956-21tr19:50:131
232259952,2cyclictest8687-21find21:00:131
232259952,2cyclictest23842-21grep19:10:141
232259952,2cyclictest21666-21cat20:15:161
232259952,2cyclictest16652-21tr20:05:151
232229952,2cyclictest28286-21gltestperf20:30:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional