You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 23:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Thu Sep 18, 2025 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
212492304272,20sleep20-21swapper/207:06:282
212502274239,22sleep30-21swapper/307:06:293
211812274210,22sleep10-21swapper/107:05:351
212022265232,21sleep00-21swapper/007:05:500
149142610,0sleep20-21swapper/209:37:042
144342600,0sleep30-21swapper/310:25:073
293392580,0sleep10-21swapper/109:48:171
184652580,0sleep00-21swapper/009:40:160
137972570,0sleep00-21swapper/011:49:490
207882550,0sleep00-21swapper/009:15:560
285692540,0sleep10-21swapper/110:11:351
83552530,0sleep10-21swapper/111:24:591
213982150,0sleep00-21swapper/011:33:040
285832130,0sleep20-21swapper/211:16:112
21628991310,2cyclictest12-21ksoftirqd/012:00:000
199382130,0sleep20-21swapper/211:53:322
2162899129,2cyclictest12-21ksoftirqd/011:00:000
2162899129,2cyclictest12-21ksoftirqd/007:15:010
2162899118,2cyclictest12-21ksoftirqd/010:25:010
2162899108,2cyclictest12-21ksoftirqd/010:45:020
2162899107,2cyclictest12-21ksoftirqd/012:20:000
2162899107,2cyclictest12-21ksoftirqd/011:40:010
2162899107,2cyclictest12-21ksoftirqd/010:20:010
2162899107,2cyclictest12-21ksoftirqd/009:30:000
182572100,0sleep20-21swapper/212:34:522
216419994,3cyclictest508-21dbus-daemon08:34:223
216419994,3cyclictest19982-21systemd-journal09:01:283
216369994,3cyclictest19982-21systemd-journal07:57:392
216289998,1cyclictest131rcuc/012:30:010
216289998,1cyclictest131rcuc/012:30:000
216289997,2cyclictest12-21ksoftirqd/009:40:010
216289997,1cyclictest131rcuc/007:20:000
216289997,1cyclictest12-21ksoftirqd/008:10:000
216289997,1cyclictest12-21ksoftirqd/008:00:000
216289996,2cyclictest12-21ksoftirqd/010:15:010
216289996,2cyclictest12-21ksoftirqd/009:35:000
216289996,2cyclictest12-21ksoftirqd/009:15:000
16288290,0sleep10-21swapper/112:11:561
216419984,3cyclictest508-21dbus-daemon08:24:223
216419984,3cyclictest19982-21systemd-journal11:08:513
216419983,3cyclictest19982-21systemd-journal07:10:073
216369983,3cyclictest19982-21systemd-journal11:46:012
216369983,3cyclictest19982-21systemd-journal07:12:112
216369983,1cyclictest28-21ksoftirqd/212:25:132
216369983,1cyclictest28-21ksoftirqd/212:25:132
216339986,1cyclictest4851-21users11:00:191
216289987,1cyclictest12-21ksoftirqd/010:55:010
216289987,1cyclictest12-21ksoftirqd/008:45:020
216289987,1cyclictest12-21ksoftirqd/007:40:000
216289985,2cyclictest6087-21grep09:55:150
216289985,2cyclictest12-21ksoftirqd/008:40:010
216289984,3cyclictest508-21dbus-daemon10:05:440
216289984,3cyclictest19982-21systemd-journal10:50:020
216289983,3cyclictest19982-21systemd-journal09:24:000
216289983,3cyclictest141rcu_preempt10:25:160
216289980,7cyclictest7308-21ssh11:02:270
17169280,0sleep30-21swapper/312:12:433
216419974,2cyclictest508-21dbus-daemon12:25:293
216419974,2cyclictest508-21dbus-daemon12:25:293
216419974,2cyclictest508-21dbus-daemon07:56:493
216419974,2cyclictest26083-21df_inode10:10:123
216419973,3cyclictest8235-21ntpq10:20:223
216419973,3cyclictest7815-21netstat11:45:173
216419973,3cyclictest19982-21systemd-journal11:12:043
216419973,3cyclictest19982-21systemd-journal07:47:133
216419973,3cyclictest0-21swapper/312:32:453
216419973,1cyclictest0-21swapper/309:36:063
216419972,3cyclictest19982-21systemd-journal10:32:473
216419972,3cyclictest19982-21systemd-journal09:50:563
216419972,3cyclictest19982-21systemd-journal08:50:123
216369976,1cyclictest28-21ksoftirqd/208:35:012
216369974,2cyclictest508-21dbus-daemon10:57:282
216369974,2cyclictest508-21dbus-daemon09:32:202
216369974,2cyclictest508-21dbus-daemon08:40:372
216369974,2cyclictest21780-21xargs12:15:192
216369973,3cyclictest9826-21cron09:05:002
216369973,3cyclictest508-21dbus-daemon08:01:492
216369973,3cyclictest19982-21systemd-journal10:06:082
216369973,3cyclictest15869-21sensors_temp10:25:192
216369973,1cyclictest0-21swapper/212:14:192
216369973,1cyclictest0-21swapper/212:01:262
216369972,3cyclictest7661-21lldpd09:21:402
216369971,4cyclictest19982-21systemd-journal11:11:152
216369971,4cyclictest19982-21systemd-journal09:45:422
216369971,2cyclictest7659-21lldpd11:24:502
216339974,2cyclictest19982-21systemd-journal08:00:331
216339973,3cyclictest30654-21snmpd09:15:371
216339973,3cyclictest19982-21systemd-journal07:39:431
216339973,3cyclictest0-21swapper/111:19:111
216339973,2cyclictest19982-21systemd-journal11:35:001
216339972,5cyclictest23895-21kworker/1:112:18:311
216339972,4cyclictest290472chrt09:23:011
216339971,2cyclictest21832-21munin-run08:20:001
216339970,3cyclictest19982-21systemd-journal11:31:021
216339970,1cyclictest0-21swapper/110:15:061
216289976,1cyclictest12-21ksoftirqd/007:45:020
216289975,2cyclictest12-21ksoftirqd/012:35:000
216289974,2cyclictest12-21ksoftirqd/011:10:000
216289974,1cyclictest12-21ksoftirqd/007:41:480
216289973,3cyclictest20735-21users12:35:260
216289973,3cyclictest19982-21systemd-journal12:21:260
216289973,3cyclictest0-21swapper/011:22:160
216289973,3cyclictest0-21swapper/010:00:310
216289973,2cyclictest141rcu_preempt11:13:320
216289973,1cyclictest12-21ksoftirqd/008:15:350
216289972,3cyclictest26313-21munin-run08:30:000
216289972,3cyclictest24081-21dump-pmu-power08:25:000
216289972,3cyclictest141rcu_preempt11:15:020
216289972,1cyclictest141rcu_preempt10:35:220
216289971,4cyclictest12-21ksoftirqd/012:10:390
216289971,4cyclictest12-21ksoftirqd/010:30:280
216289971,1cyclictest141rcu_preempt11:25:060
216289970,5cyclictest12-21ksoftirqd/012:00:130
216289970,5cyclictest12-21ksoftirqd/008:10:150
24326260,1sleep10-21swapper/112:38:281
216419966,0cyclictest0-21swapper/310:01:393
216419964,1cyclictest31645-21hddtemp_smartct08:40:153
216419964,1cyclictest31431-21unixbench_multi10:35:213
216419963,2cyclictest508-21dbus-daemon12:00:273
216419963,2cyclictest508-21dbus-daemon08:26:023
216419963,2cyclictest508-21dbus-daemon07:17:003
216419963,2cyclictest502-21systemd-logind09:30:163
216419963,2cyclictest29741-11brltty07:24:423
216419963,2cyclictest25390-21/usr/sbin/munin09:45:123
216419963,2cyclictest18921-21rm12:35:133
216419963,2cyclictest17618-21sh10:48:083
216419963,2cyclictest16934-21sh11:30:133
216419963,2cyclictest16008-21idleruntime08:05:163
216419963,2cyclictest15492-21sshd09:11:463
216419962,3cyclictest8636-21awk07:50:123
216419962,3cyclictest508-21dbus-daemon11:40:013
216419962,3cyclictest508-21dbus-daemon11:25:503
216419962,3cyclictest32079-21needreboot09:25:183
216419962,3cyclictest30942-21seq07:27:263
216419962,3cyclictest30654-21snmpd12:05:433
216419962,3cyclictest30654-21snmpd11:58:393
216419962,3cyclictest30654-21snmpd10:15:073
216419962,3cyclictest30654-21snmpd07:44:523
216419962,3cyclictest30654-21snmpd07:30:083
216419962,3cyclictest28294-21expr10:55:163
216419962,3cyclictest25598-21cat09:20:163
216419962,3cyclictest20507-21grep12:15:123
216419962,3cyclictest20152-21ntpq10:05:203
216419962,3cyclictest0-21swapper/311:15:303
216419962,2cyclictest19982-21systemd-journal09:43:373
216419962,1cyclictest0-21swapper/310:42:173
216419961,4cyclictest0-21swapper/311:01:153
216419961,3cyclictest19982-21systemd-journal09:15:413
216419961,3cyclictest19982-21systemd-journal08:55:383
216419961,3cyclictest19982-21systemd-journal08:38:063
216419960,6cyclictest0-21swapper/312:20:493
216419960,5cyclictest15327-21sed11:50:163
216419960,0cyclictest0-21swapper/311:36:543
216419960,0cyclictest0-21swapper/311:23:493
216419960,0cyclictest0-21swapper/309:57:123
216369964,1cyclictest4466-21hddtemp_smartct07:40:132
216369963,2cyclictest52150irq/139-enp4s0-07:15:112
216369963,2cyclictest464-21cat09:50:202
216369963,2cyclictest4039-21cat08:50:152
216369963,2cyclictest30654-21snmpd11:00:242
216369963,2cyclictest2927-21sshd08:47:462
216369963,2cyclictest26839-21ssh11:36:102
216369963,2cyclictest19982-21systemd-journal07:35:002
216369963,2cyclictest12065-21diskmemload11:30:092
216369963,1cyclictest0-21swapper/210:15:362
216369962,3cyclictest7661-21lldpd09:26:402
216369962,3cyclictest7086-21cat07:45:152
216369962,3cyclictest5404-21fschecks_count12:05:162
216369962,3cyclictest508-21dbus-daemon09:09:252
216369962,3cyclictest502-21systemd-logind10:47:022
216369962,3cyclictest476-21sed11:40:182
216369962,3cyclictest30654-21snmpd11:06:452
216369962,3cyclictest30654-21snmpd07:51:132
216369962,3cyclictest29046-21wc12:20:192
216369962,3cyclictest27257-21cat07:20:142
216369962,3cyclictest26377-21cat10:10:132
216369962,3cyclictest25105-21cat08:25:132
216369962,3cyclictest24082-21grep08:25:002
216369962,3cyclictest2187-21cat07:35:152
216369962,3cyclictest19982-21systemd-journal10:40:212
216369962,3cyclictest0-21swapper/210:03:222
216369962,2cyclictest19982-21systemd-journal08:16:012
216369962,1cyclictest0-21swapper/211:25:092
216369962,1cyclictest0-21swapper/210:51:012
216369962,1cyclictest0-21swapper/210:32:172
216369961,3cyclictest19982-21systemd-journal11:56:032
216369961,3cyclictest19982-21systemd-journal09:15:462
216369961,3cyclictest19982-21systemd-journal09:10:152
216369961,1cyclictest0-21swapper/209:40:152
216369960,6cyclictest0-21swapper/208:10:172
216369960,5cyclictest29827-21apt-get10:35:132
216369960,4cyclictest19982-21systemd-journal09:55:182
216369960,3cyclictest18764-21ssh12:35:062
216369960,0cyclictest0-21swapper/210:21:022
216339963,2cyclictest6535-21tr08:55:181
216339963,2cyclictest508-21dbus-daemon08:45:371
216339963,2cyclictest28225-21switchtime07:20:191
216339963,2cyclictest25606-21sh10:31:461
216339963,2cyclictest21277-21sh11:11:251
216339963,2cyclictest20759-21sh09:41:161
216339963,2cyclictest19982-21systemd-journal10:25:541
216339963,2cyclictest1579-21ssh09:26:371
216339963,1cyclictest0-21swapper/110:40:211
216339962,4cyclictest23895-21kworker/1:111:51:071
216339962,4cyclictest23895-21kworker/1:111:05:591
216339962,4cyclictest23895-21kworker/1:108:10:151
216339962,3cyclictest8093-21expr09:00:121
216339962,3cyclictest7365-21ls10:20:171
216339962,3cyclictest30654-21snmpd11:40:031
216339962,3cyclictest30654-21snmpd08:36:271
216339962,3cyclictest30654-21snmpd08:05:321
216339962,3cyclictest30654-21snmpd07:50:041
216339962,3cyclictest30654-21snmpd07:25:181
216339962,3cyclictest30654-21snmpd07:10:071
216339962,3cyclictest28266-21sshd08:31:461
216339962,3cyclictest21658-21cut10:50:171
216339962,3cyclictest19116-21gdbus07:45:011
216339962,3cyclictest18940-21date10:05:011
216339962,2cyclictest19982-21systemd-journal11:55:001
216339962,2cyclictest19982-21systemd-journal10:00:431
216339962,1cyclictest0-21swapper/112:21:411
216339962,1cyclictest0-21swapper/112:05:381
216339962,1cyclictest0-21swapper/112:01:181
216339962,1cyclictest0-21swapper/111:45:421
216339962,1cyclictest0-21swapper/111:25:091
216339962,1cyclictest0-21swapper/109:55:461
216339962,1cyclictest0-21swapper/109:36:141
216339961,3cyclictest19982-21systemd-journal10:45:221
216339961,3cyclictest19982-21systemd-journal08:28:311
216339960,6cyclictest0-21swapper/108:43:471
216339960,3cyclictest3274-21ssh12:25:051
216339960,3cyclictest3274-21ssh12:25:041
216339960,3cyclictest31653-21cpuspeed_turbos09:50:141
216339960,2cyclictest31696-21/usr/sbin/munin07:30:131
216339960,2cyclictest30680-21sshd10:56:121
216339960,0cyclictest0-21swapper/110:35:041
216339960,0cyclictest0-21swapper/107:15:021
216289965,1cyclictest12-21ksoftirqd/007:25:000
216289963,2cyclictest30654-21snmpd08:00:580
216289962,3cyclictest8644-21apt-get07:50:130
216289962,3cyclictest3792-21cut08:50:150
216289962,3cyclictest30654-21snmpd08:45:130
216289962,3cyclictest29700-21cut07:25:180
216289962,1cyclictest141rcu_preempt12:05:020
216289962,1cyclictest141rcu_preempt09:45:140
216289962,1cyclictest141rcu_preempt09:05:170
216289962,1cyclictest0-21swapper/009:50:130
216289960,4cyclictest12-21ksoftirqd/011:50:310
216289960,3cyclictest31565-21rm11:40:020
216289960,3cyclictest0-21swapper/008:55:150
216289960,2cyclictest0-21swapper/009:00:100
11156260,0sleep10-21swapper/112:30:111
216419952,2cyclictest30654-21snmpd08:00:013
216419952,2cyclictest2463-21ntpq07:35:173
216419952,2cyclictest1-21systemd10:50:013
216419952,2cyclictest1-21systemd08:15:103
216419951,3cyclictest29741-11brltty08:45:123
216419951,3cyclictest10148-21sort09:05:133
216419951,2cyclictest19982-21systemd-journal08:10:103
216369952,2cyclictest29729-21ntp_kernel_pll_08:35:172
216369951,3cyclictest15893-21/usr/sbin/munin08:05:172
216369951,2cyclictest19982-21systemd-journal08:55:132
216369951,2cyclictest19982-21systemd-journal07:25:072
216339953,1cyclictest0-21swapper/109:10:031
216339952,2cyclictest4856-21ssh09:30:031
216339952,2cyclictest23030-21ntpq08:20:181
216339952,2cyclictest11609-21uname07:55:201
216339952,2cyclictest10441-21expr09:05:141
216339950,4cyclictest3376-21apt-get08:50:121
216339950,3cyclictest19982-21systemd-journal07:40:051
216289952,2cyclictest30654-21snmpd07:30:040
216289950,3cyclictest19982-21systemd-journal08:30:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional