You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-30 - 04:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Sat Aug 30, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
221922317248,20sleep20-21swapper/219:05:552
224122298229,22sleep10-21swapper/119:08:281
223272262226,22sleep30-21swapper/319:07:213
221902258225,21sleep00-21swapper/019:05:530
236602670,0sleep30-21swapper/321:17:543
127392540,1sleep00-21swapper/023:08:000
173732520,0sleep00-21swapper/022:00:210
120212200,0sleep10-21swapper/123:07:171
276622190,0sleep30-21swapper/323:19:083
276092180,0sleep10-21swapper/121:20:201
131102180,0sleep30-21swapper/321:57:393
150312170,0sleep20-21swapper/223:33:002
136842160,0sleep10-21swapper/122:20:561
46722110,0sleep30-21swapper/323:01:423
266272110,1sleep20-21swapper/221:44:172
2264099109,1cyclictest28-21ksoftirqd/223:30:012
226439995,2cyclictest19982-21systemd-journal21:31:023
226409994,3cyclictest19982-21systemd-journal22:05:152
226409990,8cyclictest1538-21ssh00:36:272
226359997,1cyclictest27972-21apt-get19:20:121
226359996,2cyclictest22-21ksoftirqd/122:20:011
226319994,3cyclictest19982-21systemd-journal22:46:080
226319994,3cyclictest15391-21dump-pmu-power20:05:000
226319993,3cyclictest24635-21latency_hist20:25:000
226319992,1cyclictest7932-21basename23:05:010
226439984,3cyclictest34-21ksoftirqd/320:50:003
226409985,2cyclictest508-21dbus-daemon20:35:332
226409985,2cyclictest28-21ksoftirqd/220:55:002
226409984,3cyclictest19982-21systemd-journal00:32:312
226409983,3cyclictest19982-21systemd-journal22:55:012
226409983,3cyclictest19982-21systemd-journal22:03:102
226409983,3cyclictest19982-21systemd-journal19:32:332
226359984,3cyclictest508-21dbus-daemon22:55:191
226359983,3cyclictest19982-21systemd-journal00:38:541
226359982,3cyclictest19845-21awk20:15:001
226319984,2cyclictest19982-21systemd-journal23:22:410
226319982,3cyclictest32508-21awk00:10:000
226319980,7cyclictest29559-21cstates20:35:140
9686270,0sleep20-21swapper/222:41:472
25979270,0sleep10-21swapper/100:30:131
226439975,1cyclictest0-21swapper/322:54:543
226439974,2cyclictest29084-21cron20:35:003
226439974,2cyclictest19982-21systemd-journal19:53:003
226439974,2cyclictest11736-21in:imuxsock22:44:283
226439973,3cyclictest508-21dbus-daemon23:09:303
226439973,3cyclictest29741-11brltty23:21:363
226439973,3cyclictest26063-21hddtemp_smartct00:30:143
226439973,3cyclictest19982-21systemd-journal23:51:493
226439973,3cyclictest19982-21systemd-journal21:13:303
226439973,3cyclictest19982-21systemd-journal00:10:503
226439973,3cyclictest18788-21smart_sda23:35:183
226439973,1cyclictest0-21swapper/321:20:403
226439971,4cyclictest19982-21systemd-journal22:10:163
226439971,3cyclictest29780-21rm21:45:353
226439971,3cyclictest26923-21rm22:30:233
226439971,3cyclictest20082-21rm00:25:173
226439970,3cyclictest30176-21/usr/sbin/munin19:25:143
226439970,2cyclictest19982-21systemd-journal19:18:223
226409975,1cyclictest28-21ksoftirqd/220:45:002
226409974,2cyclictest21982-21ssh23:38:042
226409974,2cyclictest11736-21in:imuxsock23:14:302
226409973,3cyclictest859-21smart_sda22:35:212
226409973,3cyclictest30654-21snmpd21:52:222
226409973,3cyclictest30654-21snmpd21:09:472
226409973,3cyclictest20513-21ntpq21:15:202
226409973,3cyclictest19982-21systemd-journal00:18:372
226409973,3cyclictest0-21swapper/221:25:042
226409973,1cyclictest0-21swapper/222:31:112
226409973,1cyclictest0-21swapper/222:23:242
226409971,4cyclictest19982-21systemd-journal22:15:412
226409971,2cyclictest28-21ksoftirqd/223:40:122
226409971,2cyclictest15202sh23:23:292
226359975,1cyclictest22-21ksoftirqd/100:20:001
226359973,3cyclictest7928-21perf23:05:011
226359973,3cyclictest508-21dbus-daemon22:54:541
226359973,3cyclictest19982-21systemd-journal23:42:031
226359973,1cyclictest0-21swapper/123:54:101
226359973,1cyclictest0-21swapper/123:18:331
226359973,1cyclictest0-21swapper/122:35:281
226359973,1cyclictest0-21swapper/100:09:201
226359972,3cyclictest7661-21lldpd21:14:201
226359972,2cyclictest21691-21ssh00:01:121
226359970,0cyclictest0-21swapper/119:54:151
226319973,3cyclictest7901-21cat21:30:160
226319973,3cyclictest508-21dbus-daemon20:15:000
226319973,3cyclictest31156-21ntpq19:25:160
226319973,3cyclictest30654-21snmpd21:50:520
226319973,3cyclictest19982-21systemd-journal23:29:320
226319973,3cyclictest19982-21systemd-journal22:52:260
226319973,3cyclictest19982-21systemd-journal21:35:370
226319973,3cyclictest0-21swapper/023:36:020
226319973,3cyclictest0-21swapper/023:17:270
226319973,3cyclictest0-21swapper/022:24:540
226319973,1cyclictest0-21swapper/023:12:070
226319973,1cyclictest0-21swapper/022:40:560
226319972,3cyclictest29100-21turbostat20:35:000
226319972,1cyclictest0-21swapper/000:12:050
226319970,4cyclictest8698-21turbostat19:50:000
226319970,4cyclictest12632-21munin-run00:20:000
226439963,2cyclictest9548-21date21:00:203
226439963,2cyclictest6723-21ssh00:15:093
226439963,2cyclictest6680-21wc20:55:183
226439963,2cyclictest508-21dbus-daemon22:00:403
226439963,2cyclictest4714-21processes20:50:163
226439963,2cyclictest3811-21expr23:25:123
226439963,2cyclictest28169-21uname22:55:193
226439963,2cyclictest26496-21cat00:05:173
226439963,2cyclictest26461-21rm23:40:463
226439963,2cyclictest25800-21taskset22:06:403
226439963,2cyclictest24395-21sh21:42:053
226439963,2cyclictest23671-21cat19:10:173
226439963,2cyclictest19143-21sshd23:12:293
226439963,2cyclictest18077-21cstates20:10:133
226439963,2cyclictest14944-21ssh21:35:173
226439963,2cyclictest0-21swapper/323:30:493
226439963,2cyclictest0-21swapper/300:00:143
226439963,1cyclictest0-21swapper/322:29:393
226439962,3cyclictest6956-21expr19:45:113
226439962,3cyclictest508-21dbus-daemon20:08:263
226439962,3cyclictest508-21dbus-daemon19:45:003
226439962,3cyclictest4844-21cat22:15:133
226439962,3cyclictest3909-21sshd19:36:423
226439962,3cyclictest30654-21snmpd20:38:253
226439962,3cyclictest30654-21snmpd19:55:573
226439962,3cyclictest30654-21snmpd00:36:193
226439962,3cyclictest24630-21idleruntime-cro20:25:003
226439962,3cyclictest19982-21systemd-journal22:35:413
226439962,3cyclictest14086-21cat20:00:173
226439962,3cyclictest13965-21grep22:45:143
226439962,3cyclictest13101-21tr23:55:163
226439962,3cyclictest11589-21cat21:05:193
226439962,3cyclictest0-21swapper/321:25:213
226439962,3cyclictest0-21swapper/300:20:003
226439961,3cyclictest32184-21rm23:45:173
226439961,3cyclictest19982-21systemd-journal22:20:413
226439961,3cyclictest19982-21systemd-journal20:42:133
226439960,3cyclictest2458-21grep21:50:153
226409966,0cyclictest0-21swapper/221:12:482
226409963,2cyclictest9641-21sed21:00:202
226409963,2cyclictest668-21runrttasks21:57:252
226409963,2cyclictest502-21systemd-logind00:10:222
226409963,2cyclictest30654-21snmpd20:34:282
226409963,2cyclictest30654-21snmpd20:25:312
226409963,2cyclictest30654-21snmpd20:10:122
226409963,2cyclictest30654-21snmpd19:53:392
226409963,2cyclictest28248-21ntpq22:55:202
226409963,2cyclictest28231-21expr19:20:132
226409963,2cyclictest28-21ksoftirqd/220:21:472
226409963,2cyclictest24818-21latency_hist19:15:012
226409963,2cyclictest15529-21timerandwakeup21:35:202
226409963,2cyclictest11736-21in:imuxsock22:11:062
226409963,2cyclictest0-21swapper/223:01:102
226409962,3cyclictest7762-21tail21:30:162
226409962,3cyclictest508-21dbus-daemon19:18:472
226409962,3cyclictest32226-21date19:30:012
226409962,3cyclictest30654-21snmpd20:08:092
226409962,3cyclictest30654-21snmpd19:45:512
226409962,3cyclictest30654-21snmpd19:41:472
226409962,3cyclictest19982-21systemd-journal21:20:012
226409962,3cyclictest14139-21cat22:45:152
226409962,1cyclictest0-21swapper/223:50:062
226409962,1cyclictest0-21swapper/223:46:362
226409961,4cyclictest0-21swapper/200:05:202
226409961,3cyclictest502-21systemd-logind23:15:192
226409961,3cyclictest19982-21systemd-journal19:58:502
226409961,3cyclictest19982-21systemd-journal00:23:462
226409961,2cyclictest10111-21ssh23:05:242
226409960,6cyclictest0-21swapper/220:00:172
226409960,5cyclictest19519-21tr00:25:142
226409960,4cyclictest31476-21sshd21:47:152
226409960,3cyclictest19179-21awk00:00:122
226409960,2cyclictest19982-21systemd-journal22:26:572
226409960,0cyclictest0-21swapper/223:56:312
226359966,0cyclictest0-21swapper/123:11:461
226359966,0cyclictest0-21swapper/122:29:041
226359966,0cyclictest0-21swapper/121:25:321
226359966,0cyclictest0-21swapper/121:15:191
226359964,1cyclictest7812-21hddtemp_smartct21:30:161
226359964,1cyclictest22-21ksoftirqd/119:15:021
226359963,2cyclictest807-21ssh23:45:441
226359963,2cyclictest668-21runrttasks21:45:161
226359963,2cyclictest668-21runrttasks21:42:281
226359963,2cyclictest668-21runrttasks19:25:531
226359963,2cyclictest5447-21sh23:25:311
226359963,2cyclictest32747-21sh23:22:191
226359963,2cyclictest29741-11brltty19:58:251
226359963,2cyclictest2906-21sed20:45:221
226359963,2cyclictest22472-21sh00:27:001
226359963,2cyclictest19982-21systemd-journal21:07:111
226359963,2cyclictest1708-21sshd19:31:531
226359963,2cyclictest10590-21basename23:30:121
226359963,2cyclictest0-21swapper/122:05:081
226359962,3cyclictest6547-21cat19:45:001
226359962,3cyclictest508-21dbus-daemon21:00:341
226359962,3cyclictest30654-21snmpd20:40:221
226359962,3cyclictest30654-21snmpd20:32:551
226359962,3cyclictest30654-21snmpd20:22:251
226359962,3cyclictest30654-21snmpd20:02:271
226359962,3cyclictest30654-21snmpd00:10:181
226359962,3cyclictest2914-21cat19:35:171
226359962,3cyclictest21197-21cat20:15:201
226359962,3cyclictest17718-21expr23:35:121
226359962,3cyclictest0-21swapper/122:11:111
226359962,3cyclictest0-21swapper/100:20:141
226359962,1cyclictest0-21swapper/122:47:451
226359962,1cyclictest0-21swapper/121:50:101
226359961,3cyclictest19982-21systemd-journal22:02:451
226359960,6cyclictest0-21swapper/122:32:471
226359960,6cyclictest0-21swapper/120:35:081
226359960,5cyclictest15116-21ntp_states21:35:181
226359960,3cyclictest7291-21/usr/sbin/munin22:40:161
226359960,2cyclictest19982-21systemd-journal20:27:051
226359960,2cyclictest12970-21cut23:55:151
226319964,1cyclictest8818-21irqstats21:00:160
226319963,2cyclictest947-21ssh23:45:520
226319963,2cyclictest7083-21smart_sda20:55:210
226319963,2cyclictest508-21dbus-daemon22:30:170
226319963,2cyclictest4214-21sendmail19:40:000
226319963,2cyclictest32598-21sh21:25:030
226319963,2cyclictest30654-21snmpd22:05:010
226319963,2cyclictest29741-11brltty19:34:380
226319963,2cyclictest29423-21unixbench_multi19:20:200
226319963,2cyclictest21112-21cpuspeed_turbos21:40:130
226319963,2cyclictest19982-21systemd-journal19:45:000
226319963,2cyclictest19942-21ls00:00:160
226319963,2cyclictest13181-21basename20:00:000
226319963,2cyclictest1-21systemd21:20:110
226319963,2cyclictest10849-21taskset19:54:200
226319962,3cyclictest30654-21snmpd23:51:590
226319962,3cyclictest30654-21snmpd23:43:330
226319962,3cyclictest30654-21snmpd22:35:050
226319962,3cyclictest30654-21snmpd20:53:460
226319962,3cyclictest30654-21snmpd20:49:340
226319962,3cyclictest30654-21snmpd19:10:410
226319962,3cyclictest30654-21snmpd00:37:130
226319962,3cyclictest30654-21snmpd00:32:340
226319962,3cyclictest28144-21needreboot22:55:190
226319962,3cyclictest26280-21cat20:25:200
226319962,3cyclictest20142-21basename21:15:170
226319962,3cyclictest19982-21systemd-journal21:12:130
226319962,3cyclictest19982-21systemd-journal20:07:110
226319962,3cyclictest19471-21cat00:25:140
226319962,1cyclictest141rcu_preempt21:45:230
226319962,1cyclictest0-21swapper/022:10:290
226319961,3cyclictest19982-21systemd-journal23:56:400
226319961,2cyclictest12-21ksoftirqd/000:20:230
226319961,2cyclictest12055-21ssh21:56:360
226319960,5cyclictest4778-21/usr/sbin/munin22:15:130
226319960,3cyclictest20088-21ssh22:25:270
226319960,0cyclictest0-21swapper/023:30:220
226439952,2cyclictest25547-21if_enp4s020:25:153
226439952,2cyclictest1-21systemd20:15:013
226439951,3cyclictest1429-21unixbench-2d19:30:203
226439951,2cyclictest19982-21systemd-journal19:20:013
226409953,1cyclictest2915-21interrupts19:35:172
226409952,2cyclictest2094-21/usr/sbin/munin20:45:172
226409952,2cyclictest20745-21expr20:15:172
226409951,3cyclictest6478-21hddtemp_smartct20:55:172
226359952,2cyclictest7884-21mailstats19:45:171
226359952,2cyclictest4313-21cat20:50:131
226359952,2cyclictest30654-21snmpd20:55:011
226359951,3cyclictest30654-21snmpd21:55:011
226359951,3cyclictest30654-21snmpd20:05:061
226359950,3cyclictest19982-21systemd-journal19:10:521
226319954,1cyclictest12-21ksoftirqd/020:15:010
226319952,2cyclictest30654-21snmpd20:40:100
226319952,2cyclictest25161-21memory19:15:010
226319951,3cyclictest10730-21df21:05:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional