You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 00:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Sun Nov 23, 2025 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
277372277217,48sleep00-21swapper/007:07:110
277862272237,22sleep10-21swapper/107:07:481
279412265230,21sleep30-21swapper/307:09:313
277082260225,22sleep20-21swapper/207:06:482
124632560,0sleep20-21swapper/209:30:392
169422550,0sleep10-21swapper/110:00:551
239982160,0sleep00-21swapper/009:40:510
237952160,0sleep012-21ksoftirqd/011:45:160
284932150,1sleep10-21swapper/110:59:371
28079991411,2cyclictest12-21ksoftirqd/007:50:000
134282140,0sleep00-21swapper/012:25:160
28079991211,1cyclictest12-21ksoftirqd/011:05:000
28079991211,1cyclictest12-21ksoftirqd/009:55:020
2807999119,1cyclictest12-21ksoftirqd/010:30:010
2807999109,1cyclictest12-21ksoftirqd/010:05:010
2807999108,2cyclictest12-21ksoftirqd/012:15:000
2807999108,2cyclictest12-21ksoftirqd/007:25:000
2807999108,1cyclictest12-21ksoftirqd/007:15:010
2807999107,2cyclictest12-21ksoftirqd/012:20:000
2807999107,2cyclictest12-21ksoftirqd/012:05:000
2807999107,2cyclictest12-21ksoftirqd/007:40:010
2807999102,4cyclictest21458-21cron09:40:010
31243290,1sleep10-21swapper/111:26:071
280909994,3cyclictest19982-21systemd-journal11:40:593
280859990,8cyclictest17876-21ssh11:40:232
280799998,1cyclictest12-21ksoftirqd/010:45:020
280799998,1cyclictest12-21ksoftirqd/009:30:000
280799997,1cyclictest12-21ksoftirqd/011:55:010
280799997,1cyclictest12-21ksoftirqd/011:40:000
280799997,1cyclictest12-21ksoftirqd/010:40:010
280799997,1cyclictest12-21ksoftirqd/010:15:010
280799996,2cyclictest12-21ksoftirqd/011:45:000
280799996,2cyclictest12-21ksoftirqd/010:20:010
280799995,3cyclictest12-21ksoftirqd/009:35:000
931280,0chrt0-21swapper/212:17:072
280909988,0cyclictest0-21swapper/312:00:123
280909984,3cyclictest21452-21cron09:40:013
280909983,3cyclictest19982-21systemd-journal12:07:133
280859987,1cyclictest28-21ksoftirqd/207:35:002
280859984,3cyclictest508-21dbus-daemon09:20:002
280859982,3cyclictest27051-21perf10:10:012
280829985,2cyclictest30654-21snmpd12:10:161
280829984,3cyclictest19982-21systemd-journal12:33:081
280829984,3cyclictest19982-21systemd-journal12:33:081
280829982,3cyclictest18750irq/134-ahci[0009:55:011
280799987,1cyclictest12-21ksoftirqd/012:00:010
280799987,1cyclictest12-21ksoftirqd/009:45:020
280799987,1cyclictest12-21ksoftirqd/009:15:000
280799987,1cyclictest12-21ksoftirqd/009:00:020
280799987,1cyclictest12-21ksoftirqd/008:45:010
280799986,1cyclictest131rcuc/011:30:000
280799985,2cyclictest12-21ksoftirqd/008:00:000
280799985,1cyclictest141rcu_preempt09:55:130
280799984,1cyclictest4453-21perf08:40:010
280799984,1cyclictest4453-21perf08:40:010
280799982,2cyclictest141rcu_preempt08:05:130
280799982,1cyclictest141rcu_preempt09:05:190
20330280,0sleep20-21swapper/210:04:562
3082270,0sleep00-21swapper/009:24:160
280909974,2cyclictest11736-21in:imuxsock10:43:003
280909973,3cyclictest7661-21lldpd10:12:243
280909973,3cyclictest508-21dbus-daemon11:02:373
280909973,3cyclictest30654-21snmpd11:49:193
280909973,3cyclictest19982-21systemd-journal09:34:293
280909973,3cyclictest19982-21systemd-journal07:30:153
280909973,3cyclictest1670-21sed08:30:203
280909973,1cyclictest0-21swapper/310:59:233
280909972,3cyclictest19982-21systemd-journal11:28:043
280909971,3cyclictest23715-21rm10:06:163
280909971,2cyclictest0-21swapper/310:21:203
280909970,3cyclictest19982-21systemd-journal07:43:273
280909970,2cyclictest19982-21systemd-journal08:04:033
280859974,2cyclictest11736-21in:imuxsock08:40:012
280859974,2cyclictest11736-21in:imuxsock08:40:012
280859973,3cyclictest508-21dbus-daemon09:55:022
280859973,3cyclictest4023-21ntpq11:55:162
280859973,3cyclictest31585-21systemctl08:25:202
280859973,3cyclictest19982-21systemd-journal11:14:392
280859973,3cyclictest10423-21cat10:45:142
280859973,2cyclictest19982-21systemd-journal11:45:102
280859973,2cyclictest19982-21systemd-journal09:30:012
280859973,1cyclictest0-21swapper/211:00:262
280859973,1cyclictest0-21swapper/210:37:192
280859973,1cyclictest0-21swapper/209:54:032
280859972,4cyclictest28474-21sshd10:59:362
280859972,3cyclictest19982-21systemd-journal12:33:582
280859972,3cyclictest19982-21systemd-journal12:33:582
280859972,3cyclictest19982-21systemd-journal11:53:132
280859972,3cyclictest19982-21systemd-journal08:05:002
280859972,3cyclictest19982-21systemd-journal07:16:302
280829975,1cyclictest18750irq/134-ahci[0011:20:001
280829974,2cyclictest14514-21cron07:50:001
280829973,3cyclictest9308-21basename10:45:011
280829973,3cyclictest7661-21lldpd12:18:271
280829973,3cyclictest508-21dbus-daemon11:55:001
280829973,3cyclictest508-21dbus-daemon07:10:401
280829973,3cyclictest20197-21ntpq08:00:161
280829973,3cyclictest19662-21cat09:10:201
280829973,2cyclictest30654-21snmpd11:43:211
280829973,2cyclictest19982-21systemd-journal07:30:001
280829973,1cyclictest0-21swapper/110:11:351
280829973,1cyclictest0-21swapper/110:09:501
280829973,1cyclictest0-21swapper/109:41:561
280829971,4cyclictest19982-21systemd-journal10:52:121
280829971,3cyclictest30187-21basename08:25:001
280829970,1cyclictest17850-21diskmemload10:39:001
280799976,1cyclictest16751-21ls07:55:000
280799976,1cyclictest12-21ksoftirqd/008:30:010
280799976,1cyclictest12-21ksoftirqd/008:05:010
280799976,1cyclictest12-21ksoftirqd/007:15:010
280799975,2cyclictest12-21ksoftirqd/009:05:010
280799975,1cyclictest12-21ksoftirqd/007:45:000
280799974,2cyclictest131rcuc/008:30:120
280799973,3cyclictest508-21dbus-daemon08:50:010
280799973,2cyclictest12-21ksoftirqd/012:08:410
280799973,1cyclictest141rcu_preempt10:20:180
280799973,1cyclictest141rcu_preempt07:30:000
280799973,1cyclictest0-21swapper/010:47:430
280799972,4cyclictest27923-21dump-pmu-power08:20:000
280799972,3cyclictest19982-21systemd-journal11:05:570
280799971,5cyclictest5756-21/usr/sbin/munin12:20:180
280799971,4cyclictest12-21ksoftirqd/012:36:220
280799971,3cyclictest30336-21dump-pmu-power09:20:000
280799971,3cyclictest19982-21systemd-journal10:05:030
280799971,3cyclictest11153-21dump-pmu-power08:55:020
280799971,2cyclictest12-21ksoftirqd/010:50:190
3020260,0sleep20-21swapper/211:30:132
280909963,2cyclictest9578-21sort11:35:153
280909963,2cyclictest668-21runrttasks07:48:333
280909963,2cyclictest30462-21diskstats12:15:143
280909963,2cyclictest29741-11brltty08:15:443
280909963,2cyclictest29215-21cpu11:50:133
280909963,2cyclictest2665-21pmu-power09:50:233
280909963,2cyclictest21565-21cpuspeed08:05:123
280909963,2cyclictest17850-21diskmemload12:11:033
280909963,2cyclictest17740-21switchtime10:50:203
280909963,2cyclictest11736-21in:imuxsock08:29:553
280909962,3cyclictest8154-21sensors_temp08:45:203
280909962,3cyclictest8134-21cat09:55:133
280909962,3cyclictest508-21dbus-daemon09:45:013
280909962,3cyclictest508-21dbus-daemon08:55:013
280909962,3cyclictest4937-21cat09:25:173
280909962,3cyclictest30654-21snmpd12:36:233
280909962,3cyclictest30654-21snmpd11:55:133
280909962,3cyclictest30654-21snmpd10:28:363
280909962,3cyclictest30654-21snmpd10:15:113
280909962,3cyclictest30654-21snmpd09:01:353
280909962,3cyclictest30654-21snmpd08:40:033
280909962,3cyclictest30654-21snmpd08:23:103
280909962,3cyclictest30654-21snmpd07:55:583
280909962,3cyclictest30654-21snmpd07:35:553
280909962,3cyclictest30654-21snmpd07:24:033
280909962,3cyclictest30654-21snmpd07:14:273
280909962,3cyclictest29110-21cat10:35:163
280909962,3cyclictest24585-21expr09:15:123
280909962,3cyclictest19982-21systemd-journal08:14:113
280909962,3cyclictest16539-21smartctl11:15:153
280909962,3cyclictest16244-21cat09:05:133
280909962,3cyclictest14426-21ssh12:25:573
280909962,3cyclictest0-21swapper/310:31:443
280909962,1cyclictest0-21swapper/312:24:433
280909962,1cyclictest0-21swapper/310:48:013
280909961,4cyclictest24153-21sh11:20:343
280909961,3cyclictest19982-21systemd-journal07:52:223
280909961,2cyclictest2675-21rm09:23:483
280909960,6cyclictest0-21swapper/312:31:443
280909960,6cyclictest0-21swapper/312:31:443
280909960,6cyclictest0-21swapper/311:30:023
280909960,6cyclictest0-21swapper/308:55:123
280909960,3cyclictest7654-21rm11:08:383
280909960,3cyclictest24441-21rm09:41:203
280909960,3cyclictest12844-21rm11:12:123
280859964,1cyclictest28-21ksoftirqd/207:40:012
280859963,2cyclictest5103-21sh11:05:522
280859963,2cyclictest508-21dbus-daemon08:20:452
280859963,2cyclictest21398-21ssh09:12:072
280859963,2cyclictest17850-21diskmemload12:05:302
280859963,2cyclictest17056-21mailstats09:05:192
280859963,2cyclictest13963-21rm12:25:302
280859963,2cyclictest0-21swapper/210:45:012
280859962,3cyclictest9646-21cut08:50:132
280859962,3cyclictest8618-21expr10:20:152
280859962,3cyclictest8346-21cat07:35:142
280859962,3cyclictest6538-21sshd08:43:352
280859962,3cyclictest5164-21ntpd07:20:172
280859962,3cyclictest3544-21expr07:25:132
280859962,3cyclictest31435-21cat09:20:152
280859962,3cyclictest30654-21snmpd09:40:072
280859962,3cyclictest30654-21snmpd08:59:082
280859962,3cyclictest30654-21snmpd08:48:592
280859962,3cyclictest30654-21snmpd08:16:432
280859962,3cyclictest29301-21tune2fs11:25:132
280859962,3cyclictest27429-21cat12:35:152
280859962,3cyclictest22688-21smartctl08:05:192
280859962,3cyclictest19982-21systemd-journal11:20:082
280859962,3cyclictest19982-21systemd-journal07:51:322
280859962,3cyclictest19982-21systemd-journal07:10:392
280859962,3cyclictest19116-21gdbus09:45:012
280859962,3cyclictest16945-21ntp_states11:15:182
280859962,3cyclictest15879-21latency_hist11:40:002
280859962,3cyclictest12538-21find07:45:132
280859962,3cyclictest10142-21ntpq12:00:172
280859962,1cyclictest0-21swapper/210:51:512
280859962,1cyclictest0-21swapper/210:31:182
280859961,3cyclictest19982-21systemd-journal10:14:142
280859961,2cyclictest24778-21ssh12:10:372
280859960,2cyclictest32652-21/usr/sbin/munin08:30:212
280859960,2cyclictest2025-21/usr/sbin/munin10:15:212
280859960,0cyclictest0-21swapper/209:38:322
280829966,0cyclictest0-21swapper/109:35:221
280829964,1cyclictest9907-21grep11:35:151
280829964,1cyclictest15662-21cron09:35:001
280829963,2cyclictest8931-21if_err_enp4s010:20:171
280829963,2cyclictest668-21runrttasks07:59:281
280829963,2cyclictest5486-21sh11:56:161
280829963,2cyclictest30654-21snmpd11:05:061
280829963,2cyclictest2713-21ssh11:30:011
280829963,2cyclictest1349-21expr07:20:121
280829963,2cyclictest12923-21ssh12:02:541
280829963,2cyclictest0-21swapper/112:25:241
280829962,3cyclictest9752-21munin-plugin-st07:40:001
280829962,3cyclictest32728-21awk08:30:121
280829962,3cyclictest30654-21snmpd11:45:041
280829962,3cyclictest30654-21snmpd11:20:121
280829962,3cyclictest30654-21snmpd09:17:451
280829962,3cyclictest30654-21snmpd08:06:521
280829962,3cyclictest30654-21snmpd07:51:371
280829962,3cyclictest23018-21sensors_temp10:30:191
280829962,3cyclictest16669-21grep12:05:171
280829962,3cyclictest15617-21expr10:25:161
280829962,3cyclictest11517-21sort08:55:121
280829962,3cyclictest0-21swapper/110:16:401
280829962,1cyclictest29441-21grep09:45:201
280829962,1cyclictest0-21swapper/111:12:321
280829962,1cyclictest0-21swapper/111:00:441
280829962,1cyclictest0-21swapper/109:26:461
280829961,3cyclictest19982-21systemd-journal12:20:121
280829961,3cyclictest19982-21systemd-journal08:29:181
280829960,5cyclictest19982-21systemd-journal08:40:011
280829960,5cyclictest19982-21systemd-journal08:40:011
280829960,4cyclictest19982-21systemd-journal08:49:061
280829960,3cyclictest10044-21ssh09:55:421
280829960,2cyclictest707-21munin-run07:20:001
280829960,2cyclictest30740-21/usr/sbin/munin09:20:191
280829960,2cyclictest11394-21users10:45:191
280799964,1cyclictest19955-21df12:30:150
280799964,1cyclictest19955-21df12:30:150
280799963,2cyclictest29741-11brltty10:55:060
280799963,2cyclictest2889-21/usr/sbin/munin11:30:140
280799963,2cyclictest19982-21systemd-journal08:10:180
280799962,3cyclictest30654-21snmpd11:15:030
280799962,3cyclictest30654-21snmpd07:30:300
280799962,1cyclictest141rcu_preempt10:30:240
280799960,4cyclictest30168-21cron08:25:000
280799960,4cyclictest22313-21apt-get11:20:120
280799960,4cyclictest12-21ksoftirqd/011:12:070
280909952,2cyclictest3367-21expr07:25:123
280909952,2cyclictest2465-21basename08:35:123
280909952,2cyclictest2465-21basename08:35:113
280909952,2cyclictest18164-21rm09:10:073
280909952,2cyclictest14537-21seq10:00:053
280909951,3cyclictest5164-21ntpd07:15:013
280859953,1cyclictest0-21swapper/210:25:022
280859952,2cyclictest668-21runrttasks07:55:062
280859952,2cyclictest24113-21chrt08:10:152
280859952,2cyclictest14872-21swap09:00:192
280859950,2cyclictest4506-21ssh12:20:062
280829952,2cyclictest9141-21seq08:50:051
280829952,2cyclictest5529-21/usr/sbin/munin07:30:121
280829952,2cyclictest27005-21expr12:35:131
280829952,2cyclictest17153-21cat09:05:191
280829952,2cyclictest13660-21grep09:00:121
280829952,2cyclictest11618-21timerandwakeup07:40:211
280829951,3cyclictest4706-21basename08:40:111
280829951,3cyclictest26397-21/usr/sbin/munin08:15:161
280829951,3cyclictest24381-21cat08:10:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional