You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 22:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Sat Nov 22, 2025 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
124622287253,22sleep10-21swapper/107:06:511
124912262229,21sleep00-21swapper/007:07:150
124422262233,18sleep30-21swapper/307:06:373
124732261226,22sleep20-21swapper/207:07:002
288182620,0sleep20-21swapper/212:10:212
3552600,0sleep00-21swapper/010:02:130
128002590,0sleep122-21ksoftirqd/112:22:181
267562560,1sleep228-21ksoftirqd/207:38:362
75712540,0sleep10-21swapper/111:53:181
26592540,0sleep10-21swapper/112:15:171
162262540,0sleep10-21swapper/111:34:331
241652190,0sleep30-21swapper/309:55:203
202862190,0sleep20-21swapper/211:10:262
15962190,0sleep10-21swapper/111:22:121
228992160,0sleep10-21swapper/111:13:181
1282799107,2cyclictest22-21ksoftirqd/112:35:011
1282799107,2cyclictest22-21ksoftirqd/110:55:011
1282799107,2cyclictest22-21ksoftirqd/108:50:011
1282799100,6cyclictest9336-21ssh10:36:081
128349997,2cyclictest34-21ksoftirqd/309:10:013
128349994,3cyclictest19982-21systemd-journal10:46:213
128349994,3cyclictest19982-21systemd-journal10:46:213
128329990,6cyclictest16829-21apt08:30:002
128279998,1cyclictest22-21ksoftirqd/107:30:001
128279997,2cyclictest22-21ksoftirqd/112:30:011
128279997,1cyclictest22-21ksoftirqd/110:25:021
128279997,1cyclictest211rcuc/110:45:011
128279996,2cyclictest22-21ksoftirqd/112:40:001
128279996,2cyclictest22-21ksoftirqd/111:10:011
128279996,2cyclictest22-21ksoftirqd/109:40:021
128279996,2cyclictest22-21ksoftirqd/107:15:021
128279993,4cyclictest22-21ksoftirqd/111:47:401
128279992,5cyclictest22-21ksoftirqd/111:40:201
128279992,5cyclictest22-21ksoftirqd/110:31:451
128239994,3cyclictest19982-21systemd-journal09:36:390
128349983,3cyclictest19982-21systemd-journal11:40:003
128349983,3cyclictest19982-21systemd-journal10:25:293
128349982,5cyclictest932-21hddtemp_smartct10:55:153
128329983,4cyclictest0-21swapper/209:45:182
128329983,3cyclictest19982-21systemd-journal12:06:262
128329983,3cyclictest19982-21systemd-journal10:57:362
128279987,1cyclictest22-21ksoftirqd/110:00:011
128279987,1cyclictest22-21ksoftirqd/109:55:011
128279987,1cyclictest22-21ksoftirqd/109:15:011
128279987,1cyclictest22-21ksoftirqd/108:35:001
128279987,1cyclictest22-21ksoftirqd/107:45:001
128279987,1cyclictest22-21ksoftirqd/107:15:011
128279986,2cyclictest22-21ksoftirqd/111:35:021
128279986,1cyclictest211rcuc/108:55:111
128279985,2cyclictest22-21ksoftirqd/108:00:011
128279984,3cyclictest19982-21systemd-journal08:21:091
128279983,3cyclictest19982-21systemd-journal12:01:001
128279982,4cyclictest22-21ksoftirqd/110:04:461
128279982,4cyclictest22-21ksoftirqd/109:30:151
128279981,5cyclictest22-21ksoftirqd/108:25:191
128279981,5cyclictest22-21ksoftirqd/107:20:251
128239985,2cyclictest16667-21cron11:35:000
128239983,3cyclictest19982-21systemd-journal07:22:200
128239980,2cyclictest18096-21rm10:16:380
128349976,1cyclictest34-21ksoftirqd/309:15:013
128349974,2cyclictest508-21dbus-daemon11:20:003
128349974,2cyclictest181262sleep307:20:163
128349973,3cyclictest508-21dbus-daemon11:15:003
128349973,3cyclictest3690-21apt-get08:00:123
128349973,3cyclictest19982-21systemd-journal11:45:453
128349973,3cyclictest19982-21systemd-journal09:23:413
128349973,3cyclictest19982-21systemd-journal08:18:423
128349973,3cyclictest12724-21cut09:45:193
128349973,3cyclictest0-21swapper/311:03:273
128349973,3cyclictest0-21swapper/310:18:483
128349973,3cyclictest0-21swapper/310:00:383
128349973,2cyclictest19982-21systemd-journal10:24:143
128349973,1cyclictest0-21swapper/312:18:473
128349973,1cyclictest0-21swapper/312:09:383
128349973,1cyclictest0-21swapper/311:22:093
128349972,3cyclictest19982-21systemd-journal11:27:133
128349972,3cyclictest19982-21systemd-journal07:16:203
128349970,6cyclictest26511-21df10:50:153
128349970,6cyclictest23575-21grep12:30:143
128329975,1cyclictest14920-21ssh11:59:492
128329974,2cyclictest508-21dbus-daemon08:21:342
128329974,2cyclictest11736-21in:imuxsock09:52:572
128329973,3cyclictest508-21dbus-daemon10:40:562
128329973,3cyclictest508-21dbus-daemon09:41:172
128329973,3cyclictest30368-21ntpq07:45:212
128329973,3cyclictest29741-11brltty10:09:382
128329973,3cyclictest19982-21systemd-journal09:55:532
128329973,3cyclictest19982-21systemd-journal08:56:412
128329973,3cyclictest1-21systemd08:15:192
128329973,3cyclictest0-21swapper/212:31:502
128329973,3cyclictest0-21swapper/211:05:112
128329973,1cyclictest0-21swapper/210:37:242
128329973,1cyclictest0-21swapper/210:12:462
128329973,1cyclictest0-21swapper/209:26:182
128329972,3cyclictest7661-21lldpd11:34:172
128329972,3cyclictest7661-21lldpd09:39:302
128329971,3cyclictest5654-21munin-run08:05:002
128329970,4cyclictest3066-21awk10:05:012
128329970,3cyclictest19982-21systemd-journal08:10:332
128279976,1cyclictest22-21ksoftirqd/111:00:011
128279976,1cyclictest211rcuc/112:00:001
128279975,0cyclictest22-21ksoftirqd/109:25:061
128279974,2cyclictest22-21ksoftirqd/108:40:001
128279974,2cyclictest11736-21in:imuxsock09:09:071
128279974,1cyclictest19982-21systemd-journal09:01:121
128279973,3cyclictest508-21dbus-daemon10:10:031
128279973,1cyclictest0-21swapper/111:00:401
128279972,3cyclictest22-21ksoftirqd/110:15:571
128279972,1cyclictest141rcu_preempt10:47:461
128279972,1cyclictest141rcu_preempt10:47:461
128279971,4cyclictest22-21ksoftirqd/110:05:521
128279971,4cyclictest22-21ksoftirqd/109:11:381
128279971,4cyclictest22-21ksoftirqd/108:50:191
128279971,4cyclictest22-21ksoftirqd/108:50:181
128279971,4cyclictest22-21ksoftirqd/108:40:171
128279971,4cyclictest22-21ksoftirqd/107:36:311
128279971,4cyclictest11521-21ssh09:44:481
128279971,3cyclictest7895-21apt08:10:001
128279971,2cyclictest22-21ksoftirqd/111:28:041
128279971,1cyclictest22-21ksoftirqd/112:10:131
128279971,1cyclictest22-21ksoftirqd/109:45:171
128279970,5cyclictest22-21ksoftirqd/110:25:181
128279970,5cyclictest22-21ksoftirqd/108:10:151
128279970,4cyclictest23021-21grep12:05:201
128279970,2cyclictest22-21ksoftirqd/109:20:191
128239976,1cyclictest12-21ksoftirqd/012:00:000
128239975,2cyclictest12-21ksoftirqd/012:10:010
128239974,2cyclictest508-21dbus-daemon10:37:100
128239974,2cyclictest25745-21cron08:50:000
128239973,3cyclictest28926-21sshd09:59:420
128239973,3cyclictest19982-21systemd-journal12:37:430
128239973,3cyclictest19982-21systemd-journal12:18:080
128239973,3cyclictest19982-21systemd-journal08:50:380
128239973,3cyclictest19982-21systemd-journal08:50:380
128239973,3cyclictest19982-21systemd-journal07:41:410
128239973,3cyclictest0-21swapper/011:07:330
128239973,3cyclictest0-21swapper/010:29:220
128239973,3cyclictest0-21swapper/009:13:150
128239973,1cyclictest0-21swapper/012:27:530
128239973,1cyclictest0-21swapper/011:40:370
128239973,1cyclictest0-21swapper/011:01:040
128239972,3cyclictest19982-21systemd-journal12:15:010
128239972,3cyclictest19982-21systemd-journal11:15:440
128239972,3cyclictest19982-21systemd-journal08:27:510
128239971,4cyclictest19982-21systemd-journal08:44:070
128239971,3cyclictest2583-21sh09:10:000
128239970,6cyclictest10341-21munin-plugin-st11:30:000
128239970,5cyclictest19982-21systemd-journal09:15:280
128349963,2cyclictest7143-21ntpq09:40:193
128349963,2cyclictest619-21cat10:30:143
128349963,2cyclictest4045-21tail10:05:173
128349963,2cyclictest34-21ksoftirqd/312:20:153
128349963,2cyclictest34-21ksoftirqd/307:25:153
128349963,2cyclictest32412-21cut09:35:153
128349963,2cyclictest32370-21rm12:35:273
128349963,2cyclictest30654-21snmpd08:05:083
128349963,2cyclictest28512-21expr08:55:123
128349963,2cyclictest27137-21sshd07:40:063
128349963,2cyclictest19965-21if_enp4s008:35:173
128349963,2cyclictest17526-21cut11:35:133
128349963,2cyclictest17460-21ntp_offset12:25:173
128349963,2cyclictest13425-21sh11:05:163
128349962,3cyclictest9041-21cut08:10:183
128349962,3cyclictest508-21dbus-daemon10:10:033
128349962,3cyclictest3915-21expr11:50:153
128349962,3cyclictest31637-21awk07:50:163
128349962,3cyclictest30654-21snmpd12:00:553
128349962,3cyclictest30654-21snmpd11:55:103
128349962,3cyclictest30654-21snmpd09:15:133
128349962,3cyclictest30654-21snmpd08:47:243
128349962,3cyclictest22134-21cut09:25:143
128349962,3cyclictest20523-21systemd-udevd12:10:193
128349962,3cyclictest19982-21systemd-journal09:50:323
128349962,3cyclictest14586-21cron08:25:003
128349962,3cyclictest13778-21expr10:40:153
128349962,3cyclictest13563-21gltestperf07:10:163
128349962,2cyclictest19982-21systemd-journal07:56:073
128349962,1cyclictest0-21swapper/311:31:063
128349961,3cyclictest19982-21systemd-journal07:45:173
128349961,3cyclictest19982-21systemd-journal07:37:473
128349960,5cyclictest24172-21sshd07:30:223
128349960,3cyclictest28038-21ssh09:30:183
128329963,2cyclictest923-21expr10:30:152
128329963,2cyclictest508-21dbus-daemon11:36:502
128329963,2cyclictest4862-21ssh11:50:212
128329963,2cyclictest31217-21cut09:00:162
128329963,2cyclictest28-21ksoftirqd/207:25:142
128329963,2cyclictest26970-21ntpq08:50:182
128329963,2cyclictest26970-21ntpq08:50:182
128329963,2cyclictest19982-21systemd-journal11:40:522
128329963,2cyclictest19116-21gdbus08:45:002
128329963,2cyclictest17054-21sshd08:30:052
128329963,2cyclictest16157-21expr07:15:152
128329963,2cyclictest0-21swapper/211:45:272
128329962,3cyclictest508-21dbus-daemon07:10:212
128329962,3cyclictest31806-21cut12:35:202
128329962,3cyclictest30654-21snmpd12:25:132
128329962,3cyclictest30654-21snmpd11:17:322
128329962,3cyclictest30654-21snmpd09:09:212
128329962,3cyclictest30654-21snmpd08:45:122
128329962,3cyclictest30654-21snmpd07:41:072
128329962,3cyclictest27474-21cat10:25:122
128329962,3cyclictest19982-21systemd-journal08:09:292
128329962,3cyclictest19982-21systemd-journal07:33:112
128329962,3cyclictest19116-21gdbus09:15:012
128329962,3cyclictest18415-21expr07:20:182
128329962,3cyclictest16044-21cat09:20:132
128329962,3cyclictest15367-21basename10:15:142
128329962,3cyclictest0-21swapper/212:20:062
128329962,3cyclictest0-21swapper/211:25:432
128329962,1cyclictest0-21swapper/211:21:202
128329962,1cyclictest0-21swapper/211:01:102
128329962,1cyclictest0-21swapper/210:52:432
128329962,1cyclictest0-21swapper/210:46:542
128329962,1cyclictest0-21swapper/210:46:532
128329961,2cyclictest4844-21ssh09:10:292
128329961,2cyclictest23108-21ssh10:20:372
128329960,6cyclictest0-21swapper/212:15:272
128329960,6cyclictest0-21swapper/209:33:182
128329960,6cyclictest0-21swapper/207:59:072
128279963,1cyclictest22-21ksoftirqd/107:45:191
128279963,1cyclictest141rcu_preempt08:19:041
128279962,1cyclictest141rcu_preempt11:15:121
128279960,4cyclictest19982-21systemd-journal07:30:151
128279960,1cyclictest0-21swapper/107:50:081
128239965,1cyclictest2592-21diskmemload10:20:070
128239963,2cyclictest9111-21cat12:20:130
128239963,2cyclictest699-21df10:55:150
128239963,2cyclictest6554-21grep09:40:160
128239963,2cyclictest32412-21latency07:50:210
128239963,2cyclictest31647-21ssh10:54:380
128239963,2cyclictest31011-21cat11:45:250
128239963,2cyclictest30654-21snmpd10:32:130
128239963,2cyclictest28512-21unixbench_singl09:30:200
128239963,2cyclictest26269-21unixbench-2d07:35:220
128239963,2cyclictest24624-21sendmail_mailqu12:30:200
128239963,2cyclictest20903-21expr07:25:150
128239963,2cyclictest13905-21cat10:40:140
128239962,3cyclictest508-21dbus-daemon11:35:340
128239962,3cyclictest508-21dbus-daemon08:03:130
128239962,3cyclictest30654-21snmpd11:54:300
128239962,3cyclictest30654-21snmpd10:10:130
128239962,3cyclictest30654-21snmpd09:01:180
128239962,3cyclictest30654-21snmpd08:31:180
128239962,3cyclictest30654-21snmpd08:24:530
128239962,3cyclictest30654-21snmpd08:18:500
128239962,3cyclictest30654-21snmpd07:47:170
128239962,3cyclictest29802-21users08:55:200
128239962,3cyclictest23283-21cat07:30:160
128239962,3cyclictest17590-21entropy09:50:160
128239962,3cyclictest1-21systemd07:55:420
128239962,2cyclictest502-21systemd-logind07:10:140
128239962,1cyclictest0-21swapper/012:04:440
128239962,1cyclictest0-21swapper/009:20:270
128239961,3cyclictest19982-21systemd-journal11:11:480
128239961,3cyclictest19982-21systemd-journal10:05:020
128239961,2cyclictest16520-21ssh09:49:210
128239960,3cyclictest2271-21rm11:22:540
128349952,2cyclictest31097-21expr09:00:163
128349952,2cyclictest21627-21cat08:40:133
128349951,3cyclictest17759-21cat08:30:163
128349951,2cyclictest19982-21systemd-journal08:20:163
128349950,3cyclictest19982-21systemd-journal10:35:043
128349950,3cyclictest19982-21systemd-journal08:50:063
128349950,3cyclictest19982-21systemd-journal08:50:063
128329952,2cyclictest30654-21snmpd12:00:092
128329951,3cyclictest19412-21wc08:35:152
128329950,3cyclictest19982-21systemd-journal07:50:072
128279952,2cyclictest3687-21awk08:00:131
128239953,1cyclictest6431-21tr08:05:160
128239952,2cyclictest8265-21cpuspeed_turbos08:10:140
128239952,2cyclictest21530-21ssh09:25:030
128239952,2cyclictest20382-21grep10:45:160
128239952,2cyclictest20382-21grep10:45:160
128239952,2cyclictest15346-21cat07:15:010
128239950,4cyclictest19288-21sshd08:35:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional