You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 11:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Fri May 02, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
267062329294,22sleep20-21swapper/219:05:042
286462278245,21sleep10-21swapper/119:09:441
283642267234,20sleep30-21swapper/319:06:053
285012257223,22sleep00-21swapper/019:07:500
133532700,0sleep30-21swapper/300:27:153
85742660,0sleep10-21swapper/121:46:521
276602640,1sleep30-21swapper/300:13:223
165652620,0sleep20-21swapper/223:20:272
217742610,0sleep30-21swapper/320:05:153
96762590,0sleep20-21swapper/221:25:272
273112590,0sleep10-21swapper/121:15:211
52422570,0sleep20-21swapper/223:13:262
99952530,0sleep10-21swapper/122:10:111
212562180,0sleep30-21swapper/321:34:123
166982180,0sleep30-21swapper/321:52:393
29082140,0sleep10-21swapper/119:20:211
120742140,0sleep20-21swapper/223:17:592
296082130,0sleep10-21swapper/122:45:141
28777991310,2cyclictest28-21ksoftirqd/200:00:012
186692130,0sleep10-21swapper/121:54:251
28777991210,2cyclictest28-21ksoftirqd/222:35:012
28777991210,1cyclictest28-21ksoftirqd/219:15:002
2877799119,2cyclictest28-21ksoftirqd/221:40:022
2877799118,2cyclictest28-21ksoftirqd/221:35:012
2877799118,2cyclictest28-21ksoftirqd/221:05:002
2877799109,1cyclictest28-21ksoftirqd/221:15:012
2877799104,4cyclictest19982-21systemd-journal22:04:022
2877399105,3cyclictest19982-21systemd-journal23:22:041
287829995,3cyclictest19982-21systemd-journal00:37:093
287829994,3cyclictest19982-21systemd-journal20:30:333
287779998,1cyclictest28-21ksoftirqd/223:10:002
287779998,1cyclictest28-21ksoftirqd/200:00:002
287779997,1cyclictest28-21ksoftirqd/220:45:012
287779997,1cyclictest28-21ksoftirqd/220:40:012
287779993,4cyclictest28-21ksoftirqd/223:34:592
287779993,4cyclictest28-21ksoftirqd/222:50:152
287779991,5cyclictest28-21ksoftirqd/222:15:282
287739992,4cyclictest21548-21idleruntime-cro20:05:011
20693290,0sleep10-21swapper/123:01:041
17026290,0sleep20-21swapper/222:15:002
5606280,0sleep10-21swapper/121:23:251
287829986,2cyclictest34-21ksoftirqd/300:00:013
287829984,3cyclictest508-21dbus-daemon00:15:023
287829984,2cyclictest19982-21systemd-journal20:21:333
287829983,3cyclictest19982-21systemd-journal21:24:553
287829983,3cyclictest19982-21systemd-journal20:03:273
287779987,1cyclictest28-21ksoftirqd/222:30:012
287779987,1cyclictest28-21ksoftirqd/220:45:012
287779987,1cyclictest28-21ksoftirqd/219:50:002
287779987,1cyclictest28-21ksoftirqd/219:40:012
287779987,1cyclictest28-21ksoftirqd/219:35:012
287779987,1cyclictest28-21ksoftirqd/200:09:592
287779985,2cyclictest30654-21snmpd21:16:402
287779985,2cyclictest28-21ksoftirqd/221:40:022
287779985,2cyclictest28-21ksoftirqd/220:35:002
287779984,1cyclictest28-21ksoftirqd/222:08:142
287779983,3cyclictest28-21ksoftirqd/221:53:222
287779982,4cyclictest4900-21processes19:25:202
287779982,4cyclictest28-21ksoftirqd/223:25:152
287779982,4cyclictest28-21ksoftirqd/222:42:472
287779982,4cyclictest28-21ksoftirqd/220:19:192
287779982,4cyclictest271rcuc/223:04:042
287779981,5cyclictest28-21ksoftirqd/221:55:502
287779981,5cyclictest28-21ksoftirqd/221:23:062
287779981,5cyclictest28-21ksoftirqd/220:55:202
287779981,5cyclictest28-21ksoftirqd/200:16:132
287779981,4cyclictest28-21ksoftirqd/223:53:052
287779981,2cyclictest28-21ksoftirqd/222:20:142
287739984,3cyclictest19982-21systemd-journal23:10:231
287739984,3cyclictest19982-21systemd-journal22:05:331
287739984,3cyclictest18145-21cat19:55:201
287739983,4cyclictest0-21swapper/123:15:211
287699984,2cyclictest502-21systemd-logind21:38:340
287699983,1cyclictest0-21swapper/022:50:150
287699982,3cyclictest27000-21dump-pmu-power22:00:020
10984280,1sleep00-21swapper/000:25:170
287829974,2cyclictest5437-21pmu-power23:35:183
287829974,2cyclictest508-21dbus-daemon19:27:103
287829973,3cyclictest30654-21snmpd19:44:173
287829973,3cyclictest30654-21snmpd00:30:453
287829973,3cyclictest21801-21apt-get22:40:133
287829973,3cyclictest0-21swapper/322:29:433
287829973,3cyclictest0-21swapper/322:20:193
287829973,3cyclictest0-21swapper/322:11:153
287829973,3cyclictest0-21swapper/322:00:193
287829973,3cyclictest0-21swapper/321:15:373
287829973,1cyclictest0-21swapper/322:55:293
287829973,1cyclictest0-21swapper/322:48:083
287829973,1cyclictest0-21swapper/322:15:053
287829973,1cyclictest0-21swapper/300:20:123
287829972,3cyclictest19982-21systemd-journal21:55:023
287779976,1cyclictest28-21ksoftirqd/220:30:002
287779976,1cyclictest28-21ksoftirqd/200:20:222
287779976,1cyclictest271rcuc/219:55:162
287779975,2cyclictest28-21ksoftirqd/223:35:132
287779975,2cyclictest28-21ksoftirqd/219:15:012
287779973,1cyclictest28-21ksoftirqd/200:32:092
287779973,1cyclictest141rcu_preempt22:35:212
287779972,4cyclictest271rcuc/222:45:152
287779972,2cyclictest28-21ksoftirqd/200:07:522
287779971,4cyclictest28-21ksoftirqd/222:55:182
287779971,4cyclictest0-21swapper/220:10:212
287779971,3cyclictest141rcu_preempt21:05:532
287779970,5cyclictest7024-21uptime21:45:242
287779970,5cyclictest28-21ksoftirqd/200:35:052
287779970,4cyclictest28-21ksoftirqd/223:45:292
287779970,4cyclictest28-21ksoftirqd/219:20:162
287779970,4cyclictest0-21swapper/200:27:372
287779970,3cyclictest12419-21dump-pmu-power19:45:012
287779970,2cyclictest15649-21uniq19:50:162
287739974,2cyclictest508-21dbus-daemon19:25:301
287739974,2cyclictest14478-21turbostat00:05:001
287739973,4cyclictest25966-21kworker/1:120:06:561
287739973,4cyclictest25966-21kworker/1:100:12:071
287739973,3cyclictest30654-21snmpd19:16:401
287739973,3cyclictest19982-21systemd-journal22:21:591
287739973,3cyclictest17054-21sshd19:54:321
287739973,1cyclictest0-21swapper/123:36:201
287739973,1cyclictest0-21swapper/122:59:051
287739973,1cyclictest0-21swapper/122:42:081
287739973,1cyclictest0-21swapper/121:32:361
287739973,1cyclictest0-21swapper/100:33:161
287739972,5cyclictest25966-21kworker/1:122:17:321
287739972,5cyclictest25966-21kworker/1:121:13:191
287739972,5cyclictest25966-21kworker/1:120:26:511
287739972,5cyclictest25966-21kworker/1:100:29:151
287739972,3cyclictest19982-21systemd-journal23:40:011
287739972,3cyclictest19982-21systemd-journal23:40:011
287739972,3cyclictest1947-21dpkg22:05:021
287739970,6cyclictest5616-21head00:20:231
287699976,1cyclictest12-21ksoftirqd/020:55:010
287699974,2cyclictest508-21dbus-daemon00:14:120
287699973,3cyclictest508-21dbus-daemon21:05:370
287699973,3cyclictest508-21dbus-daemon20:56:020
287699973,3cyclictest508-21dbus-daemon20:45:000
287699973,3cyclictest29032-21cron23:30:010
287699973,3cyclictest19982-21systemd-journal20:16:480
287699973,3cyclictest0-21swapper/023:35:570
287699973,3cyclictest0-21swapper/022:26:480
287699973,1cyclictest0-21swapper/021:20:260
287699972,3cyclictest502-21systemd-logind00:07:070
287699972,3cyclictest19982-21systemd-journal23:06:370
287699971,5cyclictest30654-21snmpd21:53:240
287699971,3cyclictest15224-21rm23:42:140
287699971,3cyclictest15224-21rm23:42:140
287699970,7cyclictest0-21swapper/021:11:000
287699970,5cyclictest19982-21systemd-journal20:33:540
28440270,0chrt0-21swapper/220:20:162
287829964,1cyclictest15844-21gltestperf00:05:163
287829963,2cyclictest26456-21cat20:15:163
287829963,2cyclictest2517-21sh22:05:033
287829963,2cyclictest22227-21ssh23:47:063
287829963,2cyclictest17765-21sh23:21:343
287829963,2cyclictest14544-21expr21:00:203
287829963,2cyclictest11736-21in:imuxsock23:05:473
287829963,2cyclictest0-21swapper/321:25:563
287829963,1cyclictest0-21swapper/321:45:113
287829962,3cyclictest9933-21cat20:50:193
287829962,3cyclictest8910-21cat19:35:163
287829962,3cyclictest32735-21cat23:10:143
287829962,3cyclictest30654-21snmpd23:32:283
287829962,3cyclictest30654-21snmpd22:38:163
287829962,3cyclictest30654-21snmpd22:32:523
287829962,3cyclictest30654-21snmpd20:40:033
287829962,3cyclictest30654-21snmpd20:35:363
287829962,3cyclictest30654-21snmpd19:31:253
287829962,3cyclictest30654-21snmpd19:13:153
287829962,3cyclictest24363-21expr20:10:163
287829962,3cyclictest19982-21systemd-journal22:52:013
287829962,3cyclictest19116-21gdbus21:40:023
287829962,3cyclictest1-21systemd19:53:273
287829962,3cyclictest1-21systemd19:19:393
287829962,1cyclictest0-21swapper/323:41:413
287829962,1cyclictest0-21swapper/323:41:403
287829962,1cyclictest0-21swapper/323:29:263
287829961,4cyclictest26706-21wc23:50:193
287829961,2cyclictest24710-21rm21:35:413
287829961,2cyclictest21898-21ssh23:02:153
287829961,2cyclictest10296-21ssh00:01:063
287829960,4cyclictest19982-21systemd-journal21:11:023
287829960,0cyclictest0-21swapper/323:15:053
287779963,2cyclictest19595-21apt-get20:00:142
287779962,3cyclictest22466-21cat20:05:182
287779962,1cyclictest0-21swapper/223:40:082
287779962,1cyclictest0-21swapper/223:40:082
287779960,4cyclictest0-21swapper/220:50:152
287739964,2cyclictest25966-21kworker/1:119:45:231
287739963,3cyclictest25966-21kworker/1:121:00:191
287739963,2cyclictest508-21dbus-daemon21:06:021
287739963,2cyclictest4912-21cat22:50:181
287739963,2cyclictest18874-21ls23:45:151
287739963,2cyclictest14994-21gdbus00:05:011
287739963,2cyclictest1-21systemd21:40:151
287739962,4cyclictest25966-21kworker/1:123:55:061
287739962,4cyclictest25966-21kworker/1:120:55:301
287739962,4cyclictest25966-21kworker/1:120:50:501
287739962,4cyclictest25966-21kworker/1:120:47:101
287739962,4cyclictest25966-21kworker/1:120:31:191
287739962,4cyclictest25966-21kworker/1:120:14:481
287739962,4cyclictest25966-21kworker/1:119:40:071
287739962,4cyclictest25966-21kworker/1:119:36:231
287739962,4cyclictest25966-21kworker/1:119:13:401
287739962,4cyclictest25966-21kworker/1:100:35:111
287739962,4cyclictest25966-21kworker/1:100:16:071
287739962,3cyclictest6169-21cat20:40:261
287739962,3cyclictest508-21dbus-daemon20:35:091
287739962,3cyclictest30654-21snmpd23:50:291
287739962,3cyclictest30654-21snmpd21:35:441
287739962,3cyclictest30654-21snmpd20:16:451
287739962,3cyclictest28677-21cat20:20:171
287739962,3cyclictest1-21systemd22:26:091
287739962,1cyclictest0-21swapper/123:30:161
287739962,1cyclictest0-21swapper/123:05:591
287739962,1cyclictest0-21swapper/122:31:351
287739960,5cyclictest7879-21/usr/sbin/munin21:25:161
287739960,5cyclictest19837-21gdbus21:55:011
287739960,5cyclictest15040-21gltestperf22:35:151
287739960,3cyclictest22400-21df_inode23:25:141
287699963,2cyclictest668-21runrttasks21:45:210
287699963,2cyclictest4597-21ssh23:12:530
287699963,2cyclictest4344-21sh23:57:180
287699963,2cyclictest19298-21ntpq23:00:190
287699963,2cyclictest15802-21ssh22:58:100
287699963,2cyclictest15490-21chrt21:03:340
287699963,2cyclictest0-21swapper/022:15:160
287699962,3cyclictest5106-21cat19:25:200
287699962,3cyclictest31046-21fschecks_count20:25:160
287699962,3cyclictest30654-21snmpd23:15:530
287699962,3cyclictest30654-21snmpd22:41:240
287699962,3cyclictest30654-21snmpd22:10:210
287699962,3cyclictest30654-21snmpd21:25:330
287699962,3cyclictest30654-21snmpd20:36:410
287699962,3cyclictest30654-21snmpd20:24:170
287699962,3cyclictest30654-21snmpd19:37:430
287699962,3cyclictest30654-21snmpd19:10:550
287699962,3cyclictest30654-21snmpd00:31:330
287699962,3cyclictest30654-21snmpd00:20:280
287699962,3cyclictest30373-21/usr/sbin/munin23:30:190
287699962,3cyclictest25855-21wc21:15:120
287699962,3cyclictest25139-21cat22:20:140
287699962,3cyclictest23360-21basename00:35:190
287699962,3cyclictest20266-21cat20:00:180
287699962,3cyclictest19982-21systemd-journal20:46:010
287699962,3cyclictest16978-21uptime21:30:250
287699962,3cyclictest15021-21expr23:20:150
287699962,3cyclictest14743-21expr22:35:130
287699962,3cyclictest1-21systemd19:22:340
287699962,3cyclictest0-21swapper/022:05:160
287699962,3cyclictest0-21swapper/000:17:120
287699962,1cyclictest0-21swapper/022:34:440
287699961,3cyclictest7308-40logrotate00:00:010
287699961,2cyclictest32749-21ssh21:40:560
287699961,2cyclictest23565-21kworker/u8:123:50:470
287699960,6cyclictest0-21swapper/023:48:480
287699960,5cyclictest6398-21expr19:30:140
287699960,4cyclictest19982-21systemd-journal22:45:200
287699960,4cyclictest19982-21systemd-journal19:15:300
287699960,2cyclictest23970-21/usr/sbin/munin20:10:240
15312260,0sleep00-21swapper/019:50:150
287829952,2cyclictest7214-21cut20:45:183
287829952,2cyclictest30654-21snmpd19:55:133
287829952,2cyclictest1898-21expr19:20:133
287829952,2cyclictest15973-21cat21:05:143
287829951,3cyclictest30654-21snmpd19:45:083
287829951,3cyclictest30616-21/usr/sbin/munin20:25:143
287829951,3cyclictest11654-21cat20:55:173
287739952,2cyclictest5999-21taskset19:30:041
287699952,2cyclictest22242-21tune2fs20:05:180
287699952,2cyclictest13305-21basename19:45:210
287699952,2cyclictest11736-21in:imuxsock19:55:070
287699952,2cyclictest11071-21which19:40:220
287699950,3cyclictest19982-21systemd-journal22:00:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional