You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-04 - 02:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Mon Nov 03, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110602317289,17sleep20-21swapper/207:08:512
110602317289,17sleep20-21swapper/207:08:502
111352268213,44sleep00-21swapper/007:09:490
111352268213,44sleep00-21swapper/007:09:480
108002264225,22sleep30-21swapper/307:05:303
108002264225,22sleep30-21swapper/307:05:293
109392263229,23sleep10-21swapper/107:07:171
109392263229,23sleep10-21swapper/107:07:161
253292600,0sleep00-21swapper/009:32:300
193422580,0sleep20-21swapper/212:07:092
168272580,0sleep20-21swapper/211:39:352
12502580,1sleep30-21swapper/310:58:563
250982570,0sleep30-21swapper/307:35:213
192132560,0sleep20-21swapper/207:25:112
314462540,0sleep00-21swapper/009:37:340
111842480,1sleep228-21ksoftirqd/209:46:552
9152430,0sleep10-21swapper/112:18:261
295612420,1sleep311257-21cyclictest09:35:293
102452200,0sleep30-21swapper/312:25:213
163142180,0sleep00-21swapper/009:50:210
238192170,0sleep00-21swapper/008:45:170
45472140,0sleep00-21swapper/011:00:450
67522130,0sleep30-21swapper/310:35:173
155172130,0sleep10-21swapper/110:15:211
68802120,0sleep10-21swapper/111:30:161
297152110,0sleep20-21swapper/212:15:152
30909290,1sleep30-21swapper/307:50:143
112769996,2cyclictest17402-21fschecks_time09:25:143
112769994,3cyclictest19982-21systemd-journal07:10:523
112689990,7cyclictest19982-21systemd-journal08:50:331
28690280,0sleep10-21swapper/108:55:311
112769984,3cyclictest24771-21sshd09:31:393
112769984,3cyclictest19982-21systemd-journal11:33:413
112769983,3cyclictest19982-21systemd-journal12:31:133
112769983,3cyclictest19982-21systemd-journal08:31:403
112729984,3cyclictest508-21dbus-daemon08:53:292
112729984,3cyclictest19982-21systemd-journal08:35:582
112729983,3cyclictest19982-21systemd-journal08:25:212
112729982,3cyclictest14197-21perf12:30:012
112689984,3cyclictest19982-21systemd-journal10:32:231
112689983,4cyclictest29332-1kworker/u9:110:10:001
112689980,5cyclictest18118-21munin-run08:35:011
112689980,1cyclictest0-21swapper/108:40:211
112649984,3cyclictest508-21dbus-daemon08:30:010
112649984,3cyclictest508-21dbus-daemon07:40:540
112649984,2cyclictest19982-21systemd-journal10:10:010
112649983,4cyclictest30654-21snmpd11:07:460
112649983,3cyclictest19982-21systemd-journal11:16:410
112649983,3cyclictest19982-21systemd-journal10:24:020
112649983,3cyclictest19982-21systemd-journal10:10:160
112649983,3cyclictest19982-21systemd-journal07:47:590
112769975,1cyclictest30654-21snmpd12:12:443
112769974,2cyclictest11738-21rs:main3
112769973,3cyclictest508-21dbus-daemon11:40:013
112769973,3cyclictest4278-21sshd08:03:413
112769973,3cyclictest0-21swapper/311:51:153
112769973,1cyclictest0-21swapper/309:57:343
112769972,3cyclictest19982-21systemd-journal12:00:483
112769972,3cyclictest19982-21systemd-journal10:05:543
112769972,3cyclictest19982-21systemd-journal09:47:183
112769971,4cyclictest19982-21systemd-journal12:39:373
112769971,3cyclictest502-21systemd-logind07:20:033
112729974,2cyclictest508-21dbus-daemon12:24:362
112729974,2cyclictest19982-21systemd-journal10:05:142
112729974,2cyclictest19982-21systemd-journal09:13:302
112729974,2cyclictest19982-21systemd-journal08:22:112
112729973,3cyclictest508-21dbus-daemon12:15:002
112729973,3cyclictest508-21dbus-daemon07:35:532
112729973,3cyclictest29741-11brltty11:51:122
112729973,3cyclictest19982-21systemd-journal10:50:512
112729973,3cyclictest11736-21in:imuxsock10:49:042
112729973,3cyclictest11736-21in:imuxsock10:11:052
112729973,1cyclictest0-21swapper/210:26:492
112689974,2cyclictest11736-21in:imuxsock08:05:551
112689973,3cyclictest508-21dbus-daemon09:43:341
112689973,3cyclictest508-21dbus-daemon07:47:351
112689973,3cyclictest19982-21systemd-journal09:00:331
112689973,3cyclictest19982-21systemd-journal08:04:401
112689973,3cyclictest17892-21sed07:20:191
112689973,3cyclictest11202-21sshd08:17:401
112689973,2cyclictest19982-21systemd-journal11:51:091
112689973,1cyclictest29332-1kworker/u9:112:10:231
112689972,3cyclictest19982-21systemd-journal12:01:131
112689971,4cyclictest19982-21systemd-journal08:47:381
112689971,2cyclictest13660-21munin-run08:25:001
112649974,2cyclictest680-21irqstats10:30:150
112649974,2cyclictest508-21dbus-daemon08:06:200
112649974,2cyclictest28343-21awk10:25:250
112649974,2cyclictest20141-21ssh10:46:520
112649973,3cyclictest508-21dbus-daemon09:15:360
112649973,3cyclictest30654-21snmpd08:52:260
112649973,3cyclictest27316-21grep10:00:140
112649973,3cyclictest22100-21diskstats12:35:140
112649973,3cyclictest19982-21systemd-journal07:36:410
112649973,3cyclictest0-21swapper/009:22:180
112649973,2cyclictest19982-21systemd-journal07:12:410
112649970,7cyclictest29741-11brltty11:36:110
112769966,0cyclictest0-21swapper/311:10:163
112769966,0cyclictest0-21swapper/310:18:403
112769964,1cyclictest8446-21cut10:10:153
112769963,2cyclictest5296-21cat08:05:163
112769963,2cyclictest4509-21ssh11:00:413
112769963,2cyclictest30012-21ssh10:01:333
112769963,2cyclictest28591-21tune2fs07:45:173
112769963,2cyclictest21173-21ntpq10:20:173
112769963,2cyclictest18993-21sh10:45:293
112769963,2cyclictest1636-21sh09:40:133
112769963,2cyclictest14741-21sh09:22:353
112769963,2cyclictest11908-21rm10:40:133
112769963,2cyclictest11401-21cron08:20:013
112769963,2cyclictest0-21swapper/312:16:013
112769963,2cyclictest0-21swapper/311:55:163
112769963,1cyclictest0-21swapper/311:44:263
112769962,3cyclictest7952-21which08:10:213
112769962,3cyclictest508-21dbus-daemon09:09:193
112769962,3cyclictest30654-21snmpd12:24:293
112769962,3cyclictest30654-21snmpd11:06:423
112769962,3cyclictest30654-21snmpd10:26:263
112769962,3cyclictest30654-21snmpd09:50:393
112769962,3cyclictest30654-21snmpd08:55:033
112769962,3cyclictest30654-21snmpd08:45:453
112769962,3cyclictest30654-21snmpd08:37:233
112769962,3cyclictest30654-21snmpd07:44:163
112769962,3cyclictest30654-21snmpd07:18:103
112769962,3cyclictest2453-21cat09:10:183
112769962,3cyclictest20272-21run-parts07:25:183
112769962,3cyclictest19982-21systemd-journal08:20:063
112769962,3cyclictest1186-21ntp_states11:25:213
112769962,1cyclictest141rcu_preempt12:05:153
112769962,1cyclictest0-21swapper/309:15:463
112769961,4cyclictest25073-21apt-get08:50:133
112769961,3cyclictest19982-21systemd-journal10:50:443
112769961,3cyclictest19982-21systemd-journal08:40:413
112769961,3cyclictest19982-21systemd-journal08:25:253
112769960,4cyclictest19982-21systemd-journal09:02:403
112769960,4cyclictest19982-21systemd-journal07:58:003
112769960,2cyclictest20126-21/usr/sbin/munin11:15:193
112769960,0cyclictest0-21swapper/311:47:123
112729963,2cyclictest9956-21grep08:15:122
112729963,2cyclictest7213-21processes10:35:202
112729963,2cyclictest508-21dbus-daemon11:20:212
112729963,2cyclictest4208-21vmstat11:00:232
112729963,2cyclictest30366-21ssh09:36:212
112729963,2cyclictest3026-21sh11:26:422
112729963,2cyclictest22023-21ssh10:20:352
112729963,2cyclictest17268-21gunzip08:30:202
112729963,2cyclictest16875-21rm11:11:382
112729963,2cyclictest16316-21uptime12:30:222
112729963,2cyclictest12150-21tr10:40:162
112729962,3cyclictest7668-21grep09:15:202
112729962,3cyclictest4408-21idleruntime-cro08:05:012
112729962,3cyclictest31055-21awk09:00:212
112729962,3cyclictest30654-21snmpd11:46:102
112729962,3cyclictest30654-21snmpd11:05:062
112729962,3cyclictest30654-21snmpd10:30:152
112729962,3cyclictest30654-21snmpd09:50:062
112729962,3cyclictest30654-21snmpd07:57:352
112729962,3cyclictest30654-21snmpd07:48:112
112729962,3cyclictest30654-21snmpd07:40:462
112729962,3cyclictest22000-21expr12:35:132
112729962,3cyclictest20927-21expr08:40:162
112729962,3cyclictest18482-21sshd07:20:292
112729962,3cyclictest10579-21grep12:00:152
112729962,3cyclictest0-21swapper/211:15:572
112729962,2cyclictest19982-21systemd-journal11:58:182
112729962,1cyclictest0-21swapper/211:31:272
112729962,1cyclictest0-21swapper/210:56:502
112729962,1cyclictest0-21swapper/210:00:212
112729962,1cyclictest0-21swapper/209:41:162
112729962,1cyclictest0-21swapper/209:30:262
112729962,1cyclictest0-21swapper/209:20:112
112729961,3cyclictest19982-21systemd-journal09:55:432
112729961,3cyclictest19982-21systemd-journal09:05:372
112729961,3cyclictest19982-21systemd-journal08:05:002
112729961,3cyclictest19982-21systemd-journal07:33:402
112729960,5cyclictest30373-21find07:50:132
112729960,2cyclictest27282-21/usr/sbin/munin08:55:312
112729960,2cyclictest19982-21systemd-journal07:15:012
112689966,0cyclictest0-21swapper/111:16:071
112689964,2cyclictest22-21ksoftirqd/109:15:131
112689963,2cyclictest9215-21ssh10:37:221
112689963,2cyclictest668-21runrttasks10:52:281
112689963,2cyclictest4943-21ssh11:01:101
112689963,2cyclictest25119-21rm09:32:131
112689963,2cyclictest23539-21sshd07:35:061
112689963,2cyclictest2054-21chrt07:58:571
112689963,2cyclictest17303-21sh10:45:101
112689963,2cyclictest16170-21chrt07:18:331
112689963,2cyclictest15242-21pmu-power11:10:201
112689963,2cyclictest13083-21grep10:40:331
112689963,2cyclictest1095-21cut11:25:201
112689963,2cyclictest0-21swapper/110:25:021
112689963,2cyclictest0-21swapper/110:02:071
112689962,3cyclictest8832-21ls11:05:151
112689962,3cyclictest7661-21lldpd09:26:531
112689962,3cyclictest508-21dbus-daemon08:40:011
112689962,3cyclictest508-21dbus-daemon08:30:011
112689962,3cyclictest508-21dbus-daemon07:53:251
112689962,3cyclictest30654-21snmpd09:50:471
112689962,3cyclictest30654-21snmpd07:31:331
112689962,3cyclictest29692-21if_enp4s010:55:151
112689962,3cyclictest28705-21grep09:35:181
112689962,3cyclictest26610-21cat07:40:171
112689962,3cyclictest22422-21cat12:35:151
112689962,3cyclictest21571-21expr09:55:121
112689962,3cyclictest19982-21systemd-journal09:45:521
112689962,3cyclictest17257-21sshd12:31:161
112689962,3cyclictest12544-21proc_pri07:10:191
112689962,3cyclictest1-21systemd08:11:201
112689962,3cyclictest0-21swapper/109:20:041
112689962,1cyclictest0-21swapper/112:22:301
112689962,1cyclictest0-21swapper/111:45:101
112689962,1cyclictest0-21swapper/111:23:491
112689962,1cyclictest0-21swapper/110:21:001
112689961,2cyclictest502-21systemd-logind11:57:281
112689960,6cyclictest0-21swapper/112:05:341
112689960,6cyclictest0-21swapper/111:35:071
112689960,6cyclictest0-21swapper/109:14:521
112689960,2cyclictest8959-21pmu-power10:10:191
112689960,2cyclictest17526-21/usr/sbin/munin11:40:131
112649966,0cyclictest0-21swapper/011:45:490
112649966,0cyclictest0-21swapper/011:41:000
112649966,0cyclictest0-21swapper/010:40:520
112649964,1cyclictest29946-21df_inode09:00:150
112649964,1cyclictest29654-21grep12:15:130
112649963,2cyclictest9770-21expr08:15:120
112649963,2cyclictest6834-21rm11:30:160
112649963,2cyclictest4920-21ssh11:55:490
112649963,2cyclictest30654-21snmpd12:21:110
112649963,2cyclictest28919-21sh10:55:080
112649963,2cyclictest22679-21rm12:10:140
112649963,2cyclictest19982-21systemd-journal11:50:410
112649963,2cyclictest19604-21grep07:25:130
112649962,3cyclictest30654-21snmpd12:30:500
112649962,3cyclictest30654-21snmpd11:10:100
112649962,3cyclictest30654-21snmpd10:35:290
112649962,3cyclictest30654-21snmpd09:47:230
112649962,3cyclictest30654-21snmpd09:05:100
112649962,3cyclictest30654-21snmpd08:56:500
112649962,3cyclictest30654-21snmpd08:22:510
112649962,3cyclictest30654-21snmpd07:50:100
112649962,3cyclictest2715-21ntpq09:10:200
112649962,3cyclictest23711-21cat10:50:150
112649962,3cyclictest2006-21cat09:40:160
112649962,3cyclictest19982-21systemd-journal08:14:160
112649962,3cyclictest19982-21systemd-journal07:31:410
112649962,3cyclictest18835-21fschecks_time08:35:150
112649962,3cyclictest1777-21sshd07:55:280
112649962,3cyclictest17559-21cat07:20:180
112649962,3cyclictest17096-21ntpq08:30:200
112649962,3cyclictest15017-21cat07:15:150
112649962,3cyclictest1-21systemd11:29:060
112649962,1cyclictest0-21swapper/012:05:210
112649962,1cyclictest0-21swapper/011:22:440
112649961,4cyclictest19982-21systemd-journal08:05:000
112649961,2cyclictest10415-21ssh12:25:200
112649960,6cyclictest0-21swapper/012:00:160
112649960,5cyclictest22287-21ntp_states09:55:170
112649960,5cyclictest14762-21diskstats10:15:170
112649960,4cyclictest19982-21systemd-journal08:43:530
112769952,2cyclictest21691-21cat07:30:143
112769952,2cyclictest0-21swapper/310:30:083
112729952,2cyclictest6966-21cat08:10:142
112729952,2cyclictest30654-21snmpd10:15:022
112729952,2cyclictest17731-21tr11:40:132
112729951,3cyclictest23509-21cat08:45:152
112729951,3cyclictest11813-21expr07:10:152
112729950,4cyclictest17324-21/usr/sbin/munin09:25:132
112689953,1cyclictest19931-21missed_timers07:25:141
112689952,2cyclictest9188-21expr12:25:131
112689952,2cyclictest31768-21/usr/sbin/munin09:05:131
112649952,2cyclictest17063-21cpuspeed_turbos09:25:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional