You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 15:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Fri Nov 21, 2025 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18442294234,48sleep10-21swapper/107:06:211
19882274241,20sleep30-21swapper/307:08:113
18452268216,38sleep20-21swapper/207:06:212
20502267208,19sleep00-21swapper/007:08:490
253942620,0sleep00-21swapper/012:33:470
234632620,0sleep00-21swapper/009:35:180
76222590,0sleep10-21swapper/111:58:271
311792590,0sleep10-21swapper/110:32:551
310362590,0sleep20-21swapper/211:51:282
76772580,0sleep20-21swapper/207:20:112
39922560,0sleep00-21swapper/011:05:010
216752180,0sleep00-21swapper/009:34:510
231642170,0sleep228-21ksoftirqd/212:32:012
226599160,8cyclictest31997-21grep08:15:000
226599160,11cyclictest8851-21users10:40:230
226599154,9cyclictest19982-21systemd-journal12:39:490
226599150,9cyclictest0-21swapper/007:45:100
226599150,12cyclictest9006-21ssh12:22:110
226599150,12cyclictest5967-21ssh09:47:220
226599150,12cyclictest4587-21cat09:20:110
226599150,12cyclictest31120-21ssh10:32:510
226599150,11cyclictest28055-21ssh11:23:320
226599150,11cyclictest24966-21ssh11:47:090
226599150,10cyclictest27401-21sshd08:03:510
226599150,10cyclictest24460-21diskmemload10:51:150
226599150,10cyclictest11641-21smartctl09:25:180
182342150,0sleep2271rcuc/211:15:202
283882140,0sleep20-21swapper/209:40:032
226599140,9cyclictest31801-21proc_pri12:15:190
226599140,9cyclictest29378-21grep09:40:170
226599140,9cyclictest22674-21open_files10:00:170
226599140,9cyclictest15211-21cron08:50:000
226599140,8cyclictest19982-21systemd-journal07:35:420
226599140,11cyclictest7286-21ssh11:58:090
226599140,11cyclictest6549-21ssh10:39:500
226599140,11cyclictest6518-21mailstats07:15:200
226599140,11cyclictest5877-21ssh10:12:540
226599140,11cyclictest3315-21missed_timers07:10:170
226599140,11cyclictest3315-21missed_timers07:10:170
226599140,11cyclictest32690-21ssh09:15:320
226599140,11cyclictest30358-21ssh10:59:110
226599140,11cyclictest30188-21ssh11:50:390
226599140,11cyclictest30109-21ssh10:05:450
226599140,11cyclictest27319-21ssh12:12:230
226599140,11cyclictest27155-21ssh09:11:010
226599140,11cyclictest24460-21diskmemload11:08:280
226599140,11cyclictest24460-21diskmemload11:08:280
226599140,11cyclictest19675-21ssh11:16:460
226599140,11cyclictest19602-21ssh12:06:340
226599140,11cyclictest1952-21ssh11:28:580
226599140,11cyclictest16960-21sh10:21:310
226599140,11cyclictest16700-21sed09:55:190
226599140,11cyclictest15951-21ssh11:14:510
226599140,11cyclictest15592-21ssh10:46:070
226599140,11cyclictest13253-21ssh09:53:240
226599140,11cyclictest13095-21ssh10:19:020
226599140,11cyclictest12242-21ssh11:36:270
226599140,11cyclictest12093-21ssh12:01:000
226599130,8cyclictest3381-21cat08:20:220
226599130,8cyclictest20700-21ssh10:25:120
226599130,12cyclictest20221-21apt-get09:00:020
226599130,12cyclictest0-21swapper/011:30:110
226599130,10cyclictest16112-21cpuspeed_turbos11:40:130
226599130,10cyclictest14514-21ssh12:25:490
226599120,9cyclictest10415-21taskset08:36:160
226599120,8cyclictest7623-21processes08:30:200
226599120,8cyclictest29741-11brltty07:41:570
226599120,8cyclictest24436-21find07:55:170
226599120,7cyclictest385-21head08:15:170
226599120,7cyclictest28003-21cstates08:05:100
226599120,7cyclictest0-21swapper/009:09:590
226599120,7cyclictest0-21swapper/008:27:510
226599120,11cyclictest11027-21apt-get08:40:120
200162120,0sleep10-21swapper/111:42:581
226599113,7cyclictest11736-21in:imuxsock09:00:000
226599110,7cyclictest7602-21grep07:20:110
226599110,7cyclictest16110-21basename08:50:140
226599110,7cyclictest11661-21sshd07:28:460
226599110,1cyclictest0-21swapper/007:50:120
226599110,10cyclictest12057-21apt-get07:30:110
164232110,0sleep30-21swapper/311:15:053
22729998,1cyclictest28-21ksoftirqd/208:55:012
22729995,3cyclictest19982-21systemd-journal09:24:092
23588280,0sleep10-21swapper/112:10:121
22779983,4cyclictest0-21swapper/311:03:533
22779983,4cyclictest0-21swapper/310:45:133
22779983,3cyclictest19982-21systemd-journal09:50:033
22729985,2cyclictest28-21ksoftirqd/208:25:002
22729984,3cyclictest19982-21systemd-journal08:39:002
22729984,3cyclictest19982-21systemd-journal08:09:082
22699984,3cyclictest19982-21systemd-journal12:08:061
22699983,3cyclictest19982-21systemd-journal11:15:091
20154280,0sleep20-21swapper/209:00:002
19130280,1sleep30-21swapper/309:31:493
7419270,0sleep10-21swapper/108:30:171
22779976,1cyclictest24460-21diskmemload12:22:163
22779974,2cyclictest18639-21tr08:55:183
22779973,3cyclictest7661-21lldpd07:59:083
22779973,3cyclictest20504-21ntpq10:50:193
22779973,3cyclictest19982-21systemd-journal11:25:003
22779973,3cyclictest19982-21systemd-journal08:00:193
22779973,3cyclictest19954-21tune2fs12:30:153
22779973,3cyclictest15396-21ntpq10:20:173
22779973,3cyclictest11736-21in:imuxsock12:26:033
22779973,3cyclictest0-21swapper/309:55:333
22779973,2cyclictest19982-21systemd-journal11:55:013
22779973,2cyclictest19982-21systemd-journal09:39:213
22779973,1cyclictest0-21swapper/310:37:343
22779973,1cyclictest0-21swapper/310:02:073
22779972,4cyclictest0-21swapper/311:59:413
22779972,3cyclictest19982-21systemd-journal11:32:143
22779972,3cyclictest19982-21systemd-journal07:48:123
22779970,1cyclictest1240-21ssh09:16:403
22729976,1cyclictest32007-21ssh11:25:532
22729976,1cyclictest28-21ksoftirqd/208:00:012
22729975,1cyclictest15538-21cron11:40:002
22729974,2cyclictest11736-21in:imuxsock12:09:212
22729974,2cyclictest11736-21in:imuxsock10:47:112
22729973,3cyclictest32509-21ls08:15:142
22729973,1cyclictest0-21swapper/212:37:432
22729973,1cyclictest0-21swapper/212:28:272
22729973,1cyclictest0-21swapper/209:33:422
22729972,3cyclictest19982-21systemd-journal10:05:282
22729972,3cyclictest19982-21systemd-journal09:57:582
22729971,3cyclictest30202-21awk12:15:002
22729970,3cyclictest19982-21systemd-journal08:45:012
22699974,2cyclictest508-21dbus-daemon12:25:141
22699974,2cyclictest14031-21ls07:35:021
22699974,2cyclictest11736-21in:imuxsock09:55:021
22699973,3cyclictest508-21dbus-daemon07:58:381
22699973,3cyclictest30654-21snmpd08:15:141
22699973,3cyclictest0-21swapper/111:12:561
22699973,2cyclictest19982-21systemd-journal08:46:121
22699973,1cyclictest0-21swapper/112:04:211
22699973,1cyclictest0-21swapper/111:34:291
22699972,3cyclictest4459-21perf07:15:021
22699972,3cyclictest4459-21perf07:15:011
22699972,3cyclictest19982-21systemd-journal10:21:201
22699972,3cyclictest19982-21systemd-journal09:30:011
22779966,0cyclictest0-21swapper/308:40:203
22779963,2cyclictest6952-21grep08:30:143
22779963,2cyclictest5856-21sendmail_mailst09:20:173
22779963,2cyclictest30654-21snmpd10:55:113
22779963,2cyclictest30654-21snmpd08:10:273
22779963,1cyclictest0-21swapper/312:37:423
22779963,1cyclictest0-21swapper/311:26:173
22779962,3cyclictest7661-21lldpd11:35:303
22779962,3cyclictest7661-21lldpd08:48:093
22779962,3cyclictest7650-21cut10:40:163
22779962,3cyclictest6522-21systemctl07:15:203
22779962,3cyclictest6001-21seq08:26:513
22779962,3cyclictest508-21dbus-daemon07:55:003
22779962,3cyclictest5028-21sed11:05:173
22779962,3cyclictest5028-21sed11:05:163
22779962,3cyclictest32129-21cat12:15:203
22779962,3cyclictest30654-21snmpd09:45:053
22779962,3cyclictest30654-21snmpd09:25:313
22779962,3cyclictest30654-21snmpd08:08:243
22779962,3cyclictest30654-21snmpd07:35:583
22779962,3cyclictest29591-21cat09:40:193
22779962,3cyclictest2614-21head10:10:143
22779962,3cyclictest23303-21sed11:45:213
22779962,3cyclictest0-21swapper/311:10:403
22779962,1cyclictest0-21swapper/312:00:203
22779962,1cyclictest0-21swapper/310:05:413
22779961,3cyclictest19982-21systemd-journal12:05:203
22779961,3cyclictest19982-21systemd-journal07:10:153
22779961,3cyclictest19982-21systemd-journal07:10:153
22779961,2cyclictest23415-21ssh12:10:093
22779961,2cyclictest18321-21ssh11:41:053
22779960,6cyclictest0-21swapper/310:27:033
22779960,6cyclictest0-21swapper/309:12:143
22779960,3cyclictest28138-21awk10:30:203
22779960,3cyclictest1126-21ls08:15:223
22779960,3cyclictest10585-21rm10:16:013
22779960,2cyclictest15817-21expr08:50:133
22779960,0cyclictest0-21swapper/309:05:083
22779960,0cyclictest0-21swapper/307:23:233
22729965,1cyclictest28-21ksoftirqd/209:00:002
22729964,1cyclictest28641-21unixbench_multi10:30:222
22729963,2cyclictest668-21runrttasks12:00:062
22729963,2cyclictest5237-21grep08:25:162
22729963,2cyclictest3364-21grep07:10:182
22729963,2cyclictest3364-21grep07:10:182
22729963,2cyclictest30654-21snmpd11:05:532
22729963,2cyclictest30654-21snmpd11:05:532
22729963,2cyclictest23502-21sh11:45:282
22729963,2cyclictest1-21systemd08:45:222
22729963,2cyclictest12033-21sh09:25:192
22729963,1cyclictest0-21swapper/209:18:502
22729962,3cyclictest31779-21seq08:12:502
22729962,3cyclictest3109-21cut10:10:172
22729962,3cyclictest30654-21snmpd10:17:152
22729962,3cyclictest30654-21snmpd09:50:042
22729962,3cyclictest30654-21snmpd09:46:272
22729962,3cyclictest30654-21snmpd08:33:062
22729962,3cyclictest30654-21snmpd07:48:562
22729962,3cyclictest30654-21snmpd07:32:402
22729962,3cyclictest26022-21fschecks_time08:00:152
22729962,3cyclictest22871-21df_inode09:05:162
22729962,3cyclictest21898-21sed07:50:182
22729962,3cyclictest21386-21basename10:25:142
22729962,3cyclictest14542-21expr07:35:132
22729962,3cyclictest12160-21unixbench_multi11:10:182
22729962,3cyclictest10895-21cut07:25:152
22729962,3cyclictest0-21swapper/210:35:582
22729962,3cyclictest0-21swapper/209:36:152
22729962,3cyclictest0-21swapper/209:11:562
22729962,2cyclictest19982-21systemd-journal11:20:022
22729962,1cyclictest0-21swapper/211:56:402
22729962,1cyclictest0-21swapper/211:41:032
22729962,1cyclictest0-21swapper/211:30:092
22729962,1cyclictest0-21swapper/211:01:212
22729960,6cyclictest0-21swapper/212:18:332
22729960,5cyclictest7156-21/usr/sbin/munin10:40:222
22729960,4cyclictest19982-21systemd-journal12:20:372
22729960,3cyclictest24659-21rm10:01:522
22729960,0cyclictest0-21swapper/210:21:532
22699966,0cyclictest0-21swapper/110:08:251
22699964,2cyclictest11736-21in:imuxsock11:08:021
22699964,2cyclictest11736-21in:imuxsock11:08:021
22699964,1cyclictest16166-21irqstats08:50:151
22699963,2cyclictest9453-21cat08:35:161
22699963,2cyclictest668-21runrttasks10:15:471
22699963,2cyclictest30654-21snmpd09:30:381
22699963,2cyclictest30654-21snmpd07:39:211
22699963,2cyclictest3026-21ntp_offset08:20:181
22699963,2cyclictest27789-21apt-get08:05:091
22699963,2cyclictest23133-21ssh10:52:261
22699963,2cyclictest22635-21ntp_kernel_pll_10:00:161
22699963,2cyclictest16999-1kworker/u9:209:15:191
22699963,2cyclictest0-21swapper/108:42:231
22699963,1cyclictest19982-21systemd-journal07:54:031
22699962,3cyclictest7661-21lldpd07:49:541
22699962,3cyclictest5717-21cat08:25:201
22699962,3cyclictest5662-21cstates12:20:141
22699962,3cyclictest5620-21expr07:15:131
22699962,3cyclictest3396-21expr10:10:181
22699962,3cyclictest32185-21cat11:00:171
22699962,3cyclictest30654-21snmpd09:40:451
22699962,3cyclictest30129-21expr11:25:131
22699962,3cyclictest25544-21cat09:10:121
22699962,3cyclictest21791-21unixbench_singl09:00:191
22699962,3cyclictest19982-21systemd-journal07:40:211
22699962,3cyclictest19677-21apt-get09:00:001
22699962,3cyclictest1-21systemd11:24:441
22699962,2cyclictest19982-21systemd-journal08:10:181
22699962,1cyclictest141rcu_preempt11:35:111
22699962,1cyclictest0-21swapper/112:32:301
22699962,1cyclictest0-21swapper/111:45:361
22699962,1cyclictest0-21swapper/110:55:101
22699962,1cyclictest0-21swapper/110:48:571
22699962,1cyclictest0-21swapper/110:40:131
22699962,1cyclictest0-21swapper/110:25:361
22699962,1cyclictest0-21swapper/109:50:521
22699961,3cyclictest7661-21lldpd07:20:371
22699961,3cyclictest19982-21systemd-journal09:07:281
22699961,3cyclictest19982-21systemd-journal07:26:051
22699961,2cyclictest4570-21ssh09:45:581
22699961,2cyclictest30616-21ssh12:36:281
22699960,6cyclictest0-21swapper/111:50:031
22699960,6cyclictest0-21swapper/109:35:201
22699960,5cyclictest31253-21sed12:15:151
22699960,4cyclictest19982-21systemd-journal10:35:061
22699960,3cyclictest9960-21munin-run09:25:011
22779952,2cyclictest2290-21cstates08:20:143
22779952,2cyclictest20691-21uniq09:00:143
22779952,2cyclictest17290-21cat07:40:183
22779952,2cyclictest12072-21cpu07:30:113
22779951,3cyclictest9892-21cat07:25:103
22779951,3cyclictest30654-21snmpd08:35:093
22729952,2cyclictest5022-21hwlatdetect07:15:012
22729952,2cyclictest19347-21rm10:50:072
22729952,2cyclictest16730-21cat07:40:152
22729950,3cyclictest19982-21systemd-journal10:55:072
22699951,3cyclictest25835-21expr08:00:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional