You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 21:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Mon Nov 24, 2025 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16552324292,20sleep20-21swapper/207:09:422
16112266230,22sleep00-21swapper/007:09:080
16042263229,21sleep30-21swapper/307:09:033
13802260226,22sleep10-21swapper/107:06:081
228752630,0sleep10-21swapper/110:30:461
176412620,0sleep00-21swapper/010:54:070
165012580,1sleep216498-21perf07:40:012
96692560,0sleep10-21swapper/112:06:481
6572560,0sleep20-21swapper/208:15:162
40372560,0sleep00-21swapper/009:20:120
288852540,0sleep20-21swapper/208:05:192
319632530,0sleep20-21swapper/210:39:322
131542530,0sleep30-21swapper/312:35:173
141432440,0sleep20-21swapper/211:18:242
33342180,0sleep20-21swapper/212:27:272
38952170,0sleep30-21swapper/309:20:113
54382140,0sleep30-21swapper/309:49:403
213872130,1sleep20-21swapper/212:15:262
6798290,0sleep00-21swapper/011:38:480
31516290,0sleep20-21swapper/209:44:182
20445290,1sleep20-21swapper/210:01:442
17939994,3cyclictest19982-21systemd-journal11:25:352
17939993,5cyclictest7053-21df_inode08:30:132
17939993,3cyclictest14057-21munin-run10:25:012
17919995,3cyclictest11661-21sh12:34:501
8892280,0sleep10-21swapper/109:24:341
17979983,3cyclictest19982-21systemd-journal12:21:293
17979983,3cyclictest19982-21systemd-journal11:29:453
17979983,3cyclictest19982-21systemd-journal10:00:013
17979983,3cyclictest19982-21systemd-journal08:55:353
17939985,2cyclictest30654-21snmpd09:57:312
17939984,2cyclictest19982-21systemd-journal12:05:132
17939983,3cyclictest19982-21systemd-journal08:28:412
17919987,1cyclictest22-21ksoftirqd/107:45:011
17919987,1cyclictest22-21ksoftirqd/107:20:001
17919984,3cyclictest19982-21systemd-journal11:21:031
17919983,3cyclictest7661-21lldpd08:50:101
17919983,3cyclictest19982-21systemd-journal12:38:101
17919983,3cyclictest19982-21systemd-journal08:05:191
17869983,4cyclictest19982-21systemd-journal09:33:460
17869983,3cyclictest19982-21systemd-journal07:26:310
25245270,0sleep00-21swapper/009:38:310
22946270,0sleep20-21swapper/210:58:102
17979976,1cyclictest34-21ksoftirqd/311:20:003
17979974,2cyclictest19223-21dump-pmu-power12:15:003
17979974,2cyclictest11736-21in:imuxsock11:15:003
17979973,3cyclictest30654-21snmpd09:50:523
17979973,3cyclictest27782-21grep09:40:163
17979973,3cyclictest1569-21sshd08:15:423
17979973,2cyclictest19982-21systemd-journal10:41:473
17979973,2cyclictest19982-21systemd-journal07:39:273
17979972,3cyclictest19982-21systemd-journal12:01:203
17979972,3cyclictest19982-21systemd-journal11:22:143
17979972,3cyclictest19982-21systemd-journal10:20:553
17979972,3cyclictest19982-21systemd-journal07:19:263
17979971,4cyclictest19982-21systemd-journal11:03:533
17979970,3cyclictest24419-21sshd07:55:183
17939974,2cyclictest502-21systemd-logind11:00:332
17939974,2cyclictest11736-21in:imuxsock08:00:012
17939973,3cyclictest508-21dbus-daemon11:23:552
17939973,3cyclictest508-21dbus-daemon07:20:002
17939973,3cyclictest30654-21snmpd11:30:582
17939973,3cyclictest19982-21systemd-journal09:25:202
17939973,3cyclictest1-21systemd07:15:002
17939973,3cyclictest0-21swapper/210:43:082
17939973,2cyclictest19982-21systemd-journal11:05:332
17939973,1cyclictest0-21swapper/212:36:342
17939973,1cyclictest0-21swapper/210:16:062
17939972,3cyclictest23196-21perf07:55:012
17939972,3cyclictest19982-21systemd-journal08:50:012
17939972,3cyclictest19982-21systemd-journal08:15:012
17939972,3cyclictest19982-21systemd-journal07:41:572
17939970,2cyclictest502-21systemd-logind10:33:012
17919974,2cyclictest22-21ksoftirqd/107:45:121
17919973,3cyclictest508-21dbus-daemon10:25:011
17919973,3cyclictest29741-11brltty09:16:391
17919973,3cyclictest24615-21smart_sda10:05:211
17919972,3cyclictest7661-21lldpd12:25:011
17919972,1cyclictest141rcu_preempt08:05:011
17919971,2cyclictest19982-21systemd-journal11:28:551
17919970,4cyclictest31762-21avahi-daemon11:20:001
17919970,3cyclictest31926-21cron12:00:001
17869975,1cyclictest12-21ksoftirqd/007:15:010
17869974,2cyclictest508-21dbus-daemon11:53:080
17869973,3cyclictest9929-21sed08:35:180
17869973,3cyclictest30826-21cat08:10:140
17869973,3cyclictest29741-11brltty10:21:450
17869973,3cyclictest19982-21systemd-journal12:31:060
17869973,3cyclictest19982-21systemd-journal09:45:480
17869973,3cyclictest19982-21systemd-journal08:24:310
17869973,3cyclictest14492-21memory11:45:170
17869973,3cyclictest0-21swapper/012:05:070
17869973,3cyclictest0-21swapper/010:26:420
17869973,3cyclictest0-21swapper/009:59:550
17869973,2cyclictest19982-21systemd-journal07:47:480
17869973,1cyclictest0-21swapper/010:12:020
17869972,4cyclictest19557-21basename10:55:140
17869972,3cyclictest19982-21systemd-journal10:48:020
17869972,3cyclictest19982-21systemd-journal07:50:160
17979966,0cyclictest0-21swapper/309:27:373
17979964,1cyclictest0-21swapper/311:36:023
17979963,2cyclictest9745-21cat07:25:143
17979963,2cyclictest5867-21sh12:30:063
17979963,2cyclictest508-21dbus-daemon09:30:003
17979963,2cyclictest4721-21ssh10:15:263
17979963,2cyclictest30929-21users10:10:233
17979963,2cyclictest30654-21snmpd10:50:213
17979963,2cyclictest30654-21snmpd10:26:413
17979963,2cyclictest29872-21ssh11:57:373
17979963,2cyclictest27054-21chrt10:35:043
17979963,2cyclictest26787-21ssh09:10:293
17979963,2cyclictest22720-21unixbench-2d09:35:213
17979963,2cyclictest19982-21systemd-journal11:50:113
17979963,2cyclictest19982-21systemd-journal08:03:143
17979963,2cyclictest19347-21vmstat10:00:223
17979963,2cyclictest18688-21sh10:55:013
17979963,2cyclictest16114-21sh11:46:193
17979962,3cyclictest9116-21cat11:40:153
17979962,3cyclictest7578-21ntpq12:05:163
17979962,3cyclictest30654-21snmpd08:52:503
17979962,3cyclictest30654-21snmpd08:45:353
17979962,3cyclictest27926-21apt08:05:133
17979962,3cyclictest22649-21seq12:16:403
17979962,3cyclictest19982-21systemd-journal10:31:013
17979962,3cyclictest17426-21if_err_enp4s007:40:163
17979962,3cyclictest11473-21expr08:40:163
17979962,1cyclictest0-21swapper/310:48:113
17979961,4cyclictest0-21swapper/311:05:013
17979961,3cyclictest19982-21systemd-journal09:06:393
17979960,6cyclictest0-21swapper/308:30:153
17979960,6cyclictest0-21swapper/308:20:013
17979960,5cyclictest32662-21expr12:25:133
17979960,4cyclictest19982-21systemd-journal07:20:243
17979960,3cyclictest32524-21ssh09:15:253
17979960,0cyclictest0-21swapper/310:05:103
17979960,0cyclictest0-21swapper/309:00:403
17939963,2cyclictest8858-21chrt07:20:192
17939963,2cyclictest668-21runrttasks10:25:572
17939963,2cyclictest32508-21cpuspeed_turbos12:00:112
17939963,2cyclictest30654-21snmpd07:45:482
17939963,2cyclictest28-21ksoftirqd/212:10:102
17939963,2cyclictest26088-21sh10:06:442
17939963,2cyclictest23452-21cat09:05:172
17939963,2cyclictest17233-21ssh09:30:462
17939963,2cyclictest15118-21sshd10:51:002
17939963,1cyclictest0-21swapper/209:45:362
17939962,3cyclictest508-21dbus-daemon12:30:392
17939962,3cyclictest4295-21cat09:20:132
17939962,3cyclictest3630-21date08:20:212
17939962,3cyclictest30654-21snmpd11:50:252
17939962,3cyclictest26710-21cat11:55:162
17939962,3cyclictest25690-21apt-get08:00:122
17939962,3cyclictest25061-21cat09:10:132
17939962,3cyclictest21589-21df_inode09:35:142
17939962,3cyclictest18520-21df_inode08:55:132
17939962,3cyclictest1-21systemd11:46:012
17939962,1cyclictest0-21swapper/212:20:162
17939962,1cyclictest0-21swapper/210:45:512
17939962,1cyclictest0-21swapper/209:16:312
17939961,3cyclictest19982-21systemd-journal11:37:412
17939960,6cyclictest0-21swapper/210:11:082
17939960,0cyclictest0-21swapper/211:41:422
17919966,0cyclictest0-21swapper/111:30:071
17919963,2cyclictest977-21tail10:40:151
17919963,2cyclictest8674-21sshd10:45:491
17919963,2cyclictest7986-21ssh09:50:331
17919963,2cyclictest5872-21cat11:10:171
17919963,2cyclictest5827-21ssh12:04:421
17919963,2cyclictest3173-21sh08:20:191
17919963,2cyclictest27366-21cut10:35:141
17919963,2cyclictest21761-21ssh12:15:501
17919963,2cyclictest19982-21systemd-journal11:50:201
17919963,2cyclictest19982-21systemd-journal10:11:191
17919963,2cyclictest19982-21systemd-journal08:25:461
17919963,2cyclictest13486-21cat10:50:151
17919963,2cyclictest11736-21in:imuxsock09:09:591
17919963,2cyclictest11538-21df_inode08:40:161
17919962,4cyclictest0-21swapper/108:10:371
17919962,3cyclictest508-21dbus-daemon08:35:011
17919962,3cyclictest32710-21sort09:45:151
17919962,3cyclictest30654-21snmpd11:06:181
17919962,3cyclictest30654-21snmpd08:35:261
17919962,3cyclictest22719-21awk07:50:211
17919962,3cyclictest20386-21apt09:00:111
17919962,3cyclictest19982-21systemd-journal07:25:121
17919962,3cyclictest18924-21expr08:55:151
17919962,3cyclictest15155-21cat10:25:151
17919962,3cyclictest14491-21cut11:45:171
17919962,3cyclictest13833-21cat12:10:181
17919962,3cyclictest10312-21cat09:25:171
17919962,3cyclictest0-21swapper/112:20:491
17919962,3cyclictest0-21swapper/109:39:551
17919962,1cyclictest0-21swapper/111:40:051
17919962,1cyclictest0-21swapper/111:37:311
17919962,1cyclictest0-21swapper/110:55:321
17919962,1cyclictest0-21swapper/110:15:321
17919962,1cyclictest0-21swapper/109:57:361
17919962,1cyclictest0-21swapper/109:32:251
17919962,1cyclictest0-21swapper/109:13:591
17919961,3cyclictest19982-21systemd-journal09:43:221
17869966,0cyclictest0-21swapper/010:35:120
17869965,1cyclictest12-21ksoftirqd/007:15:010
17869963,2cyclictest6078-21rm09:50:060
17869963,2cyclictest32110-21expr11:05:160
17869963,2cyclictest27620-21fschecks_count09:40:150
17869963,2cyclictest26760-21fschecks_count12:20:130
17869963,2cyclictest19982-21systemd-journal07:35:130
17869963,2cyclictest13635-21packagekitd08:45:020
17869963,2cyclictest12-21ksoftirqd/012:00:100
17869963,2cyclictest1-21systemd11:20:010
17869963,2cyclictest12029-21ssh11:15:450
17869963,2cyclictest11736-21in:imuxsock11:26:060
17869963,2cyclictest1127-21awk08:15:190
17869963,2cyclictest0-21swapper/012:13:510
17869963,2cyclictest0-21swapper/010:05:210
17869963,1cyclictest0-21swapper/010:30:200
17869962,3cyclictest614-21cat12:25:150
17869962,3cyclictest30654-21snmpd11:56:440
17869962,3cyclictest30654-21snmpd08:40:320
17869962,3cyclictest30654-21snmpd08:30:520
17869962,3cyclictest30654-21snmpd08:28:400
17869962,3cyclictest30654-21snmpd08:01:070
17869962,3cyclictest29988-21mailstats11:30:190
17869962,3cyclictest25674-21cat11:00:160
17869962,3cyclictest19982-21systemd-journal07:30:110
17869962,3cyclictest15889-21acpi08:50:100
17869962,3cyclictest0-21swapper/010:15:130
17869962,3cyclictest0-21swapper/009:10:190
17869962,2cyclictest19982-21systemd-journal11:13:290
17869962,1cyclictest0-21swapper/010:00:140
17869961,4cyclictest0-21swapper/008:05:210
17869961,3cyclictest502-21systemd-logind10:40:060
17869961,3cyclictest19982-21systemd-journal07:56:090
17869960,6cyclictest0-21swapper/012:15:530
17869960,5cyclictest9610-21tr09:25:140
17869960,3cyclictest8279-21rm11:40:050
17869960,3cyclictest378-21rm09:15:550
17869960,2cyclictest16737-21/usr/sbin/munin07:40:200
17869960,2cyclictest131582sed12:35:170
17979952,2cyclictest5086-21if_enp4s008:25:163
17979952,2cyclictest30485-21expr08:10:123
17979952,2cyclictest21588-21df07:50:133
17979952,2cyclictest2065-21cpu07:10:133
17979952,2cyclictest18963-21sort07:45:113
17979951,3cyclictest12247-21/usr/sbin/munin07:30:123
17979951,2cyclictest19982-21systemd-journal11:30:003
17979950,4cyclictest8892-21find08:35:123
17939952,2cyclictest9865-21cat07:25:142
17939952,2cyclictest20796-21fschecks_count09:00:132
17939952,2cyclictest12475-21expr07:30:152
17939952,2cyclictest11160-21grep08:40:152
17939951,3cyclictest9215-21cat08:35:132
17939951,3cyclictest4969-21runrttasks11:10:022
17939951,2cyclictest19982-21systemd-journal09:50:032
17939951,2cyclictest19982-21systemd-journal08:45:022
17919952,2cyclictest784-21cat08:15:171
17919952,2cyclictest24812-21ssh11:00:041
17919952,2cyclictest23644-21cat07:55:131
17919952,2cyclictest17496-21ssh10:00:031
17919952,2cyclictest13374-21find08:45:021
17919951,3cyclictest508-21dbus-daemon07:30:011
17919951,3cyclictest30654-21snmpd07:20:391
17919951,3cyclictest2636-21grep07:10:151
17919951,2cyclictest19982-21systemd-journal07:35:101
17869953,1cyclictest7535-21cpuspeed_turbos07:20:110
17869952,2cyclictest30654-21snmpd09:05:440
17869952,2cyclictest18338-21cat08:55:120
17869951,3cyclictest21063-21cat09:00:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional