You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-26 - 01:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Sun Oct 26, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2123321010,0sleep30-21swapper/321:14:183
255522970,2sleep02550399cyclictest21:59:140
215322850,0sleep10-21swapper/121:14:201
233522670,0sleep00-21swapper/023:05:500
69032660,0sleep30-21swapper/300:35:493
42762630,0sleep10-21swapper/122:47:571
241202620,0sleep20-21swapper/200:26:552
240922620,0sleep30-21swapper/323:09:143
199352620,0sleep10-21swapper/123:37:401
105552610,1sleep3620-13audispd21:19:403
92082580,0sleep10-21swapper/122:42:001
288352580,0sleep00-21swapper/021:15:040
7652550,0sleep30-21swapper/322:28:283
148032550,0sleep00-21swapper/021:32:430
276082540,0sleep30-21swapper/300:10:303
260212540,0sleep10-21swapper/123:44:451
61052530,1sleep36101-21sshd23:49:113
61482520,1sleep16133-21sshd21:44:411
38282520,0sleep13823-21sshd22:00:151
219722520,1sleep30-21swapper/300:30:173
302732510,0sleep10-21swapper/100:38:231
221182510,0sleep00-21swapper/022:30:300
325012500,1sleep232500-21pmu-power23:45:182
19862490,0sleep10-21swapper/100:04:551
101682480,2sleep32552099cyclictest00:18:433
327532470,0sleep10-21swapper/122:31:351
160912460,0sleep30-21swapper/322:58:453
186612450,2sleep02550399cyclictest21:20:210
29532440,1sleep3401ktimersoftd/323:10:183
48762420,1sleep14875-21sshd23:13:451
241522410,1sleep224154-21bash23:28:282
195702350,0sleep10-21swapper/121:49:101
137612350,0sleep02550399cyclictest22:55:170
327432340,0sleep20-21swapper/222:50:422
321382320,0sleep10-21swapper/122:57:071
183232310,1sleep318320-21bash21:39:303
251472308,7sleep30-21swapper/319:06:423
252612287,7sleep20-21swapper/219:08:062
2539222615,7sleep00-21swapper/019:09:450
236162219,7sleep10-21swapper/119:05:051
296922190,0sleep20-21swapper/223:19:272
85892180,1sleep28562-21sshd22:25:592
21162180,0sleep30-21swapper/321:28:173
93102170,1sleep19308-21cut00:25:181
145992170,0sleep20-21swapper/221:23:112
98232160,0sleep00-21swapper/023:59:140
56862160,0sleep10-21swapper/100:05:151
313572160,0sleep20-21swapper/200:14:142
216862160,0sleep20-21swapper/200:33:562
99072150,1sleep341-21ksoftirqd/322:19:523
25516991513,1cyclictest684-21polkitd23:36:002
2551699150,0cyclictest26964-21lspci23:22:192
80882140,0sleep00-21swapper/023:30:060
2552099130,1cyclictest9415-21sshd00:02:233
25516991312,0cyclictest9890-21lspci21:25:492
25516991311,1cyclictest28279-21lspci00:17:122
2551699130,11cyclictest27770-21bash23:31:592
203292130,0sleep10-21swapper/121:36:271
185402130,0sleep10-21swapper/100:33:351
2552099120,11cyclictest1130-21sshd23:42:123
25516991211,0cyclictest29888-21lspci21:15:112
25516991211,0cyclictest24491-21lspci21:33:442
25516991211,0cyclictest0-21swapper/222:04:082
25516991210,1cyclictest26670-21id23:12:392
25516991210,1cyclictest14690-21lspci21:51:492
2551699120,1cyclictest19668-21sshd21:10:082
2551699120,11cyclictest0-21swapper/222:14:592
25509991210,1cyclictest18654-21sshd23:47:091
2550999120,1cyclictest2500-21grep21:53:491
2550999120,11cyclictest28826-21lspci23:54:401
2550999120,11cyclictest0-21swapper/123:26:001
2550999120,11cyclictest0-21swapper/121:29:591
25503991211,0cyclictest0-21swapper/022:51:180
2550399120,11cyclictest16137-21sshd00:12:370
2550399120,11cyclictest0-21swapper/023:38:380
217882120,0sleep20-21swapper/223:57:062
117542120,0sleep10-21swapper/121:32:241
316092110,5sleep30-21swapper/322:53:553
2552099119,1cyclictest75550irq/24-eno1-rx-23:53:433
2552099119,1cyclictest12827-21sshd21:07:423
25520991110,0cyclictest0-21swapper/321:34:223
2552099110,10cyclictest0-21swapper/322:09:423
2551699119,1cyclictest10446-21sshd23:04:392
25516991110,0cyclictest8057-21sshd22:06:592
25516991110,0cyclictest12853-21lspci21:57:582
25516991110,0cyclictest0-21swapper/200:21:292
2551699110,10cyclictest29924-21sshd23:09:482
2551699110,10cyclictest0-21swapper/222:45:192
2551699110,10cyclictest0-21swapper/222:40:492
2551699110,0cyclictest0-21swapper/220:00:192
25509991110,0cyclictest0-21swapper/122:36:001
2550999110,0cyclictest0-21swapper/100:10:491
2550399119,1cyclictest618-13audispd00:02:480
25503991110,0cyclictest25361-21sshd00:23:380
2550399110,10cyclictest0-21swapper/023:26:380
2550399110,10cyclictest0-21swapper/022:48:280
2550399110,0cyclictest0-21swapper/023:02:080
2550399110,0cyclictest0-21swapper/021:14:580
2552099109,0cyclictest0-21swapper/323:29:023
2552099109,0cyclictest0-21swapper/323:22:123
2552099109,0cyclictest0-21swapper/322:45:123
2552099100,0cyclictest0-21swapper/321:55:523
2551699109,0cyclictest28238-21lspci22:34:222
2551699109,0cyclictest0-21swapper/223:51:302
2551699109,0cyclictest0-21swapper/221:48:492
2551699109,0cyclictest0-21swapper/220:55:192
2551699108,1cyclictest33-21ksoftirqd/221:40:372
2551699100,0cyclictest0-21swapper/222:36:192
2551699100,0cyclictest0-21swapper/200:06:302
2550999109,0cyclictest25842-21sshd22:05:301
2550999109,0cyclictest0-21swapper/123:09:291
2550999109,0cyclictest0-21swapper/120:20:201
2550999108,1cyclictest0-21swapper/100:18:201
2550399109,0cyclictest0-21swapper/023:42:380
2550399109,0cyclictest0-21swapper/022:36:380
2550399109,0cyclictest0-21swapper/022:20:280
2550399109,0cyclictest0-21swapper/021:40:080
2550399108,1cyclictest943-21sshd21:47:180
2550399108,1cyclictest24829-21sshd23:47:470
2550399108,1cyclictest17125-21sshd22:42:470
2550399108,1cyclictest0-21swapper/021:50:170
25503991010,0cyclictest0-21swapper/022:15:170
2550399100,0cyclictest0-21swapper/022:07:180
2550399100,0cyclictest0-21swapper/021:09:480
255209998,0cyclictest0-21swapper/323:33:013
255209998,0cyclictest0-21swapper/323:15:213
255209998,0cyclictest0-21swapper/320:25:223
255209998,0cyclictest0-21swapper/319:25:223
255209998,0cyclictest0-21swapper/319:13:223
255209998,0cyclictest0-21swapper/300:28:233
255209997,1cyclictest0-21swapper/323:37:033
255169998,0cyclictest9295-21lspci22:16:352
255169998,0cyclictest24896-21lspci22:56:232
255169997,1cyclictest33-21ksoftirqd/221:39:592
255169997,1cyclictest24970-21lspci00:37:492
255099998,0cyclictest0-21swapper/122:17:291
255099998,0cyclictest0-21swapper/121:59:501
255099998,0cyclictest0-21swapper/120:40:201
255099998,0cyclictest0-21swapper/120:40:201
255039998,0cyclictest0-21swapper/020:33:280
255039998,0cyclictest0-21swapper/019:58:280
255039990,5cyclictest30751-21munin-run00:35:000
8388280,1sleep0111rcuc/000:15:120
255209987,0cyclictest8282-21sshd21:48:013
255209987,0cyclictest0-21swapper/322:24:023
255209987,0cyclictest0-21swapper/322:12:323
255209987,0cyclictest0-21swapper/321:51:023
255209987,0cyclictest0-21swapper/320:45:223
255209985,2cyclictest649-21avahi-daemon23:59:193
255169983,3cyclictest616-13auditd23:41:372
255169982,2cyclictest27166-21sshd22:24:442
255099987,0cyclictest0-21swapper/123:32:491
255099987,0cyclictest0-21swapper/123:21:591
255099986,1cyclictest32248-21grep22:50:401
255099986,1cyclictest22353-21lspci23:15:241
255099985,2cyclictest649-21avahi-daemon23:57:381
255099985,2cyclictest649-21avahi-daemon23:03:541
255099984,3cyclictest649-21avahi-daemon22:21:421
255039987,0cyclictest0-21swapper/023:22:370
255039987,0cyclictest0-21swapper/022:14:080
255039987,0cyclictest0-21swapper/020:19:280
255039986,1cyclictest28554-21lspci00:38:120
255039985,2cyclictest700-21gdbus00:07:020
255039985,2cyclictest649-21avahi-daemon23:51:530
255039985,2cyclictest649-21avahi-daemon23:18:520
255039985,2cyclictest649-21avahi-daemon22:03:450
255039985,2cyclictest649-21avahi-daemon21:38:550
969270,0sleep10-21swapper/120:45:171
255209976,0cyclictest0-21swapper/323:00:323
255209975,1cyclictest649-21avahi-daemon21:40:403
255209975,1cyclictest5106-21sshd21:22:143
255209975,1cyclictest22462-21lspci00:06:523
255209975,1cyclictest0-21swapper/322:42:223
255209974,2cyclictest649-21avahi-daemon22:36:443
255209974,2cyclictest649-21avahi-daemon22:01:543
255209974,2cyclictest19124-21grep22:30:183
255209974,2cyclictest17136-21sshd00:22:443
255169975,1cyclictest9129-21lspci00:02:202
255099976,1cyclictest18351-21lspci21:23:331
255099976,0cyclictest0-21swapper/121:17:101
255099976,0cyclictest0-21swapper/121:08:001
255099975,1cyclictest646-21dbus-daemon00:21:521
255099975,1cyclictest21932-21lspci22:11:301
255099974,2cyclictest649-21avahi-daemon22:27:531
255039976,0cyclictest0-21swapper/023:10:080
255039976,0cyclictest0-21swapper/020:50:180
255039974,2cyclictest4908-21sshd22:28:550
255039971,2cyclictest22140-21sshd21:27:020
255209963,2cyclictest646-21dbus-daemon20:55:013
255209963,2cyclictest17299-21snmpd20:55:593
255169965,0cyclictest0-21swapper/220:12:282
255169964,1cyclictest33-21ksoftirqd/220:20:002
255169964,1cyclictest10499-21sshd21:06:442
255169960,5cyclictest0-21swapper/220:49:582
255169960,5cyclictest0-21swapper/219:42:192
255169960,5cyclictest0-21swapper/219:30:392
255099963,2cyclictest17299-21snmpd19:29:091
255099963,2cyclictest17299-21snmpd19:11:181
255039965,0cyclictest0-21swapper/020:56:480
255039964,1cyclictest24876-21mii-tool20:25:170
255039964,1cyclictest10813-21sshd00:25:230
255039960,5cyclictest0-21swapper/020:08:380
255039960,5cyclictest0-21swapper/019:14:370
255209954,0cyclictest0-21swapper/320:22:113
255209954,0cyclictest0-21swapper/319:42:423
255209953,1cyclictest30773-21cat19:20:153
255209953,1cyclictest29337-21ntp_states20:35:173
255209953,1cyclictest21477-21threads20:15:213
255209953,1cyclictest17299-21snmpd21:00:093
255209953,1cyclictest17299-21snmpd20:30:323
255209953,1cyclictest17299-21snmpd20:10:393
255209953,1cyclictest17299-21snmpd19:46:183
255209953,1cyclictest17299-21snmpd19:30:083
255209953,1cyclictest11957-21latency_hist19:54:593
255209952,1cyclictest31569-21sshd20:40:213
255209952,1cyclictest31569-21sshd20:40:213
255209950,4cyclictest0-21swapper/319:52:123
255209950,4cyclictest0-21swapper/319:16:523
255209950,2cyclictest4338-21diskstats19:35:133
255169953,1cyclictest27645-21munin-node19:49:382
255169953,1cyclictest25701-21/usr/sbin/munin19:10:202
255169953,1cyclictest17299-21snmpd20:40:142
255169953,1cyclictest17299-21snmpd20:40:142
255169953,1cyclictest17299-21snmpd20:34:082
255169953,1cyclictest17299-21snmpd20:26:502
255169953,1cyclictest17299-21snmpd20:20:202
255169953,1cyclictest17299-21snmpd19:29:272
255169953,1cyclictest17299-21snmpd19:21:292
255169953,1cyclictest1109-21ntpd20:50:182
255169953,1cyclictest1109-21ntpd20:35:172
255169952,2cyclictest17299-21snmpd21:00:332
255169950,4cyclictest0-21swapper/219:55:222
255169950,1cyclictest4065-21/usr/sbin/munin19:35:162
255169950,1cyclictest16263-21/usr/sbin/munin20:05:202
255169950,1cyclictest10163-21/usr/sbin/munin19:50:232
255169950,0cyclictest0-21swapper/219:19:092
255099953,1cyclictest649-21avahi-daemon21:01:181
255099953,1cyclictest620-13audispd20:16:171
255099953,1cyclictest30794-21mii-tool19:20:141
255099953,1cyclictest17299-21snmpd20:56:391
255099953,1cyclictest17299-21snmpd20:51:291
255099953,1cyclictest17299-21snmpd20:35:171
255099953,1cyclictest17299-21snmpd20:27:251
255099953,1cyclictest17299-21snmpd20:07:581
255099953,1cyclictest17299-21snmpd20:01:061
255099953,1cyclictest17299-21snmpd19:56:011
255099953,1cyclictest17299-21snmpd19:35:081
255099953,1cyclictest17299-21snmpd19:30:481
255099953,1cyclictest17299-21snmpd19:15:241
255099952,2cyclictest17299-21snmpd20:10:061
255099952,2cyclictest17299-21snmpd19:50:041
255099952,2cyclictest17299-21snmpd19:44:191
255099950,4cyclictest0-21swapper/119:46:091
255039953,1cyclictest821-21ntp_states19:25:180
255039953,1cyclictest30320-21/usr/sbin/munin19:20:120
255039953,1cyclictest18757-21cat20:10:170
255039953,1cyclictest17299-21snmpd20:42:350
255039953,1cyclictest17299-21snmpd20:42:340
255039953,1cyclictest17299-21snmpd20:35:140
255039953,1cyclictest17299-21snmpd20:24:050
255039953,1cyclictest17299-21snmpd20:01:120
255039953,1cyclictest17299-21snmpd19:45:250
255039953,1cyclictest17299-21snmpd19:41:270
255039953,1cyclictest17299-21snmpd19:35:470
255039953,1cyclictest17299-21snmpd19:16:210
255039953,1cyclictest1053-21lldpd20:49:150
255039952,2cyclictest700-21gdbus21:00:590
255209942,1cyclictest16353-21cut20:05:123
255209942,1cyclictest0-21swapper/320:00:143
255099942,1cyclictest26612-21expr20:30:151
255039942,1cyclictest2756-21nfsd419:30:180
255039942,1cyclictest11183-21gzip19:50:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional