You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-30 - 15:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack2slot0.osadl.org (updated Sat Aug 30, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1229221140,0sleep112291-21grep10:53:301
95102930,0sleep10-21swapper/109:21:501
217212790,1sleep2321ktimersoftd/211:16:142
90422580,0sleep30-21swapper/310:31:493
96382550,0sleep30-21swapper/311:21:523
19062550,0sleep10-21swapper/112:31:511
31742540,1sleep13170-21lspci09:17:331
97502530,0sleep00-21swapper/010:45:560
222622530,0sleep10-21swapper/111:30:151
86062520,0sleep20-21swapper/210:10:532
242462520,0sleep10-21swapper/110:47:491
118292510,2sleep011826-21lspci12:38:590
11152510,0sleep30-21swapper/312:13:023
83052500,0sleep30-21swapper/310:28:133
158842500,0sleep10-21swapper/110:08:201
55812490,0sleep20-21swapper/211:10:412
33962490,0sleep20-21swapper/209:14:062
278142480,1sleep3670-21packagekitd12:02:293
147182480,0sleep30-21swapper/309:57:413
83492470,0sleep00-21swapper/011:11:070
84562460,0sleep3391rcuc/312:17:033
56432450,0sleep00-21swapper/012:26:010
83392390,0sleep10-21swapper/111:21:421
109552380,2sleep31318199cyclictest12:29:413
164802370,0sleep11095-21nfsd12:14:411
39032360,0sleep01316599cyclictest09:38:470
75522350,2sleep275650irq/25-eno1-tx-09:49:592
1274923516,7sleep00-21swapper/007:06:080
129952297,7sleep30-21swapper/307:09:153
128842297,7sleep10-21swapper/107:07:491
190012230,0sleep0111rcuc/010:39:550
146502230,0sleep0111rcuc/010:15:000
127512235,13sleep20-21swapper/207:06:102
191022200,0sleep10-21swapper/109:33:191
13181992011,6cyclictest18224-21sshd09:19:203
28042190,2sleep11317299cyclictest10:34:471
1318199194,10cyclictest649-21avahi-daemon11:17:253
68432170,0sleep30-21swapper/308:10:163
205072170,0sleep20-21swapper/211:40:292
196032170,1sleep0111rcuc/009:26:210
266122150,1sleep326614-21bash10:55:163
266122150,1sleep326614-21bash10:55:163
235212150,1sleep323520-21bash12:33:573
17632150,0sleep0111rcuc/010:41:270
133562150,0sleep00-21swapper/012:23:450
1318199150,0cyclictest0-21swapper/310:18:113
125962150,1sleep212598-21bash11:04:362
61672140,0sleep00-21swapper/011:21:290
246592140,0sleep10-21swapper/111:44:211
166232140,0sleep2321ktimersoftd/209:57:562
1317799140,13cyclictest0-21swapper/212:02:242
117472140,0sleep00-21swapper/009:18:360
46002130,0sleep30-21swapper/311:56:243
274032130,0sleep227402-21open_files11:20:192
26982130,0sleep00-21swapper/011:59:500
144812130,0sleep20-21swapper/211:36:252
1318199130,2cyclictest646-21dbus-daemon09:40:203
13177991312,0cyclictest10776-21lspci11:46:172
13177991312,0cyclictest0-21swapper/212:26:242
129902130,0sleep10-21swapper/109:39:481
70052120,1sleep0646-21dbus-daemon11:32:060
289212120,0sleep20-21swapper/209:23:592
1318199124,7cyclictest646-21dbus-daemon11:44:313
1318199120,2cyclictest9296-21sshd11:28:563
1318199120,2cyclictest646-21dbus-daemon11:36:483
1318199120,1cyclictest32208-21sshd10:48:443
1318199120,1cyclictest23799-21sshd11:02:203
1318199120,1cyclictest0-21swapper/311:50:283
1318199120,1cyclictest0-21swapper/309:49:203
1318199120,11cyclictest0-21swapper/310:51:413
13177991211,0cyclictest523-40kipmi012:36:572
13177991211,0cyclictest18961-21lspci10:50:422
13177991210,1cyclictest20094-21bash12:11:342
1317799120,1cyclictest18898-21grep09:51:042
1317799120,1cyclictest0-21swapper/212:18:442
13172991210,1cyclictest9188-21grep09:53:411
13172991210,1cyclictest48-21kauditd12:19:121
13172991210,1cyclictest0-21swapper/112:02:211
1317299120,1cyclictest20959-21grep10:12:111
1317299120,1cyclictest0-21swapper/111:46:411
1317299120,11cyclictest9722-21bash11:11:211
1316599120,1cyclictest21684-21sshd12:01:530
1316599120,11cyclictest9741-21sshd10:28:230
1316599120,11cyclictest15317-21lspci09:11:230
1318199119,1cyclictest9744-21sshd10:11:003
1318199116,4cyclictest21950-21lspci12:21:243
1318199115,5cyclictest649-21avahi-daemon12:35:203
1318199114,6cyclictest700-21gdbus10:41:373
1318199114,6cyclictest684-21polkitd11:08:013
1318199114,6cyclictest684-21polkitd10:05:033
1318199114,6cyclictest649-21avahi-daemon12:07:003
1318199114,6cyclictest649-21avahi-daemon10:21:143
1318199114,6cyclictest646-21dbus-daemon11:47:283
1318199114,6cyclictest646-21dbus-daemon10:36:523
1318199114,6cyclictest28032-21sshd09:52:113
1318199114,6cyclictest20940-21sshd09:12:103
1318199114,6cyclictest11817-21sshd10:00:453
1318199113,3cyclictest649-21avahi-daemon09:39:563
1318199112,1cyclictest21954-21chrt08:48:243
13181991110,0cyclictest0-21swapper/309:32:103
1318199110,1cyclictest684-21polkitd11:34:243
1318199110,1cyclictest31428-21sshd09:27:403
1317799110,3cyclictest18223-21sshd10:15:172
1317799110,10cyclictest0-21swapper/209:38:442
1317799110,10cyclictest0-21swapper/209:33:542
1317799110,10cyclictest0-21swapper/209:28:342
1317299110,0cyclictest0-21swapper/110:37:411
1317299110,0cyclictest0-21swapper/110:24:511
1316599119,1cyclictest14717-21sshd11:15:230
1316599119,1cyclictest0-21swapper/010:03:230
13165991110,0cyclictest0-21swapper/009:44:330
1316599110,10cyclictest0-21swapper/012:33:030
1316599110,0cyclictest0-21swapper/012:18:430
1318199109,0cyclictest0-21swapper/307:11:503
1318199108,1cyclictest0-21swapper/308:05:103
1318199104,5cyclictest649-21avahi-daemon11:10:223
1318199104,5cyclictest646-21dbus-daemon09:21:093
1318199100,9cyclictest0-21swapper/307:26:203
1318199100,0cyclictest0-21swapper/309:07:403
1317799109,0cyclictest0-21swapper/210:32:342
1317799109,0cyclictest0-21swapper/210:04:342
1317799108,1cyclictest33-21ksoftirqd/210:06:192
1317799103,1cyclictest33-21ksoftirqd/209:15:072
1317799101,1cyclictest33-21ksoftirqd/212:20:032
1317799100,0cyclictest0-21swapper/210:37:442
1317299109,0cyclictest0-21swapper/109:48:511
1316599107,3cyclictest20023-21kworker/0:310:23:290
1316599100,0cyclictest0-21swapper/011:48:430
1316599100,0cyclictest0-21swapper/011:25:330
131819998,0cyclictest0-21swapper/307:41:103
131819993,1cyclictest646-21dbus-daemon07:55:003
131819993,1cyclictest24865-21cat08:55:163
131819993,1cyclictest17299-21snmpd08:52:473
131819992,1cyclictest16153-21expr07:15:143
131819990,2cyclictest27280-21ntp_states09:00:173
131819990,0cyclictest0-21swapper/307:55:403
131779998,0cyclictest0-21swapper/208:47:442
131779997,1cyclictest33-21ksoftirqd/211:56:442
131779997,1cyclictest33-21ksoftirqd/211:05:032
131779996,1cyclictest33-21ksoftirqd/210:25:542
131779991,1cyclictest131rcu_sched12:30:442
131779990,1cyclictest648-21systemd-logind11:33:492
131779990,1cyclictest33-21ksoftirqd/211:25:202
131779990,1cyclictest131rcu_sched10:45:342
131729998,0cyclictest0-21swapper/110:25:211
131729998,0cyclictest0-21swapper/109:25:511
131729998,0cyclictest0-21swapper/109:07:111
131659998,0cyclictest0-21swapper/010:18:430
131659996,2cyclictest32292-21kworker/0:112:08:490
131659990,5cyclictest13949-21munin-run08:30:000
131819986,1cyclictest0-21swapper/307:20:503
131819983,1cyclictest17299-21snmpd07:34:093
131819982,1cyclictest8597-21kernelversion08:15:163
131819982,1cyclictest299272chrt07:49:423
131819982,1cyclictest25184-21switchtime07:35:193
131819982,1cyclictest16810-21cat08:35:163
131819982,1cyclictest12386-21cat08:25:133
131819980,2cyclictest14458-21diskstats08:30:143
131779987,0cyclictest33-21ksoftirqd/211:50:232
131779986,1cyclictest33-21ksoftirqd/212:06:122
131779986,1cyclictest33-21ksoftirqd/210:22:222
131779986,1cyclictest33-21ksoftirqd/209:45:012
131779985,1cyclictest649-21avahi-daemon10:40:092
131779980,1cyclictest131rcu_sched10:59:242
131779980,1cyclictest131rcu_sched10:59:242
131729987,0cyclictest0-21swapper/110:16:011
131729986,1cyclictest16013-21lspci10:04:441
131729986,1cyclictest14047-21sshd12:26:521
131729985,2cyclictest649-21avahi-daemon11:53:171
131729985,2cyclictest616-17auditd12:35:301
131729984,3cyclictest700-21gdbus10:42:561
131659987,0cyclictest0-21swapper/012:11:330
131659987,0cyclictest0-21swapper/011:50:130
131659987,0cyclictest0-21swapper/010:09:230
131659986,2cyclictest23804-21kworker/0:209:45:250
131659986,1cyclictest6820-21lspci11:42:260
131659985,2cyclictest649-21avahi-daemon10:58:560
131659985,2cyclictest649-21avahi-daemon10:58:560
131659983,4cyclictest3297-21kworker/u8:010:00:000
131659980,4cyclictest26184-21munin-run09:00:000
26146270,0sleep226143-21cpu07:40:122
131819972,1cyclictest18405-21tr08:40:133
131819971,1cyclictest2068-21tr08:00:123
131819970,2cyclictest10207-21expr08:20:143
131779970,1cyclictest131rcu_sched07:25:002
131729976,0cyclictest0-21swapper/111:25:011
131729975,1cyclictest649-21avahi-daemon09:56:311
131729975,1cyclictest4359-21lspci11:00:091
131729975,1cyclictest22618-21sshd11:16:221
131729974,2cyclictest649-21avahi-daemon12:21:161
131729974,2cyclictest649-21avahi-daemon10:55:421
131729974,2cyclictest649-21avahi-daemon10:55:421
131729974,2cyclictest648-21systemd-logind09:42:141
131729974,2cyclictest646-21dbus-daemon12:08:131
131729974,2cyclictest21063-21sshd09:12:101
131729973,3cyclictest700-21gdbus11:07:041
131659976,0cyclictest0-21swapper/009:30:030
131659975,1cyclictest5182-21lspci11:07:210
131659975,1cyclictest13077-21sshd09:50:250
131659975,1cyclictest10636-21lspci11:39:310
131659974,2cyclictest649-21avahi-daemon11:01:070
131659974,2cyclictest649-21avahi-daemon10:50:220
131659974,2cyclictest649-21avahi-daemon10:30:540
131659973,3cyclictest700-21gdbus09:08:130
13155270,2sleep01316599cyclictest09:22:130
131779964,1cyclictest649-21avahi-daemon09:07:062
131779964,1cyclictest646-21dbus-daemon08:35:002
131779964,1cyclictest646-21dbus-daemon07:35:002
131779964,1cyclictest33-21ksoftirqd/208:00:002
131779963,2cyclictest17299-21snmpd08:55:172
131779962,1cyclictest0-21swapper/207:39:442
131729964,1cyclictest646-21dbus-daemon11:35:481
131729964,1cyclictest24567-21mii-tool07:35:131
131729963,2cyclictest646-21dbus-daemon11:55:111
131659964,1cyclictest684-21polkitd07:44:560
131659964,1cyclictest684-21polkitd07:29:550
131659960,5cyclictest0-21swapper/007:50:420
131659960,0cyclictest0-21swapper/008:35:330
131779953,1cyclictest30706-21cat07:50:162
131779953,1cyclictest20496-21mii-tool07:25:132
131779953,1cyclictest17299-21snmpd09:00:182
131779953,1cyclictest17299-21snmpd08:51:442
131779953,1cyclictest17299-21snmpd08:42:262
131779953,1cyclictest17299-21snmpd08:36:532
131779953,1cyclictest17299-21snmpd08:05:552
131779953,1cyclictest17299-21snmpd08:02:252
131779953,1cyclictest17299-21snmpd07:45:092
131779953,1cyclictest17299-21snmpd07:15:062
131779953,1cyclictest1053-21lldpd08:10:282
131779953,1cyclictest0-21swapper/208:25:202
131779952,2cyclictest11891-21sshd08:24:582
131779950,4cyclictest8062-21/usr/sbin/munin08:15:192
131779950,4cyclictest0-21swapper/207:11:042
131729954,0cyclictest0-21swapper/108:44:011
131729953,1cyclictest648-21systemd-logind08:10:001
131729953,1cyclictest646-21dbus-daemon07:30:001
131729953,1cyclictest2430-21cat08:00:141
131729953,1cyclictest17299-21snmpd09:00:241
131729953,1cyclictest17299-21snmpd08:50:111
131729953,1cyclictest17299-21snmpd08:47:051
131729953,1cyclictest17299-21snmpd08:35:321
131729953,1cyclictest17299-21snmpd08:15:071
131729953,1cyclictest17299-21snmpd08:08:191
131729953,1cyclictest17299-21snmpd07:53:221
131729953,1cyclictest17299-21snmpd07:47:311
131729953,1cyclictest17299-21snmpd07:30:121
131729953,1cyclictest17299-21snmpd07:20:091
131729953,1cyclictest17299-21snmpd07:13:121
131729953,1cyclictest16438-21cat07:15:161
131729953,1cyclictest0-21swapper/108:30:161
131729952,2cyclictest27818-21sshd07:43:441
131729952,2cyclictest17299-21snmpd08:25:021
131729952,2cyclictest17299-21snmpd08:22:291
131729950,4cyclictest0-21swapper/107:57:311
131659954,0cyclictest0-21swapper/008:41:330
131659953,1cyclictest682-21lsmd08:33:260
131659953,1cyclictest17299-21snmpd09:00:480
131659953,1cyclictest17299-21snmpd08:52:380
131659953,1cyclictest17299-21snmpd08:46:470
131659953,1cyclictest17299-21snmpd08:17:190
131659953,1cyclictest17299-21snmpd08:00:130
131659953,1cyclictest17299-21snmpd07:56:580
131659953,1cyclictest17299-21snmpd07:45:460
131659953,1cyclictest17299-21snmpd07:35:240
131659953,1cyclictest17299-21snmpd07:34:180
131659953,1cyclictest17299-21snmpd07:16:210
131659953,1cyclictest10562-21cat08:20:160
131659953,1cyclictest1053-21lldpd08:05:090
131659952,2cyclictest18256-21df07:20:130
131659950,4cyclictest0-21swapper/007:12:320
131729942,1cyclictest17299-21snmpd08:55:081
131659942,1cyclictest6181-21seq08:10:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional