You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-18 - 06:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Sat Oct 18, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
485121040,0sleep30-21swapper/300:14:273
200062960,0sleep20-21swapper/223:55:352
267312870,2sleep1231rcuc/100:16:411
316362640,0sleep00-21swapper/021:30:380
235792600,0sleep20-21swapper/223:46:102
57672590,1sleep35765-21lspci23:31:333
53822590,0sleep10-21swapper/122:52:301
276352590,0sleep20-21swapper/200:37:412
146892590,0sleep10-21swapper/122:01:191
322832580,0sleep00-21swapper/021:17:530
322832580,0sleep00-21swapper/021:17:530
223872570,0sleep30-21swapper/322:15:033
305562560,0sleep230557-21grepconf.sh00:17:062
325492550,0sleep00-21swapper/023:37:270
131542550,0sleep00-21swapper/021:35:150
4212540,0sleep20-21swapper/222:22:352
315862540,0sleep20-21swapper/222:29:002
61922530,0sleep20-21swapper/221:31:212
141382530,0sleep014139-21lspci22:10:560
204472520,0sleep0101ktimersoftd/022:37:350
203742520,0sleep30-21swapper/323:00:293
92722510,0sleep30-21swapper/322:42:593
222322490,1sleep222230-21lspci21:16:512
222322490,1sleep222230-21lspci21:16:512
130102480,0sleep10-21swapper/123:06:161
302692470,0sleep10-21swapper/121:59:431
158372440,2sleep2124499cyclictest21:48:312
45982430,2sleep0123199cyclictest00:07:310
292122370,0sleep20-21swapper/200:27:192
166122370,0sleep316609-21lspci23:45:263
318452360,0sleep231844-21missed_timers00:00:162
183482350,1sleep118346-21lspci23:52:101
3263623119,7sleep20-21swapper/219:05:182
77223013,11sleep10-21swapper/119:06:051
8502287,7sleep30-21swapper/319:07:033
71022311,7sleep00-21swapper/019:05:280
96652210,0sleep20-21swapper/222:59:322
139322200,0sleep10-21swapper/100:08:321
178402180,1sleep125-21ksoftirqd/123:10:031
237872170,2sleep0123199cyclictest23:56:010
186132160,1sleep218616-21bash23:23:112
159832160,0sleep30-21swapper/321:48:323
1231991614,1cyclictest30369-21kworker/0:000:33:420
1231991614,1cyclictest1025-21kworker/0:023:19:000
118242160,0sleep10-21swapper/121:15:461
118242160,0sleep10-21swapper/121:15:461
67832150,0sleep30-21swapper/322:49:243
320182150,1sleep332020-21sshd22:38:463
268622150,0sleep30-21swapper/321:27:013
234462150,0sleep30-21swapper/321:13:473
1231991514,0cyclictest17299-21snmpd22:49:310
66762140,1sleep30-21swapper/300:28:243
259682140,0sleep30-21swapper/300:20:073
19082140,0sleep00-21swapper/023:47:160
117822140,0sleep30-21swapper/321:35:103
269002130,0sleep10-21swapper/122:21:581
1252991310,2cyclictest12045-21cp00:32:283
124499130,1cyclictest26125-21id21:26:572
1237991311,1cyclictest646-21dbus-daemon21:35:341
1231991312,0cyclictest32422-21kworker/0:022:25:060
1231991311,1cyclictest10273-21kworker/0:121:40:120
175912120,0sleep217582-21bash21:13:102
15702120,0sleep20-21swapper/223:11:372
125299122,1cyclictest41-21ksoftirqd/323:36:543
1252991210,1cyclictest620-13audispd23:24:263
125299120,1cyclictest75550irq/24-eno1-rx-22:22:273
125299120,11cyclictest0-21swapper/323:10:373
125299120,11cyclictest0-21swapper/321:52:473
124499120,11cyclictest0-21swapper/223:05:272
1237991210,1cyclictest0-21swapper/100:00:531
123799120,1cyclictest19120-21cp23:23:141
123799120,1cyclictest1822-21sshd21:30:531
123799120,11cyclictest9240-21bash23:31:541
1231991211,0cyclictest8599-21kworker/0:023:25:460
1231991211,0cyclictest30615-21kworker/0:022:07:470
1231991211,0cyclictest21659-21kworker/0:021:55:390
1231991210,1cyclictest2700-21sshd21:47:100
1231991210,1cyclictest24481-21kworker/0:100:26:460
1231991210,1cyclictest0-21swapper/022:22:100
123199120,11cyclictest25031-21sshd23:07:300
123199120,11cyclictest0-21swapper/021:24:200
100692120,0sleep00-21swapper/000:21:480
327142110,0sleep10-21swapper/123:18:011
197862110,1sleep20-21swapper/221:55:202
125299119,1cyclictest41-21ksoftirqd/323:45:003
125299114,3cyclictest41-21ksoftirqd/300:03:213
1252991110,0cyclictest0-21swapper/322:27:373
1252991110,0cyclictest0-21swapper/319:25:173
125299110,10cyclictest0-21swapper/321:59:073
124499119,1cyclictest7094-21bash23:44:372
1244991110,0cyclictest0-21swapper/223:16:572
1244991110,0cyclictest0-21swapper/221:24:372
124499110,10cyclictest0-21swapper/222:32:462
124499110,10cyclictest0-21swapper/220:57:362
124499110,0cyclictest0-21swapper/222:17:172
124499110,0cyclictest0-21swapper/221:37:272
123799119,1cyclictest26244-21grep23:59:441
123799119,1cyclictest14566-21bash22:40:141
1237991110,0cyclictest0-21swapper/123:04:141
123799110,10cyclictest8006-21sshd21:50:541
123799110,10cyclictest0-21swapper/122:30:241
123799110,0cyclictest0-21swapper/123:44:041
123799110,0cyclictest0-21swapper/122:05:141
1231991110,0cyclictest9004-21kworker/0:122:04:280
1231991110,0cyclictest29960-21kworker/0:221:26:300
1231991110,0cyclictest29537-21lspci00:00:040
1231991110,0cyclictest27619-21lspci23:20:450
1231991110,0cyclictest16612-21lspci22:30:380
1231991110,0cyclictest11628-21kworker/0:100:10:410
125299109,0cyclictest0-21swapper/321:22:173
125299108,1cyclictest0-21swapper/300:35:583
125299106,2cyclictest41-21ksoftirqd/322:51:343
125299105,3cyclictest41-21ksoftirqd/323:09:373
125299105,3cyclictest41-21ksoftirqd/322:13:023
125299104,3cyclictest41-21ksoftirqd/322:32:503
125299102,2cyclictest41-21ksoftirqd/322:00:583
125299101,3cyclictest41-21ksoftirqd/323:58:563
125299101,3cyclictest41-21ksoftirqd/323:16:243
125299101,3cyclictest0-21swapper/300:17:393
125299101,1cyclictest41-21ksoftirqd/322:06:453
125299101,1cyclictest41-21ksoftirqd/321:18:513
125299101,1cyclictest41-21ksoftirqd/321:18:513
125299100,1cyclictest41-21ksoftirqd/322:59:543
125299100,0cyclictest0-21swapper/300:06:473
124499109,0cyclictest0-21swapper/221:09:372
124499108,1cyclictest5756-21lspci22:42:372
124499100,9cyclictest0-21swapper/219:45:362
124499100,9cyclictest0-21swapper/219:44:562
124499100,0cyclictest0-21swapper/222:46:072
123799109,0cyclictest0-21swapper/122:18:541
123799108,1cyclictest13784-21sshd22:10:541
123799100,0cyclictest0-21swapper/121:27:241
123199109,0cyclictest20983-21kworker/0:122:18:300
123199109,0cyclictest0-21swapper/020:35:200
123199108,1cyclictest11884-21sshd23:12:400
1231991010,0cyclictest20007-21kworker/0:221:05:130
12529997,1cyclictest41-21ksoftirqd/323:28:043
12529994,3cyclictest41-21ksoftirqd/321:32:013
12529991,2cyclictest0-21swapper/323:50:543
12449998,0cyclictest0-21swapper/223:33:072
12319999,0cyclictest8599-21kworker/0:023:42:570
12319997,1cyclictest9-21ksoftirqd/023:52:160
12319996,2cyclictest22012-21kworker/0:122:42:120
29019280,0sleep30-21swapper/321:40:063
12449987,0cyclictest0-21swapper/222:52:572
12449987,0cyclictest0-21swapper/221:52:472
12449986,1cyclictest8337-21lspci00:07:552
12449986,1cyclictest6027-21lspci22:36:062
12449986,1cyclictest29579-21sshd23:01:272
12449986,1cyclictest17299-21snmpd22:09:172
12379987,0cyclictest0-21swapper/122:29:141
12379986,1cyclictest646-21dbus-daemon22:36:441
12379986,1cyclictest30957-21lspci23:46:561
12379986,1cyclictest17205-21lspci23:35:511
12379985,2cyclictest649-21avahi-daemon00:35:171
12379985,2cyclictest646-21dbus-daemon00:12:331
12319986,1cyclictest9-21ksoftirqd/000:40:000
12319986,1cyclictest9-21ksoftirqd/000:16:190
12319986,1cyclictest6949-21lspci21:50:470
12319986,1cyclictest30130-21lspci23:30:430
12319985,2cyclictest649-21avahi-daemon22:57:200
12319985,2cyclictest649-21avahi-daemon22:50:270
12319983,1cyclictest8351-21sshd23:02:360
3607270,0sleep10-21swapper/100:31:311
29924270,1sleep1684-21polkitd22:55:031
14016270,0sleep10-21swapper/119:40:001
12529975,1cyclictest5800-21crond19:20:013
12529971,3cyclictest41-21ksoftirqd/320:15:123
12449976,0cyclictest0-21swapper/219:24:362
12449974,2cyclictest684-21polkitd23:25:172
12449974,2cyclictest649-21avahi-daemon22:01:132
12449974,2cyclictest649-21avahi-daemon21:41:442
12449974,2cyclictest649-21avahi-daemon00:11:392
12449974,2cyclictest3409-21sshd00:21:042
12449974,1cyclictest15326-21sshd23:35:402
12449974,1cyclictest1347-21sshd00:31:152
12449974,1cyclictest10300-21sshd22:10:322
12449973,3cyclictest30312-21sshd23:50:102
12379976,0cyclictest0-21swapper/120:48:041
12379976,0cyclictest0-21swapper/120:05:021
12379975,1cyclictest649-21avahi-daemon21:40:451
12379975,1cyclictest15071-21lspci00:25:451
12379974,2cyclictest684-21polkitd21:22:351
12379974,2cyclictest649-21avahi-daemon00:20:561
12379974,2cyclictest16594-21sshd21:45:161
12379973,3cyclictest649-21avahi-daemon22:45:271
12319975,1cyclictest9-21ksoftirqd/020:49:590
12319972,1cyclictest30496-21sshd21:10:240
12035271,2sleep1121rcu_preempt23:25:431
5522260,1sleep15526-21unixbench_multi20:35:211
12529961,3cyclictest41-21ksoftirqd/320:25:493
12529961,2cyclictest7808-21taskset19:24:443
12529960,5cyclictest0-21swapper/321:00:073
12529960,3cyclictest41-21ksoftirqd/320:57:303
12529960,1cyclictest0-21swapper/321:06:413
12449963,2cyclictest17299-21snmpd20:46:082
12449963,2cyclictest17299-21snmpd19:51:242
12449962,1cyclictest121rcu_preempt19:35:002
12449960,5cyclictest0-21swapper/220:38:162
12449960,5cyclictest0-21swapper/220:13:462
12379964,1cyclictest27696-21sshd21:10:121
12379964,1cyclictest22492-21sshd21:08:291
12379963,2cyclictest17299-21snmpd20:00:191
12379960,5cyclictest0-21swapper/120:56:141
12379960,5cyclictest0-21swapper/120:27:031
12379960,5cyclictest0-21swapper/119:32:331
12319966,0cyclictest20007-21kworker/0:220:41:070
12319964,1cyclictest9-21ksoftirqd/020:15:000
12319964,1cyclictest20007-21kworker/0:220:15:130
12319962,2cyclictest2937-21sshd19:11:340
12319960,0cyclictest0-21swapper/020:25:300
12529953,1cyclictest26852-21mii-tool20:10:153
12529953,1cyclictest17299-21snmpd20:50:443
12529953,1cyclictest17299-21snmpd20:41:353
12529953,1cyclictest17299-21snmpd20:35:143
12529953,1cyclictest17299-21snmpd20:31:533
12529953,1cyclictest17299-21snmpd20:05:043
12529953,1cyclictest17299-21snmpd19:30:093
12529953,1cyclictest0-21swapper/319:50:193
12529952,2cyclictest20971-21head19:55:173
12529951,2cyclictest41-21ksoftirqd/320:20:443
12529951,1cyclictest41-21ksoftirqd/319:45:113
12529950,4cyclictest15077-21pmu-power19:40:183
12529950,3cyclictest41-21ksoftirqd/320:45:143
12529950,1cyclictest0-21swapper/320:00:143
12529950,1cyclictest0-21swapper/319:10:093
12529950,0cyclictest121rcu_preempt19:40:003
12449954,0cyclictest0-21swapper/219:25:152
12449953,1cyclictest7370-21xargs20:40:192
12449953,1cyclictest649-21avahi-daemon19:15:422
12449953,1cyclictest30932-21cat20:20:152
12449953,1cyclictest2617-21cat20:30:142
12449953,1cyclictest22300-21/usr/sbin/munin20:00:212
12449953,1cyclictest1830-21hwlatdetect19:10:122
12449953,1cyclictest17299-21snmpd20:27:202
12449953,1cyclictest17299-21snmpd20:07:492
12449953,1cyclictest17299-21snmpd19:37:302
12449950,1cyclictest10298-21/usr/sbin/munin20:50:212
12449950,0cyclictest0-21swapper/219:56:262
12379954,0cyclictest0-21swapper/120:30:441
12379954,0cyclictest0-21swapper/119:26:231
12379953,1cyclictest684-21polkitd19:45:001
12379953,1cyclictest26866-21cat20:10:151
12379953,1cyclictest17299-21snmpd20:50:201
12379953,1cyclictest17299-21snmpd20:40:591
12379953,1cyclictest17299-21snmpd20:17:311
12379953,1cyclictest17299-21snmpd19:55:041
12379953,1cyclictest17299-21snmpd19:51:421
12379953,1cyclictest17299-21snmpd19:20:531
12379953,1cyclictest17299-21snmpd19:15:171
12379953,1cyclictest1718-21gltestperf19:10:111
12379953,1cyclictest16673-21mii-tool19:45:131
12379952,2cyclictest17299-21snmpd20:20:011
12319955,0cyclictest20007-21kworker/0:220:54:590
12319953,1cyclictest2496-21gltestperf20:30:140
12319953,1cyclictest20007-21kworker/0:219:50:170
12319953,1cyclictest17299-21snmpd20:55:120
12319953,1cyclictest17299-21snmpd20:06:010
12319953,1cyclictest17299-21snmpd19:56:460
12319953,1cyclictest17299-21snmpd19:45:060
12319953,1cyclictest17299-21snmpd19:34:030
12319953,1cyclictest17299-21snmpd19:20:050
12319953,1cyclictest1058-21sendmail20:00:190
12319953,1cyclictest1058-21sendmail19:26:470
12319953,1cyclictest1053-21lldpd21:04:180
12319953,1cyclictest1053-21lldpd19:44:030
12319953,1cyclictest1053-21lldpd19:36:510
12319953,1cyclictest0-21swapper/019:15:340
12319952,2cyclictest31371-21tr20:20:180
12449942,1cyclictest0-21swapper/220:15:122
12449940,1cyclictest14634-21diskstats21:00:152
12379942,1cyclictest14537-21expr21:00:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional