You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 09:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Fri Nov 28, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
151222940,0sleep30-21swapper/323:20:433
230802700,0sleep00-21swapper/023:31:220
155572690,0sleep10-21swapper/121:55:111
209522670,2sleep0293899cyclictest22:21:560
195502660,0sleep30-21swapper/321:16:193
168442620,0sleep10-21swapper/123:57:391
61762610,0sleep00-21swapper/023:00:060
267992590,1sleep09-21ksoftirqd/023:08:520
254832590,0sleep20-21swapper/222:42:092
109062590,0sleep20-21swapper/222:54:002
148462580,0sleep10-21swapper/100:00:541
53162570,0sleep30-21swapper/321:54:083
102912570,1sleep0111rcuc/021:21:540
102912570,1sleep0111rcuc/021:21:530
116292560,0sleep00-21swapper/023:57:060
56332550,0sleep25630-21sshd23:56:272
33732540,1sleep3391rcuc/322:49:563
21822540,0sleep00-21swapper/023:16:090
18342530,0sleep20-21swapper/223:09:372
42512510,0sleep10-21swapper/123:09:521
255212510,0sleep30-21swapper/323:15:143
20142510,0sleep10-21swapper/100:24:101
192122510,0sleep00-21swapper/022:44:560
45772500,0sleep24576-21sshd21:47:272
29752490,0sleep02959-21sshd21:17:570
160162490,2sleep2294799cyclictest22:21:272
320832480,0sleep20-21swapper/223:12:382
149302470,0sleep20-21swapper/219:35:202
124272400,0sleep00-21swapper/023:46:560
62892350,0sleep30-21swapper/322:27:003
120723018,7sleep20-21swapper/219:05:152
26862297,7sleep30-21swapper/319:08:043
25062297,7sleep00-21swapper/019:05:530
274322817,7sleep10-21swapper/119:08:461
189162240,1sleep2321ktimersoftd/200:37:082
174362230,0sleep117437-21tty00:08:121
195742220,0sleep00-21swapper/000:05:030
231612210,0sleep00-21swapper/021:59:140
236472190,1sleep12999-1kworker/1:0H22:25:271
209312190,0sleep20-21swapper/200:01:352
63152180,0sleep10-21swapper/122:53:311
44682180,0sleep10-21swapper/123:23:011
308722180,1sleep330870-21lspci23:45:263
326252170,0sleep20-21swapper/222:29:432
169662170,1sleep3391rcuc/323:54:203
54102160,1sleep35409-21grep21:31:103
299162160,1sleep229912-21bash22:49:192
247662160,0sleep30-21swapper/321:13:403
219612160,1sleep221962-21sshd21:39:252
174792160,1sleep317476-21lspci22:57:563
165802160,0sleep016583-21grep19:40:140
68642150,1sleep26832-21sshd00:07:052
65902150,1sleep2311rcuc/221:31:172
43242150,0sleep1231rcuc/100:39:191
87812140,0sleep00-21swapper/000:35:580
293899140,12cyclictest14536-21sshd22:50:590
287662140,1sleep1241ktimersoftd/123:12:161
244402140,1sleep024430-21ntp_states22:55:170
197062140,0sleep20-21swapper/223:17:592
2947991312,0cyclictest0-21swapper/223:47:192
294499130,2cyclictest646-21dbus-daemon23:47:141
294499130,1cyclictest0-21swapper/123:32:341
293899130,12cyclictest29730-21lspci23:35:180
28062130,0sleep30-21swapper/323:29:253
276792130,1sleep327670-21sshd22:06:143
101112130,0sleep310077-21sshd23:40:023
294899120,1cyclictest28000-21lspci22:12:533
294899120,11cyclictest8915-21sshd22:20:433
294899120,11cyclictest0-21swapper/322:37:533
294799120,1cyclictest618-13audispd00:10:592
294799120,11cyclictest31639-21bash22:16:292
2944991210,1cyclictest619-17sedispatch22:08:341
2944991210,1cyclictest1011-21sshd23:18:351
294499120,1cyclictest20604-21tty23:27:551
294499120,1cyclictest0-21swapper/122:15:441
294499120,11cyclictest30902-21sshd00:34:551
294499120,11cyclictest28039-21sshd00:16:251
294499120,11cyclictest17086-21sshd22:24:541
293899120,11cyclictest27500-21sshd23:25:180
293899120,11cyclictest0-21swapper/022:07:170
156532120,0sleep00-21swapper/000:11:270
294899119,1cyclictest22335-21id23:08:223
2948991110,0cyclictest0-21swapper/323:55:423
2948991110,0cyclictest0-21swapper/321:58:233
2948991110,0cyclictest0-21swapper/321:46:533
2948991110,0cyclictest0-21swapper/321:27:323
2948991110,0cyclictest0-21swapper/300:20:123
294899110,10cyclictest0-21swapper/300:38:423
2947991110,0cyclictest0-21swapper/222:57:292
2947991110,0cyclictest0-21swapper/221:19:192
294799110,0cyclictest0-21swapper/220:20:202
294499119,1cyclictest16725-21grepconf.sh00:11:341
294499119,1cyclictest14534-21lspci23:50:351
2944991110,0cyclictest0-21swapper/121:24:541
2944991110,0cyclictest0-21swapper/121:24:531
2944991110,0cyclictest0-21swapper/121:09:131
2944991110,0cyclictest0-21swapper/100:28:441
294499110,10cyclictest0-21swapper/121:14:541
2938991110,0cyclictest0-21swapper/023:51:580
293899110,10cyclictest0-21swapper/023:20:380
293899110,10cyclictest0-21swapper/000:23:190
86972100,0sleep10-21swapper/123:36:271
294899109,0cyclictest0-21swapper/300:14:023
294899100,0cyclictest0-21swapper/321:09:423
294899100,0cyclictest0-21swapper/319:55:033
294899100,0cyclictest0-21swapper/300:25:433
294799109,0cyclictest0-21swapper/222:02:092
294799109,0cyclictest0-21swapper/200:28:492
294799100,0cyclictest0-21swapper/200:35:002
294499109,0cyclictest0-21swapper/122:43:141
294499109,0cyclictest0-21swapper/121:40:231
294499108,1cyclictest834-21lspci21:17:441
294499108,1cyclictest12029-21lspci21:38:241
294499100,0cyclictest0-21swapper/122:02:451
293899109,0cyclictest0-21swapper/022:13:080
293899109,0cyclictest0-21swapper/021:31:470
293899109,0cyclictest0-21swapper/021:12:470
293899109,0cyclictest0-21swapper/021:09:570
293899108,1cyclictest14497-21lspci21:48:280
293899108,1cyclictest0-21swapper/023:14:380
293899106,3cyclictest15662-21kworker/0:221:53:440
126462100,2sleep2294799cyclictest21:58:082
29489998,0cyclictest0-21swapper/322:50:023
29489998,0cyclictest0-21swapper/300:32:333
29489998,0cyclictest0-21swapper/300:08:333
29489997,1cyclictest0-21swapper/322:33:523
29479998,0cyclictest0-21swapper/223:43:202
29479998,0cyclictest0-21swapper/223:39:592
29479998,0cyclictest0-21swapper/222:09:192
29479998,0cyclictest0-21swapper/221:54:392
29479998,0cyclictest0-21swapper/221:26:292
29479998,0cyclictest0-21swapper/220:05:202
29479997,1cyclictest2556-21sshd00:17:102
29389998,0cyclictest0-21swapper/022:46:280
29389998,0cyclictest0-21swapper/020:32:170
29389998,0cyclictest0-21swapper/020:24:180
29389995,3cyclictest30563-21kworker/0:121:43:080
29389990,0cyclictest0-21swapper/020:37:380
29489987,0cyclictest0-21swapper/320:50:223
29489987,0cyclictest0-21swapper/319:45:023
29489986,1cyclictest8049-21lspci21:37:593
29489986,1cyclictest29344-21lspci23:02:273
29489986,1cyclictest28185-21lspci21:23:453
29489986,1cyclictest28185-21lspci21:23:453
29489986,1cyclictest25369-21lspci00:16:053
29489986,1cyclictest13028-21lspci22:40:503
29489986,1cyclictest11572-21lspci23:10:293
29489985,2cyclictest12212-21sshd22:04:443
29479987,0cyclictest0-21swapper/220:47:502
29479986,1cyclictest6277-21lspci23:26:262
29479985,2cyclictest7244-21sshd22:10:442
29479985,2cyclictest649-21avahi-daemon22:33:422
29479985,2cyclictest649-21avahi-daemon21:13:192
29479980,5cyclictest3536-21sshd23:03:082
29449987,0cyclictest0-21swapper/122:47:041
29449986,1cyclictest6186-21kworker/1:022:57:261
29449986,1cyclictest23636-21lspci21:29:501
29449986,1cyclictest12237-21kworker/1:122:31:021
29449985,2cyclictest649-21avahi-daemon22:37:011
29449985,2cyclictest649-21avahi-daemon22:13:241
29449985,2cyclictest649-21avahi-daemon21:31:501
29389987,0cyclictest0-21swapper/022:38:090
29389987,0cyclictest0-21swapper/021:27:470
29389987,0cyclictest0-21swapper/019:57:180
29389987,0cyclictest0-21swapper/019:37:270
29389987,0cyclictest0-21swapper/000:17:480
29389986,2cyclictest10181-21kworker/0:022:16:540
29389985,2cyclictest649-21avahi-daemon22:31:430
29389980,7cyclictest0-21swapper/020:05:270
29389980,4cyclictest13805-21munin-run20:55:000
25393280,0sleep20-21swapper/221:23:282
25393280,0sleep20-21swapper/221:23:272
29489976,0cyclictest0-21swapper/322:19:223
29489976,0cyclictest0-21swapper/320:30:233
29489975,1cyclictest646-21dbus-daemon23:31:273
29489974,2cyclictest646-21dbus-daemon23:35:083
29489974,2cyclictest19631-21sshd00:01:283
29479976,1cyclictest25112-21lspci22:38:502
29479976,0cyclictest0-21swapper/219:27:092
29479975,1cyclictest649-21avahi-daemon00:22:132
29479975,1cyclictest22348-21lspci23:21:312
29479974,1cyclictest7106-21lspci21:41:062
29479973,1cyclictest700-21gdbus23:33:292
29479973,1cyclictest0-21swapper/219:12:192
29449976,1cyclictest25235-21lspci21:46:141
29449976,1cyclictest10659-21kworker/1:121:50:261
29449976,0cyclictest27215-21kworker/1:123:41:231
29449970,1cyclictest0-21swapper/123:00:211
29389976,0cyclictest0-21swapper/020:42:370
29389975,1cyclictest648-21systemd-logind23:44:010
29389975,1cyclictest23126-21sshd22:28:440
29389975,1cyclictest16487-21lspci21:35:310
29389975,1cyclictest14085-21bash22:01:340
29389974,2cyclictest648-21systemd-logind00:30:100
29389974,2cyclictest10441-21sshd00:28:470
29389973,1cyclictest121rcu_preempt00:03:160
10506270,1sleep2646-21dbus-daemon23:53:392
29489965,0cyclictest0-21swapper/320:35:123
29489965,0cyclictest0-21swapper/319:51:223
29489964,1cyclictest646-21dbus-daemon21:40:243
29489963,2cyclictest16735-21ntpq19:40:163
29489960,5cyclictest0-21swapper/320:01:123
29489960,5cyclictest0-21swapper/319:31:333
29479963,2cyclictest17299-21snmpd20:15:252
29479962,3cyclictest616-13auditd21:07:542
29479962,2cyclictest7263-21sshd19:17:072
29479960,5cyclictest0-21swapper/220:53:392
29449966,0cyclictest27582-21kworker/1:220:10:191
29449965,0cyclictest25524-21kworker/1:120:05:141
29449965,0cyclictest0-21swapper/119:17:231
29449964,1cyclictest684-21polkitd19:15:001
29389963,2cyclictest17299-21snmpd20:57:330
29389960,5cyclictest0-21swapper/019:34:480
29389960,0cyclictest0-21swapper/020:10:080
29389960,0cyclictest0-21swapper/019:46:280
29489954,0cyclictest0-21swapper/320:15:123
29489953,1cyclictest8424-21cat20:40:143
29489953,1cyclictest649-21avahi-daemon20:55:013
29489953,1cyclictest649-21avahi-daemon19:15:143
29489953,1cyclictest17299-21snmpd21:00:163
29489953,1cyclictest17299-21snmpd20:46:363
29489953,1cyclictest17299-21snmpd20:26:383
29489953,1cyclictest17299-21snmpd20:10:493
29489953,1cyclictest17299-21snmpd20:06:473
29489953,1cyclictest17299-21snmpd19:29:273
29489953,1cyclictest17299-21snmpd19:23:003
29489953,1cyclictest1053-21lldpd19:12:153
29489952,2cyclictest1496-21chrt20:23:503
29479953,1cyclictest682-21lsmd19:55:222
29479953,1cyclictest2187-21gltestperf20:25:142
29479953,1cyclictest18359-21cat19:45:122
29479953,1cyclictest17299-21snmpd20:55:272
29479953,1cyclictest17299-21snmpd20:36:542
29479953,1cyclictest17299-21snmpd20:33:022
29479953,1cyclictest17299-21snmpd20:01:072
29479953,1cyclictest17299-21snmpd19:51:462
29479953,1cyclictest17299-21snmpd19:31:012
29479953,1cyclictest17299-21snmpd19:20:452
29479950,1cyclictest28083-21/usr/sbin/munin20:10:132
29479950,1cyclictest16069-21/usr/sbin/munin21:00:252
29479950,1cyclictest15880-21/usr/sbin/munin19:40:172
29449955,0cyclictest33050irq/27-ahci[00019:56:031
29449954,0cyclictest3529-21kworker/1:220:40:121
29449953,1cyclictest649-21avahi-daemon19:45:051
29449953,1cyclictest17299-21snmpd21:02:431
29449953,1cyclictest17299-21snmpd20:45:031
29449953,1cyclictest17299-21snmpd20:36:211
29449953,1cyclictest17299-21snmpd20:26:141
29449953,1cyclictest17299-21snmpd20:22:511
29449953,1cyclictest17299-21snmpd20:15:221
29449953,1cyclictest17299-21snmpd20:00:401
29449953,1cyclictest17299-21snmpd19:32:461
29449953,1cyclictest17299-21snmpd19:25:331
29449953,1cyclictest17299-21snmpd19:20:521
29449953,1cyclictest16332-21cat19:40:131
29449953,1cyclictest14299-21cat19:35:141
29449953,1cyclictest1053-21lldpd20:31:121
29449952,2cyclictest12875-21ntpq20:50:191
29389954,0cyclictest0-21swapper/019:24:580
29389953,1cyclictest17299-21snmpd21:03:100
29389953,1cyclictest17299-21snmpd20:49:300
29389953,1cyclictest17299-21snmpd20:25:060
29389953,1cyclictest17299-21snmpd20:16:040
29389953,1cyclictest17299-21snmpd19:52:250
29389953,1cyclictest17299-21snmpd19:29:360
29389953,1cyclictest17299-21snmpd19:16:180
29389950,0cyclictest0-21swapper/019:13:570
29489942,1cyclictest14020-21expr19:35:123
29479940,1cyclictest0-21swapper/220:40:152
29449942,1cyclictest20260-21grep19:50:151
29449942,1cyclictest14099-21cpuspeed_turbos20:55:111
29389942,1cyclictest24592-21cat20:00:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional