You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 04:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack2slot0.osadl.org (updated Mon May 05, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
209121010,0sleep10-21swapper/100:22:121
86192820,0sleep30-21swapper/321:36:163
64402640,0sleep30-21swapper/321:26:313
48432600,0sleep00-21swapper/023:52:390
47202560,0sleep20-21swapper/200:15:322
267232540,0sleep00-21swapper/021:34:570
193242540,0sleep10-21swapper/100:38:461
325502530,0sleep30-21swapper/323:42:373
300882530,0sleep30-21swapper/321:47:583
22532530,0sleep30-21swapper/322:04:203
324552520,0sleep20-21swapper/222:29:182
59652510,0sleep10-21swapper/122:29:531
283202500,0sleep30-21swapper/321:05:003
205212500,0sleep00-21swapper/023:03:090
30772490,0sleep13073-21lspci22:58:091
30772490,0sleep13073-21lspci22:58:091
207302490,0sleep00-21swapper/023:12:540
193092490,0sleep20-21swapper/200:35:032
89252480,0sleep20-21swapper/222:33:192
89252480,0sleep20-21swapper/222:33:192
235532480,0sleep30-21swapper/322:53:463
242692470,1sleep124268-21systemd-cgroups21:31:261
174612470,0sleep117460-21sshd22:08:541
148942470,0sleep00-21swapper/000:34:340
229472460,2sleep01334299cyclictest21:47:150
206092450,2sleep21334799cyclictest22:12:202
94482410,2sleep01334299cyclictest21:14:140
172002410,0sleep20-21swapper/223:34:512
22882400,2sleep11334699cyclictest00:08:381
1290623927,7sleep00-21swapper/019:05:500
29572320,0sleep00-21swapper/022:42:100
29572320,0sleep00-21swapper/022:42:100
1294322816,7sleep30-21swapper/319:06:173
1311022616,6sleep20-21swapper/219:08:242
129412208,7sleep10-21swapper/119:06:151
226602170,1sleep30-21swapper/323:22:343
20922170,0sleep02096-21id23:39:410
133912170,0sleep10-21swapper/121:52:401
58452160,0sleep31011-21sshd23:46:213
38462160,1sleep03838-21sshd22:04:290
261532160,0sleep20-21swapper/221:57:062
195092160,1sleep00-21swapper/022:56:320
195092160,1sleep00-21swapper/022:56:320
171282160,0sleep3391rcuc/322:46:453
151242160,1sleep10-21swapper/100:00:091
103652160,0sleep30-21swapper/320:20:163
323612150,0sleep20-21swapper/222:07:112
8062140,0sleep10-21swapper/122:13:351
283572140,1sleep128360-21bash23:58:131
277552140,0sleep20-21swapper/223:23:052
276472140,0sleep20-21swapper/222:19:212
13346991410,1cyclictest8411-21bash23:11:391
1334699140,1cyclictest19393-21systemd-cgroups22:46:591
78232130,0sleep00-21swapper/022:17:230
45962130,0sleep00-21swapper/021:23:150
306942130,0sleep0111rcuc/023:42:260
270982130,0sleep20-21swapper/222:57:182
270982130,0sleep20-21swapper/222:57:182
15662130,0sleep30-21swapper/322:29:273
1334799130,12cyclictest0-21swapper/200:08:362
13346991311,1cyclictest0-21swapper/122:23:291
96432120,0sleep39622-21sshd00:19:343
13348991210,1cyclictest9771-21bash21:23:483
13348991210,1cyclictest646-21dbus-daemon00:21:073
1334899120,1cyclictest5299-21bash21:16:573
1334899120,11cyclictest25382-21sshd22:34:573
1334899120,11cyclictest25382-21sshd22:34:573
1334899120,11cyclictest2028-21cpuspeed_turbos00:05:173
1334799120,1cyclictest649-21avahi-daemon22:04:062
1334799120,11cyclictest20932-21df21:50:162
13342991211,0cyclictest0-21swapper/023:05:130
13342991210,1cyclictest24326-21sshd22:06:230
1334299120,1cyclictest11692-21sshd21:27:030
1334299120,11cyclictest0-21swapper/023:25:440
1334899110,10cyclictest32495-21lspci22:38:473
1334899110,10cyclictest0-21swapper/323:54:073
1334899110,10cyclictest0-21swapper/322:20:473
1334899110,10cyclictest0-21swapper/322:16:273
1334899110,10cyclictest0-21swapper/320:55:173
1334899110,0cyclictest0-21swapper/323:30:373
1334799119,1cyclictest27937-21sshd22:41:262
1334799119,1cyclictest27937-21sshd22:41:262
1334799119,1cyclictest0-21swapper/221:44:262
13347991110,0cyclictest0-21swapper/223:46:462
13347991110,0cyclictest0-21swapper/223:38:562
1334799110,1cyclictest22850-21sshd00:24:262
1334799110,10cyclictest0-21swapper/222:50:462
13346991110,0cyclictest0-21swapper/121:44:291
1334299119,1cyclictest646-21dbus-daemon23:58:440
13342991110,0cyclictest0-21swapper/023:49:140
13342991110,0cyclictest0-21swapper/022:35:030
1334299110,10cyclictest670-21packagekitd21:52:330
1334299110,0cyclictest0-21swapper/023:20:440
1334299110,0cyclictest0-21swapper/022:20:530
220692100,0sleep10-21swapper/123:44:511
1334899109,0cyclictest0-21swapper/323:55:473
1334899109,0cyclictest0-21swapper/322:55:473
1334899109,0cyclictest0-21swapper/322:55:473
1334899109,0cyclictest0-21swapper/322:06:173
1334899105,3cyclictest649-21avahi-daemon21:30:533
1334899100,0cyclictest0-21swapper/323:36:473
1334899100,0cyclictest0-21swapper/321:40:473
1334899100,0cyclictest0-21swapper/321:09:373
1334799109,0cyclictest0-21swapper/223:59:362
1334799109,0cyclictest0-21swapper/223:13:162
1334799109,0cyclictest0-21swapper/222:37:362
1334799109,0cyclictest0-21swapper/222:23:262
1334799109,0cyclictest0-21swapper/221:30:362
1334699109,0cyclictest0-21swapper/123:46:491
1334699109,0cyclictest0-21swapper/123:02:191
1334699109,0cyclictest0-21swapper/122:54:391
1334699109,0cyclictest0-21swapper/119:45:191
1334699108,1cyclictest20361-21lspci21:24:491
1334699108,1cyclictest0-21swapper/123:21:391
1334699100,0cyclictest0-21swapper/122:39:191
1334299109,0cyclictest0-21swapper/000:28:040
1334299106,3cyclictest26012-21kworker/0:423:16:550
1334299100,0cyclictest0-21swapper/000:17:540
133489998,0cyclictest0-21swapper/323:07:173
133489998,0cyclictest0-21swapper/322:42:373
133489998,0cyclictest0-21swapper/322:42:373
133489998,0cyclictest0-21swapper/321:58:173
133489998,0cyclictest0-21swapper/300:28:273
133479998,0cyclictest0-21swapper/223:16:362
133479998,0cyclictest0-21swapper/223:02:162
133479998,0cyclictest0-21swapper/219:35:162
133479998,0cyclictest0-21swapper/200:28:562
133479997,1cyclictest20336-21id21:21:362
133479996,2cyclictest649-21avahi-daemon23:05:492
133479996,2cyclictest649-21avahi-daemon21:18:102
133479990,0cyclictest0-21swapper/220:32:162
133469998,0cyclictest0-21swapper/123:32:491
133469998,0cyclictest0-21swapper/121:05:191
133469998,0cyclictest0-21swapper/100:31:491
133469997,1cyclictest0-21swapper/123:16:391
133429998,0cyclictest0-21swapper/022:11:430
133429998,0cyclictest0-21swapper/021:58:230
133429998,0cyclictest0-21swapper/000:35:240
133429997,1cyclictest9261-21cp00:09:240
133429997,1cyclictest6395-21sshd22:52:030
133429997,1cyclictest0-21swapper/000:12:140
133489987,0cyclictest0-21swapper/320:50:173
133489986,1cyclictest26008-21lspci00:39:363
133489985,2cyclictest649-21avahi-daemon23:03:133
133489985,2cyclictest649-21avahi-daemon00:02:453
133489984,1cyclictest684-21polkitd21:12:093
133479987,0cyclictest0-21swapper/200:33:262
133479986,1cyclictest4096-21sshd21:45:202
133479986,1cyclictest14833-21bash21:14:462
133479986,1cyclictest12688-21lspci23:40:372
133479986,1cyclictest0-21swapper/222:45:162
133479985,2cyclictest649-21avahi-daemon23:54:092
133479985,2cyclictest649-21avahi-daemon21:25:382
133479985,2cyclictest649-21avahi-daemon00:11:272
133479985,2cyclictest13950-21sshd21:36:482
133479984,1cyclictest15906-21sshd23:25:092
133479983,2cyclictest700-21gdbus21:08:422
133469987,0cyclictest0-21swapper/123:38:591
133469987,0cyclictest0-21swapper/123:06:091
133469987,0cyclictest0-21swapper/122:31:391
133469987,0cyclictest0-21swapper/122:31:391
133469986,1cyclictest25-21ksoftirqd/121:58:441
133469986,1cyclictest16497-21lspci00:16:511
133469985,2cyclictest700-21gdbus21:19:181
133469985,2cyclictest649-21avahi-daemon22:43:281
133469985,2cyclictest649-21avahi-daemon22:43:281
133429987,0cyclictest31479-21kworker/0:022:48:130
133429987,0cyclictest0-21swapper/020:00:030
133429987,0cyclictest0-21swapper/000:00:240
133429986,1cyclictest17587-21lspci00:23:520
133429985,2cyclictest649-21avahi-daemon22:31:340
133429985,2cyclictest649-21avahi-daemon22:31:340
133429985,2cyclictest649-21avahi-daemon22:28:060
133429985,2cyclictest649-21avahi-daemon21:43:570
10834285,1sleep341-21ksoftirqd/300:30:163
133489976,0cyclictest0-21swapper/323:11:083
133489975,1cyclictest649-21avahi-daemon23:15:133
133489975,1cyclictest41-21ksoftirqd/323:25:123
133489975,1cyclictest15457-21grepconf.sh00:10:013
133489975,1cyclictest1438-21sshd22:10:233
133489974,2cyclictest26384-21sshd21:50:433
133479973,3cyclictest684-21polkitd00:00:122
133469976,0cyclictest0-21swapper/121:47:391
133469975,1cyclictest4995-21sshd23:52:401
133469975,1cyclictest28665-21kworker/1:321:35:481
133469975,1cyclictest25-21ksoftirqd/123:25:251
133469974,2cyclictest649-21avahi-daemon22:18:461
133469974,2cyclictest649-21avahi-daemon22:02:061
133469974,2cyclictest649-21avahi-daemon21:25:501
133469974,2cyclictest26956-21sshd21:12:471
133469973,3cyclictest646-21dbus-daemon00:25:201
133469973,1cyclictest6525-21sshd00:12:241
133429975,1cyclictest28729-21sshd21:35:080
133429974,2cyclictest649-21avahi-daemon23:31:500
133429973,3cyclictest700-21gdbus21:17:410
133489964,1cyclictest684-21polkitd20:40:003
133489963,2cyclictest646-21dbus-daemon20:15:003
133489963,2cyclictest17299-21snmpd20:42:283
133489963,2cyclictest17299-21snmpd19:58:293
133489963,2cyclictest17299-21snmpd19:46:233
133489960,5cyclictest0-21swapper/319:54:173
133479965,0cyclictest0-21swapper/219:44:162
133479964,1cyclictest684-21polkitd20:50:002
133479964,1cyclictest646-21dbus-daemon19:45:012
133479963,2cyclictest17299-21snmpd21:03:252
133469965,0cyclictest0-21swapper/120:29:591
133469963,2cyclictest17299-21snmpd20:32:271
133469963,2cyclictest17299-21snmpd19:11:101
133429965,0cyclictest0-21swapper/019:46:230
133429965,0cyclictest0-21swapper/019:25:530
133429964,1cyclictest646-21dbus-daemon20:10:000
133429964,1cyclictest30220-21sshd21:08:060
133429963,2cyclictest649-21avahi-daemon20:50:000
133429963,2cyclictest17299-21snmpd19:56:200
133489954,0cyclictest0-21swapper/319:40:263
133489954,0cyclictest0-21swapper/319:10:363
133489953,1cyclictest17299-21snmpd20:48:463
133489953,1cyclictest17299-21snmpd20:31:243
133489953,1cyclictest17299-21snmpd20:25:033
133489953,1cyclictest17299-21snmpd20:15:003
133489953,1cyclictest17299-21snmpd20:09:243
133489953,1cyclictest17299-21snmpd19:33:223
133489953,1cyclictest17299-21snmpd19:27:253
133489953,1cyclictest1053-21lldpd19:23:253
133489953,1cyclictest0-21swapper/319:35:173
133489952,2cyclictest17299-21snmpd20:00:113
133479954,0cyclictest0-21swapper/219:26:062
133479953,1cyclictest646-21dbus-daemon19:20:012
133479953,1cyclictest18716-21idleruntime20:40:162
133479953,1cyclictest17299-21snmpd20:55:042
133479953,1cyclictest17299-21snmpd20:50:102
133479953,1cyclictest17299-21snmpd20:35:282
133479953,1cyclictest17299-21snmpd20:27:152
133479953,1cyclictest17299-21snmpd20:15:572
133479953,1cyclictest17299-21snmpd20:02:022
133479953,1cyclictest17299-21snmpd19:57:532
133479953,1cyclictest17299-21snmpd19:50:052
133479953,1cyclictest16738-21missed_timers19:15:172
133479953,1cyclictest10663-21cat20:20:182
133479952,2cyclictest5216-21cat20:05:252
133479952,1cyclictest23271-21/usr/sbin/munin19:30:212
133479950,4cyclictest13531-21/usr/sbin/munin19:10:202
133479950,4cyclictest0-21swapper/220:12:062
133469953,1cyclictest26760-21cat19:40:141
133469953,1cyclictest2533-21cat20:00:171
133469953,1cyclictest19335-21sort19:20:221
133469953,1cyclictest17299-21snmpd21:03:131
133469953,1cyclictest17299-21snmpd20:56:011
133469953,1cyclictest17299-21snmpd20:54:371
133469953,1cyclictest17299-21snmpd20:37:131
133469953,1cyclictest17299-21snmpd20:20:481
133469953,1cyclictest17299-21snmpd20:15:271
133469953,1cyclictest17299-21snmpd20:10:151
133469953,1cyclictest17299-21snmpd20:05:541
133469953,1cyclictest17299-21snmpd19:50:561
133469953,1cyclictest17299-21snmpd19:36:321
133469953,1cyclictest17299-21snmpd19:30:371
133469953,1cyclictest17299-21snmpd19:25:041
133469953,1cyclictest16093-21mii-tool19:15:011
133469953,1cyclictest1049-21rpcbind20:45:001
133469950,0cyclictest0-21swapper/119:57:191
133429953,1cyclictest6600-21cat20:10:170
133429953,1cyclictest26722-21cat19:40:140
133429953,1cyclictest17299-21snmpd21:04:190
133429953,1cyclictest17299-21snmpd20:50:520
133429953,1cyclictest17299-21snmpd20:30:180
133429953,1cyclictest17299-21snmpd20:29:570
133429953,1cyclictest17299-21snmpd19:36:530
133429953,1cyclictest17299-21snmpd19:34:410
133429953,1cyclictest17299-21snmpd19:22:340
133429953,1cyclictest17299-21snmpd19:15:010
133429953,1cyclictest17299-21snmpd19:13:490
133429953,1cyclictest1053-21lldpd19:52:100
133429952,2cyclictest9676-21taskset20:17:040
133429952,2cyclictest646-21dbus-daemon20:40:000
133429952,2cyclictest17299-21snmpd20:20:180
133489942,1cyclictest15584-21smicount19:15:003
133469942,1cyclictest18446-21cstates20:40:141
133429944,0cyclictest9907-21kworker/0:220:35:090
133429944,0cyclictest20102-21kworker/0:120:55:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional