You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 17:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Thu Dec 04, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1650221040,2sleep0135899cyclictest09:23:410
253212970,0sleep30-21swapper/312:33:413
324232890,0sleep10-21swapper/109:18:091
150242890,0sleep115010-21sshd09:27:271
172732840,0sleep117168-21sshd12:06:111
125152820,0sleep10-21swapper/110:56:261
145182680,0sleep20-21swapper/210:29:042
83482650,2sleep1136699cyclictest11:13:411
98872640,1sleep3401ktimersoftd/311:17:193
110672610,0sleep30-21swapper/311:13:593
271982590,0sleep10-21swapper/111:53:261
155552580,0sleep00-21swapper/011:17:560
69642560,1sleep16962-21lspci12:35:071
308602560,0sleep1241ktimersoftd/111:26:261
298862560,0sleep20-21swapper/209:40:142
325552550,1sleep032553-21sshd12:37:470
237812550,0sleep00-21swapper/010:36:550
223892550,0sleep00-21swapper/010:01:180
10552550,0sleep00-21swapper/010:30:580
275302540,1sleep10-21swapper/110:51:061
51512530,0sleep00-21swapper/011:37:270
47232530,0sleep00-21swapper/007:15:160
304882520,0sleep30-21swapper/309:21:363
195812510,0sleep20-21swapper/211:18:222
142642510,0sleep20-21swapper/210:49:472
124212490,1sleep212422-21grepconf.sh12:15:452
321452480,0sleep10-21swapper/111:23:101
175932480,0sleep20-21swapper/211:07:292
238632470,2sleep2137299cyclictest10:57:402
172762470,1sleep2311rcuc/210:00:402
262122410,0sleep20-21swapper/211:43:012
112323624,7sleep20-21swapper/207:08:472
53192350,0sleep10-21swapper/111:37:281
117922716,7sleep30-21swapper/307:09:163
106022211,7sleep10-21swapper/107:08:131
315662218,7sleep00-21swapper/007:05:000
1372992019,0cyclictest12050-21lspci09:38:152
133532190,0sleep30-21swapper/310:39:183
86662180,1sleep0111rcuc/011:51:250
183672180,1sleep218362-21sshd10:11:342
264642170,0sleep226470-21switchtime10:05:202
124012170,0sleep10-21swapper/107:35:101
308432160,0sleep20-21swapper/210:23:392
305462160,0sleep10-21swapper/110:34:161
213832160,0sleep30-21swapper/311:52:483
78102150,0sleep00-21swapper/011:41:030
320392150,1sleep0111rcuc/009:10:280
143002150,1sleep014296-21bash11:21:130
138099150,13cyclictest26143-21bash09:39:533
100352150,0sleep0111rcuc/010:24:530
232322140,0sleep00-21swapper/012:23:330
228622140,0sleep20-21swapper/212:06:492
148272140,0sleep20-21swapper/209:53:032
179552130,0sleep00-21swapper/012:13:070
14242130,0sleep10-21swapper/112:00:591
1358991311,1cyclictest19789-21sshd12:16:330
108902130,0sleep110889-21grep10:35:281
138099120,11cyclictest0-21swapper/309:43:333
137299120,11cyclictest554-21sshd09:29:392
137299120,11cyclictest1953-21bash11:57:392
137299120,11cyclictest0-21swapper/212:31:092
1366991210,1cyclictest681-21gdbus09:40:201
136699120,1cyclictest0-21swapper/111:55:421
1358991210,1cyclictest0-21swapper/011:57:430
135899120,11cyclictest522-21sshd10:09:430
135899120,11cyclictest0-21swapper/010:44:430
1380991110,0cyclictest0-21swapper/311:36:423
137299119,1cyclictest0-21swapper/211:23:192
137299119,1cyclictest0-21swapper/209:14:592
1372991110,0cyclictest0-21swapper/211:02:092
137299110,10cyclictest0-21swapper/209:09:192
137299110,0cyclictest0-21swapper/209:47:492
136699119,1cyclictest8688-21lspci09:45:111
136699110,1cyclictest30964-21lspci10:05:511
1358991110,0cyclictest0-21swapper/009:49:030
1358991110,0cyclictest0-21swapper/007:55:130
135899110,10cyclictest0-21swapper/009:53:530
135899110,10cyclictest0-21swapper/009:28:230
138099109,0cyclictest0-21swapper/312:09:133
138099109,0cyclictest0-21swapper/311:22:433
138099109,0cyclictest0-21swapper/309:58:533
138099109,0cyclictest0-21swapper/309:30:433
138099109,0cyclictest0-21swapper/309:19:033
138099109,0cyclictest0-21swapper/309:14:333
138099108,1cyclictest27886-21lspci11:33:033
138099100,0cyclictest0-21swapper/311:57:333
137299109,0cyclictest4542-21lspci11:47:342
137299109,0cyclictest0-21swapper/209:32:092
137299108,1cyclictest33-21ksoftirqd/211:31:242
137299105,1cyclictest33-21ksoftirqd/209:17:202
137299100,0cyclictest0-21swapper/211:26:192
136699109,0cyclictest0-21swapper/111:01:211
136699109,0cyclictest0-21swapper/109:58:311
136699109,0cyclictest0-21swapper/109:10:211
136699109,0cyclictest0-21swapper/108:09:411
136699108,1cyclictest8149-21sshd10:10:231
136699108,1cyclictest0-21swapper/112:32:111
136699100,0cyclictest0-21swapper/108:45:011
135899109,0cyclictest18039-21sshd10:53:430
135899109,0cyclictest0-21swapper/009:42:230
1358991010,0cyclictest0-21swapper/008:45:130
135899100,0cyclictest0-21swapper/008:28:230
25388290,1sleep025391-21bash11:08:230
13809997,1cyclictest29107-21lspci10:58:133
13809997,1cyclictest16031-21sshd10:29:133
13729997,1cyclictest33-21ksoftirqd/212:36:352
13729997,1cyclictest33-21ksoftirqd/212:27:172
13729997,1cyclictest33-21ksoftirqd/212:21:232
13729997,1cyclictest33-21ksoftirqd/210:54:142
13729997,1cyclictest33-21ksoftirqd/210:43:292
13729997,1cyclictest33-21ksoftirqd/210:33:342
13729997,1cyclictest33-21ksoftirqd/210:16:222
13729997,1cyclictest33-21ksoftirqd/209:58:262
13729996,1cyclictest33-21ksoftirqd/211:53:072
13729996,1cyclictest33-21ksoftirqd/211:35:252
13729995,3cyclictest33-21ksoftirqd/212:00:102
13669998,0cyclictest0-21swapper/112:17:321
13669998,0cyclictest0-21swapper/110:45:411
13669997,1cyclictest0-21swapper/111:47:121
13669997,1cyclictest0-21swapper/110:42:411
13589998,0cyclictest0-21swapper/012:26:530
13589998,0cyclictest0-21swapper/012:04:230
13589998,0cyclictest0-21swapper/010:28:430
13589997,1cyclictest22617-21sshd09:08:030
13589990,5cyclictest16395-21munin-run10:50:000
6619280,0sleep00-21swapper/010:14:040
3938280,1sleep33936-21sshd12:24:563
13809987,0cyclictest0-21swapper/312:01:133
13809987,0cyclictest0-21swapper/311:09:533
13809987,0cyclictest0-21swapper/310:42:233
13809986,1cyclictest14005-21sshd11:00:033
13809985,2cyclictest649-21avahi-daemon12:18:073
13809980,7cyclictest4001-21sshd10:34:523
13729986,1cyclictest33-21ksoftirqd/211:11:072
13729986,1cyclictest33-21ksoftirqd/209:21:462
13729986,1cyclictest26213-21lspci12:10:362
13729985,1cyclictest33-21ksoftirqd/210:35:092
13669987,0cyclictest0-21swapper/111:31:311
13669987,0cyclictest0-21swapper/109:31:211
13669986,1cyclictest20933-21sshd09:50:011
13669986,1cyclictest18145-21lspci10:29:271
13669986,1cyclictest12825-21lspci11:06:541
13669986,1cyclictest10520-21lspci09:38:041
13669986,1cyclictest0-21swapper/109:23:011
13669984,1cyclictest17547-21sshd10:00:421
13589987,0cyclictest0-21swapper/011:10:030
13589986,1cyclictest27225-21lspci09:32:290
13589986,1cyclictest20398-21lspci09:39:150
13589985,2cyclictest24441-21sshd12:33:350
32593270,5sleep332699-21lspci09:25:253
23320270,0sleep30-21swapper/311:42:423
21343270,1sleep321382-21grep09:07:313
17114270,1sleep1241ktimersoftd/109:05:161
13809976,0cyclictest0-21swapper/310:05:033
13809976,0cyclictest0-21swapper/309:45:233
13809975,1cyclictest649-21avahi-daemon10:45:063
13809975,1cyclictest649-21avahi-daemon10:01:043
13809975,1cyclictest41-21ksoftirqd/310:50:203
13809975,1cyclictest30780-21sshd10:16:363
13809975,1cyclictest19830-21lspci11:25:163
13809975,1cyclictest0-21swapper/310:11:133
13809974,2cyclictest700-21gdbus12:38:213
13809974,2cyclictest700-21gdbus12:10:203
13809974,2cyclictest649-21avahi-daemon11:47:143
13809974,2cyclictest649-21avahi-daemon09:54:093
13809974,2cyclictest646-21dbus-daemon10:20:453
13809974,2cyclictest30556-21sshd12:27:353
13729976,0cyclictest0-21swapper/207:50:092
13669976,0cyclictest0-21swapper/111:42:221
13669975,1cyclictest620-13audispd11:17:011
13669975,1cyclictest27400-21kworker/1:012:10:501
13669975,1cyclictest26530-21lspci12:27:081
13669975,1cyclictest20118-21kworker/1:108:15:121
13669974,2cyclictest649-21avahi-daemon10:20:471
13669974,2cyclictest22579-21sshd12:20:121
13589976,0cyclictest0-21swapper/011:49:130
13589975,1cyclictest20009-21bash10:15:230
13589975,1cyclictest15164-21lspci11:00:110
13589975,1cyclictest11017-21lspci11:31:150
13589974,2cyclictest649-21avahi-daemon12:07:010
13589974,2cyclictest649-21avahi-daemon09:56:060
13589973,3cyclictest616-13auditd11:26:490
9192260,1sleep19242-21smartctl07:25:191
13809964,1cyclictest31011-21mii-tool08:20:143
13809964,1cyclictest13709-21grep08:55:253
13809960,5cyclictest0-21swapper/308:51:333
13729964,1cyclictest33-21ksoftirqd/209:05:012
13729964,1cyclictest33-21ksoftirqd/208:50:002
13729964,1cyclictest33-21ksoftirqd/207:40:002
13729960,5cyclictest0-21swapper/208:59:092
13729960,5cyclictest0-21swapper/208:03:192
13729960,5cyclictest0-21swapper/207:18:092
13669965,1cyclictest20118-21kworker/1:108:33:551
13669965,0cyclictest20118-21kworker/1:108:55:021
13669965,0cyclictest0-21swapper/107:40:011
13669964,1cyclictest17105-21sshd10:15:121
13589965,0cyclictest0-21swapper/007:52:530
13589964,1cyclictest8182-21cpu07:25:120
13589964,1cyclictest2695-21sshd09:15:030
13589963,2cyclictest646-21dbus-daemon10:55:420
13589960,5cyclictest0-21swapper/007:33:030
13809954,0cyclictest0-21swapper/308:37:223
13809954,0cyclictest0-21swapper/307:50:133
13809953,1cyclictest9982-21turbostat07:30:003
13809953,1cyclictest700-21gdbus08:45:003
13809953,1cyclictest26947-21mii-tool08:10:133
13809953,1cyclictest17299-21snmpd08:30:063
13809953,1cyclictest17299-21snmpd08:26:573
13809953,1cyclictest17299-21snmpd08:15:363
13809953,1cyclictest17299-21snmpd08:05:033
13809953,1cyclictest17299-21snmpd08:00:033
13809953,1cyclictest17299-21snmpd07:56:563
13809953,1cyclictest17299-21snmpd07:45:563
13809953,1cyclictest17299-21snmpd07:33:503
13809953,1cyclictest17299-21snmpd07:21:553
13809953,1cyclictest17299-21snmpd07:15:493
13809953,1cyclictest1646-21cpuspeed_turbos07:10:113
13809952,2cyclictest9978-21chrt08:47:563
13809950,4cyclictest0-21swapper/307:40:433
13809950,1cyclictest14559-21cpuspeed_turbos09:00:113
13729954,0cyclictest0-21swapper/208:36:592
13729954,0cyclictest0-21swapper/207:22:082
13729953,1cyclictest8181-21/usr/sbin/munin07:25:122
13729953,1cyclictest28502-21/usr/sbin/munin08:15:202
13729953,1cyclictest20819-21cat07:55:132
13729953,1cyclictest17299-21snmpd08:40:012
13729953,1cyclictest17299-21snmpd08:30:152
13729953,1cyclictest17299-21snmpd08:26:272
13729953,1cyclictest17299-21snmpd08:10:062
13729953,1cyclictest17299-21snmpd08:08:512
13729953,1cyclictest17299-21snmpd07:45:252
13729953,1cyclictest17299-21snmpd07:30:082
13729953,1cyclictest17299-21snmpd07:12:252
13729953,1cyclictest15621-21sshd07:40:222
13729953,1cyclictest10881-21cat08:50:152
13729950,4cyclictest30538-21/usr/sbin/munin08:20:152
13669955,0cyclictest23503-21kworker/1:207:50:001
13669955,0cyclictest23503-21kworker/1:207:45:011
13669955,0cyclictest23503-21kworker/1:207:30:031
13669955,0cyclictest23503-21kworker/1:207:20:031
13669955,0cyclictest23503-21kworker/1:207:15:331
13669955,0cyclictest23503-21kworker/1:207:10:001
13669955,0cyclictest20118-21kworker/1:109:00:061
13669955,0cyclictest20118-21kworker/1:108:50:111
13669955,0cyclictest20118-21kworker/1:108:40:041
13669955,0cyclictest20118-21kworker/1:108:25:081
13669955,0cyclictest20118-21kworker/1:108:10:061
13669955,0cyclictest20118-21kworker/1:108:00:241
13669955,0cyclictest20118-21kworker/1:107:55:101
13669954,0cyclictest20118-21kworker/1:108:35:021
13669954,0cyclictest20118-21kworker/1:108:20:051
13589954,0cyclictest0-21swapper/008:06:030
13589953,1cyclictest7052-21open_inodes07:20:190
13589953,1cyclictest22888-21cat08:00:120
13589953,1cyclictest17299-21snmpd09:00:340
13589953,1cyclictest17299-21snmpd08:55:040
13589953,1cyclictest17299-21snmpd08:50:580
13589953,1cyclictest17299-21snmpd08:38:580
13589953,1cyclictest17299-21snmpd08:20:540
13589953,1cyclictest17299-21snmpd08:10:330
13589953,1cyclictest17299-21snmpd07:41:560
13589953,1cyclictest17299-21snmpd07:36:410
13589953,1cyclictest16792-21cat07:45:120
13589953,1cyclictest1053-21lldpd08:40:170
13589953,1cyclictest1053-21lldpd07:12:080
13589953,1cyclictest0-21swapper/008:30:170
13589952,2cyclictest28769-21df_inode08:15:120
13809942,1cyclictest12560-21grep07:35:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional