You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 10:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Thu Nov 27, 2025 00:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2814323890,2sleep10-21swapper/119:05:141
2900623020,2sleep30-21swapper/319:05:323
2892522700,2sleep20-21swapper/219:05:272
2980298157151,4cyclictest3724-21kworker/u8:1021:17:323
2979598153146,4cyclictest1050ksoftirqd/021:17:320
1025821270,2sleep10-21swapper/100:35:401
2980298123115,5cyclictest12246-21kworker/u8:2120:06:523
2979598120109,8cyclictest10-21ksoftirqd/020:06:520
2979598118105,10cyclictest10-21ksoftirqd/020:57:060
2980298116110,4cyclictest1859-21kworker/u8:7720:57:063
2832721130,3sleep30-21swapper/321:50:383
2980298108100,5cyclictest6134-21kworker/u8:10400:32:173
297959810795,8cyclictest10-21ksoftirqd/000:32:180
29801989991,5cyclictest9625-21kworker/u8:2621:17:312
29798989889,5cyclictest8509-21kworker/u8:920:06:521
29798989385,5cyclictest1807-21kworker/u8:1220:57:071
131042920,2chrt0-21swapper/323:35:203
131042920,2chrt0-21swapper/323:35:203
317642860,2sleep20-21swapper/200:14:372
29798988174,4cyclictest6087-21kworker/u8:5700:32:171
29802987063,5cyclictest10646-21kworker/u8:022:42:313
29795986958,8cyclictest10-21ksoftirqd/022:42:310
29801986154,4cyclictest15883-21kworker/u8:4620:06:522
29801985650,4cyclictest1861-21kworker/u8:7920:57:072
29802984639,4cyclictest14590-21kworker/u8:523:52:093
29801984639,4cyclictest6086-21kworker/u8:5600:32:182
29801984539,4cyclictest7465-21kworker/u8:2022:22:022
29798984338,3cyclictest13068-21kworker/u8:622:42:311
29802984134,4cyclictest19620-21kworker/u8:520:22:153
29795984134,4cyclictest1050ksoftirqd/023:52:090
29802984034,4cyclictest3649-21kworker/u8:900:37:123
29795984017,19cyclictest118150irq/29-4f00000.23:20:130
2979898392,10cyclictest121rcu_preempt22:00:141
29795983929,7cyclictest10-21ksoftirqd/000:37:120
29795983928,8cyclictest10-21ksoftirqd/020:22:140
2979898362,4cyclictest121rcu_preempt19:50:141
42052350,7sleep14204-21ntpq23:15:351
29802983428,3cyclictest14344-21kworker/u8:1321:32:033
307862330,2sleep230784-21awk20:45:022
271302330,2sleep10-21swapper/120:30:261
310662320,18sleep30-21swapper/320:45:323
303852320,11sleep331-21ksoftirqd/300:10:243
178032320,8sleep1191ksoftirqd/121:30:181
2979898313,6cyclictest19-21ksoftirqd/119:26:261
29795983122,7cyclictest10-21ksoftirqd/021:32:040
236602310,1sleep320563-21kworker/u8:222:50:163
73362300,18sleep33725-21kworker/u8:1121:06:033
316012300,3sleep131598-21ntpq23:05:261
2980198305,4cyclictest121rcu_preempt22:00:232
2979898304,3cyclictest121rcu_preempt21:55:141
2979898301,5cyclictest7449-21ntpq22:15:291
2979898301,5cyclictest7449-21ntpq22:15:281
278582300,17sleep127857-21ssh22:58:411
220322300,12sleep119-21ksoftirqd/123:53:241
155442300,9sleep2121rcu_preempt22:32:452
97782290,2sleep10-21swapper/123:27:491
75762290,14sleep1121rcu_preempt23:23:431
29802982912,14cyclictest31-21ksoftirqd/320:00:183
260382290,5sleep2251ksoftirqd/220:29:092
24902290,2sleep10-21swapper/123:12:211
207032290,2sleep30-21swapper/321:35:273
170482290,17sleep114336-21kworker/u8:321:28:341
106212290,11sleep119-21ksoftirqd/122:22:021
91792280,3sleep3121rcu_preempt23:25:423
56662280,6sleep331-21ksoftirqd/321:03:093
52892280,2sleep30-21swapper/319:30:123
47152280,6sleep3121rcu_preempt23:16:253
42382280,10sleep1121rcu_preempt21:00:151
38412280,16sleep33645-21kworker/u8:400:22:523
2979898287,5cyclictest19-21ksoftirqd/119:45:111
2979598287,6cyclictest20227-21idleruntime21:35:220
195002280,17sleep10-21swapper/123:47:251
123932280,3sleep2251ksoftirqd/222:25:372
117912280,17sleep30-21swapper/323:30:493
8942270,2sleep20-21swapper/219:18:372
71582270,1sleep34702-21kworker/u8:923:21:323
61692270,2sleep30-21swapper/300:27:173
4992270,3sleep119-21ksoftirqd/100:15:331
35052270,2sleep129792-21cyclictest22:07:261
34032270,2sleep30-21swapper/322:06:563
313422270,14sleep228499-21kworker/u8:1121:58:492
301832270,10sleep2121rcu_preempt20:41:052
2980298273,4cyclictest121rcu_preempt20:40:123
2980298272,3cyclictest121rcu_preempt21:55:133
29795982720,5cyclictest10-21ksoftirqd/020:00:170
258512270,3sleep123379-21kworker/u8:6020:26:421
252112270,2sleep10-21swapper/122:52:111
232792270,5sleep2251ksoftirqd/220:16:472
228822270,2sleep30-21swapper/322:47:173
21312270,7sleep2251ksoftirqd/200:20:122
213052270,3sleep121280-21apt-get22:45:191
179222270,5sleep2251ksoftirqd/220:03:502
139642270,2sleep30-21swapper/319:50:573
112772270,2sleep1191ksoftirqd/121:15:301
95022260,2sleep20-21swapper/223:26:182
85372260,3sleep38536-21ssh22:18:423
85372260,3sleep38536-21ssh22:18:423
84412260,2sleep10-21swapper/119:36:301
84412260,2sleep10-21swapper/119:36:301
62632260,5sleep2251ksoftirqd/222:14:272
62632260,5sleep2251ksoftirqd/222:14:272
41622260,14sleep232417-21kworker/u8:423:15:322
3032260,2sleep30-21swapper/323:08:533
2979898261,7cyclictest247422ntp_offset20:20:331
29795982616,6cyclictest10-21ksoftirqd/022:00:170
29795982615,7cyclictest10-21ksoftirqd/022:55:160
29795982612,11cyclictest118150irq/29-4f00000.22:05:350
28052260,14sleep221478-21kworker/u8:522:05:372
276162260,5sleep2251ksoftirqd/220:30:502
245322260,1sleep321827-21kworker/u8:423:59:143
21412260,3sleep12129-21apt-get00:20:151
119022260,2sleep10-21swapper/123:31:231
100372260,2sleep10-21swapper/121:14:311
100372260,2sleep10-21swapper/121:14:311
2980298252,3cyclictest121rcu_preempt00:15:143
2980198252,3cyclictest121rcu_preempt22:35:202
2980198251,4cyclictest0-21swapper/221:15:002
2980198251,4cyclictest0-21swapper/221:15:002
2980198251,21cyclictest27361-21ssh00:05:142
2979898251,12cyclictest0-21swapper/120:10:281
2979898251,11cyclictest312092kworker/u8:2200:14:371
26482250,14sleep32647-21ssh23:13:083
193372250,1sleep317010-21kworker/u8:4423:46:353
179782250,2sleep10-21swapper/122:37:591
173702250,2sleep217006-21kworker/u8:4023:43:522
146432250,1sleep39615-21kworker/u8:521:23:203
121502250,1sleep36652-21kworker/u8:2019:46:213
94852240,2sleep30-21swapper/321:11:503
94852240,2sleep30-21swapper/321:11:503
318332240,2sleep30-21swapper/319:15:093
304972240,2sleep10-21swapper/123:04:451
302002240,1sleep320570-21kworker/u8:823:03:113
2980198244,3cyclictest121rcu_preempt23:40:022
2980198244,3cyclictest121rcu_preempt23:40:012
2980198241,6cyclictest25-21ksoftirqd/221:30:322
2980198241,4cyclictest121rcu_preempt22:15:092
2980198241,4cyclictest121rcu_preempt22:15:082
2980198241,3cyclictest121rcu_preempt21:23:282
2980198241,3cyclictest0-21swapper/219:55:372
2979898247,10cyclictest229352chrt21:40:241
2979898241,5cyclictest121rcu_preempt20:15:181
29795982411,10cyclictest118150irq/29-4f00000.22:15:410
29795982411,10cyclictest118150irq/29-4f00000.22:15:400
29795982411,10cyclictest118150irq/29-4f00000.20:45:410
29795982410,10cyclictest118150irq/29-4f00000.22:35:300
285002240,2sleep10-21swapper/121:51:261
28352240,2sleep32698-21kworker/u8:919:23:413
282472240,2sleep10-21swapper/120:35:191
262782240,2sleep30-21swapper/321:47:133
253682240,5sleep2251ksoftirqd/220:23:382
220172240,12sleep221827-21kworker/u8:423:53:172
121742240,12sleep28500-21kworker/u8:019:46:362
10632240,1sleep327786-21kworker/u8:2920:50:263
103432240,3sleep10-21swapper/119:41:491
74432233,14sleep17447-21kworker/u8:221:07:241
59662230,2sleep10-21swapper/100:26:401
49032230,2sleep30-21swapper/319:28:233
326602230,12sleep225-21ksoftirqd/223:08:202
313282230,2sleep10-21swapper/119:11:491
312432230,2sleep30-21swapper/319:10:473
304592230,12sleep119-21ksoftirqd/120:44:301
2980198232,5cyclictest25-21ksoftirqd/221:45:002
2980198232,3cyclictest233122ssh23:55:262
2980198232,3cyclictest121rcu_preempt19:25:012
2980198232,3cyclictest121rcu_preempt00:00:262
2980198232,3cyclictest121rcu_preempt00:00:262
2980198231,7cyclictest6686-21cron00:30:002
2980198231,4cyclictest0-21swapper/222:40:422
2980198231,3cyclictest0-21swapper/223:30:242
2979898231,5cyclictest19-21ksoftirqd/100:00:081
2979898231,5cyclictest19-21ksoftirqd/100:00:081
2979898231,11cyclictest106562kworker/u8:1022:27:011
2979598239,4cyclictest118150irq/29-4f00000.21:25:000
2979598239,11cyclictest118150irq/29-4f00000.23:45:190
2979598239,11cyclictest118150irq/29-4f00000.23:35:520
2979598239,11cyclictest118150irq/29-4f00000.23:35:520
2979598237,6cyclictest118150irq/29-4f00000.00:15:430
2979598236,8cyclictest30106-21cat00:10:220
2979598234,6cyclictest10667-21/usr/sbin/munin23:30:190
29795982317,3cyclictest10-21ksoftirqd/023:55:150
29795982315,6cyclictest31533-21cron22:00:010
29795982315,4cyclictest0-21swapper/022:50:140
29795982310,10cyclictest118150irq/29-4f00000.20:10:310
274432230,2sleep20-21swapper/222:56:262
261402230,1sleep126111-21kworker/u8:121:46:271
260672230,2sleep30-21swapper/320:29:303
168362230,1sleep114801-21kworker/u8:2323:40:581
66272220,5sleep2251ksoftirqd/219:31:562
66162220,1sleep12691-21kworker/u8:419:31:471
2980298224,4cyclictest121rcu_preempt20:00:003
2980298221,3cyclictest121rcu_preempt22:35:143
2980198222,3cyclictest275432kworker/u8:1823:00:242
29801982215,4cyclictest23910-21df22:50:202
2980198221,3cyclictest121rcu_preempt23:15:022
2980198221,3cyclictest121rcu_preempt20:10:402
2980198221,3cyclictest0-21swapper/222:47:082
2980198221,3cyclictest0-21swapper/219:40:252
2979898221,8cyclictest14027-21wc21:20:451
29798982212,7cyclictest22042-21cron21:40:011
2979598229,10cyclictest118150irq/29-4f00000.22:30:450
2979598229,10cyclictest118150irq/29-4f00000.19:55:320
2979598228,7cyclictest0-21swapper/019:50:400
2979598227,5cyclictest118150irq/29-4f00000.23:05:120
2979598226,7cyclictest0-21swapper/021:45:400
2979598225,4cyclictest118150irq/29-4f00000.21:11:480
2979598225,4cyclictest118150irq/29-4f00000.21:11:480
29795982216,4cyclictest111rcuc/022:25:150
29795982212,7cyclictest10-21ksoftirqd/021:05:140
288542220,3sleep328853-21ssh00:06:463
17162220,5sleep2251ksoftirqd/220:51:032
160302220,1sleep115883-21kworker/u8:4619:58:341
150562220,1sleep114814-21kworker/u8:3623:39:131
150562220,1sleep114814-21kworker/u8:3623:39:131
13552220,10sleep225-21ksoftirqd/200:17:362
63062210,1sleep130930-21kworker/u8:1822:14:421
63062210,1sleep130930-21kworker/u8:1822:14:421
2980298211,7cyclictest121rcu_preempt22:59:023
29802982114,4cyclictest2081-21runrttasks22:13:183
29802982114,4cyclictest2081-21runrttasks22:13:173
2980198211,4cyclictest9455-21ssh00:35:212
29801982114,4cyclictest26807-21idleruntime-cro21:50:002
29801982112,6cyclictest7686-21sshd23:24:192
2980198211,11cyclictest0-21swapper/223:45:282
29801982110,3cyclictest25-21ksoftirqd/221:00:182
2980198210,3cyclictest0-21swapper/219:40:012
2980198210,3cyclictest0-21swapper/219:40:012
2979898212,5cyclictest19-21ksoftirqd/123:55:031
2979598219,9cyclictest118150irq/29-4f00000.20:40:250
2979598218,4cyclictest118150irq/29-4f00000.23:40:220
2979598218,10cyclictest118150irq/29-4f00000.23:25:240
2979598218,10cyclictest118150irq/29-4f00000.22:20:210
2979598217,4cyclictest118150irq/29-4f00000.23:15:170
2979598217,4cyclictest118150irq/29-4f00000.20:15:420
2979598217,4cyclictest118150irq/29-4f00000.19:40:290
2979598217,3cyclictest118150irq/29-4f00000.00:05:300
2979598217,11cyclictest118150irq/29-4f00000.21:00:280
2979598217,11cyclictest118150irq/29-4f00000.19:30:360
2979598217,11cyclictest118150irq/29-4f00000.19:25:520
2979598216,6cyclictest118150irq/29-4f00000.21:40:270
2979598216,4cyclictest118150irq/29-4f00000.22:45:390
29795982115,4cyclictest10-21ksoftirqd/022:10:360
29795982115,4cyclictest10-21ksoftirqd/022:10:350
29795982115,4cyclictest10-21ksoftirqd/021:25:120
29795982115,4cyclictest10-21ksoftirqd/020:30:100
29795982114,5cyclictest10-21ksoftirqd/000:20:300
29795982114,4cyclictest10-21ksoftirqd/023:00:310
29795982113,6cyclictest111rcuc/019:24:150
29795982113,5cyclictest10-21ksoftirqd/019:45:190
135312210,2sleep30-21swapper/322:29:473
8112200,9sleep331-21ksoftirqd/322:01:203
78882200,9sleep3301rcuc/319:35:283
78882200,9sleep3301rcuc/319:35:273
6762200,9sleep119-21ksoftirqd/119:16:151
2980298201,6cyclictest15568-21aten2_rfpower_e23:40:173
29802982013,4cyclictest9413-21if_err_eth122:20:233
29802982013,4cyclictest15415-21aten2_rfpower_v21:25:173
2980198201,4cyclictest121rcu_preempt19:25:312
2979898209,3cyclictest19-21ksoftirqd/120:47:251
2979898201,8cyclictest121rcu_preempt22:30:111
29798982013,4cyclictest2081-21runrttasks19:20:161
2979598207,4cyclictest118150irq/29-4f00000.23:10:110
2979598205,4cyclictest118150irq/29-4f00000.19:35:390
2979598205,4cyclictest118150irq/29-4f00000.19:35:380
29795982015,3cyclictest27342-21ssh21:50:230
29795982015,3cyclictest10-21ksoftirqd/000:25:360
29795982013,5cyclictest10-21ksoftirqd/019:15:140
176842200,10sleep119-21ksoftirqd/120:00:561
69322190,7sleep2241rcuc/221:05:382
2980298193,4cyclictest12245-21kworker/u8:1420:10:463
2980298191,7cyclictest2081-21runrttasks22:30:353
29802981913,3cyclictest28356-21kworker/u8:4320:40:003
29802981912,4cyclictest21950-21/usr/sbin/munin20:15:133
29802981912,4cyclictest2081-21runrttasks00:00:363
29802981912,4cyclictest2081-21runrttasks00:00:363
29802981910,6cyclictest31-21ksoftirqd/320:35:003
2980198192,3cyclictest276852kworker/u8:1220:39:482
2980198191,3cyclictest0-21swapper/221:54:442
29801981912,4cyclictest16309-21sendmail_mailtr21:25:412
29801981912,4cyclictest12714-21aten2_rfpower_c19:50:172
2979898196,3cyclictest121rcu_preempt20:50:191
29798981912,4cyclictest28184-21ntpq00:05:331
2979598195,4cyclictest118150irq/29-4f00000.20:50:120
2979598194,3cyclictest118150irq/29-4f00000.19:12:260
208222190,7sleep229792-21cyclictest21:35:352
2980298189,6cyclictest9259-21sshd19:40:193
29802981811,4cyclictest24449-21latency_hist21:45:013
2979598184,5cyclictest283872chrt20:36:590
29795981810,6cyclictest25286-21idleruntime00:00:250
29795981810,6cyclictest25286-21idleruntime00:00:250
29801981711,4cyclictest29993-21/usr/sbin/munin19:10:232
2979598179,6cyclictest29744-21latency_hist19:10:010
2979598163,10cyclictest23301-1kworker/u9:120:25:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional