You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 06:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Fri Nov 28, 2025 00:45:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1204522970,2sleep30-21swapper/319:05:323
1204522970,2sleep30-21swapper/319:05:313
1289222710,1sleep212626-21kworker/u8:2219:10:012
1289222710,1sleep212626-21kworker/u8:2219:10:002
1200822570,2sleep10-21swapper/119:05:301
1200822570,2sleep10-21swapper/119:05:301
1292298201191,6cyclictest20043-21kworker/u8:3419:31:481
1292198196189,4cyclictest1050ksoftirqd/019:31:480
1292498185180,3cyclictest20102-21kworker/u8:9319:31:472
1292898164158,4cyclictest25760-21kworker/u8:5219:57:243
1292898141134,4cyclictest8277-21kworker/u8:2920:32:133
1292898141134,4cyclictest8277-21kworker/u8:2920:32:133
1292898121115,4cyclictest25768-21kworker/u8:6019:47:103
1292198114104,7cyclictest10-21ksoftirqd/019:57:240
1292898113108,3cyclictest5302-21kworker/u8:2100:02:083
1292298113106,4cyclictest29513-21kworker/u8:4719:57:241
129249810295,4cyclictest29468-21kworker/u8:119:57:242
12922989991,5cyclictest12049-21kworker/u8:921:01:541
12922989991,5cyclictest12049-21kworker/u8:921:01:541
12928989590,3cyclictest21485-21kworker/u8:3122:16:443
12921989589,3cyclictest1050ksoftirqd/021:01:540
12921989589,3cyclictest1050ksoftirqd/021:01:540
12921988979,7cyclictest10-21ksoftirqd/020:32:130
12921988979,7cyclictest10-21ksoftirqd/020:32:130
12924988881,4cyclictest12048-21kworker/u8:721:01:552
12924988881,4cyclictest12048-21kworker/u8:721:01:542
12924987771,4cyclictest10143-21kworker/u8:420:32:132
12924987771,4cyclictest10143-21kworker/u8:420:32:132
12921987160,8cyclictest10-21ksoftirqd/019:47:100
12922986762,3cyclictest25770-21kworker/u8:6219:47:101
12921986654,8cyclictest10-21ksoftirqd/000:02:080
12922986556,4cyclictest10121-21kworker/u8:4600:02:081
137662640,3sleep110188-21kworker/u8:5520:35:441
137662640,3sleep110188-21kworker/u8:5520:35:441
12924986052,5cyclictest25722-21kworker/u8:1019:47:102
12928985651,3cyclictest15926-21kworker/u8:823:12:103
12928985651,3cyclictest15926-21kworker/u8:823:12:103
12924985445,6cyclictest2853-21kworker/u8:2900:02:082
12928985344,6cyclictest20037-21kworker/u8:2819:31:483
12922985145,3cyclictest32256-21kworker/u8:3621:27:301
12921985144,4cyclictest1050ksoftirqd/021:27:300
282592490,9sleep1121rcu_preempt23:29:141
185472490,2sleep20-21swapper/200:15:242
12921984737,7cyclictest10-21ksoftirqd/020:27:060
12921984636,7cyclictest10-21ksoftirqd/022:16:440
252552450,3sleep2251ksoftirqd/219:40:402
252552450,3sleep2251ksoftirqd/219:40:392
203372450,15sleep10-21swapper/119:29:451
12922984538,4cyclictest8265-21kworker/u8:1720:27:061
12922984538,4cyclictest19061-21kworker/u8:822:16:431
12928984439,3cyclictest10188-21kworker/u8:5520:41:263
12924984335,5cyclictest27392-21kworker/u8:1221:27:312
53572420,5sleep1191ksoftirqd/123:47:121
12928983933,3cyclictest736-21kworker/u8:1320:16:513
315952380,3chrt0-21swapper/322:29:023
1292498382,3cyclictest121rcu_preempt23:45:202
12928983731,3cyclictest32737-21kworker/u8:2423:46:513
1292898368,7cyclictest121rcu_preempt21:50:163
1292898368,7cyclictest121rcu_preempt21:50:163
213182350,8sleep2251ksoftirqd/222:05:442
1292898358,5cyclictest31-21ksoftirqd/320:05:153
1292898358,5cyclictest31-21ksoftirqd/320:05:153
1292898357,5cyclictest121rcu_preempt22:45:343
12924983528,4cyclictest8257-21kworker/u8:1120:27:062
1292498351,3cyclictest121rcu_preempt21:15:132
1292498351,3cyclictest121rcu_preempt00:05:122
12921983528,5cyclictest10-21ksoftirqd/023:35:140
12921983526,4cyclictest10-21ksoftirqd/021:10:160
12924983427,4cyclictest21685-21kworker/u8:4922:16:432
12922983426,5cyclictest21967-21kworker/u8:1719:36:551
12922983424,5cyclictest19-21ksoftirqd/121:15:131
1292898335,5cyclictest31-21ksoftirqd/323:40:223
12922983326,4cyclictest10653-21kworker/u8:3023:22:111
1292898327,4cyclictest121rcu_preempt19:25:183
1292898327,3cyclictest121rcu_preempt23:50:373
1292898325,4cyclictest121rcu_preempt22:20:213
12928983225,5cyclictest26334-21kworker/u8:2522:32:023
12928983211,4cyclictest121rcu_preempt23:15:403
12922983213,4cyclictest19-21ksoftirqd/123:15:141
8042310,6sleep225-21ksoftirqd/223:40:002
55282310,2sleep35529-21latency_hist21:35:013
35042310,2sleep2121rcu_preempt21:30:212
297802310,3sleep329761-21munin-run19:55:013
1292898319,4cyclictest121rcu_preempt21:25:103
1292898316,4cyclictest121rcu_preempt22:00:243
1292898315,4cyclictest121rcu_preempt00:10:283
1292898314,5cyclictest0-21swapper/319:10:293
1292898313,4cyclictest121rcu_preempt21:45:013
12928983114,4cyclictest121rcu_preempt22:55:143
1292298316,4cyclictest121rcu_preempt20:20:191
87642300,6sleep225-21ksoftirqd/222:49:162
34632300,7sleep2251ksoftirqd/223:44:472
1292898309,13cyclictest121rcu_preempt23:05:353
1292898309,13cyclictest121rcu_preempt23:05:343
1292898308,4cyclictest121rcu_preempt23:00:143
1292898308,4cyclictest121rcu_preempt21:25:023
1292898302,4cyclictest121rcu_preempt00:35:373
1292898301,6cyclictest121rcu_preempt00:30:173
12928983011,3cyclictest121rcu_preempt19:40:003
1292498301,3cyclictest121rcu_preempt23:15:172
1292298305,5cyclictest121rcu_preempt22:55:171
12922983018,9cyclictest2536-21switchtime23:40:561
12921983024,3cyclictest1050ksoftirqd/023:22:120
83292290,3sleep28328-21sshd20:22:342
50002290,7sleep1191ksoftirqd/121:33:071
290282290,6sleep1191ksoftirqd/122:23:101
278252290,7sleep2251ksoftirqd/223:26:542
1292898298,5cyclictest121rcu_preempt23:20:143
1292898296,4cyclictest121rcu_preempt21:15:273
1292898296,4cyclictest121rcu_preempt20:15:003
1292898294,3cyclictest121rcu_preempt00:15:253
1292898293,6cyclictest31-21ksoftirqd/320:55:353
1292898291,5cyclictest31-21ksoftirqd/321:10:373
1292498294,6cyclictest25-21ksoftirqd/223:10:002
1292498294,6cyclictest25-21ksoftirqd/223:09:592
1292498291,3cyclictest121rcu_preempt23:50:192
1292498291,3cyclictest121rcu_preempt22:00:122
1292498291,3cyclictest121rcu_preempt21:55:142
1292298291,3cyclictest121rcu_preempt22:40:131
12921982924,3cyclictest1050ksoftirqd/019:36:550
12921982923,4cyclictest10-21ksoftirqd/023:50:160
98402280,2sleep20-21swapper/221:43:252
73532280,2sleep30-21swapper/321:38:083
63902280,3sleep1191ksoftirqd/120:17:061
34752280,2sleep20-21swapper/222:36:172
321222280,1sleep129791-21kworker/u8:2021:21:481
288562280,1sleep227040-21kworker/u8:1700:35:432
276702280,7sleep331-21ksoftirqd/323:25:573
270232280,5sleep225-21ksoftirqd/200:31:532
189522280,2sleep10-21swapper/122:00:541
168472280,2sleep20-21swapper/219:20:132
162372280,5sleep331-21ksoftirqd/319:16:133
159832280,4sleep12857-1kworker/u9:300:10:161
1292898289,10cyclictest121rcu_preempt22:05:253
1292898288,13cyclictest31-21ksoftirqd/322:38:213
1292898288,10cyclictest121rcu_preempt22:10:323
1292898286,4cyclictest121rcu_preempt00:25:033
1292898286,3cyclictest121rcu_preempt00:05:303
12928982822,4cyclictest31-21ksoftirqd/319:20:313
1292498281,3cyclictest121rcu_preempt23:10:292
1292498281,3cyclictest121rcu_preempt23:10:282
1292498281,3cyclictest121rcu_preempt20:35:142
1292498281,3cyclictest121rcu_preempt20:35:142
1292298287,5cyclictest121rcu_preempt00:40:001
1292298287,4cyclictest121rcu_preempt21:35:191
1292198287,4cyclictest118150irq/29-4f00000.21:35:270
12921982811,14cyclictest118150irq/29-4f00000.00:35:300
12921982811,11cyclictest118150irq/29-4f00000.20:55:310
100452280,2sleep10-21swapper/122:50:311
89132270,4sleep28879-21ssh23:55:252
77832270,2sleep36366-21kworker/u8:420:20:383
76062270,8sleep1191ksoftirqd/123:51:261
323812270,3sleep30-21swapper/323:35:473
240082270,2sleep20-21swapper/219:39:082
170632270,3sleep115703-21kworker/u8:020:45:371
168042270,16sleep30-21swapper/321:57:173
165332270,5sleep1191ksoftirqd/121:55:461
142192270,14sleep2241rcuc/223:00:152
1292898277,4cyclictest121rcu_preempt21:05:463
1292898275,5cyclictest121rcu_preempt21:05:003
1292898275,5cyclictest121rcu_preempt21:05:003
1292898275,4cyclictest121rcu_preempt21:50:003
1292898275,3cyclictest121rcu_preempt20:45:163
1292898275,3cyclictest121rcu_preempt20:25:333
1292898273,4cyclictest121rcu_preempt19:40:273
1292898273,4cyclictest121rcu_preempt19:40:273
1292898272,5cyclictest121rcu_preempt20:00:323
1292898272,3cyclictest121rcu_preempt20:50:453
1292898271,3cyclictest121rcu_preempt23:35:013
1292498273,4cyclictest121rcu_preempt21:25:002
1292498272,3cyclictest121rcu_preempt22:40:342
1292298276,4cyclictest121rcu_preempt22:35:241
1292298275,6cyclictest19-21ksoftirqd/122:05:231
12922982719,5cyclictest16366-21kworker/u8:1819:22:351
12922982710,4cyclictest19-21ksoftirqd/100:30:001
1292198279,4cyclictest118150irq/29-4f00000.23:05:440
1292198279,4cyclictest118150irq/29-4f00000.23:05:430
9892260,2sleep20-21swapper/222:31:062
75862260,2sleep20-21swapper/221:39:182
311222260,14sleep126333-21kworker/u8:2422:26:351
183692260,2sleep10-21swapper/120:50:231
176232260,2sleep20-21swapper/220:47:022
139132260,1sleep312049-21kworker/u8:920:37:313
139132260,1sleep312049-21kworker/u8:920:37:313
1292898266,5cyclictest121rcu_preempt23:55:163
1292898265,4cyclictest121rcu_preempt22:50:423
1292898265,4cyclictest121rcu_preempt22:40:293
1292498265,4cyclictest121rcu_preempt22:10:252
1292498261,3cyclictest121rcu_preempt00:25:162
1292298269,5cyclictest19-21ksoftirqd/121:10:151
12922982615,8cyclictest27211-21ssh00:32:491
12922982614,3cyclictest19-21ksoftirqd/120:30:361
12922982614,3cyclictest19-21ksoftirqd/120:30:361
109682260,1sleep210654-21kworker/u8:3122:53:192
315292250,2sleep20-21swapper/222:28:412
287002250,7sleep1121rcu_preempt23:30:141
27492250,2sleep10-21swapper/120:07:451
27492250,2sleep10-21swapper/120:07:451
220922250,2sleep20-21swapper/200:20:502
158952250,1sleep212048-21kworker/u8:720:43:492
142902250,3sleep20-21swapper/221:51:342
142902250,3sleep20-21swapper/221:51:332
1292498259,4cyclictest25-21ksoftirqd/219:15:152
1292498252,8cyclictest121rcu_preempt20:15:332
1292498251,4cyclictest121rcu_preempt19:10:282
1292498251,2cyclictest121rcu_preempt20:05:152
1292498251,2cyclictest121rcu_preempt20:05:152
1292498250,6cyclictest28940-21ls23:30:212
12922982513,4cyclictest19-21ksoftirqd/119:10:281
12921982517,5cyclictest10-21ksoftirqd/000:25:170
12921982515,7cyclictest10-21ksoftirqd/022:37:090
1292198251,10cyclictest203612basename22:05:260
12921982510,5cyclictest118150irq/29-4f00000.00:15:460
12921982510,10cyclictest10-21ksoftirqd/022:50:410
96802240,12sleep14727-21kworker/u8:921:42:351
294322240,2sleep125756-21kworker/u8:4819:51:571
153982240,2sleep10-21swapper/100:09:401
142302240,1sleep111980-21kworker/u8:121:51:131
142302240,1sleep111980-21kworker/u8:121:51:121
1292898244,4cyclictest121rcu_preempt00:20:183
1292498243,3cyclictest121rcu_preempt19:50:252
1292498241,3cyclictest121rcu_preempt00:10:112
1292298241,4cyclictest0-21swapper/120:00:421
1292198249,4cyclictest118150irq/29-4f00000.23:25:370
1292198249,4cyclictest118150irq/29-4f00000.00:10:450
1292198248,4cyclictest118150irq/29-4f00000.20:20:230
1292198248,4cyclictest118150irq/29-4f00000.19:50:470
1292198247,4cyclictest118150irq/29-4f00000.22:25:440
1292198247,4cyclictest118150irq/29-4f00000.00:05:290
12921982411,3cyclictest118150irq/29-4f00000.23:00:300
254362230,1sleep225267-21kworker/u8:821:09:142
239072230,1sleep123404-21kworker/u8:021:05:121
215062230,12sleep225-21ksoftirqd/220:56:402
165062230,2sleep10-21swapper/119:19:151
1292498232,8cyclictest121rcu_preempt20:50:442
1292498231,3cyclictest121rcu_preempt22:55:282
12924982313,3cyclictest25-21ksoftirqd/219:26:472
1292498231,2cyclictest121rcu_preempt22:20:312
1292498231,11cyclictest0-21swapper/221:45:272
1292198239,4cyclictest118150irq/29-4f00000.22:00:140
1292198239,4cyclictest118150irq/29-4f00000.00:30:400
1292198239,3cyclictest118150irq/29-4f00000.19:10:360
1292198238,4cyclictest118150irq/29-4f00000.23:58:350
1292198238,4cyclictest118150irq/29-4f00000.21:05:310
1292198238,4cyclictest118150irq/29-4f00000.20:35:340
1292198238,4cyclictest118150irq/29-4f00000.20:35:340
1292198234,17cyclictest111rcuc/021:15:290
1292198233,9cyclictest214872kworker/u8:3322:13:330
12921982318,3cyclictest10-21ksoftirqd/021:40:140
1292198231,10cyclictest163652kworker/u8:1619:21:270
46342220,11sleep225-21ksoftirqd/220:13:212
1292498222,7cyclictest121rcu_preempt23:20:432
1292498221,2cyclictest121rcu_preempt20:00:352
1292298225,4cyclictest121rcu_preempt22:45:351
1292298224,5cyclictest121rcu_preempt21:45:141
1292298222,3cyclictest121rcu_preempt23:05:421
1292298222,3cyclictest121rcu_preempt23:05:411
1292298222,3cyclictest121rcu_preempt20:45:011
1292298221,7cyclictest14768-21irqrtprio23:00:411
1292298221,3cyclictest121rcu_preempt23:40:001
1292298221,3cyclictest0-21swapper/122:12:571
1292198229,3cyclictest118150irq/29-4f00000.20:10:260
1292198228,4cyclictest118150irq/29-4f00000.22:45:340
1292198227,4cyclictest118150irq/29-4f00000.20:50:420
12921982214,5cyclictest10-21ksoftirqd/023:30:160
12921982212,8cyclictest984-21sh22:31:060
1292198221,10cyclictest181332kworker/u9:223:12:210
1292198221,10cyclictest181332kworker/u9:223:12:210
1292298212,3cyclictest121rcu_preempt22:30:201
1292298211,3cyclictest121rcu_preempt19:40:161
1292298211,3cyclictest121rcu_preempt19:40:161
1292198219,3cyclictest118150irq/29-4f00000.19:10:020
1292198219,3cyclictest118150irq/29-4f00000.19:10:020
1292198217,4cyclictest118150irq/29-4f00000.23:45:350
1292198217,4cyclictest118150irq/29-4f00000.23:20:000
1292198212,10cyclictest238392kworker/u9:020:01:390
12921982115,3cyclictest10-21ksoftirqd/021:30:150
12921982113,3cyclictest10-21ksoftirqd/020:40:160
1292498201,3cyclictest121rcu_preempt21:10:242
1292298204,5cyclictest19-21ksoftirqd/100:23:061
1292298202,3cyclictest121rcu_preempt00:15:191
1292298201,7cyclictest25520-21diskmemload23:10:201
1292298201,7cyclictest25520-21diskmemload23:10:191
12922982013,4cyclictest8733-21cpu23:55:191
1292198207,4cyclictest118150irq/29-4f00000.21:50:320
1292198207,4cyclictest118150irq/29-4f00000.21:50:320
1292198207,4cyclictest118150irq/29-4f00000.20:45:130
1292198207,4cyclictest118150irq/29-4f00000.19:40:310
1292198207,4cyclictest118150irq/29-4f00000.19:40:310
1292198206,4cyclictest118150irq/29-4f00000.21:48:270
12921982013,5cyclictest15248-21ssh21:55:160
1292298194,3cyclictest121rcu_preempt20:55:191
1292198199,7cyclictest3017-21latency_hist20:10:010
1292198199,7cyclictest3017-21latency_hist20:10:010
1292198197,3cyclictest118150irq/29-4f00000.20:15:450
12921981914,3cyclictest10-21ksoftirqd/022:20:140
12921981913,3cyclictest10-21ksoftirqd/021:20:330
12921981912,5cyclictest10-21ksoftirqd/023:40:160
12921981911,6cyclictest18689-21/usr/sbin/munin19:25:300
12921981911,6cyclictest11950-21irqrtprio22:55:240
1292298181,3cyclictest121rcu_preempt20:10:171
12921981813,3cyclictest4476-21ssh22:40:140
12921981811,4cyclictest10-21ksoftirqd/019:15:300
12921981810,6cyclictest21673-21ntpq00:20:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional