You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 21:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot4.osadl.org (updated Wed Dec 03, 2025 12:45:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1384923260,2sleep211735-21kworker/u8:3607:10:002
1354122720,2sleep30-21swapper/307:06:153
1375622590,1sleep113599-21kworker/u8:207:08:581
1391398225213,8cyclictest25121-21kworker/u8:2209:11:471
1391398225213,8cyclictest25121-21kworker/u8:2209:11:461
1391198213207,3cyclictest1050ksoftirqd/009:11:460
1391198213207,3cyclictest1050ksoftirqd/009:11:460
1391498174165,6cyclictest26974-21kworker/u8:2709:11:472
1391498174165,6cyclictest26974-21kworker/u8:2709:11:462
1391998134125,6cyclictest25120-21kworker/u8:2109:11:463
1391998134125,6cyclictest25120-21kworker/u8:2109:11:463
13913987568,4cyclictest24572-21kworker/u8:1611:26:561
13913987568,4cyclictest19693-21kworker/u8:2807:32:391
13911987462,9cyclictest10-21ksoftirqd/007:32:390
13911987161,7cyclictest10-21ksoftirqd/011:26:560
220482630,3sleep219701-21kworker/u8:3607:30:172
13913986256,4cyclictest7760-21kworker/u8:5408:31:541
13911986251,8cyclictest10-21ksoftirqd/008:31:540
13911985545,7cyclictest10-21ksoftirqd/011:06:270
13911985545,7cyclictest10-21ksoftirqd/011:06:270
91692480,3sleep19141-21ssh11:50:591
13913984842,4cyclictest2893-21kworker/u8:910:41:531
13911984737,7cyclictest10-21ksoftirqd/010:41:530
128602450,2sleep30-21swapper/309:45:293
20782440,16sleep225-21ksoftirqd/208:01:292
20782440,16sleep225-21ksoftirqd/208:01:292
34292390,1sleep10-21swapper/110:34:291
1391498381,3cyclictest121rcu_preempt10:25:142
60252360,10sleep26026-21cat09:30:402
60252360,10sleep26026-21cat09:30:392
13913983628,4cyclictest4009-21kworker/u8:2708:22:371
13911983627,6cyclictest10-21ksoftirqd/008:25:160
103992350,15sleep331-21ksoftirqd/311:55:123
13911983422,9cyclictest10-21ksoftirqd/008:22:370
97032310,3sleep10-21swapper/110:45:431
284782310,4sleep1191ksoftirqd/107:45:401
274402310,4sleep127438-21ntpq10:15:301
257072310,3sleep225206-21apt-get11:20:072
255692310,7sleep331-21ksoftirqd/310:11:033
155872310,2chrt15581-21ssh09:50:411
13922310,5sleep11397-21cat08:00:311
13922310,5sleep11397-21cat08:00:311
13913983116,4cyclictest19-21ksoftirqd/108:35:441
13913983116,4cyclictest19-21ksoftirqd/108:35:431
13911983123,6cyclictest10-21ksoftirqd/009:30:150
13911983123,6cyclictest10-21ksoftirqd/009:30:150
26212300,2sleep20-21swapper/208:05:152
13913983023,4cyclictest16135-21kworker/u8:2409:56:501
13913983015,4cyclictest19-21ksoftirqd/110:50:401
196832290,2sleep20-21swapper/212:14:532
1391998291,9cyclictest144672basename07:10:323
1391998291,4cyclictest121rcu_preempt09:20:163
1391998291,4cyclictest121rcu_preempt09:20:153
13911982922,5cyclictest10-21ksoftirqd/008:40:140
13911982922,4cyclictest111rcuc/011:30:170
121642290,2sleep10-21swapper/109:45:031
100372290,2sleep20-21swapper/209:40:322
90302280,2sleep27813-21kworker/u8:210:45:232
257912280,2sleep10-21swapper/110:12:171
238872280,1sleep121566-21kworker/u8:5507:35:191
1391498284,4cyclictest25-21ksoftirqd/209:54:142
1391498284,3cyclictest121rcu_preempt11:40:162
13913982821,4cyclictest17741-21kworker/u8:1208:47:111
13911982818,8cyclictest10-21ksoftirqd/009:56:490
122122280,2sleep20-21swapper/209:45:112
66102270,6sleep119-21ksoftirqd/109:33:251
66102270,6sleep119-21ksoftirqd/109:33:251
40842270,2sleep10-21swapper/108:08:191
310792270,10sleep1121rcu_preempt12:37:161
300012270,3sleep213908-21cyclictest09:15:122
300012270,3sleep213908-21cyclictest09:15:122
240962270,2sleep10-21swapper/112:23:211
216212270,2sleep10-21swapper/112:17:381
212392270,1sleep20-21swapper/210:03:252
208452270,5sleep1191ksoftirqd/110:01:141
18592270,2sleep11858-21ssh11:36:231
156452270,5sleep2251ksoftirqd/207:11:222
1391498274,4cyclictest121rcu_preempt09:00:362
1391498274,4cyclictest121rcu_preempt09:00:352
1391498272,4cyclictest121rcu_preempt11:25:192
1391398271,4cyclictest121rcu_preempt10:35:141
13911982720,4cyclictest10-21ksoftirqd/008:00:410
13911982720,4cyclictest10-21ksoftirqd/008:00:400
110772270,6sleep2121rcu_preempt10:50:112
99552260,2sleep20-21swapper/211:54:022
89372260,2sleep331561-21kworker/u8:809:38:043
85792260,15sleep10-21swapper/109:36:141
58482260,1sleep14009-21kworker/u8:2708:12:211
56052260,6sleep156011telnet11:45:201
3472260,14sleep330793-21kworker/u8:2907:59:213
326532260,14sleep230793-21kworker/u8:2907:57:152
316702260,1sleep131566-21kworker/u8:1209:17:281
316702260,1sleep131566-21kworker/u8:1209:17:271
29332260,2sleep20-21swapper/210:31:572
245682260,15sleep3301rcuc/307:35:333
232962260,5sleep123295-21ssh10:06:341
232942260,1sleep27739-21kworker/u8:3308:57:192
187022260,2sleep20-21swapper/209:57:422
178742260,1sleep115096-21kworker/u8:1711:04:171
178742260,1sleep115096-21kworker/u8:1711:04:161
153752260,2sleep20-21swapper/210:58:552
147032260,1sleep211922-21kworker/u8:1612:03:392
141752260,2sleep10-21swapper/112:00:491
1391498267,9cyclictest121rcu_preempt11:56:072
1391498264,15cyclictest23293-21/usr/sbin/munin12:20:402
1391498261,6cyclictest8173-21apt-config08:20:022
1391498261,6cyclictest8173-21apt-config08:20:022
1391498261,4cyclictest0-21swapper/211:35:442
1391198268,12cyclictest29758-21diskstats12:35:220
13911982616,7cyclictest111rcuc/011:55:420
113622260,2sleep14665-21kworker/u8:1011:55:421
99922250,2sleep30-21swapper/308:24:093
318932250,2sleep20-21swapper/211:31:212
307412250,4sleep130740-21ssh11:30:201
273732250,3sleep127372-21df_inode12:30:201
272762250,2sleep127264-21kworker/u8:5111:21:591
270342250,1sleep219694-21kworker/u8:2907:41:232
270342250,1sleep219694-21kworker/u8:2907:41:232
264372250,5sleep3311ksoftirqd/312:28:013
232462250,1sleep221000-21kworker/u8:610:06:192
203152250,2sleep10-21swapper/107:25:421
202732250,2sleep20-21swapper/207:25:342
195402250,12sleep311921-21kworker/u8:1512:14:063
1391998255,3cyclictest121rcu_preempt11:35:173
1391998251,5cyclictest18698-21ssh11:05:243
1391998251,5cyclictest18698-21ssh11:05:243
1391998251,4cyclictest121rcu_preempt12:00:283
1391498254,3cyclictest121rcu_preempt12:35:012
1391498252,3cyclictest121rcu_preempt11:10:352
1391498251,5cyclictest18993-21ntpq08:45:312
1391498251,4cyclictest5805-21ssh11:45:262
1391498251,3cyclictest121rcu_preempt07:20:432
1391198259,4cyclictest118150irq/29-4f00000.12:15:230
1391198256,8cyclictest2009-21rm09:24:180
1391198256,8cyclictest2009-21rm09:24:180
13911982519,4cyclictest10-21ksoftirqd/011:45:420
13911982513,6cyclictest14190-21rm09:49:130
128352250,12sleep310275-21kworker/u8:010:53:053
76312240,1sleep15864-21kworker/u8:908:16:321
76312240,1sleep15864-21kworker/u8:908:16:311
53052240,3sleep35304-21ssh10:36:443
51332240,12sleep332048-21kworker/u8:911:44:573
272302240,12sleep327160-21kworker/u8:1807:43:413
272302240,12sleep327160-21kworker/u8:1807:43:413
253222240,1sleep219685-21kworker/u8:2007:38:222
239172240,2sleep30-21swapper/310:09:573
178752240,12sleep20-21swapper/207:18:102
178522240,2sleep10-21swapper/108:43:261
156342240,2sleep10-21swapper/107:11:131
1391998243,5cyclictest31-21ksoftirqd/310:31:443
1391998242,5cyclictest31-21ksoftirqd/308:25:163
1391998241,5cyclictest15864-21apt-get08:40:173
1391998241,3cyclictest121rcu_preempt08:45:263
1391498245,3cyclictest121rcu_preempt10:40:452
1391498244,4cyclictest121rcu_preempt10:20:112
1391498244,3cyclictest121rcu_preempt08:40:382
1391498241,5cyclictest9548-21sshd09:40:012
1391498241,4cyclictest0-21swapper/208:25:252
1391398243,3cyclictest121rcu_preempt09:20:241
1391398243,3cyclictest121rcu_preempt09:20:231
1391398242,7cyclictest121rcu_preempt11:05:231
1391398242,7cyclictest121rcu_preempt11:05:221
1391198249,6cyclictest31171-21threads09:15:430
1391198249,6cyclictest31171-21threads09:15:420
1391198245,9cyclictest26302-21runrttasks12:27:150
13911982415,6cyclictest10-21ksoftirqd/007:50:150
13911982414,7cyclictest111rcuc/007:45:150
13911982413,9cyclictest10-21ksoftirqd/007:25:170
13911982413,5cyclictest23660-21ssh12:20:540
13911982412,5cyclictest17238-21/usr/sbin/munin07:16:140
101782240,2sleep310177-21ssh10:46:383
69062230,2sleep30-21swapper/311:46:463
3842230,2sleep10-21swapper/107:59:471
294392230,12sleep225-21ksoftirqd/207:50:152
270712230,1sleep121567-21kworker/u8:5607:41:461
270712230,1sleep121567-21kworker/u8:5607:41:461
266852230,2sleep225-21ksoftirqd/212:29:212
232652230,2sleep30-21swapper/308:56:543
177972230,11sleep311748-21kworker/u8:4907:17:113
168042230,12sleep331-21ksoftirqd/309:55:013
155682230,2sleep213744-21kworker/u8:308:36:352
155682230,2sleep213744-21kworker/u8:308:36:352
152272230,2sleep30-21swapper/310:58:033
1391998237,3cyclictest245882kworker/u8:3411:20:043
1391998235,11cyclictest121rcu_preempt12:05:533
1391998234,4cyclictest21499-21ntpq11:10:313
1391998234,3cyclictest121rcu_preempt10:27:393
1391998233,4cyclictest121rcu_preempt12:35:393
1391998231,4cyclictest0-21swapper/310:20:023
1391998231,3cyclictest121rcu_preempt09:15:343
1391998231,3cyclictest121rcu_preempt09:15:343
1391398232,4cyclictest121rcu_preempt11:40:031
1391398232,3cyclictest121rcu_preempt10:25:341
1391398231,3cyclictest0-21swapper/110:56:021
1391198239,4cyclictest118150irq/29-4f00000.09:40:000
1391198238,12cyclictest118150irq/29-4f00000.07:40:000
1391198235,8cyclictest26118-21taskset10:13:580
13911982310,10cyclictest118150irq/29-4f00000.08:45:450
137112230,1sleep27758-21kworker/u8:5208:31:342
37712220,11sleep3301rcuc/309:25:553
37712220,11sleep3301rcuc/309:25:543
289112220,11sleep30-21swapper/312:33:283
272862220,2sleep30-21swapper/309:09:423
272862220,2sleep30-21swapper/309:09:413
271582220,2sleep10-21swapper/109:08:031
271582220,2sleep10-21swapper/109:08:021
227802220,1sleep17818-21kworker/u8:911:14:591
1391998226,4cyclictest121rcu_preempt11:05:003
1391998226,4cyclictest121rcu_preempt11:05:003
1391998222,3cyclictest121rcu_preempt12:20:393
1391998222,3cyclictest121rcu_preempt07:25:273
1391998221,9cyclictest91462mailstats11:50:593
1391998221,5cyclictest8149-21dpkg08:20:033
1391998221,5cyclictest8149-21dpkg08:20:023
1391998221,3cyclictest0-21swapper/311:15:243
1391998221,3cyclictest0-21swapper/311:15:243
1391498221,3cyclictest121rcu_preempt09:05:422
1391498221,3cyclictest121rcu_preempt09:05:412
1391498221,3cyclictest121rcu_preempt08:50:302
1391498221,3cyclictest0-21swapper/212:05:222
1391398221,3cyclictest121rcu_preempt12:10:161
1391398221,3cyclictest121rcu_preempt11:18:451
1391398221,3cyclictest121rcu_preempt11:18:451
1391398221,3cyclictest121rcu_preempt09:45:431
1391398221,3cyclictest121rcu_preempt07:15:551
13913982213,4cyclictest19-21ksoftirqd/109:25:131
13913982213,4cyclictest19-21ksoftirqd/109:25:131
1391198229,10cyclictest118150irq/29-4f00000.12:30:230
1391198229,10cyclictest118150irq/29-4f00000.12:00:240
1391198229,10cyclictest118150irq/29-4f00000.11:20:540
1391198229,10cyclictest118150irq/29-4f00000.11:10:140
1391198228,4cyclictest118150irq/29-4f00000.12:10:260
1391198227,12cyclictest118150irq/29-4f00000.07:20:250
13911982217,3cyclictest10-21ksoftirqd/010:35:390
13911982216,4cyclictest10-21ksoftirqd/008:50:300
13911982216,3cyclictest1050ksoftirqd/010:47:000
13911982215,5cyclictest118150irq/29-4f00000.10:20:160
13911982213,7cyclictest10-21ksoftirqd/010:17:180
13911982213,5cyclictest10-21ksoftirqd/009:40:320
13911982210,10cyclictest118150irq/29-4f00000.07:55:340
289172210,10sleep213908-21cyclictest07:46:462
235982210,10sleep331-21ksoftirqd/307:34:453
1391998216,3cyclictest121rcu_preempt10:20:253
1391998212,5cyclictest31-21ksoftirqd/308:35:433
1391998212,5cyclictest31-21ksoftirqd/308:35:423
1391998212,4cyclictest121rcu_preempt08:10:223
13919982114,4cyclictest20301-21sh10:00:353
1391498212,3cyclictest121rcu_preempt10:35:232
1391498211,3cyclictest121rcu_preempt11:15:472
1391498211,3cyclictest121rcu_preempt11:15:472
13914982113,5cyclictest16826-21ntpq11:00:372
13914982113,5cyclictest16826-21ntpq11:00:372
1391498211,2cyclictest0-21swapper/209:20:232
1391498211,2cyclictest0-21swapper/209:20:222
1391398213,3cyclictest121rcu_preempt08:55:411
1391398212,3cyclictest121rcu_preempt12:05:371
1391398212,3cyclictest121rcu_preempt10:20:111
1391398211,9cyclictest121rcu_preempt07:20:221
1391398211,3cyclictest121rcu_preempt08:50:201
13913982113,4cyclictest19-21ksoftirqd/112:25:161
13913982112,5cyclictest7969-21kworker/1:108:25:171
1391198217,8cyclictest22187-21if_err_eth110:05:250
1391198217,4cyclictest118150irq/29-4f00000.11:15:370
1391198217,4cyclictest118150irq/29-4f00000.11:15:370
1391198217,4cyclictest118150irq/29-4f00000.10:25:310
1391198216,4cyclictest118150irq/29-4f00000.11:35:160
1391198212,7cyclictest154942kworker/u9:109:54:460
13911982116,3cyclictest10-21ksoftirqd/011:50:180
13911982116,3cyclictest10-21ksoftirqd/011:00:340
13911982116,3cyclictest10-21ksoftirqd/011:00:340
13911982116,3cyclictest10-21ksoftirqd/007:10:220
13911982115,4cyclictest10-21ksoftirqd/010:30:340
13911982114,5cyclictest10-21ksoftirqd/009:25:140
13911982114,5cyclictest10-21ksoftirqd/009:25:130
13911982114,5cyclictest10-21ksoftirqd/009:05:140
13911982114,5cyclictest10-21ksoftirqd/009:05:140
13911982113,6cyclictest111rcuc/009:03:110
13911982113,6cyclictest111rcuc/009:03:110
13911982113,4cyclictest10-21ksoftirqd/008:10:360
108182210,9sleep3121rcu_preempt09:40:543
280882200,3chrt0-21swapper/210:16:412
1391998203,3cyclictest23320-21kworker/u8:1409:00:293
1391998203,3cyclictest23320-21kworker/u8:1409:00:283
1391998201,4cyclictest0-21swapper/308:00:483
1391998201,4cyclictest0-21swapper/308:00:483
13919982014,3cyclictest5390-21irqstats09:30:233
13919982014,3cyclictest5390-21irqstats09:30:233
1391998201,3cyclictest185562kworker/u8:109:58:353
1391998201,3cyclictest121rcu_preempt10:40:273
13919982013,4cyclictest27334-21diskmemload12:15:113
13919982010,6cyclictest30212-21cron11:30:013
1391498202,3cyclictest287492kworker/u8:1312:36:212
1391498202,3cyclictest121rcu_preempt10:10:152
1391498201,3cyclictest121rcu_preempt11:05:292
1391498201,3cyclictest121rcu_preempt11:05:292
1391398201,8cyclictest121rcu_preempt09:00:251
1391398201,8cyclictest121rcu_preempt09:00:241
1391398201,3cyclictest121rcu_preempt07:50:401
1391198209,7cyclictest10-21ksoftirqd/010:00:180
1391198207,4cyclictest118150irq/29-4f00000.11:40:050
1391198207,4cyclictest118150irq/29-4f00000.08:20:010
1391198207,4cyclictest118150irq/29-4f00000.08:20:010
1391198207,10cyclictest118150irq/29-4f00000.08:35:190
1391198207,10cyclictest118150irq/29-4f00000.08:35:190
1391198202,9cyclictest150982kworker/u8:1910:57:210
13911982015,3cyclictest10-21ksoftirqd/010:50:410
13911982014,4cyclictest10-21ksoftirqd/008:05:280
13911982014,4cyclictest10-21ksoftirqd/007:40:500
13911982014,4cyclictest10-21ksoftirqd/007:40:500
59492190,8sleep213908-21cyclictest08:13:312
1391998196,3cyclictest36122chrt08:05:403
13919981912,4cyclictest30320-21ntpq07:50:373
13919981912,4cyclictest20859-21ntpq08:50:303
13919981912,4cyclictest18414-21aten2.4-expect07:20:213
1391498191,3cyclictest121rcu_preempt12:15:112
13914981912,4cyclictest2586-21sh09:25:182
13914981912,4cyclictest2586-21sh09:25:182
1391498190,3cyclictest121rcu_preempt08:20:052
1391198194,3cyclictest118150irq/29-4f00000.08:56:230
13911981912,4cyclictest10-21ksoftirqd/012:05:200
1391998181,3cyclictest0-21swapper/308:30:433
13919981811,4cyclictest31625-21xargs11:30:413
1391998163,3cyclictest271602kworker/u8:1807:45:223
1391198161,6cyclictest3092050kworker/u9:307:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional