You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 05:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Wed Nov 26, 2025 00:45:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1128423360,3sleep119-21ksoftirqd/119:05:321
1217798295287,5cyclictest25725-21kworker/u8:2823:26:521
1217798289282,4cyclictest32420-21kworker/u8:320:07:081
1210922800,3sleep212099-21cron19:10:002
1217898256250,3cyclictest25721-21kworker/u8:2523:26:532
1119922550,1sleep327605-21kworker/u8:3719:05:303
1217898253246,4cyclictest32544-21kworker/u8:12920:07:082
1217498209202,4cyclictest1050ksoftirqd/023:26:520
1217498203197,3cyclictest1050ksoftirqd/020:07:070
1217898167158,5cyclictest28602-21kworker/u8:419:56:542
1218198162152,7cyclictest25722-21kworker/u8:2623:26:523
1218198156147,6cyclictest32437-21kworker/u8:2120:07:073
1217498115109,3cyclictest1050ksoftirqd/019:56:540
12177989487,4cyclictest13722-21kworker/u8:1119:27:111
12177987265,4cyclictest23942-21kworker/u8:022:22:181
12181986960,5cyclictest28666-21kworker/u8:7119:56:533
12178985951,5cyclictest17525-21kworker/u8:6319:27:112
12174985948,8cyclictest10-21ksoftirqd/020:41:570
244092560,3sleep216899-21kworker/u8:321:08:382
302682540,2sleep330245-21ssh23:30:453
12177985246,4cyclictest30536-21kworker/u8:1220:02:011
193092460,3sleep2241rcuc/200:15:222
12177984640,4cyclictest32433-21kworker/u8:1720:22:301
12177984640,4cyclictest32433-21kworker/u8:1720:22:301
215462440,2sleep10-21swapper/119:35:011
215462440,2sleep10-21swapper/119:35:001
115252440,2sleep10-21swapper/122:53:581
56092400,19sleep119-21ksoftirqd/123:46:391
56092400,19sleep119-21ksoftirqd/123:46:391
1217798401,5cyclictest121rcu_preempt22:00:131
1217798391,6cyclictest121rcu_preempt22:35:141
312182370,2sleep20-21swapper/222:26:482
1217798371,5cyclictest121rcu_preempt22:40:171
1217798361,4cyclictest121rcu_preempt20:25:151
261142350,2sleep30-21swapper/321:10:503
1218198354,6cyclictest31-21ksoftirqd/323:10:273
1218198354,6cyclictest31-21ksoftirqd/323:10:273
12177983528,5cyclictest23077-21kworker/u8:319:42:411
310432340,8sleep2251ksoftirqd/200:40:002
12181983413,4cyclictest31-21ksoftirqd/319:30:303
12181983413,4cyclictest31-21ksoftirqd/319:30:293
1217898341,3cyclictest121rcu_preempt20:50:162
1217798341,5cyclictest121rcu_preempt00:10:161
1218198337,5cyclictest31-21ksoftirqd/320:35:433
1218198332,5cyclictest22468-21ntpq19:35:313
12178983328,3cyclictest26406-21kworker/u8:1222:22:182
135322320,2sleep211663-21kworker/u8:421:50:402
1218198329,7cyclictest31-21ksoftirqd/300:05:133
1218198323,6cyclictest10347-21ntpq22:50:243
1218198322,10cyclictest23744-21ntpq21:05:293
1218198321,11cyclictest16228-21cat21:55:433
61732310,11sleep225-21ksoftirqd/222:41:362
33032310,7sleep2251ksoftirqd/222:35:412
302512310,5sleep18954-21kworker/1:100:36:181
261252310,7sleep225-21ksoftirqd/223:23:192
1218198318,5cyclictest31-21ksoftirqd/320:30:323
1218198316,8cyclictest31-21ksoftirqd/319:40:383
1218198316,5cyclictest31-21ksoftirqd/322:15:333
1218198316,5cyclictest31-21ksoftirqd/322:15:333
1218198316,5cyclictest31-21ksoftirqd/322:05:213
1218198315,6cyclictest31-21ksoftirqd/321:15:453
1218198315,5cyclictest31-21ksoftirqd/322:35:333
1218198312,6cyclictest31-21ksoftirqd/323:40:283
1218198312,6cyclictest31-21ksoftirqd/323:40:273
12177983126,3cyclictest21476-21kworker/u8:2222:12:031
12177983126,3cyclictest21476-21kworker/u8:2222:12:031
84722300,5sleep12126-21bootmenu22:45:531
68402300,13sleep225-21ksoftirqd/223:50:282
159612300,8sleep225-21ksoftirqd/219:20:012
132442300,2sleep27655-1kworker/u9:019:10:362
1218198306,5cyclictest31-21ksoftirqd/320:55:273
1218198306,4cyclictest31-21ksoftirqd/320:15:343
1218198305,7cyclictest31-21ksoftirqd/323:55:193
1218198305,6cyclictest31-21ksoftirqd/323:05:213
1218198305,6cyclictest31-21ksoftirqd/323:05:203
1218198302,8cyclictest18784-21ntpq19:25:313
1218198302,5cyclictest31-21ksoftirqd/323:20:183
1217798303,3cyclictest121rcu_preempt00:25:011
1217798302,4cyclictest121rcu_preempt22:28:581
1217798300,4cyclictest121rcu_preempt19:10:151
33522290,15sleep2121rcu_preempt23:42:382
33522290,15sleep2121rcu_preempt23:42:382
269372290,11sleep225-21ksoftirqd/222:19:482
269372290,11sleep225-21ksoftirqd/222:19:482
205602290,5sleep225-21ksoftirqd/220:56:522
171002290,17sleep216540-21kworker/u8:821:59:412
128372290,2sleep2121rcu_preempt20:35:482
1218198297,5cyclictest31-21ksoftirqd/322:45:003
1218198295,6cyclictest31-21ksoftirqd/323:00:173
1218198295,6cyclictest31-21ksoftirqd/323:00:173
1218198295,6cyclictest31-21ksoftirqd/320:29:413
1218198295,5cyclictest301rcuc/320:10:333
1218198295,4cyclictest31-21ksoftirqd/322:55:313
1218198294,7cyclictest31-21ksoftirqd/321:25:153
1218198294,5cyclictest31-21ksoftirqd/319:50:403
1218198294,5cyclictest31-21ksoftirqd/319:50:393
1218198294,5cyclictest31-21ksoftirqd/300:30:383
1218198293,9cyclictest31-21ksoftirqd/319:45:183
1218198293,7cyclictest31164-21aten2_rfpower_f20:00:183
1218198293,5cyclictest31-21ksoftirqd/322:25:323
1218198293,5cyclictest31-21ksoftirqd/322:10:473
1218198293,5cyclictest31-21ksoftirqd/322:10:473
1218198292,4cyclictest31-21ksoftirqd/300:25:433
1218198291,7cyclictest31-21ksoftirqd/321:35:223
1218198291,6cyclictest21981-21ntpq21:00:423
1217898291,4cyclictest5176-21ssh23:45:412
1217898291,4cyclictest5176-21ssh23:45:412
1217798294,5cyclictest121rcu_preempt20:10:401
1217798293,3cyclictest121rcu_preempt21:35:171
76992280,2sleep10-21swapper/123:50:501
42272280,2sleep20-21swapper/221:32:052
38302280,6sleep22126-21bootmenu20:11:422
288492280,6sleep12126-21bootmenu19:54:031
288492280,6sleep12126-21bootmenu19:54:031
277532280,2sleep2121rcu_preempt00:31:032
199262280,3sleep219924-21ssh23:10:252
199262280,3sleep219924-21ssh23:10:242
187652280,4sleep225-21ksoftirqd/223:08:352
187652280,4sleep225-21ksoftirqd/223:08:352
156882280,2sleep10-21swapper/119:18:151
1218198285,8cyclictest31-21ksoftirqd/300:10:203
1218198285,4cyclictest31-21ksoftirqd/300:20:323
1218198284,8cyclictest31-21ksoftirqd/319:20:253
1218198284,6cyclictest31-21ksoftirqd/322:30:253
1218198284,6cyclictest31-21ksoftirqd/319:15:283
1218198284,6cyclictest31-21ksoftirqd/300:15:303
1218198284,5cyclictest31-21ksoftirqd/321:40:383
1218198284,5cyclictest31-21ksoftirqd/300:36:163
1218198284,4cyclictest31-21ksoftirqd/321:25:013
1218198284,4cyclictest31-21ksoftirqd/321:25:003
1217898283,3cyclictest121rcu_preempt23:35:382
1217798284,4cyclictest121rcu_preempt20:55:011
1217798281,4cyclictest121rcu_preempt22:32:581
288552270,2sleep20-21swapper/219:54:092
288552270,2sleep20-21swapper/219:54:082
262042270,15sleep113615-21kworker/u8:623:23:431
158862270,3sleep115883-21ntpq21:55:331
156692270,2sleep10-21swapper/100:06:481
1218198275,6cyclictest31-21ksoftirqd/322:45:283
1218198275,2cyclictest121rcu_preempt22:20:373
1218198274,7cyclictest31-21ksoftirqd/323:51:013
1218198274,6cyclictest31-21ksoftirqd/320:45:343
1218198274,6cyclictest31-21ksoftirqd/300:00:313
1218198274,6cyclictest31-21ksoftirqd/300:00:313
1218198274,5cyclictest31-21ksoftirqd/320:40:153
1218198273,5cyclictest31-21ksoftirqd/321:45:033
1218198273,4cyclictest31-21ksoftirqd/323:35:373
1218198273,4cyclictest31-21ksoftirqd/323:15:333
1218198273,4cyclictest31-21ksoftirqd/323:15:333
1218198272,4cyclictest31-21ksoftirqd/320:50:293
1217898273,3cyclictest121rcu_preempt00:00:002
1217898272,3cyclictest121rcu_preempt22:55:422
1217898271,5cyclictest11721-21ssh22:55:012
1217898271,4cyclictest22129-21ssh00:20:272
1217798274,4cyclictest121rcu_preempt20:35:261
12174982721,4cyclictest10-21ksoftirqd/021:30:160
111812270,2sleep10-21swapper/121:45:521
267972260,2sleep1181rcuc/121:12:571
177562260,3chrt2126-21bootmenu19:25:012
143292260,3sleep114328-21ssh21:52:561
1218198264,4cyclictest31-21ksoftirqd/320:20:323
1218198264,4cyclictest31-21ksoftirqd/320:20:313
1218198263,5cyclictest31-21ksoftirqd/321:50:323
1218198262,4cyclictest31-21ksoftirqd/322:00:273
1218198261,5cyclictest3513-21ntpq21:30:353
1218198260,8cyclictest31-21ksoftirqd/319:10:183
1217898265,4cyclictest121rcu_preempt21:25:022
1217898263,5cyclictest121rcu_preempt23:35:002
1217898261,4cyclictest0-21swapper/221:50:012
1217798262,3cyclictest211442kworker/u8:619:35:341
1217798262,3cyclictest121rcu_preempt20:45:001
12177982619,4cyclictest8439-21kworker/u8:823:57:321
12177982614,9cyclictest19-21ksoftirqd/121:00:011
1217798261,3cyclictest121rcu_preempt20:45:331
12174982611,13cyclictest30314-21kworker/0:221:37:590
112462260,3sleep29502-21kworker/u8:120:31:332
306792250,1sleep128284-21kworker/u8:1723:31:471
223502250,2sleep20-21swapper/221:00:552
1218198253,5cyclictest31-21ksoftirqd/323:45:113
1218198253,5cyclictest31-21ksoftirqd/323:45:113
1217898254,3cyclictest121rcu_preempt21:15:352
1217898252,10cyclictest0-21swapper/222:00:132
1217898251,3cyclictest0-21swapper/220:00:402
1217898251,3cyclictest0-21swapper/200:10:422
1217798253,5cyclictest121rcu_preempt21:21:021
1217798253,5cyclictest121rcu_preempt21:21:021
1217798252,3cyclictest121rcu_preempt21:15:581
1217798251,5cyclictest16270-21aten2_rfpower_v19:20:171
1217798251,4cyclictest121rcu_preempt21:00:251
1217798251,3cyclictest121rcu_preempt22:15:271
1217798251,3cyclictest121rcu_preempt22:15:271
58072240,2sleep20-21swapper/220:17:502
268172240,13sleep225-21ksoftirqd/219:47:362
231742240,3sleep123173-21ssh23:16:191
231742240,3sleep123173-21ssh23:16:181
214252240,13sleep225-21ksoftirqd/219:34:582
214252240,13sleep225-21ksoftirqd/219:34:572
213302240,13sleep119-21ksoftirqd/122:06:231
134282240,12sleep113204-21kworker/u8:700:02:501
134282240,12sleep113204-21kworker/u8:700:02:491
1217898243,4cyclictest23966-21irqrtprio19:40:232
1217898243,3cyclictest121rcu_preempt22:45:262
1217898241,6cyclictest23927-21munin-run23:20:012
1217898241,6cyclictest23927-21munin-run23:20:002
1217898241,5cyclictest22108-21idleruntime-cro22:10:002
1217898241,4cyclictest25046-21ssh21:10:132
1217898241,3cyclictest121rcu_preempt20:25:142
1217798241,5cyclictest13110-21switchtime22:55:431
1217798241,4cyclictest457-21kcompactd023:36:011
1217798241,4cyclictest121rcu_preempt21:05:231
1217798241,3cyclictest121rcu_preempt23:00:131
1217798241,3cyclictest121rcu_preempt23:00:131
1217798241,3cyclictest121rcu_preempt21:30:291
1217798241,3cyclictest121rcu_preempt19:45:321
1217498242,16cyclictest118150irq/29-4f00000.20:29:590
113882240,2sleep10-21swapper/120:33:141
43472230,2sleep10-21swapper/120:15:111
241442230,2sleep20-21swapper/222:13:082
241442230,2sleep20-21swapper/222:13:082
208722230,12sleep119-21ksoftirqd/123:12:001
208722230,12sleep119-21ksoftirqd/123:12:001
165182230,12sleep225-21ksoftirqd/223:04:332
165182230,12sleep225-21ksoftirqd/223:04:332
1217898234,3cyclictest121rcu_preempt21:40:272
1217898233,3cyclictest121rcu_preempt00:05:332
1217898230,5cyclictest25-21ksoftirqd/221:40:002
1217798233,3cyclictest65102kworker/u8:521:40:121
1217798233,3cyclictest121rcu_preempt21:25:301
1217798231,5cyclictest0-21swapper/100:25:171
1217798231,3cyclictest121rcu_preempt23:40:321
1217798231,3cyclictest121rcu_preempt23:40:321
1217798231,3cyclictest121rcu_preempt23:05:421
1217798231,3cyclictest121rcu_preempt23:05:411
1217798231,3cyclictest121rcu_preempt00:30:381
1217798230,11cyclictest0-21swapper/100:18:341
1217498235,13cyclictest0-21swapper/019:34:580
1217498235,13cyclictest0-21swapper/019:34:580
76182220,1sleep25653-21kworker/u8:1320:22:132
76182220,1sleep25653-21kworker/u8:1320:22:132
321282220,10sleep225-21ksoftirqd/222:30:062
1217898222,3cyclictest242462kworker/u8:621:22:272
1217898222,3cyclictest242462kworker/u8:621:22:272
1217898221,7cyclictest24785-21gcc00:25:332
1217798221,3cyclictest121rcu_preempt19:55:121
1217498223,14cyclictest2126-21bootmenu23:04:580
1217498223,14cyclictest2126-21bootmenu23:04:580
1217498221,6cyclictest17948-21ssh00:10:580
12174982216,3cyclictest10-21ksoftirqd/021:40:150
12174982214,6cyclictest31176-21sh21:20:420
12174982214,6cyclictest31176-21sh21:20:420
12174982213,7cyclictest118150irq/29-4f00000.23:50:170
151392210,10sleep225-21ksoftirqd/220:43:092
12178982114,4cyclictest11696-21/usr/sbin/munin00:00:232
12178982114,4cyclictest11696-21/usr/sbin/munin00:00:232
1217498214,12cyclictest0-21swapper/020:48:580
1217498213,13cyclictest30314-21kworker/0:223:08:590
1217498213,13cyclictest30314-21kworker/0:223:08:580
12174982114,5cyclictest10-21ksoftirqd/019:20:140
12174982113,6cyclictest26174-21sh21:10:500
12174982113,6cyclictest12322-21irqstats00:00:310
12174982113,6cyclictest12322-21irqstats00:00:300
163232200,8sleep225-21ksoftirqd/220:45:302
1217898201,3cyclictest121rcu_preempt19:35:202
1217498208,6cyclictest22812-21vmstat00:20:470
12174982015,3cyclictest12658-21/usr/sbin/munin19:10:240
12174982015,3cyclictest12352-21latency_hist21:50:000
1217498201,4cyclictest0-21swapper/022:27:050
12174982014,3cyclictest10-21ksoftirqd/022:10:450
12174982014,3cyclictest10-21ksoftirqd/022:10:450
12174982013,4cyclictest4974-21ssh22:40:250
12174982012,6cyclictest3062-21ntp_kernel_pll_22:35:310
12174982012,6cyclictest24537-21diskmemload22:00:160
12174982012,6cyclictest11139-21sh23:58:460
12174982011,7cyclictest10-21ksoftirqd/019:25:210
12174982011,6cyclictest12932-21idleruntime21:50:270
12174982011,3cyclictest25838-21ssh23:21:510
1217498199,6cyclictest4731-21kernelversion23:45:260
1217498199,6cyclictest4731-21kernelversion23:45:260
1217498192,12cyclictest0-21swapper/022:05:580
1217498191,7cyclictest131422kworker/u8:2420:37:240
12174981914,3cyclictest29935-21python300:35:460
12174981914,3cyclictest10-21ksoftirqd/023:15:290
12174981914,3cyclictest10-21ksoftirqd/023:15:280
12174981914,3cyclictest10-21ksoftirqd/019:45:320
12174981913,4cyclictest27216-21ssh00:30:310
12174981913,3cyclictest10-21ksoftirqd/000:25:360
12174981912,4cyclictest10-21ksoftirqd/021:15:310
12174981911,6cyclictest31388-21if_err_eth120:00:240
12174981911,6cyclictest28939-21sh19:55:000
12174981911,6cyclictest28939-21sh19:54:590
12174981911,6cyclictest22663-21sendmail_mailst19:35:400
12174981911,6cyclictest19317-21/usr/sbin/munin23:10:110
12174981911,6cyclictest19317-21/usr/sbin/munin23:10:110
12174981911,5cyclictest15950-21ntpq21:55:400
1217498191,12cyclictest22678-21cron21:05:000
1217498191,12cyclictest0-21swapper/020:58:590
1217498191,10cyclictest24780-21/usr/sbin/munin22:15:220
1217498191,10cyclictest24780-21/usr/sbin/munin22:15:220
12174981910,6cyclictest3391-21sh23:42:500
12174981910,6cyclictest3391-21sh23:42:490
12174981910,6cyclictest2081-21runrttasks20:30:110
1217498189,7cyclictest14593-21cut19:15:210
1217498189,7cyclictest10-21ksoftirqd/022:50:120
1217498189,6cyclictest7394-21timerandwakeup20:20:420
1217498189,6cyclictest7394-21timerandwakeup20:20:410
1217498188,6cyclictest7536-21irqrtprio22:45:230
12174981813,3cyclictest31613-21ssh23:35:150
12174981813,3cyclictest10-21ksoftirqd/022:30:330
12174981812,3cyclictest10-21ksoftirqd/020:20:000
1217498181,14cyclictest29184-21ssh23:30:160
12174981810,6cyclictest2511-21/usr/sbin/munin20:10:300
12174981810,6cyclictest19009-21/usr/sbin/munin00:15:170
12174981810,6cyclictest17388-21/usr/sbin/munin20:50:400
12174981810,6cyclictest16067-21sh00:08:500
1217498179,3cyclictest15589-1kworker/u9:119:40:120
1217498177,7cyclictest0-21swapper/022:20:270
1217498171,2cyclictest0-21swapper/022:55:130
12174981712,3cyclictest983-21ssh21:25:300
12174981712,3cyclictest10-21ksoftirqd/021:05:150
1217498144,8cyclictest12176-21sed19:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional