You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 12:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot4.osadl.org (updated Mon Dec 08, 2025 00:45:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
362022660,7sleep319031-1kworker/u9:019:05:333
363822620,2sleep12242-21kworker/u8:2119:05:351
423622540,1sleep24097-21kworker/u8:719:08:322
442998182171,6cyclictest23161-21kworker/u8:7620:02:011
442898167161,3cyclictest1050ksoftirqd/020:02:010
442898118109,6cyclictest1050ksoftirqd/020:47:040
884621140,2sleep10-21swapper/123:05:291
442998107100,4cyclictest25083-21kworker/u8:5020:07:081
44289810190,8cyclictest10-21ksoftirqd/020:07:080
228492950,2sleep322848-21ssh22:25:493
228492950,2sleep322848-21ssh22:25:483
118892950,2sleep111888-21ssh22:05:031
4432989183,5cyclictest23154-21kworker/u8:6920:02:003
4429988882,4cyclictest25580-21kworker/u8:3122:41:461
4429988679,4cyclictest32545-21kworker/u8:2820:36:581
4429988679,4cyclictest32545-21kworker/u8:2820:36:581
4428988072,5cyclictest118150irq/29-4f00000.22:41:450
4428987969,7cyclictest10-21ksoftirqd/020:36:580
4428987969,7cyclictest10-21ksoftirqd/020:36:580
4429987467,4cyclictest31053-21kworker/u8:1121:42:211
4428986957,8cyclictest10-21ksoftirqd/021:42:210
281662560,2sleep20-21swapper/222:38:402
281662560,2sleep20-21swapper/222:38:392
234642520,10sleep119-21ksoftirqd/122:29:041
234642520,10sleep119-21ksoftirqd/122:29:041
4429984942,4cyclictest13476-21kworker/u8:2022:17:101
9702480,2sleep30-21swapper/322:49:583
4429984640,3cyclictest28788-21kworker/u8:720:27:371
4429984640,3cyclictest28788-21kworker/u8:720:27:371
4428984432,8cyclictest10-21ksoftirqd/022:17:110
58982410,5sleep3311ksoftirqd/320:39:543
58982410,5sleep3311ksoftirqd/320:39:543
4432983731,4cyclictest7545-21kworker/u8:720:47:043
250262370,2sleep325018-21ssh22:30:433
250262370,2sleep325018-21ssh22:30:433
4429983619,4cyclictest19-21ksoftirqd/121:55:151
4429983619,4cyclictest19-21ksoftirqd/121:55:151
442998361,3cyclictest121rcu_preempt21:00:151
442998361,3cyclictest121rcu_preempt21:00:151
4428983528,5cyclictest10-21ksoftirqd/020:40:190
4428983520,5cyclictest10-21ksoftirqd/000:30:410
4428983519,4cyclictest10-21ksoftirqd/023:10:350
443098342,7cyclictest25-21ksoftirqd/222:30:432
443098342,7cyclictest25-21ksoftirqd/222:30:422
4429983427,4cyclictest5990-21kworker/u8:2222:02:511
37732340,8sleep331-21ksoftirqd/320:31:343
443098332,6cyclictest25-21ksoftirqd/200:20:232
4428983320,3cyclictest10-21ksoftirqd/021:10:420
4428983320,3cyclictest10-21ksoftirqd/020:15:310
4428983320,3cyclictest10-21ksoftirqd/020:15:310
4428983319,7cyclictest10-21ksoftirqd/022:20:310
443298321,3cyclictest121rcu_preempt23:20:173
443098329,6cyclictest25-21ksoftirqd/223:15:322
443098326,6cyclictest25-21ksoftirqd/220:45:432
443098324,5cyclictest25-21ksoftirqd/221:50:412
443098324,5cyclictest25-21ksoftirqd/221:50:412
443098324,5cyclictest25-21ksoftirqd/219:20:372
443098324,5cyclictest25-21ksoftirqd/219:20:372
4430983226,4cyclictest241rcuc/223:45:392
196772320,1sleep313984-21kworker/u8:800:35:163
64262310,6sleep36425-21cpuspeed20:40:233
4432983125,3cyclictest27311-21kworker/u8:3123:47:183
443098317,8cyclictest25-21ksoftirqd/219:25:272
443098317,8cyclictest25-21ksoftirqd/219:25:262
443098315,5cyclictest25-21ksoftirqd/223:10:002
443098314,5cyclictest25-21ksoftirqd/223:55:172
443098314,5cyclictest25-21ksoftirqd/222:25:182
443098314,5cyclictest25-21ksoftirqd/222:25:172
443098311,6cyclictest25-21ksoftirqd/219:35:342
442998312,5cyclictest121rcu_preempt21:50:161
442998312,5cyclictest121rcu_preempt21:50:161
442998311,7cyclictest17201-21ssh00:30:121
4428983118,3cyclictest10-21ksoftirqd/020:10:210
443098300,10cyclictest25-21ksoftirqd/222:00:202
442898306,8cyclictest23040-21taskset22:26:550
442898306,8cyclictest23040-21taskset22:26:550
4428983019,3cyclictest10-21ksoftirqd/023:25:350
33062300,6sleep331-21ksoftirqd/321:45:423
320892300,2sleep30-21swapper/321:40:153
272682300,8sleep3121rcu_preempt21:30:263
214092300,7sleep225-21ksoftirqd/200:38:102
202212300,7sleep1191ksoftirqd/123:29:091
170142300,6sleep331-21ksoftirqd/321:09:103
443298292,5cyclictest31-21ksoftirqd/320:50:413
443098294,4cyclictest25-21ksoftirqd/221:40:402
443098293,6cyclictest25-21ksoftirqd/222:55:002
443098293,5cyclictest25-21ksoftirqd/200:05:442
443098293,5cyclictest25-21ksoftirqd/200:05:442
443098292,6cyclictest25-21ksoftirqd/221:25:292
443098292,6cyclictest25-21ksoftirqd/221:20:192
443098292,5cyclictest18301-21ssh21:10:392
4430982916,10cyclictest241rcuc/200:10:202
443098291,5cyclictest20490-21ssh21:15:282
443098290,7cyclictest25-21ksoftirqd/223:35:312
443098290,7cyclictest25-21ksoftirqd/223:35:302
277062290,5sleep331-21ksoftirqd/323:44:243
166622290,5sleep3311ksoftirqd/300:28:413
56582280,2sleep20-21swapper/220:36:522
56582280,2sleep20-21swapper/220:36:522
443098285,6cyclictest25-21ksoftirqd/221:55:582
443098285,6cyclictest25-21ksoftirqd/221:55:572
443098285,5cyclictest25-21ksoftirqd/222:15:142
443098284,7cyclictest25-21ksoftirqd/220:10:372
443098284,5cyclictest25-21ksoftirqd/223:10:392
443098284,5cyclictest25-21ksoftirqd/219:40:412
443098284,5cyclictest25-21ksoftirqd/200:30:422
443098283,6cyclictest25-21ksoftirqd/223:40:322
443098283,4cyclictest25-21ksoftirqd/223:25:402
443098283,4cyclictest25-21ksoftirqd/220:15:432
443098283,4cyclictest25-21ksoftirqd/220:15:422
443098283,4cyclictest25-21ksoftirqd/219:45:122
443098282,6cyclictest27510-21ssh21:30:362
443098280,7cyclictest25-21ksoftirqd/223:00:272
442998281,3cyclictest121rcu_preempt22:45:241
442898287,10cyclictest29869-21kworker/0:121:15:360
4428982816,4cyclictest10-21ksoftirqd/022:10:300
4428982814,8cyclictest10-21ksoftirqd/021:50:380
4428982814,8cyclictest10-21ksoftirqd/021:50:380
31882280,2sleep12900-21kworker/u8:1722:53:381
289422280,5sleep331-21ksoftirqd/320:14:123
260692280,2sleep126043-21ssh22:35:011
260692280,2sleep126043-21ssh22:35:001
210612280,2sleep311307-21kworker/u8:221:15:423
141302280,2sleep10-21swapper/100:23:001
122572280,6sleep1191ksoftirqd/123:11:111
63822270,5sleep331-21ksoftirqd/319:14:083
51992270,15sleep32900-21kworker/u8:1722:56:463
443098276,11cyclictest241rcuc/223:50:342
443098274,5cyclictest25-21ksoftirqd/222:10:192
443098274,5cyclictest25-21ksoftirqd/221:00:182
443098274,5cyclictest25-21ksoftirqd/221:00:182
443098273,6cyclictest25-21ksoftirqd/220:00:322
443098273,5cyclictest25-21ksoftirqd/222:40:322
443098273,5cyclictest25-21ksoftirqd/220:20:192
443098273,5cyclictest25-21ksoftirqd/220:20:192
443098272,4cyclictest25-21ksoftirqd/223:20:302
443098271,7cyclictest25-21ksoftirqd/222:05:252
443098271,6cyclictest25-21ksoftirqd/219:50:282
443098271,6cyclictest25-21ksoftirqd/219:50:282
443098271,5cyclictest25-21ksoftirqd/219:55:202
443098270,7cyclictest25-21ksoftirqd/221:45:312
443098270,10cyclictest25-21ksoftirqd/221:35:392
443098270,10cyclictest25-21ksoftirqd/221:35:392
442998276,5cyclictest121rcu_preempt23:30:451
442998275,4cyclictest121rcu_preempt19:20:151
442998275,4cyclictest121rcu_preempt19:20:141
442998273,4cyclictest121rcu_preempt22:25:001
4429982711,5cyclictest19-21ksoftirqd/120:50:191
442898277,9cyclictest29869-21kworker/0:123:20:200
4428982721,4cyclictest10-21ksoftirqd/020:20:170
4428982721,4cyclictest10-21ksoftirqd/020:20:160
4428982716,3cyclictest10-21ksoftirqd/023:05:470
4428982716,3cyclictest10-21ksoftirqd/022:50:240
4428982716,3cyclictest10-21ksoftirqd/021:35:360
4428982716,3cyclictest10-21ksoftirqd/021:35:350
37402270,2sleep20-21swapper/220:31:082
35402270,2sleep10-21swapper/121:46:251
305572270,3sleep331-21ksoftirqd/320:16:223
305572270,3sleep331-21ksoftirqd/320:16:213
296132270,1sleep10-21swapper/123:46:511
244872270,2sleep10-21swapper/123:36:141
244872270,2sleep10-21swapper/123:36:131
226952270,2sleep322233-21kworker/u8:1323:34:313
205842270,4sleep3121rcu_preempt22:21:343
20332270,1sleep22019-21kworker/u8:1220:27:512
20332270,1sleep22019-21kworker/u8:1220:27:512
119072270,5sleep331-21ksoftirqd/319:28:203
119072270,5sleep331-21ksoftirqd/319:28:193
118832270,7sleep1191ksoftirqd/100:18:531
95662260,15sleep10-21swapper/120:48:291
89212260,2sleep34551-21kworker/u8:000:10:473
50142260,3sleep15013-21ssh22:55:481
443298267,3cyclictest121rcu_preempt22:00:013
443298267,3cyclictest121rcu_preempt22:00:003
443298266,4cyclictest121rcu_preempt21:10:273
443298265,5cyclictest121rcu_preempt23:25:443
443298264,5cyclictest121rcu_preempt23:00:063
443298261,6cyclictest7525-21latency_hist00:10:023
443298261,6cyclictest7525-21latency_hist00:10:013
443298261,5cyclictest3007-21aten2_rfpower_f00:00:213
443298261,5cyclictest3007-21aten2_rfpower_f00:00:213
443298261,4cyclictest0-21swapper/300:20:213
443098267,4cyclictest121rcu_preempt00:00:212
443098267,4cyclictest121rcu_preempt00:00:202
443098266,5cyclictest25-21ksoftirqd/222:20:282
443098266,4cyclictest25-21ksoftirqd/221:05:252
443098265,5cyclictest25-21ksoftirqd/221:00:012
443098265,3cyclictest121rcu_preempt22:45:402
443098265,12cyclictest25-21ksoftirqd/219:12:082
443098264,5cyclictest25-21ksoftirqd/200:15:432
443098263,5cyclictest25-21ksoftirqd/222:55:212
443098263,3cyclictest0-21swapper/220:50:162
443098261,7cyclictest25-21ksoftirqd/200:25:242
443098261,6cyclictest25-21ksoftirqd/220:40:212
443098261,6cyclictest25-21ksoftirqd/220:05:302
442998264,4cyclictest121rcu_preempt21:17:331
442998264,4cyclictest121rcu_preempt19:30:211
442998264,4cyclictest121rcu_preempt19:30:201
442898268,15cyclictest118150irq/29-4f00000.22:05:330
442898265,10cyclictest10-21ksoftirqd/021:00:380
442898265,10cyclictest10-21ksoftirqd/021:00:370
4428982615,3cyclictest10-21ksoftirqd/023:34:350
4428982615,3cyclictest10-21ksoftirqd/020:50:420
4428982613,7cyclictest10-21ksoftirqd/019:50:250
4428982613,7cyclictest10-21ksoftirqd/019:50:240
216252260,2sleep10-21swapper/100:39:211
130912260,2sleep10-21swapper/120:56:291
100232260,2sleep30-21swapper/319:22:443
100232260,2sleep30-21swapper/319:22:443
99572250,1sleep35281-21kworker/u8:123:06:353
91632250,2sleep10-21swapper/100:12:021
79772250,2sleep10-21swapper/119:16:031
78292250,2sleep10-21swapper/123:02:511
44602250,1sleep326190-21kworker/u8:2321:50:063
44602250,1sleep326190-21kworker/u8:2321:50:053
443298251,7cyclictest17935-21timerwakeupswit22:15:443
443298251,3cyclictest121rcu_preempt22:10:413
443098255,4cyclictest121rcu_preempt23:30:232
443098251,7cyclictest25-21ksoftirqd/219:30:282
443098251,7cyclictest25-21ksoftirqd/219:30:272
442998258,13cyclictest181rcuc/121:25:381
442998255,4cyclictest121rcu_preempt22:10:331
442998252,4cyclictest121rcu_preempt20:40:171
442998251,5cyclictest0-21swapper/123:40:581
442998251,4cyclictest121rcu_preempt21:10:421
442998251,4cyclictest121rcu_preempt20:10:291
442898257,9cyclictest23880-21ssh23:35:290
442898257,9cyclictest23880-21ssh23:35:280
442898254,14cyclictest2268-21ssh23:58:210
442898254,12cyclictest24763-21ntpq22:30:330
442898254,12cyclictest24763-21ntpq22:30:330
4428982519,4cyclictest10-21ksoftirqd/000:20:370
324932250,2sleep10-21swapper/120:22:071
324932250,2sleep10-21swapper/120:22:061
287412250,2sleep10-21swapper/121:31:491
24782250,2sleep128761-21kworker/1:223:59:271
150762250,2sleep30-21swapper/323:17:023
72902240,1sleep1191ksoftirqd/100:09:531
72902240,1sleep1191ksoftirqd/100:09:531
443298242,4cyclictest121rcu_preempt20:20:263
443298242,4cyclictest121rcu_preempt20:20:263
443298241,5cyclictest121rcu_preempt23:55:273
443298241,4cyclictest0-21swapper/300:30:193
443298241,2cyclictest0-21swapper/320:25:193
443298241,2cyclictest0-21swapper/320:25:193
443298240,4cyclictest30810-21ssh23:50:253
442998246,4cyclictest121rcu_preempt20:30:261
4429982417,4cyclictest19-21ksoftirqd/119:45:371
442998241,4cyclictest121rcu_preempt21:20:371
442998241,3cyclictest121rcu_preempt23:22:091
442998241,3cyclictest121rcu_preempt22:35:241
442998241,3cyclictest121rcu_preempt22:35:231
442998241,3cyclictest121rcu_preempt19:10:261
442998240,4cyclictest0-21swapper/121:35:371
442998240,4cyclictest0-21swapper/121:35:371
442898249,5cyclictest118150irq/29-4f00000.19:30:010
442898249,5cyclictest118150irq/29-4f00000.19:30:000
442898248,6cyclictest573-21sshd20:25:180
442898248,6cyclictest573-21sshd20:25:180
442898243,12cyclictest23942-21ssh21:22:550
4428982413,3cyclictest10-21ksoftirqd/022:00:250
4428982412,6cyclictest29364-21munin-run21:35:000
251592240,3sleep325158-21ssh23:39:573
251592240,3sleep325158-21ssh23:39:573
230262240,5sleep331-21ksoftirqd/321:20:323
131152240,2sleep30-21swapper/320:56:473
110522240,12sleep33764-21kworker/u8:1522:01:513
443298236,5cyclictest121rcu_preempt20:00:013
443298233,4cyclictest121rcu_preempt00:20:013
443298232,3cyclictest121rcu_preempt22:05:253
443098231,4cyclictest0-21swapper/219:15:172
442998233,3cyclictest121rcu_preempt00:04:441
442998233,3cyclictest121rcu_preempt00:04:431
442998232,4cyclictest121rcu_preempt23:50:261
442998232,3cyclictest121rcu_preempt19:55:381
442998232,3cyclictest121rcu_preempt00:26:421
442998231,4cyclictest121rcu_preempt19:35:231
442998231,3cyclictest121rcu_preempt20:15:421
442998231,3cyclictest121rcu_preempt20:15:421
442998230,4cyclictest121rcu_preempt23:15:441
442898239,6cyclictest4085-21ps22:55:250
442898239,5cyclictest6215-21aten2_rfpower_f23:00:180
442898238,8cyclictest2094-21taskset21:45:070
442898237,8cyclictest9465-21/usr/sbin/munin19:20:380
442898237,8cyclictest9465-21/usr/sbin/munin19:20:370
442898235,8cyclictest0-21swapper/023:45:250
442898233,11cyclictest4463-21runrttasks00:02:160
442898233,11cyclictest4463-21runrttasks00:02:160
4428982318,3cyclictest30477-21ssh23:50:170
4428982318,3cyclictest111rcuc/021:55:150
4428982318,3cyclictest111rcuc/021:55:150
4428982317,4cyclictest10-21ksoftirqd/023:40:580
4428982316,4cyclictest118150irq/29-4f00000.20:00:000
4428982315,6cyclictest10-21ksoftirqd/000:35:160
301412230,1sleep327794-21kworker/u8:4522:41:253
443298222,4cyclictest121rcu_preempt21:25:363
443298221,4cyclictest13049-21ssh23:15:013
4432982214,5cyclictest18970-21ntpq19:45:363
442998222,3cyclictest121rcu_preempt19:40:331
442998221,3cyclictest121rcu_preempt19:25:301
442998221,3cyclictest121rcu_preempt19:25:301
442898228,11cyclictest118150irq/29-4f00000.21:10:000
442898226,7cyclictest0-21swapper/000:18:140
442898224,9cyclictest10-21ksoftirqd/019:35:010
442898224,9cyclictest10-21ksoftirqd/019:35:010
442898223,8cyclictest5511-21diskstats00:05:230
442898223,8cyclictest5511-21diskstats00:05:230
4428982217,3cyclictest10-21ksoftirqd/022:45:410
4428982216,4cyclictest10-21ksoftirqd/022:35:370
4428982216,4cyclictest10-21ksoftirqd/022:35:370
4428982215,5cyclictest10-21ksoftirqd/021:25:330
4428982215,4cyclictest111rcuc/000:25:450
4428982212,3cyclictest10-21ksoftirqd/019:15:250
168422220,2sleep10-21swapper/121:06:591
443298214,3cyclictest121rcu_preempt20:05:333
443298213,3cyclictest8081-21kworker/u8:1819:18:423
443298211,7cyclictest121rcu_preempt21:35:383
443298211,7cyclictest121rcu_preempt21:35:383
443298211,4cyclictest2887-21192.168.114.17122:52:063
443298210,8cyclictest121rcu_preempt19:40:143
443298210,7cyclictest2081-21runrttasks22:35:573
443298210,7cyclictest2081-21runrttasks22:35:563
442998211,4cyclictest121rcu_preempt19:50:201
442998211,4cyclictest121rcu_preempt19:50:191
442898218,10cyclictest118150irq/29-4f00000.19:45:190
442898217,11cyclictest118150irq/29-4f00000.20:55:400
442898213,8cyclictest17515-21chrt19:40:590
4428982115,4cyclictest10-21ksoftirqd/023:15:280
4428982115,4cyclictest10-21ksoftirqd/000:10:300
4428982112,6cyclictest111rcuc/019:35:190
213082210,2sleep30-21swapper/319:51:563
213082210,2sleep30-21swapper/319:51:553
443298204,3cyclictest121rcu_preempt19:35:203
443298201,4cyclictest121rcu_preempt19:35:003
443298201,4cyclictest121rcu_preempt19:35:003
442898207,4cyclictest118150irq/29-4f00000.19:10:010
442898204,8cyclictest2646-21grep20:30:180
442898203,8cyclictest0-21swapper/019:10:150
4432981912,4cyclictest14023-21irqrtprio21:00:233
4432981912,4cyclictest14023-21irqrtprio21:00:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional