You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 14:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Fri Dec 05, 2025 00:45:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
83622730,3sleep3312-21cron19:05:183
211522650,1sleep132495-21kworker/u8:2819:05:581
84222480,2sleep228836-1kworker/u9:319:05:212
254998234226,4cyclictest18935-21kworker/u8:2620:17:071
254998234226,4cyclictest18935-21kworker/u8:2620:17:061
255398199190,5cyclictest18933-21kworker/u8:2420:17:073
255398199190,5cyclictest18933-21kworker/u8:2420:17:073
254798197184,10cyclictest10-21ksoftirqd/022:56:520
254798195184,8cyclictest10-21ksoftirqd/020:17:070
254798195184,8cyclictest10-21ksoftirqd/020:17:060
255398194189,3cyclictest29830-21kworker/u8:5322:56:513
255298155147,5cyclictest27543-21kworker/u8:1322:56:512
255298154148,4cyclictest24811-21kworker/u8:9020:17:072
255298154148,4cyclictest24811-21kworker/u8:9020:17:062
84252840,2sleep20-21swapper/200:25:592
112592790,2sleep20-21swapper/200:34:312
127752530,2sleep20-21swapper/222:15:172
167042450,3sleep314051-21kworker/u8:522:24:183
29432440,2sleep30-21swapper/323:05:033
2552983610,7cyclictest121rcu_preempt23:50:252
17642360,1sleep119-21ksoftirqd/100:12:021
293712350,3sleep329321-21ssh00:00:453
254998341,3cyclictest121rcu_preempt21:05:171
254998341,3cyclictest121rcu_preempt21:05:171
181042340,3sleep318106-21irqrtprio19:50:243
165642340,9sleep1121rcu_preempt22:23:241
2549983327,3cyclictest20609-21kworker/u8:1823:47:021
2549983326,4cyclictest27571-21kworker/u8:4322:56:521
254998331,4cyclictest121rcu_preempt23:35:151
194682330,1sleep313739-21kworker/u8:3323:40:273
94332320,7sleep1191ksoftirqd/123:19:291
51922320,2sleep20-21swapper/220:40:462
255298320,10cyclictest24242-21ntpq20:05:312
147862320,2sleep10-21swapper/119:40:341
242252310,2sleep124224-21cat22:40:261
110352311,8sleep331-21ksoftirqd/319:30:373
110352311,8sleep331-21ksoftirqd/319:30:373
255298304,9cyclictest16227-21ssh23:33:082
255298300,10cyclictest12429-21ntpq21:00:442
216292300,2sleep10-21swapper/121:22:111
316872290,2sleep124981-21kworker/u8:1100:05:551
316862290,17sleep10-21swapper/120:25:301
255298290,14cyclictest30183-21awk21:40:462
254998292,3cyclictest121rcu_preempt23:00:301
2549982918,6cyclictest19-21ksoftirqd/100:20:151
2549982918,6cyclictest19-21ksoftirqd/100:20:141
254998291,4cyclictest121rcu_preempt21:35:131
254798293,18cyclictest8491-21grep23:15:380
140422290,14sleep119-21ksoftirqd/122:17:011
127412290,1sleep111629-21kworker/u8:223:25:281
319022280,16sleep30-21swapper/300:07:143
303112280,3sleep3121rcu_preempt20:20:453
255298288,9cyclictest577450ssh22:00:072
2549982822,4cyclictest31991-21kworker/u8:3000:26:571
254998281,9cyclictest19-21ksoftirqd/120:00:421
205692280,8sleep1121rcu_preempt23:41:531
70832270,2sleep10-21swapper/122:00:441
306312270,5sleep1191ksoftirqd/121:43:391
306242270,12sleep331-21ksoftirqd/321:43:373
258532270,6sleep1191ksoftirqd/123:55:051
2552982714,8cyclictest24098-21/usr/sbin/munin22:40:212
2552982713,9cyclictest1472-21ssh21:50:242
255298270,8cyclictest943-21irqstats20:30:312
255298270,8cyclictest20765-21ssh23:42:562
255298270,3cyclictest322292kworker/u8:2920:35:202
255298270,3cyclictest322292kworker/u8:2920:35:202
255298270,10cyclictest10458-21aten2.4-expect22:10:212
2547982716,5cyclictest7842-21aten2_rfpower_c20:50:200
65752260,2sleep30-21swapper/300:23:303
65752260,2sleep30-21swapper/300:23:293
54582260,2sleep30-21swapper/319:15:353
43892260,5sleep1191ksoftirqd/123:06:161
36072260,15sleep30-21swapper/319:10:373
34982260,2sleep10-21swapper/120:35:471
34982260,2sleep10-21swapper/120:35:461
324912260,14sleep323565-21kworker/u8:1321:46:143
304322260,1sleep128569-21kworker/u8:1220:22:121
294932260,7sleep1191ksoftirqd/100:01:111
255298265,6cyclictest0-21swapper/219:55:312
2552982618,6cyclictest0-21swapper/200:10:002
2552982615,8cyclictest18589-21sendmail_mailqu19:50:432
2552982615,8cyclictest14051-21kworker/u8:522:25:012
2552982615,7cyclictest6760-21/usr/sbin/munin19:20:222
2552982615,7cyclictest26758-21latency22:45:282
2552982614,9cyclictest28473-21aten2_rfpower_f22:50:182
255298260,11cyclictest28130-21/usr/sbin/munin00:00:192
254998266,4cyclictest121rcu_preempt22:30:421
236982260,2sleep30-21swapper/321:27:403
229102260,5sleep2251ksoftirqd/222:35:522
171432260,2sleep10-21swapper/119:47:251
95012250,14sleep3121rcu_preempt23:19:543
2552982517,6cyclictest0-21swapper/220:59:592
2552982517,4cyclictest2081-21runrttasks21:05:192
2552982517,4cyclictest2081-21runrttasks21:05:192
2552982515,7cyclictest17519-21ssh21:15:012
2552982514,9cyclictest13345-21run-parts23:25:452
2552982514,8cyclictest0-21swapper/222:05:442
2552982513,8cyclictest27558-21/usr/sbin/munin21:35:382
255298250,8cyclictest25381-21ps21:30:492
255298250,10cyclictest2976-21cpuspeed19:10:222
254998254,9cyclictest19-21ksoftirqd/100:31:091
254998253,4cyclictest121rcu_preempt21:10:161
254998251,4cyclictest121rcu_preempt22:35:191
254998251,4cyclictest121rcu_preempt21:30:311
24482250,1sleep132674-21kworker/u8:1821:51:351
21992250,2sleep331988-21kworker/u8:2700:14:453
144332250,2sleep30-21swapper/322:19:243
118172250,2sleep10-21swapper/123:23:461
114462250,1sleep36825-21kworker/u8:023:21:233
110272250,7sleep3311ksoftirqd/320:57:163
69172240,1sleep132126-21kworker/u8:623:12:521
66582240,2sleep30-21swapper/323:11:183
43942240,1sleep332126-21kworker/u8:623:06:183
33342241,3sleep33341-21ntpq00:15:313
278652240,13sleep119-21ksoftirqd/122:48:301
274852240,12sleep30-21swapper/322:46:233
2552982416,6cyclictest0-21swapper/222:25:202
2552982415,7cyclictest20217-21apt-get21:20:152
2552982415,7cyclictest12526-21ssh00:35:422
2552982415,7cyclictest0-21swapper/223:10:242
2552982415,7cyclictest0-21swapper/223:00:412
2552982415,6cyclictest984-21ssh00:10:272
2552982415,6cyclictest15930-21aten2_rfpower_v19:45:192
2552982414,8cyclictest3916-21ntpq23:05:392
2552982414,7cyclictest4814-21ssh00:20:132
2552982414,7cyclictest4814-21ssh00:20:122
2552982414,7cyclictest18104-21ssh21:15:332
2552982414,6cyclictest4592-21/usr/sbin/munin19:15:212
2552982413,9cyclictest26544-21latency23:55:272
2552982413,8cyclictest22114-21missed_timers23:45:282
2552982413,8cyclictest12299-21ls19:35:252
2552982413,8cyclictest0-21swapper/220:10:252
2552982413,8cyclictest0-21swapper/220:10:252
2552982412,9cyclictest32126-21kworker/u8:623:15:182
2552982411,10cyclictest3772-21awk21:55:282
254998244,7cyclictest121rcu_preempt20:05:251
254998244,3cyclictest121rcu_preempt21:15:321
254998242,3cyclictest121rcu_preempt19:14:591
254998241,5cyclictest3825-21fw_packets21:55:311
254798249,12cyclictest118150irq/29-4f00000.21:40:330
254798248,3cyclictest118150irq/29-4f00000.00:00:010
254798246,15cyclictest118150irq/29-4f00000.20:45:270
254798244,5cyclictest24224-21cat22:40:270
2547982411,10cyclictest118150irq/29-4f00000.19:15:170
2547982410,11cyclictest118150irq/29-4f00000.21:10:330
2547982410,11cyclictest118150irq/29-4f00000.00:25:200
235042240,1sleep323006-21kworker/u8:322:39:393
134612240,4sleep119-21ksoftirqd/119:37:401
95332230,2sleep10-21swapper/122:06:511
6282230,1sleep128117-21kworker/u8:221:49:501
60422230,12sleep10-21swapper/119:17:591
38752230,2sleep10-21swapper/100:16:031
283532230,3sleep127573-21kworker/u8:4522:50:041
267852230,12sleep331-21ksoftirqd/320:13:093
267852230,12sleep331-21ksoftirqd/320:13:093
255298232,6cyclictest96692kworker/u8:019:30:262
255298232,6cyclictest96692kworker/u8:019:30:252
2552982315,6cyclictest0-21swapper/220:25:282
2552982314,7cyclictest0-21swapper/223:35:282
255298231,3cyclictest13407-21kworker/u8:3019:42:522
2552982313,8cyclictest0-21swapper/223:20:342
2552982313,7cyclictest31239-21ssh21:45:222
2552982313,7cyclictest0-21swapper/221:25:192
2552982312,9cyclictest0-21swapper/220:05:022
2552982312,8cyclictest6864-21ntpq20:45:382
255298230,8cyclictest0-21swapper/220:20:182
254998234,3cyclictest121rcu_preempt20:45:001
254998231,5cyclictest13412-21kworker/u8:3519:55:011
254998231,4cyclictest12548-21ntpq00:35:451
254998231,4cyclictest0-21swapper/120:31:011
254798239,11cyclictest118150irq/29-4f00000.00:40:000
254798238,4cyclictest118150irq/29-4f00000.20:05:000
254798238,12cyclictest118150irq/29-4f00000.21:27:360
2547982311,6cyclictest15575-21mailstats23:30:420
2547982310,10cyclictest118150irq/29-4f00000.19:40:290
2547982310,10cyclictest118150irq/29-4f00000.19:39:590
2547982310,10cyclictest118150irq/29-4f00000.00:20:240
2547982310,10cyclictest118150irq/29-4f00000.00:20:240
238942230,5sleep1191ksoftirqd/123:50:211
230952230,2sleep30-21swapper/323:48:263
170222230,1sleep313419-21kworker/u8:4219:45:553
153112230,12sleep30-21swapper/319:42:293
133462230,2sleep30-21swapper/319:36:513
98072220,2sleep30-21swapper/322:08:343
93442220,2sleep10-21swapper/120:54:161
70832220,11sleep119-21ksoftirqd/119:20:231
255398222,5cyclictest31-21ksoftirqd/320:40:473
2553982215,4cyclictest7279-21ntpq19:20:293
2552982213,6cyclictest0-21swapper/200:15:382
2552982212,7cyclictest0-21swapper/222:30:232
2552982212,7cyclictest0-21swapper/220:50:272
254998222,5cyclictest121rcu_preempt22:25:431
2549982210,3cyclictest19-21ksoftirqd/123:30:451
254998220,3cyclictest121rcu_preempt19:25:181
254798228,4cyclictest118150irq/29-4f00000.22:06:520
254798228,11cyclictest118150irq/29-4f00000.20:25:360
254798228,11cyclictest118150irq/29-4f00000.20:20:300
254798228,11cyclictest118150irq/29-4f00000.00:34:590
254798227,8cyclictest13133-21ssh23:25:360
254798227,4cyclictest118150irq/29-4f00000.21:20:530
254798227,4cyclictest118150irq/29-4f00000.20:30:200
2547982215,5cyclictest144772chrt22:19:410
2547982211,6cyclictest29289-21sh22:50:400
2547982210,10cyclictest118150irq/29-4f00000.21:55:370
235382220,1sleep112895-21kworker/u8:121:26:421
209742220,1sleep113423-21kworker/u8:4619:56:091
86362210,5sleep331-21ksoftirqd/300:27:163
300712210,10sleep331-21ksoftirqd/322:53:113
255398213,4cyclictest2081-21runrttasks22:30:583
255398211,7cyclictest27748-21find21:35:403
255398211,3cyclictest121rcu_preempt19:55:023
2553982113,5cyclictest24735-21ntpq22:40:353
2552982111,7cyclictest0-21swapper/219:25:342
254998211,3cyclictest121rcu_preempt20:50:011
254798219,9cyclictest118150irq/29-4f00000.19:25:110
254798219,10cyclictest118150irq/29-4f00000.22:10:380
254798218,9cyclictest118150irq/29-4f00000.00:00:380
254798218,4cyclictest118150irq/29-4f00000.20:59:590
254798218,3cyclictest118150irq/29-4f00000.23:40:220
254798218,10cyclictest118150irq/29-4f00000.21:30:300
254798217,4cyclictest118150irq/29-4f00000.21:50:340
254798217,4cyclictest118150irq/29-4f00000.00:15:400
254798216,9cyclictest19168-21latency_hist22:30:010
2547982112,6cyclictest3324-21sshd23:05:280
2547982111,8cyclictest10-21ksoftirqd/022:20:240
2547982110,9cyclictest118150irq/29-4f00000.19:45:290
255398206,3cyclictest251512kworker/u8:2123:56:363
255398205,4cyclictest121rcu_preempt21:20:183
255398203,4cyclictest121rcu_preempt21:30:423
255398202,11cyclictest15322-21aten2_rfpower_e21:10:163
2553982015,3cyclictest15159-21irqstats23:30:283
2553982013,4cyclictest8411-21kernelversion20:50:283
2553982013,4cyclictest4412-21ntpq21:55:453
2553982013,4cyclictest2483-21sh21:51:503
2553982013,4cyclictest2081-21runrttasks22:28:333
2553982013,4cyclictest17719-21sh21:15:033
2553982013,4cyclictest13651-21forks21:05:243
2553982013,4cyclictest13651-21forks21:05:243
2553982012,5cyclictest8626-21if_err_eth019:25:223
254998201,7cyclictest121rcu_preempt20:10:261
254998201,7cyclictest121rcu_preempt20:10:251
2549982013,4cyclictest10636-21sendmail_mailst20:55:421
2549982013,4cyclictest10168-21apt19:30:111
2549982013,4cyclictest10168-21apt19:30:101
254798208,9cyclictest118150irq/29-4f00000.20:10:140
254798208,9cyclictest118150irq/29-4f00000.20:10:140
254798207,4cyclictest118150irq/29-4f00000.21:35:300
254798207,4cyclictest118150irq/29-4f00000.21:05:370
254798207,4cyclictest118150irq/29-4f00000.21:05:370
254798207,4cyclictest118150irq/29-4f00000.20:35:260
254798207,4cyclictest118150irq/29-4f00000.20:35:260
254798207,4cyclictest118150irq/29-4f00000.19:10:550
254798206,8cyclictest0-21swapper/000:14:200
254798206,4cyclictest118150irq/29-4f00000.21:47:100
254798205,4cyclictest118150irq/29-4f00000.00:05:240
254798205,12cyclictest118150irq/29-4f00000.22:03:420
254798202,9cyclictest54622kworker/u8:1220:42:110
254798202,3cyclictest16938-1kworker/u9:121:18:280
254798201,3cyclictest32122-21kworker/u8:323:00:490
231782200,10sleep331-21ksoftirqd/320:04:483
168232200,9sleep3301rcuc/323:35:153
110052200,9sleep32542-21cyclictest00:32:553
103052200,9sleep119-21ksoftirqd/122:10:131
72302190,7sleep331-21ksoftirqd/320:45:533
255398195,11cyclictest11240-21ld22:10:403
255398194,4cyclictest121rcu_preempt22:00:343
2553981912,4cyclictest3136-21ntpq20:35:403
2553981912,4cyclictest3136-21ntpq20:35:403
2553981912,4cyclictest1299-21ntpq20:30:593
2553981911,5cyclictest13443-21timerandwakeup23:25:473
254998193,7cyclictest54622kworker/u8:1221:01:281
254798197,10cyclictest118150irq/29-4f00000.22:36:560
254798196,4cyclictest118150irq/29-4f00000.23:35:420
254798195,8cyclictest0-21swapper/023:51:090
2547981914,3cyclictest5298-21ssh23:10:190
2547981912,5cyclictest18472-21ntpq19:50:350
2547981912,5cyclictest12474-21processes21:00:450
2547981911,6cyclictest21383-21/usr/sbin/munin23:45:130
2547981911,5cyclictest19869-21aten2_rfpower_v19:55:320
242762190,3sleep324277-21ntpq20:05:333
128802190,8sleep331-21ksoftirqd/321:02:053
2553981811,4cyclictest32552-21latency_hist20:30:023
2553981811,4cyclictest23606-21/usr/sbin/munin23:50:383
254798185,4cyclictest118150irq/29-4f00000.23:20:370
254798185,4cyclictest118150irq/29-4f00000.22:30:380
254798184,4cyclictest118150irq/29-4f00000.22:48:420
2547981813,3cyclictest10-21ksoftirqd/020:05:180
254798174,5cyclictest0-21swapper/019:30:180
254798174,5cyclictest0-21swapper/019:30:170
254798171,13cyclictest6858-21irqrtprio19:20:230
116312170,6sleep310881-21kworker/u8:1700:35:213
254798147,5cyclictest2581-21latency_hist19:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional