You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-28 - 03:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Sun Jun 28, 2026 00:45:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2062821500,3sleep30-21swapper/321:55:583
2062821500,3sleep30-21swapper/321:55:583
2589821180,4sleep00-21swapper/023:57:090
2589821180,4sleep00-21swapper/023:57:090
2289921060,3sleep30-21swapper/323:15:003
2289921060,3sleep30-21swapper/323:15:003
2289921060,3sleep30-21swapper/323:15:003
2875821040,4sleep00-21swapper/021:29:140
2875821040,4sleep00-21swapper/021:29:140
79532980,3chrt0-21swapper/000:14:330
79532980,3chrt0-21swapper/000:14:330
81692970,3chrt0-21swapper/200:14:512
81692970,3chrt0-21swapper/200:14:512
238092960,3sleep20-21swapper/221:22:332
238092960,3sleep20-21swapper/221:22:332
238092960,3sleep20-21swapper/221:22:332
154212960,3sleep20-21swapper/200:21:142
154212960,3sleep20-21swapper/200:21:142
154212960,3sleep20-21swapper/200:21:142
226832880,17sleep00-21swapper/020:05:550
226832880,17sleep00-21swapper/020:05:550
201212820,2sleep30-21swapper/323:50:493
201212820,2sleep30-21swapper/323:50:493
188542810,3sleep218853-21ssh00:25:572
188542810,3sleep218853-21ssh00:25:572
188542810,3sleep218853-21ssh00:25:572
189422780,9sleep333-21ksoftirqd/300:25:583
189422780,9sleep333-21ksoftirqd/300:25:583
189422780,9sleep333-21ksoftirqd/300:25:583
319982720,4sleep20-21swapper/220:30:562
319982720,4sleep20-21swapper/220:30:562
244372710,3sleep10-21swapper/121:23:441
244372710,3sleep10-21swapper/121:23:441
244372710,3sleep10-21swapper/121:23:441
250832700,3sleep20-21swapper/222:38:212
250832700,3sleep20-21swapper/222:38:212
178842650,3sleep00-21swapper/000:25:380
178842650,3sleep00-21swapper/000:25:380
178842650,3sleep00-21swapper/000:25:380
102652650,3chrt0-21swapper/023:38:320
102652650,3chrt0-21swapper/023:38:320
190912610,1sleep019234-21/usr/sbin/munin00:26:000
190912610,1sleep019234-21/usr/sbin/munin00:26:000
190912610,1sleep019234-21/usr/sbin/munin00:26:000
317322570,2sleep10-21swapper/100:05:301
317322570,2sleep10-21swapper/100:05:301
317322570,2sleep10-21swapper/100:05:301
261312560,3sleep30-21swapper/322:03:053
261312560,3sleep30-21swapper/322:03:053
261312560,3sleep30-21swapper/322:03:053
83932550,2sleep28502-21switchtime23:35:582
83932550,2sleep28502-21switchtime23:35:582
122312550,3sleep012228-21ssh22:25:490
122312550,3sleep012228-21ssh22:25:490
66112540,3chrt0-21swapper/322:19:093
66112540,3chrt0-21swapper/322:19:093
287872540,5sleep00-21swapper/000:00:540
287872540,5sleep00-21swapper/000:00:540
287872540,5sleep00-21swapper/000:00:540
96432530,3chrt0-21swapper/300:15:533
96432530,3chrt0-21swapper/300:15:533
97512520,2chrt0-21swapper/022:58:290
97512520,2chrt0-21swapper/022:58:290
3892520,2sleep00-21swapper/022:46:400
3892520,2sleep00-21swapper/022:46:400
190162510,3sleep20-21swapper/222:31:542
190162510,3sleep20-21swapper/222:31:542
312992500,4sleep30-21swapper/300:04:433
312992500,4sleep30-21swapper/300:04:433
312992500,4sleep30-21swapper/300:04:433
281892490,2sleep20-21swapper/220:20:562
281892490,2sleep20-21swapper/220:20:562
221612490,3chrt0-21swapper/122:35:471
221612490,3chrt0-21swapper/122:35:471
19622480,3sleep01623-21ls19:10:500
19622480,3sleep01623-21ls19:10:500
69272470,3sleep20-21swapper/222:55:412
69272470,3sleep20-21swapper/222:55:412
318822470,2sleep30-21swapper/323:25:493
318822470,2sleep30-21swapper/323:25:493
3117994628,12cyclictest27980-21latency_hist00:00:431
3117994628,12cyclictest27980-21latency_hist00:00:431
32602450,2sleep13454-21awk21:35:591
32602450,2sleep13454-21awk21:35:591
185522450,1sleep0121ksoftirqd/023:48:410
185522450,1sleep0121ksoftirqd/023:48:410
185522450,1sleep0121ksoftirqd/023:48:410
148692450,3sleep20-21swapper/219:45:472
103662440,3sleep10-21swapper/122:59:341
103662440,3sleep10-21swapper/122:59:341
156722430,3sleep20-21swapper/223:45:412
156722430,3sleep20-21swapper/223:45:412
103842430,3sleep30-21swapper/322:59:363
103842430,3sleep30-21swapper/322:59:363
204862420,6sleep227-21ksoftirqd/221:55:572
204862420,6sleep227-21ksoftirqd/221:55:572
247462410,3sleep30-21swapper/323:55:553
247462410,3sleep30-21swapper/323:55:553
226102410,3sleep30-21swapper/300:30:533
226102410,3sleep30-21swapper/300:30:533
226102410,3sleep30-21swapper/300:30:533
290262400,3chrt0-21swapper/322:42:123
290262400,3chrt0-21swapper/322:42:123
290262400,3chrt0-21swapper/322:42:123
262992400,3sleep10-21swapper/121:25:531
262992400,3sleep10-21swapper/121:25:531
12722400,2sleep00-21swapper/022:11:580
12722400,2sleep00-21swapper/022:11:580
12722400,2sleep00-21swapper/022:11:580
318232390,2sleep031822-21/usr/sbin/munin20:30:540
318232390,2sleep031822-21/usr/sbin/munin20:30:540
166112390,10sleep333-21ksoftirqd/321:14:263
166112390,10sleep333-21ksoftirqd/321:14:263
166112390,10sleep333-21ksoftirqd/321:14:263
165772390,2sleep30-21swapper/322:30:223
165772390,2sleep30-21swapper/322:30:223
265302380,4sleep10-21swapper/120:15:561
311899371,28cyclictest29484-21chrt00:01:132
311899371,28cyclictest29484-21chrt00:01:132
311899371,28cyclictest29484-21chrt00:01:132
230642370,3sleep20-21swapper/223:15:192
230642370,3sleep20-21swapper/223:15:192
230642370,3sleep20-21swapper/223:15:192
45582360,2sleep04630-21kernelversion20:45:500
45582360,2sleep04630-21kernelversion20:45:500
326562360,2sleep132671-21ssh21:33:181
326562360,2sleep132671-21ssh21:33:181
203382360,8sleep333-21ksoftirqd/322:33:403
203382360,8sleep333-21ksoftirqd/322:33:403
99932350,3sleep20-21swapper/222:22:462
99932350,3sleep20-21swapper/222:22:462
260832350,3sleep30-21swapper/321:25:513
260832350,3sleep30-21swapper/321:25:513
15512340,2sleep01560-21sh23:27:440
15512340,2sleep01560-21sh23:27:440
15512340,2sleep01560-21sh23:27:440
194012330,3sleep0121ksoftirqd/022:32:240
194012330,3sleep0121ksoftirqd/022:32:240
187942330,4sleep10-21swapper/100:25:561
187942330,4sleep10-21swapper/100:25:561
187942330,4sleep10-21swapper/100:25:561
317372320,5sleep30-21swapper/322:10:423
317372320,5sleep30-21swapper/322:10:423
275502320,1sleep34870-21kworker/3:100:36:023
275502320,1sleep34870-21kworker/3:100:36:023
275502320,1sleep34870-21kworker/3:100:36:023
54812310,2sleep34870-21kworker/3:122:53:173
54812310,2sleep34870-21kworker/3:122:53:173
311799319,11cyclictest21-21ksoftirqd/122:23:021
311799319,11cyclictest21-21ksoftirqd/122:23:021
25092313,18sleep30-21swapper/319:10:573
25092313,18sleep30-21swapper/319:10:573
36482300,3sleep20-21swapper/222:15:462
36482300,3sleep20-21swapper/222:15:462
36482300,3sleep20-21swapper/222:15:462
3117993010,11cyclictest21-21ksoftirqd/120:36:031
3117993010,11cyclictest21-21ksoftirqd/120:36:031
51102290,2sleep03115-21cyclictest22:52:380
51102290,2sleep03115-21cyclictest22:52:380
28692290,2sleep22881-21rm00:09:182
28692290,2sleep22881-21rm00:09:182
237562290,2sleep023761-21awk23:55:370
237562290,2sleep023761-21awk23:55:370
18432295,13sleep10-21swapper/119:10:471
18432295,13sleep10-21swapper/119:10:471
311799287,10cyclictest21-21ksoftirqd/123:36:521
311799287,10cyclictest21-21ksoftirqd/123:36:521
32782270,3sleep00-21swapper/000:09:510
32782270,3sleep00-21swapper/000:09:510
311799279,7cyclictest21-21ksoftirqd/123:43:011
311799279,7cyclictest21-21ksoftirqd/123:43:011
311799278,10cyclictest21-21ksoftirqd/122:16:051
311799278,10cyclictest21-21ksoftirqd/122:16:051
311799278,10cyclictest21-21ksoftirqd/121:49:431
311799278,10cyclictest21-21ksoftirqd/121:49:431
311799278,10cyclictest21-21ksoftirqd/121:49:431
311799277,7cyclictest21-21ksoftirqd/122:27:311
311799277,7cyclictest21-21ksoftirqd/122:27:311
311799276,11cyclictest21-21ksoftirqd/120:29:141
311799276,11cyclictest21-21ksoftirqd/120:29:141
311799275,8cyclictest21-21ksoftirqd/121:59:321
311799275,8cyclictest21-21ksoftirqd/121:59:321
3117992712,5cyclictest131rcu_preempt21:53:001
3117992712,5cyclictest131rcu_preempt21:53:001
114762270,2sleep011496-21rm00:17:360
114762270,2sleep011496-21rm00:17:360
311799268,9cyclictest21-21ksoftirqd/119:31:151
311799268,9cyclictest21-21ksoftirqd/119:31:151
311799267,7cyclictest21-21ksoftirqd/121:43:271
311799267,7cyclictest21-21ksoftirqd/121:43:271
311799267,7cyclictest21-21ksoftirqd/121:43:271
311799267,10cyclictest21-21ksoftirqd/100:11:071
311799267,10cyclictest21-21ksoftirqd/100:11:071
311799265,6cyclictest21-21ksoftirqd/123:32:251
311799265,6cyclictest21-21ksoftirqd/123:32:251
311799265,6cyclictest21-21ksoftirqd/123:32:251
3117992614,9cyclictest14870-21/usr/sbin/munin19:45:471
3117992612,4cyclictest131rcu_preempt20:21:261
3117992612,4cyclictest131rcu_preempt20:21:261
253112260,2sleep20-21swapper/200:34:212
253112260,2sleep20-21swapper/200:34:212
253112260,2sleep20-21swapper/200:34:212
222532260,4sleep20-21swapper/220:05:492
222532260,4sleep20-21swapper/220:05:492
195172260,4sleep3321rcuc/321:17:153
195172260,4sleep3321rcuc/321:17:153
195172260,4sleep3321rcuc/321:17:153
18442264,13sleep21623-21ls19:10:482
18442264,13sleep21623-21ls19:10:482
311799256,6cyclictest21-21ksoftirqd/123:11:011
311799256,6cyclictest21-21ksoftirqd/123:11:011
311799256,6cyclictest21-21ksoftirqd/123:11:011
311799256,11cyclictest21-21ksoftirqd/122:43:491
311799256,11cyclictest21-21ksoftirqd/122:43:491
311799256,11cyclictest21-21ksoftirqd/122:43:491
3117992519,4cyclictest201rcuc/122:13:011
3117992519,4cyclictest201rcuc/122:13:011
3117992519,4cyclictest201rcuc/122:13:011
3117992512,9cyclictest26544-21ssh23:19:131
3117992512,9cyclictest26544-21ssh23:19:131
3117992512,3cyclictest131rcu_preempt23:52:501
3117992512,3cyclictest131rcu_preempt23:52:501
3117992511,3cyclictest131rcu_preempt00:36:301
3117992511,3cyclictest131rcu_preempt00:36:301
3117992511,3cyclictest131rcu_preempt00:36:301
3117992510,7cyclictest0-21swapper/123:23:251
3117992510,7cyclictest0-21swapper/123:23:251
3117992510,7cyclictest0-21swapper/123:23:251
3116992518,4cyclictest12540-21ssh23:40:570
3116992518,4cyclictest12540-21ssh23:40:570
3116992514,9cyclictest18353-21ssh21:53:510
3116992514,9cyclictest18353-21ssh21:53:510
87772240,3sleep30-21swapper/321:41:273
87772240,3sleep30-21swapper/321:41:273
87772240,3sleep30-21swapper/321:41:273
32132240,2sleep10-21swapper/122:50:501
32132240,2sleep10-21swapper/122:50:501
311799248,8cyclictest21-21ksoftirqd/100:08:521
311799248,8cyclictest21-21ksoftirqd/100:08:521
311799248,6cyclictest21-21ksoftirqd/100:21:501
311799248,6cyclictest21-21ksoftirqd/100:21:501
311799248,6cyclictest21-21ksoftirqd/100:21:501
311799247,9cyclictest21-21ksoftirqd/123:01:211
311799247,9cyclictest21-21ksoftirqd/123:01:211
311799247,7cyclictest21-21ksoftirqd/122:31:481
311799247,7cyclictest21-21ksoftirqd/122:31:481
311799247,11cyclictest21-21ksoftirqd/119:29:231
311799247,11cyclictest21-21ksoftirqd/119:29:231
311799247,11cyclictest21-21ksoftirqd/119:29:231
311799246,9cyclictest21-21ksoftirqd/123:28:331
311799246,9cyclictest21-21ksoftirqd/123:28:331
311799246,9cyclictest21-21ksoftirqd/123:28:331
311799246,10cyclictest21-21ksoftirqd/100:15:461
311799246,10cyclictest21-21ksoftirqd/100:15:461
311799244,8cyclictest21-21ksoftirqd/123:06:191
311799244,8cyclictest21-21ksoftirqd/123:06:191
311799244,8cyclictest21-21ksoftirqd/122:01:421
311799244,8cyclictest21-21ksoftirqd/122:01:421
311799244,8cyclictest21-21ksoftirqd/122:01:421
311799244,11cyclictest21-21ksoftirqd/122:08:451
311799244,11cyclictest21-21ksoftirqd/122:08:451
311799242,6cyclictest21-21ksoftirqd/120:05:531
311799242,6cyclictest21-21ksoftirqd/120:05:531
3117992417,5cyclictest201rcuc/119:49:171
3117992417,5cyclictest201rcuc/119:49:171
3117992412,3cyclictest131rcu_preempt22:48:271
3117992412,3cyclictest131rcu_preempt22:48:271
3117992411,7cyclictest0-21swapper/119:55:521
3117992411,3cyclictest131rcu_preempt20:48:151
3117992411,3cyclictest131rcu_preempt20:48:151
311699242,12cyclictest4062-21needreboot23:30:530
311699242,12cyclictest4062-21needreboot23:30:530
311699242,12cyclictest4062-21needreboot23:30:530
3116992417,5cyclictest31053-21ssh23:24:530
3116992417,5cyclictest31053-21ssh23:24:530
3116992417,5cyclictest31053-21ssh23:24:530
311699241,18cyclictest5487-21ls19:20:410
311699241,18cyclictest5487-21ls19:20:410
311699241,18cyclictest24059-21cut20:10:470
311699241,18cyclictest24059-21cut20:10:470
311699241,18cyclictest24059-21cut20:10:470
311899230,19cyclictest6538-21ls20:50:492
311899230,19cyclictest6538-21ls20:50:492
311799238,8cyclictest21-21ksoftirqd/121:05:521
311799238,8cyclictest21-21ksoftirqd/121:05:521
311799238,7cyclictest21-21ksoftirqd/120:35:231
311799238,7cyclictest21-21ksoftirqd/120:35:231
311799237,6cyclictest21-21ksoftirqd/121:13:561
311799237,6cyclictest21-21ksoftirqd/121:13:561
311799237,6cyclictest21-21ksoftirqd/121:13:561
311799236,9cyclictest21-21ksoftirqd/123:48:101
311799236,9cyclictest21-21ksoftirqd/123:48:101
311799236,9cyclictest21-21ksoftirqd/123:48:101
311799236,9cyclictest21-21ksoftirqd/121:17:141
311799236,9cyclictest21-21ksoftirqd/121:17:141
311799236,9cyclictest21-21ksoftirqd/121:17:141
311799236,11cyclictest21-21ksoftirqd/120:55:111
311799236,11cyclictest21-21ksoftirqd/120:55:111
3117992318,3cyclictest201rcuc/120:15:361
3117992318,3cyclictest201rcuc/120:15:361
3117992318,3cyclictest201rcuc/120:15:361
3117992316,5cyclictest201rcuc/119:54:481
3117992316,5cyclictest201rcuc/119:54:481
3117992316,5cyclictest201rcuc/119:54:481
3117992311,3cyclictest131rcu_preempt19:25:171
3117992311,3cyclictest131rcu_preempt19:25:171
3117992310,8cyclictest201rcuc/100:32:501
3117992310,8cyclictest201rcuc/100:32:501
3117992310,8cyclictest201rcuc/100:32:501
3117992310,3cyclictest131rcu_preempt19:45:381
311699239,11cyclictest134-21systemd-journal23:20:360
311699239,11cyclictest134-21systemd-journal23:20:360
3116992315,5cyclictest22997-21ssh22:35:570
3116992315,5cyclictest22997-21ssh22:35:570
3116992314,6cyclictest5685-21df_inode19:20:480
3116992314,6cyclictest5685-21df_inode19:20:480
311699231,19cyclictest12926-21find19:40:470
311699231,19cyclictest12926-21find19:40:470
311699231,11cyclictest23883-21grep22:00:480
311699231,11cyclictest23883-21grep22:00:480
217002230,3sleep00-21swapper/023:12:470
217002230,3sleep00-21swapper/023:12:470
217002230,3sleep00-21swapper/023:12:470
311899221,18cyclictest31747-21ls22:10:412
311899221,18cyclictest31747-21ls22:10:412
311899221,10cyclictest6890-21runrttasks21:40:352
311899221,10cyclictest6890-21runrttasks21:40:352
311799227,8cyclictest21-21ksoftirqd/120:00:481
311799227,8cyclictest21-21ksoftirqd/120:00:481
3117992216,4cyclictest201rcuc/120:59:221
3117992216,4cyclictest201rcuc/120:59:221
311799221,15cyclictest4217-21ls19:15:521
311799221,15cyclictest4217-21ls19:15:521
3117992210,3cyclictest131rcu_preempt20:44:121
3117992210,3cyclictest131rcu_preempt20:44:121
3117992210,3cyclictest131rcu_preempt20:44:121
311699229,9cyclictest25910-21fschecks_time20:15:480
311699221,15cyclictest27489-21find20:20:470
311699221,15cyclictest27489-21find20:20:470
311699221,11cyclictest1883-21cron21:35:350
311699221,11cyclictest1883-21cron21:35:350
239032220,3sleep00-21swapper/021:22:430
239032220,3sleep00-21swapper/021:22:430
239032220,3sleep00-21swapper/021:22:430
227122220,3sleep30-21swapper/322:35:533
227122220,3sleep30-21swapper/322:35:533
311899219,9cyclictest16833-21sed22:30:382
311899219,9cyclictest16833-21sed22:30:382
3118992114,5cyclictest1569-21ssh23:27:452
3118992114,5cyclictest1569-21ssh23:27:452
3118992114,5cyclictest1569-21ssh23:27:452
311899211,18cyclictest12358-21ls21:45:572
311899211,18cyclictest12358-21ls21:45:572
311899211,18cyclictest12358-21ls21:45:572
311899211,17cyclictest16152-21ls23:45:512
311899211,17cyclictest16152-21ls23:45:512
311899211,17cyclictest16152-21ls23:45:512
3118992110,8cyclictest0-21swapper/220:45:412
3118992110,8cyclictest0-21swapper/220:45:412
3118992110,8cyclictest0-21swapper/220:45:412
311699219,9cyclictest29893-21cut20:25:520
311699219,9cyclictest29893-21cut20:25:520
311699217,11cyclictest19997-21systemctl20:00:360
3116992115,4cyclictest8226-21ssh22:20:520
3116992115,4cyclictest8226-21ssh22:20:520
3116992114,5cyclictest27909-21ssh22:05:490
3116992114,5cyclictest27909-21ssh22:05:490
3116992114,5cyclictest21127-21ssh21:20:110
3116992114,5cyclictest21127-21ssh21:20:110
3116992114,5cyclictest21127-21ssh21:20:110
311699211,17cyclictest610-21rs:main0
311699211,17cyclictest610-21rs:main0
311699211,17cyclictest610-21rs:main0
311699211,16cyclictest7820-21ssh22:20:480
311699211,11cyclictest7516-21fschecks_time21:40:490
311699211,11cyclictest7516-21fschecks_time21:40:490
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional