You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 03:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Sun Jul 05, 2026 00:45:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1166421330,2sleep30-21swapper/321:23:573
1166421330,2sleep30-21swapper/321:23:573
526321300,3sleep00-21swapper/000:26:210
526321300,3sleep00-21swapper/000:26:210
1067921170,2sleep00-21swapper/023:54:220
1067921170,2sleep00-21swapper/023:54:220
3010121030,3sleep00-21swapper/021:45:520
3010121030,3sleep00-21swapper/021:45:520
2233321020,1sleep012-21ksoftirqd/019:11:080
2233321020,1sleep012-21ksoftirqd/019:11:080
225442870,7sleep1211ksoftirqd/120:40:581
225442870,7sleep1211ksoftirqd/120:40:581
74282810,3chrt0-21swapper/021:56:250
74282810,3chrt0-21swapper/021:56:250
74282810,3chrt0-21swapper/021:56:250
155122770,2sleep00-21swapper/022:43:480
155122770,2sleep00-21swapper/022:43:480
155122770,2sleep00-21swapper/022:43:480
150512730,4sleep10-21swapper/122:42:561
150512730,4sleep10-21swapper/122:42:561
150512730,4sleep10-21swapper/122:42:561
221042710,2sleep022107-21idleruntime-cro22:15:420
221042710,2sleep022107-21idleruntime-cro22:15:420
221042710,2sleep022107-21idleruntime-cro22:15:420
307542690,2sleep20-21swapper/221:45:582
307542690,2sleep20-21swapper/221:45:582
307542690,2sleep20-21swapper/221:45:582
284982650,2sleep10-21swapper/123:36:391
284982650,2sleep10-21swapper/123:36:391
56482630,4chrt0-21swapper/100:27:021
56482630,4chrt0-21swapper/100:27:021
268282600,2sleep0131rcu_preempt19:25:540
268282600,2sleep0131rcu_preempt19:25:540
268282600,2sleep0131rcu_preempt19:25:540
26122570,2sleep00-21swapper/023:44:450
26122570,2sleep00-21swapper/023:44:450
26122570,2sleep00-21swapper/023:44:450
267082560,2chrt0-21swapper/223:35:512
175362540,4sleep333-21ksoftirqd/300:01:563
175362540,4sleep333-21ksoftirqd/300:01:563
295082530,2chrt0-21swapper/221:45:022
295082530,2chrt0-21swapper/221:45:022
11772520,3sleep00-21swapper/022:29:010
255092500,3sleep00-21swapper/022:55:580
255092500,3sleep00-21swapper/022:55:580
255092500,3sleep00-21swapper/022:55:580
2239499484,28cyclictest15749-21wc00:00:490
2239499484,28cyclictest15749-21wc00:00:490
2239499484,28cyclictest15749-21wc00:00:490
310532460,3sleep00-21swapper/023:40:150
310532460,3sleep00-21swapper/023:40:150
146812460,2sleep30-21swapper/321:26:543
146812460,2sleep30-21swapper/321:26:543
244212450,3sleep10-21swapper/122:17:281
244212450,3sleep10-21swapper/122:17:281
60262440,3sleep30-21swapper/323:48:263
60262440,3sleep30-21swapper/323:48:263
60262440,3sleep30-21swapper/323:48:263
174342440,10sleep121-21ksoftirqd/123:25:531
174342440,10sleep121-21ksoftirqd/123:25:531
174342440,10sleep121-21ksoftirqd/123:25:531
39992420,2sleep04057-21tail19:50:590
39992420,2sleep04057-21tail19:50:590
161962420,4sleep016195-21idleruntime-cro20:25:420
161962420,4sleep016195-21idleruntime-cro20:25:420
179092410,2sleep00-21swapper/000:02:380
179092410,2sleep00-21swapper/000:02:380
104542410,3sleep110447-21ssh22:00:561
104542410,3sleep110447-21ssh22:00:561
87242390,5sleep30-21swapper/300:30:583
87242390,5sleep30-21swapper/300:30:583
39152390,3sleep13914-21ssh00:25:541
39152390,3sleep13914-21ssh00:25:541
27672390,2sleep12775-21sh23:45:031
27672390,2sleep12775-21sh23:45:031
27672390,2sleep12775-21sh23:45:031
2239499393,7cyclictest12-21ksoftirqd/000:20:540
2239499393,7cyclictest12-21ksoftirqd/000:20:540
2239499393,7cyclictest12-21ksoftirqd/000:20:540
128602390,2sleep013024-21/usr/sbin/munin20:15:550
128602390,2sleep013024-21/usr/sbin/munin20:15:550
236772380,4sleep00-21swapper/000:10:420
236772380,4sleep00-21swapper/000:10:420
236772380,4sleep00-21swapper/000:10:420
222162380,2sleep220925-21ls19:11:062
222162380,2sleep220925-21ls19:11:062
175672380,2sleep30-21swapper/320:26:053
175672380,2sleep30-21swapper/320:26:053
80892370,2sleep30-21swapper/300:30:463
80892370,2sleep30-21swapper/300:30:463
293282370,2sleep30-21swapper/319:31:043
293282370,2sleep30-21swapper/319:31:043
118272370,3chrt0-21swapper/123:18:341
118272370,3chrt0-21swapper/123:18:341
118272370,3chrt0-21swapper/123:18:341
225342360,3sleep10-21swapper/123:30:591
225342360,3sleep10-21swapper/123:30:591
222722360,5sleep222269-21if_eth023:30:562
75182350,3sleep10-21swapper/123:50:531
75182350,3sleep10-21swapper/123:50:531
75182350,3sleep10-21swapper/123:50:531
261172350,2sleep00-21swapper/022:20:370
261172350,2sleep00-21swapper/022:20:370
124152350,3sleep112417-21latency_hist22:40:431
124152350,3sleep112417-21latency_hist22:40:431
22396993422,4cyclictest15889-21grep00:00:562
22396993422,4cyclictest15889-21grep00:00:562
22396993422,4cyclictest15889-21grep00:00:562
2239499346,8cyclictest12-21ksoftirqd/021:15:560
2239499346,8cyclictest12-21ksoftirqd/021:15:560
2239499345,6cyclictest12-21ksoftirqd/000:30:560
2239499345,6cyclictest12-21ksoftirqd/000:30:560
119922340,3sleep30-21swapper/322:02:113
119922340,3sleep30-21swapper/322:02:113
27462330,2sleep330231-21kworker/3:023:45:003
27462330,2sleep330231-21kworker/3:023:45:003
27462330,2sleep330231-21kworker/3:023:45:003
252092330,2sleep025312-21latency19:20:570
252092330,2sleep025312-21latency19:20:570
244592330,3sleep00-21swapper/023:32:510
244592330,3sleep00-21swapper/023:32:510
2239499334,7cyclictest12-21ksoftirqd/020:00:540
2239499334,7cyclictest12-21ksoftirqd/020:00:540
2239499334,7cyclictest12-21ksoftirqd/020:00:540
12032330,2sleep20-21swapper/223:42:142
12032330,2sleep20-21swapper/223:42:142
12032330,2sleep20-21swapper/223:42:142
249632320,2sleep30-21swapper/323:33:353
249632320,2sleep30-21swapper/323:33:353
2239699323,23cyclictest16427-21/usr/sbin/munin00:01:012
2239699323,23cyclictest16427-21/usr/sbin/munin00:01:012
22395993223,6cyclictest15703-21cut00:00:461
22395993223,6cyclictest15703-21cut00:00:461
22395993223,6cyclictest15703-21cut00:00:461
2239599322,23cyclictest16578-21ntpq00:01:031
2239599322,23cyclictest16578-21ntpq00:01:031
158002320,3sleep00-21swapper/022:06:380
158002320,3sleep00-21swapper/022:06:380
158002320,3sleep00-21swapper/022:06:380
15372320,2sleep10-21swapper/121:11:041
15372320,2sleep10-21swapper/121:11:041
15372320,2sleep10-21swapper/121:11:041
2239799311,23cyclictest15734-21taskset00:00:483
2239799311,23cyclictest15734-21taskset00:00:483
2239799311,23cyclictest15734-21taskset00:00:483
2239499315,9cyclictest12-21ksoftirqd/019:55:570
2239499315,9cyclictest12-21ksoftirqd/019:55:570
158222310,3sleep20-21swapper/222:44:222
158222310,3sleep20-21swapper/222:44:222
158222310,3sleep20-21swapper/222:44:222
117392310,2sleep011748-21ssh22:01:450
117392310,2sleep011748-21ssh22:01:450
2239499304,6cyclictest12-21ksoftirqd/023:00:560
2239499304,6cyclictest12-21ksoftirqd/023:00:560
277062290,4sleep10-21swapper/100:15:411
277062290,4sleep10-21swapper/100:15:411
277062290,4sleep10-21swapper/100:15:411
237142290,2sleep20-21swapper/222:16:092
237142290,2sleep20-21swapper/222:16:092
2239499291,22cyclictest13637-21cat23:20:540
2239499291,22cyclictest13637-21cat23:20:540
2239499291,22cyclictest13637-21cat23:20:540
40212280,3sleep30-21swapper/321:15:003
40212280,3sleep30-21swapper/321:15:003
40212280,3sleep30-21swapper/321:15:003
2239699280,19cyclictest27184-21ssh22:21:002
2239699280,19cyclictest27184-21ssh22:21:002
2239499284,5cyclictest12-21ksoftirqd/019:40:540
2239499284,5cyclictest12-21ksoftirqd/019:40:540
2239499284,5cyclictest12-21ksoftirqd/019:40:540
2239499283,6cyclictest12-21ksoftirqd/020:45:540
2239499283,6cyclictest12-21ksoftirqd/020:45:540
22395992715,5cyclictest17449-21rm00:40:001
22395992715,5cyclictest17449-21rm00:40:001
22395992715,5cyclictest17449-21rm00:40:001
22394992719,5cyclictest7292-21ssh23:12:510
22394992719,5cyclictest7292-21ssh23:12:510
22394992719,5cyclictest7292-21ssh23:12:510
2239499271,4cyclictest151rcuc/020:35:530
2239499271,4cyclictest151rcuc/020:35:530
22394992712,7cyclictest12-21ksoftirqd/021:39:260
22394992712,7cyclictest12-21ksoftirqd/021:39:260
223512274,13sleep10-21swapper/119:11:211
223512274,13sleep10-21swapper/119:11:211
300652260,2sleep10-21swapper/100:17:301
300652260,2sleep10-21swapper/100:17:301
300652260,2sleep10-21swapper/100:17:301
22395992613,4cyclictest131rcu_preempt00:10:541
22395992613,4cyclictest131rcu_preempt00:10:541
2239499269,3cyclictest131rcu_preempt20:10:550
2239499269,3cyclictest131rcu_preempt20:10:550
2239499267,6cyclictest12-21ksoftirqd/021:00:550
2239499267,6cyclictest12-21ksoftirqd/021:00:550
2239499267,6cyclictest12-21ksoftirqd/021:00:550
2239499266,5cyclictest12-21ksoftirqd/000:25:550
2239499260,3cyclictest131rcu_preempt22:46:170
2239499260,3cyclictest131rcu_preempt22:46:170
220072260,3sleep30-21swapper/320:40:523
2239499257,8cyclictest12-21ksoftirqd/021:52:190
2239499257,8cyclictest12-21ksoftirqd/021:52:190
2239499257,12cyclictest12-21ksoftirqd/023:49:150
2239499257,12cyclictest12-21ksoftirqd/023:49:150
2239499257,12cyclictest12-21ksoftirqd/023:49:150
2239499251,21cyclictest17448-21ssh21:30:570
2239499251,21cyclictest17448-21ssh21:30:570
2239499251,19cyclictest32733-21diskmemload22:51:010
2239499251,19cyclictest32733-21diskmemload22:51:010
2239499251,19cyclictest32733-21diskmemload22:51:010
2239499251,14cyclictest12-21ksoftirqd/021:11:520
2239499251,14cyclictest12-21ksoftirqd/021:11:520
2239499251,14cyclictest12-21ksoftirqd/021:11:520
22394992510,5cyclictest12-21ksoftirqd/000:12:140
22394992510,5cyclictest12-21ksoftirqd/000:12:140
22394992510,5cyclictest12-21ksoftirqd/000:12:140
72602240,4sleep30-21swapper/321:18:263
72602240,4sleep30-21swapper/321:18:263
2239699241,2cyclictest131rcu_preempt21:16:052
2239699241,2cyclictest131rcu_preempt21:16:052
2239599242,4cyclictest131rcu_preempt21:30:561
2239599242,4cyclictest131rcu_preempt21:30:561
2239599241,15cyclictest8977-21cut21:20:551
2239499249,5cyclictest12-21ksoftirqd/021:47:230
2239499249,5cyclictest12-21ksoftirqd/021:47:230
2239499249,5cyclictest12-21ksoftirqd/021:47:230
2239499248,8cyclictest12-21ksoftirqd/023:22:160
2239499248,8cyclictest12-21ksoftirqd/023:22:160
2239499248,8cyclictest12-21ksoftirqd/023:22:160
2239499245,3cyclictest131rcu_preempt00:36:040
2239499245,3cyclictest131rcu_preempt00:36:040
2239499245,3cyclictest131rcu_preempt00:36:040
2239499244,8cyclictest12-21ksoftirqd/023:10:520
2239499244,8cyclictest12-21ksoftirqd/023:10:520
2239499244,8cyclictest12-21ksoftirqd/023:10:520
2239499244,4cyclictest131rcu_preempt20:55:560
2239499244,4cyclictest131rcu_preempt20:55:560
2239499243,6cyclictest12-21ksoftirqd/021:30:550
22394992414,4cyclictest12-21ksoftirqd/022:33:210
22394992414,4cyclictest12-21ksoftirqd/022:33:210
22394992411,7cyclictest12-21ksoftirqd/020:06:490
22394992411,7cyclictest12-21ksoftirqd/020:06:490
22394992411,4cyclictest12-21ksoftirqd/022:37:010
22394992411,4cyclictest12-21ksoftirqd/022:37:010
2239499240,18cyclictest25850-21cut20:50:560
117192240,2sleep10-21swapper/100:34:021
117192240,2sleep10-21swapper/100:34:021
2239699236,2cyclictest27-21ksoftirqd/220:40:532
22395992310,4cyclictest131rcu_preempt21:00:551
22395992310,4cyclictest131rcu_preempt21:00:551
22395992310,4cyclictest131rcu_preempt21:00:551
2239499237,8cyclictest12-21ksoftirqd/022:24:500
2239499237,8cyclictest12-21ksoftirqd/022:24:500
2239499236,10cyclictest12-21ksoftirqd/021:22:470
2239499236,10cyclictest12-21ksoftirqd/021:22:470
2239499230,11cyclictest12-21ksoftirqd/019:17:320
2239499230,11cyclictest12-21ksoftirqd/019:17:320
187652230,2sleep30-21swapper/320:31:003
187652230,2sleep30-21swapper/320:31:003
281622221,18sleep20-21swapper/223:36:122
281622221,18sleep20-21swapper/223:36:122
27372220,3sleep11622-21/usr/sbin/munin19:46:051
27372220,3sleep11622-21/usr/sbin/munin19:46:051
27372220,3sleep11622-21/usr/sbin/munin19:46:051
2239699221,3cyclictest0-21swapper/219:45:522
2239699221,3cyclictest0-21swapper/219:45:522
2239699221,3cyclictest0-21swapper/219:45:522
22396992213,6cyclictest0-21swapper/222:25:592
22396992213,6cyclictest0-21swapper/220:16:052
22396992213,6cyclictest0-21swapper/220:16:052
2239599229,5cyclictest131rcu_preempt20:55:561
2239599229,5cyclictest131rcu_preempt20:55:561
2239599229,4cyclictest131rcu_preempt20:30:561
2239599229,4cyclictest131rcu_preempt20:30:561
22395992214,6cyclictest23867-21sensors19:16:041
22395992214,6cyclictest23867-21sensors19:16:041
2239599221,2cyclictest131rcu_preempt20:26:041
2239599221,2cyclictest131rcu_preempt20:26:041
2239599221,15cyclictest1700-21cpuspeed19:45:531
22395992210,8cyclictest29340-21forks23:00:561
22395992210,8cyclictest29340-21forks23:00:561
2239599220,18cyclictest27319-21ls20:55:481
2239499228,4cyclictest12-21ksoftirqd/020:35:510
2239499228,4cyclictest12-21ksoftirqd/020:35:510
2239499225,3cyclictest131rcu_preempt23:26:000
2239499225,3cyclictest131rcu_preempt23:26:000
2239499221,18cyclictest18096-21ls20:30:440
2239499221,18cyclictest18096-21ls20:30:440
22394992210,3cyclictest131rcu_preempt21:26:040
303812210,2chrt0-21swapper/321:45:553
303812210,2chrt0-21swapper/321:45:553
303812210,2chrt0-21swapper/321:45:553
22396992115,3cyclictest271ksoftirqd/223:10:522
22396992115,3cyclictest271ksoftirqd/223:10:522
22396992115,3cyclictest271ksoftirqd/223:10:522
22396992115,3cyclictest17616-21fschecks_count23:25:552
22396992115,3cyclictest17616-21fschecks_count23:25:552
22396992112,6cyclictest0-21swapper/220:26:032
22396992112,6cyclictest0-21swapper/220:26:032
2239699211,14cyclictest15292-21ls22:06:052
2239699211,14cyclictest15292-21ls22:06:052
2239699211,14cyclictest15292-21ls22:06:052
2239699210,18cyclictest10695-21ls22:00:582
2239699210,18cyclictest10695-21ls22:00:582
2239599219,5cyclictest131rcu_preempt19:30:561
2239599219,5cyclictest131rcu_preempt19:30:561
2239599219,4cyclictest131rcu_preempt23:05:561
2239599219,4cyclictest131rcu_preempt23:05:561
2239599219,4cyclictest131rcu_preempt23:05:561
2239599219,4cyclictest131rcu_preempt22:50:551
2239599219,4cyclictest131rcu_preempt21:30:551
2239599219,4cyclictest131rcu_preempt19:20:541
2239599219,4cyclictest131rcu_preempt19:20:541
2239599212,3cyclictest0-21swapper/120:05:541
2239599212,3cyclictest0-21swapper/120:05:541
2239599211,7cyclictest21-21ksoftirqd/119:55:571
2239599211,7cyclictest21-21ksoftirqd/119:55:571
22395992113,6cyclictest429-21ssh22:27:561
22395992110,3cyclictest131rcu_preempt00:05:551
2239599210,2cyclictest131rcu_preempt21:46:041
2239599210,2cyclictest131rcu_preempt21:46:041
2239599210,2cyclictest131rcu_preempt21:46:041
2239499219,6cyclictest12-21ksoftirqd/021:05:570
2239499219,6cyclictest12-21ksoftirqd/021:05:570
2239499219,6cyclictest12-21ksoftirqd/021:05:570
2239499218,5cyclictest12-21ksoftirqd/000:24:460
2239499211,11cyclictest31971-21wc19:40:420
2239499211,11cyclictest31971-21wc19:40:420
22394992110,7cyclictest0-21swapper/020:45:500
22394992110,7cyclictest0-21swapper/020:45:500
22394992110,4cyclictest12-21ksoftirqd/019:31:410
22394992110,4cyclictest12-21ksoftirqd/019:31:410
223372211,12sleep30-21swapper/319:11:113
223372211,12sleep30-21swapper/319:11:113
145022210,2sleep20-21swapper/221:26:332
145022210,2sleep20-21swapper/221:26:332
2239799201,9cyclictest0-21swapper/319:45:533
2239799201,9cyclictest0-21swapper/319:45:533
2239699208,4cyclictest131rcu_preempt20:00:542
2239699208,4cyclictest131rcu_preempt20:00:542
2239699208,4cyclictest131rcu_preempt20:00:542
2239699202,7cyclictest131rcu_preempt23:21:312
2239699201,9cyclictest131rcu_preempt20:20:582
2239699201,9cyclictest131rcu_preempt20:20:582
2239699201,9cyclictest131rcu_preempt19:31:062
2239699201,9cyclictest131rcu_preempt19:31:062
22396992013,5cyclictest3996-21sed19:50:582
22396992013,5cyclictest3996-21sed19:50:582
2239699201,2cyclictest131rcu_preempt23:15:552
2239699201,2cyclictest131rcu_preempt23:15:552
2239699201,11cyclictest817-21runrttasks23:03:082
2239699201,11cyclictest817-21runrttasks23:03:082
2239699200,16cyclictest391-21ssh00:21:002
2239699200,16cyclictest391-21ssh00:21:002
2239599208,5cyclictest131rcu_preempt20:01:031
2239599208,5cyclictest131rcu_preempt20:01:031
2239599208,5cyclictest131rcu_preempt20:01:031
2239599208,4cyclictest131rcu_preempt21:51:031
2239599208,4cyclictest131rcu_preempt21:51:031
2239599208,4cyclictest131rcu_preempt20:20:551
2239599208,4cyclictest131rcu_preempt20:20:551
2239599204,5cyclictest0-21swapper/121:57:411
2239599204,5cyclictest0-21swapper/121:57:411
2239599204,5cyclictest0-21swapper/121:57:411
2239599204,4cyclictest131rcu_preempt22:56:051
2239599204,4cyclictest131rcu_preempt22:56:051
2239599204,4cyclictest131rcu_preempt22:56:051
22395992012,3cyclictest21-21ksoftirqd/122:15:551
2239599201,15cyclictest3048-21ssh22:30:581
2239599201,15cyclictest3048-21ssh22:30:581
2239599201,10cyclictest17846-21awk22:46:161
2239499200,2cyclictest131rcu_preempt19:46:040
2239499200,2cyclictest131rcu_preempt19:46:040
2239499200,2cyclictest131rcu_preempt19:46:040
154602200,3sleep30-21swapper/320:21:033
154602200,3sleep30-21swapper/320:21:033
324862190,3sleep3321rcuc/322:27:113
2239799191,12cyclictest0-21swapper/322:55:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional