You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 09:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Thu Apr 16, 2026 00:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
325827060,2sleep227-21ksoftirqd/219:12:242
325827060,2sleep227-21ksoftirqd/219:12:242
342722560,2sleep30-21swapper/319:12:253
342722560,2sleep30-21swapper/319:12:253
447221240,1sleep227-21ksoftirqd/200:17:192
447221240,1sleep227-21ksoftirqd/200:17:192
447221240,1sleep227-21ksoftirqd/200:17:192
1499521150,2sleep30-21swapper/321:42:193
1499521150,2sleep30-21swapper/321:42:193
2504221140,3sleep30-21swapper/300:38:273
2504221140,3sleep30-21swapper/300:38:273
1418121140,3sleep214179-21grep00:27:202
2815521040,3sleep30-21swapper/320:17:223
2815521040,3sleep30-21swapper/320:17:223
2815521040,3sleep30-21swapper/320:17:223
2942221000,2sleep20-21swapper/221:57:222
2942221000,2sleep20-21swapper/221:57:222
239102970,2sleep20-21swapper/200:37:222
239102970,2sleep20-21swapper/200:37:222
53722960,3sleep25366-21find20:42:212
53722960,3sleep25366-21find20:42:212
224692960,5sleep222454-21find21:17:222
224692960,5sleep222454-21find21:17:222
110172940,3sleep111011-21find19:32:211
110172940,3sleep111011-21find19:32:211
22242900,3sleep00-21swapper/019:12:060
22242900,3sleep00-21swapper/019:12:060
275142880,3chrt0-21swapper/321:56:223
275142880,3chrt0-21swapper/321:56:223
21892880,2sleep20-21swapper/222:02:202
21892880,2sleep20-21swapper/222:02:202
278212870,4chrt0-21swapper/221:56:452
278212870,4chrt0-21swapper/221:56:452
280412820,3chrt0-21swapper/123:35:411
280412820,3chrt0-21swapper/123:35:411
168022820,3chrt0-21swapper/319:47:233
168022820,3chrt0-21swapper/319:47:233
186132810,3chrt0-21swapper/221:47:082
186132810,3chrt0-21swapper/221:47:082
250682730,4sleep30-21swapper/321:20:203
250682730,4sleep30-21swapper/321:20:203
40772700,5sleep333-21ksoftirqd/323:43:113
40772700,5sleep333-21ksoftirqd/323:43:113
40772700,5sleep333-21ksoftirqd/323:43:113
162582620,2sleep00-21swapper/021:43:530
162582620,2sleep00-21swapper/021:43:530
42902600,4chrt0-21swapper/321:32:183
42902600,4chrt0-21swapper/321:32:183
115842590,3chrt0-21swapper/322:45:383
115842590,3chrt0-21swapper/322:45:383
212372580,2sleep10-21swapper/121:17:051
212372580,2sleep10-21swapper/121:17:051
97692560,4sleep273-21kswapd021:37:192
97692560,4sleep273-21kswapd021:37:192
97692560,4sleep273-21kswapd021:37:192
216192560,2sleep221639-21ntp_states22:22:152
216192560,2sleep221639-21ntp_states22:22:152
282842550,4chrt0-21swapper/300:08:393
282842550,4chrt0-21swapper/300:08:393
194942550,4chrt0-21swapper/322:53:263
194942550,4chrt0-21swapper/322:53:263
206932540,4chrt20694-21grep23:27:200
206932540,4chrt20694-21grep23:27:200
269982520,3sleep10-21swapper/100:41:021
269982520,3sleep10-21swapper/100:41:021
74232500,3sleep20-21swapper/222:41:272
74232500,3sleep20-21swapper/222:41:272
74232500,3sleep20-21swapper/222:41:272
63282500,2sleep26340-21ssh23:46:492
63282500,2sleep26340-21ssh23:46:492
63282500,2sleep26340-21ssh23:46:492
111452500,4sleep30-21swapper/323:52:033
111452500,4sleep30-21swapper/323:52:033
119512480,4sleep20-21swapper/223:18:222
119512480,4sleep20-21swapper/223:18:222
119512480,4sleep20-21swapper/223:18:222
142262470,2sleep014238-21sh22:15:420
142262470,2sleep014238-21sh22:15:420
82842460,3sleep30-21swapper/322:09:133
82842460,3sleep30-21swapper/322:09:133
82842460,3sleep30-21swapper/322:09:133
82202460,2sleep08327-21ls20:52:080
82202460,2sleep08327-21ls20:52:080
252372460,2sleep225264-21timerandwakeup23:32:222
252372460,2sleep225264-21timerandwakeup23:32:222
219022460,5sleep121897-21ssh21:17:121
219022460,5sleep121897-21ssh21:17:121
216372450,4chrt0-21swapper/323:28:243
216372450,4chrt0-21swapper/323:28:243
194452440,3sleep10-21swapper/123:27:011
194452440,3sleep10-21swapper/123:27:011
316322430,3sleep30-21swapper/320:27:143
316322430,3sleep30-21swapper/320:27:143
132332430,4sleep10-21swapper/119:37:591
132332430,4sleep10-21swapper/119:37:591
132332430,4sleep10-21swapper/119:37:591
151362420,2sleep30-21swapper/300:28:263
234432410,3chrt0-21swapper/000:03:060
234432410,3chrt0-21swapper/000:03:060
234432410,3chrt0-21swapper/000:03:060
210642410,3sleep00-21swapper/000:01:330
210642410,3sleep00-21swapper/000:01:330
35782400,3sleep10-21swapper/122:37:161
35782400,3sleep10-21swapper/122:37:161
35782400,3sleep10-21swapper/122:37:161
63602390,3sleep30-21swapper/323:12:563
63602390,3sleep30-21swapper/323:12:563
323262390,3sleep00-21swapper/022:33:380
323262390,3sleep00-21swapper/022:33:380
236212390,3sleep30-21swapper/300:03:253
236212390,3sleep30-21swapper/300:03:253
236212390,3sleep30-21swapper/300:03:253
68492370,3sleep30-21swapper/320:47:123
68492370,3sleep30-21swapper/320:47:123
359999375,5cyclictest27-21ksoftirqd/221:52:072
359999375,5cyclictest27-21ksoftirqd/221:52:072
359899375,8cyclictest21-21ksoftirqd/121:42:191
359899375,8cyclictest21-21ksoftirqd/121:42:191
359899374,4cyclictest21-21ksoftirqd/120:17:201
359899374,4cyclictest21-21ksoftirqd/120:17:201
359899374,4cyclictest21-21ksoftirqd/120:17:201
299292370,9sleep333-21ksoftirqd/322:32:073
299292370,9sleep333-21ksoftirqd/322:32:073
299292370,9sleep333-21ksoftirqd/322:32:073
71342360,3sleep20-21swapper/222:07:232
71342360,3sleep20-21swapper/222:07:232
71342360,3sleep20-21swapper/222:07:232
359899365,9cyclictest21-21ksoftirqd/121:57:211
359899365,9cyclictest21-21ksoftirqd/121:57:211
292632360,2sleep129265-21ssh22:31:181
292632360,2sleep129265-21ssh22:31:181
292632360,2sleep129265-21ssh22:31:181
93792350,3chrt0-21swapper/022:10:580
93792350,3chrt0-21swapper/022:10:580
93792350,3chrt0-21swapper/022:10:580
88102350,3sleep00-21swapper/019:27:170
85872350,2sleep121-21ksoftirqd/122:42:111
85872350,2sleep121-21ksoftirqd/122:42:111
359899356,6cyclictest21-21ksoftirqd/119:47:221
359899356,6cyclictest21-21ksoftirqd/119:47:221
359699351,4cyclictest0-21swapper/023:52:200
359699351,4cyclictest0-21swapper/023:52:200
359699351,4cyclictest0-21swapper/023:52:200
269412350,3sleep10-21swapper/121:22:111
269412350,3sleep10-21swapper/121:22:111
170412350,1chrt12-21ksoftirqd/021:12:210
170412350,1chrt12-21ksoftirqd/021:12:210
125662350,2sleep112584-21sshd23:19:101
125662350,2sleep112584-21sshd23:19:101
125662350,2sleep112584-21sshd23:19:101
74912340,3sleep10-21swapper/121:35:501
74912340,3sleep10-21swapper/121:35:501
61412340,3chrt0-21swapper/023:46:290
61412340,3chrt0-21swapper/023:46:290
61412340,3chrt0-21swapper/023:46:290
319372340,2sleep231977-21ssh21:27:152
319372340,2sleep231977-21ssh21:27:152
319372340,2sleep231977-21ssh21:27:152
247642340,2sleep024772-21ssh21:52:500
247642340,2sleep024772-21ssh21:52:500
170932340,2sleep30-21swapper/323:57:143
170932340,2sleep30-21swapper/323:57:143
359899335,8cyclictest21-21ksoftirqd/120:12:201
359899335,8cyclictest21-21ksoftirqd/120:12:201
3598993317,7cyclictest23593-21find22:57:211
3598993317,7cyclictest23593-21find22:57:211
3598993317,7cyclictest23593-21find22:57:211
3598993316,8cyclictest14181-21runrttasks00:27:201
3598993311,7cyclictest21-21ksoftirqd/119:56:121
3598993311,7cyclictest21-21ksoftirqd/119:56:121
240602330,1sleep124211-21/usr/sbin/munin21:52:191
240602330,1sleep124211-21/usr/sbin/munin21:52:191
177902330,2sleep217875-21fschecks_count00:32:122
177902330,2sleep217875-21fschecks_count00:32:122
289832320,2sleep30-21swapper/321:57:153
289832320,2sleep30-21swapper/321:57:153
159652320,2sleep30-21swapper/323:56:453
159652320,2sleep30-21swapper/323:56:453
159652320,2sleep30-21swapper/323:56:453
111602320,3sleep30-21swapper/321:38:453
111602320,3sleep30-21swapper/321:38:453
111602320,3sleep30-21swapper/321:38:453
3599993012,12cyclictest0-21swapper/200:15:192
3599993012,12cyclictest0-21swapper/200:15:192
359899305,4cyclictest21-21ksoftirqd/123:27:191
359899305,4cyclictest21-21ksoftirqd/123:27:191
359899303,5cyclictest21-21ksoftirqd/123:12:191
359899303,5cyclictest21-21ksoftirqd/123:12:191
359699306,2cyclictest131rcu_preempt23:47:200
359699306,2cyclictest131rcu_preempt23:47:200
359999298,11cyclictest27-21ksoftirqd/222:54:392
359999298,11cyclictest27-21ksoftirqd/222:54:392
359899294,7cyclictest21-21ksoftirqd/119:57:201
359899294,7cyclictest21-21ksoftirqd/119:57:201
359699292,8cyclictest9757-21find21:37:200
359699292,8cyclictest9757-21find21:37:200
359699292,8cyclictest9757-21find21:37:200
317842290,2sleep231796-21sh23:38:452
317842290,2sleep231796-21sh23:38:452
317842290,2sleep231796-21sh23:38:452
194882290,4sleep019458-21sendmail_mailtr21:47:180
194882290,4sleep019458-21sendmail_mailtr21:47:180
19162290,4sleep20-21swapper/222:36:172
19162290,4sleep20-21swapper/222:36:172
359999284,7cyclictest27-21ksoftirqd/222:57:222
359999284,7cyclictest27-21ksoftirqd/222:57:222
359999284,7cyclictest27-21ksoftirqd/222:57:222
359899289,8cyclictest21-21ksoftirqd/119:43:331
359899289,8cyclictest21-21ksoftirqd/119:43:331
359899289,8cyclictest21-21ksoftirqd/119:43:331
359899284,5cyclictest21-21ksoftirqd/120:42:191
359899284,5cyclictest21-21ksoftirqd/120:42:191
3598992810,8cyclictest21-21ksoftirqd/120:23:381
3598992810,8cyclictest21-21ksoftirqd/120:23:381
270382280,1sleep027050-21ssh23:34:250
270382280,1sleep027050-21ssh23:34:250
3600992714,10cyclictest33-21ksoftirqd/321:12:213
3600992714,10cyclictest33-21ksoftirqd/321:12:213
359999279,8cyclictest27-21ksoftirqd/223:13:362
359999279,8cyclictest27-21ksoftirqd/223:13:362
359999277,9cyclictest27-21ksoftirqd/222:28:082
359999277,9cyclictest27-21ksoftirqd/222:28:082
359999277,9cyclictest27-21ksoftirqd/222:28:082
3599992711,3cyclictest131rcu_preempt00:07:192
3599992711,3cyclictest131rcu_preempt00:07:192
359899276,8cyclictest21-21ksoftirqd/123:39:531
359899276,8cyclictest21-21ksoftirqd/123:39:531
359899276,8cyclictest21-21ksoftirqd/123:39:531
359899273,3cyclictest131rcu_preempt20:02:201
359899273,3cyclictest131rcu_preempt20:02:201
3598992711,7cyclictest21-21ksoftirqd/100:21:581
3598992711,7cyclictest21-21ksoftirqd/100:21:581
3598992711,7cyclictest21-21ksoftirqd/100:21:581
359999269,3cyclictest131rcu_preempt20:00:392
359999269,3cyclictest131rcu_preempt20:00:392
359999268,6cyclictest131rcu_preempt23:11:412
359999268,6cyclictest131rcu_preempt23:11:412
359999268,3cyclictest131rcu_preempt20:32:212
359999268,3cyclictest131rcu_preempt20:32:212
3599992619,5cyclictest205982sleep223:27:192
3599992619,5cyclictest205982sleep223:27:192
359999261,7cyclictest27-21ksoftirqd/220:17:202
359999261,7cyclictest27-21ksoftirqd/220:17:202
359999261,7cyclictest27-21ksoftirqd/220:17:202
359899268,9cyclictest21-21ksoftirqd/122:12:411
359899268,9cyclictest21-21ksoftirqd/122:12:411
359899267,8cyclictest21-21ksoftirqd/121:47:391
359899267,8cyclictest21-21ksoftirqd/121:47:391
359899267,8cyclictest21-21ksoftirqd/121:09:111
359899264,3cyclictest131rcu_preempt22:32:211
359899264,3cyclictest131rcu_preempt22:32:211
359899264,3cyclictest12323-21find23:52:201
359899264,3cyclictest12323-21find23:52:201
359899264,3cyclictest12323-21find23:52:201
359899261,6cyclictest21-21ksoftirqd/119:17:191
359899261,6cyclictest21-21ksoftirqd/119:17:191
3598992611,9cyclictest0-21swapper/100:35:361
3598992611,9cyclictest0-21swapper/100:35:361
3598992611,8cyclictest21-21ksoftirqd/122:53:571
3598992611,8cyclictest21-21ksoftirqd/122:53:571
3598992611,4cyclictest131rcu_preempt19:26:521
3598992611,4cyclictest131rcu_preempt19:26:521
3598992610,9cyclictest21-21ksoftirqd/123:04:461
3598992610,9cyclictest21-21ksoftirqd/123:04:461
3598992610,9cyclictest21-21ksoftirqd/123:04:461
3598992610,8cyclictest21-21ksoftirqd/123:49:411
3598992610,8cyclictest21-21ksoftirqd/123:49:411
3596992613,10cyclictest7872-21latency_hist19:27:080
182452261,4sleep218288-21awk19:52:132
182452261,4sleep218288-21awk19:52:132
359999259,7cyclictest27-21ksoftirqd/223:25:372
359999259,7cyclictest27-21ksoftirqd/223:25:372
359999256,9cyclictest27-21ksoftirqd/222:51:172
359999256,9cyclictest27-21ksoftirqd/222:51:172
359999254,6cyclictest27-21ksoftirqd/223:52:202
359999254,6cyclictest27-21ksoftirqd/223:52:202
359999254,6cyclictest27-21ksoftirqd/223:52:202
359999251,5cyclictest27-21ksoftirqd/220:02:092
359999251,5cyclictest27-21ksoftirqd/220:02:092
3599992512,5cyclictest0-21swapper/221:23:572
3599992512,5cyclictest0-21swapper/221:23:572
3599992511,6cyclictest27-21ksoftirqd/223:03:102
3599992511,6cyclictest27-21ksoftirqd/223:03:102
3599992511,6cyclictest27-21ksoftirqd/223:03:102
3599992510,8cyclictest0-21swapper/222:20:432
3599992510,8cyclictest0-21swapper/222:20:432
3599992510,3cyclictest131rcu_preempt21:36:002
3599992510,3cyclictest131rcu_preempt21:36:002
359899259,8cyclictest21-21ksoftirqd/100:22:551
359899259,8cyclictest21-21ksoftirqd/100:22:551
359899257,7cyclictest21-21ksoftirqd/121:02:101
359899257,7cyclictest21-21ksoftirqd/121:02:101
359899256,3cyclictest131rcu_preempt00:03:211
359899256,3cyclictest131rcu_preempt00:03:211
359899256,3cyclictest131rcu_preempt00:03:211
359899256,2cyclictest131rcu_preempt22:47:201
359899256,2cyclictest131rcu_preempt22:47:201
359899255,3cyclictest131rcu_preempt00:11:501
359899255,3cyclictest131rcu_preempt00:11:501
359899253,7cyclictest21-21ksoftirqd/120:27:111
359899253,7cyclictest21-21ksoftirqd/120:27:111
359899252,4cyclictest21-21ksoftirqd/120:47:191
359899252,4cyclictest21-21ksoftirqd/120:47:191
3598992511,9cyclictest0-21swapper/122:26:041
3598992511,9cyclictest0-21swapper/122:26:041
3598992511,8cyclictest21-21ksoftirqd/123:46:321
3598992511,8cyclictest21-21ksoftirqd/123:46:321
3598992511,8cyclictest21-21ksoftirqd/123:46:321
3598992511,8cyclictest21-21ksoftirqd/121:42:021
3598992511,8cyclictest21-21ksoftirqd/121:42:021
3598992511,8cyclictest21-21ksoftirqd/121:42:021
3598992510,9cyclictest21-21ksoftirqd/123:08:391
3598992510,9cyclictest21-21ksoftirqd/123:08:391
3598992510,5cyclictest21-21ksoftirqd/100:13:471
3598992510,5cyclictest21-21ksoftirqd/100:13:471
3598992510,3cyclictest131rcu_preempt19:27:211
3596992518,5cyclictest10086-21ssh22:43:150
3596992518,5cyclictest10086-21ssh22:43:150
359699251,6cyclictest131rcu_preempt20:12:210
359699251,6cyclictest131rcu_preempt20:12:210
3596992514,8cyclictest38650irq/55-eth000:37:100
3596992514,8cyclictest38650irq/55-eth000:37:100
3600992413,8cyclictest33-21ksoftirqd/319:32:203
3600992413,8cyclictest33-21ksoftirqd/319:32:203
359999249,5cyclictest27-21ksoftirqd/221:06:052
359999249,5cyclictest27-21ksoftirqd/221:06:052
359999249,4cyclictest27-21ksoftirqd/222:44:172
359999249,4cyclictest27-21ksoftirqd/222:44:172
359999248,6cyclictest131rcu_preempt23:48:112
359999248,6cyclictest131rcu_preempt23:48:112
359999248,4cyclictest131rcu_preempt19:32:102
359999248,4cyclictest131rcu_preempt19:32:102
359999247,3cyclictest131rcu_preempt00:02:192
359999247,3cyclictest131rcu_preempt00:02:192
359999247,3cyclictest131rcu_preempt00:02:192
359999245,9cyclictest27-21ksoftirqd/200:23:592
359999245,9cyclictest27-21ksoftirqd/200:23:592
359999245,8cyclictest27-21ksoftirqd/221:12:052
359999244,7cyclictest27-21ksoftirqd/219:42:092
359999244,7cyclictest27-21ksoftirqd/219:42:092
359999244,7cyclictest27-21ksoftirqd/219:42:092
359999243,7cyclictest27-21ksoftirqd/223:57:212
359999243,7cyclictest27-21ksoftirqd/223:57:212
359999241,4cyclictest0-21swapper/219:22:202
359999241,4cyclictest0-21swapper/219:22:202
3599992410,5cyclictest27-21ksoftirqd/222:14:322
3599992410,5cyclictest27-21ksoftirqd/222:14:322
3599992410,3cyclictest131rcu_preempt20:39:582
3599992410,3cyclictest131rcu_preempt20:39:582
359899249,7cyclictest21-21ksoftirqd/123:59:551
359899249,7cyclictest21-21ksoftirqd/123:59:551
359899249,6cyclictest21-21ksoftirqd/120:09:341
359899247,9cyclictest21-21ksoftirqd/122:08:251
359899247,9cyclictest21-21ksoftirqd/122:08:251
359899247,9cyclictest21-21ksoftirqd/122:08:251
359899244,4cyclictest21-21ksoftirqd/122:05:021
359899244,4cyclictest21-21ksoftirqd/122:05:021
359899243,6cyclictest21-21ksoftirqd/121:27:101
359899243,6cyclictest21-21ksoftirqd/121:27:101
359899243,6cyclictest21-21ksoftirqd/121:27:101
3598992414,4cyclictest21-21ksoftirqd/120:57:501
3598992414,4cyclictest21-21ksoftirqd/120:57:501
3596992417,5cyclictest4836-21ssh22:38:100
3596992417,5cyclictest4836-21ssh22:38:100
3596992417,5cyclictest4836-21ssh22:38:100
359699241,3cyclictest0-21swapper/022:47:460
359699241,3cyclictest0-21swapper/022:47:460
359699241,13cyclictest1833-21latency_hist23:41:570
359699241,13cyclictest1833-21latency_hist23:41:570
359699241,13cyclictest1833-21latency_hist23:41:570
260832240,3sleep30-21swapper/320:12:193
260832240,3sleep30-21swapper/320:12:193
84852230,3sleep08486-21sh21:37:010
84852230,3sleep08486-21sh21:37:010
3600992316,4cyclictest0-21swapper/319:37:213
3600992316,4cyclictest0-21swapper/319:37:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional