You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 12:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Mon Jun 22, 2026 00:45:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2735721470,8sleep227-21ksoftirqd/221:30:472
2735721470,8sleep227-21ksoftirqd/221:30:472
1060021190,3sleep30-21swapper/322:27:233
1060021190,3sleep30-21swapper/322:27:233
3082721130,3sleep20-21swapper/222:52:262
3082721130,3sleep20-21swapper/222:52:262
3082721130,3sleep20-21swapper/222:52:262
1710121120,3sleep20-21swapper/200:35:432
1710121120,3sleep20-21swapper/200:35:432
1434321070,3sleep30-21swapper/321:52:103
1434321070,3sleep30-21swapper/321:52:103
1434321070,3sleep30-21swapper/321:52:103
3126121020,4sleep00-21swapper/019:10:440
3126121020,4sleep00-21swapper/019:10:440
319862930,2sleep10-21swapper/119:10:561
319862930,2sleep10-21swapper/119:10:561
133962930,4chrt0-21swapper/200:30:492
133962930,4chrt0-21swapper/200:30:492
133962930,4chrt0-21swapper/200:30:492
263742830,3sleep20-21swapper/223:26:422
263742830,3sleep20-21swapper/223:26:422
139022810,3chrt0-21swapper/123:50:531
139022810,3chrt0-21swapper/123:50:531
252752800,3chrt0-21swapper/122:45:461
252752800,3chrt0-21swapper/122:45:461
132152780,3chrt0-21swapper/323:10:483
132152780,3chrt0-21swapper/323:10:483
22212750,3sleep30-21swapper/300:17:003
22212750,3sleep30-21swapper/300:17:003
41832740,3sleep311116-21kworker/3:219:25:333
41832740,3sleep311116-21kworker/3:219:25:333
41832740,3sleep311116-21kworker/3:219:25:333
196062740,4sleep10-21swapper/121:21:051
196062740,4sleep10-21swapper/121:21:051
129682740,2sleep013082-21ssh23:10:460
129682740,2sleep013082-21ssh23:10:460
76982730,2sleep10-21swapper/121:45:011
76982730,2sleep10-21swapper/121:45:011
76982730,2sleep10-21swapper/121:45:011
73112720,3sleep10-21swapper/123:43:421
73112720,3sleep10-21swapper/123:43:421
223382700,3sleep30-21swapper/321:25:413
223382700,3sleep30-21swapper/321:25:413
258292690,3chrt0-21swapper/122:05:551
258292690,3chrt0-21swapper/122:05:551
90542670,3sleep30-21swapper/319:35:543
90542670,3sleep30-21swapper/319:35:543
100152660,3chrt0-21swapper/119:40:421
100152660,3chrt0-21swapper/119:40:421
325252610,2sleep232527-21latency_hist00:15:302
325252610,2sleep232527-21latency_hist00:15:302
325252610,2sleep232527-21latency_hist00:15:302
302552610,4sleep30-21swapper/300:11:253
302552610,4sleep30-21swapper/300:11:253
302552610,4sleep30-21swapper/300:11:253
144272610,3sleep0151rcuc/022:31:580
144272610,3sleep0151rcuc/022:31:580
244562580,3chrt0-21swapper/220:20:422
244562580,3chrt0-21swapper/220:20:422
142552580,3sleep10-21swapper/119:50:511
142552580,3sleep10-21swapper/119:50:511
249422570,3sleep30-21swapper/320:20:483
249422570,3sleep30-21swapper/320:20:483
61942550,3sleep20-21swapper/200:21:372
61942550,3sleep20-21swapper/200:21:372
177782550,3chrt0-21swapper/121:56:021
177782550,3chrt0-21swapper/121:56:021
177782550,3chrt0-21swapper/121:56:021
92702540,4sleep10-21swapper/119:37:081
92702540,4sleep10-21swapper/119:37:081
41722540,4chrt0-21swapper/323:40:303
41722540,4chrt0-21swapper/323:40:303
41722540,4chrt0-21swapper/323:40:303
73802530,4chrt0-21swapper/321:44:263
73802530,4chrt0-21swapper/321:44:263
73802530,4chrt0-21swapper/321:44:263
177502500,2sleep1131rcu_preempt20:00:481
177502500,2sleep1131rcu_preempt20:00:481
144732500,2chrt0-21swapper/123:12:021
144732500,2chrt0-21swapper/123:12:021
277152490,3sleep10-21swapper/120:30:291
277152490,3sleep10-21swapper/120:30:291
127752480,4chrt0-21swapper/300:30:423
127752480,4chrt0-21swapper/300:30:423
50002470,4chrt5005-21needreboot22:20:461
50002470,4chrt5005-21needreboot22:20:461
160262470,2sleep20-21swapper/219:55:502
160262470,2sleep20-21swapper/219:55:502
312582450,2sleep231028-21ls19:10:422
312582450,2sleep231028-21ls19:10:422
244782450,3sleep00-21swapper/022:45:330
244782450,3sleep00-21swapper/022:45:330
192272440,3chrt0-21swapper/123:58:161
192272440,3chrt0-21swapper/123:58:161
192272440,3chrt0-21swapper/123:58:161
170222440,3sleep10-21swapper/122:35:451
170222440,3sleep10-21swapper/122:35:451
170222440,3sleep10-21swapper/122:35:451
104302440,2sleep00-21swapper/023:46:540
104302440,2sleep00-21swapper/023:46:540
104302440,2sleep00-21swapper/023:46:540
173362430,3sleep10-21swapper/123:15:481
173362430,3sleep10-21swapper/123:15:481
173362430,3sleep10-21swapper/123:15:481
68162420,3sleep30-21swapper/319:30:473
68162420,3sleep30-21swapper/319:30:473
58022420,3sleep30-21swapper/322:21:043
58022420,3sleep30-21swapper/322:21:043
308802420,3sleep30-21swapper/323:32:303
308802420,3sleep30-21swapper/323:32:303
32539994126,9cyclictest20454-21latency_hist00:00:372
32539994126,9cyclictest20454-21latency_hist00:00:372
32539994126,9cyclictest20454-21latency_hist00:00:372
32537994116,7cyclictest20634-21latency_hist00:00:370
32537994116,7cyclictest20634-21latency_hist00:00:370
32537994116,7cyclictest20634-21latency_hist00:00:370
312402410,3chrt0-21swapper/100:13:121
312402410,3chrt0-21swapper/100:13:121
312402410,3chrt0-21swapper/100:13:121
300332410,3sleep30-21swapper/322:11:113
300332410,3sleep30-21swapper/322:11:113
286742410,2sleep30-21swapper/320:30:523
286742410,2sleep30-21swapper/320:30:523
229682410,4sleep30-21swapper/322:42:503
229682410,4sleep30-21swapper/322:42:503
16512400,3sleep30-21swapper/320:45:473
131442400,2chrt0-21swapper/221:14:032
131442400,2chrt0-21swapper/221:14:032
64182390,3sleep00-21swapper/023:42:000
64182390,3sleep00-21swapper/023:42:000
51372390,3sleep00-21swapper/019:25:500
51372390,3sleep00-21swapper/019:25:500
221332390,3sleep10-21swapper/100:01:101
221332390,3sleep10-21swapper/100:01:101
221332390,3sleep10-21swapper/100:01:101
163232390,3sleep10-21swapper/121:17:271
163232390,3sleep10-21swapper/121:17:271
163232390,3sleep10-21swapper/121:17:271
28152380,2sleep02527-21/usr/sbin/munin19:20:450
28152380,2sleep02527-21/usr/sbin/munin19:20:450
28152380,2sleep02527-21/usr/sbin/munin19:20:450
3253799372,17cyclictest22264-21sh00:01:280
3253799372,17cyclictest22264-21sh00:01:280
3253799372,17cyclictest22264-21sh00:01:280
161212360,2sleep30-21swapper/319:55:513
161212360,2sleep30-21swapper/319:55:513
40892350,4sleep30-21swapper/323:00:273
40892350,4sleep30-21swapper/323:00:273
40892350,4sleep30-21swapper/323:00:273
241822350,4sleep121-21ksoftirqd/123:25:051
241822350,4sleep121-21ksoftirqd/123:25:051
206202350,3sleep012-21ksoftirqd/021:22:570
206202350,3sleep012-21ksoftirqd/021:22:570
13882350,3chrt0-21swapper/023:35:530
13882350,3chrt0-21swapper/023:35:530
13882350,3chrt0-21swapper/023:35:530
20232340,2sleep0151rcuc/022:16:470
141872340,3sleep30-21swapper/321:15:413
141872340,3sleep30-21swapper/321:15:413
139342340,4sleep20-21swapper/221:51:252
139342340,4sleep20-21swapper/221:51:252
139342340,4sleep20-21swapper/221:51:252
89962330,3sleep10-21swapper/121:45:491
89962330,3sleep10-21swapper/121:45:491
63782330,3sleep30-21swapper/323:02:043
63782330,3sleep30-21swapper/323:02:043
3253999332,26cyclictest22263-21sh00:01:282
3253999332,26cyclictest22263-21sh00:01:282
3253999332,26cyclictest22263-21sh00:01:282
20122330,2sleep02022-21ssh00:16:370
20122330,2sleep02022-21ssh00:16:370
116112330,3sleep30-21swapper/300:29:053
232272320,2sleep333-21ksoftirqd/300:03:213
232272320,2sleep333-21ksoftirqd/300:03:213
232272320,2sleep333-21ksoftirqd/300:03:213
32537993113,7cyclictest12-21ksoftirqd/022:11:230
32537993113,7cyclictest12-21ksoftirqd/022:11:230
206922310,3sleep30-21swapper/322:40:413
206922310,3sleep30-21swapper/322:40:413
3254299301,24cyclictest20593-21taskset00:00:363
3254299301,24cyclictest20593-21taskset00:00:363
3254299301,24cyclictest20593-21taskset00:00:363
229172300,3sleep10-21swapper/121:25:471
229172300,3sleep10-21swapper/121:25:471
118072300,3sleep20-21swapper/223:49:332
118072300,3sleep20-21swapper/223:49:332
118072300,3sleep20-21swapper/223:49:332
3253799287,10cyclictest12-21ksoftirqd/021:45:220
3253799287,10cyclictest12-21ksoftirqd/021:45:220
3253799287,10cyclictest12-21ksoftirqd/021:45:220
3253799281,16cyclictest12-21ksoftirqd/022:50:340
3253799281,16cyclictest12-21ksoftirqd/022:50:340
239782280,4sleep123632-21kworker/1:122:44:411
239782280,4sleep123632-21kworker/1:122:44:411
140842280,4chrt13476-21/usr/sbin/munin19:50:482
140842280,4chrt13476-21/usr/sbin/munin19:50:482
133492280,2sleep113395-21/usr/sbin/munin00:30:491
133492280,2sleep113395-21/usr/sbin/munin00:30:491
133492280,2sleep113395-21/usr/sbin/munin00:30:491
3253999274,10cyclictest27-21ksoftirqd/200:17:282
3253999274,10cyclictest27-21ksoftirqd/200:17:282
32538992712,11cyclictest32514-21cron22:55:301
32538992712,11cyclictest32514-21cron22:55:301
32538992712,11cyclictest32514-21cron22:55:301
3253799276,13cyclictest12-21ksoftirqd/020:19:460
3253799276,13cyclictest12-21ksoftirqd/020:19:460
3253799275,12cyclictest12-21ksoftirqd/021:48:160
3253799275,12cyclictest12-21ksoftirqd/021:48:160
32537992711,6cyclictest12-21ksoftirqd/019:39:550
32537992711,6cyclictest12-21ksoftirqd/019:39:550
3253799271,15cyclictest12-21ksoftirqd/020:21:070
3253799271,15cyclictest12-21ksoftirqd/020:21:070
312452272,15sleep30-21swapper/319:10:393
312452272,15sleep30-21swapper/319:10:393
27932270,2sleep30-21swapper/321:39:043
129392270,2sleep00-21swapper/021:13:410
129392270,2sleep00-21swapper/021:13:410
79862260,3sleep00-21swapper/022:25:070
79862260,3sleep00-21swapper/022:25:070
3253799269,8cyclictest12-21ksoftirqd/000:24:430
3253799269,8cyclictest12-21ksoftirqd/000:24:430
3253799268,7cyclictest12-21ksoftirqd/020:30:060
3253799268,7cyclictest12-21ksoftirqd/020:30:060
3253799264,13cyclictest131rcu_preempt21:57:500
3253799264,13cyclictest131rcu_preempt21:57:500
3253799264,13cyclictest131rcu_preempt21:57:500
3253999256,9cyclictest0-21swapper/221:59:072
3253999256,9cyclictest0-21swapper/221:59:072
3253999256,9cyclictest0-21swapper/221:59:072
3253999254,5cyclictest27-21ksoftirqd/223:45:122
3253999254,5cyclictest27-21ksoftirqd/223:45:122
32539992516,6cyclictest22563-21ssh22:02:192
32539992516,6cyclictest22563-21ssh22:02:192
32539992516,6cyclictest22563-21ssh22:02:192
3253799259,8cyclictest12-21ksoftirqd/022:08:160
3253799259,8cyclictest12-21ksoftirqd/022:08:160
3253799259,8cyclictest12-21ksoftirqd/022:03:550
3253799259,8cyclictest12-21ksoftirqd/022:03:550
3253799259,8cyclictest12-21ksoftirqd/022:03:550
3253799259,8cyclictest12-21ksoftirqd/021:26:040
3253799259,8cyclictest12-21ksoftirqd/021:26:040
3253799259,8cyclictest12-21ksoftirqd/000:14:590
3253799259,8cyclictest12-21ksoftirqd/000:14:590
3253799259,8cyclictest12-21ksoftirqd/000:14:590
3253799259,6cyclictest12-21ksoftirqd/023:09:170
3253799259,6cyclictest12-21ksoftirqd/023:09:170
3253799259,5cyclictest12-21ksoftirqd/021:51:530
3253799259,5cyclictest12-21ksoftirqd/021:51:530
3253799259,5cyclictest12-21ksoftirqd/021:51:530
3253799259,10cyclictest12-21ksoftirqd/023:00:000
3253799259,10cyclictest12-21ksoftirqd/023:00:000
3253799259,10cyclictest12-21ksoftirqd/023:00:000
3253799258,5cyclictest12-21ksoftirqd/021:38:150
3253799258,11cyclictest12-21ksoftirqd/023:31:520
3253799258,11cyclictest12-21ksoftirqd/023:31:520
3253799257,6cyclictest12-21ksoftirqd/020:47:550
3253799257,4cyclictest12-21ksoftirqd/000:30:440
3253799257,4cyclictest12-21ksoftirqd/000:30:440
3253799257,4cyclictest12-21ksoftirqd/000:30:440
3253799254,12cyclictest12-21ksoftirqd/020:05:000
3253799254,12cyclictest12-21ksoftirqd/020:05:000
32537992512,7cyclictest0-21swapper/023:16:070
32537992512,7cyclictest0-21swapper/023:16:070
32537992512,7cyclictest0-21swapper/023:16:070
32537992511,7cyclictest12-21ksoftirqd/023:04:110
32537992511,7cyclictest12-21ksoftirqd/023:04:110
32537992510,4cyclictest12-21ksoftirqd/000:26:280
32537992510,4cyclictest12-21ksoftirqd/000:26:280
32537992510,4cyclictest12-21ksoftirqd/000:26:280
288222250,3sleep128826-21latency_hist00:10:431
288222250,3sleep128826-21latency_hist00:10:431
285372250,10sleep333-21ksoftirqd/323:30:333
285372250,10sleep333-21ksoftirqd/323:30:333
250512250,1sleep30-21swapper/322:05:453
250512250,1sleep30-21swapper/322:05:453
183342250,3chrt0-21swapper/322:36:443
3253999247,9cyclictest27-21ksoftirqd/223:18:292
3253999247,9cyclictest27-21ksoftirqd/223:18:292
3253999247,9cyclictest27-21ksoftirqd/223:18:292
3253999246,7cyclictest27-21ksoftirqd/200:10:072
3253999246,7cyclictest27-21ksoftirqd/200:10:072
3253999245,4cyclictest261rcuc/223:13:462
3253999245,4cyclictest261rcuc/223:13:462
3253999243,5cyclictest27-21ksoftirqd/223:33:182
3253999243,5cyclictest27-21ksoftirqd/223:33:182
3253999241,6cyclictest24204-21ssh23:25:072
3253999241,6cyclictest24204-21ssh23:25:072
3253999241,6cyclictest16423-21ssh21:17:382
3253999241,6cyclictest16423-21ssh21:17:382
3253999241,6cyclictest16423-21ssh21:17:382
3253899241,18cyclictest10149-21latency_hist21:10:411
3253899241,18cyclictest10149-21latency_hist21:10:411
3253899241,18cyclictest10149-21latency_hist21:10:411
3253799249,8cyclictest12-21ksoftirqd/021:10:380
3253799249,8cyclictest12-21ksoftirqd/021:10:380
3253799249,8cyclictest12-21ksoftirqd/021:10:380
3253799249,4cyclictest12-21ksoftirqd/022:35:510
3253799249,4cyclictest12-21ksoftirqd/022:35:510
3253799249,4cyclictest12-21ksoftirqd/022:35:510
3253799248,8cyclictest12-21ksoftirqd/019:54:400
3253799248,8cyclictest12-21ksoftirqd/019:54:400
3253799248,5cyclictest12-21ksoftirqd/000:09:360
3253799248,5cyclictest12-21ksoftirqd/000:09:360
3253799246,8cyclictest12-21ksoftirqd/023:26:130
3253799246,8cyclictest12-21ksoftirqd/023:26:130
3253799246,5cyclictest12-21ksoftirqd/019:19:450
3253799246,5cyclictest12-21ksoftirqd/019:19:450
3253799246,3cyclictest131rcu_preempt20:05:480
3253799246,3cyclictest131rcu_preempt20:05:480
3253799244,7cyclictest12-21ksoftirqd/019:56:290
3253799244,7cyclictest12-21ksoftirqd/019:56:290
32537992413,5cyclictest12-21ksoftirqd/022:54:100
32537992413,5cyclictest12-21ksoftirqd/022:54:100
32537992413,5cyclictest12-21ksoftirqd/022:54:100
32537992410,8cyclictest12-21ksoftirqd/022:28:340
32537992410,8cyclictest12-21ksoftirqd/022:28:340
32537992410,8cyclictest12-21ksoftirqd/021:31:320
32537992410,8cyclictest12-21ksoftirqd/021:31:320
32537992410,5cyclictest12-21ksoftirqd/023:53:270
32537992410,5cyclictest12-21ksoftirqd/023:53:270
156272240,3sleep00-21swapper/021:16:100
156272240,3sleep00-21swapper/021:16:100
156272240,3sleep00-21swapper/021:16:100
3253999237,9cyclictest27-21ksoftirqd/220:30:562
3253999237,9cyclictest27-21ksoftirqd/220:30:562
3253999237,8cyclictest27-21ksoftirqd/223:38:352
3253999237,8cyclictest27-21ksoftirqd/223:38:352
3253999237,8cyclictest27-21ksoftirqd/223:38:352
3253999237,8cyclictest27-21ksoftirqd/222:22:412
3253999237,8cyclictest27-21ksoftirqd/222:22:412
3253999237,8cyclictest27-21ksoftirqd/221:47:362
3253999237,8cyclictest27-21ksoftirqd/221:47:362
3253999236,9cyclictest27-21ksoftirqd/222:08:192
3253999236,9cyclictest27-21ksoftirqd/222:08:192
3253999236,9cyclictest27-21ksoftirqd/200:26:212
3253999236,9cyclictest27-21ksoftirqd/200:26:212
3253999236,9cyclictest27-21ksoftirqd/200:26:212
3253999234,4cyclictest261rcuc/221:44:202
3253999234,4cyclictest261rcuc/221:44:202
3253999234,4cyclictest261rcuc/221:44:202
3253999233,5cyclictest27-21ksoftirqd/222:46:392
3253999233,5cyclictest27-21ksoftirqd/222:46:392
3253999232,5cyclictest27-21ksoftirqd/223:05:432
3253999232,5cyclictest27-21ksoftirqd/219:40:442
3253999232,5cyclictest27-21ksoftirqd/219:40:442
3253999231,7cyclictest13428-21cat19:50:392
3253999231,7cyclictest13428-21cat19:50:392
3253899237,4cyclictest131rcu_preempt22:15:271
3253899237,4cyclictest131rcu_preempt22:15:271
3253799239,8cyclictest12-21ksoftirqd/000:39:330
3253799239,8cyclictest12-21ksoftirqd/000:39:330
3253799238,8cyclictest12-21ksoftirqd/020:52:590
3253799232,4cyclictest12-21ksoftirqd/020:40:380
3253799232,4cyclictest12-21ksoftirqd/020:40:380
3253799232,4cyclictest12-21ksoftirqd/020:40:380
32537992312,9cyclictest21063-21if_err_eth023:20:450
32537992312,9cyclictest21063-21if_err_eth023:20:450
3253799231,11cyclictest4836-21fschecks_time20:55:430
143662230,2sleep20-21swapper/222:31:522
143662230,2sleep20-21swapper/222:31:522
3253999226,9cyclictest27-21ksoftirqd/219:37:352
3253999226,9cyclictest27-21ksoftirqd/219:37:352
3253999226,4cyclictest27-21ksoftirqd/223:54:482
3253999226,4cyclictest27-21ksoftirqd/223:54:482
3253999225,8cyclictest27-21ksoftirqd/223:07:472
3253999225,8cyclictest27-21ksoftirqd/223:07:472
3253999224,5cyclictest27-21ksoftirqd/220:10:522
3253999224,5cyclictest27-21ksoftirqd/220:10:522
3253999224,5cyclictest27-21ksoftirqd/220:10:522
3253999223,5cyclictest27-21ksoftirqd/222:15:542
3253999223,5cyclictest27-21ksoftirqd/222:11:452
3253999223,5cyclictest27-21ksoftirqd/222:11:452
3253999223,4cyclictest27-21ksoftirqd/223:00:512
3253999223,4cyclictest27-21ksoftirqd/222:57:072
3253999223,4cyclictest27-21ksoftirqd/222:57:072
3253999223,4cyclictest27-21ksoftirqd/222:57:072
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional