You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-05 - 08:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Wed Aug 05, 2026 00:36:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1464324540,7sleep214653-21sort19:11:362
2774321230,3sleep20-21swapper/219:46:332
2774321230,3sleep20-21swapper/219:46:332
1072321210,2sleep214957-21cyclictest21:57:532
1072321210,2sleep214957-21cyclictest21:57:532
1736221170,3sleep2271ksoftirqd/223:08:352
1736221170,3sleep2271ksoftirqd/223:08:352
380521130,4sleep20-21swapper/223:26:452
380521130,4sleep20-21swapper/223:26:452
645121110,2sleep30-21swapper/300:01:353
2963921090,2chrt0-21swapper/323:21:193
2963921090,2chrt0-21swapper/323:21:193
2963921090,2chrt0-21swapper/323:21:193
937421070,7sleep012-21ksoftirqd/021:25:510
769021050,2sleep30-21swapper/323:31:243
769021050,2sleep30-21swapper/323:31:243
2205921050,3chrt0-21swapper/119:31:331
2205921050,3chrt0-21swapper/119:31:331
3193721030,3sleep10-21swapper/123:22:501
2633721030,2sleep126322-21xargs21:41:361
2633721030,2sleep126322-21xargs21:41:361
212052940,2chrt21206-21/usr/sbin/munin21:36:342
212052940,2chrt21206-21/usr/sbin/munin21:36:342
207062940,3sleep30-21swapper/322:07:353
255862860,2chrt25588-21latency_hist00:21:181
255862860,2chrt25588-21latency_hist00:21:181
119932850,2sleep1211ksoftirqd/120:31:261
188922830,1sleep333-21ksoftirqd/323:41:373
188922830,1sleep333-21ksoftirqd/323:41:373
141472710,3sleep00-21swapper/022:01:290
141472710,3sleep00-21swapper/022:01:290
96372680,3chrt0-21swapper/323:01:253
96372680,3chrt0-21swapper/323:01:253
96372680,3chrt0-21swapper/323:01:253
240662680,3sleep10-21swapper/121:39:551
240662680,3sleep10-21swapper/121:39:551
300322640,2chrt0-21swapper/319:51:373
300322640,2chrt0-21swapper/319:51:373
181832620,2sleep30-21swapper/322:06:023
181832620,2sleep30-21swapper/322:06:023
323582610,3sleep30-21swapper/322:51:283
323582610,3sleep30-21swapper/322:51:283
200082610,2sleep10-21swapper/121:36:131
190052600,3sleep30-21swapper/300:14:253
190052600,3sleep30-21swapper/300:14:253
190052600,3sleep30-21swapper/300:14:253
96182580,2sleep30-21swapper/320:26:133
96182580,2sleep30-21swapper/320:26:133
39562580,4chrt0-21swapper/320:11:183
39562580,4chrt0-21swapper/320:11:183
239832580,4chrt0-21swapper/322:11:253
199672580,3chrt0-21swapper/222:39:172
199672580,3chrt0-21swapper/222:39:172
160902580,4sleep333-21ksoftirqd/321:31:333
100642580,9sleep333-21ksoftirqd/320:26:253
89342560,4chrt0-21swapper/321:25:133
129292560,2sleep10-21swapper/122:31:371
129292560,2sleep10-21swapper/122:31:371
62812550,3sleep10-21swapper/100:01:331
27902550,2sleep30-21swapper/300:30:413
27902550,2sleep30-21swapper/300:30:413
35662540,3chrt0-21swapper/322:22:383
293952540,2sleep229406-21ssh23:21:112
293952540,2sleep229406-21ssh23:21:112
293952540,2sleep229406-21ssh23:21:112
108152540,3sleep30-21swapper/322:30:383
108152540,3sleep30-21swapper/322:30:383
262012530,3sleep20-21swapper/222:46:052
262012530,3sleep20-21swapper/222:46:052
224342530,4sleep30-21swapper/323:13:353
224342530,4sleep30-21swapper/323:13:353
174552530,3sleep10-21swapper/123:08:431
174552530,3sleep10-21swapper/123:08:431
126422530,2sleep10-21swapper/123:04:041
126422530,2sleep10-21swapper/123:04:041
126422530,2sleep10-21swapper/123:04:041
3032520,4chrt0-21swapper/323:56:203
229672520,2sleep00-21swapper/023:14:200
229672520,2sleep00-21swapper/023:14:200
183162510,4chrt0-21swapper/123:41:311
183162510,4chrt0-21swapper/123:41:311
40622500,3chrt0-21swapper/321:20:313
40622500,3chrt0-21swapper/321:20:313
40622500,3chrt0-21swapper/321:20:313
259252490,3sleep20-21swapper/221:41:292
259252490,3sleep20-21swapper/221:41:292
311282480,2sleep131142-21sh22:17:591
311282480,2sleep131142-21sh22:17:591
304732470,3chrt0-21swapper/121:14:261
304732470,3chrt0-21swapper/121:14:261
300192470,7sleep333-21ksoftirqd/322:16:353
300192470,7sleep333-21ksoftirqd/322:16:353
242282470,2sleep224230-21unixbench_multi21:01:372
242282470,2sleep224230-21unixbench_multi21:01:372
285692450,4sleep128567-21cron19:51:101
285692450,4sleep128567-21cron19:51:101
116582450,3sleep10-21swapper/121:59:091
116582450,3sleep10-21swapper/121:59:091
90682440,3chrt0-21swapper/321:56:293
90682440,3chrt0-21swapper/321:56:293
293412430,5sleep229343-21missed_timers19:51:282
293412430,5sleep229343-21missed_timers19:51:282
248912420,2sleep00-21swapper/000:20:330
248912420,2sleep00-21swapper/000:20:330
214902420,3sleep30-21swapper/320:56:273
214902420,3sleep30-21swapper/320:56:273
183492420,3chrt0-21swapper/320:46:313
183492420,3chrt0-21swapper/320:46:313
14959994234,5cyclictest5121-21latency_hist00:01:131
14959994234,5cyclictest5121-21latency_hist00:01:131
1495899422,33cyclictest5244-21ssh00:01:140
1495899422,33cyclictest5244-21ssh00:01:140
136132420,3sleep20-21swapper/223:36:372
136132420,3sleep20-21swapper/223:36:372
136132420,3sleep20-21swapper/223:36:372
14722410,4sleep30-21swapper/321:49:223
14722410,4sleep30-21swapper/321:49:223
14722410,4sleep30-21swapper/321:49:223
44482390,4sleep30-21swapper/300:31:353
44482390,4sleep30-21swapper/300:31:353
118432390,4sleep30-21swapper/300:06:413
118432390,4sleep30-21swapper/300:06:413
279742380,3sleep30-21swapper/321:11:353
279742380,3sleep30-21swapper/321:11:353
201282380,3sleep20-21swapper/221:36:182
1495899381,20cyclictest6277-21ps00:01:330
70672360,4sleep30-21swapper/323:31:123
70672360,4sleep30-21swapper/323:31:123
318822350,3sleep00-21swapper/000:26:360
318822350,3sleep00-21swapper/000:26:360
220912350,2sleep122103-21sh23:13:061
220912350,2sleep122103-21sh23:13:061
201972350,3chrt19327-21/usr/sbin/munin20:51:351
201972350,3chrt19327-21/usr/sbin/munin20:51:351
70862340,3sleep10-21swapper/122:58:261
70862340,3sleep10-21swapper/122:58:261
70862340,3sleep10-21swapper/122:58:261
53342340,3sleep10-21swapper/123:28:531
53342340,3sleep10-21swapper/123:28:531
301262340,3sleep10-21swapper/123:53:051
294372340,3sleep00-21swapper/021:13:000
294372340,3sleep00-21swapper/021:13:000
58732330,2sleep15885-21ssh21:53:231
58732330,2sleep15885-21ssh21:53:231
282662330,2sleep228278-21sh00:23:172
282662330,2sleep228278-21sh00:23:172
14962993312,15cyclictest0-21swapper/300:01:143
14962993312,15cyclictest0-21swapper/300:01:143
1496099332,26cyclictest6280-21ssh00:01:332
73002320,4sleep00-21swapper/021:55:140
73002320,4sleep00-21swapper/021:55:140
72642320,2sleep3321rcuc/322:58:403
72642320,2sleep3321rcuc/322:58:403
72642320,2sleep3321rcuc/322:58:403
272082320,4sleep10-21swapper/122:14:361
256432320,4sleep20-21swapper/221:06:312
256432320,4sleep20-21swapper/221:06:312
248662320,3sleep30-21swapper/319:41:173
248662320,3sleep30-21swapper/319:41:173
14958993226,4cyclictest29142-1kworker/0:1H19:21:110
14958993226,4cyclictest29142-1kworker/0:1H19:21:110
57162310,4sleep121-21ksoftirqd/100:32:481
57162310,4sleep121-21ksoftirqd/100:32:481
326402300,2sleep032763-21df20:01:230
326402300,2sleep032763-21df20:01:230
240202300,2chrt27-21ksoftirqd/223:46:432
184542300,2sleep00-21swapper/021:34:120
1495999302,23cyclictest11020-21ssh21:26:321
1495999302,23cyclictest11020-21ssh21:26:321
14958993013,8cyclictest12-21ksoftirqd/023:36:400
14958993013,8cyclictest12-21ksoftirqd/023:36:400
14958993013,8cyclictest12-21ksoftirqd/023:36:400
130912300,2sleep213110-21rm21:28:552
130912300,2sleep213110-21rm21:28:552
155042290,3chrt0-21swapper/119:16:181
117252290,1sleep211728-21sendmail-mta23:02:542
117252290,1sleep211728-21sendmail-mta23:02:542
117252290,1sleep211728-21sendmail-mta23:02:542
14959992822,4cyclictest9461-1kworker/1:0H23:21:111
14959992822,4cyclictest9461-1kworker/1:0H23:21:111
14959992822,4cyclictest9461-1kworker/1:0H23:21:111
14959992821,5cyclictest0-21swapper/122:36:361
14959992821,5cyclictest0-21swapper/122:36:361
59952270,3sleep20-21swapper/200:33:092
59952270,3sleep20-21swapper/200:33:092
246392270,2sleep00-21swapper/023:16:210
246392270,2sleep00-21swapper/023:16:210
246392270,2sleep00-21swapper/023:16:210
299892260,2sleep00-21swapper/022:49:160
299892260,2sleep00-21swapper/022:49:160
233782260,4chrt0-21swapper/321:01:263
233782260,4chrt0-21swapper/321:01:263
14959992617,5cyclictest21-21ksoftirqd/123:31:351
14959992617,5cyclictest21-21ksoftirqd/123:31:351
14958992620,3cyclictest151rcuc/020:51:370
14958992620,3cyclictest151rcuc/020:51:370
14958992618,5cyclictest10163-21ssh21:26:220
14958992618,5cyclictest10163-21ssh21:26:220
148152261,15sleep30-21swapper/319:11:383
136312260,2sleep20-21swapper/222:32:302
136312260,2sleep20-21swapper/222:32:302
14960992518,4cyclictest23996-1kworker/2:1H19:21:112
14960992518,4cyclictest23996-1kworker/2:1H19:21:112
14958992520,3cyclictest29142-1kworker/0:1H00:21:380
14958992520,3cyclictest29142-1kworker/0:1H00:21:380
14958992516,6cyclictest18894-21grep23:41:370
14958992516,6cyclictest18894-21grep23:41:370
136362254,13sleep013396-21ls19:11:230
232102240,2sleep023205-21strings23:46:290
174822240,3sleep20-21swapper/222:05:092
174822240,3sleep20-21swapper/222:05:092
1496099243,18cyclictest16650-21timerandwakeup00:11:362
1496099243,18cyclictest16650-21timerandwakeup00:11:362
1496099243,18cyclictest16650-21timerandwakeup00:11:362
1496099240,6cyclictest261rcuc/223:11:372
1496099240,6cyclictest261rcuc/223:11:372
14958992419,3cyclictest29142-1kworker/0:1H00:11:360
14958992419,3cyclictest29142-1kworker/0:1H00:11:360
14958992419,3cyclictest29142-1kworker/0:1H00:11:360
14958992418,4cyclictest151rcuc/022:11:350
14958992412,9cyclictest12-21ksoftirqd/022:06:250
14958992411,10cyclictest12280-21latency_hist23:36:170
14958992411,10cyclictest12280-21latency_hist23:36:170
307182230,3sleep10-21swapper/122:50:181
307182230,3sleep10-21swapper/122:50:181
29912230,3chrt0-21swapper/022:54:470
29912230,3chrt0-21swapper/022:54:470
227112230,3chrt0-21swapper/322:41:353
227112230,3chrt0-21swapper/322:41:353
1496099231,17cyclictest6222-21ls20:16:252
1496099231,17cyclictest6222-21ls20:16:252
14959992311,10cyclictest25088-21systemd-journal22:26:111
14958992318,3cyclictest29142-1kworker/0:1H23:51:360
14958992314,6cyclictest4539-21ssh00:31:350
14958992314,6cyclictest4539-21ssh00:31:350
1496099229,9cyclictest27-21ksoftirqd/222:51:352
1496099229,9cyclictest27-21ksoftirqd/222:51:352
14960992215,5cyclictest10269-21ssh22:29:532
14960992215,5cyclictest10269-21ssh22:29:532
1495999221,7cyclictest200072ntp_kernel_err19:26:301
1495999221,7cyclictest200072ntp_kernel_err19:26:301
14959992214,5cyclictest19098-21snmpd20:05:301
14959992214,5cyclictest19098-21snmpd20:05:301
1495999221,15cyclictest17463-21find19:21:241
1495999221,15cyclictest17463-21find19:21:241
1495899226,13cyclictest5625-21cron20:16:110
1495899226,13cyclictest5625-21cron20:16:110
1495899221,16cyclictest20507-21cut21:36:260
1495899221,16cyclictest20507-21cut21:36:260
127222220,4chrt0-21swapper/320:31:363
123272220,4sleep10-21swapper/100:07:201
123272220,4sleep10-21swapper/100:07:201
199292210,5sleep2261rcuc/222:06:372
151052210,4chrt0-21swapper/200:10:582
151052210,4chrt0-21swapper/200:10:582
1496299214,12cyclictest0-21swapper/321:36:313
1496299214,12cyclictest0-21swapper/321:36:313
1496099219,9cyclictest29413-21tail22:16:272
1496099219,9cyclictest29413-21tail22:16:272
1496099211,3cyclictest0-21swapper/219:31:202
1496099211,3cyclictest0-21swapper/219:31:202
14960992113,6cyclictest3761-21ssh21:51:262
14960992113,6cyclictest3761-21ssh21:51:262
1496099211,17cyclictest12145-21ls20:31:272
1496099211,16cyclictest25144-21uniq19:41:262
1496099211,14cyclictest30755-21find23:21:352
14960992110,8cyclictest5192-40mandb00:01:182
14960992110,8cyclictest5192-40mandb00:01:182
1495999218,4cyclictest5089-21grep20:11:361
1495999218,4cyclictest5089-21grep20:11:361
1495999211,6cyclictest16628-21find00:11:351
1495999211,6cyclictest16628-21find00:11:351
1495999211,6cyclictest16628-21find00:11:351
1495999211,17cyclictest23834-21sed23:46:371
1495999211,17cyclictest23430-21ls21:01:261
1495999211,17cyclictest23430-21ls21:01:261
1495999210,18cyclictest2126-21find20:06:221
1495999210,18cyclictest2126-21find20:06:221
1495899218,3cyclictest131rcu_preempt21:41:360
1495899218,3cyclictest131rcu_preempt21:41:360
1495899213,8cyclictest12-21ksoftirqd/020:26:360
1495899211,9cyclictest26633-21latency_hist19:46:110
1495899211,8cyclictest7567-21latency_hist20:21:110
1495899211,8cyclictest7567-21latency_hist20:21:110
1495899211,5cyclictest3365-21find23:26:320
1495899211,5cyclictest3365-21find23:26:320
14958992113,5cyclictest29142-1kworker/0:1H21:01:110
14958992113,5cyclictest29142-1kworker/0:1H21:01:110
1495899211,17cyclictest14411-21ls23:06:160
1495899211,17cyclictest14411-21ls23:06:160
1495899211,17cyclictest14411-21ls23:06:160
1495899211,14cyclictest16510-21timerandwakeup20:41:370
1495899211,14cyclictest16510-21timerandwakeup20:41:370
1495899211,10cyclictest16968-21fschecks_time22:36:250
1495899211,10cyclictest16968-21fschecks_time22:36:250
1495899211,10cyclictest12859-21grep20:31:360
203412200,3chrt0-21swapper/320:51:373
203412200,3chrt0-21swapper/320:51:373
14960992013,5cyclictest31986-21timerwakeupswit00:26:372
14960992013,5cyclictest31986-21timerwakeupswit00:26:372
14960992013,5cyclictest30020-21ssh23:52:562
1496099201,15cyclictest5633-21latency_hist20:16:182
1496099201,15cyclictest5633-21latency_hist20:16:182
1496099201,10cyclictest21928-21ssh23:45:442
1496099201,10cyclictest21928-21ssh23:45:442
1496099200,18cyclictest23674-21ls19:36:272
1496099200,18cyclictest23674-21ls19:36:272
1496099200,15cyclictest18500-21ls19:21:372
1496099200,15cyclictest18500-21ls19:21:372
14959992013,5cyclictest2298-21ssh21:50:251
14959992013,5cyclictest2298-21ssh21:50:251
14959992013,5cyclictest2298-21ssh21:50:251
14959992011,7cyclictest24109-21sed19:36:351
14959992011,7cyclictest24109-21sed19:36:351
1495999200,4cyclictest131rcu_preempt00:21:521
1495999200,4cyclictest131rcu_preempt00:21:521
1495899206,11cyclictest18766-21rs:main0
1495899206,11cyclictest18766-21rs:main0
1495899201,16cyclictest14455-21find20:36:320
1495899201,16cyclictest14455-21find20:36:320
1495899201,16cyclictest14455-21find20:36:320
14958992011,6cyclictest0-21swapper/023:01:210
14958992011,6cyclictest0-21swapper/023:01:210
14958992011,6cyclictest0-21swapper/023:01:210
14958992011,4cyclictest0-21swapper/023:21:370
1495899201,11cyclictest29842-21find22:16:330
1495899201,11cyclictest29842-21find22:16:330
1495899201,10cyclictest4693-21sh22:24:130
1495899201,10cyclictest27811-21switchtime19:46:340
1495899201,10cyclictest27811-21switchtime19:46:340
14322200,3sleep30-21swapper/323:25:253
122312200,4sleep30-21swapper/321:27:473
122312200,4sleep30-21swapper/321:27:473
230612191,2sleep10-21swapper/122:41:471
230612191,2sleep10-21swapper/122:41:471
1496299191,13cyclictest0-21swapper/321:41:253
1496299191,13cyclictest0-21swapper/321:41:253
1496299191,12cyclictest0-21swapper/320:36:253
1496299191,12cyclictest0-21swapper/320:36:253
1496299191,12cyclictest0-21swapper/320:36:253
14960991912,5cyclictest6255-21kworker/u8:422:58:222
14960991912,5cyclictest6255-21kworker/u8:422:58:222
14960991912,5cyclictest6255-21kworker/u8:422:58:222
14960991912,5cyclictest4034-21kworker/u8:223:35:422
14960991912,5cyclictest4034-21kworker/u8:223:35:422
14960991911,4cyclictest817-21runrttasks21:17:442
14960991911,4cyclictest817-21runrttasks21:17:442
14960991911,4cyclictest817-21runrttasks21:17:442
14960991910,6cyclictest0-21swapper/220:41:382
14960991910,6cyclictest0-21swapper/220:41:382
14960991910,6cyclictest0-21swapper/219:26:332
14960991910,6cyclictest0-21swapper/219:26:332
1496099190,16cyclictest8374-21ls20:21:252
1496099190,16cyclictest8374-21ls20:21:252
1495999195,12cyclictest25160-21fschecks_count19:41:261
1495999193,13cyclictest7542-21cron20:21:111
1495999193,13cyclictest7542-21cron20:21:111
14959991912,5cyclictest30037-21unixbench_singl19:51:371
14959991912,5cyclictest30037-21unixbench_singl19:51:371
14959991912,5cyclictest20651-21kworker/u8:022:30:301
14959991912,5cyclictest20651-21kworker/u8:022:30:301
14959991912,5cyclictest12657-21fschecks_count23:36:271
14959991912,5cyclictest12657-21fschecks_count23:36:271
14959991912,5cyclictest12657-21fschecks_count23:36:271
14959991912,4cyclictest0-21swapper/121:16:241
14959991912,4cyclictest0-21swapper/121:16:241
14959991912,4cyclictest0-21swapper/121:16:241
1495999191,15cyclictest32248-21ssh22:51:271
1495999191,15cyclictest32248-21ssh22:51:271
14959991911,5cyclictest0-21swapper/120:46:331
14959991911,5cyclictest0-21swapper/120:46:331
1495999191,14cyclictest14821-21sh22:01:381
1495999191,14cyclictest14821-21sh22:01:381
1495999191,12cyclictest30949-21uniq19:56:241
1495999191,12cyclictest30949-21uniq19:56:241
14959991910,6cyclictest15351-21latency_hist20:41:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional