You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-12 - 22:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Mon May 12, 2025 12:55:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2486521270,2sleep30-21swapper/307:36:293
2486521270,2sleep30-21swapper/307:36:293
793921080,5sleep30-21swapper/312:41:433
793921080,5sleep30-21swapper/312:41:433
793921080,5sleep30-21swapper/312:41:433
854621030,3chrt0-21swapper/009:26:450
854621030,3chrt0-21swapper/009:26:450
190742950,3chrt0-21swapper/109:41:331
190742950,3chrt0-21swapper/109:41:331
50522920,2sleep00-21swapper/011:18:420
50522920,2sleep00-21swapper/011:18:420
50522920,2sleep00-21swapper/011:18:420
249752820,2sleep00-21swapper/009:01:330
249752820,2sleep00-21swapper/009:01:330
269672790,2sleep026661-21/usr/sbin/munin07:41:320
269672790,2sleep026661-21/usr/sbin/munin07:41:320
206442790,2chrt0-21swapper/311:51:283
206442790,2chrt0-21swapper/311:51:283
155052650,4sleep30-21swapper/309:36:373
153912620,2sleep015035-21ls07:11:310
153912620,2sleep015035-21ls07:11:310
234922600,3sleep00-21swapper/011:56:430
234922600,3sleep00-21swapper/011:56:430
1652999545,5cyclictest131rcu_preempt11:51:332
1652999545,5cyclictest131rcu_preempt11:51:332
16527995312,27cyclictest38650irq/55-eth009:46:280
16527995312,27cyclictest38650irq/55-eth009:46:280
10422510,4sleep10-21swapper/109:16:531
82162490,2sleep20-21swapper/208:16:432
82162490,2sleep20-21swapper/208:16:432
248682490,9sleep333-21ksoftirqd/309:01:323
248682490,9sleep333-21ksoftirqd/309:01:323
200192480,4sleep30-21swapper/308:47:503
200192480,4sleep30-21swapper/308:47:503
16528994740,5cyclictest21-21ksoftirqd/111:18:421
16528994740,5cyclictest21-21ksoftirqd/111:18:421
16528994740,5cyclictest21-21ksoftirqd/111:18:421
16528994420,18cyclictest21-21ksoftirqd/109:01:281
16528994420,18cyclictest21-21ksoftirqd/109:01:281
113842440,2sleep211392-21if_err_eth011:26:352
113842440,2sleep211392-21if_err_eth011:26:352
312372420,2sleep30-21swapper/309:14:593
312372420,2sleep30-21swapper/309:14:593
275402420,4sleep026351-21/usr/sbin/munin09:06:440
275402420,4sleep026351-21/usr/sbin/munin09:06:440
234592410,4sleep30-21swapper/311:56:433
234592410,4sleep30-21swapper/311:56:433
1652799414,32cyclictest18422-21sh09:41:270
1652799414,32cyclictest18422-21sh09:41:270
86292404,27sleep08641-21awk12:46:160
86292404,27sleep08641-21awk12:46:160
86292404,27sleep08641-21awk12:46:160
16528993924,11cyclictest0-21swapper/109:06:291
16528993924,11cyclictest0-21swapper/109:06:291
117702380,2sleep30-21swapper/309:31:383
237372370,3sleep20-21swapper/209:46:452
237372370,3sleep20-21swapper/209:46:452
304232360,7sleep2271ksoftirqd/212:16:352
304232360,7sleep2271ksoftirqd/212:16:352
16529993627,6cyclictest27-21ksoftirqd/211:18:432
16529993627,6cyclictest27-21ksoftirqd/211:18:432
16529993627,6cyclictest27-21ksoftirqd/211:18:432
125822360,2sleep20-21swapper/208:29:382
125822360,2sleep20-21swapper/208:29:382
110532360,3sleep011149-21sed12:51:320
1652999352,24cyclictest0-21swapper/211:31:302
1652999352,24cyclictest0-21swapper/211:31:302
1652899341,23cyclictest17186-21runrttasks07:16:271
16527993419,9cyclictest0-21swapper/007:26:290
16527993419,9cyclictest0-21swapper/007:26:290
102262345,23sleep30-21swapper/312:48:123
102262345,23sleep30-21swapper/312:48:123
102262345,23sleep30-21swapper/312:48:123
102262345,23sleep30-21swapper/312:48:123
104482336,19sleep00-21swapper/012:50:560
104482336,19sleep00-21swapper/012:50:560
104482336,19sleep00-21swapper/012:50:560
103752336,19sleep10-21swapper/112:50:041
103752336,19sleep10-21swapper/112:50:041
103752336,19sleep10-21swapper/112:50:041
103752336,19sleep10-21swapper/112:50:041
273792320,3sleep30-21swapper/309:06:433
273792320,3sleep30-21swapper/309:06:433
1652899325,4cyclictest131rcu_preempt07:56:311
1652799325,23cyclictest21983-21runrttasks07:46:270
1652799325,23cyclictest21983-21runrttasks07:46:270
102102326,19sleep20-21swapper/212:47:592
102102326,19sleep20-21swapper/212:47:592
102102326,19sleep20-21swapper/212:47:592
102102326,19sleep20-21swapper/212:47:592
289122310,3sleep20-21swapper/212:11:362
289122310,3sleep20-21swapper/212:11:362
1652999311,24cyclictest0-21swapper/212:31:272
1652999311,24cyclictest0-21swapper/212:31:272
1652999310,24cyclictest0-21swapper/209:16:302
1652799313,21cyclictest12-21ksoftirqd/011:46:290
1652799313,21cyclictest12-21ksoftirqd/011:46:290
208502300,4sleep30-21swapper/308:51:323
208502300,4sleep30-21swapper/308:51:323
1652999303,17cyclictest9186-21latency_hist11:21:292
1652999303,17cyclictest9186-21latency_hist11:21:292
85512291,20sleep10-21swapper/112:45:281
85512291,20sleep10-21swapper/112:45:281
85512291,20sleep10-21swapper/112:45:281
85472293,19sleep20-21swapper/212:45:252
85472293,19sleep20-21swapper/212:45:252
85472293,19sleep20-21swapper/212:45:252
1652899291,2cyclictest131rcu_preempt12:06:321
1652899291,2cyclictest131rcu_preempt12:06:321
16528992912,13cyclictest16526-21cyclictest08:11:281
16528992912,13cyclictest16526-21cyclictest08:11:281
1652799297,16cyclictest38650irq/55-eth011:26:310
1652799297,16cyclictest38650irq/55-eth011:26:310
1652799288,9cyclictest12-21ksoftirqd/008:01:300
152852287,12sleep20-21swapper/207:11:292
152852287,12sleep20-21swapper/207:11:292
303062270,3sleep10-21swapper/109:13:161
303062270,3sleep10-21swapper/109:13:161
16528992716,8cyclictest22537-21apt-get11:56:301
16528992716,8cyclictest22537-21apt-get11:56:301
1652899271,17cyclictest28523-21runrttasks07:46:271
1652899271,17cyclictest28523-21runrttasks07:46:271
16528992710,8cyclictest21-21ksoftirqd/112:31:261
16528992710,8cyclictest21-21ksoftirqd/112:31:261
55482260,2sleep00-21swapper/009:23:070
1652899269,13cyclictest21-21ksoftirqd/107:41:291
1652899269,13cyclictest21-21ksoftirqd/107:41:291
1652899261,20cyclictest21012-21chrt07:26:301
1652899261,20cyclictest21012-21chrt07:26:301
1652799262,17cyclictest12-21ksoftirqd/007:36:270
1652799262,17cyclictest12-21ksoftirqd/007:36:270
156752266,10sleep10-21swapper/107:11:361
156752266,10sleep10-21swapper/107:11:361
1652999252,19cyclictest14916-21ssh09:36:312
16527992519,4cyclictest38650irq/55-eth012:21:300
16527992519,4cyclictest38650irq/55-eth012:21:300
16527992519,4cyclictest151rcuc/008:36:270
16527992519,4cyclictest151rcuc/008:36:270
16527992518,5cyclictest21983-21runrttasks09:36:310
16527992516,4cyclictest131rcu_preempt12:06:300
16527992516,4cyclictest131rcu_preempt12:06:300
1652999241,17cyclictest21983-21runrttasks08:51:292
1652999241,17cyclictest21983-21runrttasks08:51:292
1652899249,5cyclictest21-21ksoftirqd/112:21:311
1652899249,5cyclictest21-21ksoftirqd/112:21:311
16528992418,4cyclictest201rcuc/109:46:311
16528992418,4cyclictest201rcuc/109:46:311
1652899241,4cyclictest131rcu_preempt09:31:421
310452230,3sleep012-21ksoftirqd/009:14:350
310452230,3sleep012-21ksoftirqd/009:14:350
16528992314,7cyclictest2932-21grep08:01:421
1652899231,18cyclictest19118-21taskset07:21:301
1652799232,17cyclictest21983-21runrttasks07:21:300
1652799231,19cyclictest1629-21cut12:26:320
1652799231,19cyclictest1629-21cut12:26:320
160172233,15sleep30-21swapper/307:11:423
160172233,15sleep30-21swapper/307:11:423
1653099222,15cyclictest18656-21chrt11:46:303
1653099222,15cyclictest18656-21chrt11:46:303
1652999224,13cyclictest0-21swapper/208:01:282
1652899226,8cyclictest30136-21/usr/sbin/munin12:16:321
1652899226,8cyclictest30136-21/usr/sbin/munin12:16:321
16528992215,5cyclictest25134-21ntp_states12:01:381
16528992215,5cyclictest25134-21ntp_states12:01:381
1652899221,18cyclictest16587-21ls08:41:181
1652899221,18cyclictest16587-21ls08:41:181
1652799221,17cyclictest24719-21grep12:01:320
1652799221,17cyclictest24719-21grep12:01:320
16527992210,9cyclictest9146-21/usr/sbin/munin11:21:370
16527992210,11cyclictest26589-21fschecks_count09:51:310
110372220,2sleep00-21swapper/008:26:250
1653099214,12cyclictest0-21swapper/308:36:273
1653099214,12cyclictest0-21swapper/308:36:273
1652999211,15cyclictest2272-21ls12:26:402
1652999211,15cyclictest2272-21ls12:26:402
16529992110,9cyclictest27892-21cron12:11:172
16529992110,9cyclictest27892-21cron12:11:172
1652899217,11cyclictest6904-21cron09:26:151
16528992112,7cyclictest10805-21grep11:26:161
1652899211,11cyclictest22417-21latency_hist11:56:221
1652899211,11cyclictest22417-21latency_hist11:56:221
16527992115,4cyclictest38650irq/55-eth008:56:310
16527992115,4cyclictest38650irq/55-eth008:56:310
1652799211,14cyclictest17712-21ls07:16:320
171112200,2sleep116763-21/usr/sbin/munin08:41:331
1653099203,12cyclictest0-21swapper/309:56:283
1653099203,12cyclictest0-21swapper/309:56:283
1653099203,12cyclictest0-21swapper/309:56:283
1652999206,12cyclictest26712-21fschecks_time09:51:312
1652999204,13cyclictest0-21swapper/208:46:282
1652999204,13cyclictest0-21swapper/208:46:282
16529992014,4cyclictest22665-21fschecks_count11:56:332
16529992014,4cyclictest22665-21fschecks_count11:56:332
16529992013,5cyclictest6910-21sh09:26:152
16529992013,5cyclictest21983-21runrttasks08:56:312
16529992013,5cyclictest21983-21runrttasks08:56:312
16529992013,5cyclictest19113-21apt-get07:21:292
16529992011,7cyclictest10007-21ssh09:29:272
16529992011,7cyclictest10007-21ssh09:29:272
1652999201,15cyclictest9238-21taskset08:21:312
1652999201,15cyclictest9238-21taskset08:21:312
1652999201,15cyclictest28548-21perl09:11:322
1652999201,15cyclictest28548-21perl09:11:322
1652999201,14cyclictest18656-21taskset11:46:302
1652999201,14cyclictest18656-21taskset11:46:302
1652899201,3cyclictest131rcu_preempt09:41:071
1652899201,3cyclictest131rcu_preempt09:29:051
1652899201,3cyclictest131rcu_preempt09:29:051
1652899201,17cyclictest9233-21apt-get08:21:301
1652899201,17cyclictest9233-21apt-get08:21:301
1652899201,13cyclictest15779-21ls11:36:391
1652899201,13cyclictest15779-21ls11:36:391
1652799203,14cyclictest9238-21chrt08:21:310
1652799201,8cyclictest3949-21idleruntime08:06:350
1652799201,8cyclictest3949-21idleruntime08:06:350
16527992013,6cyclictest12-21ksoftirqd/012:36:290
16527992013,6cyclictest12-21ksoftirqd/012:36:290
16527992011,5cyclictest38650irq/55-eth011:21:290
16527992011,5cyclictest38650irq/55-eth011:21:290
1653099192,12cyclictest0-21swapper/307:41:303
1653099192,12cyclictest0-21swapper/307:41:303
1653099191,14cyclictest0-21swapper/312:21:313
1653099191,14cyclictest0-21swapper/312:21:313
1653099191,14cyclictest0-21swapper/312:11:393
1653099191,14cyclictest0-21swapper/312:11:393
1653099191,14cyclictest0-21swapper/308:16:213
1653099191,14cyclictest0-21swapper/308:16:213
1653099191,14cyclictest0-21swapper/307:51:433
1652999198,9cyclictest8933-21cron11:21:162
1652999198,9cyclictest27565-21sshd09:06:512
1652999198,9cyclictest27565-21sshd09:06:512
1652999192,15cyclictest1236-21latency_hist12:26:212
1652999192,15cyclictest1236-21latency_hist12:26:212
16529991910,6cyclictest0-21swapper/209:36:162
1652899197,3cyclictest283582fschecks_time12:11:291
1652899197,3cyclictest283582fschecks_time12:11:291
1652899194,11cyclictest0-21swapper/107:36:281
1652899194,11cyclictest0-21swapper/107:36:281
1652899192,14cyclictest22886-21apt-get07:31:271
1652899192,14cyclictest22886-21apt-get07:31:271
1652899191,8cyclictest7467-21fschecks_count08:16:341
1652899191,8cyclictest7467-21fschecks_count08:16:341
1652899191,2cyclictest131rcu_preempt11:41:411
1652899191,2cyclictest131rcu_preempt11:41:411
1652899191,16cyclictest9149-21find11:21:271
1652899191,16cyclictest9149-21find11:21:271
1652899191,16cyclictest9149-21find11:21:271
16528991910,6cyclictest0-21swapper/108:06:301
16528991910,6cyclictest0-21swapper/108:06:301
1652899190,4cyclictest131rcu_preempt07:51:311
1652899190,15cyclictest21019-21latency08:51:331
1652899190,15cyclictest21019-21latency08:51:331
1652799198,9cyclictest30533-21fschecks_count07:51:320
1652799195,3cyclictest141rcub/012:16:320
1652799195,3cyclictest141rcub/012:16:320
1652799192,14cyclictest32101-21apt-get09:16:290
1652799191,9cyclictest7085-21latency_hist08:16:150
1652799191,9cyclictest7085-21latency_hist08:16:150
1652799191,9cyclictest3270-21/usr/sbin/munin12:31:420
1652799191,9cyclictest3270-21/usr/sbin/munin12:31:420
1652799191,9cyclictest20950-21uname08:51:330
1652799191,9cyclictest20950-21uname08:51:330
16527991913,4cyclictest12-21ksoftirqd/008:46:300
16527991913,4cyclictest12-21ksoftirqd/008:46:300
16527991911,6cyclictest11067-21ssh09:31:290
1652799191,15cyclictest73-21kswapd007:31:310
1652799191,15cyclictest73-21kswapd007:31:310
1652799191,14cyclictest8181-21latency_hist11:19:560
43142181,3sleep30-21swapper/309:21:393
1653099182,11cyclictest0-21swapper/312:31:283
1653099182,11cyclictest0-21swapper/312:31:283
1653099182,11cyclictest0-21swapper/312:16:313
1653099182,11cyclictest0-21swapper/312:16:313
1653099182,11cyclictest0-21swapper/312:06:323
1653099182,11cyclictest0-21swapper/312:06:323
1653099182,11cyclictest0-21swapper/311:36:293
1653099182,11cyclictest0-21swapper/311:36:293
1653099182,11cyclictest0-21swapper/309:46:253
1653099182,11cyclictest0-21swapper/309:26:303
1653099182,11cyclictest0-21swapper/309:26:303
1653099182,11cyclictest0-21swapper/308:56:293
1653099182,11cyclictest0-21swapper/308:56:293
1653099182,11cyclictest0-21swapper/308:41:303
1653099181,14cyclictest0-21swapper/311:26:463
1653099181,14cyclictest0-21swapper/311:26:463
1653099181,12cyclictest0-21swapper/312:26:423
1653099181,12cyclictest0-21swapper/312:26:423
1652999184,12cyclictest13317-21grep08:31:342
1652999184,12cyclictest13317-21grep08:31:342
1652999182,14cyclictest28517-21apt-get07:46:262
1652999182,14cyclictest28517-21apt-get07:46:262
1652999181,9cyclictest22868-21/usr/sbin/munin07:31:322
1652999181,9cyclictest22868-21/usr/sbin/munin07:31:322
1652999181,15cyclictest0-21swapper/212:36:292
1652999181,15cyclictest0-21swapper/212:36:292
16529991811,5cyclictest0-21swapper/211:41:362
16529991811,5cyclictest0-21swapper/211:41:362
1652999181,14cyclictest14868-21taskset11:36:282
1652999181,14cyclictest14868-21taskset11:36:282
1652999181,13cyclictest14895-21chrt08:36:282
1652999181,13cyclictest14895-21chrt08:36:282
1652999180,16cyclictest16876-21ls08:41:312
1652999180,11cyclictest21983-21runrttasks07:29:172
1652999180,11cyclictest21983-21runrttasks07:29:172
1652899183,11cyclictest0-21swapper/109:51:291
1652899182,13cyclictest22453-21apt-get08:56:281
1652899182,13cyclictest22453-21apt-get08:56:281
1652899182,12cyclictest21983-21runrttasks08:30:451
1652899182,12cyclictest21983-21runrttasks08:30:451
1652899181,10cyclictest21983-21runrttasks12:37:271
1652899181,10cyclictest21983-21runrttasks12:37:271
16528991810,6cyclictest19744-21wc08:46:411
16528991810,6cyclictest19744-21wc08:46:411
1652799187,9cyclictest18529-21cat08:46:190
1652799185,11cyclictest18587-21latency_hist11:46:230
1652799185,11cyclictest18587-21latency_hist11:46:230
1652799183,13cyclictest32408-21fschecks_count07:56:330
1652799182,14cyclictest15883-21grep11:36:410
1652799182,14cyclictest15883-21grep11:36:410
16527991812,4cyclictest0-21swapper/011:36:160
16527991812,4cyclictest0-21swapper/011:36:160
16527991812,3cyclictest12-21ksoftirqd/008:31:330
16527991812,3cyclictest12-21ksoftirqd/008:31:330
16527991811,5cyclictest21095-21latency11:51:380
16527991811,5cyclictest21095-21latency11:51:380
68922171,3sleep20-21swapper/208:14:062
68922171,3sleep20-21swapper/208:14:062
1653099172,11cyclictest0-21swapper/308:21:313
1653099172,11cyclictest0-21swapper/308:21:313
1653099172,11cyclictest0-21swapper/308:06:333
1653099172,11cyclictest0-21swapper/308:06:333
1653099172,11cyclictest0-21swapper/307:26:303
1653099172,11cyclictest0-21swapper/307:26:303
1653099172,10cyclictest0-21swapper/307:16:273
1653099171,13cyclictest0-21swapper/311:41:323
1653099171,13cyclictest0-21swapper/311:41:323
1653099171,11cyclictest19118-21chrt07:21:303
1653099171,11cyclictest0-21swapper/309:51:333
1653099171,11cyclictest0-21swapper/309:46:213
1653099171,10cyclictest0-21swapper/309:16:303
1652999173,12cyclictest21983-21runrttasks07:56:262
1652999171,9cyclictest0-21swapper/208:06:312
1652999171,9cyclictest0-21swapper/208:06:312
16529991711,4cyclictest30519-21fschecks_count07:51:322
1652999171,14cyclictest0-21swapper/212:01:292
1652999171,14cyclictest0-21swapper/212:01:292
16529991710,5cyclictest0-21swapper/209:41:272
16529991710,5cyclictest0-21swapper/209:41:272
1652899179,6cyclictest0-21swapper/111:26:391
1652899179,6cyclictest0-21swapper/111:26:391
1652899171,12cyclictest18859-21fschecks_time11:46:321
1652899171,12cyclictest18859-21fschecks_time11:46:321
1652799179,6cyclictest9083-21cut11:21:230
1652799178,7cyclictest8317-21cut11:19:570
1652799174,10cyclictest7640-21grep08:16:350
1652799174,10cyclictest7640-21grep08:16:350
16527991712,4cyclictest0-21swapper/012:11:360
16527991712,4cyclictest0-21swapper/012:11:360
16527991711,4cyclictest0-21swapper/008:26:280
16527991711,4cyclictest0-21swapper/008:26:280
137942170,3sleep10-21swapper/108:31:401
137942170,3sleep10-21swapper/108:31:401
1653099163,9cyclictest0-21swapper/307:46:273
1653099163,9cyclictest0-21swapper/307:46:273
1653099162,5cyclictest0-21swapper/307:56:313
1653099162,10cyclictest0-21swapper/311:21:303
1653099162,10cyclictest0-21swapper/309:46:303
1653099162,10cyclictest0-21swapper/309:46:303
1653099162,10cyclictest0-21swapper/308:26:303
1653099162,10cyclictest0-21swapper/308:26:303
1653099162,10cyclictest0-21swapper/308:16:323
1653099162,10cyclictest0-21swapper/308:16:323
1653099161,9cyclictest0-21swapper/308:36:213
1653099161,9cyclictest0-21swapper/308:36:213
1653099161,10cyclictest0-21swapper/311:31:323
1653099161,10cyclictest0-21swapper/311:31:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional