You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-13 - 10:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Sat Jul 12, 2025 22:26:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
743221280,2sleep30-21swapper/321:13:063
743221280,2sleep30-21swapper/321:13:063
293021200,3sleep10-21swapper/121:02:441
293021200,3sleep10-21swapper/121:02:441
2095421100,3sleep30-21swapper/321:27:423
2095421100,3sleep30-21swapper/321:27:423
3148321050,3sleep00-21swapper/020:52:420
51421020,2sleep30-21swapper/319:32:343
51421020,2sleep30-21swapper/319:32:343
1513121010,2sleep10-21swapper/121:57:471
1513121010,2sleep10-21swapper/121:57:471
2960621000,2sleep30-21swapper/320:47:423
2960621000,2sleep30-21swapper/320:47:423
105262910,1sleep012-21ksoftirqd/019:57:440
105262910,1sleep012-21ksoftirqd/019:57:440
67202810,1sleep012-21ksoftirqd/019:47:430
67202810,1sleep012-21ksoftirqd/019:47:430
7582760,3sleep1759-21grep22:17:441
7582760,3sleep1759-21grep22:17:441
167132750,2sleep00-21swapper/021:59:470
167132750,2sleep00-21swapper/021:59:470
126152720,2sleep00-21swapper/020:02:460
126152720,2sleep00-21swapper/020:02:460
2611099705,49cyclictest23268-21ssh22:07:302
2611099705,49cyclictest23268-21ssh22:07:302
101292650,3chrt10128-21ssh21:52:372
101292650,3chrt10128-21ssh21:52:372
280072640,3chrt0-21swapper/022:12:330
280072640,3chrt0-21swapper/022:12:330
26110996418,9cyclictest131rcu_preempt19:27:282
26110996418,9cyclictest131rcu_preempt19:27:282
290872630,3chrt0-21swapper/221:37:342
290872630,3chrt0-21swapper/221:37:342
264502620,4sleep30-21swapper/322:10:513
264502620,4sleep30-21swapper/322:10:513
2611099606,15cyclictest27-21ksoftirqd/220:57:292
2611099606,15cyclictest27-21ksoftirqd/220:57:292
255512520,2sleep30-21swapper/319:12:413
255512520,2sleep30-21swapper/319:12:413
254142520,3sleep024443-21ls19:12:390
254142520,3sleep024443-21ls19:12:390
26106994910,7cyclictest131rcu_preempt21:27:280
26106994910,7cyclictest131rcu_preempt21:27:280
2610899461,32cyclictest9591-21ssh21:52:331
2610899461,32cyclictest9591-21ssh21:52:331
298702440,3chrt0-21swapper/120:47:441
298702440,3chrt0-21swapper/120:47:441
2610699448,19cyclictest0-21swapper/021:47:280
2610699448,19cyclictest0-21swapper/021:47:280
211982440,2chrt0-21swapper/022:04:370
211982440,2chrt0-21swapper/022:04:370
2610899435,9cyclictest131rcu_preempt19:37:301
2610699431,35cyclictest28686-21ssh21:37:310
2610699431,35cyclictest28686-21ssh21:37:310
179652430,3sleep217244-21/usr/sbin/munin20:17:392
179652430,3sleep217244-21/usr/sbin/munin20:17:392
42302390,2sleep30-21swapper/321:46:113
42302390,2sleep30-21swapper/321:46:113
2611099381,26cyclictest14033-21ssh21:57:292
2611099381,26cyclictest14033-21ssh21:57:292
2610699386,26cyclictest38650irq/55-eth021:22:290
2610699386,26cyclictest38650irq/55-eth021:22:290
227612380,3sleep30-21swapper/322:07:013
227612380,3sleep30-21swapper/322:07:013
5592370,1sleep0620-21/usr/sbin/munin19:32:360
5592370,1sleep0620-21/usr/sbin/munin19:32:360
269012370,8sleep012-21ksoftirqd/021:34:590
269012370,8sleep012-21ksoftirqd/021:34:590
2611399372,27cyclictest3892-21taskset19:42:313
2611399372,27cyclictest3892-21taskset19:42:313
26108993622,10cyclictest4351-21sh22:22:321
26108993622,10cyclictest4351-21sh22:22:321
176892360,3sleep30-21swapper/321:24:133
176892360,3sleep30-21swapper/321:24:133
152532360,3sleep215273-21sed21:22:232
152532360,3sleep215273-21sed21:22:232
310802350,3sleep10-21swapper/120:52:351
308642350,3sleep30-21swapper/320:52:333
2610899358,19cyclictest21-21ksoftirqd/120:27:301
2610899358,19cyclictest21-21ksoftirqd/120:27:301
2610699354,24cyclictest10466-21ssh21:17:280
2610699354,24cyclictest10466-21ssh21:17:280
32202340,2sleep23233-21ssh21:44:302
32202340,2sleep23233-21ssh21:44:302
2610899341,28cyclictest15381-21seq20:12:311
74172330,2sleep17435-21ssh21:49:161
74172330,2sleep17435-21ssh21:49:161
2611099332,26cyclictest4352-21ssh22:22:322
2611099332,26cyclictest4352-21ssh22:22:322
26108993214,14cyclictest21-21ksoftirqd/121:17:241
226702320,2sleep19830-21kworker/1:121:30:051
226702320,2sleep19830-21kworker/1:121:30:051
26108993115,7cyclictest21-21ksoftirqd/121:07:291
26108993115,7cyclictest21-21ksoftirqd/121:07:291
34402300,3sleep20-21swapper/221:05:222
34402300,3sleep20-21swapper/221:05:222
283892300,3sleep20-21swapper/222:12:392
283892300,3sleep20-21swapper/222:12:392
2611099305,7cyclictest27-21ksoftirqd/219:17:312
2611099305,7cyclictest27-21ksoftirqd/219:17:312
26110993016,9cyclictest27-21ksoftirqd/220:47:292
26110993016,9cyclictest27-21ksoftirqd/220:47:292
10952300,2sleep01100-21sed20:57:440
10952300,2sleep01100-21sed20:57:440
2611399291,21cyclictest0-21swapper/321:47:283
2611399291,21cyclictest0-21swapper/321:47:283
2611099296,3cyclictest131rcu_preempt22:17:462
2611099296,3cyclictest131rcu_preempt22:17:462
26106992920,5cyclictest0-21swapper/020:32:300
26106992920,5cyclictest0-21swapper/020:32:300
246742290,3sleep30-21swapper/320:37:173
246742290,3sleep30-21swapper/320:37:173
150342290,2sleep115033-21apt-config21:22:171
150342290,2sleep115033-21apt-config21:22:171
26110992821,5cyclictest261rcuc/219:57:442
26110992821,5cyclictest261rcuc/219:57:442
2610699288,16cyclictest0-21swapper/022:07:310
2610699288,16cyclictest0-21swapper/022:07:310
26106992823,3cyclictest9416-1kworker/0:0H21:02:430
26106992823,3cyclictest9416-1kworker/0:0H21:02:430
2610699282,17cyclictest131rcu_preempt19:17:310
2610699282,17cyclictest131rcu_preempt19:17:310
63512270,2sleep20-21swapper/219:47:362
63512270,2sleep20-21swapper/219:47:362
2611099274,17cyclictest5851-21ssh21:12:292
2611099274,17cyclictest5851-21ssh21:12:292
2611099273,18cyclictest24331-21ssh21:32:292
2611099273,18cyclictest24331-21ssh21:32:292
2610899271,17cyclictest732-21chrt21:42:311
2610899271,17cyclictest732-21chrt21:42:311
2610899270,21cyclictest0-21swapper/122:12:281
2610899270,21cyclictest0-21swapper/122:12:281
37132260,2sleep30-21swapper/322:21:563
37132260,2sleep30-21swapper/322:21:563
2610699261,19cyclictest0-21swapper/021:12:290
2610699261,19cyclictest0-21swapper/021:12:290
2611099259,2cyclictest131rcu_preempt19:42:442
2611099259,2cyclictest131rcu_preempt19:42:442
2611099259,11cyclictest27-21ksoftirqd/220:42:302
26110992512,9cyclictest27-21ksoftirqd/221:27:282
26110992512,9cyclictest27-21ksoftirqd/221:27:282
26106992519,4cyclictest9416-1kworker/0:0H19:37:440
84552240,4sleep30-21swapper/319:52:403
84552240,4sleep30-21swapper/319:52:403
26110992416,6cyclictest27-21ksoftirqd/221:07:372
26110992416,6cyclictest27-21ksoftirqd/221:07:372
247992246,11sleep20-21swapper/219:12:252
247992246,11sleep20-21swapper/219:12:252
114882240,3chrt0-21swapper/321:17:413
114882240,3chrt0-21swapper/321:17:413
102362240,3sleep19984-21apt-get21:17:191
2611099232,9cyclictest27-21ksoftirqd/220:52:432
26110992310,3cyclictest131rcu_preempt19:37:332
2610899236,11cyclictest131rcu_preempt20:02:311
2610899236,11cyclictest131rcu_preempt20:02:311
2610899231,17cyclictest6887-21snmpd21:32:291
2610899231,17cyclictest6887-21snmpd21:32:291
2610699231,16cyclictest3898-21chrt19:42:320
2610699231,16cyclictest3898-21chrt19:42:320
26106992310,4cyclictest131rcu_preempt19:27:410
26106992310,4cyclictest131rcu_preempt19:27:410
248042230,4sleep10-21swapper/119:12:271
248042230,4sleep10-21swapper/119:12:271
173772230,3sleep30-21swapper/320:17:323
173772230,3sleep30-21swapper/320:17:323
14522230,3chrt0-21swapper/021:42:380
14522230,3chrt0-21swapper/021:42:380
290362220,2sleep30-21swapper/322:12:523
290362220,2sleep30-21swapper/322:12:523
26110992214,6cyclictest261rcuc/219:52:432
26110992214,6cyclictest261rcuc/219:52:432
2611099221,18cyclictest15603-21cut21:22:322
2611099221,18cyclictest15603-21cut21:22:322
2611099221,18cyclictest14520-21ls20:07:442
2611099221,18cyclictest14520-21ls20:07:442
2610899221,6cyclictest131rcu_preempt19:42:441
2610899221,6cyclictest131rcu_preempt19:42:441
2610699224,9cyclictest131rcu_preempt20:42:300
2610699220,11cyclictest25811-21find20:37:410
2610699220,11cyclictest25811-21find20:37:410
2611399213,12cyclictest0-21swapper/320:02:323
2611399213,12cyclictest0-21swapper/320:02:323
2611099214,6cyclictest27-21ksoftirqd/221:48:012
2611099214,6cyclictest27-21ksoftirqd/221:48:012
2611099211,18cyclictest19258-21ls20:22:302
2610899211,18cyclictest32677-21cut19:32:321
2610899211,18cyclictest32677-21cut19:32:321
2610899211,14cyclictest19009-21cut22:02:351
2610899211,14cyclictest19009-21cut22:02:351
2610699217,10cyclictest8832-21latency_hist22:27:240
2610699211,17cyclictest32368-21uniq22:17:340
2610699211,17cyclictest32368-21uniq22:17:340
26106992110,4cyclictest131rcu_preempt19:52:440
26106992110,4cyclictest131rcu_preempt19:52:440
26110992010,8cyclictest261rcuc/222:02:312
26110992010,8cyclictest261rcuc/222:02:312
26108992013,5cyclictest31627-21unixbench-2d19:27:421
26108992013,5cyclictest31627-21unixbench-2d19:27:421
26106992011,7cyclictest0-21swapper/022:22:300
2610699200,17cyclictest19695-21grep20:22:350
292472190,3sleep20-21swapper/219:22:372
292472190,3sleep20-21swapper/219:22:372
2611399192,11cyclictest0-21swapper/319:37:313
2611399192,11cyclictest0-21swapper/319:22:323
2611399192,11cyclictest0-21swapper/319:22:323
2611099197,9cyclictest25133-21fschecks_time20:37:322
2611099197,9cyclictest25133-21fschecks_time20:37:322
2611099196,3cyclictest131rcu_preempt19:32:282
2611099196,3cyclictest131rcu_preempt19:32:282
2611099192,15cyclictest15375-21apt-get20:12:302
26110991911,6cyclictest23560-21awk20:32:362
26110991911,6cyclictest23560-21awk20:32:362
2610899191,14cyclictest22941-21apt-get20:32:281
2610899191,14cyclictest22941-21apt-get20:32:281
2610699196,11cyclictest12-21ksoftirqd/021:52:340
2610699196,11cyclictest12-21ksoftirqd/021:52:340
2610699191,15cyclictest0-21swapper/019:22:320
2610699191,15cyclictest0-21swapper/019:22:320
2610699191,10cyclictest6887-21snmpd20:47:320
2610699191,10cyclictest6887-21snmpd20:47:320
2610699191,10cyclictest22262-21grep20:27:430
2610699191,10cyclictest22262-21grep20:27:430
2611399183,11cyclictest0-21swapper/320:27:303
2611399183,11cyclictest0-21swapper/320:27:303
2611399182,11cyclictest0-21swapper/321:52:333
2611399182,11cyclictest0-21swapper/321:52:333
2611399182,11cyclictest0-21swapper/321:07:313
2611399182,11cyclictest0-21swapper/321:07:313
2611399182,11cyclictest0-21swapper/321:02:323
2611399182,11cyclictest0-21swapper/321:02:323
2611399181,11cyclictest0-21swapper/322:22:343
2611399181,11cyclictest0-21swapper/322:22:343
2611099182,13cyclictest21069-21apt-get20:27:292
2611099182,13cyclictest21069-21apt-get20:27:292
26110991813,3cyclictest131rcu_preempt20:02:462
26110991813,3cyclictest131rcu_preempt20:02:462
2610899187,3cyclictest131rcu_preempt22:07:521
2610899187,3cyclictest131rcu_preempt22:07:521
2610899183,12cyclictest28567-21latency_hist19:22:211
2610899183,12cyclictest28567-21latency_hist19:22:211
2610899181,14cyclictest15823-21rm21:22:341
2610899181,14cyclictest15823-21rm21:22:341
26108991810,6cyclictest9567-21apt-get19:57:291
26108991810,6cyclictest9567-21apt-get19:57:291
2611399174,9cyclictest0-21swapper/319:47:433
2611399174,9cyclictest0-21swapper/319:47:433
2611399173,10cyclictest0-21swapper/320:37:303
2611399173,10cyclictest0-21swapper/320:37:303
2611399173,10cyclictest0-21swapper/319:17:323
2611399173,10cyclictest0-21swapper/319:17:323
2611399172,11cyclictest0-21swapper/320:12:323
2610899179,6cyclictest29137-21grep19:22:361
2610899179,6cyclictest29137-21grep19:22:361
2610899178,7cyclictest25176-21fw_packets20:37:321
2610899178,7cyclictest25176-21fw_packets20:37:321
2610899175,9cyclictest21-21ksoftirqd/120:17:311
2610899175,9cyclictest21-21ksoftirqd/120:17:311
2610899174,4cyclictest131rcu_preempt20:07:331
2610899174,4cyclictest131rcu_preempt20:07:331
2610899174,11cyclictest6882-21grep19:47:441
2610899174,11cyclictest6882-21grep19:47:441
2610899172,12cyclictest27449-21ntp_states20:42:391
26108991711,4cyclictest0-21swapper/119:52:441
26108991711,4cyclictest0-21swapper/119:52:441
2610699173,11cyclictest26105-21cyclictest20:12:310
2610699171,14cyclictest13557-21grep20:07:330
2610699171,14cyclictest13557-21grep20:07:330
26106991710,5cyclictest17964-21proc_pri20:17:390
26106991710,5cyclictest17964-21proc_pri20:17:390
2611399163,11cyclictest0-21swapper/320:22:303
2611399162,10cyclictest0-21swapper/319:57:313
2611399162,10cyclictest0-21swapper/319:57:313
2611399161,10cyclictest0-21swapper/321:32:313
2611399161,10cyclictest0-21swapper/321:32:313
2610899161,13cyclictest28817-21forks21:37:321
2610899161,13cyclictest28817-21forks21:37:321
2610899161,12cyclictest19402-21fschecks_time20:22:321
26108991610,4cyclictest32422-21apt-get20:57:291
26108991610,4cyclictest32422-21apt-get20:57:291
26106991610,4cyclictest3978-21df21:07:320
26106991610,4cyclictest3978-21df21:07:320
2611399152,11cyclictest0-21swapper/321:37:313
2611399152,11cyclictest0-21swapper/321:37:313
2611399152,11cyclictest0-21swapper/319:27:293
2611399152,11cyclictest0-21swapper/319:27:293
2611399152,10cyclictest0-21swapper/320:57:313
2611399152,10cyclictest0-21swapper/320:57:313
2611399151,9cyclictest0-21swapper/322:02:153
2611399151,9cyclictest0-21swapper/322:02:153
2611399151,9cyclictest0-21swapper/320:07:343
2611399151,9cyclictest0-21swapper/320:07:343
2611399122,8cyclictest0-21swapper/320:42:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional