You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-11-28 - 13:07

ARM Freescale i.MX6 Quad @996 MHz, Linux 5.16.2-rt19 (Profile)

Latency plot of system in rack #b, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7 (updated Mon Nov 28, 2022 00:44:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2716829416,50sleep227175-21latencyplot19:07:542
2701929117,47sleep327062-21awk19:07:513
27239998939,19cyclictest32739-21chrt19:23:041
27228998529,21cyclictest6575-21basename19:42:500
27228998227,19cyclictest32741-21taskset19:23:060
27228998147,17cyclictest6409-21taskset21:20:410
27239998027,21cyclictest25953-21taskset22:20:421
27250997933,7cyclictest141rcu_preempt20:58:222
2725099793,33cyclictest33-21ksoftirqd/221:23:112
27250997932,8cyclictest141rcu_preempt19:58:222
27228997943,27cyclictest31184-21/usr/sbin/munin20:58:180
27228997929,19cyclictest8454-21taskset19:48:080
2725099787,43cyclictest5325-21cstates19:38:132
27250997811,41cyclictest5437-21ls22:58:132
27239997829,19cyclictest21046-21chrt22:05:101
27228997831,18cyclictest12541-21awk23:18:260
27228997827,19cyclictest20595-21sed20:23:260
27228997825,19cyclictest5344-21systemd-run00:37:510
27250997632,7cyclictest141rcu_preempt22:53:232
27228997627,20cyclictest8096-21seq23:05:070
27228997625,29cyclictest29090-21taskset20:50:240
27250997535,13cyclictest141rcu_preempt21:12:532
27250997515,21cyclictest11944-21cpu23:18:112
27239997535,14cyclictest0-21swapper/120:05:501
27228997526,18cyclictest396-21runrttasks22:33:160
27228997525,18cyclictest6431-21runrttasks22:59:210
27228997525,18cyclictest0-21swapper/023:33:060
27250997427,25cyclictest0-21swapper/223:48:132
27239997448,18cyclictest4957-21apt-key19:37:521
27239997448,18cyclictest4957-21apt-key19:37:521
27228997430,36cyclictest29677-21grep00:12:520
27228997430,36cyclictest29677-21grep00:12:520
27228997429,17cyclictest19937-21apt-get22:03:120
27228997427,13cyclictest0-21swapper/023:23:170
27228997425,19cyclictest27423-21seq22:23:480
27228997422,30cyclictest15910-21runrttasks20:08:310
27250997343,22cyclictest1-21systemd21:22:512
27250997338,8cyclictest141rcu_preempt00:02:502
27250997332,19cyclictest141rcu_preempt23:03:102
27228997330,35cyclictest24475-21sendmail-msp20:37:500
27228997327,18cyclictest8011-21seq21:24:360
27228997326,19cyclictest32392-21taskset22:40:140
27228997324,17cyclictest0-21swapper/019:34:300
27228997324,17cyclictest0-21swapper/019:34:300
27228997323,21cyclictest12871-21taskset21:39:380
27228997318,21cyclictest25162-21latency20:38:250
2725099726,46cyclictest3370-21kworker/u8:000:23:102
27250997246,16cyclictest18094-21kworker/u8:223:37:502
27250997232,19cyclictest141rcu_preempt20:53:302
27250997228,18cyclictest0-21swapper/221:13:022
27250997228,18cyclictest0-21swapper/221:13:022
27250997227,9cyclictest0-21swapper/200:13:102
27239997249,15cyclictest16812-21/usr/sbin/munin20:13:151
27239997240,23cyclictest24582-21munin-run23:57:501
27239997225,18cyclictest32337-21taskset22:39:301
27239997223,17cyclictest1507-21taskset22:44:371
27228997251,8cyclictest13409-21apt-get21:43:090
27228997231,14cyclictest2777-21sed19:28:290
27228997224,21cyclictest3067-21taskset21:09:350
27228997223,20cyclictest17973-21taskset21:57:320
27250997142,13cyclictest15457-21ntpq20:08:222
27239997155,10cyclictest6600-21idleruntime-cro21:22:501
27239997139,22cyclictest3938-21taskset00:33:021
27239997123,20cyclictest27990-21taskset22:27:531
27228997131,33cyclictest24542-21idleruntime-cro22:17:510
27228997131,33cyclictest24542-21idleruntime-cro22:17:510
27228997125,18cyclictest19347-21seq21:59:030
27228997125,16cyclictest22792-21taskset22:11:580
27228997124,20cyclictest4618-21taskset21:13:520
27228997124,20cyclictest4618-21taskset21:13:520
27228997124,17cyclictest1-21systemd23:47:520
27228997122,18cyclictest30877-21runrttasks20:57:410
27228997121,17cyclictest0-21swapper/020:13:140
27262997051,12cyclictest27026-21kworker/u8:220:57:513
27250997035,10cyclictest141rcu_preempt20:13:092
27250997032,14cyclictest141rcu_preempt00:37:522
27250997030,8cyclictest141rcu_preempt22:02:532
27239997045,16cyclictest13853-21/usr/sbin/munin21:43:221
27239997045,16cyclictest12140-21/usr/sbin/munin19:58:181
27228997044,17cyclictest11693-21apt-get19:58:030
27228997029,32cyclictest8530-21/usr/sbin/munin21:28:030
27228997028,35cyclictest0-21swapper/021:48:140
27228997028,35cyclictest0-21swapper/021:48:140
27228997028,34cyclictest24755-21date23:57:550
27228997026,17cyclictest0-21swapper/000:17:100
27228997025,16cyclictest0-21swapper/022:48:120
27228997024,19cyclictest19296-21taskset20:20:130
27228997020,21cyclictest18375-21/usr/sbin/munin23:38:170
27250996934,15cyclictest141rcu_preempt22:22:512
27250996924,21cyclictest141rcu_preempt21:51:272
27250996924,21cyclictest141rcu_preempt21:51:272
27250996918,26cyclictest0-21swapper/219:52:532
27239996947,14cyclictest31644-21memory20:58:171
27239996946,16cyclictest30426-21unixbench_singl19:13:271
27239996944,16cyclictest6314-21unixbench_multi22:58:431
27228996926,15cyclictest26321-21taskset20:43:060
27228996925,17cyclictest22649-21taskset20:30:470
27228996923,16cyclictest0-21swapper/023:59:360
27228996922,17cyclictest13295-21/usr/sbin/munin20:03:240
27262996823,15cyclictest0-21swapper/322:01:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional