You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-20 - 19:07

ARM Freescale i.MX6 Quad @996 MHz, Linux 5.16.2-rt19 (Profile)

Latency plot of system in rack #b, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100, highest latencies:
System rackbslot7 (updated Mon Mar 20, 2023 12:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3238129714,55sleep032474-21grep06:59:100
528999232,34cyclictest13111-21apt-key10:58:240
3169429227,32sleep10-21swapper/106:58:501
528998861,18cyclictest13713-21sendmail09:13:240
528998861,18cyclictest13713-21sendmail09:13:240
528998730,19cyclictest20077-21ssh11:08:520
528998730,19cyclictest20077-21ssh11:08:520
528998725,23cyclictest9417-21/usr/sbin/munin09:58:470
535998633,20cyclictest18952-21ssh11:07:401
535998532,17cyclictest22047-21irqstats10:19:041
543998350,10cyclictest141rcu_preempt10:03:242
543998262,13cyclictest13700-21munin-plugin-st09:13:242
543998262,13cyclictest13700-21munin-plugin-st09:13:242
543998234,7cyclictest141rcu_preempt11:13:562
543998234,7cyclictest141rcu_preempt11:13:562
543998132,26cyclictest0-21swapper/210:58:112
535998160,13cyclictest25753-21kworker/u8:307:43:241
535998153,20cyclictest28602-21modprobe08:28:241
535998153,20cyclictest28602-21modprobe08:28:241
528998132,27cyclictest7537-21diskmemload10:35:010
528998128,20cyclictest30695-21sort08:33:450
528998128,20cyclictest30695-21sort08:33:450
528998029,15cyclictest0-21swapper/012:04:290
528998024,28cyclictest12920-21sh11:50:100
528998024,28cyclictest12920-21sh11:50:100
528998024,27cyclictest7537-21diskmemload10:12:040
528998022,32cyclictest10824-21ssh11:47:440
3208828027,25sleep30-21swapper/306:59:053
543997911,62cyclictest13504-21ssh10:58:382
535997945,25cyclictest14213-21sed11:53:251
535997945,25cyclictest14213-21sed11:53:251
535997926,22cyclictest6485-21/usr/sbin/munin07:18:491
528997932,17cyclictest18644-21fschecks_count10:13:490
543997818,27cyclictest21676-21ssh10:18:422
535997827,19cyclictest24817-21df10:23:461
528997825,28cyclictest1921-21ssh11:33:150
528997825,19cyclictest27182-21ssh10:28:060
528997824,29cyclictest7537-21diskmemload12:14:210
528997822,19cyclictest28714-21sh09:37:300
535997727,18cyclictest7537-21diskmemload09:43:511
535997727,18cyclictest7537-21diskmemload09:43:511
528997727,12cyclictest14029-21ssh10:05:480
528997727,12cyclictest14029-21ssh10:05:480
543997627,25cyclictest0-21swapper/210:06:342
543997627,25cyclictest0-21swapper/210:06:342
535997628,18cyclictest20507-21sh12:03:381
535997625,19cyclictest15092-21ntp_states11:53:581
528997628,20cyclictest0-21swapper/010:19:480
528997626,28cyclictest26773-21sh11:19:070
528997624,21cyclictest19059-21/usr/sbin/munin07:59:290
528997619,33cyclictest0-21swapper/011:34:090
543997526,27cyclictest0-21swapper/208:58:492
535997522,17cyclictest28824-21ssh12:17:011
528997526,17cyclictest16537-21rm11:56:390
528997525,18cyclictest24251-21ssh11:15:280
528997525,18cyclictest24251-21ssh11:15:280
528997523,28cyclictest7537-21diskmemload11:04:230
528997523,21cyclictest4798-21taskset09:50:460
528997521,19cyclictest31882-21sh09:42:490
528997520,19cyclictest0-21swapper/010:58:330
543997441,12cyclictest141rcu_preempt10:41:082
528997434,19cyclictest0-21swapper/009:55:050
528997429,29cyclictest0-21swapper/010:46:330
528997428,11cyclictest7525-21ssh10:48:490
528997425,19cyclictest11425-21grep07:33:510
528997425,18cyclictest21309-21/usr/sbin/munin08:03:570
528997423,26cyclictest32431-21sh09:43:390
528997423,26cyclictest32431-21sh09:43:390
528997423,21cyclictest28880-21taskset08:28:370
543997350,16cyclictest10029-21sendmail10:53:242
543997345,17cyclictest28949-21runrttasks11:23:532
543997345,17cyclictest28949-21runrttasks11:23:532
535997346,21cyclictest5321-21sed10:44:041
535997346,19cyclictest11994-21sed09:09:051
535997346,19cyclictest11994-21sed09:09:051
528997326,18cyclictest28827-21rm10:29:200
528997326,16cyclictest9556-21rm09:05:350
528997325,17cyclictest6729-21sh08:58:590
528997324,18cyclictest32142-21taskset08:38:430
528997324,15cyclictest0-21swapper/011:27:100
528997324,15cyclictest0-21swapper/011:27:100
528997323,21cyclictest22338-21taskset09:26:520
528997322,16cyclictest397-21runrttasks10:42:210
528997321,27cyclictest2899-21/usr/sbin/munin08:49:000
535997226,19cyclictest397-21runrttasks08:43:001
535997226,17cyclictest7537-21diskmemload12:27:331
528997224,18cyclictest23447-21ssh09:28:480
528997224,17cyclictest2172-21taskset12:26:140
528997223,41cyclictest20318-21cat12:03:260
535997148,16cyclictest8038-21expr09:03:421
535997127,17cyclictest7537-21diskmemload10:00:281
528997125,18cyclictest5835-21rm12:32:570
528997125,16cyclictest15448-21ssh09:14:500
528997124,19cyclictest5645-21ssh11:38:520
528997123,19cyclictest7537-21diskmemload09:20:520
560997048,13cyclictest26711-21grep11:19:013
543997049,8cyclictest141rcu_preempt12:07:502
543997048,13cyclictest24309-21runrttasks09:29:042
543996948,13cyclictest19488-21head10:14:032
543996948,12cyclictest0-21swapper/211:49:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional