You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-09-17 - 21:09

Intel(R) Atom(TM) CPU E640 @ 1.00GHz, Linux 3.18.11-rt7 (Profile)

Latency plot of system in rack #9, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack9slot4.osadl.org (updated Fri Sep 17, 2021 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
211459912749cyclictest20751-21wc07:24:320
211459912749cyclictest20751-21wc07:24:320
211459912141cyclictest20428-21sort07:09:420
211459911846cyclictest2929-21ssh07:45:080
211459911745cyclictest9095-21ssh09:00:200
211459911745cyclictest2399-21fstime06:40:040
211459911744cyclictest23976-21latency_hist06:14:390
211459911543cyclictest25902-21expr07:26:530
211459911542cyclictest28521-21if_err_eth108:35:090
211459911342cyclictest26735-21grep06:20:210
211459911341cyclictest1000-21fschecks_count08:45:040
211459911240cyclictest541-21latency_hist08:44:430
211459911139cyclictest31052-21fschecks_time06:30:090
211459911044cyclictest1133-21latency_hist09:49:450
211459910943cyclictest22038-21ssh08:22:280
211459910942cyclictest6549-21sort06:51:550
211459910941cyclictest23431-21cat08:25:100
211459910937cyclictest29424-21chrt07:34:270
211459910837cyclictest315-21runrttasks09:16:550
211459910837cyclictest315-21runrttasks09:16:550
211459910743cyclictest2425-21diskmemload06:39:340
211459910740cyclictest20697-21unixbench_singl06:45:300
211459910544cyclictest12006-21sh08:02:580
211459910535cyclictest22129-21unixbench_singl06:05:220
211459910447cyclictest18251-21df07:05:010
211459910352cyclictest5889-21ssh07:50:290
211459910237cyclictest74-21mmcqd/006:56:030
211459910138cyclictest11879-21aten_r9power_vo05:34:510
211459910137cyclictest14114-21needreboot05:40:120
211459910036cyclictest74-21mmcqd/008:30:070
211459910033cyclictest74-21mmcqd/007:59:430
21145999936cyclictest19556-21ls09:20:300
21145999932cyclictest30568-21sh09:43:050
21145999813cyclictest0-21swapper/004:55:520
21145999746cyclictest23410-21ssh09:29:310
21145999727cyclictest3054-21latency_hist08:49:440
21145999636cyclictest17579-21fstime07:03:500
21145999544cyclictest13389-21memory08:05:130
21145999443cyclictest10836-21diskmemload07:18:230
21145999410cyclictest0-21swapper/009:10:420
21145999338cyclictest12723-21sh09:08:000
21145999255cyclictest809-21/usr/sbin/munin07:40:230
21145999235cyclictest29999-21sync06:28:120
21145999227cyclictest28425-21latency_hist09:39:450
21145999133cyclictest16760-21kworker/u4:105:10:110
21145998975cyclictest7473-21ssh08:57:290
21145998947cyclictest29735-21opkg04:45:170
21145998935cyclictest23823-21runrttasks06:12:210
2114599888cyclictest0-21swapper/007:35:160
21145998838cyclictest18009-21aten_r9power_po05:54:540
21145998749cyclictest25740-21ssh09:33:520
21145998749cyclictest16602-21ssh08:11:390
21145998647cyclictest18592-21ssh08:15:170
21145998645cyclictest23353-21runrttasks04:25:070
21145998543cyclictest31249-21ntp_states04:50:200
21145998432cyclictest74-21mmcqd/005:05:120
21145998343cyclictest6654-21sshd05:15:180
21145998335cyclictest27315-21/usr/sbin/munin04:39:550
21145998230cyclictest74-21mmcqd/005:25:200
2114699818cyclictest0-21swapper/107:22:031
2114699818cyclictest0-21swapper/107:22:031
2114699808cyclictest0-21swapper/108:35:061
2114699803cyclictest19464-21fstime07:06:431
21145998030cyclictest74-21mmcqd/006:00:510
2114699799cyclictest0-21swapper/108:44:501
2114699795cyclictest23206-21od07:25:331
21145997938cyclictest15497-21/usr/sbin/munin05:45:060
21145997913cyclictest0-21swapper/004:20:470
2114699785cyclictest315-21runrttasks06:30:021
2114699785cyclictest31272-21basename09:45:011
2114699784cyclictest11090-21multi.sh06:54:171
2114699783cyclictest25325-21/usr/sbin/munin08:29:561
2114699783cyclictest21898-21/usr/sbin/munin06:05:171
2114699783cyclictest1994-21fstime06:37:401
21145997838cyclictest25034-21needreboot04:30:100
2114699778cyclictest0-21swapper/106:45:491
2114699774cyclictest17999-21fschecks_count08:15:011
2114699774cyclictest12983-21expr06:55:081
2114699773cyclictest27920-21/usr/sbin/munin07:30:151
21146997711cyclictest0-21swapper/107:10:051
2114599774cyclictest1007-21/usr/sbin/munin05:00:130
21145997738cyclictest25774-21/usr/sbin/munin04:34:510
21145997713cyclictest0-21swapper/005:20:490
2114699765cyclictest2791-21cpuspeed06:39:571
2114699765cyclictest23275-21df07:14:591
2114699765cyclictest18196-21df_inode05:54:581
2114699764cyclictest29732-21/usr/sbin/munin04:45:171
2114699764cyclictest28107-21/usr/sbin/munin06:25:091
21146997630cyclictest17133-21execl07:02:231
2114699763cyclictest21365-21/usr/sbin/munin08:20:311
21145997637cyclictest16516-21cpu05:49:550
21145997627cyclictest74-21mmcqd/005:34:110
2114699754cyclictest6524-21/usr/sbin/munin08:55:161
2114699754cyclictest5249-21ssh07:50:121
2114699754cyclictest30833-21df_inode08:40:011
2114699754cyclictest10759-21sort05:30:001
2114699753cyclictest24838-21/usr/sbin/munin04:30:031
2114699753cyclictest13226-21/usr/sbin/munin08:05:091
21146997529cyclictest8309-21grep07:55:171
21146997528cyclictest95-21systemd-journal06:01:421
21146997513cyclictest0-21swapper/104:35:121
2114699747cyclictest0-21swapper/107:59:571
2114699744cyclictest24944-21ntp_states06:15:191
2114699743cyclictest2344-21/usr/sbin/munin07:44:551
2114699743cyclictest23073-21/usr/sbin/munin08:25:011
2114699743cyclictest16736-21uniq05:50:021
2114699743cyclictest13620-21chrt09:10:011
2114699739cyclictest0-21swapper/104:20:101
2114699735cyclictest29928-21ssh07:35:001
2114699735cyclictest11103-21sh09:05:051
2114699734cyclictest9087-21missed_timers09:00:201
2114699734cyclictest7429-21diskstats05:19:591
2114699734cyclictest32482-21rm07:40:001
2114699734cyclictest27048-21ssh09:35:301
2114699734cyclictest23526-21/usr/sbin/munin06:10:171
2114699734cyclictest21144-21/usr/sbin/munin09:24:571
2114699733cyclictest315-21runrttasks04:55:091
2114699733cyclictest29269-21/usr/sbin/munin09:40:121
2114699733cyclictest23682-21/usr/sbin/munin04:25:201
2114699733cyclictest19264-21missed_timers09:20:201
2114699733cyclictest16100-21/usr/sbin/munin08:10:291
2114699729cyclictest0-21swapper/109:30:021
2114699728cyclictest0-21swapper/108:50:141
2114699724cyclictest8723-21aten_r9power_cu05:24:531
2114699724cyclictest31042-21irqstats04:50:101
2114699724cyclictest25801-21ssh06:19:531
2114699724cyclictest16624-21sed09:15:171
2114699724cyclictest16624-21sed09:15:171
2114699723cyclictest3426-21/usr/sbin/munin05:05:151
2114699723cyclictest2433-21latency_hist05:04:371
21146997210cyclictest18119-21whetstone-doubl05:35:241
6950710irq/18-mmc016760-21kworker/u4:104:15:010
2114699713cyclictest4151-21/usr/sbin/munin05:09:501
2114699713cyclictest15776-21processes05:45:181
2114699713cyclictest13873-21if_err_can005:40:051
2114699695cyclictest18119-21whetstone-doubl04:40:001
2114699693cyclictest6223-21/usr/sbin/munin05:15:031
1699680watchdog/119752-21egrep04:14:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional