You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-09-17 - 15:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

Intel(R) Core(TM) i3-2310E CPU @ 2.10GHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack8slot2s.osadl.org (updated Fri Sep 17, 2021 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1497421110,0sleep20-21swapper/209:13:062
19634211045,32sleep00-21swapper/007:06:340
1003421100,0sleep10-21swapper/109:37:461
1213921070,3sleep012-21ksoftirqd/009:40:380
19790210541,48sleep20-21swapper/207:08:362
19774210042,46sleep30-21swapper/307:08:253
289252980,0sleep30-21swapper/309:26:063
20235999688,7cyclictest0-21swapper/107:14:011
20236999087,2cyclictest0-21swapper/207:14:012
1981929047,32sleep10-21swapper/107:09:001
20234998482,1cyclictest0-21swapper/007:14:010
20237995451,2cyclictest0-21swapper/307:10:493
291722400,0sleep10-21swapper/109:26:081
2023599320,6cyclictest0-21swapper/108:50:491
37262280,0sleep20-21swapper/211:29:352
302342280,0sleep30-21swapper/310:54:573
2023599280,27cyclictest0-21swapper/109:56:021
34642270,0sleep10-21swapper/112:26:591
2023699270,26cyclictest0-21swapper/208:50:492
2023499270,26cyclictest0-21swapper/008:50:490
175072260,1sleep017508-21dpkg12:40:490
2023799221,20cyclictest0-21swapper/309:56:033
2023799220,21cyclictest0-21swapper/308:41:043
239342210,1sleep20-21swapper/210:20:082
20237991814,2cyclictest7142-21ssh09:36:043
190402170,2sleep119032-21ssh09:16:171
2023499168,2cyclictest11423-21diskmemload09:51:160
276832150,1sleep10-21swapper/111:21:171
2023799154,6cyclictest0-21swapper/310:13:583
2023799152,8cyclictest23188-21sh11:16:523
2023799151,4cyclictest16487-21ssh12:39:413
2023599150,1cyclictest2522-21ssh10:00:531
249982140,0sleep00-21swapper/012:17:160
2023799145,4cyclictest0-21swapper/312:33:563
2023799145,4cyclictest0-21swapper/311:38:163
2023799142,4cyclictest7745-21ssh10:34:393
2023599145,3cyclictest0-21swapper/107:41:531
2023799139,2cyclictest23894-21cut07:16:103
2023799138,3cyclictest0-21swapper/308:19:213
2023799137,4cyclictest6631-21/usr/sbin/munin12:01:073
2023799137,4cyclictest6631-21/usr/sbin/munin12:01:073
2023799136,5cyclictest3984-21basename11:00:493
2023799135,3cyclictest0-21swapper/310:38:583
2023799135,3cyclictest0-21swapper/307:46:083
2023799134,6cyclictest11423-21diskmemload11:46:273
2023799134,4cyclictest0-21swapper/312:15:163
2023799133,8cyclictest0-21swapper/308:02:473
2023799132,9cyclictest27430-21cut11:21:143
2023799132,8cyclictest13239-21diskstats09:41:123
2023799132,6cyclictest3919-21ssh11:58:433
2023799132,3cyclictest0-21swapper/312:21:023
2023799132,3cyclictest0-21swapper/309:16:103
2023799131,9cyclictest75-21kswapd011:05:593
2023799131,4cyclictest6150-21ssh09:35:023
2023799130,5cyclictest17344-21ntpq08:11:143
2023599134,4cyclictest25905-21ssh11:20:381
2023599134,2cyclictest41750irq/34-enp3s0-t11:11:111
2023499135,7cyclictest22538-21perf09:20:480
2023499133,2cyclictest11423-21diskmemload11:51:190
238202120,1sleep10-21swapper/108:26:071
2023799127,3cyclictest16528-21turbostat.cron12:10:483
2023799125,6cyclictest0-21swapper/311:11:143
2023799124,6cyclictest23591-21grep09:21:113
2023799124,6cyclictest15989-21cron08:10:493
2023799124,3cyclictest0-21swapper/312:15:553
2023799124,3cyclictest0-21swapper/308:30:543
2023799123,7cyclictest27577-21ssh10:22:313
2023799123,7cyclictest11423-21diskmemload11:31:173
2023799123,2cyclictest0-21swapper/309:02:153
2023799123,2cyclictest0-21swapper/307:53:443
2023799122,8cyclictest15399-21gltestperf10:41:173
2023799122,3cyclictest27897-21ssh09:54:133
2023799122,2cyclictest0-21swapper/310:16:043
2023799121,6cyclictest11139-21taskset07:57:593
2023799120,11cyclictest1850-21ssh11:26:573
2023699126,4cyclictest10160-21sh12:04:392
2023699126,4cyclictest10160-21sh12:04:392
2023699122,2cyclictest141rcu_preempt09:42:042
2023699121,9cyclictest27650-21latency_hist07:25:482
2023699121,9cyclictest16298-21grep11:41:082
2023699121,2cyclictest141rcu_preempt11:49:162
2023699121,2cyclictest141rcu_preempt11:39:172
2023699121,10cyclictest22497-21cron09:20:482
2023699120,5cyclictest23519-21perf09:50:482
2023699120,2cyclictest0-21swapper/210:11:382
2023599127,3cyclictest11423-21diskmemload11:34:061
2023599126,4cyclictest9753-21head10:36:061
2023599126,3cyclictest2158-21grep09:31:081
2023599125,5cyclictest10324-21cat07:56:111
2023599124,6cyclictest0-21swapper/111:47:571
2023599124,2cyclictest0-21swapper/109:14:401
2023599123,8cyclictest0-21swapper/110:14:091
2023599123,4cyclictest0-21swapper/108:56:551
2023599122,9cyclictest41750irq/34-enp3s0-t10:06:031
2023599122,5cyclictest1197-21ssh11:56:101
2023599121,6cyclictest0-21swapper/111:08:051
2023499127,4cyclictest6338-21df_inode12:01:050
2023499127,4cyclictest6338-21df_inode12:01:050
2023499126,4cyclictest9762-21grep10:36:060
2023499126,4cyclictest589-21snmpd09:46:350
2023499126,4cyclictest5243-21basename11:01:200
2023499126,4cyclictest32580-21aten2_r8power_e07:36:050
2023499126,4cyclictest28158-21cpu12:21:020
2023499126,4cyclictest22301-21sendmail_mailqu11:16:150
2023499126,4cyclictest1703-21df_inode12:26:160
2023499126,4cyclictest10202-21cut07:56:100
2023799116,3cyclictest6097-21timerandwakeup11:01:283
2023799116,3cyclictest31060-21cut10:26:083
2023799116,3cyclictest11820-21sh09:11:013
2023799115,4cyclictest3810-21grep10:01:123
2023799115,4cyclictest28168-21grep07:26:053
2023799115,4cyclictest20778-21grep10:46:113
2023799115,4cyclictest19114-21smartctl09:46:123
2023799114,5cyclictest6360-21grep08:56:173
2023799114,5cyclictest4494-21perf08:55:483
2023799114,5cyclictest2822-21ls07:41:103
2023799114,5cyclictest21506-21grep08:21:043
2023799114,5cyclictest1916-21head12:26:183
2023799113,6cyclictest464-21fschecks_time08:46:083
2023799113,6cyclictest29715-21ssh11:52:143
2023799113,6cyclictest0-21swapper/307:21:013
2023799112,7cyclictest0-21swapper/309:06:173
2023799112,6cyclictest16494-21ls11:41:093
2023799112,2cyclictest0-21swapper/308:27:233
2023799110,6cyclictest0-21swapper/310:05:573
2023799110,3cyclictest27796-21chrt08:36:033
2023699118,2cyclictest996-21cut11:56:082
2023699118,2cyclictest30165-21ssh09:56:072
2023699118,2cyclictest20940-21cut10:46:122
2023699118,2cyclictest0-21swapper/209:25:202
2023699116,4cyclictest31223-21ntpq08:41:142
2023699115,4cyclictest29969-21cron10:25:482
2023699115,4cyclictest2517-21head12:26:242
2023699115,1cyclictest28-21ksoftirqd/209:51:272
2023699111,9cyclictest0-21swapper/207:16:172
2023699111,2cyclictest0-21swapper/209:35:052
2023699110,5cyclictest11410-21latency_hist09:10:492
2023599117,2cyclictest28569-21idleruntime07:26:081
2023599117,2cyclictest11423-21diskmemload10:18:401
2023599116,3cyclictest26517-21needreboot08:31:121
2023599116,3cyclictest11423-21diskmemload12:35:561
2023599116,3cyclictest11423-21diskmemload09:40:551
2023599115,4cyclictest4086-21head10:31:071
2023599115,4cyclictest22296-21timerandwakeup08:21:121
2023599115,4cyclictest16842-21head08:11:091
2023599114,5cyclictest0-21swapper/107:33:101
2023599114,3cyclictest6948-1kworker/u9:211:02:481
2023599114,3cyclictest21596-1kworker/u9:010:25:481
2023599113,6cyclictest0-21swapper/112:21:541
2023599113,2cyclictest0-21swapper/111:43:011
2023599112,7cyclictest24192-21unixbench_singl12:16:141
2023599111,5cyclictest27747-21uniq11:51:111
2023599110,9cyclictest26754-21latency10:51:101
2023599110,6cyclictest30950-21fschecks_time10:26:081
2023599110,5cyclictest2924-21taskset10:59:241
2023599110,5cyclictest24030-21wget09:51:041
2023499117,3cyclictest28998-21ntpq07:26:130
2023499117,2cyclictest8169-21acpi10:06:020
2023499116,4cyclictest6673-21aten2_r8power_c12:31:040
2023499116,4cyclictest3422-21who09:31:180
2023499116,4cyclictest30588-21expr07:31:060
2023499116,4cyclictest2853-21diskstats07:41:110
2023499116,4cyclictest25922-21awk10:51:030
2023499116,4cyclictest1417-21seq10:57:180
2023499115,4cyclictest5129-21expr08:56:060
2023499115,4cyclictest22055-21proc_pri08:21:100
2023499115,4cyclictest13939-21acpi08:06:010
2023499115,4cyclictest13755-21sh11:09:090
2023499112,5cyclictest141rcu_preempt10:46:090
135792110,3sleep012-21ksoftirqd/009:41:140
2023799103,5cyclictest32591-21/usr/sbin/munin07:36:053
2023799103,5cyclictest30217-21taskset07:31:053
2023699107,2cyclictest5960-21ssh10:32:122
2023699107,2cyclictest21154-21cpuspeed_turbos08:21:022
2023699107,2cyclictest11423-21diskmemload10:56:042
2023699106,2cyclictest26659-21head08:31:152
2023699105,4cyclictest7695-21tune2fs09:36:082
2023699105,4cyclictest7178-21tr09:01:032
2023699105,4cyclictest30158-21unixbench-2d09:26:162
2023699105,3cyclictest26397-21gltestperf10:51:062
2023699105,3cyclictest11504-21unixbench-2d11:06:112
2023699104,5cyclictest28072-21tr08:36:052
2023699104,5cyclictest24273-21ntpq08:26:142
2023699104,4cyclictest9206-21cut10:36:032
2023699104,4cyclictest6722-21unixbench-2d11:31:162
2023699104,4cyclictest3981-21sed07:41:232
2023699104,4cyclictest15577-21cut11:11:092
2023699104,4cyclictest13342-21latency_hist10:10:482
2023699104,4cyclictest11858-21tr08:01:032
2023699104,2cyclictest589-21snmpd12:16:072
2023699103,5cyclictest589-21snmpd11:21:022
2023699103,5cyclictest589-21snmpd08:46:042
2023699103,3cyclictest5099-21expr08:56:062
2023699101,8cyclictest5173-21gltestperf11:01:202
2023699101,4cyclictest20617-21munin-run08:20:482
2023699101,2cyclictest141rcu_preempt12:11:172
2023699101,1cyclictest0-21swapper/210:03:562
2023699100,4cyclictest3079-21latency_hist10:30:482
2023699100,2cyclictest12673-21ntp_states12:06:162
2023599106,2cyclictest11423-21diskmemload11:36:061
2023599105,4cyclictest0-21swapper/108:43:161
2023599105,3cyclictest568-21runrttasks12:30:511
2023599105,3cyclictest21780-21switchtime10:46:201
2023599105,3cyclictest145232chrt10:40:521
2023599105,3cyclictest14251-21cstates08:06:041
2023599104,5cyclictest0-21swapper/108:48:011
2023599104,5cyclictest0-21swapper/107:40:171
2023599104,4cyclictest7097-21basename07:51:051
2023599104,4cyclictest6545-21grep12:01:071
2023599104,4cyclictest6545-21grep12:01:071
2023599104,4cyclictest589-21snmpd07:16:551
2023599104,4cyclictest26683-21ntpq07:21:131
2023599103,5cyclictest22047-21cron12:15:481
2023599101,7cyclictest31948-21apt-get11:26:021
2023599101,7cyclictest19554-21cat09:46:161
2023599101,4cyclictest0-21swapper/109:21:141
2023599100,9cyclictest0-21swapper/108:01:031
2023599100,4cyclictest4746-21wget07:46:051
2023599100,4cyclictest12714-21awk12:06:171
2023499107,2cyclictest3835-21ntp_offset10:01:120
2023499107,2cyclictest23553-21fschecks_time09:21:110
2023499106,3cyclictest31828-21sshd08:41:310
2023499106,3cyclictest28502-21hostname09:26:040
2023499106,3cyclictest28243-21cut08:36:060
2023499106,3cyclictest23227-21aten2_r8power_e08:26:020
2023499106,3cyclictest19246-21if_eno108:16:100
2023499106,3cyclictest10682-21aten2_r8power_v11:36:030
2023499105,4cyclictest8018-21missed_timers09:01:100
2023499105,4cyclictest5409-21if_eno107:46:100
2023499105,4cyclictest5254-21unixbench_singl10:31:180
2023499105,4cyclictest459-21tune2fs08:46:080
2023499105,4cyclictest27415-21uname11:21:140
2023499105,4cyclictest26398-21if_err_enp3s007:21:090
2023499105,4cyclictest25849-21latency10:21:110
2023499105,4cyclictest22620-21irqstats07:15:490
2023499105,4cyclictest17600-21fw_packets12:11:150
2023499105,4cyclictest15959-21grep11:11:110
2023499105,4cyclictest15313-21grep10:41:170
2023499105,4cyclictest1510-21ntpq11:56:130
2023499105,4cyclictest11868-21expr08:01:030
2023499105,4cyclictest11634-21cpu12:06:080
2023499105,3cyclictest29669-21grep09:56:040
2023499104,4cyclictest25810-21expr08:31:060
2023499104,4cyclictest21733-21cut11:46:020
2023499100,9cyclictest0-21swapper/011:25:570
2023499100,7cyclictest0-21swapper/011:43:140
2023499100,7cyclictest0-21swapper/010:18:060
2023499100,7cyclictest0-21swapper/008:11:080
2023499100,5cyclictest0-21swapper/009:11:140
2023499100,4cyclictest11423-21diskmemload11:31:040
2023499100,3cyclictest14471-21/usr/sbin/munin10:11:100
202369996,2cyclictest20816-21kworker/u8:112:21:002
202369995,2cyclictest21387-21df11:16:062
202369995,2cyclictest0-21swapper/208:11:062
202369994,4cyclictest8317-21systemctl07:51:152
202369994,4cyclictest6538-21sh12:30:542
202369994,4cyclictest30414-21wc07:31:062
202369994,4cyclictest15912-21needreboot10:41:212
202369994,4cyclictest14442-21cut08:06:052
202369994,4cyclictest10078-21if_enp5s007:56:092
202369994,3cyclictest5984-21mailstats07:46:212
202369993,4cyclictest27204-21sh11:51:052
202369993,4cyclictest11847-21sh12:35:492
202369992,6cyclictest589-21snmpd07:26:072
202369991,7cyclictest1127-21needreboot07:36:122
202359994,4cyclictest0-21swapper/109:00:551
202359994,3cyclictest28216-21df08:36:051
202359994,3cyclictest19753-21cut08:16:161
202359993,4cyclictest589-21snmpd09:05:561
202349994,4cyclictest9776-21expr09:06:080
202349994,4cyclictest30870-21df_inode10:26:070
202349990,8cyclictest8681-21unixbench_singl07:51:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional