You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-05 - 08:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot2s.osadl.org (updated Tue Jul 05, 2022 00:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
578699151143,7cyclictest0-21swapper/119:24:051
578599146144,1cyclictest0-21swapper/019:24:050
578799123120,2cyclictest0-21swapper/219:24:052
1499921160,1sleep30-21swapper/320:40:193
5477210245,46sleep10-21swapper/119:14:281
546729249,32sleep30-21swapper/319:14:223
542129148,32sleep20-21swapper/219:13:442
535729047,32sleep00-21swapper/019:12:540
5788997068,1cyclictest0-21swapper/319:14:593
5788997068,1cyclictest0-21swapper/319:14:593
156632370,1chrt15662-21ntpq22:10:161
221262360,1sleep30-21swapper/322:18:003
40662350,1sleep012-21ksoftirqd/000:20:190
187372340,1sleep30-21swapper/323:25:143
151202300,1sleep00-21swapper/022:10:110
5785992924,3cyclictest141rcu_preempt23:14:320
303302230,0chrt0-21swapper/223:02:562
5788992219,1cyclictest0-21swapper/319:24:053
5785992216,5cyclictest2030-21kworker/0:100:00:200
5785992216,3cyclictest14196-21munin-run22:09:560
578599221,1cyclictest0-21swapper/000:40:070
578599194,5cyclictest141rcu_preempt23:05:140
578899180,8cyclictest20897-21sh22:52:293
578899171,9cyclictest14445-21sh22:10:033
578899170,10cyclictest30889-21diskmemload23:03:543
207052170,0chrt0-21swapper/123:27:451
578899167,7cyclictest31884-21tr23:40:093
578899164,10cyclictest7230-21sh23:13:083
578899164,10cyclictest19725-21wc21:39:563
5788991612,3cyclictest41650irq/33-enp3s0-r21:30:083
578899160,9cyclictest24889-21rm22:56:283
578899160,7cyclictest22250-21ssh21:41:073
578899160,7cyclictest10363-21sh21:29:343
578899160,10cyclictest32453-21sh00:15:363
578599165,9cyclictest11341-21awk00:29:560
578599163,8cyclictest22060-21ssh21:40:460
578599162,2cyclictest141rcu_preempt00:10:100
578599162,1cyclictest141rcu_preempt23:19:560
578899156,8cyclictest4300-21latency_hist22:34:573
578899155,8cyclictest4210-21grep00:20:203
578899154,9cyclictest2641-21which21:20:143
578899154,9cyclictest15357-21rm22:45:233
578899154,9cyclictest12655-21smartctl20:35:213
578899151,12cyclictest9705-21cut23:50:183
578899151,12cyclictest9705-21cut23:50:183
578899150,9cyclictest23576-21ssh23:30:163
578899150,14cyclictest13344-21sed00:30:203
578599159,1cyclictest31838-21kworker/u8:021:54:280
578599154,6cyclictest202302sleep023:26:520
578599151,11cyclictest6610-21ssh22:35:440
578899144,8cyclictest9043-21ssh00:25:303
578899144,8cyclictest6787-21aten2_r8power_e20:25:103
578899144,8cyclictest503-21if_enp4s020:10:113
578899144,8cyclictest27726-21ssh21:47:573
578899143,9cyclictest3129-21sh23:09:023
578899143,9cyclictest29124-21cut21:50:103
578899143,9cyclictest27822-21cat21:10:103
578899143,9cyclictest2757-21idleruntime20:15:113
578899143,9cyclictest23793-21snmpd22:29:343
578899143,9cyclictest23793-21snmpd21:00:043
578899143,9cyclictest19082-21cat19:40:133
578899141,6cyclictest0-21swapper/323:15:123
578899141,11cyclictest9130-21apt-get22:40:073
578899141,11cyclictest6377-21sed22:35:213
578899140,12cyclictest5156-21ssh21:59:473
578899140,12cyclictest16541-21tune2fs19:35:113
578899140,12cyclictest12554-21ssh22:06:493
578899140,12cyclictest10057-21needreboot20:30:153
578799144,5cyclictest0-21swapper/222:43:472
578699145,4cyclictest4206-21grep23:10:091
578699144,5cyclictest0-21swapper/120:05:231
578599145,8cyclictest0-21swapper/022:41:040
578599145,8cyclictest0-21swapper/021:30:480
578599143,8cyclictest21115-21sh22:16:040
578599143,6cyclictest16902-21hwlatdetect00:35:120
578599140,9cyclictest18486-21chrt21:37:480
578599140,3cyclictest141rcu_preempt20:25:180
173652140,0chrt0-21swapper/200:35:172
578899134,7cyclictest20992-21df00:40:113
578899134,7cyclictest14852-21sh23:55:313
578899134,4cyclictest0-21swapper/319:30:133
578899133,8cyclictest6229-21grep22:00:193
578899132,9cyclictest23559-21head19:50:123
578899131,10cyclictest4838-21/usr/sbin/munin20:20:113
578899131,10cyclictest27632-21fschecks_time23:35:193
578899131,10cyclictest26474-21/usr/sbin/munin21:05:193
578899131,10cyclictest22701-21/usr/sbin/munin00:05:153
578899131,10cyclictest18527-21cpuspeed_turbos20:50:093
578899131,10cyclictest18527-21cpuspeed_turbos20:50:093
578899131,10cyclictest17740-21grep00:00:103
578899131,10cyclictest16780-21perl00:35:113
578899131,10cyclictest16480-21fschecks_time20:45:103
578899131,10cyclictest14722-21sed23:20:203
578899131,10cyclictest11812-21idleruntime19:25:123
578899130,11cyclictest4252-21ssh23:45:113
578899130,11cyclictest30061-21cpu21:15:093
578899130,11cyclictest26777-21grep00:10:113
578899130,11cyclictest25758-21fschecks_count19:55:113
578899130,11cyclictest24759-21awk22:20:183
578899130,11cyclictest24759-21awk22:20:183
578899130,11cyclictest21135-21fschecks_count19:45:113
578899130,11cyclictest20767-21cut20:55:093
578699139,2cyclictest29637-21latency_hist20:04:561
578699137,4cyclictest21697-21ntpq00:40:181
578699136,5cyclictest16168-21awk21:35:131
578699134,8cyclictest0-21swapper/100:22:231
578699134,4cyclictest0-21swapper/100:06:351
578699133,5cyclictest9460-21ssh00:26:211
578699132,6cyclictest0-21swapper/119:40:141
578599138,3cyclictest32500-21cpuspeed_turbos20:10:080
578599136,3cyclictest29555-21diskmemload21:25:360
578599134,8cyclictest0-21swapper/022:21:100
578599134,8cyclictest0-21swapper/022:21:100
578599134,8cyclictest0-21swapper/020:50:480
578599134,8cyclictest0-21swapper/020:50:480
578599134,8cyclictest0-21swapper/020:44:120
578599134,8cyclictest0-21swapper/020:33:320
578599134,8cyclictest0-21swapper/020:22:560
578599130,7cyclictest4321-21awk22:34:560
578899120,10cyclictest29887-21/usr/sbin/munin20:05:063
578899120,10cyclictest28131-21/usr/sbin/munin20:00:113
578799125,5cyclictest0-21swapper/223:25:122
578799124,4cyclictest0-21swapper/221:49:242
578799123,4cyclictest26130-21irqstats19:55:142
578799123,4cyclictest0-21swapper/221:50:242
578799122,5cyclictest0-21swapper/222:54:052
578799120,4cyclictest3659-21sh21:56:532
578699126,4cyclictest14217-21ls23:55:191
578699126,4cyclictest12570-21rt-features20:35:201
578699126,4cyclictest10379-21seq22:05:101
578699125,5cyclictest229-21systemd-journal21:00:171
578699124,6cyclictest0-21swapper/123:36:441
578699124,6cyclictest0-21swapper/121:09:231
578699123,7cyclictest0-21swapper/121:25:561
578699123,5cyclictest0-21swapper/119:55:131
578699123,4cyclictest0-21swapper/120:56:011
578699123,2cyclictest141rcu_preempt23:15:121
578699122,6cyclictest5096-21diskstats22:35:111
578699121,9cyclictest9627-21fschecks_count22:40:111
578699121,2cyclictest568-21runrttasks00:37:341
578699120,10cyclictest29867-21/usr/sbin/munin21:15:141
578599128,2cyclictest13085-21aten2_r8power_p23:55:100
578599126,4cyclictest16013-21cut20:45:080
578599125,6cyclictest0-21swapper/023:45:310
578599125,4cyclictest0-21swapper/023:41:040
578599125,4cyclictest0-21swapper/023:02:000
578599124,8cyclictest0-21swapper/023:36:160
578599124,8cyclictest0-21swapper/023:31:400
578599124,8cyclictest0-21swapper/019:43:240
578599124,7cyclictest3768-21ssh21:57:030
578599124,5cyclictest32532-21ssh00:15:460
578599124,5cyclictest0-21swapper/000:31:480
578599124,3cyclictest0-21swapper/022:25:310
578599124,3cyclictest0-21swapper/021:17:290
578599124,3cyclictest0-21swapper/020:00:050
578599124,2cyclictest0-21swapper/021:10:480
578599123,4cyclictest0-21swapper/022:00:210
578599123,3cyclictest0-21swapper/022:58:420
578599122,5cyclictest14729-21ntp_states22:45:180
578599121,2cyclictest141rcu_preempt22:50:300
578599120,2cyclictest141rcu_preempt20:05:120
578599120,1cyclictest0-21swapper/023:53:380
578599120,1cyclictest0-21swapper/023:53:380
148442120,1sleep2271rcuc/222:10:092
578799117,2cyclictest0-21swapper/223:20:422
578799115,5cyclictest0-21swapper/223:54:402
578799115,5cyclictest0-21swapper/223:54:402
578799115,5cyclictest0-21swapper/223:43:042
578799115,5cyclictest0-21swapper/222:28:042
578799115,5cyclictest0-21swapper/222:01:252
578799114,5cyclictest1529-21ssh23:06:032
578799114,5cyclictest0-21swapper/221:42:032
578799114,5cyclictest0-21swapper/221:21:502
578799114,5cyclictest0-21swapper/219:42:462
578799114,4cyclictest0-21swapper/223:15:542
578799113,5cyclictest0-21swapper/222:49:262
578799112,4cyclictest0-21swapper/222:35:142
578799111,5cyclictest0-21swapper/220:48:522
578799110,8cyclictest21537-21memory00:40:152
578699117,2cyclictest20038-21/usr/sbin/munin21:40:121
578699116,3cyclictest15856-21cron00:34:561
578699115,5cyclictest17549-21kworker/u8:121:56:451
578699115,4cyclictest3067-21sh23:44:161
578699115,4cyclictest29320-21tr21:50:111
578699115,4cyclictest2473-21expr20:15:081
578699115,4cyclictest24170-21sh23:30:211
578699115,4cyclictest23793-21snmpd20:47:521
578699115,4cyclictest15442-21sh23:21:301
578699115,4cyclictest13815-21cat20:40:091
578699115,4cyclictest12112-21grep19:25:151
578699114,5cyclictest229-21systemd-journal22:25:321
578699114,5cyclictest0-21swapper/123:00:181
578699114,5cyclictest0-21swapper/121:30:581
578699114,5cyclictest0-21swapper/120:25:141
578699113,6cyclictest30614-21wget00:15:081
578699113,6cyclictest18028-21seq22:50:161
578699113,6cyclictest0-21swapper/119:16:231
578699113,6cyclictest0-21swapper/119:16:231
578699113,2cyclictest0-21swapper/121:48:581
578699111,4cyclictest13638-21aten2_r8power_p22:45:101
578699110,9cyclictest29555-21diskmemload00:00:171
578599115,4cyclictest3058-21tr21:20:170
578599115,4cyclictest24165-21wc19:50:180
578599115,4cyclictest20842-21tr20:55:090
578599115,4cyclictest11774-21sed19:25:120
578599115,1cyclictest0-21swapper/019:55:100
578599114,7cyclictest0-21swapper/020:38:420
578599114,5cyclictest15480-21ssh23:21:340
578599113,8cyclictest0-21swapper/021:48:380
578599113,8cyclictest0-21swapper/019:34:120
578599113,3cyclictest0-21swapper/020:14:590
578599112,4cyclictest0-21swapper/021:07:260
578799106,3cyclictest28017-21uniq21:10:112
578799106,3cyclictest27608-21uniq23:35:192
578799106,3cyclictest26643-21sh22:59:452
578799106,3cyclictest16864-21sh21:35:212
578799105,4cyclictest0-21swapper/220:20:362
578799105,4cyclictest0-21swapper/200:12:112
578799105,3cyclictest14262-21grep20:40:112
578799104,5cyclictest0-21swapper/223:32:132
578799104,5cyclictest0-21swapper/221:00:342
578799104,5cyclictest0-21swapper/220:14:412
578799104,5cyclictest0-21swapper/219:35:252
578799104,5cyclictest0-21swapper/200:33:482
578799104,5cyclictest0-21swapper/200:05:162
578799104,4cyclictest8656-21switchtime00:25:202
578799104,4cyclictest5998-21sh23:10:492
578799104,4cyclictest11756-21head19:25:122
578799104,4cyclictest11588-21head21:30:122
578799104,4cyclictest10203-21cpu22:05:102
578799103,5cyclictest0-21swapper/219:52:502
578799103,5cyclictest0-21swapper/219:33:102
578799102,6cyclictest12912-21ssh23:55:022
578799101,4cyclictest0-21swapper/222:33:112
578799101,4cyclictest0-21swapper/220:08:502
578799101,4cyclictest0-21swapper/200:01:142
578799100,9cyclictest0-21swapper/223:45:522
578799100,4cyclictest29637-21latency_hist20:04:562
578699106,3cyclictest27471-21acpi21:10:071
578699105,4cyclictest3771-21acpi23:45:071
578699105,4cyclictest14277-21basename19:30:121
578699105,3cyclictest9867-21timerandwakeup23:50:191
578699105,3cyclictest9867-21timerandwakeup23:50:191
578699105,3cyclictest20866-21grep19:45:091
578699105,3cyclictest17310-21mailstats19:35:191
578699105,3cyclictest1192-21timerandwakeup20:10:181
578699104,5cyclictest0-21swapper/120:54:211
578699104,5cyclictest0-21swapper/120:54:211
578699104,4cyclictest25734-21sh22:21:211
578699104,4cyclictest25734-21sh22:21:211
578699104,4cyclictest0-21swapper/122:00:041
578699104,2cyclictest568-21runrttasks00:13:061
578699103,5cyclictest0-21swapper/120:20:181
578699103,2cyclictest41750irq/34-enp3s0-t22:55:451
578699103,2cyclictest0-21swapper/123:04:591
578699102,2cyclictest22956-21/usr/sbin/munin19:50:181
578699101,7cyclictest0-21swapper/122:30:181
578699101,7cyclictest0-21swapper/121:20:161
578699100,8cyclictest20645-21unixbench_multi22:15:201
578599105,3cyclictest23160-21sed00:05:210
578599104,4cyclictest16109-21cut19:35:090
578599103,5cyclictest5841-21aten2_r8power_c19:15:080
578599103,5cyclictest5841-21aten2_r8power_c19:15:080
578599103,5cyclictest23793-21snmpd21:00:520
578599101,1cyclictest0-21swapper/019:47:240
57879997,1cyclictest0-21swapper/221:15:032
57879996,2cyclictest7875-21swap21:25:182
57879996,2cyclictest22728-21turbostat.cron19:49:572
57879996,2cyclictest14450irq/32-ahci[00020:59:562
57879995,3cyclictest6626-21if_err_enp3s019:15:132
57879995,3cyclictest6626-21if_err_enp3s019:15:132
57879995,3cyclictest26229-21sed21:05:162
57879995,3cyclictest12196-21kernelversion20:35:162
57879995,2cyclictest20288-21readlink22:15:182
57879994,4cyclictest2640-21apt-get00:20:082
57879994,4cyclictest23793-21snmpd20:50:152
57879994,4cyclictest23793-21snmpd20:50:152
57879994,4cyclictest0-21swapper/220:30:142
57879994,3cyclictest7347-21grep20:25:132
57879994,3cyclictest30541-21acpi00:15:072
57879994,3cyclictest24533-21tail22:20:162
57879994,3cyclictest24533-21tail22:20:162
57879993,4cyclictest2301-21cut20:15:082
57869992,5cyclictest229-21systemd-journal20:30:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional