You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-27 - 14:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i7-M620 @2667 MHz, Linux 4.19.106-rt45+ (Profile)

Latency plot of shadow in rack #3, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Mon Mar 27, 2023 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2993211389,19sleep00-21swapper/007:06:100
30902112101,6sleep30-21swapper/307:07:173
3236210988,15sleep20-21swapper/207:09:082
2940210689,12sleep10-21swapper/107:05:301
3343993817,19cyclictest0-21swapper/311:25:123
3341993616,18cyclictest0-21swapper/111:25:111
3341993616,18cyclictest0-21swapper/107:15:161
334299221,19cyclictest0-21swapper/208:55:132
334299221,19cyclictest0-21swapper/208:55:122
334299221,15cyclictest0-21swapper/211:35:172
334299210,19cyclictest0-21swapper/208:45:122
334099210,19cyclictest0-21swapper/008:00:120
334399200,2cyclictest0-21swapper/312:25:123
334199200,2cyclictest0-21swapper/112:25:121
334099200,2cyclictest0-21swapper/009:15:160
334399161,13cyclictest1291-21switchtime09:50:253
3343991611,3cyclictest0-21swapper/307:10:153
334299160,14cyclictest0-21swapper/211:05:242
334199161,3cyclictest1532-21irqstats08:30:171
334199160,14cyclictest0-21swapper/107:50:291
334299155,8cyclictest4518-21gdm-simple-gree11:41:582
334299152,7cyclictest0-21swapper/210:55:002
334299151,12cyclictest0-21swapper/209:30:242
3340991510,3cyclictest0-21swapper/010:00:250
334099150,13cyclictest0-21swapper/009:40:210
334399149,3cyclictest0-21swapper/307:45:143
3343991410,2cyclictest4907-21apt-get08:40:123
334299149,3cyclictest6384-21cut07:15:222
334299149,3cyclictest0-21swapper/207:50:222
334299144,7cyclictest4518-21gdm-simple-gree07:29:592
334299142,7cyclictest0-21swapper/210:55:012
334299142,6cyclictest0-21swapper/207:45:002
3342991410,2cyclictest0-21swapper/209:55:222
334299140,12cyclictest0-21swapper/212:00:242
334299140,12cyclictest0-21swapper/208:07:592
334199140,12cyclictest5720-21processes08:40:171
334199140,12cyclictest0-21swapper/111:55:311
334099140,12cyclictest10692-21latency_hist10:15:000
334099140,12cyclictest0-21swapper/009:20:130
334399138,3cyclictest0-21swapper/308:50:153
334399132,6cyclictest0-21swapper/309:50:013
334399132,6cyclictest0-21swapper/309:00:013
334399132,6cyclictest0-21swapper/309:00:003
334399130,2cyclictest0-21swapper/309:55:183
334399130,12cyclictest0-21swapper/307:35:163
334399130,11cyclictest17369-21munin-node3
334399130,11cyclictest0-21swapper/309:20:183
334299138,3cyclictest0-21swapper/211:45:132
334299132,6cyclictest0-21swapper/212:20:002
334299132,6cyclictest0-21swapper/212:10:012
334299132,6cyclictest0-21swapper/211:15:002
3342991310,2cyclictest0-21swapper/212:26:112
3342991310,2cyclictest0-21swapper/210:40:192
3342991310,2cyclictest0-21swapper/210:20:252
3342991310,2cyclictest0-21swapper/208:35:122
3342991310,2cyclictest0-21swapper/207:20:222
334299130,2cyclictest0-21swapper/210:10:132
334299130,12cyclictest0-21swapper/210:35:422
334299130,12cyclictest0-21swapper/210:25:232
334299130,12cyclictest0-21swapper/209:50:522
334299130,11cyclictest0-21swapper/209:00:192
334299130,11cyclictest0-21swapper/209:00:182
334299130,11cyclictest0-21swapper/208:00:222
334199139,2cyclictest0-21swapper/108:35:161
334199132,6cyclictest0-21swapper/107:30:011
334199131,3cyclictest0-21swapper/110:55:281
3341991310,2cyclictest0-21swapper/111:35:341
334199130,2cyclictest14639-21iostat_ios11:40:161
334199130,2cyclictest0-21swapper/111:00:191
334199130,2cyclictest0-21swapper/110:35:261
334199130,1cyclictest0-21swapper/109:44:081
334099130,12cyclictest0-21swapper/007:15:150
221252130,3sleep122132-21munin-node1
68532120,2sleep00-21swapper/011:21:080
334399129,2cyclictest0-21swapper/311:10:263
334399129,2cyclictest0-21swapper/310:31:563
334399129,2cyclictest0-21swapper/308:35:243
334399129,2cyclictest0-21swapper/307:20:173
334399127,3cyclictest5086-21iostat_ios10:00:163
334399127,3cyclictest22495-21tr08:00:133
334399122,6cyclictest0-21swapper/308:20:013
334399120,2cyclictest0-21swapper/311:50:163
334399120,2cyclictest0-21swapper/310:40:243
334399120,11cyclictest0-21swapper/312:20:173
334399120,11cyclictest0-21swapper/312:05:323
334399120,11cyclictest0-21swapper/311:57:173
334399120,11cyclictest0-21swapper/311:00:173
334399120,11cyclictest0-21swapper/310:50:193
334399120,11cyclictest0-21swapper/310:35:153
334399120,11cyclictest0-21swapper/310:25:223
334399120,11cyclictest0-21swapper/310:10:153
334399120,11cyclictest0-21swapper/309:26:043
334399120,11cyclictest0-21swapper/309:05:253
334399120,11cyclictest0-21swapper/308:05:163
334399120,11cyclictest0-21swapper/307:55:263
334399120,11cyclictest0-21swapper/307:30:233
334399120,10cyclictest20005-21popularity-cont07:51:493
334299129,2cyclictest0-21swapper/210:30:122
334299129,2cyclictest0-21swapper/210:05:142
334299129,2cyclictest0-21swapper/208:40:252
334299127,3cyclictest11012-21cut10:15:152
334299122,7cyclictest4518-21gdm-simple-gree11:33:592
334299122,7cyclictest0-21swapper/207:33:582
334299122,6cyclictest0-21swapper/208:25:252
3342991210,1cyclictest0-21swapper/210:00:152
334299120,2cyclictest0-21swapper/211:50:252
334299120,2cyclictest0-21swapper/211:25:192
334299120,2cyclictest0-21swapper/209:45:192
334299120,11cyclictest0-21swapper/212:20:262
334299120,11cyclictest0-21swapper/212:05:252
334199129,2cyclictest0-21swapper/112:05:281
334199129,2cyclictest0-21swapper/110:10:261
334199129,2cyclictest0-21swapper/108:55:271
334199129,2cyclictest0-21swapper/108:55:261
334199127,3cyclictest13486-21head10:20:181
334199122,5cyclictest0-21swapper/110:09:591
334199121,9cyclictest0-21swapper/112:15:151
334199121,9cyclictest0-21swapper/112:10:161
334199121,9cyclictest0-21swapper/109:45:121
334199121,9cyclictest0-21swapper/108:10:171
334199121,3cyclictest0-21swapper/109:35:351
334199120,2cyclictest0-21swapper/112:30:201
334199120,2cyclictest0-21swapper/111:45:181
334199120,2cyclictest0-21swapper/109:00:141
334199120,2cyclictest0-21swapper/109:00:131
334199120,11cyclictest0-21swapper/112:25:011
334199120,11cyclictest0-21swapper/112:00:131
334199120,11cyclictest0-21swapper/111:50:231
334199120,11cyclictest0-21swapper/109:10:191
334199120,11cyclictest0-21swapper/108:50:251
334199120,11cyclictest0-21swapper/108:25:161
334199120,10cyclictest0-21swapper/107:45:261
334099129,2cyclictest0-21swapper/012:05:220
334099129,2cyclictest0-21swapper/011:30:190
334099129,2cyclictest0-21swapper/008:50:110
334099129,2cyclictest0-21swapper/008:35:260
334099122,7cyclictest0-21swapper/012:29:590
334099122,7cyclictest0-21swapper/010:41:020
334099122,7cyclictest0-21swapper/010:30:590
334099122,7cyclictest0-21swapper/009:04:020
334099122,7cyclictest0-21swapper/009:04:010
334099122,7cyclictest0-21swapper/008:49:020
334099122,7cyclictest0-21swapper/008:14:580
334099120,2cyclictest0-21swapper/012:00:140
334099120,2cyclictest0-21swapper/009:35:260
334099120,2cyclictest0-21swapper/009:05:260
334099120,2cyclictest0-21swapper/008:40:110
334099120,2cyclictest0-21swapper/007:50:150
334099120,11cyclictest0-21swapper/012:15:130
334099120,11cyclictest0-21swapper/011:55:170
334099120,11cyclictest0-21swapper/011:50:180
334099120,11cyclictest0-21swapper/011:05:300
334099120,11cyclictest0-21swapper/010:29:390
334099120,11cyclictest0-21swapper/010:10:190
334099120,11cyclictest0-21swapper/009:30:220
334099120,11cyclictest0-21swapper/009:25:270
334099120,11cyclictest0-21swapper/008:30:260
334099120,11cyclictest0-21swapper/007:35:240
334099120,11cyclictest0-21swapper/007:25:150
334099120,11cyclictest0-21swapper/007:20:170
230632120,2sleep20-21swapper/209:25:222
334399118,2cyclictest0-21swapper/311:35:333
334399118,2cyclictest0-21swapper/310:15:263
334399118,2cyclictest0-21swapper/309:35:363
334399118,2cyclictest0-21swapper/309:31:483
334399118,2cyclictest0-21swapper/309:00:213
334399118,2cyclictest0-21swapper/309:00:203
334399116,3cyclictest30715-21pzem_voltage12:15:213
334399116,3cyclictest0-21swapper/307:25:263
334399112,6cyclictest0-21swapper/307:42:013
334399110,10cyclictest0-21swapper/311:34:013
334399110,10cyclictest0-21swapper/310:49:593
334399110,10cyclictest0-21swapper/309:11:213
334299118,2cyclictest0-21swapper/211:55:152
334299118,2cyclictest0-21swapper/209:15:222
334299118,2cyclictest0-21swapper/208:20:162
334299118,2cyclictest0-21swapper/208:15:152
334299112,6cyclictest0-21swapper/212:34:012
334299112,6cyclictest0-21swapper/207:14:022
334299111,7cyclictest0-21swapper/209:44:012
334299110,6cyclictest0-21swapper/209:10:002
334299110,1cyclictest0-21swapper/207:55:042
334299110,10cyclictest0-21swapper/209:22:062
334299110,10cyclictest0-21swapper/209:10:212
334299110,10cyclictest0-21swapper/208:10:192
334199118,2cyclictest0-21swapper/110:30:281
334199117,2cyclictest3564-21munin-node1
334199117,2cyclictest0-21swapper/111:15:171
334199117,2cyclictest0-21swapper/109:25:201
334199116,3cyclictest0-21swapper/111:05:221
334199116,3cyclictest0-21swapper/108:00:001
334199112,6cyclictest0-21swapper/110:50:001
334199111,8cyclictest24979-21ntp_states08:05:201
334199111,8cyclictest0-21swapper/110:25:231
334199111,6cyclictest0-21swapper/112:35:181
334199111,3cyclictest28349-21hddtemp_smartct08:15:171
334199110,9cyclictest11633-21latency_hist11:35:011
334199110,9cyclictest0-21swapper/107:20:191
334199110,3cyclictest7360-21cat11:25:011
334199110,3cyclictest0-21swapper/110:00:261
334199110,3cyclictest0-21swapper/109:35:001
334199110,3cyclictest0-21swapper/107:30:121
334199110,2cyclictest0-21swapper/109:21:371
334199110,10cyclictest0-21swapper/107:40:211
334099118,2cyclictest0-21swapper/011:35:280
334099118,2cyclictest0-21swapper/010:20:220
334099118,2cyclictest0-21swapper/008:55:200
334099118,2cyclictest0-21swapper/008:55:190
334099118,2cyclictest0-21swapper/007:55:200
334099113,6cyclictest0-21swapper/011:28:400
334099112,5cyclictest0-21swapper/012:23:510
334099111,7cyclictest0-21swapper/007:31:580
334099110,2cyclictest0-21swapper/012:36:490
334099110,2cyclictest0-21swapper/010:56:050
334099110,10cyclictest0-21swapper/010:35:230
24752110,2sleep10-21swapper/109:55:131
334399105,3cyclictest8547-21ls08:50:003
334399105,3cyclictest28733-21timerandwakeup12:10:263
334399105,3cyclictest23764-21kernelversion12:00:163
334399101,5cyclictest0-21swapper/308:20:113
334399100,9cyclictest0-21swapper/310:56:083
334399100,6cyclictest0-21swapper/311:20:283
334399100,2cyclictest0-21swapper/311:05:153
334399100,2cyclictest0-21swapper/310:07:463
334299107,2cyclictest0-21swapper/211:00:182
334299107,2cyclictest0-21swapper/207:45:172
334299107,2cyclictest0-21swapper/207:35:152
334299105,3cyclictest27070-21uname09:35:262
334299101,6cyclictest0-21swapper/210:45:272
334299100,8cyclictest0-21swapper/211:25:002
334299100,2cyclictest0-21swapper/211:19:382
334199108,1cyclictest0-21swapper/110:15:151
334199106,2cyclictest0-21swapper/109:15:241
334199105,3cyclictest0-21swapper/108:45:161
334199102,7cyclictest0-21swapper/108:24:581
334099107,2cyclictest0-21swapper/012:30:240
334099107,2cyclictest0-21swapper/011:15:120
334099107,2cyclictest0-21swapper/009:50:420
334099102,7cyclictest0-21swapper/009:10:010
334099102,6cyclictest4512-21metacity11:10:580
334099102,6cyclictest0-21swapper/008:23:040
334099102,6cyclictest0-21swapper/008:05:250
334099102,5cyclictest4518-21gdm-simple-gree11:04:580
334099101,6cyclictest0-21swapper/007:10:580
334099100,9cyclictest0-21swapper/010:53:040
334099100,7cyclictest0-21swapper/010:46:580
334099100,2cyclictest0-21swapper/010:05:070
334099100,2cyclictest0-21swapper/009:58:420
135342100,2sleep30-21swapper/310:20:203
33439996,2cyclictest0-21swapper/309:40:453
33439996,2cyclictest0-21swapper/308:25:203
33439995,2cyclictest0-21swapper/312:35:343
33439994,3cyclictest4480-21cat11:15:273
33439994,3cyclictest27642-21taskset08:14:143
33439994,3cyclictest14871-21open_files11:40:193
33439991,6cyclictest4213-21cpuspeed_turbos12:30:193
33439990,7cyclictest0-21swapper/307:15:263
33439990,5cyclictest0-21swapper/309:15:293
33429994,3cyclictest8925-21fschecks_time08:50:162
33429991,3cyclictest0-21swapper/208:30:182
33429990,2cyclictest0-21swapper/212:35:102
33419990,8cyclictest0-21swapper/111:10:141
33419990,7cyclictest0-21swapper/108:00:171
33419990,7cyclictest0-21swapper/107:35:151
33419990,3cyclictest0-21swapper/110:50:031
33419990,3cyclictest0-21swapper/109:05:261
33419990,2cyclictest0-21swapper/109:50:141
33409995,3cyclictest29054-21ls08:15:270
33409992,6cyclictest0-21swapper/011:43:430
33409991,7cyclictest4518-21gdm-simple-gree07:44:590
33409990,2cyclictest0-21swapper/007:45:200
17981290,1sleep00-21swapper/011:46:570
33439981,3cyclictest0-21swapper/308:30:163
33409985,2cyclictest0-21swapper/012:10:150
33409980,7cyclictest0-21swapper/008:28:580
30713280,5sleep00-21swapper/009:45:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional