You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-09-17 - 14:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

Intel(R) Core(TM) i7 CPU M 620 @ 2.67GHz, Linux 4.19.106-rt45+ (Profile)

Latency plot of shadow in rack #3, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack3slot6s.osadl.org (updated Fri Sep 17, 2021 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
259082115104,6sleep10-21swapper/107:07:481
26077210796,6sleep20-21swapper/207:09:572
26052210595,6sleep00-21swapper/007:09:390
25984210392,6sleep30-21swapper/307:08:463
232832680,0sleep30-21swapper/309:55:163
2610799430,21cyclictest0-21swapper/011:56:130
162452270,1sleep00-21swapper/008:10:000
268632260,1sleep00-21swapper/011:30:280
26109992621,3cyclictest0-21swapper/209:11:442
26108992522,2cyclictest4679-21kworker/u8:108:21:041
26108992522,2cyclictest4679-21kworker/u8:107:48:041
26108992522,2cyclictest4679-21kworker/u8:107:43:051
26108992522,2cyclictest314-21kworker/u8:209:49:041
26108992522,2cyclictest1071-21kworker/u8:007:31:031
26108992421,2cyclictest4679-21kworker/u8:108:14:041
26108992421,2cyclictest314-21kworker/u8:209:56:041
26108992421,2cyclictest31345-21kworker/u8:107:28:041
26108992421,2cyclictest31345-21kworker/u8:107:22:041
26108992421,2cyclictest28826-21kworker/u8:109:10:051
26108992421,2cyclictest28826-21kworker/u8:109:01:031
26108992421,2cyclictest28826-21kworker/u8:108:47:041
26108992421,2cyclictest23487-21kworker/u8:211:28:041
2611099231,19cyclictest0-21swapper/309:10:133
2610999232,19cyclictest0-21swapper/208:20:112
26108992320,2cyclictest7928-21kworker/u8:212:11:041
26108992320,2cyclictest6030-21kworker/u8:012:22:041
26108992320,2cyclictest4679-21kworker/u8:107:56:041
26108992320,2cyclictest4679-21kworker/u8:107:54:041
26108992320,2cyclictest314-21kworker/u8:209:52:051
26108992320,2cyclictest314-21kworker/u8:209:17:031
26108992320,2cyclictest28826-21kworker/u8:108:44:041
26108992320,2cyclictest26311-21kworker/u8:007:16:051
26108992320,2cyclictest26311-21kworker/u8:007:14:041
26108992320,2cyclictest26097-21kworker/u8:011:17:041
26108992320,2cyclictest26097-21kworker/u8:010:06:041
26108992320,2cyclictest26097-21kworker/u8:010:01:041
26108992320,2cyclictest21659-21kworker/u8:008:38:041
26108992320,2cyclictest21659-21kworker/u8:008:31:041
26108992320,2cyclictest21601-21kworker/u8:110:34:041
26108992320,2cyclictest10630-21kworker/u8:210:56:041
2610899230,18cyclictest0-21swapper/112:17:041
2610799230,18cyclictest0-21swapper/011:43:040
2611099220,20cyclictest0-21swapper/312:10:233
2610999228,12cyclictest31-21ksoftirqd/210:20:142
2610999221,19cyclictest0-21swapper/212:05:182
26108992219,2cyclictest314-21kworker/u8:209:21:041
26108992219,2cyclictest28826-21kworker/u8:109:40:041
26108992219,2cyclictest28826-21kworker/u8:109:40:041
26108992219,2cyclictest28826-21kworker/u8:109:09:041
26108992219,2cyclictest28826-21kworker/u8:108:59:041
26108992219,2cyclictest26097-21kworker/u8:011:02:041
26108992219,2cyclictest2394-21kworker/u8:207:35:041
26108992219,2cyclictest23487-21kworker/u8:211:53:041
26108992219,2cyclictest23487-21kworker/u8:211:42:041
26108992219,2cyclictest23487-21kworker/u8:211:24:041
26108992219,2cyclictest21659-21kworker/u8:008:29:041
26108992219,2cyclictest21601-21kworker/u8:110:45:041
26108992219,2cyclictest21601-21kworker/u8:110:42:041
26108992219,2cyclictest21601-21kworker/u8:110:39:041
26108992219,2cyclictest21601-21kworker/u8:110:26:041
26108992219,2cyclictest10630-21kworker/u8:210:50:041
2610899220,17cyclictest0-21swapper/110:14:041
2610799220,18cyclictest0-21swapper/012:35:040
2610799220,11cyclictest0-21swapper/008:51:040
26108992118,2cyclictest7928-21kworker/u8:212:26:041
26108992118,2cyclictest23487-21kworker/u8:212:00:041
26108992118,2cyclictest23487-21kworker/u8:211:37:041
26108992118,2cyclictest10630-21kworker/u8:211:11:041
26107992118,2cyclictest2394-21kworker/u8:207:36:040
2610799210,7cyclictest0-21swapper/011:29:040
2610799210,18cyclictest0-21swapper/011:22:050
2610799210,14cyclictest0-21swapper/012:16:040
2610999200,18cyclictest0-21swapper/209:20:172
26108992017,2cyclictest7928-21kworker/u8:212:36:051
2610799200,18cyclictest0-21swapper/009:31:030
2610799200,10cyclictest0-21swapper/010:13:030
2610899190,2cyclictest0-21swapper/111:34:041
2610899190,2cyclictest0-21swapper/109:29:041
2610899190,2cyclictest0-21swapper/108:16:041
2610899190,18cyclictest0-21swapper/110:17:051
2610899190,18cyclictest0-21swapper/109:37:041
2610899190,18cyclictest0-21swapper/109:37:031
2610899190,17cyclictest0-21swapper/109:32:041
2610799190,2cyclictest0-21swapper/012:07:040
2610799190,2cyclictest0-21swapper/010:55:050
2610799190,2cyclictest0-21swapper/010:54:040
2610799190,2cyclictest0-21swapper/010:46:040
2610799190,2cyclictest0-21swapper/010:32:050
2610799190,2cyclictest0-21swapper/008:15:040
2610799190,2cyclictest0-21swapper/007:45:030
2610799190,2cyclictest0-21swapper/007:44:040
2610799190,17cyclictest0-21swapper/011:05:030
2610899180,2cyclictest0-21swapper/112:09:041
2610899180,2cyclictest0-21swapper/108:06:051
26107991815,2cyclictest7928-21kworker/u8:212:31:040
26107991815,2cyclictest4679-21kworker/u8:108:12:040
26107991815,2cyclictest314-21kworker/u8:209:24:040
26107991815,2cyclictest28826-21kworker/u8:109:43:030
26107991815,2cyclictest28826-21kworker/u8:109:43:030
26107991815,2cyclictest2394-21kworker/u8:207:32:040
26107991815,2cyclictest23487-21kworker/u8:211:46:050
26107991815,2cyclictest21601-21kworker/u8:110:36:040
2610799180,2cyclictest0-21swapper/010:15:040
2610799180,2cyclictest0-21swapper/008:42:040
2610799180,16cyclictest0-21swapper/007:52:040
2611099173,12cyclictest31534-21chrt10:15:353
26108991714,2cyclictest21601-21kworker/u8:110:22:041
2610899170,2cyclictest0-21swapper/112:34:041
2610899170,2cyclictest0-21swapper/111:55:041
2610899170,2cyclictest0-21swapper/111:47:041
2610899170,2cyclictest0-21swapper/111:08:041
2610899170,2cyclictest0-21swapper/108:01:041
26107991714,2cyclictest6030-21kworker/u8:012:03:030
26107991714,2cyclictest28826-21kworker/u8:109:39:050
26107991714,2cyclictest28826-21kworker/u8:109:39:040
26107991714,2cyclictest28826-21kworker/u8:109:13:050
26107991714,2cyclictest28826-21kworker/u8:108:46:050
26107991714,2cyclictest26097-21kworker/u8:011:04:040
26107991714,2cyclictest23487-21kworker/u8:211:50:040
26107991714,2cyclictest21601-21kworker/u8:110:43:030
2610799170,2cyclictest0-21swapper/011:35:030
26110991611,3cyclictest29199-21cut10:10:233
2610999164,10cyclictest0-21swapper/211:30:262
2610999161,13cyclictest0-21swapper/208:35:172
26107991613,2cyclictest7928-21kworker/u8:212:12:040
26107991613,2cyclictest6030-21kworker/u8:012:21:040
26107991613,2cyclictest4679-21kworker/u8:108:23:050
26107991613,2cyclictest4679-21kworker/u8:108:00:040
26107991613,2cyclictest314-21kworker/u8:209:25:040
26107991613,2cyclictest28826-21kworker/u8:109:45:040
26107991613,2cyclictest26311-21kworker/u8:007:15:050
26107991613,2cyclictest26311-21kworker/u8:007:10:040
26107991613,2cyclictest21601-21kworker/u8:110:21:040
26110991510,3cyclictest0-21swapper/311:15:173
2610999151,12cyclictest0-21swapper/210:55:222
2610999151,12cyclictest0-21swapper/208:40:232
26109991510,3cyclictest20115-21cut09:45:282
26107991512,2cyclictest7928-21kworker/u8:212:28:040
26107991512,2cyclictest314-21kworker/u8:209:19:040
26107991512,2cyclictest28826-21kworker/u8:109:05:030
26107991512,2cyclictest28826-21kworker/u8:109:02:040
26107991512,2cyclictest26097-21kworker/u8:010:03:040
26107991512,2cyclictest21601-21kworker/u8:110:29:040
26107991512,2cyclictest10630-21kworker/u8:211:13:030
2611099149,3cyclictest0-21swapper/307:10:133
2611099142,6cyclictest0-21swapper/311:30:003
2611099142,6cyclictest0-21swapper/307:30:013
26110991411,2cyclictest0-21swapper/311:00:173
2611099140,3cyclictest16723-21df11:05:143
2610999141,11cyclictest21125-21cut11:15:272
2610999141,11cyclictest14571-21cut09:30:272
2610999140,2cyclictest0-21swapper/207:55:162
2610999140,12cyclictest6248-21latency_hist09:10:002
2610999140,12cyclictest22343-21fschecks_time08:25:152
2611099132,6cyclictest0-21swapper/311:35:003
2611099132,6cyclictest0-21swapper/309:35:003
2611099131,6cyclictest0-21swapper/310:30:003
26110991310,2cyclictest0-21swapper/307:30:293
2611099130,2cyclictest0-21swapper/308:05:183
2611099130,2cyclictest0-21swapper/308:00:183
2611099130,12cyclictest0-21swapper/308:20:243
2610999132,6cyclictest0-21swapper/211:25:002
2610999132,6cyclictest0-21swapper/208:35:012
2610999132,6cyclictest0-21swapper/207:30:012
2610999131,7cyclictest0-21swapper/210:30:012
26109991310,2cyclictest31-21ksoftirqd/210:30:232
26109991310,2cyclictest0-21swapper/209:40:192
26109991310,2cyclictest0-21swapper/209:40:192
2610999130,2cyclictest29-21rcuc/209:20:002
2610999130,12cyclictest0-21swapper/212:20:262
2610999130,11cyclictest0-21swapper/210:00:252
26107991310,2cyclictest31345-21kworker/u8:107:25:040
2610799130,12cyclictest0-21swapper/010:05:000
245742130,2sleep20-21swapper/210:00:002
2611099129,2cyclictest0-21swapper/309:50:193
2611099129,2cyclictest0-21swapper/309:15:313
2611099129,2cyclictest0-21swapper/307:15:243
2611099122,6cyclictest0-21swapper/308:00:003
2611099121,5cyclictest0-21swapper/311:00:003
2611099120,2cyclictest0-21swapper/311:35:163
2611099120,11cyclictest0-21swapper/312:35:213
2611099120,11cyclictest0-21swapper/312:30:213
2611099120,11cyclictest0-21swapper/310:30:173
2611099120,11cyclictest0-21swapper/309:40:343
2611099120,11cyclictest0-21swapper/309:40:333
2611099120,11cyclictest0-21swapper/308:40:223
2611099120,11cyclictest0-21swapper/307:40:313
2611099120,11cyclictest0-21swapper/307:20:183
2610999129,2cyclictest26326-21apt-get07:10:132
2610999129,2cyclictest0-21swapper/208:05:222
2610999122,7cyclictest0-21swapper/212:16:012
2610999122,7cyclictest0-21swapper/210:45:022
2610999122,7cyclictest0-21swapper/208:19:012
2610999122,6cyclictest0-21swapper/211:55:282
2610999120,2cyclictest0-21swapper/212:35:232
2610999120,2cyclictest0-21swapper/208:00:242
2610999120,2cyclictest0-21swapper/207:35:192
2610999120,1cyclictest0-21swapper/208:50:272
2610999120,11cyclictest0-21swapper/212:25:382
2610999120,11cyclictest0-21swapper/211:50:252
2610999120,11cyclictest0-21swapper/210:15:322
2610999120,10cyclictest0-21swapper/207:15:272
2610899129,2cyclictest0-21swapper/108:50:181
2610799129,2cyclictest0-21swapper/008:55:180
2610799129,2cyclictest0-21swapper/008:35:150
2610799129,2cyclictest0-21swapper/007:55:220
2610799129,2cyclictest0-21swapper/007:20:210
2610799122,7cyclictest0-21swapper/008:26:580
115622120,2sleep311631-21memory10:50:223
2611099118,2cyclictest0-21swapper/310:05:163
2611099118,2cyclictest0-21swapper/308:10:283
2611099112,6cyclictest0-21swapper/311:50:003
2611099112,6cyclictest0-21swapper/308:36:583
2611099111,7cyclictest0-21swapper/310:24:583
2611099111,5cyclictest0-21swapper/312:00:003
2611099110,1cyclictest0-21swapper/309:05:283
2610999118,2cyclictest0-21swapper/209:50:192
2610999118,2cyclictest0-21swapper/207:30:262
2610999112,5cyclictest0-21swapper/210:50:302
2610999111,6cyclictest0-21swapper/211:40:182
2610999111,6cyclictest0-21swapper/211:02:392
2610999110,2cyclictest0-21swapper/210:35:222
2610999110,2cyclictest0-21swapper/208:10:202
2610999110,10cyclictest0-21swapper/212:30:152
2610999110,10cyclictest0-21swapper/212:10:342
2610999110,10cyclictest0-21swapper/209:35:232
2610999110,10cyclictest0-21swapper/209:35:232
2610799118,2cyclictest0-21swapper/009:55:210
2610799111,7cyclictest0-21swapper/011:17:010
2611099107,2cyclictest0-21swapper/310:45:253
2611099107,2cyclictest0-21swapper/309:35:163
2611099107,2cyclictest0-21swapper/309:35:163
2611099105,3cyclictest9124-21tr07:50:173
2611099105,3cyclictest31981-21ps08:50:223
2611099104,4cyclictest22282-21grep08:25:153
2611099103,5cyclictest0-21swapper/307:35:293
2611099102,5cyclictest0-21swapper/312:05:313
2611099102,5cyclictest0-21swapper/311:10:003
2611099102,5cyclictest0-21swapper/308:47:583
2611099101,5cyclictest0-21swapper/312:15:253
2611099100,6cyclictest0-21swapper/309:45:333
2610999107,2cyclictest29-21rcuc/211:45:282
2610999105,3cyclictest30556-21grep08:45:302
2610999105,3cyclictest0-21swapper/208:55:232
2610999104,4cyclictest12585-21tr09:25:202
2610999102,7cyclictest0-21swapper/209:00:012
2610999101,8cyclictest0-21swapper/207:50:252
2610999101,7cyclictest17424-21cut11:05:232
2610999101,7cyclictest0-21swapper/207:24:592
2610999101,6cyclictest4604-21gdm-simple-gree11:27:582
2610999100,9cyclictest0-21swapper/211:35:202
2610799107,2cyclictest0-21swapper/008:30:200
2610799102,6cyclictest4604-21gdm-simple-gree09:50:580
261109996,2cyclictest0-21swapper/312:20:263
261109996,2cyclictest0-21swapper/312:00:263
261109994,3cyclictest869-21cpuspeed_turbos11:50:193
261109994,3cyclictest7846-21iostat10:40:293
261109994,3cyclictest7324-21cpuspeed_turbos07:45:203
261109994,3cyclictest7082-21cron10:40:003
261109994,3cyclictest3077-21lldpd09:23:353
261109994,3cyclictest2798-21cut09:00:153
261109994,3cyclictest263922sleep310:04:223
261109994,3cyclictest250812sleep308:30:383
261109994,3cyclictest23337-21unixbench_singl11:20:333
261109994,3cyclictest19015-21open_inodes08:15:243
261109994,3cyclictest1418-21processes08:55:263
261109994,3cyclictest0-21swapper/312:25:253
261109994,3cyclictest0-21swapper/309:30:003
261109993,4cyclictest30761-21sed11:40:333
261099994,3cyclictest9184-21cpu10:45:202
261099994,3cyclictest7303-21cut07:45:202
261099994,3cyclictest30138-21latency_hist10:15:002
261099991,4cyclictest0-21swapper/212:03:012
261099991,3cyclictest0-21swapper/211:10:332
261099991,3cyclictest0-21swapper/210:05:172
261099990,6cyclictest0-21swapper/207:43:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional