You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-31 - 05:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i7-M620 @2667 MHz, Linux 4.19.106-rt45+ (Profile)

Latency plot of shadow in rack #3, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Tue Jan 31, 2023 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12322211380,5sleep30-21swapper/319:06:223
12604211295,12sleep10-21swapper/119:09:571
12585210787,15sleep00-21swapper/019:09:440
1240729584,6sleep20-21swapper/219:07:252
225992820,4sleep01263699cyclictest23:35:230
120702720,0sleep00-21swapper/023:10:230
80672700,1sleep10-21swapper/123:00:231
71492260,1sleep10-21swapper/120:20:311
1263999220,20cyclictest0-21swapper/322:05:153
1263999210,19cyclictest0-21swapper/319:55:153
12636992118,2cyclictest0-21swapper/020:00:170
1263699210,19cyclictest0-21swapper/021:15:160
1263799200,18cyclictest0-21swapper/119:55:151
1263799190,17cyclictest0-21swapper/120:15:161
12637991815,2cyclictest208250irq/24-eth122:40:211
12638991713,2cyclictest0-21swapper/200:10:212
1263899161,3cyclictest0-21swapper/220:10:252
12638991613,2cyclictest12006-21taskset20:35:172
12638991612,3cyclictest0-21swapper/221:15:162
1263799161,13cyclictest17924-21apt-get23:25:141
1263799161,13cyclictest0-21swapper/120:55:231
12639991511,2cyclictest5430-21df_abs22:55:193
1263799151,3cyclictest3019-21hddtemp_smartct20:10:221
12637991510,3cyclictest17001-21unixbench_multi23:20:311
12637991510,3cyclictest0-21swapper/122:20:271
1263799150,3cyclictest0-21swapper/100:35:251
291772140,1sleep2301ktimersoftd/222:35:162
1263999142,6cyclictest0-21swapper/323:25:003
12639991410,2cyclictest0-21swapper/323:30:323
1263999140,3cyclictest1203-21fgrep00:00:333
1263999140,12cyclictest16546-21kworker/u8:019:31:043
1263999140,12cyclictest0-21swapper/322:10:273
1263899141,11cyclictest16707-21cut23:20:272
12638991410,2cyclictest0-21swapper/222:25:272
1263899140,12cyclictest0-21swapper/200:00:222
1263799142,6cyclictest0-21swapper/122:50:001
1263799142,6cyclictest0-21swapper/121:30:011
1263799142,6cyclictest0-21swapper/121:30:001
12637991411,2cyclictest0-21swapper/122:00:171
12637991411,2cyclictest0-21swapper/120:05:171
1263799140,3cyclictest0-21swapper/119:20:001
1263799140,13cyclictest0-21swapper/123:10:281
12636991411,2cyclictest0-21swapper/021:25:220
12636991411,2cyclictest0-21swapper/021:25:220
12636991410,2cyclictest20038-21cat19:29:590
1263699140,2cyclictest0-21swapper/019:25:000
1263699140,12cyclictest0-21swapper/019:10:140
142262130,2sleep00-21swapper/000:30:350
1263999132,6cyclictest0-21swapper/322:25:013
12639991310,2cyclictest0-21swapper/323:25:233
12639991310,2cyclictest0-21swapper/321:30:343
12639991310,2cyclictest0-21swapper/321:05:233
12639991310,2cyclictest0-21swapper/320:55:233
12639991310,2cyclictest0-21swapper/320:45:183
12639991310,2cyclictest0-21swapper/319:20:003
12639991310,2cyclictest0-21swapper/300:20:383
1263999130,2cyclictest27602-21latency_hist19:50:003
1263999130,2cyclictest0-21swapper/320:20:163
1263999130,12cyclictest0-21swapper/323:05:283
1263999130,12cyclictest0-21swapper/322:45:293
1263999130,12cyclictest0-21swapper/319:15:183
1263999130,11cyclictest24376-21kworker/u8:221:47:043
1263899131,10cyclictest11015-21cut20:30:282
1263899130,11cyclictest0-21swapper/223:45:282
1263899130,11cyclictest0-21swapper/220:05:192
1263899130,11cyclictest0-21swapper/219:45:242
1263799133,8cyclictest10165-21ntpdc23:05:231
1263799132,6cyclictest0-21swapper/120:35:001
1263799132,6cyclictest0-21swapper/120:35:001
1263799132,6cyclictest0-21swapper/119:40:001
1263799131,6cyclictest0-21swapper/121:20:011
12637991310,2cyclictest0-21swapper/123:48:341
12637991310,2cyclictest0-21swapper/121:52:131
12637991310,2cyclictest0-21swapper/121:19:381
12637991310,2cyclictest0-21swapper/100:23:531
1263799130,2cyclictest0-21swapper/123:50:211
1263799130,2cyclictest0-21swapper/123:31:281
1263699138,3cyclictest26967-21tail19:45:310
12636991310,2cyclictest0-21swapper/019:30:180
1263699130,2cyclictest0-21swapper/019:20:000
313322120,8sleep10-21swapper/120:00:171
298082120,8sleep00-21swapper/023:50:440
1263999129,2cyclictest0-21swapper/323:10:343
1263999129,2cyclictest0-21swapper/321:35:193
1263999129,2cyclictest0-21swapper/320:50:173
1263999129,2cyclictest0-21swapper/319:10:253
1263999128,2cyclictest0-21swapper/300:30:243
1263999127,3cyclictest0-21swapper/323:50:263
1263999122,6cyclictest0-21swapper/323:20:003
1263999122,5cyclictest0-21swapper/322:44:593
1263999120,2cyclictest0-21swapper/321:10:073
1263999120,2cyclictest0-21swapper/320:15:243
1263999120,2cyclictest0-21swapper/320:00:303
1263999120,2cyclictest0-21swapper/300:35:173
1263999120,2cyclictest0-21swapper/300:10:193
1263999120,11cyclictest0-21swapper/323:55:223
1263999120,11cyclictest0-21swapper/323:45:243
1263999120,11cyclictest0-21swapper/323:35:263
1263999120,11cyclictest0-21swapper/321:56:163
1263999120,11cyclictest0-21swapper/321:52:283
1263999120,11cyclictest0-21swapper/321:20:183
1263999120,11cyclictest0-21swapper/321:18:343
1263999120,11cyclictest0-21swapper/321:00:183
1263999120,11cyclictest0-21swapper/320:25:203
1263999120,11cyclictest0-21swapper/319:40:213
1263999120,11cyclictest0-21swapper/319:25:153
1263999120,11cyclictest0-21swapper/300:25:233
1263999120,11cyclictest0-21swapper/300:05:223
1263899129,2cyclictest0-21swapper/200:26:272
1263899128,2cyclictest0-21swapper/223:30:292
1263899122,8cyclictest0-21swapper/223:01:022
1263899122,6cyclictest0-21swapper/220:50:022
1263899120,2cyclictest0-21swapper/200:35:142
1263899120,2cyclictest0-21swapper/200:34:572
1263899120,10cyclictest0-21swapper/221:40:332
1263899120,10cyclictest0-21swapper/219:30:262
1263799129,2cyclictest0-21swapper/123:38:531
1263799129,2cyclictest0-21swapper/122:55:201
1263799129,2cyclictest0-21swapper/122:35:191
1263799129,2cyclictest0-21swapper/122:28:491
1263799129,2cyclictest0-21swapper/122:15:211
1263799129,2cyclictest0-21swapper/122:10:191
1263799129,2cyclictest0-21swapper/121:32:531
1263799129,2cyclictest0-21swapper/121:12:111
1263799129,2cyclictest0-21swapper/100:30:181
1263799129,2cyclictest0-21swapper/100:00:581
1263799122,7cyclictest0-21swapper/120:54:591
1263799121,9cyclictest0-21swapper/119:54:591
1263799121,6cyclictest0-21swapper/122:50:001
1263799121,3cyclictest9189-21fgrep20:25:271
1263799120,2cyclictest0-21swapper/123:41:551
1263799120,2cyclictest0-21swapper/123:15:351
1263799120,2cyclictest0-21swapper/119:10:201
1263799120,11cyclictest0-21swapper/122:05:001
1263799120,11cyclictest0-21swapper/121:48:411
1263799120,11cyclictest0-21swapper/100:17:221
1263799120,11cyclictest0-21swapper/100:10:001
1263799120,11cyclictest0-21swapper/100:05:571
1263799120,10cyclictest0-21swapper/121:35:211
1263699129,2cyclictest0-21swapper/022:55:300
1263699120,2cyclictest0-21swapper/022:45:290
1263699120,2cyclictest0-21swapper/020:30:210
1263699120,2cyclictest0-21swapper/000:20:280
1263699120,11cyclictest0-21swapper/021:10:240
1263699120,11cyclictest0-21swapper/020:20:420
251042110,2sleep20-21swapper/223:40:362
221772110,1sleep00-21swapper/022:18:280
1263999118,2cyclictest0-21swapper/320:35:183
1263999116,3cyclictest29050-21tr22:35:153
1263999110,2cyclictest0-21swapper/300:15:333
1263999110,1cyclictest0-21swapper/322:25:253
1263999110,10cyclictest28561-21kworker/u8:123:00:043
1263999110,10cyclictest0-21swapper/322:50:343
1263999110,10cyclictest0-21swapper/322:19:003
1263999110,10cyclictest0-21swapper/322:00:283
1263899118,2cyclictest0-21swapper/200:20:212
1263899118,2cyclictest0-21swapper/200:15:232
1263899116,3cyclictest0-21swapper/222:54:252
1263899113,6cyclictest0-21swapper/222:11:022
1263899112,7cyclictest0-21swapper/223:26:022
1263899112,7cyclictest0-21swapper/223:09:582
1263899112,7cyclictest0-21swapper/221:51:012
1263899112,7cyclictest0-21swapper/221:24:592
1263899112,7cyclictest0-21swapper/219:57:592
1263899112,7cyclictest0-21swapper/219:25:022
1263899112,6cyclictest0-21swapper/221:26:592
1263899112,6cyclictest0-21swapper/221:26:582
1263899112,6cyclictest0-21swapper/220:22:592
1263899112,6cyclictest0-21swapper/220:00:212
1263899111,7cyclictest4675-21gdm-simple-gree19:22:592
1263899111,3cyclictest0-21swapper/219:50:162
1263899110,2cyclictest0-21swapper/223:55:262
1263899110,2cyclictest0-21swapper/221:10:282
1263799118,2cyclictest0-21swapper/122:30:211
1263799118,2cyclictest0-21swapper/121:44:281
1263799112,5cyclictest0-21swapper/119:40:001
1263799111,8cyclictest11306-21df00:25:151
1263799111,3cyclictest0-21swapper/121:05:221
1263799110,9cyclictest0-21swapper/119:45:221
1263799110,10cyclictest0-21swapper/123:58:551
1263799110,10cyclictest0-21swapper/121:58:411
1263799110,10cyclictest0-21swapper/120:43:521
1263699118,2cyclictest0-21swapper/023:24:130
1263699118,2cyclictest0-21swapper/023:10:000
1263699118,2cyclictest0-21swapper/021:20:290
1263699118,2cyclictest0-21swapper/000:29:210
1263699112,6cyclictest0-21swapper/023:30:590
1263699110,7cyclictest0-21swapper/021:30:520
1263699110,2cyclictest0-21swapper/022:00:020
1263699110,10cyclictest0-21swapper/022:50:240
1263699110,10cyclictest0-21swapper/022:41:100
1263699110,10cyclictest0-21swapper/019:40:220
87442100,2sleep00-21swapper/000:19:370
86652100,7sleep20-21swapper/221:45:242
222142100,2sleep00-21swapper/021:00:300
1263999107,2cyclictest0-21swapper/320:10:253
1263999105,3cyclictest3840-21Xorg20:40:593
1263999105,3cyclictest32708-21grep21:25:313
1263999105,3cyclictest32708-21grep21:25:313
1263999105,3cyclictest1410-21grep20:05:253
1263999100,9cyclictest0-21swapper/323:42:563
1263999100,2cyclictest0-21swapper/321:40:163
1263899105,3cyclictest17149-21ps22:05:232
1263899104,4cyclictest28603-21grep23:50:192
1263899102,6cyclictest0-21swapper/222:59:582
1263899102,6cyclictest0-21swapper/222:00:582
1263899102,6cyclictest0-21swapper/220:25:282
1263899102,6cyclictest0-21swapper/200:06:292
1263899102,5cyclictest0-21swapper/223:15:202
1263899102,5cyclictest0-21swapper/223:11:022
1263899102,5cyclictest0-21swapper/221:39:592
1263899101,7cyclictest0-21swapper/220:47:022
1263899101,3cyclictest0-21swapper/222:20:002
1263899100,8cyclictest3403-21snmpd20:40:312
1263899100,8cyclictest0-21swapper/223:38:022
1263899100,6cyclictest0-21swapper/219:15:132
1263799107,2cyclictest0-21swapper/119:33:591
1263799105,3cyclictest0-21swapper/119:25:191
1263799102,6cyclictest0-21swapper/119:20:141
1263799100,8cyclictest0-21swapper/121:00:181
1263699107,2cyclictest0-21swapper/022:20:210
1263699107,2cyclictest0-21swapper/021:55:280
1263699107,2cyclictest0-21swapper/020:50:170
1263699107,2cyclictest0-21swapper/019:35:200
1263699107,2cyclictest0-21swapper/000:00:270
1263699103,6cyclictest0-21swapper/022:05:270
1263699102,6cyclictest0-21swapper/022:25:310
1263699102,5cyclictest0-21swapper/023:15:020
1263699102,2cyclictest0-21swapper/023:43:040
1263699102,2cyclictest0-21swapper/020:45:040
1263699101,6cyclictest4669-21metacity22:31:580
1263699100,7cyclictest0-21swapper/023:47:580
1263699100,7cyclictest0-21swapper/022:39:590
1263699100,7cyclictest0-21swapper/021:42:580
1263699100,7cyclictest0-21swapper/020:58:010
1263699100,7cyclictest0-21swapper/000:05:590
28926290,2sleep30-21swapper/319:50:573
126399996,2cyclictest0-21swapper/319:35:253
126399994,3cyclictest27848-21switchtime22:30:323
126399994,3cyclictest10905-21open_files20:30:253
126389994,3cyclictest913-21cpuspeed_turbos22:45:172
126389994,3cyclictest31746-21cat22:40:272
126389994,3cyclictest24623-21needreboot19:40:242
126389994,3cyclictest22192-21cpuspeed_turbos19:35:152
126389994,3cyclictest19875-21if_eth020:55:232
126389994,3cyclictest1294-21ssh21:30:022
126389992,6cyclictest0-21swapper/222:20:322
126389992,6cyclictest0-21swapper/219:13:012
126389992,5cyclictest0-21swapper/221:55:592
126389991,6cyclictest27724-21cut22:30:282
126379994,3cyclictest16161-21wc20:45:211
126369995,2cyclictest16061-21cat00:35:260
126369992,2cyclictest0-21swapper/020:11:040
126369991,6cyclictest23362-21cut21:05:190
126369991,6cyclictest0-21swapper/019:55:210
126369991,6cyclictest0-21swapper/019:50:580
126369990,8cyclictest0-21swapper/023:01:140
126369990,8cyclictest0-21swapper/000:12:480
126369990,6cyclictest4669-21metacity20:07:590
126369990,4cyclictest0-21swapper/021:54:040
126389984,2cyclictest0-21swapper/221:05:132
126389983,3cyclictest4570-21chrt20:15:072
126389983,3cyclictest21403-21cpuspeed_turbos21:00:162
126369985,2cyclictest0-21swapper/023:25:140
126369984,2cyclictest9414-21timerwakeupswit20:25:300
126369981,5cyclictest0-21swapper/020:40:320
126369981,4cyclictest0-21swapper/022:12:020
126369980,6cyclictest0-21swapper/023:55:300
126369980,6cyclictest0-21swapper/020:15:260
126369974,2cyclictest9225-21rm21:45:360
126369970,6cyclictest0-21swapper/020:35:030
126369970,4cyclictest0-21swapper/021:35:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional