You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-20 - 17:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel

x86 Intel Atom D510 @1667 MHz, Linux 3.12.61-rt81 (Profile)

Latency plot of shadow in rack #1, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack1slot6s.osadl.org (updated Mon Mar 20, 2023 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13997999412,9cyclictest1199-21runrttasks11:00:160
13997999136,10cyclictest24118-21cpuspeed_turbos10:05:020
1399799884,39cyclictest0-21swapper/010:00:090
13997998816,30cyclictest4145-21crond11:39:420
13997998730,10cyclictest17663-21cpuspeed_turbos07:35:050
1399799833,41cyclictest0-21swapper/010:25:120
234599820,7rtkit-daemon0-21swapper/006:40:412
1399799829,31cyclictest1143-21snmpd08:58:360
1399799825,27cyclictest0-21swapper/009:21:240
182662800,4sleep2281ktimersoftd/206:25:322
13997997916,12cyclictest0-21swapper/010:39:450
234599660,4rtkit-daemon0-21swapper/310:04:263
14007996645,14cyclictest31023-21gltestperf09:10:133
57092650,5sleep35711-21proc_pri11:40:163
234599650,9rtkit-daemon0-21swapper/310:18:183
234599650,9rtkit-daemon0-21swapper/310:18:183
234599650,8rtkit-daemon0-21swapper/308:58:213
234599650,8rtkit-daemon0-21swapper/306:58:183
234599650,8rtkit-daemon0-21swapper/306:58:183
234599650,4rtkit-daemon0-21swapper/310:33:103
234599650,4rtkit-daemon0-21swapper/309:45:193
234599650,4rtkit-daemon0-21swapper/309:45:193
234599650,4rtkit-daemon0-21swapper/308:25:073
234599650,4rtkit-daemon0-21swapper/308:25:073
234599650,4rtkit-daemon0-21swapper/308:18:153
234599650,4rtkit-daemon0-21swapper/307:14:173
234599650,3rtkit-daemon0-21swapper/308:30:443
1400199655,51cyclictest0-21swapper/108:58:361
234599640,9rtkit-daemon0-21swapper/309:39:343
234599640,9rtkit-daemon0-21swapper/309:18:053
234599640,9rtkit-daemon0-21swapper/308:00:013
234599640,8rtkit-daemon0-21swapper/310:59:463
234599640,8rtkit-daemon0-21swapper/310:51:463
234599640,8rtkit-daemon0-21swapper/307:27:023
234599640,7rtkit-daemon0-21swapper/311:38:303
234599640,7rtkit-daemon0-21swapper/310:49:163
234599640,7rtkit-daemon0-21swapper/307:20:023
234599640,4rtkit-daemon0-21swapper/311:49:073
234599640,4rtkit-daemon0-21swapper/311:27:073
234599640,4rtkit-daemon0-21swapper/309:58:483
234599640,4rtkit-daemon0-21swapper/307:06:183
234599640,3rtkit-daemon0-21swapper/311:23:383
234599640,2rtkit-daemon0-21swapper/310:08:183
234599640,2rtkit-daemon0-21swapper/308:51:213
234599640,2rtkit-daemon0-21swapper/306:54:413
234599640,10rtkit-daemon0-21swapper/309:40:343
234599640,10rtkit-daemon0-21swapper/309:32:123
234599640,10rtkit-daemon0-21swapper/308:44:443
234599640,10rtkit-daemon0-21swapper/308:22:153
234599630,9rtkit-daemon0-21swapper/310:10:253
234599630,9rtkit-daemon0-21swapper/308:45:143
234599630,8rtkit-daemon0-21swapper/310:25:553
234599630,8rtkit-daemon0-21swapper/308:36:373
234599630,7rtkit-daemon0-21swapper/310:43:323
234599630,7rtkit-daemon0-21swapper/309:50:263
234599630,5rtkit-daemon0-21swapper/308:10:083
234599630,4rtkit-daemon0-21swapper/311:14:303
234599630,4rtkit-daemon0-21swapper/310:35:473
234599630,4rtkit-daemon0-21swapper/310:20:333
234599630,4rtkit-daemon0-21swapper/308:07:303
234599630,3rtkit-daemon0-21swapper/311:34:003
234599630,3rtkit-daemon0-21swapper/310:55:013
234599630,3rtkit-daemon0-21swapper/310:55:013
234599630,3rtkit-daemon0-21swapper/309:27:123
234599630,3rtkit-daemon0-21swapper/309:06:133
234599630,3rtkit-daemon0-21swapper/309:06:133
234599630,2rtkit-daemon0-21swapper/307:01:253
234599630,2rtkit-daemon0-21swapper/307:01:253
234599630,11rtkit-daemon0-21swapper/309:21:123
1400199637,34cyclictest0-21swapper/109:29:501
234599620,7rtkit-daemon0-21swapper/311:05:233
234599620,3rtkit-daemon0-21swapper/311:14:453
234599620,3rtkit-daemon0-21swapper/307:19:173
1400199627,34cyclictest0-21swapper/107:54:541
234599610,4rtkit-daemon0-21swapper/306:48:413
1400199615,50cyclictest0-21swapper/111:40:211
924526010,42sleep00-21swapper/008:25:110
924526010,42sleep00-21swapper/008:25:110
2940826010,8sleep20-21swapper/206:50:162
1400199604,47cyclictest0-21swapper/111:09:261
173042593,10sleep10-21swapper/108:40:241
1400199595,48cyclictest0-21swapper/107:30:171
14001995922,13cyclictest0-21swapper/110:49:291
1400199585,28cyclictest0-21swapper/107:25:281
1400199584,48cyclictest0-21swapper/111:10:171
1400199584,35cyclictest0-21swapper/106:39:561
14001995822,13cyclictest0-21swapper/107:35:211
1399799583,38cyclictest0-21swapper/009:55:110
1400199575,29cyclictest0-21swapper/106:30:091
1400199575,28cyclictest0-21swapper/109:00:331
1400199575,28cyclictest0-21swapper/109:00:331
1400199573,40cyclictest0-21swapper/107:44:501
1400199573,40cyclictest0-21swapper/107:44:501
1400199573,33cyclictest0-21swapper/111:14:531
14001995721,13cyclictest0-21swapper/108:00:251
234599560,6rtkit-daemon2344-21rtkit-daemon07:35:162
1400599569,26cyclictest19379-21runrttasks06:30:112
1400599564,31cyclictest0-21swapper/211:30:122
1400199565,28cyclictest0-21swapper/110:40:301
1400199565,28cyclictest0-21swapper/107:10:291
1400199565,27cyclictest0-21swapper/109:40:271
1400199565,27cyclictest0-21swapper/107:05:281
1400199564,28cyclictest0-21swapper/110:15:021
1400199564,28cyclictest0-21swapper/110:15:021
1400199563,9cyclictest30963-21sendmail_mailqu11:25:161
1400199563,10cyclictest0-21swapper/108:10:111
14001995621,13cyclictest0-21swapper/110:05:261
14001995620,13cyclictest0-21swapper/108:45:251
14001995620,12cyclictest0-21swapper/109:20:171
160992553,8sleep316185-21cat07:30:203
14005995535,13cyclictest0-21swapper/209:50:112
1400199554,33cyclictest0-21swapper/108:50:151
1400199554,27cyclictest0-21swapper/109:55:131
14001995521,11cyclictest0-21swapper/111:00:311
14001995519,12cyclictest0-21swapper/109:44:561
14001995519,12cyclictest0-21swapper/109:44:561
83232544,43sleep00-21swapper/008:21:000
264502542,9sleep20-21swapper/207:51:562
1400599544,31cyclictest0-21swapper/207:04:562
1400599544,31cyclictest0-21swapper/207:04:562
1400199545,27cyclictest0-21swapper/109:08:361
1400199545,27cyclictest0-21swapper/109:08:361
1400199545,27cyclictest0-21swapper/108:25:281
1400199545,27cyclictest0-21swapper/108:25:281
1400199544,27cyclictest0-21swapper/107:03:031
1400199544,27cyclictest0-21swapper/107:03:031
1400199544,13cyclictest0-21swapper/111:30:111
14001995436,10cyclictest18523-21unixbench_multi09:50:231
13997995438,11cyclictest0-21swapper/008:15:170
133712549,34sleep20-21swapper/206:15:232
133712549,34sleep20-21swapper/206:15:232
87912533,9sleep10-21swapper/111:48:411
5032532,43sleep00-21swapper/011:30:100
23872537,39sleep02408-21basename09:19:500
234599530,5rtkit-daemon2344-21rtkit-daemon09:00:282
234599530,5rtkit-daemon2344-21rtkit-daemon09:00:282
234599530,5rtkit-daemon2344-21rtkit-daemon06:45:182
1400599534,31cyclictest0-21swapper/208:15:092
1400599534,30cyclictest0-21swapper/211:05:022
1400599534,30cyclictest0-21swapper/209:30:162
1400599533,31cyclictest0-21swapper/210:30:062
14005995320,13cyclictest0-21swapper/208:50:052
1400199534,27cyclictest0-21swapper/109:18:381
1400199534,26cyclictest0-21swapper/110:39:271
14001995338,9cyclictest4264-21tr08:15:081
13782533,13sleep10-21swapper/108:09:531
313702525,40sleep00-21swapper/008:04:270
279302525,40sleep00-21swapper/006:46:480
278892523,43sleep10-21swapper/106:46:161
234599520,5rtkit-daemon2344-21rtkit-daemon07:55:312
234599520,4rtkit-daemon2344-21rtkit-daemon06:20:272
1400599524,30cyclictest0-21swapper/206:35:152
1400599524,29cyclictest0-21swapper/210:45:032
1400599523,30cyclictest0-21swapper/211:04:442
1400199525,25cyclictest0-21swapper/108:23:231
1400199524,26cyclictest0-21swapper/110:29:081
14001995219,13cyclictest0-21swapper/107:50:151
13997995232,13cyclictest0-21swapper/010:40:270
13997995231,10cyclictest0-21swapper/009:46:240
13997995231,10cyclictest0-21swapper/009:46:240
306812512,9sleep00-21swapper/010:18:140
306812512,9sleep00-21swapper/010:18:140
290082512,9sleep30-21swapper/307:59:313
175932512,9sleep30-21swapper/306:25:223
1400799514,39cyclictest0-21swapper/306:35:213
1400599515,30cyclictest0-21swapper/211:45:112
1400599514,30cyclictest0-21swapper/208:20:112
1400599514,29cyclictest0-21swapper/211:15:032
1400599514,29cyclictest0-21swapper/210:10:252
1400599514,29cyclictest0-21swapper/209:45:192
1400599514,29cyclictest0-21swapper/209:45:192
1400599514,29cyclictest0-21swapper/209:25:032
1400599514,29cyclictest0-21swapper/207:30:062
1400599514,29cyclictest0-21swapper/207:25:162
1400599513,31cyclictest0-21swapper/208:25:282
1400599513,31cyclictest0-21swapper/208:25:282
14005995119,14cyclictest0-21swapper/210:49:572
1400199515,40cyclictest0-21swapper/107:20:111
1400199515,27cyclictest0-21swapper/110:54:291
1400199514,32cyclictest0-21swapper/111:21:201
1400199514,28cyclictest0-21swapper/108:35:181
1400199514,27cyclictest0-21swapper/110:04:461
1400199513,9cyclictest0-21swapper/111:35:091
1400199513,32cyclictest0-21swapper/110:23:121
14001995121,13cyclictest0-21swapper/108:30:131
1399799514,39cyclictest0-21swapper/007:10:320
13997995131,13cyclictest0-21swapper/009:05:220
13997995131,13cyclictest0-21swapper/009:05:220
1399799513,41cyclictest0-21swapper/011:05:060
1399799513,41cyclictest0-21swapper/009:35:170
1399799513,41cyclictest0-21swapper/007:53:380
234599500,4rtkit-daemon2344-21rtkit-daemon07:45:242
1400799504,27cyclictest0-21swapper/306:20:283
1400599504,38cyclictest0-21swapper/206:59:522
1400599504,38cyclictest0-21swapper/206:59:522
1400599504,29cyclictest0-21swapper/210:55:032
1400599504,29cyclictest0-21swapper/210:55:032
1400599504,29cyclictest0-21swapper/207:22:272
1400599504,28cyclictest0-21swapper/210:40:092
1400599504,28cyclictest0-21swapper/208:35:242
1400599504,28cyclictest0-21swapper/207:40:102
1400599504,28cyclictest0-21swapper/207:40:102
1400599504,28cyclictest0-21swapper/207:15:092
14005995034,9cyclictest22271-21grep10:00:092
1400199505,13cyclictest0-21swapper/107:45:241
1400199504,31cyclictest0-21swapper/106:55:211
1400199504,31cyclictest0-21swapper/106:55:211
1400199504,27cyclictest0-21swapper/106:40:211
1400199504,25cyclictest0-21swapper/109:37:001
14001995018,13cyclictest0-21swapper/110:34:461
55992492,40sleep20-21swapper/207:10:082
14007994931,11cyclictest25332-21unixbench-2d06:40:283
14007994919,12cyclictest0-21swapper/307:45:153
1400599495,28cyclictest0-21swapper/211:35:272
1400599494,28cyclictest0-21swapper/211:40:042
1400599494,28cyclictest0-21swapper/208:10:082
1400599494,27cyclictest0-21swapper/208:55:142
14005994934,9cyclictest2766-21cpuspeed_turbos09:20:022
14005994934,9cyclictest1877-21tail10:25:072
14005994934,10cyclictest0-21swapper/209:15:142
1400599493,29cyclictest0-21swapper/209:40:052
1400599493,28cyclictest0-21swapper/209:14:502
14005994918,13cyclictest0-21swapper/210:21:252
1400199495,28cyclictest0-21swapper/106:25:221
1400199494,25cyclictest0-21swapper/110:10:261
14001994918,12cyclictest0-21swapper/106:22:571
14001994916,13cyclictest0-21swapper/109:10:131
14001994913,20cyclictest0-21swapper/110:55:191
14001994913,20cyclictest0-21swapper/110:55:191
1399799494,39cyclictest0-21swapper/007:55:120
234599480,4rtkit-daemon2344-21rtkit-daemon09:04:513
234599480,4rtkit-daemon2344-21rtkit-daemon09:04:513
183982482,39sleep00-21swapper/006:25:520
1400599484,27cyclictest0-21swapper/211:24:342
1400599484,27cyclictest0-21swapper/210:14:552
1400599484,27cyclictest0-21swapper/210:14:552
1400599484,26cyclictest0-21swapper/211:10:002
1400599484,26cyclictest0-21swapper/208:03:172
1400599483,27cyclictest0-21swapper/208:45:122
1400599483,27cyclictest0-21swapper/208:40:122
1400599483,27cyclictest0-21swapper/208:05:142
14001994830,12cyclictest8769-21gltestperf07:15:121
1400199483,27cyclictest0-21swapper/106:50:271
1399799484,37cyclictest0-21swapper/008:10:310
13997994832,11cyclictest0-21swapper/008:05:200
13997994832,10cyclictest18534-21unixbench_multi09:50:230
1399799483,20cyclictest0-21swapper/007:34:460
13997994822,12cyclictest0-21swapper/009:00:150
13997994822,12cyclictest0-21swapper/009:00:150
93282472,39sleep00-21swapper/009:32:440
255972472,39sleep00-21swapper/006:42:120
223122472,38sleep00-21swapper/007:45:040
162402472,39sleep00-21swapper/006:23:340
1400799475,13cyclictest0-21swapper/307:35:173
1400799474,33cyclictest0-21swapper/306:31:273
1400599473,27cyclictest0-21swapper/211:29:352
14005994717,12cyclictest0-21swapper/209:59:332
1400199475,18cyclictest0-21swapper/109:30:101
1400199473,25cyclictest0-21swapper/106:19:571
1400199473,25cyclictest0-21swapper/106:19:571
13997994731,12cyclictest0-21swapper/007:00:170
13997994731,12cyclictest0-21swapper/007:00:170
13997994729,13cyclictest0-21swapper/006:50:140
13997994720,8cyclictest23450-21latency_hist06:39:560
51282462,38sleep20-21swapper/207:06:572
3822462,38sleep00-21swapper/006:59:130
3822462,38sleep00-21swapper/006:59:130
218732462,9sleep30-21swapper/307:43:553
218732462,9sleep30-21swapper/307:43:553
1399799463,36cyclictest0-21swapper/011:40:070
1399799463,18cyclictest0-21swapper/008:35:170
13997994623,18cyclictest0-21swapper/008:40:160
13997994616,23cyclictest27453-21ls10:10:200
55352452,37sleep00-21swapper/010:33:340
298682452,9sleep20-21swapper/209:09:152
298682452,9sleep20-21swapper/209:09:152
14005994530,10cyclictest0-21swapper/210:05:222
14005994528,10cyclictest10204-21tune2fs09:35:052
1399799454,34cyclictest0-21swapper/007:44:540
1399799454,34cyclictest0-21swapper/007:44:540
13997994530,10cyclictest0-21swapper/011:20:120
1399799453,12cyclictest0-21swapper/010:55:200
1399799453,12cyclictest0-21swapper/010:55:200
13997994528,12cyclictest0-21swapper/007:25:200
13997994527,12cyclictest0-21swapper/011:10:200
13997994526,13cyclictest0-21swapper/011:15:110
13997994522,10cyclictest7977-21munin-node07:15:160
14007994426,11cyclictest26221-21unixbench_multi07:50:253
1399799444,34cyclictest0-21swapper/010:50:130
1399799444,34cyclictest0-21swapper/010:20:100
121952443,35sleep00-21swapper/007:21:140
85992432,36sleep00-21swapper/011:46:100
1400599434,33cyclictest0-21swapper/208:30:272
14005994324,13cyclictest0-21swapper/210:35:022
1399799435,25cyclictest0-21swapper/009:10:230
1399799434,32cyclictest0-21swapper/008:49:500
13997994325,12cyclictest0-21swapper/011:24:570
1399799425,31cyclictest0-21swapper/008:50:170
1399799424,32cyclictest0-21swapper/010:45:360
1399799423,34cyclictest0-21swapper/006:30:170
1399799423,33cyclictest0-21swapper/006:19:570
1399799423,33cyclictest0-21swapper/006:19:570
1399799423,12cyclictest0-21swapper/008:34:520
13997994224,12cyclictest0-21swapper/009:40:100
13997994224,12cyclictest0-21swapper/009:25:160
1399799413,12cyclictest0-21swapper/007:05:230
14007993815,13cyclictest30340-1kworker/3:0H06:19:573
14007993815,13cyclictest30340-1kworker/3:0H06:19:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional