You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-06 - 19:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel

x86 Intel Atom D510 @1667 MHz, Linux 3.12.61-rt81 (Profile)

Latency plot of shadow in rack #1, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Jul 06, 2022 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
273621290,4sleep12738-21find07:31:391
238199990,5rtkit-daemon0-21swapper/307:36:382
2931299904,24cyclictest0-21swapper/108:36:101
2931299903,22cyclictest6797-21fschecks_time07:41:281
29312999015,8cyclictest7533-21uniq08:51:261
238199870,5rtkit-daemon34-21rcuc/305:46:353
2931299863,22cyclictest1333-21snmpd06:50:141
2931299854,58cyclictest0-21swapper/107:17:011
2931299854,56cyclictest0-21swapper/109:51:301
2931299854,56cyclictest0-21swapper/109:51:301
2931299844,63cyclictest0-21swapper/105:15:421
2931299844,22cyclictest0-21swapper/110:11:221
2931299843,73cyclictest0-21swapper/105:26:171
29312998328,49cyclictest24288-21cpuspeed_turbos07:11:241
29312998230,45cyclictest2775-21cut08:41:261
29312998226,49cyclictest20462-21cpuspeed_turbos08:11:221
29312998225,49cyclictest27232-21timerwakeupswit06:06:471
29312998222,53cyclictest32078-21gltestperf07:26:301
29312998217,12cyclictest0-21swapper/106:45:311
2931299814,70cyclictest0-21swapper/109:51:071
2931299814,70cyclictest0-21swapper/105:41:421
2931299814,70cyclictest0-21swapper/105:41:421
2931299814,69cyclictest4606-21hwlatdetect07:36:301
2931299814,69cyclictest0-21swapper/108:46:341
29312998128,46cyclictest23270-21cut08:16:261
29312998125,49cyclictest29691-21cpuspeed_turbos05:06:301
29312998124,50cyclictest20100-21fschecks_count10:26:201
29312998122,52cyclictest15746-21gltestperf10:16:231
2931299804,68cyclictest0-21swapper/106:01:421
2931299803,70cyclictest0-21swapper/106:36:151
29312998026,47cyclictest591-21df_abs06:21:281
29312998026,47cyclictest591-21df_abs06:21:281
29312998022,51cyclictest10210-21hwlatdetect08:56:271
29312998021,52cyclictest21905-21cpuspeed_turbos07:06:251
2931299794,67cyclictest0-21swapper/110:31:181
29312997931,42cyclictest19620-21unixbench_multi08:06:431
29312997930,42cyclictest8521-21cut10:01:221
2931299793,21cyclictest1431-21runrttasks06:16:541
29312997927,46cyclictest19625-21head09:16:271
29312997924,48cyclictest12192-21fschecks_time05:36:331
29312997922,50cyclictest12392-21fschecks_time09:01:251
2931299784,56cyclictest0-21swapper/109:21:391
2931299783,66cyclictest22563-21unixbench-2d05:56:481
29312997825,45cyclictest0-21swapper/106:11:361
29312997823,48cyclictest15361-21fschecks_time06:51:301
29312997820,50cyclictest28444-21cpuspeed_turbos09:36:191
2931299779,12cyclictest0-21swapper/105:16:341
2931299774,23cyclictest0-21swapper/109:27:151
2931299774,12cyclictest0-21swapper/107:56:411
2931299773,24cyclictest0-21swapper/109:32:481
2931299773,16cyclictest25824-21gltestperf08:21:271
29312997723,47cyclictest6842-21fgrep09:56:361
29312997723,47cyclictest27530-21cpuspeed_turbos08:26:221
29312997723,47cyclictest27530-21cpuspeed_turbos08:26:221
29312997721,9cyclictest19367-21gltestperf05:51:331
29312997720,49cyclictest16631-21tr09:11:201
29312997720,49cyclictest16631-21tr09:11:201
2931299764,21cyclictest0-21swapper/110:06:341
2931299763,20cyclictest1431-21runrttasks09:46:021
29312997623,46cyclictest17785-21timerwakeupswit05:46:491
29312997622,10cyclictest1431-21runrttasks07:04:591
29312997622,10cyclictest1431-21runrttasks07:04:591
29312997614,9cyclictest17450-21cpuspeed_turbos10:21:171
29312997611,15cyclictest0-21swapper/108:01:431
2931299753,20cyclictest0-21swapper/107:51:291
29312997521,10cyclictest1431-21runrttasks06:57:571
238199750,6rtkit-daemon0-21swapper/207:09:542
2931299743,24cyclictest15912-21sshd09:07:331
2931299743,11cyclictest0-21swapper/105:31:301
29312997423,44cyclictest32280-21cut08:36:211
29312997416,9cyclictest8376-21gltestperf06:36:311
2931299733,23cyclictest29706-21grep07:21:321
29312997316,8cyclictest0-21swapper/106:26:271
29312997215,9cyclictest7501-21gltestperf05:26:361
238199720,9rtkit-daemon0-21swapper/207:11:242
29312997113,9cyclictest9147-21fschecks_time07:46:291
29312997113,9cyclictest9147-21fschecks_time07:46:291
238199710,8rtkit-daemon0-21swapper/206:51:322
238199700,8rtkit-daemon0-21swapper/206:15:192
238199700,6rtkit-daemon0-21swapper/207:04:242
238199700,6rtkit-daemon0-21swapper/207:04:242
238199700,6rtkit-daemon0-21swapper/205:36:352
2931399696,24cyclictest0-21swapper/207:51:122
2931399696,24cyclictest0-21swapper/207:51:122
238199690,9rtkit-daemon0-21swapper/206:26:262
238199680,9rtkit-daemon0-21swapper/305:31:352
29309996726,16cyclictest0-21swapper/010:01:080
238199670,9rtkit-daemon0-21swapper/205:41:423
238199670,9rtkit-daemon0-21swapper/205:41:423
238199670,7rtkit-daemon0-21swapper/206:11:263
238199670,7rtkit-daemon0-21swapper/205:54:423
238199670,7rtkit-daemon0-21swapper/205:06:513
238199660,6rtkit-daemon0-21swapper/207:51:453
238199650,7rtkit-daemon0-21swapper/207:43:452
238199650,7rtkit-daemon0-21swapper/207:26:232
238199650,7rtkit-daemon0-21swapper/207:00:392
238199650,6rtkit-daemon0-21swapper/206:33:182
238199650,6rtkit-daemon0-21swapper/206:20:482
29309996444,13cyclictest0-21swapper/005:06:460
238199640,7rtkit-daemon0-21swapper/207:23:082
238199640,7rtkit-daemon0-21swapper/206:42:252
238199640,7rtkit-daemon0-21swapper/205:21:212
238199640,6rtkit-daemon0-21swapper/207:51:222
238199640,6rtkit-daemon0-21swapper/206:40:402
238199640,6rtkit-daemon0-21swapper/206:22:562
238199640,6rtkit-daemon0-21swapper/206:22:562
238199640,6rtkit-daemon0-21swapper/205:56:343
238199640,6rtkit-daemon0-21swapper/205:28:052
238199640,6rtkit-daemon0-21swapper/205:18:062
238199640,5rtkit-daemon0-21swapper/305:16:513
238199640,5rtkit-daemon0-21swapper/207:18:162
238199640,5rtkit-daemon0-21swapper/205:12:513
206262643,11sleep00-21swapper/009:17:230
2931299636,18cyclictest0-21swapper/105:06:191
238199630,6rtkit-daemon0-21swapper/206:46:322
29314996212,43cyclictest31906-21runrttasks08:36:103
29309996246,10cyclictest8678-21grep08:51:420
238199620,6rtkit-daemon0-21swapper/305:31:433
238199610,9rtkit-daemon0-21swapper/009:00:420
238199610,7rtkit-daemon0-21swapper/009:04:350
238199610,6rtkit-daemon0-21swapper/205:38:203
238199610,5rtkit-daemon13181-21munin-node07:56:453
2931399603,49cyclictest0-21swapper/209:06:322
29309996039,14cyclictest0-21swapper/005:16:490
238199600,9rtkit-daemon0-21swapper/009:29:410
238199600,9rtkit-daemon0-21swapper/009:22:560
238199600,9rtkit-daemon0-21swapper/009:11:340
238199600,9rtkit-daemon0-21swapper/009:11:340
238199600,9rtkit-daemon0-21swapper/008:49:130
238199600,9rtkit-daemon0-21swapper/008:27:360
238199600,9rtkit-daemon0-21swapper/008:27:360
238199600,8rtkit-daemon0-21swapper/010:32:540
238199600,8rtkit-daemon0-21swapper/008:43:050
238199600,8rtkit-daemon0-21swapper/008:11:590
238199600,7rtkit-daemon0-21swapper/008:40:500
238199600,7rtkit-daemon0-21swapper/008:07:220
238199600,6rtkit-daemon0-21swapper/207:30:163
238199600,3rtkit-daemon0-21swapper/010:30:540
238199600,3rtkit-daemon0-21swapper/010:13:020
238199600,3rtkit-daemon0-21swapper/010:06:250
238199600,3rtkit-daemon0-21swapper/010:01:320
29314995919,32cyclictest1431-21runrttasks07:01:433
29314995919,32cyclictest1431-21runrttasks07:01:433
238199590,8rtkit-daemon0-21swapper/010:16:390
238199590,8rtkit-daemon0-21swapper/008:31:580
238199590,7rtkit-daemon0-21swapper/009:41:410
238199590,7rtkit-daemon0-21swapper/009:31:480
238199590,6rtkit-daemon0-21swapper/008:01:220
238199590,3rtkit-daemon0-21swapper/009:07:190
238199590,2rtkit-daemon0-21swapper/009:36:560
238199590,10rtkit-daemon0-21swapper/010:21:090
68412580,6sleep334-21rcuc/307:41:283
2930999584,34cyclictest0-21swapper/007:06:140
2930999584,34cyclictest0-21swapper/007:06:140
154762583,13sleep20-21swapper/205:41:492
154762583,13sleep20-21swapper/205:41:492
13522583,48sleep00-21swapper/009:46:250
66452573,47sleep00-21swapper/006:31:450
238199570,2rtkit-daemon0-21swapper/008:16:140
110302570,12sleep041ktimersoftd/006:41:360
2931499564,32cyclictest0-21swapper/306:20:403
2930999565,32cyclictest0-21swapper/008:26:100
29309995640,10cyclictest0-21swapper/007:21:390
29309995638,11cyclictest2037-21taskset07:31:290
29309995637,12cyclictest22457-21chrt07:06:310
151922564,10sleep00-21swapper/007:59:320
51912553,11sleep00-21swapper/009:56:000
51912553,11sleep00-21swapper/009:56:000
29313995539,9cyclictest25415-21crond06:06:152
29309995535,13cyclictest0-21swapper/005:41:440
29309995535,13cyclictest0-21swapper/005:41:440
182142554,43sleep00-21swapper/005:50:090
40792543,44sleep00-21swapper/006:26:410
323112543,10sleep00-21swapper/006:18:390
2931399543,45cyclictest0-21swapper/205:06:372
29313995421,12cyclictest0-21swapper/208:01:212
2930999544,42cyclictest0-21swapper/007:46:380
2930999544,42cyclictest0-21swapper/007:46:380
86202532,11sleep00-21swapper/005:28:330
2931499535,30cyclictest0-21swapper/309:29:503
2931499534,41cyclictest0-21swapper/308:01:383
2931499534,30cyclictest0-21swapper/308:16:423
2931499534,28cyclictest0-21swapper/308:46:103
29314995337,10cyclictest15524-21sed06:51:323
29314995335,11cyclictest4764-21tr08:46:203
29314995321,23cyclictest0-21swapper/307:06:323
29314995310,27cyclictest0-21swapper/308:14:003
29313995320,13cyclictest0-21swapper/209:21:322
29309995337,10cyclictest0-21swapper/005:39:050
29309995335,11cyclictest3887-21cpuspeed_turbos07:36:230
204632532,11sleep00-21swapper/005:53:400
13532533,43sleep00-21swapper/006:21:370
13532533,43sleep00-21swapper/006:21:370
312512523,10sleep00-21swapper/007:26:190
2931499524,22cyclictest0-21swapper/307:46:273
2931499524,22cyclictest0-21swapper/307:46:273
29314995233,11cyclictest12281-21grep09:01:243
29314995210,35cyclictest390-21fschecks_time08:36:263
29314995210,34cyclictest29560-21grep07:21:303
2931399525,27cyclictest0-21swapper/209:35:362
2931399524,29cyclictest0-21swapper/209:56:192
2931399524,29cyclictest0-21swapper/209:31:072
2931399524,29cyclictest0-21swapper/208:36:222
2931399524,28cyclictest0-21swapper/210:01:192
2931399524,28cyclictest0-21swapper/209:16:352
2931399524,28cyclictest0-21swapper/209:11:232
2931399524,28cyclictest0-21swapper/209:11:232
2931399524,28cyclictest0-21swapper/208:46:352
2931399523,26cyclictest0-21swapper/209:00:332
29313995222,24cyclictest0-21swapper/208:11:412
165452523,43sleep00-21swapper/006:52:570
2931499517,25cyclictest0-21swapper/309:31:383
2931499515,39cyclictest0-21swapper/309:16:093
2931499515,39cyclictest0-21swapper/309:16:093
2931499515,31cyclictest0-21swapper/306:23:103
2931499515,31cyclictest0-21swapper/306:23:103
2931499514,29cyclictest0-21swapper/310:21:263
2931499514,28cyclictest0-21swapper/308:11:113
29314995121,13cyclictest0-21swapper/308:26:323
29314995121,13cyclictest0-21swapper/308:26:323
2931399514,39cyclictest32504-21cut05:11:482
2931399514,29cyclictest0-21swapper/205:54:432
2931399514,28cyclictest0-21swapper/210:06:222
2931399514,28cyclictest0-21swapper/208:33:412
2931399514,27cyclictest0-21swapper/208:51:352
2930999514,29cyclictest0-21swapper/005:56:380
2930999514,29cyclictest0-21swapper/005:21:360
2931499508,26cyclictest4871-21fschecks_count05:21:323
2931499507,36cyclictest30721-21awk09:41:183
2931499507,26cyclictest0-21swapper/307:01:143
2931499505,37cyclictest0-21swapper/309:54:313
2931499505,37cyclictest0-21swapper/309:54:313
2931499504,36cyclictest0-21swapper/308:54:383
29314995019,13cyclictest0-21swapper/308:56:293
2931399504,28cyclictest0-21swapper/207:56:402
2931399504,27cyclictest0-21swapper/210:21:342
2931399504,27cyclictest0-21swapper/205:56:312
2931399504,26cyclictest0-21swapper/206:06:462
2931399503,34cyclictest0-21swapper/208:41:202
2930999504,38cyclictest30159-21munin-run06:16:150
2930999504,28cyclictest0-21swapper/007:41:320
2930999504,27cyclictest0-21swapper/007:16:560
2931499494,29cyclictest0-21swapper/306:41:293
2931499494,28cyclictest0-21swapper/307:11:443
2931499494,28cyclictest0-21swapper/306:46:293
2931499494,28cyclictest0-21swapper/306:26:303
2931499494,27cyclictest0-21swapper/309:46:333
29314994931,11cyclictest14828-21fschecks_time09:06:253
29314994920,12cyclictest0-21swapper/306:01:453
29314994919,13cyclictest0-21swapper/310:06:243
2931399494,28cyclictest0-21swapper/208:06:252
2931399494,27cyclictest0-21swapper/210:26:162
2931399494,27cyclictest0-21swapper/210:16:192
2931399493,28cyclictest0-21swapper/208:16:242
2931399493,26cyclictest0-21swapper/209:05:372
2930999495,27cyclictest0-21swapper/006:01:360
29309994930,12cyclictest0-21swapper/007:51:280
29309994927,14cyclictest0-21swapper/006:36:460
2931499487,22cyclictest8962-21cat05:31:183
2931499486,33cyclictest0-21swapper/307:31:393
2931499485,11cyclictest23289-21munin-run09:26:083
2931499484,26cyclictest0-21swapper/310:20:303
2931499484,26cyclictest0-21swapper/307:36:333
2931499484,24cyclictest7339-21munin-run06:36:153
29314994831,11cyclictest22830-21gltestperf10:31:233
29314994813,11cyclictest0-21swapper/308:21:373
2931499481,40cyclictest7479-21chrt09:59:453
2931399484,28cyclictest0-21swapper/208:28:062
2931399484,28cyclictest0-21swapper/208:28:062
2931399484,26cyclictest0-21swapper/210:15:482
2931399484,26cyclictest0-21swapper/209:51:182
2931399484,26cyclictest0-21swapper/209:51:182
29313994818,12cyclictest0-21swapper/210:31:182
29313994817,13cyclictest0-21swapper/205:46:402
29313994817,12cyclictest0-21swapper/207:31:432
2930999484,27cyclictest0-21swapper/005:12:040
2930999484,26cyclictest0-21swapper/006:10:440
2930999483,27cyclictest0-21swapper/006:51:140
261052483,10sleep00-21swapper/007:13:580
2931399474,24cyclictest0-21swapper/209:46:202
29313994717,14cyclictest0-21swapper/208:25:392
2930999474,27cyclictest0-21swapper/006:56:330
2931499465,34cyclictest0-21swapper/309:16:333
2931499465,33cyclictest0-21swapper/306:36:393
2931499464,25cyclictest0-21swapper/310:15:483
2931499464,25cyclictest0-21swapper/305:06:193
29314994630,10cyclictest8595-21gltestperf10:01:233
2931499463,27cyclictest0-21swapper/306:06:283
2931399464,12cyclictest0-21swapper/209:41:072
2930999464,35cyclictest0-21swapper/005:31:370
2931499454,33cyclictest0-21swapper/310:26:183
2931499454,32cyclictest29103-21cut09:36:263
2931499454,13cyclictest0-21swapper/307:16:433
2931399458,9cyclictest31155-21fschecks_count09:41:232
289312433,33sleep00-21swapper/005:01:500
2931399364,23cyclictest0-21swapper/205:06:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional