You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-06-16 - 22:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel

Intel(R) Atom(TM) CPU D510 @ 1.66GHz, Linux 3.12.61-rt81 (Profile)

Latency plot of shadow in rack #1, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack1slot6s.osadl.org (updated Wed Jun 16, 2021 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30673991187,44cyclictest0-21swapper/108:34:471
231899910,5rtkit-daemon2317-21rtkit-daemon09:07:413
231899900,6rtkit-daemon2317-21rtkit-daemon12:14:561
3067599895,26cyclictest0-21swapper/208:38:362
3067599893,34cyclictest0-21swapper/211:45:052
30675998928,9cyclictest1402-21runrttasks07:30:012
30675998924,15cyclictest0-21swapper/209:36:142
3067599883,32cyclictest2501-21tune2fs08:05:052
3067599883,32cyclictest2501-21tune2fs08:05:052
3067599875,33cyclictest0-21swapper/210:05:072
3067599874,33cyclictest0-21swapper/207:20:172
3067599874,33cyclictest0-21swapper/207:10:042
3067599874,26cyclictest0-21swapper/210:23:542
30675998720,13cyclictest0-21swapper/209:45:062
30675998720,13cyclictest0-21swapper/209:45:062
30675998720,13cyclictest0-21swapper/208:15:122
3067599864,33cyclictest0-21swapper/210:40:002
3067599863,28cyclictest0-21swapper/210:55:002
30675998620,12cyclictest0-21swapper/212:14:582
3067599854,36cyclictest0-21swapper/211:04:412
3067599854,35cyclictest0-21swapper/210:00:132
30675998521,12cyclictest0-21swapper/208:04:482
3067599844,29cyclictest0-21swapper/208:30:182
30675998424,53cyclictest0-21swapper/209:09:562
231899840,6rtkit-daemon2317-21rtkit-daemon08:13:431
231899840,5rtkit-daemon2317-21rtkit-daemon11:44:501
231899840,27rtkit-daemon32013-21munin-node09:05:180
3067599834,35cyclictest0-21swapper/209:25:152
3067599834,35cyclictest0-21swapper/207:54:482
30675998327,11cyclictest8479-21grep10:34:532
30675998327,11cyclictest8479-21grep10:34:532
30675998325,13cyclictest0-21swapper/211:23:022
30675998325,13cyclictest0-21swapper/211:23:022
3067599824,34cyclictest0-21swapper/208:50:132
3067599824,29cyclictest0-21swapper/210:10:222
30675998224,13cyclictest0-21swapper/208:55:362
30675998224,13cyclictest0-21swapper/208:55:362
30675998220,25cyclictest0-21swapper/207:15:242
30675998220,25cyclictest0-21swapper/207:15:242
231899820,4rtkit-daemon2317-21rtkit-daemon09:08:481
231899820,26rtkit-daemon27045-21threads08:55:340
231899820,26rtkit-daemon27045-21threads08:55:340
3067599814,36cyclictest0-21swapper/210:29:422
3067599814,32cyclictest0-21swapper/211:25:042
30675998124,12cyclictest0-21swapper/209:29:582
3067599804,27cyclictest0-21swapper/212:10:092
231899800,23rtkit-daemon5720-21munin-node07:05:300
3067599794,35cyclictest0-21swapper/210:29:592
3067599794,35cyclictest0-21swapper/210:29:592
3067599794,35cyclictest0-21swapper/209:55:032
3067599794,33cyclictest0-21swapper/207:29:512
3067599793,34cyclictest0-21swapper/211:55:092
3067599793,28cyclictest0-21swapper/208:20:192
3067599784,35cyclictest0-21swapper/207:49:482
3067599784,34cyclictest0-21swapper/212:00:052
3067599784,34cyclictest0-21swapper/210:14:542
3067599784,34cyclictest0-21swapper/209:00:092
3067599784,33cyclictest0-21swapper/208:25:042
3067599783,33cyclictest0-21swapper/207:35:042
3067599774,32cyclictest0-21swapper/211:09:572
3067599774,12cyclictest20756-21cat09:50:142
3067599774,12cyclictest0-21swapper/211:15:072
3067599773,25cyclictest0-21swapper/212:09:382
30675997729,9cyclictest4804-21fschecks_time08:10:052
30675997729,10cyclictest30867-21fschecks_time09:05:022
3067599763,12cyclictest0-21swapper/211:35:042
231899760,6rtkit-daemon2317-21rtkit-daemon08:02:363
3067599735,14cyclictest0-21swapper/206:50:162
3067599734,12cyclictest0-21swapper/207:55:202
231899720,5rtkit-daemon2317-21rtkit-daemon08:44:573
231899700,7rtkit-daemon12936-21fschecks_time09:35:020
145322703,14sleep00-21swapper/008:30:050
231899690,6rtkit-daemon2317-21rtkit-daemon08:31:273
231899680,6rtkit-daemon2317-21rtkit-daemon10:19:533
231899680,6rtkit-daemon2317-21rtkit-daemon09:29:403
231899680,6rtkit-daemon2317-21rtkit-daemon08:29:353
231899680,4rtkit-daemon2317-21rtkit-daemon07:50:063
3067599672,17cyclictest0-21swapper/210:45:112
231899670,6rtkit-daemon16690-21ls07:25:220
231899670,6rtkit-daemon0-21swapper/111:48:120
231899670,5rtkit-daemon2317-21rtkit-daemon10:30:003
231899670,5rtkit-daemon2317-21rtkit-daemon10:30:003
231899670,4rtkit-daemon2317-21rtkit-daemon08:41:343
61462667,50sleep10-21swapper/110:29:541
61462667,50sleep10-21swapper/110:29:541
231899660,5rtkit-daemon2317-21rtkit-daemon11:41:273
231899660,4rtkit-daemon2317-21rtkit-daemon11:36:203
231899660,4rtkit-daemon2317-21rtkit-daemon11:34:283
231899660,4rtkit-daemon2317-21rtkit-daemon09:47:023
231899660,4rtkit-daemon2317-21rtkit-daemon09:47:023
231899660,4rtkit-daemon2317-21rtkit-daemon08:35:203
231899660,4rtkit-daemon2317-21rtkit-daemon08:17:503
231899660,4rtkit-daemon2317-21rtkit-daemon06:49:543
231899650,4rtkit-daemon2317-21rtkit-daemon09:33:403
72452640,6sleep27243-21ls07:05:292
3066999645,14cyclictest0-21swapper/007:36:200
231899640,6rtkit-daemon8298-21munin-node10:35:070
231899640,6rtkit-daemon8298-21munin-node10:35:070
231899640,6rtkit-daemon13995-21cpuspeed11:54:490
231899640,32rtkit-daemon18546-21perl10:54:591
3067699638,46cyclictest0-21swapper/309:59:443
30669996310,20cyclictest0-21swapper/009:14:470
231899630,7rtkit-daemon0-21swapper/111:13:060
231899630,6rtkit-daemon0-21swapper/110:49:520
30669996243,12cyclictest32294-21grep10:15:070
231899620,7rtkit-daemon0-21swapper/308:40:040
231899620,6rtkit-daemon0-21swapper/309:40:172
125942625,50sleep10-21swapper/110:41:591
30676995934,17cyclictest14293-21crond09:39:443
231899590,7rtkit-daemon0-21swapper/311:42:202
231899590,7rtkit-daemon0-21swapper/308:45:190
231899590,6rtkit-daemon0-21swapper/308:42:042
231899590,14rtkit-daemon2317-21rtkit-daemon08:20:203
313972584,46sleep00-21swapper/011:20:160
313972584,46sleep00-21swapper/011:20:160
3066999588,40cyclictest0-21swapper/008:52:280
82052576,44sleep10-21swapper/111:40:081
3066999574,36cyclictest0-21swapper/008:09:590
283812573,47sleep00-21swapper/010:08:120
231899570,6rtkit-daemon0-21swapper/311:33:352
15072574,46sleep00-21swapper/010:19:570
30676995639,10cyclictest5892-21head09:20:033
30676995521,15cyclictest0-21swapper/307:24:503
3067599553,45cyclictest0-21swapper/209:20:032
3066999555,30cyclictest0-21swapper/009:34:440
30669995524,24cyclictest0-21swapper/011:59:590
165002553,45sleep00-21swapper/009:42:290
3067399544,29cyclictest0-21swapper/109:24:451
3066999544,31cyclictest0-21swapper/009:00:040
30669995436,11cyclictest357-21grep11:24:570
3067699535,28cyclictest0-21swapper/310:34:593
3067699535,28cyclictest0-21swapper/310:34:593
30676995339,8cyclictest16355-21if_eth010:49:593
3067399535,28cyclictest0-21swapper/111:55:091
3067399534,31cyclictest0-21swapper/109:40:201
3066999535,28cyclictest0-21swapper/007:50:010
30669995339,9cyclictest18241-21processes09:45:120
30669995339,9cyclictest18241-21processes09:45:120
30669995334,12cyclictest8471-21unixbench_multi11:40:110
30669995332,13cyclictest2251-21sort08:05:040
30669995332,13cyclictest2251-21sort08:05:040
293292533,42sleep00-21swapper/011:19:150
116592534,42sleep00-21swapper/010:40:090
45702523,42sleep00-21swapper/009:16:160
30676995233,12cyclictest4218-21tail07:00:133
3067399525,29cyclictest0-21swapper/108:20:121
3067399524,30cyclictest0-21swapper/111:00:041
3067399524,30cyclictest0-21swapper/109:45:111
3067399524,30cyclictest0-21swapper/109:45:111
3067399524,29cyclictest0-21swapper/107:00:181
30673995236,10cyclictest15569-21tr10:49:511
30673995235,10cyclictest22473-21tail08:45:181
3066999525,30cyclictest0-21swapper/006:58:000
3066999525,29cyclictest0-21swapper/008:35:100
3066999525,28cyclictest0-21swapper/010:45:010
3066999525,28cyclictest0-21swapper/010:24:580
3066999524,29cyclictest0-21swapper/011:29:490
3066999524,29cyclictest0-21swapper/009:50:120
3066999524,29cyclictest0-21swapper/007:30:230
30669995236,9cyclictest6172-21unixbench_singl11:35:110
30669995233,11cyclictest13469-21tune2fs07:20:090
30669995222,23cyclictest0-21swapper/006:52:290
231899520,5rtkit-daemon2317-21rtkit-daemon12:13:343
211532522,42sleep10-21swapper/109:51:281
3067699516,27cyclictest0-21swapper/309:50:053
3067699514,39cyclictest0-21swapper/309:00:153
3067699514,28cyclictest0-21swapper/310:25:133
30676995137,8cyclictest16356-21grep07:25:153
30676995133,10cyclictest11721-21tr11:49:543
30676995120,13cyclictest0-21swapper/309:44:443
3067599513,40cyclictest0-21swapper/211:09:412
3067399514,29cyclictest0-21swapper/111:19:581
3067399514,29cyclictest0-21swapper/111:19:581
3067399514,29cyclictest0-21swapper/111:04:551
3067399514,29cyclictest0-21swapper/109:55:051
3067399514,29cyclictest0-21swapper/108:00:261
3067399514,28cyclictest0-21swapper/107:10:311
30673995120,13cyclictest0-21swapper/109:35:131
3066999514,30cyclictest0-21swapper/010:55:000
3066999514,28cyclictest0-21swapper/007:55:240
3066999514,28cyclictest0-21swapper/007:40:080
3066999514,28cyclictest0-21swapper/007:00:100
30669995133,11cyclictest8464-21df07:10:060
306222513,9sleep00-21swapper/010:11:310
3067699505,27cyclictest0-21swapper/311:10:103
30676995032,11cyclictest23328-21gltestperf11:04:583
3067399504,28cyclictest0-21swapper/112:00:001
3067399504,28cyclictest0-21swapper/110:15:051
3067399504,28cyclictest0-21swapper/110:05:021
3067399504,28cyclictest0-21swapper/107:30:041
3067399504,23cyclictest0-21swapper/108:50:161
3067399503,28cyclictest491-21taskset09:09:581
30673995015,12cyclictest0-21swapper/107:52:231
3066999505,28cyclictest0-21swapper/009:20:060
3066999504,28cyclictest0-21swapper/008:20:220
3066999504,28cyclictest0-21swapper/008:19:480
3066999504,28cyclictest0-21swapper/008:00:090
3066999504,28cyclictest0-21swapper/007:45:030
3066999504,27cyclictest0-21swapper/007:15:170
3066999504,27cyclictest0-21swapper/007:15:170
258892503,9sleep00-21swapper/010:01:310
252342503,41sleep00-21swapper/012:16:190
231899500,32rtkit-daemon29001-21users11:15:131
218892500,7chrt0-21swapper/012:10:010
205732503,9sleep00-21swapper/012:07:120
3067699495,27cyclictest0-21swapper/310:48:583
3067699494,27cyclictest0-21swapper/312:04:583
3067699492,41cyclictest0-21swapper/310:00:093
3067599492,41cyclictest0-21swapper/208:44:592
3067399494,28cyclictest0-21swapper/111:29:561
3067399494,28cyclictest0-21swapper/108:40:091
3067399494,28cyclictest0-21swapper/107:45:181
3067399494,28cyclictest0-21swapper/106:55:081
3067399494,27cyclictest0-21swapper/110:10:191
3067399494,27cyclictest0-21swapper/108:24:571
3067399494,27cyclictest0-21swapper/107:25:131
3067399494,27cyclictest0-21swapper/106:50:271
3067399493,27cyclictest27661-21systemd-cgroups08:59:461
3067399493,27cyclictest27661-21systemd-cgroups08:59:461
30673994919,13cyclictest0-21swapper/111:50:011
3066999495,27cyclictest0-21swapper/010:33:560
3066999495,27cyclictest0-21swapper/010:33:560
3066999494,27cyclictest0-21swapper/011:50:020
3066999494,27cyclictest0-21swapper/011:04:410
231899490,31rtkit-daemon20903-21irqstats07:35:141
231899490,30rtkit-daemon10061-21users10:35:151
231899490,30rtkit-daemon10061-21users10:35:151
221822493,9sleep30-21swapper/311:03:383
132952493,9sleep00-21swapper/008:28:080
313572483,10sleep30-21swapper/307:57:473
30676994831,10cyclictest14755-21gltestperf11:54:563
30676994821,11cyclictest0-21swapper/310:18:533
30676994820,12cyclictest0-21swapper/310:04:533
30676994816,25cyclictest23980-21unixbench_singl07:40:223
30676994816,13cyclictest0-21swapper/307:15:273
30676994816,13cyclictest0-21swapper/307:15:273
30676994812,20cyclictest34-21rcuc/306:49:513
3067399484,28cyclictest0-21swapper/109:15:151
3067399484,27cyclictest0-21swapper/109:28:371
3067399484,27cyclictest0-21swapper/108:39:151
3067399484,26cyclictest0-21swapper/111:34:491
3067399484,26cyclictest0-21swapper/107:40:011
3067399483,28cyclictest0-21swapper/110:20:091
30673994819,12cyclictest0-21swapper/111:10:021
3066999485,34cyclictest0-21swapper/009:24:540
3066999485,26cyclictest0-21swapper/011:04:580
30669994822,13cyclictest0-21swapper/009:59:130
231502482,39sleep123310-21date12:14:381
36472473,38sleep33707-21iostat09:15:063
3067699476,34cyclictest0-21swapper/307:45:053
3067699474,35cyclictest0-21swapper/312:14:493
30676994725,15cyclictest0-21swapper/311:25:113
30676994723,16cyclictest0-21swapper/310:40:023
3067599474,35cyclictest0-21swapper/207:40:112
3067399474,28cyclictest0-21swapper/108:04:591
3067399474,28cyclictest0-21swapper/108:04:591
3067399474,27cyclictest0-21swapper/107:09:501
3067399474,26cyclictest0-21swapper/107:23:241
3067399474,25cyclictest0-21swapper/110:49:431
30673994719,10cyclictest7065-21chrt08:15:061
291192473,10sleep30-21swapper/311:16:323
124932472,40sleep10-21swapper/107:18:561
124932472,40sleep10-21swapper/107:18:561
3067699466,32cyclictest1402-21runrttasks10:55:183
30676994624,15cyclictest0-21swapper/310:10:173
3067599465,26cyclictest0-21swapper/210:54:422
3067599464,26cyclictest0-21swapper/207:03:212
3067599464,25cyclictest0-21swapper/209:18:432
3067399463,39cyclictest0-21swapper/112:05:331
119152462,9sleep10-21swapper/109:34:351
3067699454,34cyclictest0-21swapper/311:20:133
3067699454,34cyclictest0-21swapper/311:20:133
3067699454,34cyclictest0-21swapper/309:14:463
3067699454,34cyclictest0-21swapper/307:30:053
3067699454,25cyclictest0-21swapper/308:13:333
30676994529,10cyclictest2680-21gltestperf08:05:063
30676994529,10cyclictest2680-21gltestperf08:05:063
30676994524,14cyclictest0-21swapper/306:55:233
30676994523,15cyclictest0-21swapper/308:50:043
3067599455,24cyclictest0-21swapper/206:55:142
30675994524,10cyclictest0-21swapper/211:50:052
3067399454,24cyclictest0-21swapper/111:24:531
3067399454,12cyclictest0-21swapper/110:25:001
30673994528,10cyclictest31079-21grep07:55:251
112312452,9sleep30-21swapper/311:48:483
3067399444,12cyclictest0-21swapper/110:00:031
276212442,9sleep30-21swapper/308:59:303
276212442,9sleep30-21swapper/308:59:303
231899440,25rtkit-daemon27879-21munin-node09:00:191
219582442,36sleep30-21swapper/307:39:013
3067699434,13cyclictest0-21swapper/312:04:113
30676994316,11cyclictest0-21swapper/307:12:183
304872434,32sleep00-21swapper/006:47:560
3067699423,13cyclictest0-21swapper/307:05:273
3067399423,33cyclictest0-21swapper/106:49:511
3067599382,31cyclictest0-21swapper/206:49:512
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional