You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-08-05 - 07:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel

Intel(R) Atom(TM) CPU D510 @ 1.66GHz, Linux 3.12.61-rt81 (Profile)

Latency plot of shadow in rack #1, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Thu Aug 05, 2021 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3052221110,5sleep130520-21grep20:48:521
2318991100,7rtkit-daemon0-21swapper/221:34:052
2318991050,4rtkit-daemon0-21swapper/221:53:492
2318991040,7rtkit-daemon0-21swapper/219:30:172
2318991030,6rtkit-daemon0-21swapper/219:49:092
2318991030,6rtkit-daemon0-21swapper/219:49:092
2318991000,6rtkit-daemon0-21swapper/218:59:112
231899980,5rtkit-daemon1742-21gdm-binary22:08:562
1653499954,75cyclictest1282-21snmpd23:03:480
1653499954,75cyclictest1282-21snmpd23:03:480
1654199934,30cyclictest0-21swapper/321:54:533
155322930,5sleep315531-21egrep22:33:503
16541999240,44cyclictest8122-21ntpdc23:24:033
1653499914,80cyclictest0-21swapper/022:48:580
1654199904,28cyclictest0-21swapper/320:23:583
1654199894,77cyclictest29639-21unixbench_multi20:44:123
1654199894,30cyclictest0-21swapper/322:29:093
1654199884,30cyclictest0-21swapper/319:24:153
16534998829,53cyclictest7737-21sed23:23:550
1653499863,76cyclictest0-21swapper/022:04:140
1653499863,76cyclictest0-21swapper/018:29:090
1654199855,73cyclictest0-21swapper/321:20:173
1653499854,73cyclictest11384-21munin-run23:33:310
1654199844,32cyclictest20157-21cpuspeed_turbos19:18:543
16541998432,44cyclictest1347-21cpuspeed_turbos22:03:523
16541998428,50cyclictest30814-21wc23:03:553
16541998428,50cyclictest30814-21wc23:03:553
1653499845,9cyclictest15411-21grep20:14:130
1653499844,74cyclictest0-21swapper/021:55:160
1653499844,73cyclictest0-21swapper/018:24:030
1653499843,74cyclictest0-21swapper/021:48:560
16541998332,44cyclictest23300-21wc21:39:103
1653499834,71cyclictest0-21swapper/019:14:490
1653499834,13cyclictest0-21swapper/018:43:430
1653499833,74cyclictest0-21swapper/020:29:100
16534998317,7cyclictest118650irq/46-eth020:08:550
1654199824,24cyclictest0-21swapper/320:03:413
16541998233,43cyclictest16079-21gltestperf19:09:053
1654199823,34cyclictest20381-21tr22:43:443
1653499824,71cyclictest0-21swapper/023:14:050
1653499824,70cyclictest0-21swapper/019:34:080
1653499823,72cyclictest0-21swapper/019:49:000
1653499823,72cyclictest0-21swapper/019:49:000
16534998225,51cyclictest0-21swapper/022:18:520
16534998222,53cyclictest0-21swapper/021:39:230
16534998219,12cyclictest0-21swapper/020:19:170
16534998213,12cyclictest0-21swapper/019:58:510
1654199814,14cyclictest0-21swapper/319:34:013
1654199813,70cyclictest0-21swapper/320:54:103
1654199813,26cyclictest0-21swapper/319:54:183
16541998128,9cyclictest1402-21runrttasks18:35:193
1653499814,70cyclictest0-21swapper/018:14:020
1653499814,69cyclictest0-21swapper/021:34:030
1653499813,69cyclictest0-21swapper/018:34:040
1654199804,12cyclictest0-21swapper/321:29:053
16541998025,10cyclictest9608-21fschecks_time20:04:003
16541998017,10cyclictest1055-21cpuspeed_turbos18:38:583
1653499805,13cyclictest0-21swapper/019:24:150
1653499804,69cyclictest0-21swapper/021:44:110
1653499804,69cyclictest0-21swapper/021:04:070
1653499803,7cyclictest6672-21grep23:23:330
1653499803,69cyclictest0-21swapper/021:13:520
16534998023,9cyclictest3637-21munin-node22:09:000
1654199794,26cyclictest16273-21cpuspeed_turbos20:18:573
1654199794,12cyclictest0-21swapper/318:54:453
1654199794,12cyclictest0-21swapper/318:54:453
16541997924,10cyclictest15411-21gltestperf21:23:573
16541997924,10cyclictest15411-21gltestperf21:23:573
16541997919,11cyclictest21095-21unixbench_singl21:34:183
1653499797,9cyclictest1966-21grep20:54:150
1653499794,16cyclictest0-21swapper/022:58:530
1653499793,69cyclictest0-21swapper/022:30:210
1653499793,68cyclictest0-21swapper/018:21:020
16534997927,46cyclictest1402-21runrttasks22:35:210
16534997914,17cyclictest0-21swapper/022:43:500
16534997913,9cyclictest7642-21cpuspeed_turbos21:08:510
16534997912,10cyclictest1402-21runrttasks18:54:450
16534997912,10cyclictest1402-21runrttasks18:54:450
1654199784,24cyclictest0-21swapper/318:49:063
16541997822,10cyclictest13033-21unixbench-2d20:09:123
1653499783,68cyclictest0-21swapper/021:19:100
1653499783,68cyclictest0-21swapper/019:39:000
1654199774,29cyclictest0-21swapper/322:58:493
1654199774,27cyclictest0-21swapper/322:39:453
1654199774,25cyclictest0-21swapper/320:18:393
1654199774,13cyclictest0-21swapper/321:13:303
16541997721,10cyclictest1402-21runrttasks18:21:413
16541997719,11cyclictest5330-21gltestperf23:18:523
1653499774,20cyclictest0-21swapper/022:38:450
1653499773,66cyclictest0-21swapper/019:08:580
1653499773,14cyclictest0-21swapper/018:04:050
1653499773,11cyclictest0-21swapper/020:38:560
1653499773,11cyclictest0-21swapper/020:38:560
16534997719,9cyclictest12878-21munin-node19:04:030
1654199768,25cyclictest0-21swapper/318:43:573
1654199764,29cyclictest0-21swapper/321:14:093
1654199764,29cyclictest0-21swapper/319:39:003
1654199764,24cyclictest0-21swapper/321:49:073
1654199764,20cyclictest13885-21kernelversion19:04:033
1654199764,15cyclictest0-21swapper/318:24:403
1654199763,65cyclictest0-21swapper/322:48:583
1654199763,24cyclictest10497-21taskset18:58:463
16541997620,11cyclictest5290-21cpuspeed_turbos21:03:583
1653499766,10cyclictest0-21swapper/020:45:050
1653499764,12cyclictest0-21swapper/020:52:420
16534997619,9cyclictest12425-21unixbench_multi22:24:070
16534997618,8cyclictest1402-21runrttasks23:08:360
16534997611,12cyclictest0-21swapper/018:48:580
1654199754,23cyclictest0-21swapper/319:44:003
1654199754,17cyclictest25283-21taskset20:37:453
1654199754,17cyclictest25283-21taskset20:37:453
1654199754,15cyclictest0-21swapper/320:29:063
16541997525,9cyclictest3586-21grep19:49:153
16541997525,9cyclictest3586-21grep19:49:153
16541997525,9cyclictest27344-21unixbench_singl20:39:173
16541997525,9cyclictest27344-21unixbench_singl20:39:173
16541997522,9cyclictest9181-21gltestperf22:19:013
16541997520,9cyclictest11524-21gltestperf22:23:533
1653499754,21cyclictest0-21swapper/019:28:580
1653499753,27cyclictest0-21swapper/019:53:590
16534997519,7cyclictest1402-21runrttasks18:10:230
16534997519,7cyclictest1402-21runrttasks18:10:230
16534997510,16cyclictest0-21swapper/019:18:540
1654199747,9cyclictest7150irq/45-ahci18:09:013
1654199747,9cyclictest7150irq/45-ahci18:09:013
1654199744,27cyclictest0-21swapper/318:31:353
1654199744,25cyclictest0-21swapper/321:59:063
1654199744,24cyclictest0-21swapper/318:03:453
1654199744,13cyclictest0-21swapper/319:14:103
1654199743,22cyclictest0-21swapper/321:43:593
16541997418,10cyclictest18367-21sed18:04:163
1654199734,32cyclictest0-21swapper/322:08:403
1654199734,23cyclictest0-21swapper/323:09:053
1654199734,14cyclictest0-21swapper/323:15:073
1654199733,24cyclictest0-21swapper/322:14:073
1654199733,24cyclictest0-21swapper/322:14:073
1653499734,10cyclictest23226-21munin-node20:33:510
1653499734,10cyclictest23226-21munin-node20:33:510
1653499733,9cyclictest0-21swapper/022:58:070
16534997320,7cyclictest1402-21runrttasks21:24:480
16534997320,7cyclictest1402-21runrttasks21:24:480
1653499732,65cyclictest0-21swapper/022:13:450
1653499732,65cyclictest0-21swapper/022:13:450
16534997314,9cyclictest18172-21needreboot21:29:030
16534997311,12cyclictest0-21swapper/020:58:560
1654199724,22cyclictest0-21swapper/319:29:063
1653499724,59cyclictest0-21swapper/020:03:540
1653499723,22cyclictest0-21swapper/018:58:580
16534997215,14cyclictest0-21swapper/020:24:090
16534997210,12cyclictest0-21swapper/019:48:410
1654199713,9cyclictest0-21swapper/320:59:123
1654199713,30cyclictest10480-21taskset23:29:013
16534997115,9cyclictest2340-21gdm-simple-gree22:01:340
16534997111,12cyclictest0-21swapper/018:48:390
1654199704,30cyclictest0-21swapper/322:54:573
1654199692,23cyclictest0-21swapper/318:18:453
16534996913,8cyclictest0-21swapper/018:03:440
1654199682,23cyclictest0-21swapper/320:49:123
1654099624,24cyclictest0-21swapper/218:39:192
1654099614,13cyclictest0-21swapper/220:13:592
1654099604,39cyclictest0-21swapper/221:08:512
1654099603,40cyclictest0-21swapper/219:59:152
271002593,49sleep20-21swapper/222:58:332
1654099594,12cyclictest0-21swapper/222:23:492
16540995931,20cyclictest23057-21tune2fs19:24:052
1654099584,13cyclictest0-21swapper/223:08:472
1654099584,13cyclictest0-21swapper/220:54:142
1654099584,13cyclictest0-21swapper/219:39:182
1654099583,34cyclictest0-21swapper/218:23:452
1654099574,28cyclictest0-21swapper/218:08:482
1654099574,28cyclictest0-21swapper/218:08:482
1654099574,13cyclictest0-21swapper/219:18:422
16540995736,13cyclictest30528-21cpuspeed_turbos20:48:522
16537995725,13cyclictest0-21swapper/121:54:041
95672567,40sleep10-21swapper/118:54:251
95672567,40sleep10-21swapper/118:54:251
231899560,4rtkit-daemon2317-21rtkit-daemon23:26:081
231899560,4rtkit-daemon2317-21rtkit-daemon23:23:081
1654099564,13cyclictest0-21swapper/221:24:172
1654099564,13cyclictest0-21swapper/221:24:172
16540995630,20cyclictest14831-21unixbench_singl22:29:072
16540995622,15cyclictest0-21swapper/222:49:022
16537995636,15cyclictest0-21swapper/122:48:591
16537995617,21cyclictest0-21swapper/121:24:031
16537995617,21cyclictest0-21swapper/121:24:031
243932553,9sleep224422-21netstat20:34:022
243932553,9sleep224422-21netstat20:34:022
231899550,4rtkit-daemon2317-21rtkit-daemon23:30:311
193472554,11sleep10-21swapper/121:33:391
1654099554,31cyclictest0-21swapper/219:18:572
1654099554,30cyclictest0-21swapper/222:43:432
1654099554,30cyclictest0-21swapper/222:33:542
1654099554,12cyclictest0-21swapper/223:27:092
1654099554,12cyclictest0-21swapper/221:13:562
1653799556,29cyclictest0-21swapper/119:34:021
1653799555,30cyclictest0-21swapper/119:20:371
1653799555,30cyclictest0-21swapper/118:39:141
16537995523,11cyclictest1282-21snmpd18:04:111
297802542,10sleep20-21swapper/220:44:432
231899540,5rtkit-daemon2317-21rtkit-daemon23:08:461
212472543,12sleep10-21swapper/118:13:381
212472543,12sleep10-21swapper/118:13:381
1654099545,30cyclictest0-21swapper/223:20:012
1654099545,30cyclictest0-21swapper/222:38:492
1654099544,31cyclictest0-21swapper/220:19:322
1654099544,30cyclictest0-21swapper/221:44:112
1654099544,30cyclictest0-21swapper/218:34:102
16540995424,13cyclictest0-21swapper/219:58:402
1653799545,30cyclictest0-21swapper/122:38:481
1653799545,30cyclictest0-21swapper/121:04:001
1653799544,30cyclictest0-21swapper/121:14:301
1653799544,29cyclictest0-21swapper/120:30:191
1653799544,27cyclictest0-21swapper/118:21:091
16537995437,12cyclictest8559-21cut22:18:531
16537995430,14cyclictest0-21swapper/121:58:551
1653799543,44cyclictest0-21swapper/118:25:351
16537995414,14cyclictest0-21swapper/120:39:151
16537995414,14cyclictest0-21swapper/120:39:151
16537995413,23cyclictest460-21jbd2/dm-0-821:43:361
312842533,11sleep10-21swapper/119:39:561
1654099535,30cyclictest0-21swapper/222:04:042
1654099534,31cyclictest0-21swapper/218:05:532
1654099534,30cyclictest0-21swapper/221:38:532
1654099534,30cyclictest0-21swapper/221:18:542
1654099534,29cyclictest0-21swapper/223:28:472
1654099534,29cyclictest0-21swapper/220:30:012
1654099534,29cyclictest0-21swapper/218:23:572
1654099534,28cyclictest0-21swapper/220:39:182
1654099534,28cyclictest0-21swapper/220:39:182
1654099534,27cyclictest11364-21yum-updatesd-he20:08:552
16540995336,10cyclictest3601-21grep20:58:582
16540995335,11cyclictest32713-21wc19:44:022
1653799536,14cyclictest1402-21runrttasks18:33:431
1653799535,30cyclictest0-21swapper/122:28:451
1653799535,29cyclictest0-21swapper/119:49:011
1653799535,29cyclictest0-21swapper/119:49:011
1653799535,27cyclictest0-21swapper/120:34:121
1653799535,27cyclictest0-21swapper/120:34:121
1653799535,27cyclictest0-21swapper/119:58:501
1653799534,40cyclictest0-21swapper/122:08:351
1653799534,29cyclictest0-21swapper/120:59:121
1653799534,29cyclictest0-21swapper/120:54:121
1653799534,29cyclictest0-21swapper/119:54:051
16537995334,11cyclictest1402-21runrttasks18:59:141
1653799533,42cyclictest0-21swapper/120:08:561
16537995320,14cyclictest0-21swapper/123:14:011
16537995320,14cyclictest0-21swapper/121:30:111
16537995316,14cyclictest0-21swapper/118:17:301
222002524,40sleep20-21swapper/218:14:032
1654099525,29cyclictest0-21swapper/222:19:182
1654099525,29cyclictest0-21swapper/218:44:162
1654099524,30cyclictest0-21swapper/218:54:082
1654099524,30cyclictest0-21swapper/218:54:082
1654099524,29cyclictest0-21swapper/222:14:072
1654099524,29cyclictest0-21swapper/222:14:072
1654099524,29cyclictest0-21swapper/220:24:092
1654099524,29cyclictest0-21swapper/220:04:162
16540995221,13cyclictest0-21swapper/218:28:582
1653799525,28cyclictest0-21swapper/120:03:541
1653799524,39cyclictest0-21swapper/119:08:421
1653799524,29cyclictest0-21swapper/122:59:121
1653799524,29cyclictest0-21swapper/119:10:521
1653799524,28cyclictest0-21swapper/122:54:571
1653799524,28cyclictest0-21swapper/121:51:181
1653799524,28cyclictest0-21swapper/120:13:561
1653799524,28cyclictest0-21swapper/118:44:431
1653799524,27cyclictest0-21swapper/122:34:041
1653799523,24cyclictest7960-21sort21:08:561
16537995216,12cyclictest0-21swapper/119:29:131
107312523,10sleep10-21swapper/122:23:461
1654099515,28cyclictest0-21swapper/222:59:092
1654099514,30cyclictest0-21swapper/219:09:032
1654099514,29cyclictest0-21swapper/223:07:002
1654099514,29cyclictest0-21swapper/223:07:002
1654099514,27cyclictest1282-21snmpd21:04:072
16540995133,11cyclictest18690-21tail21:29:112
16540995119,15cyclictest0-21swapper/223:15:012
1653799515,28cyclictest0-21swapper/118:49:001
1653799514,29cyclictest0-21swapper/122:09:091
1653799514,28cyclictest0-21swapper/121:44:041
1653799513,25cyclictest0-21swapper/119:44:541
270782502,10sleep20-21swapper/219:33:482
165842504,11sleep10-21swapper/120:19:021
1654099504,29cyclictest0-21swapper/221:59:002
1654099504,29cyclictest0-21swapper/221:50:142
1654099504,29cyclictest0-21swapper/218:50:022
1654099504,28cyclictest0-21swapper/219:05:072
1653799504,28cyclictest0-21swapper/121:20:171
1653799504,28cyclictest0-21swapper/120:24:011
1653799504,28cyclictest0-21swapper/119:14:151
16537995021,10cyclictest0-21swapper/122:43:471
16537995017,13cyclictest0-21swapper/120:43:541
79322493,11sleep10-21swapper/122:16:041
79322493,11sleep10-21swapper/122:16:041
1653799484,26cyclictest0-21swapper/119:23:551
1653799474,35cyclictest0-21swapper/123:04:041
1653799474,35cyclictest0-21swapper/123:04:041
1653799474,28cyclictest0-21swapper/118:35:191
16537994528,9cyclictest16522-21munin-run18:03:441
163892444,6sleep20-21swapper/218:02:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional