You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-19 - 21:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Sep 19, 2024 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2443991030,6rtkit-daemon2442-21rtkit-daemon06:42:000
548799939,64cyclictest0-21swapper/206:31:372
548999914,80cyclictest0-21swapper/309:47:033
548799914,66cyclictest0-21swapper/207:32:082
548799914,66cyclictest0-21swapper/207:32:082
5487999017,50cyclictest0-21swapper/206:39:522
548799874,12cyclictest0-21swapper/206:47:102
548799874,12cyclictest0-21swapper/206:47:102
548799873,76cyclictest13432-21aten2.4-expect06:01:502
548799873,63cyclictest0-21swapper/209:11:432
548799873,59cyclictest4314-21munin-node07:52:072
548799868,52cyclictest0-21swapper/208:31:332
548799867,17cyclictest0-21swapper/209:06:582
548799865,13cyclictest0-21swapper/206:41:442
548799864,60cyclictest0-21swapper/209:31:302
244399860,4rtkit-daemon2442-21rtkit-daemon10:21:440
244399860,4rtkit-daemon2442-21rtkit-daemon10:21:440
548999853,75cyclictest0-21swapper/307:32:493
548999853,75cyclictest0-21swapper/307:32:493
548799856,12cyclictest29375-21gltestperf06:31:562
548799854,59cyclictest0-21swapper/210:42:452
548799854,12cyclictest0-21swapper/206:16:562
548799853,62cyclictest0-21swapper/208:06:442
548799853,61cyclictest1675-21munin-node07:46:532
548799853,12cyclictest0-21swapper/210:51:272
5487998520,43cyclictest0-21swapper/207:21:552
5487998513,9cyclictest3429-21idleruntime08:51:502
548999843,75cyclictest22329-21latency_hist09:31:303
548799845,11cyclictest1304-21runrttasks06:00:532
548799844,12cyclictest0-21swapper/206:57:082
548799844,11cyclictest17061-21aten2.4-expect08:16:452
548799844,10cyclictest32438-21crond09:51:292
5487998417,45cyclictest0-21swapper/210:11:532
548799837,12cyclictest0-21swapper/206:06:542
548799835,64cyclictest0-21swapper/208:40:142
548799834,64cyclictest0-21swapper/211:14:362
548799834,59cyclictest0-21swapper/209:22:012
548799834,57cyclictest0-21swapper/208:41:432
548799834,13cyclictest0-21swapper/209:56:482
548799834,11cyclictest0-21swapper/205:50:092
5487998317,46cyclictest20164-21sshd10:28:462
548999823,72cyclictest0-21swapper/309:21:303
548799825,14cyclictest0-21swapper/208:02:032
548799824,55cyclictest0-21swapper/207:02:032
548799824,13cyclictest0-21swapper/206:21:482
5487998216,48cyclictest0-21swapper/207:14:582
548999814,70cyclictest0-21swapper/307:51:543
548799815,55cyclictest0-21swapper/210:31:512
548799814,57cyclictest24289-21munin-run08:31:312
548799814,13cyclictest0-21swapper/209:02:042
548799813,58cyclictest0-21swapper/210:01:412
548799813,57cyclictest0-21swapper/210:17:592
548799813,20cyclictest0-21swapper/206:54:542
548999803,8cyclictest8150-21runrttasks11:09:223
548999803,70cyclictest0-21swapper/306:31:363
548799804,57cyclictest0-21swapper/209:36:522
548799804,13cyclictest0-21swapper/208:22:052
548799804,12cyclictest0-21swapper/209:31:582
548799803,10cyclictest3255-21crond11:06:212
548799803,10cyclictest3255-21crond11:06:212
5487998015,50cyclictest0-21swapper/207:07:032
548999793,69cyclictest0-21swapper/310:53:483
548999793,69cyclictest0-21swapper/310:32:533
548999792,69cyclictest0-21swapper/310:41:423
548799794,9cyclictest31450-21kworker/u8:010:21:522
548799794,9cyclictest31450-21kworker/u8:010:21:522
548799794,57cyclictest0-21swapper/210:40:332
548799794,55cyclictest0-21swapper/207:36:482
548799794,13cyclictest0-21swapper/209:51:412
548799794,13cyclictest0-21swapper/207:46:342
548799794,12cyclictest0-21swapper/210:06:512
548799793,13cyclictest0-21swapper/211:07:132
548999784,67cyclictest1283-21snmpd07:40:033
548999783,8cyclictest1152-21munin-node08:47:023
548999783,7cyclictest26324-21cut07:31:353
548999783,69cyclictest0-21swapper/307:01:483
548799784,13cyclictest0-21swapper/208:11:462
548799784,13cyclictest0-21swapper/208:11:462
5487997819,51cyclictest6504-21sort08:57:032
5487997819,51cyclictest6504-21sort08:57:032
548999774,7cyclictest9720-21munin-node05:52:073
548999774,68cyclictest0-21swapper/310:26:403
548999773,67cyclictest0-21swapper/308:36:323
548799774,12cyclictest0-21swapper/211:00:372
548799774,12cyclictest0-21swapper/209:16:542
548799773,66cyclictest0-21swapper/208:49:002
5487997714,40cyclictest0-21swapper/207:26:452
5487997711,8cyclictest98550irq/46-eth007:56:442
548999764,65cyclictest0-21swapper/306:42:053
548999763,67cyclictest0-21swapper/306:49:543
548999763,67cyclictest0-21swapper/306:49:543
548999763,66cyclictest0-21swapper/309:45:363
548999763,65cyclictest0-21swapper/310:21:283
548999763,45cyclictest0-21swapper/309:01:423
5489997619,50cyclictest17209-21fschecks_time07:11:543
548799764,17cyclictest0-21swapper/205:51:552
548999754,7cyclictest24148-21python09:32:003
548999754,65cyclictest0-21swapper/311:01:263
548999753,66cyclictest0-21swapper/308:27:003
548999752,67cyclictest0-21swapper/306:19:483
548799754,64cyclictest0-21swapper/209:41:502
548799754,49cyclictest560-21turbostat10:56:262
5487997519,50cyclictest20615-21crond06:16:372
548999744,53cyclictest9757-21tail06:56:553
548999743,8cyclictest14117-21chrt08:10:473
548999743,8cyclictest10552-21grep09:06:473
548999743,65cyclictest0-21swapper/309:56:483
548999743,6cyclictest4644-21crond08:56:313
548999743,59cyclictest0-21swapper/309:36:443
548999743,10cyclictest25670-21latency_hist06:26:373
5487997416,49cyclictest0-21swapper/207:16:482
548999734,63cyclictest0-21swapper/306:06:563
548999734,62cyclictest0-21swapper/306:37:033
548999733,8cyclictest30207-21timerwakeupswit06:32:103
548999733,64cyclictest0-21swapper/309:23:253
548999732,43cyclictest0-21swapper/306:51:563
548999723,7cyclictest29480-21cat08:41:323
548999723,63cyclictest0-21swapper/306:06:253
548999723,62cyclictest13072-21fschecks_count09:11:493
548999722,63cyclictest11658-21munin-node10:11:493
548999714,62cyclictest0-21swapper/308:13:003
548999714,62cyclictest0-21swapper/308:13:003
548999714,57cyclictest0-21swapper/311:11:383
548999714,57cyclictest0-21swapper/307:46:593
548999713,8cyclictest6881-21kernelversion05:47:033
548999713,8cyclictest17498-21munin-node10:22:053
548999713,8cyclictest17498-21munin-node10:22:053
548999713,61cyclictest19613-21aten_r1power_vo08:21:443
548999712,64cyclictest0-21swapper/307:56:443
548999712,59cyclictest21420-21munin-node07:21:553
548799714,11cyclictest0-21swapper/205:46:392
548999705,56cyclictest0-21swapper/307:16:483
548999704,7cyclictest5504-21fschecks_count08:56:483
548999704,7cyclictest5504-21fschecks_count08:56:483
548999704,59cyclictest0-21swapper/306:11:413
548999704,58cyclictest0-21swapper/307:42:003
548999704,44cyclictest0-21swapper/305:57:013
548999703,61cyclictest6430-21head10:01:493
548999703,58cyclictest5094-21switchtime11:01:583
548999703,58cyclictest5094-21switchtime11:01:583
548999703,58cyclictest0-21swapper/309:56:303
548999702,8cyclictest18861-21uptime08:17:073
548999702,47cyclictest0-21swapper/307:06:473
548999694,59cyclictest0-21swapper/310:40:013
5489996930,32cyclictest11141-21ls08:02:063
548999688,53cyclictest0-21swapper/308:41:493
548999683,59cyclictest0-21swapper/310:07:463
548999682,60cyclictest0-21swapper/310:46:563
548999633,53cyclictest0-21swapper/305:46:393
548399604,48cyclictest0-21swapper/108:51:531
5483996011,16cyclictest0-21swapper/106:16:381
548099603,24cyclictest0-21swapper/005:56:530
548399594,48cyclictest0-21swapper/108:01:561
5480995933,12cyclictest0-21swapper/008:37:060
5480995932,12cyclictest0-21swapper/008:56:470
5480995932,12cyclictest0-21swapper/008:56:470
548399585,46cyclictest10951-21sshd06:59:551
548399585,46cyclictest0-21swapper/110:31:591
548399585,46cyclictest0-21swapper/109:16:521
548399584,47cyclictest0-21swapper/107:17:001
548399580,10cyclictest5488-21kworker/2:205:46:381
130272583,46sleep10-21swapper/110:16:391
548399574,46cyclictest31176-21swap08:42:071
548399574,46cyclictest12806-21cpuspeed_turbos09:11:451
548399574,46cyclictest0-21swapper/110:46:521
548399574,46cyclictest0-21swapper/109:32:021
548399574,46cyclictest0-21swapper/108:17:071
548399574,46cyclictest0-21swapper/107:11:581
548399574,46cyclictest0-21swapper/105:56:381
548399573,46cyclictest0-21swapper/111:05:451
548399573,46cyclictest0-21swapper/111:05:451
113762574,46sleep00-21swapper/009:06:580
548399565,45cyclictest0-21swapper/106:41:561
548399565,44cyclictest0-21swapper/105:51:381
548399564,47cyclictest0-21swapper/110:56:391
548399564,46cyclictest0-21swapper/106:49:541
548399564,46cyclictest0-21swapper/106:49:541
548399564,45cyclictest16621-21taskset08:15:331
548399564,45cyclictest16621-21taskset08:15:331
548399564,45cyclictest0-21swapper/110:42:001
548399564,45cyclictest0-21swapper/110:01:411
548399564,45cyclictest0-21swapper/106:01:511
300252562,11sleep00-21swapper/010:47:040
548399555,45cyclictest21713-21runrttasks08:25:571
548399554,45cyclictest0-21swapper/111:06:551
548399554,45cyclictest0-21swapper/110:08:191
548399554,44cyclictest0-21swapper/106:37:021
548399553,46cyclictest0-21swapper/106:21:381
5480995530,11cyclictest0-21swapper/008:31:480
11662553,46sleep00-21swapper/007:43:290
548399544,44cyclictest0-21swapper/107:26:351
244399540,6rtkit-daemon0-21swapper/009:06:551
191402542,46sleep00-21swapper/008:20:280
5483995335,11cyclictest9382-21sshd11:11:451
548399533,45cyclictest0-21swapper/108:46:511
548399533,44cyclictest0-21swapper/109:36:471
5480995329,11cyclictest0-21swapper/008:07:000
132772532,10sleep00-21swapper/007:02:230
84482523,10sleep10-21swapper/109:01:511
81362523,10sleep00-21swapper/011:09:120
62902523,44sleep00-21swapper/007:52:270
548399523,44cyclictest0-21swapper/110:22:001
548399523,44cyclictest0-21swapper/110:22:001
5480995217,23cyclictest9340-21vmstat09:02:050
63162514,40sleep16402-21munin-node06:51:481
548399514,40cyclictest0-21swapper/108:31:481
5480995129,10cyclictest0-21swapper/005:51:480
298062513,10sleep10-21swapper/109:45:081
77422503,40sleep00-21swapper/005:48:240
63452503,40sleep10-21swapper/107:53:091
5483995022,8cyclictest16293-21cat07:11:361
5483995020,12cyclictest0-21swapper/107:01:471
548099504,14cyclictest0-21swapper/009:31:420
5480995026,11cyclictest0-21swapper/010:21:280
5480995023,22cyclictest0-21swapper/006:31:530
51212503,41sleep00-21swapper/010:00:220
49462503,40sleep10-21swapper/108:56:441
49462503,40sleep10-21swapper/108:56:441
30762503,41sleep00-21swapper/010:59:090
264232504,7sleep026479-21netstat09:36:570
261502503,40sleep00-21swapper/007:30:310
209052502,9sleep00-21swapper/007:17:580
197892503,41sleep10-21swapper/109:26:221
548399494,27cyclictest0-21swapper/110:51:441
548399493,41cyclictest0-21swapper/108:31:311
548399493,11cyclictest0-21swapper/109:46:401
5483994920,12cyclictest0-21swapper/106:32:051
5480994935,9cyclictest22543-21df08:26:480
5480994932,12cyclictest0-21swapper/007:32:010
5480994932,12cyclictest0-21swapper/007:32:010
310312493,39sleep10-21swapper/107:38:061
291862493,40sleep10-21swapper/108:39:271
230182492,40sleep00-21swapper/006:20:040
174602493,39sleep00-21swapper/006:07:100
548399485,27cyclictest0-21swapper/106:06:491
548399484,28cyclictest0-21swapper/106:22:141
548399484,27cyclictest0-21swapper/107:35:021
548399484,27cyclictest0-21swapper/107:35:021
5480994828,9cyclictest0-21swapper/007:09:570
5480994822,22cyclictest0-21swapper/009:50:090
4702482,10sleep00-21swapper/006:37:370
316762483,38sleep00-21swapper/008:44:020
26622482,40sleep00-21swapper/009:56:150
253442483,39sleep10-21swapper/110:40:161
243082483,39sleep00-21swapper/010:36:530
234492483,39sleep00-21swapper/007:23:140
200702483,39sleep020246-21fschecks_time08:21:490
113302482,10sleep00-21swapper/010:11:460
100442482,11sleep00-21swapper/010:08:360
82482472,39sleep00-21swapper/006:52:360
58552472,38sleep00-21swapper/006:49:170
58552472,38sleep00-21swapper/006:49:170
548399474,26cyclictest0-21swapper/108:06:541
548399474,26cyclictest0-21swapper/107:57:031
548399474,25cyclictest0-21swapper/107:47:101
548399474,24cyclictest32691-21iostat07:41:571
5483994732,10cyclictest11497-21gltestperf10:11:471
5483994721,9cyclictest34602df_abs09:56:441
548099473,40cyclictest18476-21aten2.4-expect06:11:510
548099473,38cyclictest23377-21munin-node06:21:570
548099473,38cyclictest0-21swapper/011:02:010
548099473,38cyclictest0-21swapper/011:02:010
5480994724,12cyclictest0-21swapper/010:36:060
548099472,39cyclictest0-21swapper/010:26:390
40262472,10sleep00-21swapper/007:50:540
326982472,39sleep00-21swapper/010:52:280
311022472,9sleep00-21swapper/007:39:010
279502472,39sleep00-21swapper/006:28:300
200312473,10sleep00-21swapper/009:26:330
17932473,37sleep00-21swapper/008:48:490
144112473,38sleep00-21swapper/008:11:420
144112473,38sleep00-21swapper/008:11:420
129412473,38sleep10-21swapper/106:00:221
76762462,9sleep00-21swapper/010:05:420
5483994632,9cyclictest838-21sort09:51:461
5483994621,11cyclictest0-21swapper/109:27:071
5480994627,9cyclictest0-21swapper/010:41:430
5480994627,9cyclictest0-21swapper/007:58:520
5480994627,9cyclictest0-21swapper/007:01:070
5480994626,9cyclictest0-21swapper/011:13:020
5480994619,12cyclictest0-21swapper/009:26:290
5480994617,24cyclictest0-21swapper/008:01:440
53172464,36sleep00-21swapper/005:44:540
296462462,36sleep00-21swapper/009:43:010
260492463,10sleep10-21swapper/107:29:111
172342463,37sleep00-21swapper/009:21:050
548399455,12cyclictest26866-21gltestperf06:26:561
548399453,26cyclictest0-21swapper/110:26:411
548099454,25cyclictest0-21swapper/006:02:000
5480994526,9cyclictest0-21swapper/008:53:570
548099443,36cyclictest0-21swapper/009:14:220
548099443,25cyclictest0-21swapper/007:11:490
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional