You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 23:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Fri Apr 19, 2024 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3154121460,6sleep0613199cyclictest09:34:410
6141999122,12cyclictest0-21swapper/306:17:203
6141999033,49cyclictest2889-21gltestperf06:25:003
6141998933,48cyclictest28712-21gltestperf08:19:533
614199854,26cyclictest0-21swapper/308:32:243
614199854,13cyclictest0-21swapper/308:59:473
614199853,32cyclictest0-21swapper/305:44:413
614199833,26cyclictest17041-21aten_r1power_cu06:54:463
614199833,17cyclictest0-21swapper/306:45:133
614199828,14cyclictest0-21swapper/309:54:413
6141998222,9cyclictest15266-21needreboot05:45:053
6141998221,9cyclictest30646-21gltestperf07:19:593
614199815,28cyclictest0-21swapper/307:39:553
614199814,32cyclictest0-21swapper/309:29:403
614199814,32cyclictest0-21swapper/309:29:403
6141998126,10cyclictest11036-21gltestperf07:44:553
6141998120,13cyclictest0-21swapper/310:14:223
6141998120,13cyclictest0-21swapper/310:14:223
6141998117,8cyclictest17050-21kworker/3:107:24:463
6141998028,11cyclictest20734-21kernelversion07:00:013
6141998024,10cyclictest19064-21aten_r1power_fr05:54:513
614199794,30cyclictest0-21swapper/306:50:063
614199794,25cyclictest0-21swapper/310:20:023
614199794,25cyclictest0-21swapper/310:20:023
614199794,12cyclictest0-21swapper/308:54:443
6141997923,9cyclictest25390-21gltestperf10:24:483
6141997922,9cyclictest16854-21fschecks_count09:04:473
613899793,69cyclictest30577-21if_eth010:34:521
613899793,69cyclictest0-21swapper/109:14:321
613899793,68cyclictest0-21swapper/105:58:541
614199784,32cyclictest0-21swapper/306:14:393
614199784,31cyclictest0-21swapper/308:14:403
614199783,31cyclictest0-21swapper/309:24:583
6141997827,8cyclictest1286-21runrttasks10:49:463
6141997824,10cyclictest25054-21latency09:19:593
614199774,23cyclictest0-21swapper/307:29:543
614199773,29cyclictest0-21swapper/307:50:003
6141997720,10cyclictest32332-21taskset10:39:443
6141997711,12cyclictest0-21swapper/305:29:413
613899774,55cyclictest0-21swapper/105:34:521
613899773,67cyclictest9002-21snmpd10:03:481
242299770,13rtkit-daemon2421-21rtkit-daemon09:50:282
614199764,9cyclictest30971-21grep08:24:503
614199764,29cyclictest0-21swapper/308:40:063
614199763,28cyclictest0-21swapper/309:49:323
614199763,27cyclictest0-21swapper/308:54:333
613899763,66cyclictest0-21swapper/110:09:551
613899763,66cyclictest0-21swapper/110:09:551
613899763,65cyclictest24594-21munin-node07:09:551
614199754,20cyclictest0-21swapper/310:34:203
614199754,12cyclictest0-21swapper/308:14:353
614199753,22cyclictest0-21swapper/309:34:573
6141997522,9cyclictest22481-21gltestperf05:59:583
6141997522,10cyclictest18789-21latency07:59:593
6141997522,10cyclictest18789-21latency07:59:593
613899754,51cyclictest0-21swapper/106:44:491
613899753,66cyclictest14879-21gltestperf05:44:571
613899753,66cyclictest0-21swapper/108:19:431
613899753,65cyclictest32582-21runrttasks09:34:531
613899753,56cyclictest0-21swapper/106:54:481
614199743,28cyclictest0-21swapper/305:50:133
614199743,21cyclictest0-21swapper/305:29:543
6141997418,7cyclictest9952-21idleruntime05:35:023
6141997416,8cyclictest9002-21snmpd07:38:243
613899744,61cyclictest5353-21timerwakeupswit08:40:021
614199733,21cyclictest0-21swapper/306:39:583
6141997322,9cyclictest31966-21cpuspeed_turbos06:19:543
6141997322,9cyclictest31966-21cpuspeed_turbos06:19:543
613899739,57cyclictest18428-21runrttasks09:08:131
613899734,62cyclictest28281-21iostat_ios07:15:011
613899734,62cyclictest0-21swapper/110:24:381
613899733,64cyclictest0-21swapper/105:30:091
613899733,63cyclictest1544-21runrttasks10:40:121
613899733,62cyclictest7887-21iostat_ios09:49:551
613899733,62cyclictest4128-21unixbench_singl10:45:041
242299730,12rtkit-daemon2421-21rtkit-daemon07:24:192
614199724,21cyclictest25021-21df07:09:523
614199724,11cyclictest0-21swapper/307:18:213
614199723,31cyclictest0-21swapper/309:14:413
614199723,27cyclictest0-21swapper/310:00:043
6141997218,20cyclictest0-21swapper/310:34:563
6140997234,16cyclictest0-21swapper/210:34:302
613899724,56cyclictest30832-21kernelversion07:20:041
613899723,62cyclictest0-21swapper/107:24:481
614199713,34cyclictest0-21swapper/306:35:143
6138997132,32cyclictest26850-21tr06:09:551
613899713,61cyclictest9002-21snmpd06:53:161
613899713,61cyclictest28729-21sed09:29:321
613899713,61cyclictest22760-21fschecks_count07:04:571
613899713,61cyclictest22760-21fschecks_count07:04:571
613899713,61cyclictest0-21swapper/107:54:481
613899713,61cyclictest0-21swapper/107:54:481
613899713,61cyclictest0-21swapper/107:39:491
613899713,60cyclictest7094-21tr08:44:551
613899713,60cyclictest7094-21tr08:44:551
613899713,48cyclictest0-21swapper/106:04:391
613899713,45cyclictest10799-21munin-node09:55:021
614199704,13cyclictest0-21swapper/310:46:293
613899704,59cyclictest0-21swapper/109:19:561
613899704,59cyclictest0-21swapper/108:54:341
613899704,59cyclictest0-21swapper/108:04:511
613899704,58cyclictest0-21swapper/105:50:011
613899703,61cyclictest15719-21runrttasks09:00:461
613899703,61cyclictest0-21swapper/106:07:261
613899703,60cyclictest6367-21netstat07:35:061
613899703,60cyclictest4703-21sshd07:34:151
613899703,60cyclictest24752-21chrt08:12:191
613899703,60cyclictest0-21swapper/108:15:101
613899703,59cyclictest21394-21seq09:14:411
613899703,53cyclictest0-21swapper/107:53:261
613899703,35cyclictest0-21swapper/108:39:341
613899694,59cyclictest0-21swapper/108:54:541
613899694,58cyclictest0-21swapper/109:44:321
613899694,57cyclictest1286-21runrttasks10:54:591
613899693,59cyclictest7445-21df_abs06:34:531
613899693,59cyclictest19344-21aten_r1power_cu10:14:401
613899693,59cyclictest0-21swapper/110:06:351
613899693,43cyclictest30255-21aten2.4-expect08:24:431
6141996823,9cyclictest2751-21idleruntime09:39:553
613899684,56cyclictest0-21swapper/108:33:121
613899683,59cyclictest11103-21cat06:40:091
613899683,59cyclictest10406-21cat07:44:491
614199674,28cyclictest0-21swapper/307:08:193
614199674,28cyclictest0-21swapper/307:08:193
613899674,54cyclictest6136-21systemd-cgroups05:29:401
613899674,38cyclictest0-21swapper/107:59:541
613899674,38cyclictest0-21swapper/107:59:541
613899673,58cyclictest20331-21fschecks_time06:59:541
613899673,57cyclictest465-21cat06:20:081
613899673,57cyclictest465-21cat06:20:081
613899673,57cyclictest23023-21munin-node10:19:531
613899673,57cyclictest23023-21munin-node10:19:531
613899672,58cyclictest4757-21munin-node10:49:371
613899664,39cyclictest0-21swapper/106:29:581
613899663,57cyclictest0-21swapper/109:44:401
613899663,56cyclictest31356-21cat09:34:321
613899663,56cyclictest31356-21cat09:34:321
613899663,56cyclictest0-21swapper/106:15:001
614199653,15cyclictest0-21swapper/306:30:163
6141996521,7cyclictest95250irq/46-eth009:49:413
613899653,56cyclictest0-21swapper/105:42:031
613899653,44cyclictest29113-21taskset10:33:101
613899643,54cyclictest0-21swapper/106:29:091
614099634,28cyclictest1171-21lldpd07:00:022
614099624,49cyclictest0-21swapper/205:44:592
86342613,11sleep20-21swapper/207:40:002
614099614,28cyclictest0-21swapper/210:50:042
6140996110,27cyclictest0-21swapper/206:49:552
6131996138,13cyclictest0-21swapper/006:50:030
614199603,13cyclictest0-21swapper/307:57:003
614199603,13cyclictest0-21swapper/307:57:003
614099605,48cyclictest0-21swapper/207:25:372
614099605,28cyclictest0-21swapper/210:05:102
614099605,27cyclictest0-21swapper/209:44:452
614099604,29cyclictest0-21swapper/207:35:142
614099604,28cyclictest0-21swapper/209:29:322
614099594,30cyclictest0-21swapper/208:15:002
614099594,29cyclictest0-21swapper/208:00:062
614099594,29cyclictest0-21swapper/208:00:062
614099594,28cyclictest0-21swapper/210:40:002
614099594,28cyclictest0-21swapper/210:24:582
614099594,28cyclictest0-21swapper/207:09:582
614099594,13cyclictest0-21swapper/206:04:392
614099593,11cyclictest20907-21sendmail_mailqu10:15:032
6140995921,13cyclictest0-21swapper/206:15:012
6140995920,13cyclictest0-21swapper/206:35:042
6140995915,22cyclictest0-21swapper/208:09:442
6131995926,26cyclictest0-21swapper/006:25:150
6131995925,26cyclictest0-21swapper/005:35:030
614099585,29cyclictest0-21swapper/208:54:492
614099585,28cyclictest0-21swapper/210:55:002
614099585,27cyclictest0-21swapper/209:59:432
614099584,29cyclictest0-21swapper/206:19:582
614099584,29cyclictest0-21swapper/206:19:582
614099584,29cyclictest0-21swapper/206:05:002
614099584,29cyclictest0-21swapper/205:35:072
614099584,28cyclictest0-21swapper/205:50:052
614099584,10cyclictest10240-21sendmail_mailqu08:50:052
614099583,28cyclictest0-21swapper/209:19:492
6140995823,13cyclictest1286-21runrttasks10:13:492
6140995823,13cyclictest1286-21runrttasks10:13:492
613199583,38cyclictest22405-21crond08:09:340
242299580,4rtkit-daemon2421-21rtkit-daemon10:44:562
614099574,29cyclictest0-21swapper/208:59:572
316032574,46sleep00-21swapper/007:20:190
614099564,12cyclictest0-21swapper/208:44:342
6140995635,11cyclictest4485-21head06:29:492
613199565,33cyclictest0-21swapper/008:00:000
613199565,33cyclictest0-21swapper/008:00:000
613199564,42cyclictest0-21swapper/006:34:490
6131995633,14cyclictest0-21swapper/007:09:100
6131995633,14cyclictest0-21swapper/007:09:100
6140995537,10cyclictest28459-21grep07:15:042
6140995520,14cyclictest0-21swapper/205:55:462
613199554,27cyclictest0-21swapper/006:40:100
6131995524,14cyclictest0-21swapper/010:09:570
6131995524,14cyclictest0-21swapper/010:09:570
242299550,5rtkit-daemon2421-21rtkit-daemon09:10:372
159542552,46sleep00-21swapper/005:46:190
6140995421,13cyclictest0-21swapper/208:19:452
613199545,41cyclictest0-21swapper/006:04:590
613199544,30cyclictest0-21swapper/008:24:330
613199544,27cyclictest0-21swapper/009:09:440
6131995435,11cyclictest644-21grep08:29:470
6131995434,13cyclictest0-21swapper/009:00:090
6131995422,14cyclictest0-21swapper/005:40:180
287342544,8sleep00-21swapper/010:30:080
613199534,42cyclictest0-21swapper/010:14:490
613199534,32cyclictest0-21swapper/006:54:490
6131995335,11cyclictest7654-21cpuspeed_turbos10:54:430
6131995333,11cyclictest1286-21runrttasks08:58:140
242299530,4rtkit-daemon2421-21rtkit-daemon06:24:512
106242532,44sleep00-21swapper/008:50:120
614099524,28cyclictest0-21swapper/209:04:412
6140995232,12cyclictest9769-21tr06:39:492
614099523,42cyclictest13697-21latency_hist05:44:412
6140995217,14cyclictest0-21swapper/206:54:472
613199526,29cyclictest0-21swapper/009:20:100
613199524,39cyclictest0-21swapper/007:29:490
613199524,29cyclictest0-21swapper/008:24:470
613199524,26cyclictest0-21swapper/009:59:390
6131995232,12cyclictest0-21swapper/009:55:000
6131995222,11cyclictest386-21jbd2/dm-0-809:09:310
32702522,10sleep00-21swapper/008:38:110
242299520,5rtkit-daemon2421-21rtkit-daemon08:28:092
242299520,4rtkit-daemon2421-21rtkit-daemon10:19:502
242299520,4rtkit-daemon2421-21rtkit-daemon10:19:502
242299520,4rtkit-daemon2421-21rtkit-daemon08:45:013
242299520,4rtkit-daemon2421-21rtkit-daemon08:45:013
242299520,4rtkit-daemon2421-21rtkit-daemon08:05:102
242299520,4rtkit-daemon2421-21rtkit-daemon07:45:112
233112523,7sleep023350-21proc_pri10:20:000
233112523,7sleep023350-21proc_pri10:20:000
114132523,40sleep20-21swapper/209:58:012
614099514,28cyclictest0-21swapper/208:44:582
614099514,28cyclictest0-21swapper/208:44:582
614099514,28cyclictest0-21swapper/207:50:012
614099514,28cyclictest0-21swapper/205:30:152
6140995111,20cyclictest0-21swapper/207:29:462
613199514,29cyclictest0-21swapper/009:43:440
613199514,28cyclictest0-21swapper/010:39:450
613199514,28cyclictest0-21swapper/007:54:560
613199514,28cyclictest0-21swapper/007:54:560
613199514,28cyclictest0-21swapper/006:59:520
613199514,28cyclictest0-21swapper/005:30:010
6131995131,12cyclictest17445-21sed05:50:000
613199513,36cyclictest0-21swapper/008:43:240
6131995129,14cyclictest0-21swapper/009:49:540
6131995124,12cyclictest0-21swapper/010:49:450
242299510,5rtkit-daemon2421-21rtkit-daemon09:14:452
6140995031,12cyclictest12517-21df06:44:542
613199504,29cyclictest0-21swapper/006:10:140
613199504,28cyclictest0-21swapper/009:14:480
613199504,28cyclictest0-21swapper/007:15:000
613199504,28cyclictest0-21swapper/006:29:510
6131995031,12cyclictest0-21swapper/010:04:450
6131995030,13cyclictest0-21swapper/008:15:020
613199503,42cyclictest0-21swapper/009:32:350
613199503,42cyclictest0-21swapper/009:32:350
613199503,39cyclictest1350-21sendmail_mailqu07:25:040
242299500,4rtkit-daemon2421-21rtkit-daemon09:33:062
242299500,4rtkit-daemon2421-21rtkit-daemon09:33:062
240482502,10sleep00-21swapper/008:10:050
614099494,24cyclictest29476-21aten2.4-expect10:34:392
614099494,12cyclictest0-21swapper/207:04:502
614099494,12cyclictest0-21swapper/207:04:502
614099493,26cyclictest0-21swapper/206:10:082
613199495,37cyclictest0-21swapper/009:25:020
613199494,27cyclictest0-21swapper/010:24:400
613199494,27cyclictest0-21swapper/007:40:080
6131994934,10cyclictest0-21swapper/006:14:480
6131994932,10cyclictest12318-21grep06:44:520
6131994928,14cyclictest0-21swapper/008:49:330
6131994928,14cyclictest0-21swapper/008:49:330
6131994919,13cyclictest0-21swapper/005:58:080
6131994918,11cyclictest29883-21sshd10:34:440
242299490,4rtkit-daemon2421-21rtkit-daemon08:30:092
171162493,10sleep20-21swapper/207:56:292
171162493,10sleep20-21swapper/207:56:292
614099484,27cyclictest0-21swapper/209:38:432
614099484,26cyclictest0-21swapper/208:38:332
613199484,37cyclictest0-21swapper/009:44:510
613199484,29cyclictest0-21swapper/007:45:110
613199484,27cyclictest0-21swapper/006:19:590
613199484,27cyclictest0-21swapper/006:19:590
613199484,26cyclictest0-21swapper/007:53:260
613199484,25cyclictest0-21swapper/007:13:200
6131994834,10cyclictest0-21swapper/006:04:010
6131994833,10cyclictest0-21swapper/010:45:000
242299480,4rtkit-daemon2421-21rtkit-daemon09:41:142
6140994714,12cyclictest7150irq/45-ahci05:29:412
614199464,26cyclictest0-21swapper/309:14:253
614199463,25cyclictest0-21swapper/308:37:233
6141994617,12cyclictest0-21swapper/310:06:473
6141994431,8cyclictest19947-21forks10:14:483
613199444,33cyclictest6125-21cyclictest05:29:400
6131994416,13cyclictest0-21swapper/007:34:480
614199433,25cyclictest0-21swapper/310:55:023
614199413,24cyclictest0-21swapper/308:05:103
242299400,3rtkit-daemon2421-21rtkit-daemon06:04:523
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional