You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-20 - 16:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Celeron 33455 @1500 MHz, Linux 5.15.2-rt19 (Profile)

Latency plot of shadow in rack #c, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackcslot7s.osadl.org (updated Mon Mar 20, 2023 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4008515991432,20cyclictest141rcu_preempt12:18:582
4008509991338,15cyclictest26-21ksoftirqd/111:53:591
4008506991312,9cyclictest141rcu_preempt09:32:460
4008506991312,9cyclictest141rcu_preempt09:32:450
40085069912941,13cyclictest880726-21firefox11:42:310
4008509991252,24cyclictest0-21swapper/111:21:071
4008509991243,26cyclictest0-21swapper/112:02:401
40085099912362,8cyclictest26-21ksoftirqd/111:37:381
4008506991222,20cyclictest141rcu_preempt11:02:360
4008509991213,18cyclictest0-21swapper/110:52:201
4008506991214,10cyclictest141rcu_preempt12:34:420
4008506991212,17cyclictest141rcu_preempt09:52:580
4008506991192,19cyclictest141rcu_preempt10:26:490
4008506991192,19cyclictest141rcu_preempt10:26:480
4008509991162,17cyclictest141rcu_preempt07:58:081
4008506991162,8cyclictest0-21swapper/007:21:070
4008506991162,8cyclictest0-21swapper/007:21:060
4008509991132,26cyclictest0-21swapper/110:10:471
4008509991112,17cyclictest141rcu_preempt11:19:371
406905921090,8sleep10-21swapper/110:00:191
40085159910855,12cyclictest881337-21WRRende~ckend#107:11:212
1623991060,9rtkit-daemon1622-21rtkit-daemon08:03:510
40085159910557,20cyclictest881356-21Isolated14:31:442
1623991050,8rtkit-daemon1622-21rtkit-daemon10:44:110
4008509991032,13cyclictest880898-21Xwayland11:05:221
40085069910317,19cyclictest881369-21Timer10:30:340
40085219910144,49cyclictest881337-21WRRende~ckend#110:56:503
40085099910124,19cyclictest26-21ksoftirqd/112:07:551
4008521991002,93cyclictest880898-21Xwayland09:17:153
40085099910033,62cyclictest881337-21WRRende~ckend#110:45:191
4008515999843,13cyclictest881337-21WRRende~ckend#111:43:532
4008506999815,17cyclictest880965-21glean.dispatche10:45:200
400852199972,9cyclictest0-21swapper/312:10:583
4008515999642,12cyclictest881337-21WRRende~ckend#112:23:562
400851599962,89cyclictest880898-21Xwayland11:00:362
400850999962,26cyclictest1753-21gnome-shell09:12:581
4008509999618,23cyclictest26-21ksoftirqd/110:57:351
162399960,8rtkit-daemon1622-21rtkit-daemon12:38:480
40081232950,6sleep1251rcuc/107:07:201
4008521999481,8cyclictest881356-21Isolated14:31:443
400850699942,15cyclictest881337-21WRRende~ckend#110:37:190
162399940,8rtkit-daemon1622-21rtkit-daemon07:43:150
41173892930,5sleep10-21swapper/112:17:411
4008521999380,9cyclictest880898-21Xwayland07:48:383
400850999934,80cyclictest881253-21Renderer09:46:161
4008515999282,6cyclictest0-21swapper/209:17:142
400851599922,87cyclictest0-21swapper/212:10:592
162399920,79rtkit-daemon0-21swapper/307:08:043
40331022910,5sleep10-21swapper/108:15:311
400852199913,85cyclictest0-21swapper/309:41:583
4008515999179,8cyclictest3966797-21kworker/2:011:55:582
400851599912,7cyclictest3966797-21kworker/2:007:59:582
400850699912,86cyclictest0-21swapper/007:14:580
400852199903,84cyclictest0-21swapper/307:33:593
400850699903,55cyclictest881253-21Renderer09:26:440
400809929058,25sleep20-21swapper/207:07:022
4008515998980,5cyclictest0-21swapper/207:52:582
400799228956,25sleep00-21swapper/007:05:400
4008521998880,5cyclictest0-21swapper/312:08:593
4008521998879,6cyclictest0-21swapper/312:24:413
4008509998880,5cyclictest0-21swapper/111:00:371
400850999872,25cyclictest26-21ksoftirqd/108:13:251
4008509998713,54cyclictest4029979-21kworker/u8:008:22:401
40219722860,6sleep24021939-40lsb_release07:45:202
40178502860,3chrt4010220-21kworker/0:207:35:080
4008521998678,5cyclictest0-21swapper/311:48:583
4008521998678,5cyclictest0-21swapper/311:48:583
4008521998635,10cyclictest881337-21WRRende~ckend#112:04:113
4008515998680,4cyclictest0-21swapper/207:33:592
4008515998679,4cyclictest0-21swapper/210:22:582
400850699866,21cyclictest141rcu_preempt12:22:410
400850699842,52cyclictest881253-21Renderer11:37:380
4008521998350,9cyclictest42-21ksoftirqd/310:16:333
4008506998377,4cyclictest0-21swapper/012:10:580
4008506998332,19cyclictest141rcu_preempt07:52:240
4008515998274,5cyclictest0-21swapper/210:42:342
4008515998271,7cyclictest880898-21Xwayland10:35:192
4008506998212,8cyclictest141rcu_preempt08:18:260
4008509998172,6cyclictest4094889-21kworker/1:212:10:581
400850999813,51cyclictest4057620-21Classif~14:31:441
400850999813,49cyclictest0-21swapper/107:35:221
4008509998125,50cyclictest881253-21Renderer08:29:551
41242862800,3chrt4123210-21/usr/sbin/munin12:35:401
4008521998072,5cyclictest0-21swapper/311:11:583
400851599802,74cyclictest0-21swapper/208:35:122
4008509998022,45cyclictest881253-21Renderer10:05:471
4008506998063,11cyclictest881253-21Renderer10:00:480
4008506998025,49cyclictest881253-21Renderer07:34:070
4008521997929,26cyclictest42-21ksoftirqd/310:40:193
4008515997922,49cyclictest881337-21WRRende~ckend#111:24:532
4008509997964,9cyclictest881337-21WRRende~ckend#107:34:371
4008509997939,17cyclictest4060666-21ntp_states09:35:301
4008509997939,14cyclictest881356-21Isolated14:31:441
400850699792,22cyclictest0-21swapper/011:29:070
40555662780,5sleep0181irq_work/009:20:290
4008521997869,5cyclictest0-21swapper/308:28:413
4008521997810,8cyclictest141rcu_preempt10:49:363
4008506997865,7cyclictest881356-21Isolated14:31:440
400850999771,8cyclictest4001456-21kworker/1:207:22:591
400850999771,8cyclictest4001456-21kworker/1:207:22:591
4008506997759,13cyclictest881364-21IPC0
4008506997722,14cyclictest0-21swapper/010:09:320
4008515997669,5cyclictest0-21swapper/211:50:582
4008506997621,48cyclictest880966-21IPC0
4008521997515,50cyclictest0-21swapper/310:21:183
400851599754,26cyclictest0-21swapper/208:54:422
4008515997528,10cyclictest141rcu_preempt10:10:482
4008506997528,16cyclictest141rcu_preempt08:37:260
400850699752,7cyclictest141rcu_preempt09:39:460
400850999742,61cyclictest881253-21Renderer09:42:151
4008509997413,47cyclictest881356-21Isolated14:31:441
4008506997416,50cyclictest881369-21Timer11:32:230
4008521997352,12cyclictest42-21ksoftirqd/307:14:213
400852199732,28cyclictest881253-21Renderer09:37:313
4008521997316,51cyclictest881364-21IPC3
400852199731,13cyclictest881356-21Isolated14:31:443
4008515997359,10cyclictest34-21ksoftirqd/210:53:352
4008515997340,12cyclictest34-21ksoftirqd/212:27:562
400851599731,28cyclictest0-21swapper/212:07:252
400850699733,8cyclictest141rcu_preempt10:10:470
400852199723,61cyclictest881253-21Renderer07:52:233
4008521997229,25cyclictest42-21ksoftirqd/309:03:583
400851599726,32cyclictest0-21swapper/209:50:312
4008515997213,50cyclictest881253-21Renderer07:22:512
4008515997213,50cyclictest881253-21Renderer07:22:512
400850999724,59cyclictest0-21swapper/107:12:351
4008506997266,4cyclictest0-21swapper/009:41:580
400850699722,9cyclictest0-21swapper/011:11:070
4008521997150,15cyclictest881262-21Compositor07:43:523
400852199712,56cyclictest880898-21Xwayland12:15:413
4008521997112,7cyclictest141rcu_preempt12:38:273
4008515997164,4cyclictest0-21swapper/211:48:592
4008515997164,4cyclictest0-21swapper/211:48:582
4008515997120,47cyclictest34-21ksoftirqd/209:13:582
400851599711,7cyclictest141rcu_preempt10:46:502
4008509997162,5cyclictest0-21swapper/109:17:141
4008509997161,6cyclictest4039082-21apt08:35:121
4008509997118,11cyclictest26-21ksoftirqd/112:22:421
400850999711,19cyclictest141rcu_preempt07:47:541
400850699715,19cyclictest881356-21Isolated14:31:440
400850699713,23cyclictest880898-21Xwayland10:56:500
400850699712,8cyclictest141rcu_preempt07:25:590
4008506997115,11cyclictest0-21swapper/009:46:160
4008506997110,52cyclictest881253-21Renderer11:45:540
4008506997110,52cyclictest881253-21Renderer11:45:540
400852199702,60cyclictest881253-21Renderer10:08:173
4008521997023,23cyclictest141rcu_preempt08:40:113
400852199702,23cyclictest880898-21Xwayland11:06:213
4008509997010,14cyclictest880898-21Xwayland07:18:371
4008506997062,5cyclictest0-21swapper/010:22:590
400852199694,58cyclictest881337-21WRRende~ckend#111:53:393
400852199692,60cyclictest880898-21Xwayland11:29:223
400852199692,59cyclictest880898-21Xwayland09:54:313
4008521996916,48cyclictest0-21swapper/308:46:573
4008515996958,8cyclictest3966797-21kworker/2:011:11:582
400851599693,58cyclictest1753-21gnome-shell09:44:322
400851599693,4cyclictest141rcu_preempt12:35:432
400851599692,60cyclictest880898-21Xwayland10:02:322
4008515996910,14cyclictest0-21swapper/212:30:572
4008509996945,10cyclictest881369-21Timer08:44:271
400850999693,10cyclictest881356-21Isolated14:31:441
400850999692,57cyclictest881253-21Renderer08:30:401
4008509996915,46cyclictest0-21swapper/110:22:581
4008506996963,4cyclictest0-21swapper/008:21:410
4008506996962,4cyclictest0-21swapper/011:55:580
4008506996930,7cyclictest141rcu_preempt08:31:560
400852199683,58cyclictest880898-21Xwayland10:01:333
400852199683,57cyclictest881337-21WRRende~ckend#108:59:283
400852199682,59cyclictest880898-21Xwayland12:33:283
4008521996811,51cyclictest0-21swapper/309:29:143
4008515996854,9cyclictest880898-21Xwayland11:30:532
4008515996851,6cyclictest34-21ksoftirqd/208:33:592
400851599684,55cyclictest881356-21Isolated14:31:442
4008515996816,47cyclictest34-21ksoftirqd/209:06:442
4008515996816,47cyclictest34-21ksoftirqd/209:06:432
400850699688,15cyclictest881337-21WRRende~ckend#112:16:410
400850699686,53cyclictest880898-21Xwayland08:40:260
400850699683,55cyclictest880898-21Xwayland09:12:440
4008506996817,8cyclictest0-21swapper/008:48:580
4008521996738,22cyclictest881253-21Renderer09:20:443
4008521996717,45cyclictest881337-21WRRende~ckend#111:42:243
4008521996714,47cyclictest881253-21Renderer09:33:463
4008521996714,47cyclictest881253-21Renderer09:33:453
400851599673,19cyclictest880898-21Xwayland10:34:352
400851599672,4cyclictest141rcu_preempt10:16:482
4008515996722,42cyclictest0-21swapper/210:07:332
4008509996759,5cyclictest0-21swapper/111:55:591
400850999675,17cyclictest881356-21Isolated14:31:441
400850999675,14cyclictest0-21swapper/109:32:461
400850999675,14cyclictest0-21swapper/109:32:451
400850999673,19cyclictest1753-21gnome-shell08:51:581
400850999672,61cyclictest881253-21Renderer08:56:421
4008509996710,53cyclictest0-21swapper/111:30:091
4008506996751,12cyclictest13-21ksoftirqd/008:50:430
4008521996657,6cyclictest0-21swapper/310:36:583
400852199663,55cyclictest42-21ksoftirqd/310:10:173
4008521996617,45cyclictest881337-21WRRende~ckend#107:17:063
400851599664,17cyclictest880898-21Xwayland12:03:402
400850999666,12cyclictest0-21swapper/110:30:331
400850999664,17cyclictest881356-21Isolated14:31:441
400850699664,17cyclictest880898-21Xwayland11:24:220
4008506996618,40cyclictest881356-21Isolated14:31:440
400852199652,59cyclictest880898-21Xwayland11:30:233
400851599654,16cyclictest880898-21Xwayland09:02:592
4008509996558,4cyclictest0-21swapper/107:52:591
400850999654,52cyclictest881356-21Isolated14:31:441
4008509996514,45cyclictest0-21swapper/108:08:241
400850699654,15cyclictest881356-21Isolated14:31:440
400850699653,9cyclictest0-21swapper/012:03:410
400850699653,16cyclictest880898-21Xwayland08:56:420
400852199649,11cyclictest0-21swapper/309:11:283
400852199645,52cyclictest880898-21Xwayland12:27:563
400852199644,53cyclictest881356-21Isolated14:31:443
400852199644,53cyclictest880898-21Xwayland11:17:233
400852199644,15cyclictest881356-21Isolated14:31:443
400852199644,15cyclictest880898-21Xwayland07:57:543
400852199642,19cyclictest881253-21Renderer10:30:183
400851599647,49cyclictest881337-21WRRende~ckend#108:49:272
4008515996458,4cyclictest0-21swapper/208:43:412
400851599644,51cyclictest881356-21Isolated14:31:442
400851599644,15cyclictest881356-21Isolated14:31:442
400851599643,16cyclictest881253-21Renderer09:38:452
400851599641,58cyclictest1069-21runrttasks08:09:102
400850999646,49cyclictest881337-21WRRende~ckend#112:30:571
400850999643,12cyclictest881356-21Isolated14:31:441
400850999643,12cyclictest881356-21Isolated14:31:441
4008509996413,45cyclictest881253-21Renderer09:52:471
400850699642,26cyclictest141rcu_preempt08:28:560
400852199634,14cyclictest881337-21WRRende~ckend#107:35:523
400852199633,52cyclictest881356-21Isolated14:31:443
400852199633,52cyclictest880898-21Xwayland09:07:433
400852199633,52cyclictest880898-21Xwayland09:07:433
400852199632,56cyclictest881337-21WRRende~ckend#110:29:493
400852199632,56cyclictest881337-21WRRende~ckend#110:29:493
400851599634,50cyclictest881356-21Isolated14:31:442
400851599633,16cyclictest881356-21Isolated14:31:442
4008515996311,47cyclictest0-21swapper/210:28:482
4008515996311,47cyclictest0-21swapper/210:28:482
400850999632,15cyclictest881253-21Renderer11:45:241
400850999632,15cyclictest881253-21Renderer11:45:241
400850699634,14cyclictest881337-21WRRende~ckend#111:52:540
40870482620,5sleep00-21swapper/010:50:290
400852199623,17cyclictest880898-21Xwayland08:31:413
400851599629,11cyclictest881253-21Renderer11:07:062
4008515996256,4cyclictest0-21swapper/208:28:402
400851599625,13cyclictest881253-21Renderer09:59:312
400851599624,14cyclictest0-21swapper/208:58:572
400851599623,52cyclictest880898-21Xwayland07:43:382
4008515996231,10cyclictest34-21ksoftirqd/207:15:212
400851599622,17cyclictest881253-21Renderer09:46:472
4008509996245,10cyclictest881337-21WRRende~ckend#107:28:511
4008509996241,13cyclictest881356-21Isolated14:31:441
400850999623,52cyclictest881337-21WRRende~ckend#110:39:501
400850699624,49cyclictest0-21swapper/012:26:570
400850699623,52cyclictest880898-21Xwayland09:01:580
400850699622,54cyclictest880898-21Xwayland08:11:240
4008521996145,10cyclictest881337-21WRRende~ckend#108:20:263
400852199614,15cyclictest880898-21Xwayland11:56:243
400852199613,50cyclictest880965-21glean.dispatche11:01:513
400852199612,53cyclictest880898-21Xwayland07:22:513
400852199612,53cyclictest880898-21Xwayland07:22:513
400851599614,50cyclictest881356-21Isolated14:31:442
400851599612,16cyclictest880898-21Xwayland11:16:522
4008515996112,8cyclictest0-21swapper/208:14:092
400850999612,54cyclictest880898-21Xwayland08:49:121
400850699613,51cyclictest881356-21Isolated14:31:440
400850699613,50cyclictest881356-21Isolated14:31:440
400850699612,51cyclictest880898-21Xwayland12:08:550
400852199608,48cyclictest881251-21Softwar~cThread07:28:073
4008521996038,14cyclictest880898-21Xwayland09:57:463
4008509996011,8cyclictest0-21swapper/109:20:441
400852199594,49cyclictest881253-21Renderer08:04:553
400850999593,11cyclictest0-21swapper/111:11:361
4008521995845,8cyclictest42-21ksoftirqd/308:11:543
400851599583,12cyclictest881356-21Isolated14:31:442
400851599582,48cyclictest881253-21Renderer09:31:302
400851599582,48cyclictest881253-21Renderer09:31:302
400850999583,49cyclictest881356-21Isolated14:31:441
400850999583,49cyclictest881356-21Isolated14:31:441
400850699582,12cyclictest881253-21Renderer09:09:280
400850699582,12cyclictest881253-21Renderer09:09:280
400852199571,7cyclictest141rcu_preempt10:51:213
400851599573,48cyclictest881356-21Isolated14:31:442
400850999579,8cyclictest26-21ksoftirqd/110:16:191
4008509995739,13cyclictest1753-21gnome-shell09:00:131
400852199553,46cyclictest1753-21gnome-shell08:52:593
400851599553,46cyclictest881356-21Isolated14:31:442
400850699552,47cyclictest0-21swapper/011:15:370
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional