You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-05 - 16:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Tue Dec 05, 2023 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24388999912,64cyclictest12334-21kernelversion08:11:150
2438899923,23cyclictest2159-21sh05:45:480
24388998921,52cyclictest0-21swapper/008:36:030
2438899883,24cyclictest0-21swapper/008:06:000
2438899883,24cyclictest0-21swapper/008:06:000
24388998815,13cyclictest0-21swapper/008:46:100
24388998815,13cyclictest0-21swapper/008:46:100
2438899874,75cyclictest0-21swapper/008:26:100
2438899874,29cyclictest0-21swapper/006:11:260
2438899874,26cyclictest0-21swapper/010:01:130
2438899873,24cyclictest0-21swapper/010:51:090
2438899873,24cyclictest0-21swapper/010:51:090
2438899873,24cyclictest0-21swapper/006:51:050
2438899864,75cyclictest0-21swapper/010:15:570
2438899864,27cyclictest0-21swapper/005:31:260
2438899864,25cyclictest0-21swapper/009:21:100
24388998631,48cyclictest5724-21grep10:06:050
24388998631,48cyclictest5724-21grep10:06:050
2438899854,74cyclictest0-21swapper/007:41:070
2438899854,18cyclictest0-21swapper/010:37:340
2438899853,27cyclictest0-21swapper/006:41:170
24388998421,9cyclictest1222-21snmpd07:15:060
24388998416,9cyclictest951-21ntpq09:56:160
24388998415,13cyclictest0-21swapper/007:25:440
24388998415,13cyclictest0-21swapper/007:25:440
2438899834,25cyclictest0-21swapper/006:56:090
2438899824,69cyclictest0-21swapper/009:15:290
24388998230,45cyclictest24815-21fgrep07:31:270
2438899823,26cyclictest0-21swapper/009:05:410
2438899814,69cyclictest0-21swapper/010:10:400
24388998127,46cyclictest13109-21grep10:21:010
2438899804,26cyclictest0-21swapper/006:31:230
2438899803,69cyclictest0-21swapper/010:30:050
2438899803,23cyclictest0-21swapper/005:46:090
24388998023,8cyclictest1274-21runrttasks09:53:380
2438899794,67cyclictest0-21swapper/007:06:170
2438899794,34cyclictest0-21swapper/006:21:280
2438899794,26cyclictest0-21swapper/009:06:220
2438899794,15cyclictest0-21swapper/006:06:240
2438899794,14cyclictest0-21swapper/006:26:120
2438899794,12cyclictest0-21swapper/009:46:180
2438899793,68cyclictest0-21swapper/009:33:010
24388997836,35cyclictest26482-21grep05:26:330
2438899783,68cyclictest7852-21tr05:56:090
2438899783,23cyclictest0-21swapper/010:45:590
2438899783,23cyclictest0-21swapper/009:40:580
24388997823,8cyclictest1274-21runrttasks07:46:430
24388997820,8cyclictest1274-21runrttasks07:03:180
2438899774,66cyclictest0-21swapper/009:00:410
2438899774,66cyclictest0-21swapper/007:51:060
2438899773,23cyclictest0-21swapper/008:15:590
24388997722,8cyclictest1274-21runrttasks08:05:000
24388997721,48cyclictest0-21swapper/009:20:400
2438899764,23cyclictest0-21swapper/005:36:120
2438899764,21cyclictest0-21swapper/010:41:040
2438899764,20cyclictest0-21swapper/010:31:100
2438899764,20cyclictest0-21swapper/008:45:410
2438899763,66cyclictest0-21swapper/005:51:110
2438899763,22cyclictest0-21swapper/008:21:030
2438899763,20cyclictest25776-21munin-node07:36:120
24388997620,9cyclictest1274-21runrttasks08:51:140
2438899755,12cyclictest24377-21munin-run05:25:490
2438899754,63cyclictest0-21swapper/006:46:120
2438899753,20cyclictest0-21swapper/007:20:090
24388997520,8cyclictest28158-21df_abs06:36:080
24388997519,8cyclictest22724-21fschecks_time09:36:050
24388997510,12cyclictest0-21swapper/006:16:340
2438899743,23cyclictest0-21swapper/007:56:190
2438899743,12cyclictest0-21swapper/009:26:030
2438899743,12cyclictest0-21swapper/009:26:030
24388997426,42cyclictest21728-21gltestperf07:26:100
24388997422,8cyclictest11109-21if_err_eth006:01:180
24388997422,8cyclictest11109-21if_err_eth006:01:180
250652720,5sleep125068-21unixbench-2d07:31:301
24393997126,26cyclictest17228-21gltestperf08:21:101
2438899714,12cyclictest0-21swapper/008:31:010
2439399638,21cyclictest0-21swapper/109:45:391
2439499600,11cyclictest4510-21kworker/0:110:05:382
159172604,11sleep10-21swapper/108:19:511
24393995827,25cyclictest0-21swapper/108:37:341
24393995822,14cyclictest0-21swapper/106:11:251
83922573,47sleep10-21swapper/108:05:411
39462573,47sleep20-21swapper/207:56:072
24395995730,12cyclictest0-21swapper/309:20:413
2439599573,11cyclictest0-21swapper/305:55:573
2439499574,46cyclictest0-21swapper/210:41:152
2439499574,46cyclictest0-21swapper/208:45:582
2439499574,46cyclictest0-21swapper/208:45:582
2439499574,46cyclictest0-21swapper/206:21:142
24393995719,13cyclictest0-21swapper/108:31:161
135612573,45sleep10-21swapper/107:11:081
12142573,47sleep10-21swapper/108:55:021
2439499564,44cyclictest0-21swapper/210:26:102
2439399565,26cyclictest0-21swapper/107:00:061
2439399564,29cyclictest0-21swapper/110:15:541
2439399564,29cyclictest0-21swapper/109:21:111
2439399564,29cyclictest0-21swapper/107:06:141
2439399564,29cyclictest0-21swapper/106:26:141
2439399564,29cyclictest0-21swapper/105:56:231
2439399564,28cyclictest0-21swapper/109:38:101
24393995625,11cyclictest31368-21df_abs07:46:041
24393995620,14cyclictest0-21swapper/109:10:551
24393995613,20cyclictest4106-21latency_hist09:00:421
243699560,6rtkit-daemon2435-21rtkit-daemon10:41:133
243699560,6rtkit-daemon2435-21rtkit-daemon09:06:023
243699560,5rtkit-daemon2435-21rtkit-daemon06:37:453
71642554,13sleep30-21swapper/305:54:523
2439499553,45cyclictest0-21swapper/206:51:052
2439399555,31cyclictest0-21swapper/110:46:121
2439399555,28cyclictest0-21swapper/108:06:221
2439399555,28cyclictest0-21swapper/108:06:221
2439399555,28cyclictest0-21swapper/107:36:261
2439399555,28cyclictest0-21swapper/106:37:361
2439399555,28cyclictest0-21swapper/105:31:271
2439399555,27cyclictest0-21swapper/109:20:401
2439399554,29cyclictest0-21swapper/110:51:051
2439399554,29cyclictest0-21swapper/110:51:051
2439399554,29cyclictest0-21swapper/107:51:111
2439399554,29cyclictest0-21swapper/106:01:261
2439399554,29cyclictest0-21swapper/106:01:261
2439399554,28cyclictest0-21swapper/109:51:171
2439399554,28cyclictest0-21swapper/109:25:571
2439399554,28cyclictest0-21swapper/109:25:571
2439399554,27cyclictest0-21swapper/108:50:241
2439399554,27cyclictest0-21swapper/108:50:241
2439399554,27cyclictest0-21swapper/107:41:211
2439399554,27cyclictest0-21swapper/106:24:581
2439399554,27cyclictest0-21swapper/105:41:111
24393995520,14cyclictest0-21swapper/108:41:101
24393995520,13cyclictest0-21swapper/110:06:211
24393995520,13cyclictest0-21swapper/110:06:211
24393995519,13cyclictest0-21swapper/107:21:241
24393995519,13cyclictest0-21swapper/107:21:241
24393995510,27cyclictest0-21swapper/106:31:061
243699550,5rtkit-daemon2435-21rtkit-daemon08:37:413
63872543,10sleep10-21swapper/109:05:021
271402542,10sleep30-21swapper/305:31:063
2439499544,45cyclictest0-21swapper/206:34:142
2439499544,44cyclictest0-21swapper/206:09:552
2439499544,43cyclictest0-21swapper/205:26:242
2439499543,45cyclictest0-21swapper/210:31:042
2439399546,27cyclictest0-21swapper/105:36:061
2439399545,29cyclictest0-21swapper/109:46:191
2439399545,28cyclictest0-21swapper/110:00:561
2439399545,26cyclictest0-21swapper/109:10:281
2439399544,28cyclictest0-21swapper/109:31:111
2439399544,28cyclictest0-21swapper/105:51:221
2439399544,27cyclictest0-21swapper/110:00:391
2439399544,26cyclictest0-21swapper/110:15:391
2439399544,26cyclictest0-21swapper/105:49:521
24393995420,12cyclictest0-21swapper/110:20:431
243699540,5rtkit-daemon2435-21rtkit-daemon06:41:303
243699540,4rtkit-daemon2435-21rtkit-daemon10:26:593
160152542,11sleep10-21swapper/110:26:111
77812532,10sleep20-21swapper/207:00:212
2439499534,43cyclictest0-21swapper/207:25:452
2439499534,43cyclictest0-21swapper/207:25:452
24394995315,15cyclictest0-21swapper/209:15:412
2439399539,24cyclictest0-21swapper/108:26:171
2439399539,20cyclictest0-21swapper/106:05:491
2439399534,28cyclictest0-21swapper/106:41:201
2439399534,26cyclictest0-21swapper/107:30:451
24393995322,14cyclictest0-21swapper/110:36:091
243699530,6rtkit-daemon2435-21rtkit-daemon08:16:113
243699530,5rtkit-daemon2435-21rtkit-daemon09:31:083
243699530,5rtkit-daemon2435-21rtkit-daemon07:16:213
243699530,5rtkit-daemon2435-21rtkit-daemon06:21:083
24394995236,10cyclictest21506-21grep07:26:082
2439499523,43cyclictest0-21swapper/207:45:362
243699520,6rtkit-daemon2435-21rtkit-daemon08:01:123
243699520,5rtkit-daemon2435-21rtkit-daemon08:31:113
243699520,5rtkit-daemon2435-21rtkit-daemon07:01:073
193312523,10sleep10-21swapper/110:31:351
326212513,7sleep3304-21df_inode05:41:103
302692512,10sleep30-21swapper/307:41:453
246882513,10sleep10-21swapper/110:45:171
2439499514,41cyclictest0-21swapper/207:37:442
2439499513,42cyclictest0-21swapper/210:40:372
243699510,6rtkit-daemon2435-21rtkit-daemon05:24:483
243699510,5rtkit-daemon2435-21rtkit-daemon09:01:103
243699510,5rtkit-daemon2435-21rtkit-daemon07:31:213
243699510,4rtkit-daemon2435-21rtkit-daemon07:11:213
173312513,41sleep20-21swapper/206:15:472
132182513,41sleep10-21swapper/108:12:501
2439599505,39cyclictest0-21swapper/307:55:433
2439599503,42cyclictest0-21swapper/310:06:153
2439599503,42cyclictest0-21swapper/310:06:153
2439499505,38cyclictest0-21swapper/208:21:212
24394995034,10cyclictest28567-21grep06:36:122
24394995033,11cyclictest14413-21wc07:11:182
24394995022,22cyclictest23808-21df_abs07:31:122
24394995020,12cyclictest0-21swapper/206:16:272
2439399504,40cyclictest0-21swapper/107:01:241
243699500,5rtkit-daemon2435-21rtkit-daemon10:50:583
243699500,5rtkit-daemon2435-21rtkit-daemon10:50:583
120562503,9sleep30-21swapper/310:20:253
271722492,40sleep30-21swapper/310:49:473
2439599494,38cyclictest0-21swapper/305:36:273
24395994934,9cyclictest4879-21unixbench_multi06:51:293
2439499494,38cyclictest0-21swapper/207:06:102
24394994934,10cyclictest7009-21cpuspeed_turbos09:05:572
24394994933,11cyclictest1800-21grep07:51:102
2439499493,27cyclictest0-21swapper/207:46:192
24394994919,12cyclictest0-21swapper/206:41:132
243699490,5rtkit-daemon2435-21rtkit-daemon10:01:223
243699490,4rtkit-daemon2435-21rtkit-daemon05:21:182
234152492,9sleep20-21swapper/208:33:472
189862492,9sleep20-21swapper/209:29:332
189862492,9sleep20-21swapper/209:29:332
185032493,40sleep318567-21cat08:25:423
176692493,11sleep10-21swapper/107:17:251
114522492,10sleep30-21swapper/309:15:153
92282482,10sleep20-21swapper/210:11:412
2439499485,36cyclictest0-21swapper/209:16:002
2439499484,37cyclictest10088-21cpuspeed_turbos10:15:572
2439499484,37cyclictest0-21swapper/208:56:082
2439499484,28cyclictest0-21swapper/209:46:162
24394994833,9cyclictest25176-21needreboot08:36:152
24394994833,10cyclictest31286-21unixbench_multi09:51:212
24394994833,10cyclictest13294-21grep10:21:032
24394994820,9cyclictest1222-21snmpd05:49:512
24394994810,20cyclictest0-21swapper/208:25:592
2439399484,28cyclictest0-21swapper/106:46:091
243699480,4rtkit-daemon2435-21rtkit-daemon06:48:303
240882482,9sleep30-21swapper/309:40:023
147482483,10sleep30-21swapper/306:10:003
56442473,11sleep10-21swapper/107:57:471
263942473,7sleep226395-21sshd09:42:072
2439599475,9cyclictest0-21swapper/310:35:183
2439599474,37cyclictest0-21swapper/308:12:423
24395994732,9cyclictest26712-21tr08:41:023
2439599472,40cyclictest0-21swapper/306:19:443
2439499476,35cyclictest0-21swapper/205:51:062
2439499475,36cyclictest0-21swapper/210:50:552
2439499475,36cyclictest0-21swapper/210:50:552
2439499474,35cyclictest0-21swapper/205:41:042
2439499474,28cyclictest0-21swapper/209:01:042
2439499474,27cyclictest0-21swapper/205:31:292
2439499474,26cyclictest0-21swapper/208:51:242
24394994732,9cyclictest5732-21sed10:06:052
24394994732,9cyclictest5732-21sed10:06:052
24394994731,10cyclictest8747-21grep07:01:122
24394994727,16cyclictest0-21swapper/208:06:062
24394994727,16cyclictest0-21swapper/208:06:062
2439499472,40cyclictest0-21swapper/208:15:182
2439399475,25cyclictest0-21swapper/106:19:571
2439399474,27cyclictest0-21swapper/105:26:261
24393994717,13cyclictest0-21swapper/106:55:051
203172472,10sleep30-21swapper/310:35:563
122352472,38sleep30-21swapper/306:05:123
122352472,38sleep30-21swapper/306:05:123
308772462,9sleep30-21swapper/308:47:103
308772462,9sleep30-21swapper/308:47:103
2439599463,37cyclictest0-21swapper/309:25:543
2439599463,37cyclictest0-21swapper/309:25:543
2439499465,13cyclictest0-21swapper/209:25:392
2439499464,28cyclictest0-21swapper/206:26:022
2439499464,27cyclictest0-21swapper/210:45:572
2439499464,25cyclictest0-21swapper/209:57:402
2439499464,24cyclictest0-21swapper/209:31:152
24394994631,10cyclictest10317-21cpuspeed_turbos06:01:102
24394994631,10cyclictest10317-21cpuspeed_turbos06:01:102
2439499463,37cyclictest0-21swapper/208:16:112
243699460,4rtkit-daemon2435-21rtkit-daemon09:56:223
210022462,9sleep30-21swapper/308:30:213
152522463,36sleep315324-21http_loadtime09:21:083
41892452,36sleep30-21swapper/307:56:123
316332452,37sleep20-21swapper/205:36:452
266202452,36sleep30-21swapper/305:27:153
265392452,10sleep30-21swapper/309:44:013
2439599454,34cyclictest0-21swapper/306:56:043
2439599454,23cyclictest20643-21date07:25:453
2439599454,23cyclictest20643-21date07:25:453
24395994530,9cyclictest31329-21unixbench_singl09:51:223
24395994530,10cyclictest2660-21gltestperf08:56:093
2439499454,35cyclictest0-21swapper/208:01:242
2439499454,25cyclictest0-21swapper/208:41:092
2439499454,25cyclictest0-21swapper/207:16:032
24394994518,11cyclictest0-21swapper/206:46:222
171892453,35sleep30-21swapper/306:13:593
9242442,35sleep30-21swapper/308:51:333
75862442,34sleep20-21swapper/205:56:082
2439599444,12cyclictest0-21swapper/307:36:083
24395994431,8cyclictest8071-21grep10:11:033
24395994429,9cyclictest23713-21hwlatdetect06:26:143
24395994427,10cyclictest9027-21cstates08:06:033
24395994427,10cyclictest9027-21cstates08:06:033
24394994425,15cyclictest0-21swapper/209:36:142
103782442,9sleep30-21swapper/307:05:463
4752432,35sleep30-21swapper/307:48:343
44182432,35sleep30-21swapper/305:46:583
24395994323,15cyclictest0-21swapper/307:26:113
243699430,5rtkit-daemon2435-21rtkit-daemon10:22:513
243699420,4rtkit-daemon2435-21rtkit-daemon09:46:303
243699420,4rtkit-daemon2435-21rtkit-daemon06:31:153
2439399354,13cyclictest0-21swapper/105:25:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional