You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-17 - 21:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Jul 17, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2230991060,9rtkit-daemon0-21swapper/109:16:541
2230991040,6rtkit-daemon0-21swapper/107:00:451
2230991010,7rtkit-daemon0-21swapper/107:42:281
2230991010,6rtkit-daemon0-21swapper/107:21:141
2230991000,8rtkit-daemon0-21swapper/106:26:311
2230991000,7rtkit-daemon0-21swapper/108:07:201
2230991000,6rtkit-daemon24564-21perl08:57:101
2230991000,6rtkit-daemon0-21swapper/109:04:401
2230991000,6rtkit-daemon0-21swapper/108:33:491
2230991000,6rtkit-daemon0-21swapper/108:25:411
223099990,8rtkit-daemon0-21swapper/108:49:561
223099990,8rtkit-daemon0-21swapper/107:26:361
223099990,6rtkit-daemon29259-21fschecks_count09:07:101
223099990,6rtkit-daemon0-21swapper/108:01:121
223099990,6rtkit-daemon0-21swapper/108:01:121
223099990,6rtkit-daemon0-21swapper/106:44:451
223099990,5rtkit-daemon14593-21python07:27:291
223099980,6rtkit-daemon12-21rcu_preempt08:20:341
223099980,6rtkit-daemon11246-21df_inode09:37:091
223099980,6rtkit-daemon0-21swapper/110:15:521
223099980,6rtkit-daemon0-21swapper/109:13:251
223099980,6rtkit-daemon0-21swapper/107:51:201
223099980,6rtkit-daemon0-21swapper/107:39:131
223099980,6rtkit-daemon0-21swapper/107:31:591
223099970,8rtkit-daemon0-21swapper/109:28:461
223099970,7rtkit-daemon0-21swapper/109:32:091
223099970,7rtkit-daemon0-21swapper/106:29:011
223099970,6rtkit-daemon20995-21perl09:57:081
223099970,6rtkit-daemon0-21swapper/110:03:451
223099970,6rtkit-daemon0-21swapper/110:03:451
223099970,6rtkit-daemon0-21swapper/109:56:381
223099970,6rtkit-daemon0-21swapper/109:48:081
223099970,6rtkit-daemon0-21swapper/108:12:191
223099970,6rtkit-daemon0-21swapper/107:53:051
223099970,6rtkit-daemon0-21swapper/107:12:441
223099970,6rtkit-daemon0-21swapper/107:12:441
223099970,6rtkit-daemon0-21swapper/107:10:221
223099970,6rtkit-daemon0-21swapper/107:03:521
223099970,6rtkit-daemon0-21swapper/106:53:231
223099970,6rtkit-daemon0-21swapper/106:48:451
223099970,6rtkit-daemon0-21swapper/106:38:311
223099970,6rtkit-daemon0-21swapper/106:33:311
223099970,6rtkit-daemon0-21swapper/106:33:311
223099960,8rtkit-daemon0-21swapper/108:37:341
223099960,7rtkit-daemon0-21swapper/108:43:261
223099960,6rtkit-daemon0-21swapper/110:20:221
223099960,6rtkit-daemon0-21swapper/110:07:301
223099960,6rtkit-daemon0-21swapper/109:44:381
223099960,6rtkit-daemon0-21swapper/109:23:541
223099960,6rtkit-daemon0-21swapper/109:23:541
223099960,6rtkit-daemon0-21swapper/108:52:551
223099960,6rtkit-daemon0-21swapper/108:26:561
223099960,6rtkit-daemon0-21swapper/108:01:571
223099790,4rtkit-daemon2229-21rtkit-daemon10:39:213
223099780,7rtkit-daemon8701-21cat08:22:270
223099770,5rtkit-daemon1265-21runrttasks10:19:000
65502760,6sleep06549-21grep09:27:070
223099710,5rtkit-daemon0-21swapper/107:27:590
223099700,6rtkit-daemon0-21swapper/107:47:350
223099680,6rtkit-daemon0-21swapper/108:06:050
223099660,4rtkit-daemon2229-21rtkit-daemon11:01:582
14171996622,11cyclictest2640-21cpuspeed_turbos08:12:073
94412655,11sleep00-21swapper/010:42:010
1416699633,52cyclictest0-21swapper/011:16:460
223099620,7rtkit-daemon0-21swapper/210:33:443
12182628,8sleep00-21swapper/008:07:240
1417199617,41cyclictest0-21swapper/308:16:583
1416699613,52cyclictest0-21swapper/006:47:290
1416999594,28cyclictest0-21swapper/111:06:481
223099580,7rtkit-daemon0-21swapper/211:06:503
1416699584,47cyclictest0-21swapper/009:02:100
1416699583,48cyclictest6316-21timerandwakeup08:17:280
223099570,6rtkit-daemon0-21swapper/107:53:350
223099570,5rtkit-daemon0-21swapper/108:40:030
14170995726,14cyclictest0-21swapper/211:37:152
1416999574,28cyclictest0-21swapper/111:17:161
1416699574,45cyclictest0-21swapper/009:07:170
47752569,7sleep20-21swapper/209:22:192
47752569,7sleep20-21swapper/209:22:192
223099560,7rtkit-daemon2229-21rtkit-daemon10:48:282
223099560,7rtkit-daemon2229-21rtkit-daemon10:48:282
223099560,6rtkit-daemon0-21swapper/109:46:160
223099560,6rtkit-daemon0-21swapper/107:18:070
223099560,6rtkit-daemon0-21swapper/107:02:070
223099560,6rtkit-daemon0-21swapper/107:00:370
223099560,5rtkit-daemon2229-21rtkit-daemon11:16:272
223099560,5rtkit-daemon2229-21rtkit-daemon11:09:282
223099560,4rtkit-daemon2229-21rtkit-daemon10:32:142
223099560,4rtkit-daemon2229-21rtkit-daemon10:31:142
1417099564,44cyclictest0-21swapper/208:12:072
1416699563,47cyclictest0-21swapper/010:27:190
282892552,17sleep20-21swapper/206:49:472
223099550,6rtkit-daemon2229-21rtkit-daemon11:32:572
223099550,6rtkit-daemon2229-21rtkit-daemon11:23:492
223099550,6rtkit-daemon2229-21rtkit-daemon11:21:202
223099550,6rtkit-daemon2229-21rtkit-daemon06:17:021
223099550,6rtkit-daemon0-21swapper/108:31:410
223099550,6rtkit-daemon0-21swapper/107:57:580
223099550,6rtkit-daemon0-21swapper/107:57:580
223099550,6rtkit-daemon0-21swapper/107:36:510
223099550,6rtkit-daemon0-21swapper/106:36:530
223099550,6rtkit-daemon0-21swapper/106:36:530
223099550,6rtkit-daemon0-21swapper/106:27:090
223099550,5rtkit-daemon2229-21rtkit-daemon11:49:482
223099550,5rtkit-daemon2229-21rtkit-daemon11:45:042
223099550,5rtkit-daemon2229-21rtkit-daemon11:30:192
223099550,5rtkit-daemon2229-21rtkit-daemon11:30:192
223099550,5rtkit-daemon2229-21rtkit-daemon10:53:362
223099550,5rtkit-daemon2229-21rtkit-daemon10:40:212
14170995516,24cyclictest6444-21grep08:17:292
223099540,6rtkit-daemon0-21swapper/211:34:273
223099540,5rtkit-daemon2229-21rtkit-daemon10:41:512
223099540,4rtkit-daemon2229-21rtkit-daemon10:57:362
223099540,4rtkit-daemon2229-21rtkit-daemon10:24:142
157832543,43sleep20-21swapper/207:32:072
1417099544,11cyclictest0-21swapper/209:17:222
1417099543,43cyclictest21014-21grep07:42:132
223099530,5rtkit-daemon0-21swapper/211:01:433
1417199539,22cyclictest27138-21crond10:11:493
1417199534,26cyclictest0-21swapper/306:52:093
14171995337,10cyclictest18144-21tr09:52:023
14171995314,22cyclictest0-21swapper/311:17:013
1417099534,27cyclictest0-21swapper/208:52:082
1416699535,26cyclictest0-21swapper/010:02:010
1416699535,26cyclictest0-21swapper/010:02:010
1416699534,29cyclictest0-21swapper/011:42:090
14166995334,13cyclictest0-21swapper/007:22:160
1416699533,44cyclictest0-21swapper/011:37:180
1416699533,44cyclictest0-21swapper/007:07:180
257372522,9sleep30-21swapper/308:58:343
1417199527,40cyclictest0-21swapper/311:23:333
14171995236,10cyclictest10386-21gltestperf08:27:133
14171995220,13cyclictest0-21swapper/307:42:203
1417099527,30cyclictest29191-21df_abs06:52:132
1417099523,43cyclictest0-21swapper/209:42:132
1417099523,26cyclictest0-21swapper/206:59:342
1417099522,44cyclictest0-21swapper/209:47:102
14170995218,16cyclictest0-21swapper/207:20:492
14169995222,13cyclictest0-21swapper/110:32:111
1416699523,43cyclictest0-21swapper/010:37:180
41772513,9sleep10-21swapper/110:28:401
1417199514,28cyclictest0-21swapper/307:17:103
1417199514,27cyclictest0-21swapper/311:06:483
14171995132,12cyclictest7562-21grep07:12:303
14171995132,12cyclictest7562-21grep07:12:303
14171995130,13cyclictest23425-21tail10:02:083
14171995130,13cyclictest23425-21tail10:02:083
1417099515,28cyclictest0-21swapper/207:37:202
1417099514,41cyclictest0-21swapper/209:37:042
1417099514,40cyclictest0-21swapper/206:42:162
1417099514,38cyclictest0-21swapper/207:07:102
1417099514,26cyclictest0-21swapper/207:24:342
14170995118,12cyclictest0-21swapper/206:28:362
1416999515,27cyclictest0-21swapper/111:47:151
1416699519,26cyclictest0-21swapper/011:46:590
1416699515,28cyclictest0-21swapper/007:42:180
1416699514,42cyclictest0-21swapper/008:56:310
14166995135,9cyclictest1719-21tune2fs09:17:100
14166995133,11cyclictest31340-21cpuspeed_turbos09:12:070
31072502,9sleep30-21swapper/307:04:033
283182502,9sleep20-21swapper/209:06:072
152582502,9sleep30-21swapper/307:31:323
1417199506,39cyclictest0-21swapper/307:35:423
1417199504,28cyclictest0-21swapper/308:22:193
1417199504,27cyclictest0-21swapper/308:02:233
1417199504,26cyclictest0-21swapper/310:52:003
1417199504,26cyclictest0-21swapper/309:35:123
14171995032,12cyclictest2933-21fschecks_count10:27:073
14171995031,12cyclictest15779-21tr09:47:043
14171995030,12cyclictest20363-21needreboot06:32:233
14171995030,12cyclictest20363-21needreboot06:32:233
14171995021,12cyclictest0-21swapper/308:52:243
14171995020,13cyclictest0-21swapper/307:49:323
14171995019,17cyclictest0-21swapper/311:16:473
14171995019,12cyclictest0-21swapper/306:57:303
1417099505,38cyclictest1160-21snmpd10:16:502
1417099504,38cyclictest0-21swapper/209:15:302
1417099504,28cyclictest0-21swapper/207:57:222
1417099504,28cyclictest0-21swapper/207:57:222
1417099504,28cyclictest0-21swapper/206:37:102
1417099504,27cyclictest0-21swapper/209:27:022
1417099504,27cyclictest0-21swapper/208:37:252
1417099504,27cyclictest0-21swapper/208:32:212
1417099504,27cyclictest0-21swapper/206:22:262
1417099503,41cyclictest0-21swapper/209:52:002
1417099503,28cyclictest0-21swapper/209:57:012
1417099502,42cyclictest0-21swapper/209:07:082
14170995019,13cyclictest0-21swapper/207:27:252
14170995019,13cyclictest0-21swapper/206:32:312
14170995019,13cyclictest0-21swapper/206:32:312
1416999505,27cyclictest0-21swapper/111:37:041
1416999504,27cyclictest0-21swapper/111:31:461
1416999504,27cyclictest0-21swapper/111:31:461
14169995019,12cyclictest0-21swapper/110:46:541
14169995019,12cyclictest0-21swapper/110:46:541
1416699504,39cyclictest0-21swapper/011:07:050
1416699504,28cyclictest0-21swapper/011:17:000
1416699504,28cyclictest0-21swapper/008:57:150
1416699503,42cyclictest0-21swapper/011:32:060
1416699503,40cyclictest0-21swapper/009:22:110
1416699503,40cyclictest0-21swapper/009:22:110
139262502,9sleep30-21swapper/308:35:123
5572492,9sleep30-21swapper/309:14:543
37732492,9sleep00-21swapper/008:12:240
16742492,9sleep30-21swapper/310:23:423
1417199494,27cyclictest0-21swapper/311:37:193
1417199494,27cyclictest0-21swapper/307:57:213
1417199494,27cyclictest0-21swapper/307:57:213
1417199494,27cyclictest0-21swapper/307:07:203
1417199494,26cyclictest0-21swapper/306:47:123
1417099494,38cyclictest0-21swapper/210:17:162
1417099494,38cyclictest0-21swapper/208:27:102
1417099494,28cyclictest0-21swapper/209:32:212
1417099494,27cyclictest0-21swapper/208:07:182
1417099494,27cyclictest0-21swapper/207:06:562
1417099492,42cyclictest0-21swapper/210:02:102
1417099492,42cyclictest0-21swapper/210:02:102
1417099492,41cyclictest0-21swapper/208:02:072
14170994918,13cyclictest0-21swapper/207:52:062
1416999494,28cyclictest0-21swapper/111:11:461
14169994920,12cyclictest0-21swapper/110:21:501
1416699495,38cyclictest0-21swapper/011:27:030
1416699495,38cyclictest0-21swapper/011:27:030
1416699494,27cyclictest0-21swapper/009:37:210
14166994933,10cyclictest17568-21gltestperf08:42:110
1416699493,41cyclictest0-21swapper/010:47:130
1416699493,41cyclictest0-21swapper/010:47:130
1416699493,40cyclictest0-21swapper/010:57:110
1416699493,40cyclictest0-21swapper/006:22:230
14166994919,13cyclictest0-21swapper/007:12:220
14166994919,13cyclictest0-21swapper/007:12:220
78272483,9sleep10-21swapper/111:44:571
185482482,9sleep20-21swapper/208:43:092
1417199484,27cyclictest0-21swapper/309:17:053
1417199484,26cyclictest0-21swapper/310:46:543
1417199484,26cyclictest0-21swapper/310:46:543
1417199484,26cyclictest0-21swapper/310:12:223
1417199483,27cyclictest0-21swapper/309:06:513
1417199483,26cyclictest0-21swapper/309:11:423
14171994819,12cyclictest0-21swapper/310:01:443
1417099484,27cyclictest0-21swapper/207:47:062
1417099484,26cyclictest0-21swapper/207:12:272
1417099484,26cyclictest0-21swapper/207:12:272
1416999484,26cyclictest0-21swapper/111:22:051
1416699484,38cyclictest0-21swapper/008:32:190
1416699484,28cyclictest0-21swapper/009:57:180
1416699484,27cyclictest0-21swapper/010:22:220
1416699483,39cyclictest0-21swapper/010:51:590
1416699483,39cyclictest0-21swapper/010:07:070
64722472,39sleep00-21swapper/010:32:260
200282472,9sleep30-21swapper/307:41:313
162612472,38sleep30-21swapper/308:39:273
1417199476,34cyclictest361ktimersoftd/309:37:063
1417199474,35cyclictest0-21swapper/310:16:533
1417199474,12cyclictest0-21swapper/309:42:453
1417199473,26cyclictest0-21swapper/311:47:193
1417099473,27cyclictest0-21swapper/210:07:072
1416999474,27cyclictest0-21swapper/110:42:271
1416999474,25cyclictest0-21swapper/110:56:561
14169994719,13cyclictest0-21swapper/110:39:251
1416699479,33cyclictest0-21swapper/007:37:070
1416699474,37cyclictest0-21swapper/006:42:150
1416699474,27cyclictest0-21swapper/006:38:360
14166994733,9cyclictest28194-21grep10:12:090
104342472,9sleep00-21swapper/009:36:480
304202462,38sleep00-21swapper/011:23:080
257252463,37sleep10-21swapper/111:14:141
1417199464,25cyclictest0-21swapper/307:56:253
1417199464,24cyclictest0-21swapper/308:07:073
14169994616,12cyclictest0-21swapper/110:52:171
1416699464,36cyclictest0-21swapper/008:47:270
1416699464,27cyclictest0-21swapper/009:52:190
1416699463,38cyclictest0-21swapper/006:52:100
3532452,9sleep30-21swapper/311:28:233
3532452,9sleep30-21swapper/311:28:233
211732452,9sleep20-21swapper/208:51:192
164072452,9sleep30-21swapper/306:25:223
1417199454,33cyclictest0-21swapper/309:27:193
1417199454,24cyclictest0-21swapper/306:37:193
1417199453,35cyclictest1265-21runrttasks11:42:003
14171994520,7cyclictest19093-21cat06:31:583
14170994517,13cyclictest0-21swapper/208:22:102
14169994514,13cyclictest0-21swapper/111:32:061
1416699459,20cyclictest106250irq/46-eth009:47:070
1416699453,36cyclictest0-21swapper/011:01:570
133082454,34sleep30-21swapper/306:17:253
1417199448,31cyclictest0-21swapper/306:44:243
1417199447,23cyclictest0-21swapper/307:26:563
1417199446,32cyclictest0-21swapper/309:26:063
1417199446,32cyclictest0-21swapper/309:26:063
1417199444,32cyclictest0-21swapper/308:42:053
1417099444,24cyclictest0-21swapper/208:57:032
139802444,35sleep00-21swapper/006:19:590
210822432,35sleep30-21swapper/308:50:083
1417199434,12cyclictest0-21swapper/310:42:093
1417099343,24cyclictest14147-21latency_hist06:21:582
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional