You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 12:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Nov 17, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2437991140,23rtkit-daemon0-21swapper/019:59:541
2437991130,22rtkit-daemon0-21swapper/019:56:471
2437991120,22rtkit-daemon0-21swapper/022:56:021
2437991100,23rtkit-daemon0-21swapper/022:15:561
2437991100,23rtkit-daemon0-21swapper/019:15:491
2437991100,22rtkit-daemon0-21swapper/020:26:011
243799990,21rtkit-daemon0-21swapper/022:14:120
243799980,21rtkit-daemon0-21swapper/022:29:110
243799980,21rtkit-daemon0-21swapper/019:39:180
243799970,21rtkit-daemon0-21swapper/022:34:180
243799970,20rtkit-daemon0-21swapper/022:09:120
243799970,19rtkit-daemon0-21swapper/022:59:100
243799970,19rtkit-daemon0-21swapper/021:49:200
243799970,19rtkit-daemon0-21swapper/019:14:340
243799960,20rtkit-daemon0-21swapper/019:59:240
243799950,21rtkit-daemon0-21swapper/021:57:570
243799950,21rtkit-daemon0-21swapper/021:57:570
243799950,21rtkit-daemon0-21swapper/019:19:260
243799950,20rtkit-daemon0-21swapper/022:04:120
243799940,19rtkit-daemon0-21swapper/020:19:310
2515099923,80cyclictest0-21swapper/200:08:472
243799920,18rtkit-daemon0-21swapper/021:34:130
243799900,19rtkit-daemon0-21swapper/021:19:210
243799900,19rtkit-daemon0-21swapper/019:56:170
25150998918,12cyclictest0-21swapper/200:19:102
243799890,20rtkit-daemon0-21swapper/021:14:290
2515099884,77cyclictest0-21swapper/222:44:142
243799880,18rtkit-daemon0-21swapper/019:29:250
2515099874,28cyclictest0-21swapper/221:34:152
2515099873,27cyclictest0-21swapper/220:24:282
2515099844,27cyclictest0-21swapper/221:29:192
2515099843,32cyclictest0-21swapper/222:08:532
25150998428,13cyclictest0-21swapper/219:39:132
243799840,8rtkit-daemon0-21swapper/020:39:230
243799830,9rtkit-daemon0-21swapper/020:44:080
243799830,8rtkit-daemon0-21swapper/022:54:170
243799830,7rtkit-daemon0-21swapper/023:14:020
243799830,7rtkit-daemon0-21swapper/022:24:560
2515099823,28cyclictest0-21swapper/220:14:132
2515099814,33cyclictest0-21swapper/223:54:132
2515099814,33cyclictest0-21swapper/223:44:222
2515099804,34cyclictest0-21swapper/219:34:142
25150998027,13cyclictest0-21swapper/200:09:242
2515099794,34cyclictest0-21swapper/223:09:212
25150997930,14cyclictest0-21swapper/219:09:242
2515099793,35cyclictest0-21swapper/222:09:242
2515099754,25cyclictest0-21swapper/223:15:372
243799740,9rtkit-daemon0-21swapper/022:09:191
243799740,9rtkit-daemon0-21swapper/020:44:151
2515099724,25cyclictest0-21swapper/221:45:232
25144997220,45cyclictest0-21swapper/023:31:420
243799710,8rtkit-daemon1919-21fschecks_time22:44:101
243799710,11rtkit-daemon0-21swapper/021:58:051
243799710,11rtkit-daemon0-21swapper/021:58:051
25144997024,30cyclictest5860-21idleruntime-cro22:53:500
25144996814,46cyclictest32216-21turbostat21:33:520
25144996812,37cyclictest0-21swapper/019:50:040
25144996719,30cyclictest0-21swapper/021:48:520
25144996717,31cyclictest0-21swapper/019:04:150
243799670,27rtkit-daemon0-21swapper/021:59:120
243799670,27rtkit-daemon0-21swapper/021:24:280
243799670,27rtkit-daemon0-21swapper/020:58:000
25144996622,38cyclictest31389-21rt-features23:44:180
25144996615,44cyclictest0-21swapper/020:13:560
243799660,5rtkit-daemon2436-21rtkit-daemon19:05:563
25144996540,16cyclictest25147-21basename19:03:590
25144996540,16cyclictest25147-21basename19:03:590
25144996519,30cyclictest0-21swapper/023:59:210
25144996519,30cyclictest0-21swapper/023:59:210
25144996517,30cyclictest0-21swapper/000:30:190
243799650,3rtkit-daemon0-21swapper/323:50:083
243799650,3rtkit-daemon0-21swapper/300:27:293
243799650,26rtkit-daemon0-21swapper/021:04:220
243799650,23rtkit-daemon0-21swapper/019:24:330
243799650,22rtkit-daemon0-21swapper/019:37:480
25144996419,29cyclictest0-21swapper/000:10:090
247912646,51sleep20-21swapper/218:59:502
247912646,51sleep20-21swapper/218:59:502
243799640,6rtkit-daemon0-21swapper/020:29:460
243799640,6rtkit-daemon0-21swapper/020:29:460
243799640,23rtkit-daemon0-21swapper/022:46:180
243799640,23rtkit-daemon0-21swapper/021:13:440
243799640,23rtkit-daemon0-21swapper/021:13:440
243799640,23rtkit-daemon0-21swapper/020:34:080
25144996319,37cyclictest12049-21munin-node00:14:240
25144996317,39cyclictest0-21swapper/021:42:410
25144996311,44cyclictest0-21swapper/023:34:110
25144996311,36cyclictest0-21swapper/019:09:190
243799630,24rtkit-daemon0-21swapper/022:39:180
243799630,24rtkit-daemon0-21swapper/022:39:180
243799630,24rtkit-daemon0-21swapper/020:24:010
243799630,23rtkit-daemon0-21swapper/023:09:320
243799630,23rtkit-daemon0-21swapper/023:04:320
243799630,23rtkit-daemon0-21swapper/021:00:590
243799630,23rtkit-daemon0-21swapper/020:16:240
243799630,23rtkit-daemon0-21swapper/020:04:470
243799630,22rtkit-daemon0-21swapper/023:20:310
243799630,22rtkit-daemon0-21swapper/023:20:310
243799630,22rtkit-daemon0-21swapper/022:22:410
243799630,22rtkit-daemon0-21swapper/019:46:100
243799630,22rtkit-daemon0-21swapper/019:46:100
25144996218,12cyclictest28518-21wc23:39:130
25144996216,29cyclictest0-21swapper/023:54:040
243799620,8rtkit-daemon0-21swapper/319:09:113
243799620,7rtkit-daemon0-21swapper/323:45:533
243799620,7rtkit-daemon0-21swapper/300:31:593
243799620,7rtkit-daemon0-21swapper/300:01:003
243799620,7rtkit-daemon0-21swapper/300:01:003
243799620,7rtkit-daemon0-21swapper/022:34:411
243799620,7rtkit-daemon0-21swapper/020:19:391
243799620,6rtkit-daemon0-21swapper/300:09:073
243799620,5rtkit-daemon0-21swapper/300:16:143
243799620,22rtkit-daemon0-21swapper/023:24:390
243799620,22rtkit-daemon0-21swapper/020:49:000
2515099613,51cyclictest0-21swapper/221:04:252
25148996127,14cyclictest0-21swapper/120:54:091
25148996116,38cyclictest12304-21sendmail_mailqu23:04:221
243799610,9rtkit-daemon0-21swapper/323:40:233
243799610,9rtkit-daemon0-21swapper/300:19:223
243799610,8rtkit-daemon0-21swapper/323:35:383
243799610,7rtkit-daemon0-21swapper/300:04:003
243799610,7rtkit-daemon0-21swapper/023:14:171
243799610,7rtkit-daemon0-21swapper/022:04:341
243799610,6rtkit-daemon0-21swapper/022:25:041
243799610,4rtkit-daemon0-21swapper/323:57:453
25144996017,28cyclictest0-21swapper/023:52:220
243799600,7rtkit-daemon0-21swapper/023:27:011
243799600,7rtkit-daemon0-21swapper/021:34:211
243799600,7rtkit-daemon0-21swapper/019:39:401
243799590,8rtkit-daemon0-21swapper/020:50:521
243799590,6rtkit-daemon0-21swapper/022:53:181
243799590,6rtkit-daemon0-21swapper/021:19:291
25151995840,11cyclictest13914-21cut23:09:103
25144995818,34cyclictest17283-21df_abs00:24:060
25144995814,37cyclictest0-21swapper/000:05:220
243799580,7rtkit-daemon0-21swapper/019:19:331
35092572,48sleep10-21swapper/123:54:131
2515099564,10cyclictest8861-21tr22:59:082
25150995636,13cyclictest0-21swapper/219:04:282
2514899564,28cyclictest0-21swapper/119:37:441
25148995622,14cyclictest0-21swapper/100:29:091
243799560,6rtkit-daemon0-21swapper/022:29:181
179072552,10sleep10-21swapper/121:03:551
176352553,9sleep317734-21fschecks_time19:54:193
310882540,4sleep331104-21kernelversion21:29:213
2515099544,42cyclictest0-21swapper/219:48:572
2515099544,42cyclictest0-21swapper/219:48:572
25150995437,11cyclictest0-21swapper/223:04:052
25150995433,12cyclictest0-21swapper/220:54:282
25150995421,26cyclictest0-21swapper/219:49:322
2514899545,30cyclictest0-21swapper/122:19:241
25144995436,11cyclictest14783-21cpuspeed_turbos00:19:010
2515199535,29cyclictest0-21swapper/320:24:263
2515199535,28cyclictest0-21swapper/321:14:243
2515199535,28cyclictest0-21swapper/319:14:183
2515199533,33cyclictest0-21swapper/319:44:263
2515199533,33cyclictest0-21swapper/319:44:263
25150995335,11cyclictest25206-21munin-node23:34:092
25150995323,12cyclictest0-21swapper/223:23:492
25150995323,12cyclictest0-21swapper/223:23:492
2514899534,29cyclictest0-21swapper/120:14:171
25148995322,13cyclictest0-21swapper/119:44:221
25148995322,13cyclictest0-21swapper/119:44:221
25148995319,14cyclictest0-21swapper/121:59:301
140422532,9sleep10-21swapper/100:16:551
52092523,8sleep15228-21python20:34:281
2515199525,28cyclictest0-21swapper/321:04:263
2515199524,29cyclictest0-21swapper/323:14:213
2515199524,28cyclictest0-21swapper/323:19:183
2515199524,28cyclictest0-21swapper/323:19:183
25151995234,11cyclictest24484-21cut20:09:123
2515199522,36cyclictest0-21swapper/320:38:563
25150995230,14cyclictest0-21swapper/222:23:512
25150995213,32cyclictest0-21swapper/220:59:122
2514899525,29cyclictest0-21swapper/121:49:251
2514899525,28cyclictest0-21swapper/122:59:181
2514899525,28cyclictest0-21swapper/122:39:101
2514899525,28cyclictest0-21swapper/122:39:101
2514899524,30cyclictest0-21swapper/119:09:311
2514899524,29cyclictest0-21swapper/123:59:201
2514899524,29cyclictest0-21swapper/123:59:201
2514899524,29cyclictest0-21swapper/123:09:261
2514899524,29cyclictest0-21swapper/121:29:161
2514899524,25cyclictest0-21swapper/120:04:101
25148995222,13cyclictest0-21swapper/123:39:231
25148995220,14cyclictest0-21swapper/120:39:311
25148995220,14cyclictest0-21swapper/120:10:501
24122523,42sleep30-21swapper/320:29:223
24122523,42sleep30-21swapper/320:29:223
44352512,9sleep10-21swapper/121:40:271
2515199516,28cyclictest0-21swapper/319:38:573
2515199514,28cyclictest0-21swapper/322:39:143
2515199514,28cyclictest0-21swapper/322:39:143
2515199514,28cyclictest0-21swapper/322:19:163
2515199514,28cyclictest0-21swapper/320:14:203
2515199514,28cyclictest0-21swapper/320:04:283
2515199514,24cyclictest8645-21aten2.4-expect20:44:083
2514899515,28cyclictest0-21swapper/121:24:281
2514899515,28cyclictest0-21swapper/100:04:151
2514899514,28cyclictest0-21swapper/123:34:071
2514899514,28cyclictest0-21swapper/119:29:341
297012502,41sleep20-21swapper/223:43:222
27962502,40sleep10-21swapper/119:24:141
2515199504,28cyclictest0-21swapper/322:59:173
2515199504,28cyclictest0-21swapper/321:44:053
2515199504,28cyclictest0-21swapper/321:09:253
2515199504,28cyclictest0-21swapper/321:09:253
2515199504,27cyclictest0-21swapper/322:33:513
2515199504,27cyclictest0-21swapper/321:24:073
25151995032,10cyclictest6801-21tune2fs22:54:093
25151995030,11cyclictest11204-21cpuspeed_turbos23:04:063
25151995029,12cyclictest12640-21sed20:49:283
25150995035,11cyclictest0-21swapper/200:24:162
25150995029,14cyclictest0-21swapper/222:29:202
25150995029,14cyclictest0-21swapper/222:24:282
25150995019,13cyclictest0-21swapper/220:34:282
2514899505,26cyclictest0-21swapper/121:10:171
2514899505,26cyclictest0-21swapper/121:10:171
2514899505,26cyclictest0-21swapper/100:20:111
2514899504,28cyclictest0-21swapper/123:19:261
2514899504,28cyclictest0-21swapper/123:19:261
2514899504,28cyclictest0-21swapper/120:29:281
2514899504,28cyclictest0-21swapper/120:29:281
2514899504,28cyclictest0-21swapper/100:09:131
2514899503,28cyclictest0-21swapper/121:04:271
25148995019,14cyclictest0-21swapper/119:49:251
68512493,9sleep30-21swapper/319:29:563
2515199494,36cyclictest0-21swapper/319:19:183
2515199494,35cyclictest0-21swapper/322:09:143
2515199494,25cyclictest0-21swapper/321:49:243
25151994931,11cyclictest10076-21cpuspeed_turbos21:54:093
25151994931,11cyclictest10076-21cpuspeed_turbos21:54:093
25151994930,12cyclictest12724-21cut21:59:133
25151994919,13cyclictest0-21swapper/322:14:103
2515099494,38cyclictest0-21swapper/220:10:502
2515099494,27cyclictest0-21swapper/222:39:062
2515099494,27cyclictest0-21swapper/222:39:062
2515099494,27cyclictest0-21swapper/200:14:082
25150994930,12cyclictest0-21swapper/219:59:302
2515099493,28cyclictest0-21swapper/223:59:202
2515099493,28cyclictest0-21swapper/223:59:202
2515099493,28cyclictest0-21swapper/220:04:332
2514899494,27cyclictest0-21swapper/121:44:051
2514899494,27cyclictest0-21swapper/121:15:181
2514899494,27cyclictest0-21swapper/100:25:121
243799490,5rtkit-daemon2436-21rtkit-daemon19:14:112
2515199484,35cyclictest0-21swapper/323:29:123
2515199484,26cyclictest0-21swapper/322:05:263
2515199484,25cyclictest1762-21df_abs22:44:083
2515199484,25cyclictest0-21swapper/319:59:123
25151994810,29cyclictest0-21swapper/321:03:543
2515099485,25cyclictest0-21swapper/222:00:252
2515099484,36cyclictest0-21swapper/221:14:232
2515099484,27cyclictest0-21swapper/220:44:192
2515099484,27cyclictest0-21swapper/220:39:202
25150994834,10cyclictest0-21swapper/219:29:312
25150994830,12cyclictest0-21swapper/223:24:122
2515099483,28cyclictest0-21swapper/222:49:262
2515099483,28cyclictest0-21swapper/222:34:082
2515099483,28cyclictest0-21swapper/221:24:242
2515099483,28cyclictest0-21swapper/221:19:072
2515099483,27cyclictest0-21swapper/223:29:152
25148994820,10cyclictest31697-21unixbench_multi23:44:221
2515199474,36cyclictest0-21swapper/322:38:503
2515199474,27cyclictest0-21swapper/323:24:373
2515199474,25cyclictest0-21swapper/321:35:213
2515199474,23cyclictest2788-21aten2.4-expect19:24:133
25150994731,11cyclictest0-21swapper/223:50:262
25150994731,11cyclictest0-21swapper/221:39:172
25150994730,12cyclictest0-21swapper/219:19:112
2514899474,26cyclictest0-21swapper/123:30:401
25148994731,10cyclictest26247-21gltestperf19:04:221
2515199464,34cyclictest0-21swapper/321:39:283
2515199464,25cyclictest0-21swapper/319:39:113
2515099464,36cyclictest0-21swapper/221:58:532
2515099464,36cyclictest0-21swapper/221:58:532
2515099464,34cyclictest0-21swapper/220:29:112
2515099464,34cyclictest0-21swapper/220:29:112
25150994630,10cyclictest20819-21cut21:09:112
25150994630,10cyclictest20819-21cut21:09:112
2515099463,37cyclictest0-21swapper/200:33:452
247952464,6sleep10-21swapper/118:59:531
247952464,6sleep10-21swapper/118:59:531
62202456,32sleep20-21swapper/222:54:042
2515199455,21cyclictest0-21swapper/320:39:073
2515199454,34cyclictest0-21swapper/322:24:123
2515199454,21cyclictest0-21swapper/321:19:083
2515099453,26cyclictest0-21swapper/222:14:142
2515099453,26cyclictest0-21swapper/221:50:242
25150994510,20cyclictest0-21swapper/219:24:282
2514899453,23cyclictest0-21swapper/123:49:011
154392452,37sleep30-21swapper/320:58:173
56792442,9sleep30-21swapper/322:51:403
2515199444,33cyclictest0-21swapper/319:49:253
2515199444,24cyclictest0-21swapper/320:19:103
2515099444,33cyclictest0-21swapper/220:19:112
2515099443,34cyclictest0-21swapper/220:49:162
25150994316,12cyclictest0-21swapper/219:54:272
247852434,6sleep30-21swapper/318:59:473
247852434,6sleep30-21swapper/318:59:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional