You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-16 - 20:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Mon Jun 16, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
223099820,4rtkit-daemon2229-21rtkit-daemon10:41:192
1772399692,59cyclictest0-21swapper/212:11:172
223099680,6rtkit-daemon0-21swapper/010:11:050
223099680,6rtkit-daemon0-21swapper/010:11:050
223099680,5rtkit-daemon19526-21df_abs10:16:200
1772399654,54cyclictest0-21swapper/209:51:292
223099640,7rtkit-daemon0-21swapper/309:34:512
223099640,4rtkit-daemon2229-21rtkit-daemon08:56:002
17723996413,29cyclictest29261-21tune2fs10:36:182
1772499632,55cyclictest0-21swapper/308:56:393
1772399634,51cyclictest0-21swapper/206:56:402
1772399634,32cyclictest0-21swapper/209:36:122
223099620,6rtkit-daemon0-21swapper/309:16:152
223099620,6rtkit-daemon0-21swapper/309:12:522
1771699624,52cyclictest0-21swapper/009:26:000
17716996213,31cyclictest0-21swapper/010:36:160
223099610,7rtkit-daemon0-21swapper/311:24:472
223099610,7rtkit-daemon0-21swapper/309:26:292
223099610,7rtkit-daemon0-21swapper/309:26:292
223099610,7rtkit-daemon0-21swapper/308:17:172
223099610,6rtkit-daemon0-21swapper/307:49:252
223099610,6rtkit-daemon0-21swapper/111:05:330
1772399616,49cyclictest281ktimersoftd/210:21:292
1771699618,46cyclictest0-21swapper/009:46:340
223099600,7rtkit-daemon0-21swapper/312:07:532
223099600,7rtkit-daemon0-21swapper/311:47:312
223099600,7rtkit-daemon0-21swapper/311:15:402
223099600,7rtkit-daemon0-21swapper/310:58:562
223099600,7rtkit-daemon0-21swapper/310:58:562
223099600,7rtkit-daemon0-21swapper/308:15:022
223099600,7rtkit-daemon0-21swapper/308:06:322
223099600,7rtkit-daemon0-21swapper/307:45:032
223099600,7rtkit-daemon0-21swapper/307:37:412
223099600,6rtkit-daemon0-21swapper/311:01:552
223099600,3rtkit-daemon0-21swapper/307:35:262
1772499603,49cyclictest0-21swapper/309:11:273
1771699607,47cyclictest0-21swapper/008:26:390
17716996014,38cyclictest0-21swapper/006:56:240
17716996013,29cyclictest0-21swapper/008:36:190
223099590,7rtkit-daemon0-21swapper/312:16:452
223099590,7rtkit-daemon0-21swapper/312:05:082
223099590,7rtkit-daemon0-21swapper/310:50:332
223099590,7rtkit-daemon0-21swapper/310:01:502
223099590,7rtkit-daemon0-21swapper/310:00:052
223099590,7rtkit-daemon0-21swapper/309:02:232
223099590,7rtkit-daemon0-21swapper/308:58:082
223099590,7rtkit-daemon0-21swapper/307:30:042
223099590,7rtkit-daemon0-21swapper/307:10:272
223099590,6rtkit-daemon0-21swapper/311:54:312
223099590,6rtkit-daemon0-21swapper/311:31:392
223099590,6rtkit-daemon0-21swapper/311:28:022
223099590,6rtkit-daemon0-21swapper/309:10:152
223099590,6rtkit-daemon0-21swapper/308:36:542
223099590,6rtkit-daemon0-21swapper/110:26:190
223099590,5rtkit-daemon1584-21nscd11:06:250
1772399598,29cyclictest0-21swapper/208:25:402
1771699598,45cyclictest0-21swapper/009:41:190
1771699597,46cyclictest0-21swapper/007:44:240
223099580,7rtkit-daemon0-21swapper/308:29:012
223099580,7rtkit-daemon0-21swapper/307:24:112
223099580,7rtkit-daemon0-21swapper/307:24:112
223099580,7rtkit-daemon0-21swapper/307:12:272
223099580,7rtkit-daemon0-21swapper/307:01:572
223099580,6rtkit-daemon0-21swapper/311:57:082
223099580,6rtkit-daemon0-21swapper/311:43:312
223099580,6rtkit-daemon0-21swapper/311:39:242
223099580,6rtkit-daemon0-21swapper/311:39:242
223099580,6rtkit-daemon0-21swapper/310:06:432
223099580,6rtkit-daemon0-21swapper/309:49:062
223099580,6rtkit-daemon0-21swapper/309:44:512
223099580,6rtkit-daemon0-21swapper/308:47:162
223099580,6rtkit-daemon0-21swapper/308:42:232
223099580,6rtkit-daemon0-21swapper/308:32:462
223099580,6rtkit-daemon0-21swapper/308:05:472
223099580,6rtkit-daemon0-21swapper/308:05:472
223099580,6rtkit-daemon0-21swapper/307:58:182
223099580,6rtkit-daemon0-21swapper/307:53:482
223099580,6rtkit-daemon0-21swapper/306:55:202
223099580,5rtkit-daemon2229-21rtkit-daemon07:51:333
223099580,4rtkit-daemon2229-21rtkit-daemon10:45:193
1771699587,35cyclictest0-21swapper/011:17:070
1771699586,44cyclictest0-21swapper/009:06:190
1771699585,29cyclictest0-21swapper/011:30:000
223099570,6rtkit-daemon0-21swapper/311:18:322
223099570,6rtkit-daemon0-21swapper/310:51:562
223099570,6rtkit-daemon0-21swapper/307:17:122
223099570,5rtkit-daemon2229-21rtkit-daemon09:39:213
223099570,5rtkit-daemon2229-21rtkit-daemon09:04:533
223099570,4rtkit-daemon2229-21rtkit-daemon07:29:343
17724995723,13cyclictest0-21swapper/306:51:403
1771699576,35cyclictest0-21swapper/011:45:020
223099560,5rtkit-daemon2229-21rtkit-daemon12:07:233
223099560,5rtkit-daemon2229-21rtkit-daemon11:44:313
223099560,5rtkit-daemon2229-21rtkit-daemon10:01:583
223099560,5rtkit-daemon2229-21rtkit-daemon09:50:583
223099560,5rtkit-daemon2229-21rtkit-daemon08:25:173
1771699569,40cyclictest0-21swapper/010:01:150
1771699569,40cyclictest0-21swapper/007:21:220
1771699569,40cyclictest0-21swapper/007:21:220
1771699564,45cyclictest0-21swapper/012:16:280
1771699563,47cyclictest0-21swapper/010:49:540
1771699563,47cyclictest0-21swapper/009:26:320
1771699563,47cyclictest0-21swapper/009:26:320
223099550,6rtkit-daemon2229-21rtkit-daemon07:11:273
223099550,6rtkit-daemon2229-21rtkit-daemon06:46:201
223099550,6rtkit-daemon0-21swapper/309:21:072
223099550,5rtkit-daemon2229-21rtkit-daemon11:26:393
223099550,5rtkit-daemon2229-21rtkit-daemon11:16:103
223099550,5rtkit-daemon2229-21rtkit-daemon11:15:473
223099550,5rtkit-daemon2229-21rtkit-daemon10:49:483
223099550,5rtkit-daemon2229-21rtkit-daemon10:09:053
223099550,5rtkit-daemon2229-21rtkit-daemon09:54:063
223099550,5rtkit-daemon2229-21rtkit-daemon08:39:093
223099550,4rtkit-daemon2229-21rtkit-daemon11:48:543
223099550,4rtkit-daemon2229-21rtkit-daemon08:02:473
223099550,4rtkit-daemon2229-21rtkit-daemon08:02:473
223099550,4rtkit-daemon2229-21rtkit-daemon07:16:573
17724995537,11cyclictest12739-21gltestperf07:46:253
1772199555,44cyclictest0-21swapper/111:11:101
1772199552,48cyclictest0-21swapper/109:19:381
1771699559,39cyclictest18484-21fschecks_time11:21:180
1771699554,43cyclictest0-21swapper/007:51:180
1771699554,27cyclictest0-21swapper/012:10:200
17716995529,21cyclictest29238-21grep07:11:390
223099540,6rtkit-daemon2229-21rtkit-daemon07:06:053
223099540,5rtkit-daemon2229-21rtkit-daemon12:17:153
223099540,5rtkit-daemon2229-21rtkit-daemon12:01:163
223099540,5rtkit-daemon2229-21rtkit-daemon11:34:023
223099540,5rtkit-daemon2229-21rtkit-daemon11:25:553
223099540,5rtkit-daemon2229-21rtkit-daemon11:02:183
223099540,5rtkit-daemon2229-21rtkit-daemon10:59:483
223099540,5rtkit-daemon2229-21rtkit-daemon10:59:483
223099540,5rtkit-daemon2229-21rtkit-daemon10:53:183
223099540,5rtkit-daemon2229-21rtkit-daemon09:28:523
223099540,5rtkit-daemon2229-21rtkit-daemon09:28:523
223099540,5rtkit-daemon2229-21rtkit-daemon09:24:593
223099540,5rtkit-daemon2229-21rtkit-daemon09:06:373
223099540,5rtkit-daemon2229-21rtkit-daemon08:41:083
223099540,5rtkit-daemon2229-21rtkit-daemon08:31:243
223099540,5rtkit-daemon2229-21rtkit-daemon08:18:473
223099540,5rtkit-daemon2229-21rtkit-daemon08:13:473
223099540,5rtkit-daemon2229-21rtkit-daemon08:08:103
223099540,5rtkit-daemon2229-21rtkit-daemon07:57:183
223099540,5rtkit-daemon2229-21rtkit-daemon07:43:033
223099540,5rtkit-daemon2229-21rtkit-daemon07:36:333
223099540,5rtkit-daemon2229-21rtkit-daemon06:58:423
223099540,4rtkit-daemon2229-21rtkit-daemon11:59:233
223099540,4rtkit-daemon2229-21rtkit-daemon11:52:013
223099540,4rtkit-daemon2229-21rtkit-daemon09:45:363
223099540,4rtkit-daemon2229-21rtkit-daemon08:27:313
1772499544,42cyclictest0-21swapper/309:56:313
1772399545,42cyclictest0-21swapper/210:31:322
17721995422,13cyclictest0-21swapper/111:16:131
1771699548,38cyclictest0-21swapper/008:13:560
1771699545,42cyclictest0-21swapper/008:16:510
1771699545,30cyclictest0-21swapper/008:44:560
1771699544,44cyclictest15-21rcuc/011:46:090
1771699544,44cyclictest0-21swapper/010:31:330
1771699543,45cyclictest0-21swapper/010:21:120
1771699543,45cyclictest0-21swapper/009:56:130
1771699543,43cyclictest0-21swapper/007:56:180
1771699543,34cyclictest0-21swapper/007:31:380
223099530,6rtkit-daemon2229-21rtkit-daemon07:31:113
223099530,5rtkit-daemon2229-21rtkit-daemon09:19:223
223099530,5rtkit-daemon2229-21rtkit-daemon08:51:383
223099530,5rtkit-daemon2229-21rtkit-daemon08:47:233
223099530,5rtkit-daemon2229-21rtkit-daemon07:06:573
223099530,4rtkit-daemon2229-21rtkit-daemon12:15:383
223099530,4rtkit-daemon2229-21rtkit-daemon11:37:543
223099530,4rtkit-daemon2229-21rtkit-daemon11:37:543
223099530,4rtkit-daemon2229-21rtkit-daemon09:35:063
223099530,4rtkit-daemon2229-21rtkit-daemon07:21:343
223099530,4rtkit-daemon2229-21rtkit-daemon07:21:343
1772199534,41cyclictest28977-21cpuspeed_turbos08:21:191
1772199533,44cyclictest0-21swapper/111:56:111
1771699538,31cyclictest19350-21cpuspeed08:01:190
1771699538,31cyclictest19350-21cpuspeed08:01:190
1771699537,39cyclictest0-21swapper/009:01:370
1771699537,38cyclictest0-21swapper/012:00:540
1771699532,45cyclictest0-21swapper/008:21:340
1771699532,44cyclictest0-21swapper/008:51:180
17716995311,28cyclictest0-21swapper/006:51:400
317272522,9sleep10-21swapper/109:33:141
1772199525,29cyclictest0-21swapper/111:36:231
1772199525,29cyclictest0-21swapper/111:36:231
1772199524,42cyclictest0-21swapper/109:21:311
1772199524,40cyclictest0-21swapper/111:51:181
1772199524,40cyclictest0-21swapper/109:11:231
1772199524,30cyclictest0-21swapper/111:01:201
1772199524,27cyclictest0-21swapper/111:27:301
1771699527,27cyclictest0-21swapper/007:01:300
1771699525,38cyclictest0-21swapper/007:36:160
1771699524,39cyclictest0-21swapper/009:16:360
1771699524,39cyclictest0-21swapper/007:16:260
1771699522,31cyclictest0-21swapper/009:11:270
17716995210,36cyclictest9505-21aten2.4-expect12:11:090
1772399514,27cyclictest0-21swapper/206:51:072
1772199514,40cyclictest0-21swapper/108:01:411
1772199514,40cyclictest0-21swapper/108:01:411
1772199514,29cyclictest0-21swapper/110:56:341
1772199514,29cyclictest0-21swapper/110:56:341
1772199514,29cyclictest0-21swapper/108:56:371
1772199514,29cyclictest0-21swapper/107:11:381
1772199513,42cyclictest0-21swapper/107:21:161
1772199513,42cyclictest0-21swapper/107:21:161
1771699515,26cyclictest0-21swapper/007:26:260
1771699514,38cyclictest0-21swapper/011:31:220
1771699514,28cyclictest0-21swapper/011:11:270
1771699514,28cyclictest0-21swapper/010:41:100
1771699513,42cyclictest0-21swapper/010:51:250
1771699513,42cyclictest0-21swapper/009:36:160
1771699513,42cyclictest0-21swapper/008:48:250
1771699513,42cyclictest0-21swapper/007:06:170
317622502,9sleep10-21swapper/107:17:511
280852502,9sleep30-21swapper/310:32:583
257472502,40sleep10-21swapper/110:28:361
1772399504,39cyclictest0-21swapper/211:06:152
1772399504,38cyclictest0-21swapper/210:11:212
1772399504,38cyclictest0-21swapper/210:11:212
1772399502,42cyclictest0-21swapper/210:16:162
1772199505,38cyclictest0-21swapper/107:01:311
1772199505,28cyclictest0-21swapper/109:56:331
1772199504,39cyclictest0-21swapper/108:31:361
17721995037,7cyclictest31886-21munin-run11:50:541
17721995034,10cyclictest31892-21gltestperf08:26:261
17721995034,10cyclictest10591-21needreboot12:11:221
1771699508,12cyclictest0-21swapper/009:31:220
1771699504,38cyclictest0-21swapper/011:51:180
1771699504,38cyclictest0-21swapper/009:51:370
1771699504,38cyclictest0-21swapper/008:06:320
43682492,9sleep10-21swapper/109:44:591
30892492,9sleep10-21swapper/110:49:241
197892492,9sleep10-21swapper/106:52:151
1772499493,27cyclictest0-21swapper/310:26:203
1772199499,9cyclictest17710-21cyclictest10:45:561
1772199496,26cyclictest0-21swapper/108:41:301
1772199495,27cyclictest0-21swapper/110:51:351
1772199495,27cyclictest0-21swapper/107:11:061
1772199494,38cyclictest0-21swapper/110:16:171
1772199494,38cyclictest0-21swapper/109:01:361
1772199494,28cyclictest0-21swapper/109:46:121
1772199494,27cyclictest0-21swapper/109:39:411
1772199494,27cyclictest0-21swapper/108:46:381
1772199494,27cyclictest0-21swapper/106:56:251
1772199494,26cyclictest0-21swapper/110:40:571
1772199493,42cyclictest0-21swapper/107:54:281
1772199493,41cyclictest0-21swapper/110:21:111
1772199493,41cyclictest0-21swapper/107:26:181
1772199493,40cyclictest0-21swapper/110:06:131
1772199493,40cyclictest0-21swapper/108:16:271
1772199493,28cyclictest0-21swapper/111:35:551
1771699498,35cyclictest1881-21gltestperf08:31:260
1771699495,38cyclictest0-21swapper/011:36:100
1771699495,38cyclictest0-21swapper/011:36:100
1771699494,38cyclictest0-21swapper/007:51:040
1771699494,37cyclictest0-21swapper/010:56:280
1771699494,37cyclictest0-21swapper/010:56:280
1771699493,38cyclictest0-21swapper/010:06:360
65912482,40sleep10-21swapper/107:32:141
1772499484,38cyclictest0-21swapper/311:06:353
1772499484,37cyclictest0-21swapper/310:21:313
17724994833,9cyclictest29978-21fgrep10:36:303
1772499483,26cyclictest0-21swapper/310:14:023
1772499483,26cyclictest0-21swapper/310:14:023
1772399484,28cyclictest0-21swapper/210:26:332
1772199484,38cyclictest0-21swapper/109:11:011
1772199484,36cyclictest0-21swapper/110:11:181
1772199484,36cyclictest0-21swapper/110:11:181
17721994831,10cyclictest23885-21aten_r1power_cu08:11:151
1772199483,40cyclictest0-21swapper/110:01:261
1772199483,40cyclictest0-21swapper/107:46:391
1772199483,38cyclictest0-21swapper/112:16:181
1772199483,28cyclictest0-21swapper/111:25:561
17721994820,12cyclictest0-21swapper/108:36:161
17721994810,32cyclictest0-21swapper/107:56:151
1771699487,34cyclictest4952-21cpuspeed_turbos12:01:080
1771699485,34cyclictest17717-21awk06:51:060
1772499474,27cyclictest0-21swapper/310:16:353
1772199474,36cyclictest0-21swapper/110:31:251
17721994730,10cyclictest21496-21aten_r1power_cu08:06:151
1772199473,39cyclictest0-21swapper/112:01:221
1772199473,38cyclictest0-21swapper/111:06:191
1771699474,26cyclictest0-21swapper/008:59:350
1772199464,23cyclictest0-21swapper/107:36:161
1772199463,38cyclictest0-21swapper/108:51:211
1772199463,38cyclictest0-21swapper/107:41:341
17721994629,10cyclictest7385-21cpuspeed_turbos09:51:151
1772199454,35cyclictest0-21swapper/111:41:221
1772199454,34cyclictest0-21swapper/109:26:301
1772199454,34cyclictest0-21swapper/109:26:301
1772199453,36cyclictest0-21swapper/112:06:401
17724993411,8cyclictest17699-21latency_hist06:51:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional