You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-22 - 18:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Tue Apr 22, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2751399904,12cyclictest0-21swapper/208:51:262
2751399894,61cyclictest0-21swapper/205:41:292
2751399894,12cyclictest0-21swapper/205:51:272
27513998918,54cyclictest0-21swapper/209:36:232
2751399884,12cyclictest0-21swapper/209:16:322
27513998814,51cyclictest0-21swapper/210:06:082
2751399864,66cyclictest0-21swapper/208:06:222
2751399863,64cyclictest23776-21munin-run08:36:022
2751399854,13cyclictest0-21swapper/206:56:202
2751399844,64cyclictest0-21swapper/209:26:092
2751399844,12cyclictest0-21swapper/208:56:192
2751399844,12cyclictest0-21swapper/208:26:242
2751399843,11cyclictest0-21swapper/206:21:372
2751399843,11cyclictest0-21swapper/206:21:372
2751399834,12cyclictest0-21swapper/206:16:292
2751399833,10cyclictest3798-21kworker/2:007:06:052
2751399833,10cyclictest3798-21kworker/2:007:06:052
2751399833,10cyclictest0-21swapper/205:16:232
27513998316,44cyclictest0-21swapper/206:26:412
27513998314,45cyclictest0-21swapper/206:31:392
2751399824,13cyclictest0-21swapper/205:46:352
2751399824,12cyclictest0-21swapper/209:11:272
2751399824,12cyclictest0-21swapper/209:11:272
2751399824,12cyclictest0-21swapper/206:01:252
2751399823,58cyclictest0-21swapper/207:11:422
27513998215,50cyclictest0-21swapper/206:06:272
2751399815,13cyclictest1263-21runrttasks09:21:272
2751399814,55cyclictest0-21swapper/205:11:472
2751399814,54cyclictest0-21swapper/208:46:102
2751399814,12cyclictest0-21swapper/210:31:192
2751399814,12cyclictest0-21swapper/210:31:192
2751399814,11cyclictest0-21swapper/207:31:252
2751399813,9cyclictest28541-21tr07:26:152
2751399813,12cyclictest0-21swapper/210:11:192
27513998120,44cyclictest0-21swapper/206:51:402
2751399804,60cyclictest0-21swapper/205:56:392
2751399804,58cyclictest0-21swapper/209:31:112
2751399803,56cyclictest0-21swapper/206:36:172
2751399794,59cyclictest0-21swapper/207:16:282
2751399794,54cyclictest0-21swapper/208:11:332
2751399794,12cyclictest0-21swapper/208:21:302
2751399794,12cyclictest0-21swapper/206:11:392
2751399794,12cyclictest0-21swapper/205:06:112
2751399794,12cyclictest0-21swapper/205:06:112
2751399793,69cyclictest0-21swapper/207:23:072
2751399793,57cyclictest0-21swapper/209:06:012
2751399793,11cyclictest0-21swapper/206:46:252
27513997915,48cyclictest0-21swapper/209:06:092
27513997914,53cyclictest0-21swapper/208:36:152
2751399784,14cyclictest0-21swapper/209:56:332
2751399784,13cyclictest0-21swapper/210:16:222
2751399784,11cyclictest0-21swapper/206:46:012
27513997817,44cyclictest0-21swapper/205:26:312
27513997816,48cyclictest0-21swapper/207:56:142
2751399774,58cyclictest0-21swapper/210:26:192
2751399774,14cyclictest0-21swapper/209:43:252
2751399774,13cyclictest0-21swapper/205:21:242
2751399774,12cyclictest0-21swapper/208:05:292
2751399768,8cyclictest18038-21aten_r1power_cu09:46:062
2751399764,52cyclictest0-21swapper/205:06:392
2751399754,54cyclictest0-21swapper/205:36:222
2751399754,53cyclictest0-21swapper/208:16:142
2751399754,13cyclictest0-21swapper/207:36:322
2751399753,12cyclictest0-21swapper/208:43:582
27513997519,39cyclictest0-21swapper/205:31:302
27513997513,7cyclictest5862-21awk07:51:042
27513997513,7cyclictest5862-21awk07:51:042
2751399744,13cyclictest0-21swapper/207:51:152
27513997330,35cyclictest21659-21needreboot07:06:342
27513997220,45cyclictest20553-21aten_r1power_vo09:51:112
27513997220,45cyclictest20553-21aten_r1power_vo09:51:112
2751399707,44cyclictest0-21swapper/210:05:592
2751399696,54cyclictest0-21swapper/210:21:372
2751399694,47cyclictest0-21swapper/207:42:252
2751199654,56cyclictest0-21swapper/107:33:381
2751499633,51cyclictest0-21swapper/307:51:343
27514996240,12cyclictest20717-21sendmail_mailst05:56:373
2751199603,51cyclictest0-21swapper/107:46:261
2751199603,51cyclictest0-21swapper/107:46:261
2751199584,47cyclictest0-21swapper/108:36:151
2751199583,48cyclictest0-21swapper/109:36:001
2751199583,46cyclictest0-21swapper/109:06:081
227799580,4rtkit-daemon2276-21rtkit-daemon07:47:310
227799580,4rtkit-daemon2276-21rtkit-daemon07:47:310
73392572,48sleep00-21swapper/007:51:310
27506995737,13cyclictest0-21swapper/010:25:570
227799570,6rtkit-daemon2276-21rtkit-daemon08:11:300
2751499566,31cyclictest0-21swapper/306:46:393
2751499565,31cyclictest0-21swapper/308:46:093
2751499563,47cyclictest0-21swapper/307:46:253
2751499563,47cyclictest0-21swapper/307:46:253
2751199563,47cyclictest26511-21aten_r1power_en06:11:201
27511995616,11cyclictest3439-21crond10:30:571
46012552,46sleep00-21swapper/005:24:100
2751499556,30cyclictest0-21swapper/306:51:363
2751499556,29cyclictest0-21swapper/308:56:263
2751499555,31cyclictest0-21swapper/308:51:173
2751499555,30cyclictest0-21swapper/305:36:403
2751499554,32cyclictest0-21swapper/306:56:313
2751499554,31cyclictest0-21swapper/305:41:263
2751499554,30cyclictest0-21swapper/306:36:083
2751199553,47cyclictest0-21swapper/105:11:461
2751199553,46cyclictest0-21swapper/110:06:171
27506995526,23cyclictest29269-21latency10:11:200
234052552,10sleep00-21swapper/007:11:240
227799550,5rtkit-daemon2276-21rtkit-daemon10:16:250
227799550,5rtkit-daemon2276-21rtkit-daemon09:36:270
227799550,5rtkit-daemon2276-21rtkit-daemon09:11:280
227799550,5rtkit-daemon2276-21rtkit-daemon09:11:280
134942553,45sleep10-21swapper/108:09:261
104622552,46sleep00-21swapper/006:43:430
306672543,9sleep10-21swapper/108:51:301
2751499546,30cyclictest0-21swapper/310:26:113
2751499546,29cyclictest0-21swapper/309:56:223
2751499546,29cyclictest0-21swapper/307:06:273
2751499545,30cyclictest0-21swapper/308:16:223
2751499545,30cyclictest0-21swapper/305:26:433
2751499545,30cyclictest0-21swapper/305:11:393
2751499544,31cyclictest0-21swapper/308:01:043
2751499544,30cyclictest0-21swapper/307:01:283
2751499544,30cyclictest0-21swapper/307:01:283
2751499544,30cyclictest0-21swapper/305:31:423
2751199545,43cyclictest0-21swapper/107:11:361
2751199543,45cyclictest0-21swapper/109:11:151
2751199543,45cyclictest0-21swapper/109:11:151
2751199543,45cyclictest0-21swapper/105:36:231
2751199543,44cyclictest0-21swapper/106:21:351
2751199543,44cyclictest0-21swapper/106:21:351
27511995425,10cyclictest23946-21cat08:36:031
27506995438,9cyclictest41ktimersoftd/005:26:350
27506995431,9cyclictest11013-21aten2.4-expect06:46:210
227799540,5rtkit-daemon2276-21rtkit-daemon06:31:270
51232533,44sleep10-21swapper/110:31:311
51232533,44sleep10-21swapper/110:31:311
2751499536,29cyclictest0-21swapper/306:11:363
2751499535,29cyclictest0-21swapper/309:11:253
2751499535,29cyclictest0-21swapper/309:11:253
2751499534,31cyclictest0-21swapper/308:36:273
2751499534,31cyclictest0-21swapper/305:21:473
27514995322,14cyclictest0-21swapper/309:06:253
27514995320,15cyclictest0-21swapper/307:30:293
2751499532,45cyclictest0-21swapper/310:16:213
2751199534,41cyclictest0-21swapper/109:56:101
2751199533,44cyclictest0-21swapper/107:01:191
2751199533,44cyclictest0-21swapper/107:01:191
2751199533,44cyclictest0-21swapper/105:41:211
2751199532,45cyclictest0-21swapper/107:36:181
27511995318,10cyclictest8576-21open_inodes09:16:291
27506995335,12cyclictest0-21swapper/006:16:220
27506995334,12cyclictest0-21swapper/007:06:200
227799530,6rtkit-daemon2276-21rtkit-daemon08:16:300
227799530,5rtkit-daemon2276-21rtkit-daemon09:02:210
227799530,5rtkit-daemon2276-21rtkit-daemon08:51:210
227799530,5rtkit-daemon2276-21rtkit-daemon08:36:370
227799530,5rtkit-daemon2276-21rtkit-daemon07:31:320
227799530,5rtkit-daemon2276-21rtkit-daemon07:26:320
227799530,5rtkit-daemon2276-21rtkit-daemon06:26:270
92532523,41sleep00-21swapper/007:56:230
34332522,10sleep00-21swapper/007:45:470
2751499525,28cyclictest0-21swapper/308:27:233
2751499524,30cyclictest0-21swapper/306:41:363
2751499524,29cyclictest0-21swapper/307:36:293
2751499524,29cyclictest0-21swapper/307:26:043
2751499524,28cyclictest0-21swapper/308:11:023
27514995235,11cyclictest29171-21tr06:16:233
27514995221,11cyclictest22200-21vmstat09:51:333
27514995221,11cyclictest22200-21vmstat09:51:333
2751499522,45cyclictest0-21swapper/307:11:283
2751199523,43cyclictest0-21swapper/110:16:111
2751199523,43cyclictest0-21swapper/109:26:271
2751199523,43cyclictest0-21swapper/107:16:351
2751199522,44cyclictest0-21swapper/106:26:401
27506995236,11cyclictest0-21swapper/006:21:430
27506995236,11cyclictest0-21swapper/006:21:430
27506995220,13cyclictest0-21swapper/009:55:590
27506995220,13cyclictest0-21swapper/009:55:590
27506995213,33cyclictest0-21swapper/007:26:050
227799520,5rtkit-daemon2276-21rtkit-daemon10:26:250
227799520,5rtkit-daemon2276-21rtkit-daemon09:06:130
227799520,5rtkit-daemon2276-21rtkit-daemon08:06:300
227799520,5rtkit-daemon2276-21rtkit-daemon07:01:400
227799520,5rtkit-daemon2276-21rtkit-daemon07:01:400
227799520,5rtkit-daemon2276-21rtkit-daemon06:57:260
141372523,42sleep00-21swapper/005:44:090
82332513,10sleep30-21swapper/306:40:443
31422514,40sleep30-21swapper/307:41:593
2751499516,14cyclictest0-21swapper/309:46:073
2751499515,28cyclictest0-21swapper/309:28:343
2751499514,14cyclictest0-21swapper/305:46:333
27514995120,14cyclictest0-21swapper/308:11:273
27514995119,9cyclictest3497-21crond06:31:073
27514995118,13cyclictest0-21swapper/306:06:073
27514995117,13cyclictest0-21swapper/308:32:293
2751199515,40cyclictest0-21swapper/105:16:431
2751199515,28cyclictest0-21swapper/106:51:181
2751199513,42cyclictest0-21swapper/108:46:111
2750699514,41cyclictest0-21swapper/005:17:170
27506995126,8cyclictest28616-21latency_hist06:16:080
82092503,39sleep00-21swapper/005:31:310
2751499504,28cyclictest0-21swapper/310:06:003
2751499504,27cyclictest32307-21yum-updatesd-he06:21:353
2751499504,27cyclictest32307-21yum-updatesd-he06:21:353
27514995033,11cyclictest24205-21aten_r1power_po06:06:243
27514995031,12cyclictest17243-21cut05:51:243
2751499503,25cyclictest0-21swapper/307:31:343
2751499502,10cyclictest0-21swapper/310:06:163
27514995018,15cyclictest0-21swapper/308:02:593
2751199505,39cyclictest0-21swapper/107:06:201
2751199504,39cyclictest0-21swapper/106:11:081
27511995034,10cyclictest18996-21crond08:26:021
2751199503,42cyclictest0-21swapper/105:46:471
2751199503,26cyclictest0-21swapper/110:11:111
2750699504,38cyclictest0-21swapper/010:06:240
27506995031,13cyclictest0-21swapper/008:46:240
2750699503,41cyclictest0-21swapper/005:56:350
254372503,9sleep10-21swapper/110:04:261
236602502,42sleep00-21swapper/006:03:480
227799500,5rtkit-daemon2276-21rtkit-daemon09:46:270
227799500,5rtkit-daemon2276-21rtkit-daemon08:22:000
92642493,9sleep10-21swapper/105:32:451
296062492,42sleep00-21swapper/005:07:410
2751499494,29cyclictest0-21swapper/309:45:193
2751499494,28cyclictest0-21swapper/309:22:213
27514994919,14cyclictest0-21swapper/308:21:333
2751199495,11cyclictest0-21swapper/105:56:351
2751199494,39cyclictest0-21swapper/109:45:591
2751199494,29cyclictest0-21swapper/107:56:291
2751199493,41cyclictest0-21swapper/105:06:301
2750699495,40cyclictest0-21swapper/007:18:450
2750699494,38cyclictest0-21swapper/009:26:000
80202483,9sleep10-21swapper/106:37:551
2751499486,13cyclictest0-21swapper/309:16:373
2751499484,28cyclictest0-21swapper/307:16:173
2751499484,22cyclictest0-21swapper/309:36:313
27514994831,10cyclictest28041-21cpuspeed_turbos05:06:243
2751499483,26cyclictest0-21swapper/310:11:163
2751199485,38cyclictest0-21swapper/109:01:011
2751199485,37cyclictest0-21swapper/107:46:051
2751199484,37cyclictest0-21swapper/106:46:071
27511994834,8cyclictest6354-21cpuspeed_turbos07:51:181
2751199483,26cyclictest0-21swapper/105:51:221
27511994816,13cyclictest0-21swapper/109:26:011
2750699484,38cyclictest0-21swapper/009:29:340
27506994833,10cyclictest0-21swapper/008:31:130
27506994832,11cyclictest0-21swapper/007:36:250
2750699483,39cyclictest0-21swapper/009:43:190
259502483,39sleep00-21swapper/006:07:350
25952483,38sleep10-21swapper/105:21:121
253142482,39sleep00-21swapper/010:02:480
109762482,9sleep00-21swapper/008:02:400
68692473,10sleep10-21swapper/105:27:371
321112472,39sleep00-21swapper/005:14:140
2751499474,23cyclictest0-21swapper/309:31:333
27514994730,9cyclictest1060-21latency_hist10:25:583
27514994714,12cyclictest0-21swapper/310:31:113
27514994714,12cyclictest0-21swapper/310:31:113
2751199475,37cyclictest0-21swapper/108:11:241
2751199475,36cyclictest21624-21taskset09:51:241
2751199475,36cyclictest21624-21taskset09:51:241
2751199475,36cyclictest0-21swapper/109:36:291
2751199474,36cyclictest0-21swapper/110:21:281
2751199473,38cyclictest0-21swapper/106:31:201
2751199473,10cyclictest0-21swapper/109:46:161
27506994730,12cyclictest0-21swapper/008:26:200
27506994727,13cyclictest0-21swapper/005:46:250
27506994720,8cyclictest8269-21latency_hist06:41:070
264472473,37sleep10-21swapper/108:42:031
227799470,4rtkit-daemon2276-21rtkit-daemon08:56:280
201272473,37sleep10-21swapper/108:26:191
189742472,9sleep00-21swapper/005:55:050
18712473,38sleep10-21swapper/109:02:271
130082473,11sleep10-21swapper/106:50:491
301222463,38sleep10-21swapper/107:27:581
2751199464,37cyclictest0-21swapper/107:26:041
2751199464,36cyclictest0-21swapper/106:21:081
27506994629,12cyclictest0-21swapper/009:56:160
22922463,10sleep30-21swapper/305:20:343
2751499454,12cyclictest0-21swapper/308:46:033
2751199453,34cyclictest22067-21tr06:01:241
27506994532,9cyclictest0-21swapper/009:16:220
27506994530,10cyclictest0-21swapper/009:31:100
2750699453,35cyclictest0-21swapper/005:06:100
2750699453,35cyclictest0-21swapper/005:06:100
27506994525,9cyclictest0-21swapper/010:31:320
27506994525,9cyclictest0-21swapper/010:31:320
267072452,37sleep00-21swapper/008:45:290
180562453,37sleep10-21swapper/108:16:441
110372453,9sleep10-21swapper/108:03:291
27511994415,11cyclictest0-21swapper/105:06:111
27511994415,11cyclictest0-21swapper/105:06:111
2750699443,36cyclictest0-21swapper/006:51:210
2751199435,33cyclictest15652-21munin-node06:56:201
20492432,34sleep30-21swapper/309:03:503
2750699424,32cyclictest0-21swapper/005:36:320
2751499403,19cyclictest27675-21latency_hist05:06:113
2751499403,19cyclictest27675-21latency_hist05:06:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional