You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-09 - 14:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri Jan 09, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1445599894,30cyclictest0-21swapper/211:34:222
14455998938,44cyclictest16822-21tr10:14:252
14455998933,49cyclictest10490-21tune2fs08:49:312
1445599884,33cyclictest0-21swapper/209:29:342
1445599874,12cyclictest0-21swapper/210:37:532
248599860,4rtkit-daemon2484-21rtkit-daemon11:23:153
1445599864,27cyclictest0-21swapper/211:09:402
1445599864,27cyclictest0-21swapper/207:33:212
1445599864,27cyclictest0-21swapper/207:33:212
14455998624,10cyclictest27373-21grep07:09:372
1445599854,27cyclictest0-21swapper/210:59:282
1445599854,12cyclictest0-21swapper/208:14:452
1445599854,12cyclictest0-21swapper/208:14:452
1445599854,11cyclictest23660-21munin-node10:29:352
1445599845,9cyclictest18734-21unixbench_singl09:04:482
1445599845,34cyclictest0-21swapper/206:49:312
14455998421,12cyclictest0-21swapper/207:39:382
14455998416,12cyclictest0-21swapper/209:26:562
14455998321,12cyclictest0-21swapper/211:59:212
14455998316,11cyclictest0-21swapper/211:19:202
1445599824,31cyclictest0-21swapper/208:04:332
1445599824,12cyclictest0-21swapper/206:58:152
1445599823,35cyclictest0-21swapper/208:32:232
1445599823,25cyclictest0-21swapper/210:23:502
1445599823,25cyclictest0-21swapper/210:23:502
1445599814,28cyclictest0-21swapper/208:59:392
1445599814,12cyclictest0-21swapper/207:24:332
1445599813,23cyclictest0-21swapper/207:18:012
14455998112,12cyclictest0-21swapper/207:04:392
1445599804,26cyclictest0-21swapper/210:49:282
1445599804,13cyclictest0-21swapper/206:44:412
1445599804,13cyclictest0-21swapper/206:44:412
1445599803,31cyclictest21531-21munin-run09:14:142
14455998016,11cyclictest0-21swapper/210:04:182
248599790,4rtkit-daemon2484-21rtkit-daemon11:03:310
1445599794,12cyclictest0-21swapper/210:44:352
14455997915,11cyclictest0-21swapper/211:44:032
1445599784,33cyclictest0-21swapper/207:54:162
1445599784,31cyclictest0-21swapper/209:19:452
1445599784,25cyclictest0-21swapper/211:04:212
1445599784,25cyclictest0-21swapper/211:04:212
1445599784,24cyclictest0-21swapper/208:09:452
1445599784,23cyclictest0-21swapper/211:29:202
1445599784,14cyclictest0-21swapper/212:09:312
1445599774,33cyclictest0-21swapper/209:59:442
1445599773,28cyclictest0-21swapper/209:39:222
14455997722,9cyclictest5085-21df_abs09:49:272
1445599764,31cyclictest0-21swapper/212:04:292
1445599764,13cyclictest0-21swapper/211:14:202
1445599764,13cyclictest0-21swapper/208:34:272
1445599763,17cyclictest0-21swapper/208:54:482
14455997626,8cyclictest32205-21tail07:19:362
1445599754,32cyclictest0-21swapper/211:54:092
1445599754,29cyclictest0-21swapper/210:39:232
1445599754,14cyclictest0-21swapper/210:09:412
1445599753,22cyclictest0-21swapper/208:24:252
320732740,3sleep30-21swapper/310:44:373
1445599743,33cyclictest0-21swapper/211:54:402
1445599743,25cyclictest11680-21fschecks_count07:44:342
1445599743,23cyclictest0-21swapper/208:39:272
1445599743,22cyclictest0-21swapper/208:44:252
1445599734,30cyclictest0-21swapper/207:34:572
1445599733,26cyclictest0-21swapper/207:54:312
14455997327,8cyclictest23460-21cat06:59:522
1445599724,29cyclictest0-21swapper/209:44:262
1445599724,13cyclictest0-21swapper/211:24:272
1445599723,27cyclictest0-21swapper/208:19:312
248599710,7rtkit-daemon0-21swapper/006:46:111
248599710,7rtkit-daemon0-21swapper/006:46:111
248599710,6rtkit-daemon0-21swapper/008:49:511
248599710,5rtkit-daemon0-21swapper/008:45:071
1445599713,22cyclictest0-21swapper/209:54:232
14455997116,10cyclictest0-21swapper/209:14:192
194192704,24sleep00-21swapper/009:09:260
14455997028,10cyclictest27827-21grep11:44:252
248599690,9rtkit-daemon0-21swapper/106:45:110
248599690,9rtkit-daemon0-21swapper/106:45:110
248599690,8rtkit-daemon0-21swapper/008:39:290
248599690,6rtkit-daemon0-21swapper/008:42:371
248599680,7rtkit-daemon0-21swapper/108:44:590
1445599684,32cyclictest0-21swapper/207:59:402
248599670,6rtkit-daemon0-21swapper/006:49:261
14457996746,13cyclictest0-21swapper/309:24:143
14457996745,15cyclictest0-21swapper/310:39:223
248599660,5rtkit-daemon2484-21rtkit-daemon11:04:163
248599660,5rtkit-daemon2484-21rtkit-daemon11:04:163
248599650,7rtkit-daemon0-21swapper/106:49:340
248599650,5rtkit-daemon2484-21rtkit-daemon10:57:463
248599650,5rtkit-daemon2484-21rtkit-daemon09:12:213
248599650,5rtkit-daemon2484-21rtkit-daemon08:59:443
248599650,5rtkit-daemon2484-21rtkit-daemon07:21:253
248599650,4rtkit-daemon2484-21rtkit-daemon09:42:423
248599650,4rtkit-daemon2484-21rtkit-daemon09:15:583
1445599654,15cyclictest0-21swapper/210:24:352
1445599654,11cyclictest0-21swapper/209:39:142
42272640,6sleep04228-21rm10:54:290
248599640,5rtkit-daemon2484-21rtkit-daemon08:58:293
248599640,5rtkit-daemon2484-21rtkit-daemon07:01:333
248599640,4rtkit-daemon2484-21rtkit-daemon11:14:013
248599640,4rtkit-daemon2484-21rtkit-daemon10:22:403
248599640,4rtkit-daemon2484-21rtkit-daemon10:22:403
248599640,4rtkit-daemon2484-21rtkit-daemon10:15:113
248599640,4rtkit-daemon2484-21rtkit-daemon10:06:113
248599640,4rtkit-daemon2484-21rtkit-daemon08:18:533
248599640,4rtkit-daemon2484-21rtkit-daemon08:18:533
248599640,4rtkit-daemon2484-21rtkit-daemon06:56:113
248599640,4rtkit-daemon2484-21rtkit-daemon06:51:343
248599630,4rtkit-daemon2484-21rtkit-daemon07:41:173
178052634,52sleep00-21swapper/010:14:400
1444799634,51cyclictest0-21swapper/009:04:140
248599620,5rtkit-daemon29195-21python08:19:453
1444799626,48cyclictest0-21swapper/011:14:220
248599610,4rtkit-daemon23090-21yum-updatesd-he10:25:033
1444799614,50cyclictest0-21swapper/009:44:320
1444799614,50cyclictest0-21swapper/009:19:240
1444799614,49cyclictest0-21swapper/011:09:090
1444799614,49cyclictest0-21swapper/011:09:090
1444799614,49cyclictest0-21swapper/008:24:410
248599600,5rtkit-daemon1828-21iostat10:49:323
248599600,5rtkit-daemon1287-21snmpd09:33:423
248599600,4rtkit-daemon30713-21diskstats08:24:303
248599600,4rtkit-daemon19469-21yum-updatesd-he11:25:003
1444799605,47cyclictest21956-21aten2.4-expect06:59:310
1444799604,49cyclictest0-21swapper/012:07:360
1444799604,49cyclictest0-21swapper/011:28:440
1444799604,49cyclictest0-21swapper/010:34:110
1444799604,48cyclictest6710-21idleruntime-cro09:54:120
248599590,5rtkit-daemon21621-21iostat_ios08:04:383
248599590,4rtkit-daemon7693-21python07:34:473
248599590,4rtkit-daemon25840-21iostat11:39:303
248599590,4rtkit-daemon18386-21processes09:04:433
248599590,4rtkit-daemon14448-21iostat07:49:393
1444799594,48cyclictest32586-21head08:29:270
1444799593,50cyclictest0-21swapper/008:22:550
1444799592,51cyclictest0-21swapper/011:35:360
248599580,5rtkit-daemon26936-21cat09:24:283
1444799585,46cyclictest0-21swapper/011:59:200
1444799585,13cyclictest0-21swapper/011:54:370
284492573,10sleep00-21swapper/010:39:230
248599570,4rtkit-daemon2596-21cstates09:44:273
14452995739,12cyclictest0-21swapper/109:49:291
1444799574,46cyclictest0-21swapper/008:49:310
1444799573,47cyclictest0-21swapper/007:14:380
1444799573,47cyclictest0-21swapper/006:54:330
14457995617,23cyclictest3863-21munin-node07:29:453
14457995617,23cyclictest3863-21munin-node07:29:453
1444799564,44cyclictest31077-21turbostat09:34:130
1444799563,10cyclictest0-21swapper/010:09:380
248599550,4rtkit-daemon2484-21rtkit-daemon09:34:353
248599550,4rtkit-daemon2484-21rtkit-daemon09:34:353
1445799555,42cyclictest0-21swapper/307:59:513
1445799553,46cyclictest0-21swapper/307:14:343
14457995522,13cyclictest0-21swapper/310:04:123
14457995521,13cyclictest0-21swapper/308:44:263
1444799555,42cyclictest27528-21munin-run08:19:160
1444799555,42cyclictest27528-21munin-run08:19:160
320492543,44sleep10-21swapper/108:26:101
280482543,10sleep10-21swapper/110:37:061
22242543,44sleep10-21swapper/109:44:251
194622543,44sleep10-21swapper/111:24:471
1445799545,28cyclictest0-21swapper/310:34:123
1444799545,43cyclictest0-21swapper/011:44:190
1444799543,7cyclictest2627-21munin-node08:34:410
1444799543,44cyclictest0-21swapper/009:09:150
142152543,43sleep00-21swapper/007:49:370
86462533,43sleep00-21swapper/007:39:250
27872533,10sleep00-21swapper/010:50:230
207312533,9sleep00-21swapper/010:20:160
207312533,9sleep00-21swapper/010:20:160
1445799535,28cyclictest0-21swapper/310:59:363
1445799534,35cyclictest0-21swapper/312:04:193
1445799534,24cyclictest26137-21aten2.4-expect10:34:213
14457995320,14cyclictest0-21swapper/308:49:253
14457995319,14cyclictest0-21swapper/306:44:203
14452995337,11cyclictest0-21swapper/108:34:461
1445299533,44cyclictest0-21swapper/108:58:131
1444799533,44cyclictest0-21swapper/009:40:010
1444799533,11cyclictest0-21swapper/010:25:110
87632523,42sleep00-21swapper/009:54:560
313182522,43sleep00-21swapper/011:49:410
246442523,8sleep324776-21df_abs07:04:333
1445799526,39cyclictest0-21swapper/310:09:443
1445799526,28cyclictest0-21swapper/311:14:303
1445799525,39cyclictest0-21swapper/308:14:173
1445799525,29cyclictest0-21swapper/311:49:313
1445799525,29cyclictest0-21swapper/309:54:353
1445799525,29cyclictest0-21swapper/308:39:313
1445799525,28cyclictest0-21swapper/306:44:363
1445799525,28cyclictest0-21swapper/306:44:363
1445799522,24cyclictest0-21swapper/309:52:003
14457995219,14cyclictest0-21swapper/311:54:223
14452995227,7cyclictest17983-21latency_hist07:59:171
7232513,9sleep00-21swapper/009:35:330
7232513,9sleep00-21swapper/009:35:330
1445799515,28cyclictest0-21swapper/311:59:443
14457995128,8cyclictest22515-21tail11:34:193
14457995119,14cyclictest0-21swapper/308:34:163
14452995119,27cyclictest2006-21aten_r1power_en11:59:191
1444799514,27cyclictest0-21swapper/009:24:310
14447995136,9cyclictest24539-21grep07:04:320
268792502,42sleep10-21swapper/111:43:011
251592502,10sleep10-21swapper/107:04:391
171412503,10sleep00-21swapper/011:20:430
1445799505,38cyclictest0-21swapper/311:44:413
1445799505,27cyclictest0-21swapper/307:28:213
1445799504,29cyclictest0-21swapper/308:38:063
14457995017,15cyclictest0-21swapper/307:13:183
1445299504,39cyclictest0-21swapper/110:14:331
14452995022,13cyclictest0-21swapper/111:14:291
1444799504,28cyclictest0-21swapper/011:29:410
1444799504,12cyclictest0-21swapper/007:19:420
1444799502,9cyclictest0-21swapper/009:14:360
119112503,41sleep00-21swapper/011:09:380
113052503,41sleep00-21swapper/010:02:020
7892492,39sleep20-21swapper/209:36:242
274492492,9sleep10-21swapper/108:18:281
274492492,9sleep10-21swapper/108:18:281
178872492,9sleep30-21swapper/307:58:103
155532492,10sleep10-21swapper/107:53:531
1445799495,37cyclictest0-21swapper/311:34:083
1445799495,23cyclictest0-21swapper/307:44:293
14455994920,12cyclictest0-21swapper/210:54:432
1445299494,38cyclictest0-21swapper/109:04:281
14452994932,12cyclictest0-21swapper/107:19:411
1445299493,41cyclictest0-21swapper/107:31:261
1445299493,41cyclictest0-21swapper/107:31:261
14452994928,6cyclictest17510-21cat11:24:101
1444799495,14cyclictest0-21swapper/007:24:450
1444799494,34cyclictest0-21swapper/011:39:190
1444799494,15cyclictest0-21swapper/007:34:300
14447994934,8cyclictest17532-21grep07:54:490
14447994933,9cyclictest23286-21grep08:09:270
136432493,10sleep00-21swapper/010:06:210
1445799485,24cyclictest0-21swapper/312:09:173
1445299484,38cyclictest0-21swapper/106:54:501
1445299484,21cyclictest0-21swapper/107:40:001
14452994833,9cyclictest29519-21unixbench_singl08:19:481
14452994833,10cyclictest27209-21munin-node11:44:191
1445299483,39cyclictest0-21swapper/107:25:061
1445299483,38cyclictest0-21swapper/108:29:281
14452994823,9cyclictest1822-21munin-plugin-st09:44:131
14452994822,12cyclictest0-21swapper/110:44:251
1444799484,37cyclictest0-21swapper/012:09:240
1444799484,24cyclictest20376-21idleruntime-cro08:04:160
1444799484,12cyclictest21419-21chrt08:04:350
14447994835,8cyclictest32559-21grep10:44:440
14447994832,9cyclictest4231-21grep07:29:330
14447994832,9cyclictest4231-21grep07:29:330
14447994817,13cyclictest0-21swapper/010:34:400
130432484,10sleep00-21swapper/007:47:270
115002483,7sleep111665-21latency_hist10:04:121
86742472,10sleep10-21swapper/112:09:571
284462472,39sleep10-21swapper/107:10:241
259522472,39sleep10-21swapper/109:19:501
1445299474,36cyclictest0-21swapper/109:14:311
14452994725,11cyclictest0-21swapper/112:04:341
14452994725,11cyclictest0-21swapper/108:04:421
14452994724,7cyclictest13997-21cat10:09:121
14452994722,9cyclictest0-21swapper/110:19:191
14452994722,9cyclictest0-21swapper/110:19:191
14452994721,11cyclictest11188-21grep11:09:251
1444799474,28cyclictest0-21swapper/007:13:170
81372462,37sleep10-21swapper/107:35:431
248832462,9sleep10-21swapper/108:11:061
15182462,10sleep10-21swapper/111:56:391
1445299465,36cyclictest0-21swapper/107:44:421
14452994631,9cyclictest25379-21tail10:29:451
1444799468,24cyclictest0-21swapper/008:58:370
141732463,38sleep00-21swapper/006:41:090
9702452,37sleep10-21swapper/109:38:411
9702452,37sleep10-21swapper/109:38:411
1445299454,12cyclictest0-21swapper/109:29:241
14452994530,9cyclictest7098-21aten_r1power_vo09:54:241
14452994530,11cyclictest0-21swapper/110:09:231
14452994530,11cyclictest0-21swapper/108:59:271
1445299453,38cyclictest0-21swapper/110:42:051
1445299445,34cyclictest0-21swapper/111:49:391
14452994429,11cyclictest0-21swapper/111:29:271
14452994420,11cyclictest0-21swapper/111:04:261
14452994420,11cyclictest0-21swapper/111:04:261
244652432,9sleep10-21swapper/111:37:371
1445599434,13cyclictest0-21swapper/206:44:202
1445299434,32cyclictest0-21swapper/109:09:441
1445299434,10cyclictest0-21swapper/107:14:411
14452994321,9cyclictest0-21swapper/110:57:581
1445299424,31cyclictest0-21swapper/111:04:101
1445299423,12cyclictest0-21swapper/110:49:361
14452994225,12cyclictest0-21swapper/108:02:081
14452994220,10cyclictest0-21swapper/110:24:251
1445299413,33cyclictest0-21swapper/109:24:261
1445299403,14cyclictest0-21swapper/106:59:311
14452993113,12cyclictest0-21swapper/106:44:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional