You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 18:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Tue Apr 07, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30382991024,91cyclictest0-21swapper/008:06:080
248599970,5rtkit-daemon0-21swapper/305:21:453
3038299953,84cyclictest0-21swapper/008:07:070
3038299943,48cyclictest16761-21grep10:21:490
3038299935,81cyclictest0-21swapper/009:51:500
3038299934,83cyclictest0-21swapper/009:16:520
3038299924,81cyclictest0-21swapper/009:41:430
3038299924,70cyclictest0-21swapper/009:01:560
3038299923,82cyclictest0-21swapper/007:33:350
30382999212,45cyclictest0-21swapper/007:46:510
30382999212,45cyclictest0-21swapper/007:46:510
3038299904,67cyclictest0-21swapper/010:31:300
3038299904,67cyclictest0-21swapper/010:31:300
3038299903,80cyclictest28552-21unixbench_singl07:27:110
3038299894,78cyclictest0-21swapper/009:11:340
3038299894,78cyclictest0-21swapper/009:11:340
3038299894,78cyclictest0-21swapper/007:40:440
3038299894,77cyclictest0-21swapper/010:46:500
3038299893,78cyclictest0-21swapper/007:42:070
271902890,8sleep13038699cyclictest09:01:511
3038299884,77cyclictest0-21swapper/010:01:550
3038299884,77cyclictest0-21swapper/009:00:190
3038299884,63cyclictest0-21swapper/006:36:500
3038299883,77cyclictest0-21swapper/009:21:460
3038299874,76cyclictest0-21swapper/010:14:280
3038299874,76cyclictest0-21swapper/008:43:330
3038299874,76cyclictest0-21swapper/008:16:480
3038299874,76cyclictest0-21swapper/008:00:090
3038299874,75cyclictest0-21swapper/005:31:570
3038299874,74cyclictest25433-21ssh07:23:080
3038299874,64cyclictest0-21swapper/009:11:440
3038299873,77cyclictest0-21swapper/009:38:010
3038299873,77cyclictest0-21swapper/008:15:410
3038299873,67cyclictest0-21swapper/010:36:310
3038299873,65cyclictest0-21swapper/008:36:460
3038299864,75cyclictest0-21swapper/010:36:410
3038299864,75cyclictest0-21swapper/009:56:440
3038299864,75cyclictest0-21swapper/008:52:070
3038299864,75cyclictest0-21swapper/007:52:010
3038299864,66cyclictest0-21swapper/009:47:040
3038299864,66cyclictest0-21swapper/009:47:040
3038299864,64cyclictest0-21swapper/010:06:590
3038299863,76cyclictest0-21swapper/009:31:350
3038299863,76cyclictest0-21swapper/009:26:350
3038299863,76cyclictest0-21swapper/008:30:570
3038299863,76cyclictest0-21swapper/008:30:570
3038299863,65cyclictest0-21swapper/008:50:230
3038299854,74cyclictest0-21swapper/008:35:360
3038299854,74cyclictest0-21swapper/008:26:130
3038299854,74cyclictest0-21swapper/006:10:460
3038299853,76cyclictest0-21swapper/010:17:090
3038299853,61cyclictest30106-21sort10:41:470
3038299843,75cyclictest0-21swapper/006:11:530
3038299843,74cyclictest0-21swapper/007:07:070
3038299843,74cyclictest0-21swapper/007:07:070
3038299843,59cyclictest8302-21unixbench-2d06:47:120
3038299835,70cyclictest21061-21telnet07:16:470
3038299834,72cyclictest0-21swapper/007:12:080
3038299834,56cyclictest14784-21crond05:56:410
3038299824,72cyclictest0-21swapper/006:51:540
3038299824,71cyclictest0-21swapper/006:01:110
3038299824,71cyclictest0-21swapper/005:37:030
3038299824,71cyclictest0-21swapper/005:37:030
30382998236,40cyclictest12607-21strings06:57:040
3038299804,69cyclictest0-21swapper/006:26:570
3038299804,69cyclictest0-21swapper/006:02:100
3038299802,71cyclictest15940-21chrt07:06:360
248599800,4rtkit-daemon2484-21rtkit-daemon05:27:450
3038299793,69cyclictest0-21swapper/006:45:520
3038299793,62cyclictest0-21swapper/006:20:490
248599790,4rtkit-daemon2484-21rtkit-daemon05:24:220
3038299784,67cyclictest0-21swapper/006:26:400
3038299784,67cyclictest0-21swapper/006:26:400
3038299783,67cyclictest10247-21munin-node05:47:080
3038299773,67cyclictest0-21swapper/005:42:030
3038299773,57cyclictest1416-21sshd06:35:470
3038299714,57cyclictest30384-21basename05:21:410
248599700,5rtkit-daemon0-21swapper/305:23:302
30388996921,16cyclictest0-21swapper/308:25:293
9742680,15sleep23038799cyclictest07:36:372
3038899675,11cyclictest28616-21runrttasks08:16:463
30387996736,9cyclictest18141-21sa108:01:362
30386996746,13cyclictest0-21swapper/108:51:481
248599660,5rtkit-daemon2484-21rtkit-daemon05:32:151
3038699654,53cyclictest0-21swapper/106:36:391
3038899635,12cyclictest18717-21gltestperf09:36:533
3038899632,52cyclictest0-21swapper/310:32:163
30387996224,30cyclictest0-21swapper/207:47:502
30387996224,30cyclictest0-21swapper/207:47:502
30386996126,18cyclictest29905-21munin-node09:07:111
30386996126,18cyclictest29905-21munin-node09:07:111
30388996040,12cyclictest32076-21cpuspeed_turbos06:31:553
3038899604,13cyclictest0-21swapper/307:22:013
30388996017,27cyclictest0-21swapper/308:32:563
30387996041,13cyclictest0-21swapper/208:47:342
30387996022,21cyclictest1287-21snmpd08:06:062
3038699605,49cyclictest0-21swapper/107:24:311
30386996039,13cyclictest0-21swapper/107:31:561
153562604,48sleep30-21swapper/308:43:393
3038899595,13cyclictest0-21swapper/309:07:003
3038899595,13cyclictest0-21swapper/309:07:003
3038899594,37cyclictest0-21swapper/310:37:353
3038899594,36cyclictest0-21swapper/310:18:023
3038899594,13cyclictest0-21swapper/307:51:513
3038899594,13cyclictest0-21swapper/307:27:003
3038899594,13cyclictest0-21swapper/306:22:033
3038899594,13cyclictest0-21swapper/306:22:033
30387995942,11cyclictest0-21swapper/208:21:452
3038799593,13cyclictest0-21swapper/207:42:512
248599590,4rtkit-daemon2484-21rtkit-daemon08:38:523
30388995840,10cyclictest2111-21gltestperf07:36:573
3038899584,36cyclictest21098-21awk08:52:013
3038899584,36cyclictest0-21swapper/309:06:033
3038899584,14cyclictest0-21swapper/309:54:563
3038899584,13cyclictest0-21swapper/307:32:113
30387995826,13cyclictest0-21swapper/208:41:352
3038699585,15cyclictest0-21swapper/110:22:041
30386995841,10cyclictest19231-21gltestperf08:01:551
3038699583,28cyclictest7318-21swap10:07:031
256342582,10sleep30-21swapper/308:59:203
251622582,11sleep10-21swapper/108:57:361
145992585,13sleep20-21swapper/207:56:012
3038899575,13cyclictest0-21swapper/310:06:013
3038899574,32cyclictest0-21swapper/310:11:443
3038899574,13cyclictest0-21swapper/309:33:143
3038899574,13cyclictest0-21swapper/309:17:453
3038899574,12cyclictest0-21swapper/310:43:263
3038899574,12cyclictest0-21swapper/307:50:543
3038899574,12cyclictest0-21swapper/307:50:543
30387995738,13cyclictest0-21swapper/207:21:542
30387995735,15cyclictest0-21swapper/208:41:492
30387995729,12cyclictest0-21swapper/209:09:472
30387995729,12cyclictest0-21swapper/209:09:472
3038699575,45cyclictest0-21swapper/109:47:591
3038699575,45cyclictest0-21swapper/109:47:591
3038699574,46cyclictest0-21swapper/108:23:181
3038699573,35cyclictest0-21swapper/108:40:281
248599570,4rtkit-daemon2484-21rtkit-daemon08:14:013
248599570,4rtkit-daemon2484-21rtkit-daemon05:28:221
173252573,46sleep20-21swapper/210:21:592
3038899565,12cyclictest0-21swapper/309:21:593
3038899565,12cyclictest0-21swapper/308:08:173
3038899564,33cyclictest0-21swapper/310:06:543
3038899564,29cyclictest0-21swapper/308:29:383
3038899564,29cyclictest0-21swapper/308:29:383
3038899564,13cyclictest0-21swapper/310:28:373
3038899564,13cyclictest0-21swapper/310:28:373
3038899564,12cyclictest0-21swapper/308:05:243
3038899564,12cyclictest0-21swapper/305:41:523
30388995615,11cyclictest4121-21latency_hist09:16:333
3038799564,46cyclictest0-21swapper/208:56:162
3038799564,26cyclictest0-21swapper/209:46:542
3038799564,26cyclictest0-21swapper/209:46:542
3038699565,17cyclictest0-21swapper/109:23:221
30386995634,14cyclictest0-21swapper/108:30:561
30386995634,14cyclictest0-21swapper/108:30:561
30386995620,13cyclictest29710-21unixbench-2d09:52:051
186792564,46sleep30-21swapper/310:25:153
121972562,10sleep30-21swapper/309:26:573
3038899555,30cyclictest0-21swapper/305:52:053
3038899554,30cyclictest0-21swapper/306:37:113
3038899554,13cyclictest0-21swapper/308:47:023
3038799555,14cyclictest0-21swapper/207:41:372
30387995539,9cyclictest1105-21grep10:46:482
30387995538,11cyclictest28719-21grep09:51:502
30387995535,13cyclictest0-21swapper/207:26:522
3038799553,46cyclictest23127-21diskmemload08:35:472
3038799553,46cyclictest0-21swapper/208:29:012
3038799553,46cyclictest0-21swapper/208:29:012
3038799553,45cyclictest0-21swapper/208:17:022
3038799553,43cyclictest0-21swapper/205:31:582
30387995518,21cyclictest26041-21head08:11:552
3038699554,46cyclictest0-21swapper/107:46:181
3038699554,30cyclictest0-21swapper/107:52:091
30386995537,11cyclictest17730-21cpuspeed_turbos06:01:531
30386995534,13cyclictest0-21swapper/107:26:491
3038899545,30cyclictest0-21swapper/309:57:023
3038899545,28cyclictest0-21swapper/307:44:033
3038899544,30cyclictest0-21swapper/306:52:133
30387995436,12cyclictest0-21swapper/210:31:502
30387995434,13cyclictest0-21swapper/210:12:012
3038699549,39cyclictest16962-21df_abs08:46:511
3038699545,29cyclictest0-21swapper/105:47:071
3038699545,28cyclictest0-21swapper/109:34:371
3038699545,16cyclictest0-21swapper/110:40:391
3038699545,16cyclictest0-21swapper/107:51:301
3038699545,16cyclictest0-21swapper/107:51:301
3038699544,28cyclictest14121-21iostat_ios08:41:561
3038699544,12cyclictest22426-21grep10:31:301
3038699544,12cyclictest22426-21grep10:31:301
3038699544,12cyclictest0-21swapper/107:40:421
30386995427,8cyclictest58-21kswapd010:31:481
29812543,43sleep20-21swapper/210:01:482
3038899534,30cyclictest0-21swapper/310:47:053
3038899534,29cyclictest0-21swapper/307:57:003
3038899534,29cyclictest0-21swapper/306:50:533
30388995321,13cyclictest0-21swapper/307:06:383
3038799534,41cyclictest0-21swapper/210:41:422
30387995333,13cyclictest0-21swapper/206:17:002
30387995332,14cyclictest0-21swapper/209:16:492
3038799533,44cyclictest0-21swapper/210:06:552
3038799533,43cyclictest0-21swapper/209:21:562
30387995327,11cyclictest0-21swapper/205:51:532
3038699535,28cyclictest0-21swapper/105:52:071
3038699535,27cyclictest0-21swapper/108:17:461
3038699535,14cyclictest0-21swapper/110:42:041
3038699534,29cyclictest0-21swapper/109:42:031
30386995321,14cyclictest0-21swapper/109:41:101
135462533,43sleep113559-21munin-run07:01:381
88002522,10sleep20-21swapper/206:51:392
3038899526,38cyclictest0-21swapper/305:36:533
3038899526,38cyclictest0-21swapper/305:36:533
3038899525,27cyclictest0-21swapper/306:17:123
3038899524,28cyclictest0-21swapper/306:27:073
30388995231,12cyclictest4287-21cut05:32:063
30388995220,13cyclictest0-21swapper/309:47:003
30388995220,13cyclictest0-21swapper/309:47:003
30388995219,13cyclictest0-21swapper/309:41:563
3038799524,42cyclictest0-21swapper/210:41:302
3038799524,41cyclictest0-21swapper/209:56:572
3038799523,42cyclictest0-21swapper/209:02:032
3038799523,11cyclictest0-21swapper/209:27:022
3038699525,27cyclictest0-21swapper/109:59:381
3038699525,27cyclictest0-21swapper/108:31:561
3038699525,27cyclictest0-21swapper/108:01:211
3038699525,26cyclictest21761-21munin-node08:07:061
3038699524,28cyclictest0-21swapper/110:01:461
3038699524,28cyclictest0-21swapper/107:16:541
3038699524,28cyclictest0-21swapper/106:01:191
3038699524,27cyclictest0-21swapper/110:20:361
30386995233,13cyclictest0-21swapper/108:12:351
30386995233,11cyclictest4718-21cpuspeed_turbos09:16:461
30386995231,12cyclictest1300-21cut10:46:501
30386995220,13cyclictest0-21swapper/109:26:411
290402522,17sleep20-21swapper/206:25:392
290402522,17sleep20-21swapper/206:25:392
248599520,4rtkit-daemon2484-21rtkit-daemon05:23:451
204952522,42sleep10-21swapper/107:13:351
3038899515,28cyclictest0-21swapper/305:30:443
3038899514,28cyclictest0-21swapper/307:07:033
3038899514,28cyclictest0-21swapper/307:07:033
30388995134,10cyclictest18219-21head06:01:593
30388995133,11cyclictest11123-21head05:47:003
3038799514,40cyclictest0-21swapper/210:26:442
3038799514,40cyclictest0-21swapper/210:26:442
30387995133,12cyclictest0-21swapper/210:20:202
30387995133,12cyclictest0-21swapper/209:12:362
30387995132,12cyclictest0-21swapper/209:31:482
3038799513,40cyclictest0-21swapper/209:36:562
3038699514,28cyclictest0-21swapper/107:01:501
3038699514,27cyclictest957-21head09:11:461
3038699514,27cyclictest0-21swapper/106:37:031
30386995121,12cyclictest0-21swapper/110:12:051
168642512,9sleep20-21swapper/205:57:422
99272502,42sleep10-21swapper/105:45:391
3038899504,28cyclictest0-21swapper/306:15:493
3038799503,41cyclictest0-21swapper/209:42:022
3038799503,28cyclictest19184-21unixbench_singl06:02:132
3038699508,26cyclictest0-21swapper/106:11:521
3038699504,28cyclictest0-21swapper/106:26:171
3038699504,28cyclictest0-21swapper/106:26:171
30386995027,16cyclictest0-21swapper/106:51:541
192492502,9sleep30-21swapper/307:11:563
3038799496,36cyclictest0-21swapper/208:57:012
3038799493,39cyclictest0-21swapper/207:12:072
30387994920,7cyclictest32715-21if_err_eth006:32:022
3038699494,27cyclictest0-21swapper/106:16:571
30386994930,13cyclictest0-21swapper/107:11:381
30386994930,13cyclictest0-21swapper/107:11:381
30386994917,13cyclictest0-21swapper/105:37:151
30386994917,13cyclictest0-21swapper/105:37:151
229032492,9sleep30-21swapper/307:18:533
85522482,11sleep10-21swapper/106:48:481
3038899485,34cyclictest0-21swapper/306:11:413
30388994815,13cyclictest0-21swapper/306:41:503
3038799484,37cyclictest0-21swapper/207:16:512
30387994825,10cyclictest0-21swapper/208:08:142
30386994816,13cyclictest0-21swapper/106:07:001
54672472,38sleep20-21swapper/205:36:462
54672472,38sleep20-21swapper/205:36:462
314722472,38sleep10-21swapper/106:31:101
30387994732,10cyclictest0-21swapper/206:37:012
3038699475,13cyclictest0-21swapper/106:42:111
30388994630,10cyclictest12140-21fschecks_time06:56:583
3038799463,36cyclictest0-21swapper/207:06:482
3038799463,36cyclictest0-21swapper/207:06:482
3038799463,26cyclictest0-21swapper/206:08:182
3038799463,26cyclictest0-21swapper/205:41:582
30387994627,13cyclictest0-21swapper/206:56:382
3038899454,35cyclictest0-21swapper/305:57:063
3038799453,35cyclictest0-21swapper/206:41:532
3038799453,24cyclictest0-21swapper/206:59:412
3038799443,34cyclictest0-21swapper/206:12:082
3038799442,36cyclictest0-21swapper/207:02:062
30387994415,13cyclictest0-21swapper/205:27:092
3038799433,12cyclictest0-21swapper/206:26:552
30387994329,10cyclictest0-21swapper/205:51:152
30387994019,7cyclictest30362-21latency_hist05:21:422
30388993816,10cyclictest0-21swapper/305:21:423
3038699353,26cyclictest0-21swapper/105:21:421
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional