You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 02:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri Jul 03, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
219499890,6rtkit-daemon15-21rcuc/018:42:210
219499880,4rtkit-daemon2193-21rtkit-daemon23:39:323
3133499866,72cyclictest0-21swapper/320:55:573
219499860,5rtkit-daemon2193-21rtkit-daemon22:35:343
3133499854,73cyclictest0-21swapper/320:42:103
219499850,5rtkit-daemon2193-21rtkit-daemon20:58:313
3133499844,71cyclictest0-21swapper/323:16:463
219499830,5rtkit-daemon2193-21rtkit-daemon23:18:032
219499830,5rtkit-daemon2193-21rtkit-daemon23:18:032
3133499826,68cyclictest0-21swapper/322:53:073
3133499824,61cyclictest0-21swapper/322:42:413
31334998119,34cyclictest5028-21processes23:17:253
31334998119,34cyclictest5028-21processes23:17:253
219499810,4rtkit-daemon2193-21rtkit-daemon22:09:053
3133499804,67cyclictest0-21swapper/319:32:043
3133499803,37cyclictest1910-21sort00:02:073
3133499797,51cyclictest0-21swapper/323:02:143
3133499785,65cyclictest0-21swapper/322:16:383
3133499783,65cyclictest11834-21fschecks_count19:02:223
3133499783,65cyclictest11834-21fschecks_count19:02:223
3133499776,64cyclictest0-21swapper/323:59:203
3133499776,64cyclictest0-21swapper/323:59:203
3133499774,54cyclictest0-21swapper/319:02:063
3133499773,56cyclictest0-21swapper/321:17:063
219499770,5rtkit-daemon2193-21rtkit-daemon21:16:530
219499770,5rtkit-daemon2193-21rtkit-daemon21:16:530
3133499767,62cyclictest0-21swapper/323:53:543
3133499765,64cyclictest0-21swapper/321:32:333
3133499764,64cyclictest0-21swapper/320:32:143
3133499764,64cyclictest0-21swapper/320:32:143
31334997620,38cyclictest1124-21snmpd23:34:383
3133499762,57cyclictest0-21swapper/321:44:063
3133499756,53cyclictest0-21swapper/323:25:573
3133499754,63cyclictest0-21swapper/322:19:293
3133499754,63cyclictest0-21swapper/321:52:163
3133499753,46cyclictest20505-21kworker/3:020:51:433
3133499746,61cyclictest0-21swapper/321:11:413
3133499745,62cyclictest0-21swapper/322:50:213
3133499745,45cyclictest0-21swapper/322:27:413
3133499744,63cyclictest0-21swapper/321:57:133
3133499744,63cyclictest0-21swapper/321:57:133
3133499744,63cyclictest0-21swapper/321:48:343
3133499743,63cyclictest0-21swapper/322:06:053
3133499743,52cyclictest25052-21ssh23:47:223
3133499743,50cyclictest0-21swapper/321:02:013
219499740,9rtkit-daemon0-21swapper/021:41:070
219499740,21rtkit-daemon0-21swapper/118:38:360
3133499736,49cyclictest0-21swapper/322:58:083
3133499734,53cyclictest30725-21grep23:07:273
3133499733,62cyclictest0-21swapper/321:29:503
219499730,4rtkit-daemon2193-21rtkit-daemon21:36:590
3133499727,48cyclictest0-21swapper/321:24:423
3133499725,60cyclictest0-21swapper/321:14:533
3133499725,60cyclictest0-21swapper/321:14:533
3133499725,59cyclictest0-21swapper/321:37:103
3133499724,40cyclictest0-21swapper/323:27:193
31334997230,34cyclictest32053-21unixbench_singl19:42:353
3133499723,54cyclictest0-21swapper/322:41:353
3133499723,54cyclictest0-21swapper/322:41:353
3133499717,48cyclictest1547-21nscd20:37:273
3133499714,59cyclictest0-21swapper/323:44:593
3133499704,52cyclictest0-21swapper/322:22:253
3133499702,61cyclictest19517-21munin-node20:27:173
31333997029,26cyclictest31154-21munin-node20:47:372
3133199705,57cyclictest0-21swapper/123:56:531
3133199698,53cyclictest0-21swapper/122:46:561
219499690,5rtkit-daemon2193-21rtkit-daemon21:49:440
219499690,5rtkit-daemon2193-21rtkit-daemon21:22:070
3133499686,52cyclictest0-21swapper/319:15:433
3133499684,57cyclictest0-21swapper/318:52:243
3133499683,57cyclictest14403-21sshd20:15:463
31334996827,32cyclictest5800-21unixbench_singl18:47:393
31334996825,37cyclictest2546-21munin-node18:42:263
123482683,24sleep00-21swapper/023:27:490
3133499675,45cyclictest0-21swapper/319:52:213
3133499674,52cyclictest0-21swapper/319:33:553
3133499673,48cyclictest17344-21cpu20:22:143
31334996721,38cyclictest622-21timerandwakeup18:37:403
3133399674,43cyclictest0-21swapper/223:42:272
219499670,4rtkit-daemon2193-21rtkit-daemon21:45:290
219499670,4rtkit-daemon2193-21rtkit-daemon21:31:590
3133499664,55cyclictest0-21swapper/320:07:063
31334996629,30cyclictest1227-21runrttasks19:41:523
31334996625,33cyclictest18928-21df_abs19:17:213
3133399664,27cyclictest0-21swapper/221:01:062
219499660,5rtkit-daemon2193-21rtkit-daemon21:54:060
3133499655,53cyclictest0-21swapper/319:57:263
3133499654,53cyclictest0-21swapper/320:02:363
31333996544,14cyclictest0-21swapper/223:02:262
31333996537,22cyclictest0-21swapper/221:18:052
3133199654,53cyclictest0-21swapper/119:57:241
219499650,7rtkit-daemon0-21swapper/122:03:280
3133499645,43cyclictest0-21swapper/319:47:263
31333996435,7cyclictest30398-21latency_hist23:56:542
219499640,5rtkit-daemon2193-21rtkit-daemon22:20:202
3133499633,27cyclictest22608-21taskset19:23:223
31334996322,33cyclictest15332-21forks20:17:193
31333996341,15cyclictest0-21swapper/223:32:322
3133199634,50cyclictest2348-21timerwakeupswit21:37:301
285672633,12sleep10-21swapper/123:05:531
219499630,5rtkit-daemon2193-21rtkit-daemon18:47:062
42932623,12sleep00-21swapper/020:52:530
31334996223,32cyclictest15118-21timerandwakeup19:07:363
31333996242,13cyclictest0-21swapper/223:57:232
31333996242,13cyclictest0-21swapper/223:57:232
3133199624,51cyclictest0-21swapper/121:05:381
3133199624,51cyclictest0-21swapper/119:37:361
3133199624,50cyclictest0-21swapper/120:42:181
3133199624,50cyclictest0-21swapper/118:52:321
31331996221,33cyclictest25213-21cut22:12:191
219499620,6rtkit-daemon0-21swapper/121:58:510
219499620,6rtkit-daemon0-21swapper/121:58:510
219499620,5rtkit-daemon2193-21rtkit-daemon20:55:462
31333996139,15cyclictest0-21swapper/221:37:302
3133199615,49cyclictest0-21swapper/122:29:111
206942613,12sleep10-21swapper/122:52:311
31333996040,13cyclictest0-21swapper/222:11:592
3133399604,48cyclictest0-21swapper/221:22:232
31333996039,14cyclictest0-21swapper/221:27:182
31333996039,13cyclictest0-21swapper/222:22:302
3133199604,49cyclictest0-21swapper/123:32:211
219499600,4rtkit-daemon6843-21sh20:57:230
31333995940,12cyclictest0-21swapper/221:52:242
3133399594,48cyclictest0-21swapper/221:32:192
31333995939,14cyclictest0-21swapper/223:22:572
31333995939,13cyclictest0-21swapper/221:42:202
219499590,8rtkit-daemon0-21swapper/221:16:001
219499590,8rtkit-daemon0-21swapper/221:16:001
219499590,6rtkit-daemon0-21swapper/118:37:060
3133399584,37cyclictest0-21swapper/223:14:462
31333995838,13cyclictest0-21swapper/221:07:132
31333995838,13cyclictest0-21swapper/221:02:352
31333995837,14cyclictest0-21swapper/221:47:422
31333995821,21cyclictest0-21swapper/223:37:092
3133199584,48cyclictest0-21swapper/121:26:561
3133199584,47cyclictest0-21swapper/119:07:161
3133199584,12cyclictest0-21swapper/120:57:431
3132799585,28cyclictest1227-21runrttasks23:41:450
219499580,4rtkit-daemon2193-21rtkit-daemon22:50:192
3133399574,45cyclictest0-21swapper/220:42:172
31333995738,12cyclictest24961-21taskset22:12:162
31333995737,14cyclictest0-21swapper/222:02:182
31333995736,14cyclictest0-21swapper/220:25:082
31333995718,13cyclictest1227-21runrttasks23:31:552
31333995710,28cyclictest0-21swapper/222:37:122
31333995710,28cyclictest0-21swapper/222:37:122
3133199577,42cyclictest0-21swapper/123:57:151
3133199577,42cyclictest0-21swapper/123:57:151
3133199575,46cyclictest0-21swapper/121:35:321
3133199574,12cyclictest0-21swapper/122:00:321
3133199574,12cyclictest0-21swapper/122:00:321
3132799574,43cyclictest1227-21runrttasks22:56:570
31327995713,12cyclictest1002-21sshd21:09:520
219499570,4rtkit-daemon0-21swapper/123:36:250
31333995637,12cyclictest0-21swapper/223:07:072
3133199565,45cyclictest0-21swapper/122:49:301
3133199563,9cyclictest3292-21cut20:52:211
3133199563,47cyclictest18792-21sed23:37:261
31331995614,36cyclictest12716-21aten_r1power_cu21:07:111
3132799565,27cyclictest0-21swapper/020:07:140
3132799564,26cyclictest0-21swapper/020:27:020
3132799564,13cyclictest0-21swapper/023:44:560
31327995625,25cyclictest0-21swapper/023:17:330
31327995625,25cyclictest0-21swapper/023:17:330
219499560,7rtkit-daemon0-21swapper/321:14:232
219499560,7rtkit-daemon0-21swapper/321:14:232
219499560,7rtkit-daemon0-21swapper/318:48:212
219499560,5rtkit-daemon2193-21rtkit-daemon21:53:361
219499560,5rtkit-daemon2193-21rtkit-daemon21:20:151
3133399558,23cyclictest31321-21cyclictest19:42:142
3133399554,44cyclictest0-21swapper/200:02:122
3133399554,26cyclictest0-21swapper/223:47:112
3133399553,45cyclictest0-21swapper/222:57:292
31333995527,12cyclictest0-21swapper/221:59:272
31333995527,12cyclictest0-21swapper/221:59:272
3133199555,45cyclictest0-21swapper/123:26:511
3133199554,46cyclictest0-21swapper/122:41:061
3133199554,46cyclictest0-21swapper/122:41:061
3133199554,44cyclictest0-21swapper/122:06:411
3133199554,44cyclictest0-21swapper/120:49:561
3133199553,37cyclictest0-21swapper/123:09:391
3132799556,30cyclictest0-21swapper/019:12:220
31327995526,11cyclictest0-21swapper/022:19:270
219499550,5rtkit-daemon2193-21rtkit-daemon21:48:511
111242550,5sleep011127-21sh21:02:350
3133499544,43cyclictest0-21swapper/318:37:073
3133399544,41cyclictest0-21swapper/222:27:312
3133199546,26cyclictest0-21swapper/122:32:161
3133199545,44cyclictest0-21swapper/121:45:291
3133199544,45cyclictest0-21swapper/123:21:131
3133199544,45cyclictest0-21swapper/123:21:131
3133199544,45cyclictest0-21swapper/123:01:421
3132799545,14cyclictest0-21swapper/023:16:240
3132799545,14cyclictest0-21swapper/020:40:310
31327995418,12cyclictest0-21swapper/022:12:280
219499540,5rtkit-daemon2193-21rtkit-daemon21:28:221
3133399534,41cyclictest0-21swapper/219:06:472
3133399534,41cyclictest0-21swapper/219:06:472
3133399533,44cyclictest0-21swapper/222:43:062
31333995317,23cyclictest0-21swapper/220:40:022
3133199535,42cyclictest0-21swapper/122:07:371
31331995324,12cyclictest0-21swapper/123:43:271
3132799538,38cyclictest0-21swapper/022:07:150
3132799536,40cyclictest0-21swapper/021:17:110
3132799536,39cyclictest0-21swapper/022:51:560
3132799534,16cyclictest0-21swapper/020:48:360
3133399525,40cyclictest0-21swapper/222:52:272
3133399525,40cyclictest0-21swapper/219:22:292
3133399524,29cyclictest0-21swapper/219:07:212
3133399524,13cyclictest0-21swapper/222:32:262
31333995233,11cyclictest10968-21crond19:02:052
3133199525,14cyclictest0-21swapper/123:47:101
3133199524,43cyclictest0-21swapper/123:28:431
3133199524,43cyclictest0-21swapper/123:12:431
3133199524,35cyclictest0-21swapper/100:03:581
3133199524,30cyclictest0-21swapper/122:17:271
3132799524,25cyclictest10256-21open_files22:37:230
3132799524,25cyclictest10256-21open_files22:37:230
31327995232,12cyclictest14095-21unixbench_singl22:42:320
31327995221,10cyclictest27952-21ssh23:03:410
227312523,43sleep00-21swapper/019:24:570
200922522,10sleep20-21swapper/220:27:192
3133399514,39cyclictest0-21swapper/218:37:402
3133399514,29cyclictest0-21swapper/220:17:292
31333995135,8cyclictest10989-21iostat_ios20:07:242
31333995117,14cyclictest0-21swapper/219:42:032
3133199515,28cyclictest0-21swapper/122:22:391
3133199514,28cyclictest0-21swapper/120:32:271
3133199514,28cyclictest0-21swapper/120:32:271
3133199514,28cyclictest0-21swapper/120:07:241
3133199514,28cyclictest0-21swapper/119:27:231
3133199514,27cyclictest0-21swapper/118:57:291
31331995120,12cyclictest0-21swapper/120:12:361
3132799515,39cyclictest0-21swapper/022:57:320
3132799515,39cyclictest0-21swapper/020:42:180
3132799515,14cyclictest0-21swapper/023:56:260
3132799515,13cyclictest0-21swapper/022:28:370
3132799514,27cyclictest0-21swapper/023:47:130
3132799514,27cyclictest0-21swapper/019:12:060
3132799514,13cyclictest0-21swapper/023:22:120
31327995126,11cyclictest0-21swapper/022:22:220
94342503,9sleep00-21swapper/020:03:140
61592503,9sleep00-21swapper/018:51:390
3133399505,25cyclictest0-21swapper/219:57:152
3133399504,29cyclictest0-21swapper/218:52:222
31333995029,14cyclictest0-21swapper/219:52:222
31333995028,15cyclictest0-21swapper/220:36:452
31333995028,15cyclictest0-21swapper/220:36:452
3133199504,37cyclictest0-21swapper/119:02:231
3133199504,37cyclictest0-21swapper/119:02:231
3133199504,28cyclictest0-21swapper/120:27:361
3133199504,27cyclictest0-21swapper/118:47:401
3132799508,12cyclictest0-21swapper/000:04:240
3132799505,27cyclictest0-21swapper/019:32:030
3132799505,13cyclictest0-21swapper/019:38:560
3132799504,28cyclictest0-21swapper/019:52:130
3132799504,27cyclictest0-21swapper/020:17:160
3132799503,37cyclictest1761-21Xorg22:35:590
31327995020,13cyclictest0-21swapper/020:27:170
297352503,9sleep029888-21ssh23:07:130
274202503,41sleep00-21swapper/019:33:400
3133399495,27cyclictest0-21swapper/219:13:522
3133399494,38cyclictest0-21swapper/219:27:182
3133399494,28cyclictest0-21swapper/220:12:242
3133399494,28cyclictest0-21swapper/219:33:552
3133199494,29cyclictest0-21swapper/119:52:211
3133199494,27cyclictest0-21swapper/120:19:431
3133199494,27cyclictest0-21swapper/119:32:471
3133199494,26cyclictest0-21swapper/120:37:071
3133199493,9cyclictest0-21swapper/120:02:201
3132799494,34cyclictest19246-21gltestperf19:17:240
3132799494,27cyclictest0-21swapper/020:32:330
3132799494,27cyclictest0-21swapper/020:32:330
3132799494,27cyclictest0-21swapper/018:52:160
31327994918,13cyclictest0-21swapper/023:57:060
31327994918,13cyclictest0-21swapper/023:57:060
23762493,40sleep00-21swapper/019:49:400
178832492,9sleep10-21swapper/119:14:021
142052493,9sleep00-21swapper/020:13:140
37532482,9sleep10-21swapper/118:46:321
3133399484,37cyclictest0-21swapper/220:02:182
3133399484,36cyclictest0-21swapper/219:47:162
3133199484,35cyclictest0-21swapper/119:17:171
3133199484,28cyclictest0-21swapper/118:37:191
3133199484,25cyclictest0-21swapper/119:23:541
31331994820,13cyclictest0-21swapper/119:42:211
3132799488,25cyclictest0-21swapper/019:57:150
3132799485,26cyclictest0-21swapper/019:42:140
3132799484,27cyclictest0-21swapper/018:59:440
203392482,9sleep20-21swapper/219:19:512
130852483,9sleep00-21swapper/019:03:410
130852483,9sleep00-21swapper/019:03:410
3133199474,26cyclictest0-21swapper/119:49:441
3133199454,36cyclictest31321-21cyclictest18:37:061
3133199454,35cyclictest0-21swapper/120:27:011
312982418,21sleep20-21swapper/218:37:062
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional