You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 00:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Sat Aug 29, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
702621170,5sleep27027-21sed08:13:162
2194991110,8rtkit-daemon0-21swapper/308:03:103
26611991014,89cyclictest0-21swapper/009:43:250
26611991005,88cyclictest0-21swapper/008:28:160
26611991004,89cyclictest0-21swapper/008:45:240
26611991004,27cyclictest0-21swapper/009:18:230
26611991003,74cyclictest10260-21cpuspeed_turbos09:08:110
2661199987,69cyclictest0-21swapper/008:26:380
2661199984,76cyclictest0-21swapper/009:03:100
219499980,5rtkit-daemon12-21rcu_preempt06:43:201
219499980,5rtkit-daemon12-21rcu_preempt06:43:201
2661199964,75cyclictest0-21swapper/008:04:030
26611999620,11cyclictest0-21swapper/010:53:200
184472960,6sleep018444-21tune2fs10:58:110
2661599954,79cyclictest20562-21runrttasks07:44:523
2661199944,74cyclictest0-21swapper/010:50:100
2661199944,74cyclictest0-21swapper/010:50:100
2661199944,72cyclictest0-21swapper/011:08:230
2661199944,27cyclictest0-21swapper/009:33:300
2661199944,27cyclictest0-21swapper/009:33:300
2661599934,68cyclictest0-21swapper/310:08:103
2661599934,68cyclictest0-21swapper/310:08:103
2661199933,70cyclictest0-21swapper/010:17:340
26611999321,12cyclictest0-21swapper/007:45:540
2661599924,78cyclictest0-21swapper/307:18:143
2661599924,68cyclictest0-21swapper/308:32:453
2661599924,65cyclictest0-21swapper/305:58:033
26615999222,47cyclictest10696-21aten_r1power_po09:58:053
2661199914,80cyclictest0-21swapper/010:25:030
2661199914,80cyclictest0-21swapper/010:00:070
2661199914,79cyclictest0-21swapper/007:08:160
2661199914,29cyclictest0-21swapper/005:43:040
2661599905,13cyclictest10827-21sendmail_mailqu08:18:263
2661599904,78cyclictest0-21swapper/308:23:353
2661599904,76cyclictest0-21swapper/308:00:533
2661599904,23cyclictest0-21swapper/308:17:483
2661599904,20cyclictest0-21swapper/308:58:213
26615999025,57cyclictest27909-21grep10:23:113
26615999018,10cyclictest0-21swapper/310:42:433
26615999017,10cyclictest0-21swapper/310:31:363
2661199905,78cyclictest0-21swapper/008:12:250
2661199905,78cyclictest0-21swapper/008:12:250
2661199904,78cyclictest0-21swapper/008:14:110
2661199904,26cyclictest1227-21runrttasks07:36:280
2661199904,13cyclictest30644-21runrttasks09:38:130
2661199903,70cyclictest0-21swapper/008:22:490
26611999028,48cyclictest0-21swapper/009:17:280
2661599896,61cyclictest8360-21irqstats09:53:163
2661599894,64cyclictest0-21swapper/307:53:243
2661599894,63cyclictest0-21swapper/307:33:123
2661599894,62cyclictest0-21swapper/310:44:053
26615998919,12cyclictest0-21swapper/308:49:153
26615998919,12cyclictest0-21swapper/308:49:153
2661199894,78cyclictest0-21swapper/010:18:110
2661199894,77cyclictest0-21swapper/007:59:120
2661199894,76cyclictest0-21swapper/010:10:270
2661199894,76cyclictest0-21swapper/010:10:270
2661199894,28cyclictest0-21swapper/008:58:160
2661199894,25cyclictest0-21swapper/010:38:030
2661199894,12cyclictest0-21swapper/007:53:150
2661599884,74cyclictest22058-21timerandwakeup10:13:253
2661599884,62cyclictest0-21swapper/305:58:363
2661599884,62cyclictest0-21swapper/305:58:363
2661599884,61cyclictest0-21swapper/309:08:223
2661599884,22cyclictest0-21swapper/310:32:583
2661199884,78cyclictest0-21swapper/007:18:330
2661199884,77cyclictest0-21swapper/009:23:250
2661199884,29cyclictest0-21swapper/008:37:410
2661199884,28cyclictest0-21swapper/009:53:180
26611998830,50cyclictest23922-21wc08:38:260
26611998811,12cyclictest0-21swapper/008:48:260
26611998811,12cyclictest0-21swapper/008:48:260
2661599875,26cyclictest0-21swapper/309:51:473
2661599874,73cyclictest0-21swapper/307:38:253
2661599874,24cyclictest0-21swapper/310:54:263
2661599874,24cyclictest0-21swapper/309:21:273
2661599874,21cyclictest0-21swapper/308:45:223
2661199874,74cyclictest0-21swapper/008:53:310
26611998716,10cyclictest0-21swapper/010:02:550
26611998714,12cyclictest0-21swapper/007:48:370
2661599864,75cyclictest0-21swapper/309:03:133
2661599864,74cyclictest0-21swapper/310:20:423
2661599864,74cyclictest0-21swapper/308:53:593
2661599864,72cyclictest0-21swapper/309:34:043
2661599864,72cyclictest0-21swapper/309:34:043
2661599864,23cyclictest3522-21df_inode06:03:183
2661599864,23cyclictest0-21swapper/310:50:343
2661599864,23cyclictest0-21swapper/310:50:343
2661599863,25cyclictest0-21swapper/310:05:113
26615998623,56cyclictest1519-21gltestperf09:43:153
2661199864,75cyclictest0-21swapper/009:27:560
2661199864,30cyclictest0-21swapper/011:05:560
2661199864,26cyclictest0-21swapper/010:35:420
2661199864,26cyclictest0-21swapper/007:32:050
2661199863,15cyclictest0-21swapper/009:49:060
26611998613,10cyclictest107550irq/46-eth007:13:120
2661599854,74cyclictest0-21swapper/309:28:283
2661599854,74cyclictest0-21swapper/308:40:373
2661599854,73cyclictest0-21swapper/311:08:073
2661599854,73cyclictest0-21swapper/308:33:023
2661599854,24cyclictest0-21swapper/309:27:393
2661599854,23cyclictest0-21swapper/311:06:283
26615998524,53cyclictest10989-21gltestperf06:18:213
2661199854,74cyclictest0-21swapper/006:03:140
2661199854,13cyclictest0-21swapper/006:28:140
2661199853,21cyclictest18203-21diskmemload10:44:260
2661599846,69cyclictest0-21swapper/306:12:413
2661599844,73cyclictest0-21swapper/309:40:403
2661599844,70cyclictest0-21swapper/306:33:013
2661599844,23cyclictest0-21swapper/308:08:283
2661599844,23cyclictest0-21swapper/308:08:283
2661599844,23cyclictest0-21swapper/307:52:143
26615998415,12cyclictest0-21swapper/309:16:283
2661199845,24cyclictest0-21swapper/010:31:140
2661199844,72cyclictest0-21swapper/006:18:320
26611998433,44cyclictest16410-21tr07:38:130
2661599835,22cyclictest0-21swapper/311:01:263
26615998325,50cyclictest26213-21unixbench_singl06:48:333
2661199834,72cyclictest0-21swapper/005:48:100
2661199834,13cyclictest0-21swapper/006:43:330
2661199834,13cyclictest0-21swapper/006:43:330
26615998228,47cyclictest17584-21cpuspeed_turbos06:33:163
2661199824,32cyclictest0-21swapper/006:13:280
2661199824,24cyclictest0-21swapper/005:53:160
26611998219,18cyclictest1227-21runrttasks07:04:560
2661599814,23cyclictest0-21swapper/306:13:263
2661599804,21cyclictest0-21swapper/307:03:133
2661199805,11cyclictest0-21swapper/007:23:130
2661199805,11cyclictest0-21swapper/007:23:130
2661199803,19cyclictest1227-21runrttasks06:48:110
26611998021,9cyclictest5690-21grep06:08:160
2661599794,67cyclictest0-21swapper/306:47:553
2661599794,67cyclictest0-21swapper/306:47:553
2661599794,21cyclictest0-21swapper/306:53:133
2661599794,15cyclictest0-21swapper/306:23:343
2661599793,22cyclictest0-21swapper/307:13:133
2661199794,68cyclictest0-21swapper/006:38:220
2661199794,14cyclictest0-21swapper/006:55:530
26611997924,47cyclictest0-21swapper/006:33:240
26611997910,9cyclictest107550irq/46-eth005:43:250
26615997825,45cyclictest1554-21nscd07:12:593
26615997718,9cyclictest13026-21unixbench_singl07:28:323
2661199774,14cyclictest0-21swapper/005:58:200
2661199774,14cyclictest0-21swapper/005:58:200
26611997711,12cyclictest0-21swapper/006:58:180
219499770,4rtkit-daemon2193-21rtkit-daemon10:48:031
219499770,4rtkit-daemon2193-21rtkit-daemon10:48:031
2661599764,23cyclictest0-21swapper/305:48:393
26615997620,10cyclictest19968-21cpuspeed_turbos06:38:153
26611997621,9cyclictest144232sleep006:25:080
2661599753,25cyclictest0-21swapper/307:26:463
2661599753,25cyclictest0-21swapper/307:26:463
219499740,5rtkit-daemon2193-21rtkit-daemon10:02:051
2661599735,12cyclictest1227-21runrttasks05:43:343
219499730,5rtkit-daemon2193-21rtkit-daemon10:14:201
219499730,4rtkit-daemon2193-21rtkit-daemon08:33:311
26615997218,9cyclictest29281-21aten2.4-expect06:58:133
219499710,4rtkit-daemon2193-21rtkit-daemon08:23:161
219499700,6rtkit-daemon26958-21tail05:43:151
26614996718,34cyclictest2824-21ssh10:33:222
219499670,6rtkit-daemon0-21swapper/107:40:332
219499670,5rtkit-daemon2193-21rtkit-daemon09:45:211
219499670,5rtkit-daemon2193-21rtkit-daemon08:19:321
219499670,4rtkit-daemon2193-21rtkit-daemon10:31:561
219499670,4rtkit-daemon2193-21rtkit-daemon08:32:461
219499660,5rtkit-daemon24661-21runrttasks06:48:131
219499650,6rtkit-daemon674-21open_files08:03:252
219499650,5rtkit-daemon2193-21rtkit-daemon09:21:591
219499650,4rtkit-daemon2193-21rtkit-daemon10:19:041
219499650,4rtkit-daemon2193-21rtkit-daemon09:35:591
219499650,4rtkit-daemon2193-21rtkit-daemon09:35:591
219499650,4rtkit-daemon2193-21rtkit-daemon09:02:371
219499640,6rtkit-daemon0-21swapper/310:40:182
2661499637,31cyclictest0-21swapper/208:01:342
26614996310,46cyclictest182031diskmemload11:01:522
26613996320,24cyclictest20555-21seq09:23:131
219499630,6rtkit-daemon0-21swapper/310:43:182
219499630,5rtkit-daemon29269-21yum-updatesd-he10:25:041
2661499628,46cyclictest0-21swapper/209:50:132
2661499628,33cyclictest0-21swapper/210:28:092
219499620,7rtkit-daemon0-21swapper/109:08:151
219499620,6rtkit-daemon0-21swapper/307:54:032
219499620,4rtkit-daemon18397-21diskstats10:58:101
219499620,3rtkit-daemon0-21swapper/110:03:201
26614996111,42cyclictest0-21swapper/209:18:172
219499610,7rtkit-daemon0-21swapper/108:46:451
219499610,6rtkit-daemon0-21swapper/307:51:032
219499610,4rtkit-daemon25090-21fschecks_time11:08:101
2661499609,44cyclictest182031diskmemload10:07:392
2661499605,47cyclictest0-21swapper/206:23:012
2661499604,48cyclictest0-21swapper/209:07:422
26614996011,43cyclictest0-21swapper/208:18:292
219499600,4rtkit-daemon7620-21smartctl09:03:151
219499600,4rtkit-daemon2220-21udisks-daemon09:51:501
219499600,13rtkit-daemon2193-21rtkit-daemon08:08:321
219499600,13rtkit-daemon2193-21rtkit-daemon08:08:321
326492593,13sleep10-21swapper/109:42:301
2661499597,45cyclictest0-21swapper/208:58:312
26614995911,41cyclictest12158-21wc10:48:122
26614995911,41cyclictest12158-21wc10:48:122
2661399594,27cyclictest0-21swapper/107:58:171
2661499589,32cyclictest0-21swapper/211:09:412
2661499588,40cyclictest0-21swapper/209:37:582
2661499588,33cyclictest0-21swapper/208:25:162
2661499587,44cyclictest0-21swapper/210:56:492
2661499583,47cyclictest0-21swapper/210:13:102
26614995816,35cyclictest0-21swapper/209:55:562
26614995811,40cyclictest1972-21ntpq09:43:232
26613995841,10cyclictest23407-21gltestperf08:38:181
26613995813,12cyclictest0-21swapper/110:40:081
219499580,5rtkit-daemon2193-21rtkit-daemon10:33:111
2661499578,42cyclictest0-21swapper/208:52:222
2661499578,42cyclictest0-21swapper/208:52:222
2661499578,33cyclictest0-21swapper/208:43:432
2661499577,44cyclictest0-21swapper/209:27:452
2661499574,45cyclictest0-21swapper/208:38:192
26614995713,29cyclictest19820-21ps07:43:272
26614995712,39cyclictest0-21swapper/208:34:182
26614995711,39cyclictest18465-21ssh08:31:042
26613995737,11cyclictest10584-21unixbench_multi07:23:341
26613995737,11cyclictest10584-21unixbench_multi07:23:341
2661499569,40cyclictest0-21swapper/206:38:152
2661499568,41cyclictest0-21swapper/210:10:412
2661499568,41cyclictest0-21swapper/210:10:412
2661499568,34cyclictest0-21swapper/209:11:562
2661499567,43cyclictest0-21swapper/206:58:192
2661499567,42cyclictest0-21swapper/207:33:172
2661499564,44cyclictest0-21swapper/211:03:132
2661499563,45cyclictest0-21swapper/208:11:032
2661499563,45cyclictest0-21swapper/208:11:032
2661499561,48cyclictest0-21swapper/209:33:482
2661499561,48cyclictest0-21swapper/209:33:482
214832563,46sleep10-21swapper/106:38:391
2661499558,41cyclictest25991-21chrt10:20:002
2661499558,40cyclictest0-21swapper/206:33:162
2661499557,41cyclictest0-21swapper/207:03:472
26614995538,10cyclictest9801-21wc07:23:212
26614995538,10cyclictest9801-21wc07:23:212
2661499552,40cyclictest0-21swapper/208:53:002
26614995514,35cyclictest14154-21gltestperf09:13:142
26614995511,37cyclictest11102-21df_abs09:58:082
26614995510,38cyclictest28048-21sshd06:53:262
2661399559,27cyclictest0-21swapper/108:48:151
2661399559,27cyclictest0-21swapper/108:48:151
2661399555,39cyclictest0-21swapper/107:43:331
26613995520,29cyclictest0-21swapper/108:06:461
264002553,14sleep10-21swapper/107:53:251
171252555,44sleep10-21swapper/110:08:021
171252555,44sleep10-21swapper/110:08:021
2661499549,39cyclictest0-21swapper/207:12:592
2661499549,38cyclictest0-21swapper/206:28:302
2661499548,38cyclictest0-21swapper/209:27:552
2661499545,43cyclictest0-21swapper/205:53:162
2661499543,44cyclictest0-21swapper/210:25:052
2661399546,38cyclictest0-21swapper/107:32:591
2661499537,40cyclictest0-21swapper/206:48:192
2661499537,29cyclictest0-21swapper/206:05:442
2661499534,41cyclictest0-21swapper/205:58:222
2661499534,41cyclictest0-21swapper/205:58:222
26614995310,36cyclictest0-21swapper/205:43:352
2661399534,31cyclictest0-21swapper/108:13:071
2661399534,30cyclictest0-21swapper/107:12:591
2661399534,29cyclictest0-21swapper/109:53:061
2661399533,34cyclictest0-21swapper/111:05:561
26613995311,24cyclictest8651-21awk07:22:591
9872523,10sleep1992-21diskstats05:58:201
9872523,10sleep1992-21diskstats05:58:201
2661499524,30cyclictest0-21swapper/206:43:202
2661499524,30cyclictest0-21swapper/206:43:202
2661499522,43cyclictest0-21swapper/206:28:012
2661399525,29cyclictest0-21swapper/109:13:161
2661399525,28cyclictest0-21swapper/106:33:131
2661399524,14cyclictest0-21swapper/110:53:211
26613995234,11cyclictest23500-21tr09:28:091
2661399514,22cyclictest31698-21aten2.4-expect07:03:121
2661399513,28cyclictest17683-21ls07:38:311
26613995120,12cyclictest0-21swapper/107:50:041
120222513,13sleep10-21swapper/106:20:011
2661599504,38cyclictest0-21swapper/305:43:033
2661499504,40cyclictest0-21swapper/206:08:152
26614995013,31cyclictest0-21swapper/207:18:192
2661399504,28cyclictest0-21swapper/108:53:211
2661399504,28cyclictest0-21swapper/106:58:241
2661399504,28cyclictest0-21swapper/106:53:281
26613995021,12cyclictest0-21swapper/110:43:111
26613995011,21cyclictest0-21swapper/106:03:131
169362503,12sleep10-21swapper/106:31:501
2661399494,28cyclictest0-21swapper/107:33:291
2661399494,27cyclictest0-21swapper/106:08:311
26613994919,12cyclictest0-21swapper/106:18:021
26614994827,15cyclictest0-21swapper/207:13:162
2661399484,27cyclictest0-21swapper/105:48:151
2661499477,34cyclictest0-21swapper/207:32:592
26614994716,24cyclictest0-21swapper/206:13:262
2661399474,27cyclictest0-21swapper/107:16:251
26613994725,14cyclictest0-21swapper/105:53:211
2661499464,25cyclictest0-21swapper/205:50:422
248162464,33sleep10-21swapper/105:38:181
143402463,36sleep10-21swapper/106:24:041
2661499424,32cyclictest0-21swapper/205:43:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional