You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 06:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Wed Mar 25, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
70152860,3sleep229-21ksoftirqd/221:27:382
248599820,5rtkit-daemon0-21swapper/320:14:443
5212655,49sleep1672-21timerwakeupswit17:29:491
248599650,4rtkit-daemon2484-21rtkit-daemon23:02:300
1273996444,13cyclictest1274-21systemd-cgroups17:34:202
126899644,53cyclictest0-21swapper/119:35:381
297122633,10sleep00-21swapper/019:38:560
126499633,9cyclictest0-21swapper/020:49:370
126499625,35cyclictest0-21swapper/019:59:180
126499623,39cyclictest0-21swapper/022:31:250
126499623,39cyclictest0-21swapper/022:31:250
126499623,39cyclictest0-21swapper/022:07:540
185012613,12sleep00-21swapper/020:55:280
126899613,52cyclictest0-21swapper/122:49:491
127599609,44cyclictest15305-21gltestperf21:39:303
126899604,13cyclictest0-21swapper/120:29:341
126899604,13cyclictest0-21swapper/120:29:341
256412594,48sleep00-21swapper/021:06:560
127599596,11cyclictest0-21swapper/320:54:313
127399594,47cyclictest0-21swapper/219:31:492
248599580,4rtkit-daemon2484-21rtkit-daemon22:50:450
127599585,45cyclictest0-21swapper/318:04:413
127599583,46cyclictest0-21swapper/321:53:173
127599583,46cyclictest0-21swapper/321:53:173
1275995827,12cyclictest31911-21unixbench_singl19:39:483
126899583,39cyclictest0-21swapper/120:24:151
126499587,28cyclictest1419-21runrttasks20:46:490
126499585,27cyclictest0-21swapper/021:15:010
201972573,9sleep00-21swapper/021:46:470
127599576,43cyclictest13731-21awk22:24:333
1275995740,10cyclictest7222-21gltestperf20:39:323
127599574,14cyclictest0-21swapper/320:51:263
1273995720,29cyclictest25914-21processes21:54:392
126899574,11cyclictest0-21swapper/121:10:191
126899574,11cyclictest0-21swapper/121:10:191
126499575,30cyclictest0-21swapper/020:32:250
126499575,30cyclictest0-21swapper/020:32:250
126499574,25cyclictest26434-21diskmemload22:44:090
1264995727,12cyclictest0-21swapper/020:24:250
1264995724,15cyclictest0-21swapper/018:09:290
118732572,9sleep10-21swapper/122:23:091
248599560,5rtkit-daemon2484-21rtkit-daemon20:59:271
127599565,43cyclictest0-21swapper/322:39:323
1275995637,12cyclictest29257-21proc_pri21:59:403
127599563,27cyclictest0-21swapper/321:09:123
1273995616,27cyclictest0-21swapper/220:04:252
126899564,12cyclictest0-21swapper/120:34:321
126899563,47cyclictest0-21swapper/121:35:561
126899563,45cyclictest17617-21unixbench_multi22:29:421
126899563,45cyclictest17617-21unixbench_multi22:29:421
126899563,11cyclictest0-21swapper/120:47:061
126499565,36cyclictest0-21swapper/022:26:520
126499565,17cyclictest0-21swapper/020:59:290
126499564,29cyclictest0-21swapper/020:04:430
1264995624,13cyclictest0-21swapper/021:19:440
1264995623,14cyclictest0-21swapper/021:59:240
1264995620,20cyclictest0-21swapper/020:35:540
56362552,9sleep20-21swapper/220:37:402
191742553,12sleep30-21swapper/319:18:163
127599555,43cyclictest0-21swapper/322:18:163
1275995538,10cyclictest23436-21tr18:19:323
1275995537,12cyclictest32047-21sed18:34:543
127599552,40cyclictest0-21swapper/322:31:113
127599552,40cyclictest0-21swapper/322:31:113
127399554,45cyclictest0-21swapper/221:15:062
1273995534,14cyclictest0-21swapper/221:59:342
1273995527,13cyclictest0-21swapper/219:49:372
1273995527,13cyclictest0-21swapper/219:49:372
1273995523,25cyclictest0-21swapper/219:14:442
126899554,12cyclictest0-21swapper/123:01:021
126899554,12cyclictest0-21swapper/122:06:281
126899554,12cyclictest0-21swapper/121:59:261
126899553,12cyclictest0-21swapper/122:46:071
126899553,11cyclictest0-21swapper/122:43:281
126499554,32cyclictest0-21swapper/020:39:410
126499554,29cyclictest29625-21taskset21:14:120
126499554,29cyclictest29625-21taskset21:14:120
126499554,28cyclictest0-21swapper/019:06:270
126499553,24cyclictest0-21swapper/022:44:300
78452543,7sleep17891-21switchtime20:39:441
50372542,10sleep20-21swapper/217:39:442
248599540,5rtkit-daemon2484-21rtkit-daemon21:39:261
248599540,5rtkit-daemon2484-21rtkit-daemon21:24:340
127599548,38cyclictest6805-21runrttasks23:03:583
127599546,40cyclictest0-21swapper/320:12:393
127599544,44cyclictest0-21swapper/322:45:303
1275995434,13cyclictest0-21swapper/321:24:393
1275995430,16cyclictest0-21swapper/321:49:113
1275995411,36cyclictest0-21swapper/319:36:483
1275995410,11cyclictest3829-21gltestperf20:34:343
127399548,19cyclictest27538-21if_eth021:09:332
127399548,19cyclictest27538-21if_eth021:09:332
127399545,23cyclictest0-21swapper/222:49:222
127399544,43cyclictest0-21swapper/222:42:292
127399544,43cyclictest0-21swapper/220:29:452
127399544,43cyclictest0-21swapper/220:29:452
127399544,36cyclictest0-21swapper/219:46:582
127399544,30cyclictest0-21swapper/217:44:232
127399544,30cyclictest0-21swapper/217:44:232
127399544,29cyclictest0-21swapper/221:19:252
1273995433,14cyclictest0-21swapper/222:24:232
1273995432,15cyclictest0-21swapper/221:39:292
127399543,44cyclictest0-21swapper/219:59:312
126899544,12cyclictest0-21swapper/120:02:041
126899544,12cyclictest0-21swapper/119:47:581
1268995437,10cyclictest2621-21cut22:09:231
126899543,11cyclictest0-21swapper/122:34:481
126899543,11cyclictest0-21swapper/122:34:481
126899543,11cyclictest0-21swapper/120:53:241
126499545,28cyclictest6030-21tr22:14:230
126499545,26cyclictest15902-21ssh21:39:400
126499544,30cyclictest0-21swapper/018:54:410
1264995423,12cyclictest0-21swapper/019:54:310
1264995417,23cyclictest0-21swapper/019:43:000
1264995411,23cyclictest18763-21grep20:09:290
96812532,44sleep10-21swapper/118:59:071
275942533,9sleep00-21swapper/020:21:540
212842534,13sleep30-21swapper/318:14:353
127599539,36cyclictest3203-21gltestperf22:09:293
127599538,17cyclictest26308-21unixbench_singl21:54:443
127599537,39cyclictest0-21swapper/321:30:293
127599537,27cyclictest0-21swapper/322:54:303
127599534,40cyclictest0-21swapper/319:54:333
127599534,25cyclictest16910-21ssh20:04:493
127599534,24cyclictest0-21swapper/319:53:563
127599534,24cyclictest0-21swapper/319:53:563
1275995336,10cyclictest24610-21cpuspeed_turbos19:29:323
127599533,23cyclictest9826-21ssh20:44:243
127599532,37cyclictest0-21swapper/319:48:143
127399535,39cyclictest0-21swapper/221:44:292
127399534,43cyclictest0-21swapper/222:59:232
127399533,35cyclictest26538-21df_inode22:44:252
126899535,12cyclictest0-21swapper/120:10:071
126499536,26cyclictest0-21swapper/021:35:140
126499535,29cyclictest0-21swapper/019:09:370
126499535,29cyclictest0-21swapper/019:09:370
126499534,29cyclictest0-21swapper/018:44:440
126499534,29cyclictest0-21swapper/018:14:500
126499534,13cyclictest0-21swapper/022:11:110
126499533,25cyclictest0-21swapper/018:39:270
1264995326,13cyclictest0-21swapper/021:31:450
1264995324,10cyclictest21911-21ssh20:14:260
1264995320,14cyclictest0-21swapper/022:20:290
1264995320,14cyclictest0-21swapper/017:51:140
1264995315,22cyclictest24585-21aten2.4-expect21:54:220
83502522,42sleep10-21swapper/117:46:441
83502522,42sleep10-21swapper/117:46:441
35742523,9sleep00-21swapper/017:36:440
207472523,9sleep00-21swapper/019:19:420
20022523,41sleep20-21swapper/218:39:502
170872522,9sleep10-21swapper/120:05:261
127599525,39cyclictest3456-21fschecks_count18:44:363
127599525,13cyclictest0-21swapper/319:59:333
127599524,40cyclictest0-21swapper/321:18:073
127599524,39cyclictest12774-21ls21:34:433
1275995233,11cyclictest10268-21tr18:59:323
127599521,43cyclictest0-21swapper/318:32:213
127399524,42cyclictest0-21swapper/220:55:172
127399524,40cyclictest0-21swapper/221:34:272
127399524,21cyclictest0-21swapper/221:49:552
127399524,21cyclictest0-21swapper/221:49:552
127399524,13cyclictest0-21swapper/222:54:252
1273995226,12cyclictest0-21swapper/220:14:372
126899524,29cyclictest0-21swapper/119:54:291
126899524,12cyclictest0-21swapper/121:24:491
126499526,25cyclictest0-21swapper/021:50:000
126499526,25cyclictest0-21swapper/021:50:000
126499525,29cyclictest0-21swapper/022:54:350
126499525,28cyclictest0-21swapper/018:19:420
126499525,27cyclictest0-21swapper/017:54:420
126499524,28cyclictest0-21swapper/019:44:300
126499524,28cyclictest0-21swapper/019:14:500
126499524,27cyclictest0-21swapper/019:49:510
126499524,27cyclictest0-21swapper/019:49:510
1264995220,13cyclictest0-21swapper/019:29:290
1264995219,14cyclictest0-21swapper/022:34:580
1264995219,14cyclictest0-21swapper/022:34:580
90602514,40sleep20-21swapper/221:29:402
237362513,9sleep00-21swapper/019:25:180
190522512,9sleep10-21swapper/119:16:411
127599519,34cyclictest32540-21fschecks_count20:29:333
127599519,34cyclictest32540-21fschecks_count20:29:333
127599514,39cyclictest0-21swapper/320:24:263
127599514,28cyclictest0-21swapper/322:34:273
127599514,28cyclictest0-21swapper/322:34:273
1275995129,13cyclictest0-21swapper/322:04:303
127399514,29cyclictest0-21swapper/219:54:522
127399514,26cyclictest0-21swapper/220:43:202
127399514,13cyclictest0-21swapper/220:46:162
127399514,12cyclictest0-21swapper/220:09:402
1273995137,9cyclictest0-21swapper/219:38:092
1273995131,13cyclictest0-21swapper/219:39:322
1273995130,14cyclictest0-21swapper/221:05:582
127399513,31cyclictest0-21swapper/219:14:172
127399513,31cyclictest0-21swapper/219:14:172
127399513,30cyclictest0-21swapper/220:54:132
1273995126,11cyclictest0-21swapper/220:26:542
127399512,43cyclictest0-21swapper/222:14:392
126899514,25cyclictest0-21swapper/122:15:341
126899513,29cyclictest0-21swapper/119:39:561
126499514,28cyclictest0-21swapper/017:39:420
126499514,27cyclictest0-21swapper/018:29:420
126499514,26cyclictest0-21swapper/018:36:210
1264995118,14cyclictest0-21swapper/018:24:530
1264995118,14cyclictest0-21swapper/018:24:530
1264995118,14cyclictest0-21swapper/018:04:470
108712512,9sleep10-21swapper/117:53:331
248599500,5rtkit-daemon2484-21rtkit-daemon21:31:331
127599505,28cyclictest0-21swapper/320:19:313
127599504,38cyclictest0-21swapper/322:19:303
127599504,29cyclictest0-21swapper/321:11:213
127599504,29cyclictest0-21swapper/321:11:213
127599504,28cyclictest0-21swapper/320:59:283
127599504,27cyclictest0-21swapper/321:19:303
127599504,27cyclictest0-21swapper/319:24:483
1275995010,22cyclictest16884-21awk19:14:173
1275995010,22cyclictest16884-21awk19:14:173
127399505,38cyclictest0-21swapper/222:34:392
127399505,38cyclictest0-21swapper/222:34:392
127399504,28cyclictest0-21swapper/218:14:462
127399504,27cyclictest0-21swapper/222:19:262
127399503,13cyclictest0-21swapper/218:24:182
1273995024,12cyclictest0-21swapper/222:10:192
127399502,43cyclictest0-21swapper/222:08:392
127399502,42cyclictest0-21swapper/220:19:272
1273995018,19cyclictest0-21swapper/222:30:202
1273995018,19cyclictest0-21swapper/222:30:202
1268995034,10cyclictest16283-21cpuspeed_turbos18:04:331
126899503,40cyclictest0-21swapper/121:14:341
126899503,28cyclictest0-21swapper/121:56:121
126899503,28cyclictest0-21swapper/120:18:111
126499505,26cyclictest0-21swapper/017:47:510
126499505,26cyclictest0-21swapper/017:47:510
126499504,27cyclictest0-21swapper/018:49:380
1264995013,14cyclictest0-21swapper/018:59:410
116252503,40sleep111721-21users18:59:521
127599494,37cyclictest0-21swapper/317:59:353
127599494,27cyclictest0-21swapper/319:04:433
127599494,27cyclictest0-21swapper/318:09:483
1275994930,13cyclictest0-21swapper/318:44:183
1275994910,32cyclictest0-21swapper/322:51:033
127399495,27cyclictest0-21swapper/219:24:412
127399494,28cyclictest0-21swapper/218:49:532
127399494,28cyclictest0-21swapper/217:54:412
127399494,27cyclictest0-21swapper/218:54:462
127399494,27cyclictest0-21swapper/218:24:482
127399494,27cyclictest0-21swapper/218:24:482
127399494,27cyclictest0-21swapper/218:09:462
127399494,27cyclictest0-21swapper/217:36:122
127399494,26cyclictest0-21swapper/220:59:142
126899497,26cyclictest0-21swapper/121:09:071
126899494,28cyclictest0-21swapper/122:54:301
126899494,28cyclictest0-21swapper/119:49:471
126899494,28cyclictest0-21swapper/119:49:471
126899493,28cyclictest0-21swapper/121:44:391
126899493,27cyclictest0-21swapper/119:08:391
126499494,27cyclictest0-21swapper/017:59:510
61782482,39sleep10-21swapper/118:49:401
25262482,9sleep10-21swapper/118:44:161
132502482,9sleep30-21swapper/317:58:273
127399484,27cyclictest0-21swapper/218:34:352
127399484,27cyclictest0-21swapper/218:29:402
1273994827,14cyclictest0-21swapper/218:04:432
126899484,27cyclictest0-21swapper/121:19:311
126899484,27cyclictest0-21swapper/119:09:311
126899484,27cyclictest0-21swapper/119:09:311
126899484,12cyclictest0-21swapper/121:49:341
126899484,12cyclictest0-21swapper/121:49:341
1268994831,10cyclictest17223-21fschecks_time20:54:321
1268994818,26cyclictest13992-21switchtime22:24:391
48662472,9sleep10-21swapper/118:48:351
298802472,37sleep10-21swapper/118:32:111
263912472,39sleep10-21swapper/119:33:491
1275994730,11cyclictest25835-21grep18:24:333
1275994730,11cyclictest25835-21grep18:24:333
1275994717,12cyclictest0-21swapper/317:44:493
1275994717,12cyclictest0-21swapper/317:44:493
127399473,26cyclictest3628-21grep18:44:382
1273994727,12cyclictest10551-21grep17:49:532
1268994732,9cyclictest20107-21unixbench_singl18:09:521
1268994731,10cyclictest20343-21gltestperf19:19:341
126899473,39cyclictest0-21swapper/117:39:531
126899473,27cyclictest0-21swapper/118:24:191
9992464,35sleep00-21swapper/017:31:330
37322462,9sleep30-21swapper/317:38:483
34702462,38sleep10-21swapper/117:35:241
1275994627,11cyclictest9106-21cpuspeed_turbos17:49:343
127399464,35cyclictest0-21swapper/219:04:472
127399464,34cyclictest0-21swapper/217:59:482
126899463,37cyclictest21605-21gltestperf18:14:381
127599454,34cyclictest0-21swapper/318:49:473
1275994527,12cyclictest0-21swapper/319:19:383
126899454,25cyclictest0-21swapper/120:23:321
1268994516,13cyclictest0-21swapper/117:59:411
127599444,33cyclictest0-21swapper/317:39:333
127399444,23cyclictest0-21swapper/219:19:272
127399442,20cyclictest0-21swapper/218:59:472
1268994429,9cyclictest23546-21unixbench-2d19:24:501
1268994428,10cyclictest11996-21tail17:54:391
1268994427,11cyclictest31631-21grep18:34:491
1268994426,11cyclictest26710-21cut18:24:441
1268994426,11cyclictest26710-21cut18:24:441
127599438,29cyclictest361ktimersoftd/318:54:353
9952414,30sleep30-21swapper/317:31:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional