You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 03:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Mon Mar 23, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2575221220,5sleep224611-21diskmemload22:46:292
2575221220,5sleep224611-21diskmemload22:46:292
3187699983,87cyclictest0-21swapper/020:41:400
3187799973,23cyclictest0-21swapper/122:11:061
3187699964,84cyclictest0-21swapper/021:41:210
31877999516,13cyclictest0-21swapper/119:52:271
3187699953,84cyclictest0-21swapper/022:16:370
31877999415,11cyclictest22342-21gltestperf21:06:251
3187699947,79cyclictest0-21swapper/023:01:530
3187699943,82cyclictest0-21swapper/020:27:440
3187799936,65cyclictest0-21swapper/121:17:021
31877999316,12cyclictest0-21swapper/120:56:361
3187699934,81cyclictest0-21swapper/020:59:310
3187699933,69cyclictest0-21swapper/020:53:300
3187699925,70cyclictest0-21swapper/022:07:230
3187699924,81cyclictest0-21swapper/021:46:250
3187699924,50cyclictest0-21swapper/022:41:160
3187699923,9cyclictest429-21grep22:56:350
3187799917,76cyclictest1419-21runrttasks20:09:571
3187799914,22cyclictest0-21swapper/120:05:411
3187799914,22cyclictest0-21swapper/120:05:411
3187799914,22cyclictest0-21swapper/119:42:451
3187699916,78cyclictest0-21swapper/020:01:430
3187699916,78cyclictest0-21swapper/020:01:430
3187699914,11cyclictest0-21swapper/019:48:240
3187699913,69cyclictest0-21swapper/019:39:040
3187699913,66cyclictest0-21swapper/019:26:290
3187699913,53cyclictest0-21swapper/022:51:360
3187699912,83cyclictest7250irq/45-ahci21:24:530
3187699912,83cyclictest7250irq/45-ahci21:24:530
3187799905,59cyclictest0-21swapper/121:36:271
3187799905,17cyclictest4133-21taskset22:16:091
3187799904,23cyclictest0-21swapper/120:12:571
3187699907,65cyclictest0-21swapper/019:42:230
3187699904,8cyclictest24486-21runrttasks22:46:130
3187699904,8cyclictest24486-21runrttasks22:46:130
3187699904,79cyclictest0-21swapper/020:16:290
3187699904,63cyclictest0-21swapper/021:16:160
3187699903,8cyclictest20752-21latency_hist22:41:020
31876999010,72cyclictest18300-21cpu21:01:170
3187699898,74cyclictest0-21swapper/021:14:090
3187699893,8cyclictest11526-21grep22:26:200
3187799885,26cyclictest0-21swapper/121:11:451
3187799884,77cyclictest0-21swapper/121:31:311
3187799884,27cyclictest0-21swapper/120:56:061
3187799884,22cyclictest0-21swapper/121:49:471
31877998821,9cyclictest24613-21latency_hist19:36:091
31877998820,11cyclictest0-21swapper/120:23:351
31877998819,9cyclictest1419-21runrttasks22:38:551
3187699883,77cyclictest0-21swapper/019:57:570
3187699882,7cyclictest3702-21grep18:51:260
3187799874,77cyclictest0-21swapper/121:53:191
3187799874,75cyclictest0-21swapper/120:41:241
3187799874,23cyclictest0-21swapper/119:38:001
3187799874,22cyclictest0-21swapper/121:27:011
3187799874,22cyclictest0-21swapper/119:57:571
3187799874,21cyclictest1419-21runrttasks21:43:391
31877998723,55cyclictest10559-21needreboot17:56:371
31877998716,13cyclictest0-21swapper/122:09:331
31877998715,12cyclictest0-21swapper/120:46:251
31877998714,12cyclictest0-21swapper/120:26:251
3187699876,61cyclictest0-21swapper/019:55:210
3187699874,76cyclictest0-21swapper/022:14:010
3187699873,77cyclictest0-21swapper/020:06:180
3187799864,76cyclictest1419-21runrttasks22:50:351
3187799864,76cyclictest1419-21runrttasks22:50:351
3187799864,25cyclictest0-21swapper/122:57:001
3187799863,23cyclictest20523-21expr20:16:221
31877998624,52cyclictest14553-21unixbench-2d19:11:421
31877998619,10cyclictest0-21swapper/123:02:561
31877998616,13cyclictest0-21swapper/121:21:341
31877998616,13cyclictest0-21swapper/121:21:341
31877998616,12cyclictest0-21swapper/122:01:251
31877998616,12cyclictest0-21swapper/122:01:251
3187699864,76cyclictest0-21swapper/021:51:210
31876998635,34cyclictest24620-21munin-run19:36:090
3187699863,76cyclictest0-21swapper/022:04:220
3187699863,76cyclictest0-21swapper/022:04:220
3187699863,53cyclictest0-21swapper/021:06:200
3187799854,22cyclictest0-21swapper/122:54:091
3187699854,54cyclictest0-21swapper/020:36:050
3187699853,74cyclictest0-21swapper/020:46:380
3187699853,74cyclictest0-21swapper/020:36:530
3187699853,61cyclictest23613-21ssh21:56:220
3187699853,11cyclictest0-21swapper/020:21:380
3187699852,8cyclictest17281-21ssh20:11:230
3187799844,24cyclictest19614-21munin-node21:01:331
3187799844,23cyclictest0-21swapper/122:29:101
3187799843,17cyclictest0-21swapper/120:32:071
3187699843,63cyclictest0-21swapper/022:32:330
3187799835,24cyclictest0-21swapper/119:46:291
3187799834,73cyclictest0-21swapper/120:36:381
3187799834,24cyclictest0-21swapper/122:41:071
31877998336,40cyclictest4202-21head18:51:311
31877998327,48cyclictest8145-21forks22:21:201
31877998324,50cyclictest32061-21needreboot18:41:361
31877998320,45cyclictest0-21swapper/121:56:261
3187699834,73cyclictest0-21swapper/021:39:090
31876998332,37cyclictest27103-21runrttasks18:31:350
3187699833,9cyclictest1419-21runrttasks21:34:300
31877998227,48cyclictest20365-21tr19:26:231
31877998223,52cyclictest12797-21latency18:01:361
31877998222,53cyclictest0-21swapper/122:34:191
3187699824,71cyclictest0-21swapper/022:21:290
3187699824,55cyclictest0-21swapper/021:26:080
3187699823,60cyclictest0-21swapper/018:11:290
3187799815,14cyclictest0-21swapper/118:46:341
31877998128,47cyclictest3244-21kernelversion17:41:371
31877998120,12cyclictest30226-21unixbench_singl18:36:441
31877998120,12cyclictest30226-21unixbench_singl18:36:441
31877998118,10cyclictest0-21swapper/118:26:441
3187699814,70cyclictest0-21swapper/018:06:340
3187699814,66cyclictest0-21swapper/019:11:220
3187699814,63cyclictest0-21swapper/017:56:410
3187699814,52cyclictest0-21swapper/019:01:240
3187799804,27cyclictest1419-21runrttasks19:01:571
31877998018,11cyclictest18905-21munin-node18:16:271
3187799795,12cyclictest12566-21runrttasks19:10:041
31877997923,47cyclictest0-21swapper/117:36:281
31877997917,11cyclictest19361-21unixbench_multi19:21:411
31877997917,11cyclictest19361-21unixbench_multi19:21:411
3187699794,68cyclictest0-21swapper/018:21:240
3187699794,68cyclictest0-21swapper/018:16:410
3187699793,9cyclictest24532-21head18:26:310
3187699793,8cyclictest4348-21latency_hist17:46:140
3187799784,66cyclictest0-21swapper/118:31:171
31877997820,9cyclictest0-21swapper/117:51:271
31877997820,9cyclictest0-21swapper/117:51:271
31876997831,41cyclictest31723-21sed18:41:300
3187699783,48cyclictest0-21swapper/019:16:340
3187799773,8cyclictest121850irq/46-eth019:16:421
3187799773,30cyclictest14124-21munin-node18:06:411
3187799773,27cyclictest18727-21cat18:16:121
31877997720,11cyclictest23042-21unixbench_singl18:21:451
3187699773,8cyclictest7250irq/45-ahci19:21:360
3187699773,8cyclictest7250irq/45-ahci19:21:360
3187699773,56cyclictest0-21swapper/017:41:130
3187699773,11cyclictest0-21swapper/019:06:320
3187699773,10cyclictest0-21swapper/018:01:340
3187799765,13cyclictest6466-21runrttasks17:47:471
3187799764,24cyclictest0-21swapper/118:57:191
3187699763,10cyclictest0-21swapper/018:46:220
248599760,4rtkit-daemon2484-21rtkit-daemon20:00:223
3187699743,7cyclictest5801-21aten_r1power_fr18:56:220
3187699743,64cyclictest0-21swapper/017:51:130
3187699733,64cyclictest0-21swapper/018:36:420
3187699733,64cyclictest0-21swapper/018:36:420
31878997235,19cyclictest16924-21ssh21:46:212
3187699723,62cyclictest0-21swapper/017:51:420
3187699723,62cyclictest0-21swapper/017:51:420
3187799706,16cyclictest0-21swapper/117:36:141
3187699683,59cyclictest0-21swapper/017:36:140
31878996331,18cyclictest24611-21diskmemload20:37:042
3187999628,42cyclictest0-21swapper/322:41:153
31879996221,34cyclictest926-21cpuspeed_turbos22:11:173
248599620,10rtkit-daemon2484-21rtkit-daemon19:56:372
3187899614,49cyclictest0-21swapper/221:06:382
31878996127,19cyclictest23930-21ssh22:45:232
31878995934,9cyclictest24286-21ssh20:21:272
31878995934,9cyclictest11346-21ssh22:26:182
276992593,12sleep20-21swapper/220:26:272
3187999584,27cyclictest0-21swapper/320:46:193
3187899582,48cyclictest0-21swapper/221:40:142
81782564,13sleep20-21swapper/217:51:392
81782564,13sleep20-21swapper/217:51:392
34792568,8sleep20-21swapper/222:14:382
3187999564,37cyclictest0-21swapper/322:48:513
3187999564,37cyclictest0-21swapper/322:48:513
3187999564,11cyclictest0-21swapper/320:11:373
31879995614,22cyclictest0-21swapper/319:11:213
31878995639,10cyclictest4268-21wc18:51:332
31878995632,8cyclictest3293-21ssh21:26:212
248599560,7rtkit-daemon2484-21rtkit-daemon19:46:382
248599560,6rtkit-daemon2484-21rtkit-daemon19:16:242
248599560,6rtkit-daemon2484-21rtkit-daemon18:41:332
248599560,6rtkit-daemon2484-21rtkit-daemon18:20:042
248599560,6rtkit-daemon2484-21rtkit-daemon18:11:122
248599560,5rtkit-daemon2484-21rtkit-daemon21:31:262
248599560,5rtkit-daemon2484-21rtkit-daemon19:41:302
3187999554,37cyclictest0-21swapper/321:55:043
31879995530,20cyclictest0-21swapper/321:01:243
31879995513,10cyclictest10832-21gltestperf20:01:253
31879995513,10cyclictest10832-21gltestperf20:01:253
3187899554,32cyclictest0-21swapper/218:31:342
3187899553,45cyclictest0-21swapper/222:01:192
3187899553,45cyclictest0-21swapper/222:01:192
31878995521,21cyclictest5614-21ssh19:54:092
31878995512,26cyclictest0-21swapper/222:36:232
248599550,6rtkit-daemon2484-21rtkit-daemon18:01:272
248599550,6rtkit-daemon2484-21rtkit-daemon17:36:282
248599550,5rtkit-daemon2484-21rtkit-daemon22:06:172
248599550,5rtkit-daemon2484-21rtkit-daemon21:20:042
248599550,5rtkit-daemon2484-21rtkit-daemon19:36:382
248599550,5rtkit-daemon2484-21rtkit-daemon19:21:312
248599550,5rtkit-daemon2484-21rtkit-daemon19:21:312
248599550,5rtkit-daemon2484-21rtkit-daemon19:01:322
227562552,10sleep20-21swapper/220:19:342
153802552,11sleep20-21swapper/221:44:022
3187999545,34cyclictest0-21swapper/320:58:473
3187999545,10cyclictest16110-21unixbench_singl22:31:343
31878995438,10cyclictest32375-21tr22:56:262
31878995432,7cyclictest16091-21ssh20:56:322
3187899543,44cyclictest0-21swapper/221:02:442
248599540,5rtkit-daemon2484-21rtkit-daemon21:53:402
248599540,5rtkit-daemon2484-21rtkit-daemon20:41:282
248599540,5rtkit-daemon2484-21rtkit-daemon19:31:232
248599540,5rtkit-daemon2484-21rtkit-daemon19:26:242
248599540,5rtkit-daemon2484-21rtkit-daemon19:06:322
248599540,5rtkit-daemon2484-21rtkit-daemon18:56:322
248599540,5rtkit-daemon2484-21rtkit-daemon18:21:262
248599540,5rtkit-daemon2484-21rtkit-daemon18:16:112
248599540,5rtkit-daemon2484-21rtkit-daemon17:42:582
248599540,5rtkit-daemon2484-21rtkit-daemon17:36:132
209602543,14sleep30-21swapper/318:20:013
6402532,11sleep30-21swapper/320:35:193
3187999535,43cyclictest0-21swapper/321:46:373
3187999535,29cyclictest0-21swapper/321:26:213
3187999534,30cyclictest0-21swapper/318:31:113
3187999534,13cyclictest0-21swapper/320:36:253
3187999534,12cyclictest0-21swapper/321:32:423
3187999534,12cyclictest0-21swapper/319:51:263
31879995324,12cyclictest5708-21if_eth020:41:273
31879995312,23cyclictest13195-21unixbench_multi20:51:393
31878995338,9cyclictest4474-21cpuspeed_turbos22:16:162
258902534,41sleep30-21swapper/319:36:303
254312533,15sleep30-21swapper/321:58:513
248599530,5rtkit-daemon2484-21rtkit-daemon21:56:332
248599530,5rtkit-daemon2484-21rtkit-daemon17:56:352
3187999525,29cyclictest0-21swapper/321:41:203
3187999525,13cyclictest0-21swapper/323:01:213
3187999525,13cyclictest0-21swapper/320:23:543
3187999524,13cyclictest0-21swapper/322:58:243
3187999524,13cyclictest0-21swapper/322:54:253
3187999524,12cyclictest549-21sadc18:46:113
3187999524,12cyclictest0-21swapper/322:21:563
31879995236,9cyclictest10318-21grep21:36:223
3187999523,10cyclictest20848-21grep19:26:293
31879995223,11cyclictest24611-21diskmemload22:01:243
31879995223,11cyclictest24611-21diskmemload22:01:243
3187899523,43cyclictest28595-21grep22:51:222
248599520,5rtkit-daemon2484-21rtkit-daemon21:23:122
248599520,5rtkit-daemon2484-21rtkit-daemon21:23:122
248599520,5rtkit-daemon2484-21rtkit-daemon20:49:352
248599520,5rtkit-daemon2484-21rtkit-daemon18:26:332
3187999515,27cyclictest0-21swapper/321:22:573
3187999515,27cyclictest0-21swapper/321:22:573
3187999515,26cyclictest0-21swapper/319:32:403
3187999515,12cyclictest0-21swapper/321:18:503
3187999514,14cyclictest0-21swapper/320:18:223
3187999514,13cyclictest0-21swapper/322:09:233
3187999514,12cyclictest0-21swapper/319:41:253
31879995136,8cyclictest5785-21tail17:46:393
31879995122,13cyclictest0-21swapper/322:30:573
31879995121,11cyclictest27022-21taskset21:12:383
31879995119,7cyclictest361ktimersoftd/320:26:223
3187899514,41cyclictest0-21swapper/222:21:082
31878995135,10cyclictest13761-21sed19:11:292
31878995130,7cyclictest31182-21rm20:31:272
248599510,5rtkit-daemon2484-21rtkit-daemon20:54:352
90412503,11sleep30-21swapper/317:55:193
90412503,11sleep30-21swapper/317:55:193
3187999505,26cyclictest0-21swapper/318:01:283
3187999504,28cyclictest0-21swapper/321:06:363
3187999504,28cyclictest0-21swapper/317:36:133
3187999504,27cyclictest0-21swapper/320:06:373
3187999504,12cyclictest0-21swapper/322:16:293
31879995035,8cyclictest32670-21sed19:46:293
3187999503,19cyclictest0-21swapper/318:46:293
3187999503,11cyclictest0-21swapper/319:01:273
31878995035,9cyclictest15161-21unixbench_multi20:06:412
31878995028,7cyclictest27078-21ssh21:12:512
31878995014,21cyclictest0-21swapper/220:13:052
248599500,5rtkit-daemon2484-21rtkit-daemon17:46:422
3187999495,27cyclictest0-21swapper/319:22:393
3187999495,27cyclictest0-21swapper/319:22:393
3187999495,26cyclictest0-21swapper/318:07:253
3187999494,28cyclictest0-21swapper/322:36:213
3187999494,28cyclictest0-21swapper/319:06:453
3187999494,28cyclictest0-21swapper/318:21:393
3187999494,28cyclictest0-21swapper/317:36:413
3187899494,23cyclictest0-21swapper/222:31:122
248599490,5rtkit-daemon2484-21rtkit-daemon23:05:382
3187999485,26cyclictest0-21swapper/319:16:423
3187999485,26cyclictest0-21swapper/317:57:233
3187999485,11cyclictest16885-21cpuspeed_turbos18:11:263
3187999484,26cyclictest0-21swapper/318:57:343
3187899483,39cyclictest0-21swapper/220:01:282
3187899483,39cyclictest0-21swapper/220:01:282
31878994822,12cyclictest0-21swapper/218:36:222
31878994822,12cyclictest0-21swapper/218:36:222
3187999474,27cyclictest0-21swapper/318:36:233
3187999474,27cyclictest0-21swapper/318:36:233
3187999474,27cyclictest0-21swapper/318:31:453
3187999473,27cyclictest0-21swapper/317:42:213
3187999454,25cyclictest0-21swapper/318:51:233
31878994519,11cyclictest0-21swapper/218:46:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional