You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 00:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Thu May 21, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1856599985,38cyclictest13719-21kworker/2:208:00:332
1856599975,27cyclictest0-21swapper/207:15:402
1856599975,25cyclictest9888-21python08:10:422
18565999733,14cyclictest0-21swapper/206:45:492
1856599965,28cyclictest0-21swapper/206:50:462
18565999538,49cyclictest0-21swapper/209:25:112
18565999530,14cyclictest0-21swapper/205:30:342
248599930,5rtkit-daemon21-21ksoftirqd/104:44:331
1856599934,39cyclictest0-21swapper/209:45:462
1856599934,24cyclictest28044-21ssh09:25:372
1856599934,13cyclictest0-21swapper/207:08:322
18565999332,12cyclictest0-21swapper/207:50:342
248599910,8rtkit-daemon0-21swapper/005:15:313
18565999128,15cyclictest0-21swapper/208:45:402
1856599898,25cyclictest0-21swapper/208:20:412
1856599898,25cyclictest0-21swapper/208:20:412
1856599883,29cyclictest0-21swapper/207:30:342
1856599874,36cyclictest0-21swapper/206:40:482
1856599865,36cyclictest0-21swapper/210:05:432
1856599865,25cyclictest0-21swapper/208:53:372
1856599859,33cyclictest0-21swapper/210:01:572
1856599854,34cyclictest0-21swapper/209:42:092
1856599854,12cyclictest0-21swapper/209:55:222
18565998536,7cyclictest11739-21ssh07:25:432
1856599845,27cyclictest0-21swapper/208:25:552
1856599844,38cyclictest22093-21hwlatdetect04:45:432
1856599835,39cyclictest0-21swapper/207:00:282
1856599835,39cyclictest0-21swapper/207:00:282
18565998320,12cyclictest0-21swapper/205:45:392
1856599815,14cyclictest0-21swapper/207:39:162
1856599814,38cyclictest0-21swapper/208:35:432
1856599804,42cyclictest0-21swapper/209:14:342
1856599804,39cyclictest0-21swapper/209:05:292
1856599804,39cyclictest0-21swapper/209:05:292
248599790,23rtkit-daemon5215-21gltestperf06:25:361
1856599793,38cyclictest0-21swapper/205:50:502
1856599784,40cyclictest0-21swapper/207:13:052
1856599784,28cyclictest0-21swapper/208:40:312
1856599784,27cyclictest0-21swapper/208:17:412
18565997835,9cyclictest31897-21aten_r1power_cu06:15:302
18565997835,9cyclictest31897-21aten_r1power_cu06:15:302
18565997829,13cyclictest0-21swapper/209:15:322
248599770,19rtkit-daemon0-21swapper/006:10:141
248599770,19rtkit-daemon0-21swapper/004:53:171
248599770,19rtkit-daemon0-21swapper/004:53:171
248599760,22rtkit-daemon0-21swapper/005:16:241
248599760,19rtkit-daemon0-21swapper/006:04:291
18566997626,42cyclictest32398-21tr08:45:263
248599750,6rtkit-daemon2484-21rtkit-daemon07:10:270
248599750,23rtkit-daemon0-21swapper/005:22:241
248599750,23rtkit-daemon0-21swapper/004:56:401
18566997529,38cyclictest21647-21idleruntime-cro08:30:133
1856599754,26cyclictest0-21swapper/207:20:592
17632750,3sleep041ktimersoftd/008:46:320
248599740,23rtkit-daemon0-21swapper/005:58:001
248599740,19rtkit-daemon0-21swapper/006:19:291
248599740,19rtkit-daemon0-21swapper/006:19:291
248599740,19rtkit-daemon0-21swapper/005:11:091
248599730,23rtkit-daemon0-21swapper/006:33:281
248599730,19rtkit-daemon0-21swapper/006:10:221
248599730,19rtkit-daemon0-21swapper/004:49:401
248599730,17rtkit-daemon3219-21netstat06:20:441
18566997323,42cyclictest1419-21runrttasks06:09:043
248599720,8rtkit-daemon0-21swapper/005:38:233
248599720,8rtkit-daemon0-21swapper/005:38:233
18566997223,42cyclictest1419-21runrttasks07:40:243
18566997223,42cyclictest1419-21runrttasks07:40:243
248599710,5rtkit-daemon2484-21rtkit-daemon06:35:511
18566997127,28cyclictest5553-21tail09:40:313
18566997118,46cyclictest0-21swapper/307:57:543
18566997029,33cyclictest6763-21aten_r1power_cu06:30:283
18566997025,38cyclictest400-21sa105:10:213
18566997025,26cyclictest13667-21tr09:05:263
18566997025,26cyclictest13667-21tr09:05:263
18566997023,32cyclictest0-21swapper/309:50:453
18566997020,41cyclictest6647-21aten_r1power_po08:55:243
18566997018,45cyclictest0-21swapper/310:01:103
18566997017,46cyclictest0-21swapper/309:15:313
28872694,56sleep10-21swapper/108:50:121
248599690,3rtkit-daemon18246-21ssh08:25:091
248599690,3rtkit-daemon18246-21ssh08:25:091
18566996928,11cyclictest3085-21grep09:35:433
18566996927,35cyclictest5920-21gltestperf08:05:343
18566996926,27cyclictest15096-21aten_r1power_en06:45:293
18566996921,40cyclictest0-21swapper/304:40:323
18566996920,42cyclictest0-21swapper/307:20:343
18566996919,43cyclictest0-21swapper/307:26:403
18566996918,43cyclictest0-21swapper/304:55:543
18565996927,34cyclictest30408-21cpuspeed09:30:232
248599680,5rtkit-daemon2484-21rtkit-daemon07:00:420
248599680,5rtkit-daemon2484-21rtkit-daemon07:00:420
1856699689,51cyclictest0-21swapper/307:35:533
18566996825,31cyclictest1419-21runrttasks07:01:183
18566996825,31cyclictest1419-21runrttasks07:01:183
18566996820,42cyclictest0-21swapper/307:12:213
18566996820,41cyclictest0-21swapper/308:52:483
18566996817,43cyclictest0-21swapper/309:00:273
131642685,11sleep00-21swapper/007:29:250
248599670,4rtkit-daemon2484-21rtkit-daemon07:22:491
18566996725,35cyclictest18590-21runrttasks06:50:253
18566996723,37cyclictest14228-21sed07:30:313
18566996721,39cyclictest0-21swapper/306:56:283
18566996721,39cyclictest0-21swapper/306:56:283
18566996721,37cyclictest167742sleep309:56:093
18566996721,30cyclictest0-21swapper/308:00:373
18566996719,41cyclictest28526-21munin-node07:50:433
18566996719,41cyclictest12656-21gltestperf08:15:323
18566996719,32cyclictest0-21swapper/309:48:533
248599660,8rtkit-daemon0-21swapper/107:52:251
248599660,24rtkit-daemon2484-21rtkit-daemon09:14:520
18566996618,41cyclictest0-21swapper/306:15:193
18566996618,40cyclictest0-21swapper/307:05:493
18566996616,43cyclictest10972-21seq08:13:223
18566996613,45cyclictest0-21swapper/309:26:323
18565996646,13cyclictest0-21swapper/208:05:352
1856499669,48cyclictest10672-21cpuspeed_turbos07:25:281
18566996520,38cyclictest8727-21perl05:25:393
18566996520,37cyclictest25911-21entropy08:35:293
18566996516,42cyclictest0-21swapper/308:22:563
18566996516,42cyclictest0-21swapper/308:22:563
18566996514,44cyclictest0-21swapper/308:40:433
18566996427,24cyclictest25285-21udisks-helper-a09:20:463
18566996424,33cyclictest24698-21gltestperf07:45:353
18566996422,25cyclictest1419-21runrttasks09:32:023
18566996418,38cyclictest0-21swapper/305:55:333
18566996413,43cyclictest0-21swapper/307:15:453
248599630,9rtkit-daemon0-21swapper/108:55:531
248599630,6rtkit-daemon18-21rcuc/110:03:051
248599630,6rtkit-daemon0-21swapper/106:58:501
248599630,6rtkit-daemon0-21swapper/106:58:501
18566996326,30cyclictest21940-21aten_r1power_cu08:30:233
18566996322,34cyclictest22618-21python04:45:533
18566996321,35cyclictest24781-21aten_r1power_fr06:00:303
18566996321,35cyclictest0-21swapper/305:45:383
18566996319,24cyclictest16363-21kworker/3:209:10:443
18566996318,39cyclictest0-21swapper/304:40:223
248599620,9rtkit-daemon0-21swapper/110:05:501
248599620,9rtkit-daemon0-21swapper/109:18:141
248599620,9rtkit-daemon0-21swapper/107:37:261
248599620,8rtkit-daemon0-21swapper/108:43:311
248599620,8rtkit-daemon0-21swapper/108:01:551
248599620,8rtkit-daemon0-21swapper/107:56:481
248599620,8rtkit-daemon0-21swapper/107:40:181
248599620,8rtkit-daemon0-21swapper/107:40:181
248599620,8rtkit-daemon0-21swapper/106:42:051
248599620,7rtkit-daemon0-21swapper/109:09:221
248599620,7rtkit-daemon0-21swapper/109:09:221
248599620,7rtkit-daemon0-21swapper/108:51:451
248599620,7rtkit-daemon0-21swapper/107:18:341
248599620,6rtkit-daemon0-21swapper/109:25:441
248599620,6rtkit-daemon0-21swapper/108:25:541
248599620,3rtkit-daemon12-21rcu_preempt09:30:441
248599620,3rtkit-daemon0-21swapper/109:36:061
248599620,3rtkit-daemon0-21swapper/108:18:021
248599620,3rtkit-daemon0-21swapper/106:55:051
18566996216,40cyclictest16829-21grep05:40:523
136512623,50sleep10-21swapper/107:30:221
248599610,8rtkit-daemon0-21swapper/109:00:531
248599610,8rtkit-daemon0-21swapper/106:45:431
248599610,7rtkit-daemon0-21swapper/108:37:011
248599610,7rtkit-daemon0-21swapper/108:05:171
248599610,6rtkit-daemon0-21swapper/109:50:581
248599610,6rtkit-daemon0-21swapper/109:45:511
248599610,6rtkit-daemon0-21swapper/107:45:181
248599610,4rtkit-daemon0-21swapper/107:06:491
248599610,3rtkit-daemon0-21swapper/109:41:211
248599610,3rtkit-daemon0-21swapper/109:24:521
248599610,3rtkit-daemon0-21swapper/109:11:521
18566996121,34cyclictest0-21swapper/310:05:193
18566996118,36cyclictest14144-21ssh06:43:153
18566996110,45cyclictest0-21swapper/305:55:183
18565996141,13cyclictest0-21swapper/207:55:332
18565996134,20cyclictest23672-21kworker/u8:206:26:332
248599600,4rtkit-daemon0-21swapper/107:14:271
248599600,3rtkit-daemon0-21swapper/109:59:431
248599600,2rtkit-daemon0-21swapper/108:30:461
18566996010,44cyclictest0-21swapper/306:15:313
18566996010,44cyclictest0-21swapper/306:15:313
1856199604,50cyclictest0-21swapper/008:15:230
1856199603,11cyclictest0-21swapper/007:15:420
110692604,12sleep10-21swapper/108:13:441
18566995917,35cyclictest0-21swapper/304:55:223
18566995917,35cyclictest0-21swapper/304:55:223
18566995912,40cyclictest0-21swapper/305:10:343
1856599593,39cyclictest0-21swapper/207:48:092
18565995924,11cyclictest1586-21df_abs09:35:242
1856199594,13cyclictest0-21swapper/009:25:450
128922593,47sleep00-21swapper/005:35:330
128922593,47sleep00-21swapper/005:35:330
1856199589,35cyclictest0-21swapper/009:36:420
18561995839,10cyclictest31180-21grep06:10:510
18566995735,16cyclictest0-21swapper/305:00:513
18566995720,21cyclictest3864-21seq06:22:033
18565995742,10cyclictest0-21swapper/208:33:462
18564995738,12cyclictest27476-21unixbench_multi07:00:501
18564995738,12cyclictest27476-21unixbench_multi07:00:501
1856199573,12cyclictest0-21swapper/005:00:410
18566995614,35cyclictest4496-21basename06:25:293
18565995640,11cyclictest0-21swapper/209:51:462
1856599564,44cyclictest0-21swapper/207:00:172
1856599564,44cyclictest0-21swapper/207:00:172
18565995634,15cyclictest0-21swapper/206:00:192
18565995617,32cyclictest11138-21missed_timers09:00:352
18564995637,11cyclictest14910-21crond05:40:191
18564995637,11cyclictest14910-21crond05:40:191
1856199564,35cyclictest0-21swapper/010:02:560
1856199563,38cyclictest0-21swapper/009:08:340
1856199563,38cyclictest0-21swapper/009:08:340
18561995615,27cyclictest0-21swapper/008:21:500
18561995615,27cyclictest0-21swapper/008:21:500
248599550,7rtkit-daemon0-21swapper/305:08:392
18566995519,29cyclictest0-21swapper/305:32:383
18565995535,13cyclictest0-21swapper/204:55:222
18565995535,13cyclictest0-21swapper/204:55:222
1856199554,12cyclictest0-21swapper/008:39:390
1856199553,8cyclictest21455-21ps09:15:420
18561995518,11cyclictest0-21swapper/007:48:310
163942553,9sleep00-21swapper/007:33:480
92732542,44sleep00-21swapper/006:35:310
248599540,6rtkit-daemon2484-21rtkit-daemon08:35:010
248599540,5rtkit-daemon2484-21rtkit-daemon07:05:270
18566995419,28cyclictest0-21swapper/305:20:503
1856499540,9cyclictest9826-21yum-updatesd-he05:26:321
1856199544,35cyclictest0-21swapper/007:56:180
1856199544,31cyclictest0-21swapper/009:20:460
1856199544,11cyclictest0-21swapper/006:42:570
18561995437,11cyclictest20809-21gltestperf05:50:380
1856199543,11cyclictest0-21swapper/008:41:210
95232532,9sleep00-21swapper/009:45:430
57092533,43sleep00-21swapper/009:40:350
18566995331,16cyclictest0-21swapper/306:38:023
1856599534,42cyclictest0-21swapper/205:20:302
18565995332,14cyclictest0-21swapper/206:05:482
1856499534,25cyclictest15309-21tail05:40:321
1856199537,26cyclictest0-21swapper/008:30:140
1856199534,32cyclictest0-21swapper/005:30:410
1856199534,31cyclictest0-21swapper/005:40:300
148772532,9sleep00-21swapper/009:55:220
1856599524,12cyclictest0-21swapper/208:55:312
18565995232,13cyclictest14307-21timerandwakeup05:35:522
18565995232,13cyclictest14307-21timerandwakeup05:35:522
18564995221,12cyclictest0-21swapper/105:05:301
1856199525,30cyclictest0-21swapper/010:06:240
1856199525,29cyclictest0-21swapper/007:35:420
1856199525,29cyclictest0-21swapper/006:50:320
1856199524,32cyclictest0-21swapper/007:24:500
1856199524,29cyclictest0-21swapper/006:45:400
1856199524,28cyclictest0-21swapper/006:58:410
1856199524,28cyclictest0-21swapper/006:58:410
1856199524,26cyclictest0-21swapper/008:51:230
18561995220,13cyclictest0-21swapper/009:50:110
1856199514,41cyclictest0-21swapper/009:00:270
1856199514,29cyclictest0-21swapper/004:55:460
1856199514,28cyclictest0-21swapper/008:05:390
18561995119,14cyclictest0-21swapper/005:45:400
1856599504,39cyclictest0-21swapper/205:15:322
1856599504,38cyclictest0-21swapper/206:00:402
18565995033,12cyclictest0-21swapper/205:10:332
18565995031,13cyclictest0-21swapper/207:40:312
18565995031,13cyclictest0-21swapper/207:40:312
18565995021,12cyclictest0-21swapper/205:05:202
1856199507,25cyclictest0-21swapper/008:00:360
1856199504,29cyclictest0-21swapper/008:10:460
1856199504,29cyclictest0-21swapper/006:20:450
1856199504,28cyclictest0-21swapper/006:25:370
1856199504,28cyclictest0-21swapper/005:20:530
1856199504,27cyclictest0-21swapper/007:50:380
1856199504,27cyclictest0-21swapper/007:41:110
1856199504,27cyclictest0-21swapper/007:41:110
1856199503,29cyclictest0-21swapper/005:55:310
1856199503,29cyclictest0-21swapper/005:15:210
1856199503,28cyclictest0-21swapper/008:55:220
186872492,39sleep00-21swapper/004:40:230
18565994930,12cyclictest0-21swapper/206:20:432
1856499494,28cyclictest0-21swapper/105:30:361
1856499494,27cyclictest0-21swapper/105:00:371
1856199495,27cyclictest0-21swapper/005:15:540
1856199494,28cyclictest0-21swapper/004:45:510
1856199494,27cyclictest0-21swapper/009:30:290
1856199494,27cyclictest0-21swapper/006:15:330
1856199494,27cyclictest0-21swapper/006:15:330
1856199494,27cyclictest0-21swapper/005:25:430
1856199494,27cyclictest0-21swapper/005:05:370
18561994920,12cyclictest0-21swapper/004:50:330
18561994920,12cyclictest0-21swapper/004:50:330
1856599484,35cyclictest0-21swapper/205:25:422
1856599482,23cyclictest0-21swapper/205:41:142
1856499484,27cyclictest0-21swapper/105:50:461
1856199484,27cyclictest0-21swapper/006:30:320
1856199484,26cyclictest0-21swapper/006:00:480
1856599463,26cyclictest0-21swapper/204:55:512
1856599463,25cyclictest0-21swapper/206:10:452
18565994615,13cyclictest0-21swapper/206:30:392
1856499464,26cyclictest0-21swapper/105:47:281
1856199463,26cyclictest0-21swapper/006:05:290
183132464,6sleep00-21swapper/004:37:340
185042454,6sleep20-21swapper/204:40:052
1856599444,33cyclictest0-21swapper/204:40:552
1856499444,13cyclictest0-21swapper/104:40:221
1856599424,13cyclictest0-21swapper/206:35:292
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional