You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 21:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed Mar 18, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991100,8rtkit-daemon0-21swapper/110:33:271
32478991039,22cyclictest0-21swapper/211:10:152
32472991024,90cyclictest0-21swapper/007:55:330
3247899973,70cyclictest0-21swapper/208:06:332
32478999717,11cyclictest0-21swapper/208:10:332
32478999617,7cyclictest29810-21ssh09:20:482
3247299963,87cyclictest0-21swapper/008:55:300
3247899956,25cyclictest0-21swapper/208:34:132
3247899956,25cyclictest0-21swapper/208:34:132
3247899954,27cyclictest0-21swapper/210:32:022
3247899954,26cyclictest0-21swapper/209:46:522
32478999517,13cyclictest0-21swapper/210:23:382
3247299954,66cyclictest0-21swapper/008:31:200
3247299954,66cyclictest0-21swapper/008:31:200
3247899944,28cyclictest0-21swapper/209:10:342
3247899944,28cyclictest0-21swapper/209:10:342
3247899944,26cyclictest0-21swapper/209:16:452
3247899943,26cyclictest0-21swapper/210:10:322
32478999413,19cyclictest8940-21ssh08:01:212
248599940,5rtkit-daemon2484-21rtkit-daemon10:09:280
3247899934,67cyclictest0-21swapper/208:24:382
3247899934,26cyclictest0-21swapper/210:35:262
3247899934,26cyclictest0-21swapper/210:35:262
3247899934,25cyclictest0-21swapper/208:38:142
3247899933,74cyclictest0-21swapper/207:45:162
3247899933,24cyclictest19657-21basename09:55:282
3247899933,24cyclictest19657-21basename09:55:282
3247899924,27cyclictest0-21swapper/206:35:532
3247299924,80cyclictest0-21swapper/009:30:110
3247899914,64cyclictest0-21swapper/209:03:382
3247899914,25cyclictest0-21swapper/208:49:052
3247899914,24cyclictest0-21swapper/208:54:082
3247299915,79cyclictest0-21swapper/008:26:270
3247299914,79cyclictest0-21swapper/011:00:450
32472999119,65cyclictest1419-21runrttasks07:41:300
3247899905,66cyclictest0-21swapper/207:40:222
32478999020,10cyclictest32593-21grep06:45:492
32478999017,13cyclictest0-21swapper/209:30:402
32478999016,59cyclictest0-21swapper/207:46:132
32478999016,59cyclictest0-21swapper/207:46:132
3247299904,79cyclictest0-21swapper/010:55:370
3247299903,80cyclictest0-21swapper/011:05:470
3247299903,80cyclictest0-21swapper/009:24:050
3247299903,64cyclictest26033-21sed10:50:480
3247899895,60cyclictest0-21swapper/209:40:542
3247899894,69cyclictest0-21swapper/210:15:532
3247899894,26cyclictest0-21swapper/210:41:532
3247899894,25cyclictest0-21swapper/211:00:432
3247899894,25cyclictest0-21swapper/210:08:412
3247899893,72cyclictest0-21swapper/209:00:042
32478998920,10cyclictest22752-21grep06:25:422
32478998920,10cyclictest22752-21grep06:25:422
32478998916,13cyclictest0-21swapper/207:50:492
3247299894,78cyclictest0-21swapper/010:25:290
3247299894,78cyclictest0-21swapper/010:17:290
3247299893,78cyclictest0-21swapper/010:44:320
3247299893,7cyclictest1419-21runrttasks08:49:260
3247899885,26cyclictest0-21swapper/209:09:002
3247899884,26cyclictest0-21swapper/208:18:202
3247899883,27cyclictest0-21swapper/208:25:452
3247899883,27cyclictest0-21swapper/207:55:362
3247899883,26cyclictest0-21swapper/210:04:272
3247299884,77cyclictest0-21swapper/009:39:500
3247299884,75cyclictest0-21swapper/008:05:120
3247299883,79cyclictest0-21swapper/010:10:290
3247299883,77cyclictest0-21swapper/009:18:290
3247299883,77cyclictest0-21swapper/009:07:250
3247899878,23cyclictest0-21swapper/208:42:002
3247899874,28cyclictest0-21swapper/209:50:442
3247899874,28cyclictest0-21swapper/206:40:532
3247899874,26cyclictest0-21swapper/210:30:092
3247899873,25cyclictest0-21swapper/210:52:492
32478998718,12cyclictest0-21swapper/207:20:352
3247299875,75cyclictest0-21swapper/010:34:470
3247299874,76cyclictest0-21swapper/009:48:330
3247299874,75cyclictest29629-21grep07:45:410
3247299874,75cyclictest29629-21grep07:45:410
3247299874,75cyclictest0-21swapper/009:10:310
3247299874,75cyclictest0-21swapper/009:10:310
3247299873,76cyclictest4034-21ssh09:30:430
3247299873,76cyclictest0-21swapper/010:36:280
3247299873,76cyclictest0-21swapper/010:36:280
3247299873,66cyclictest0-21swapper/009:01:200
3247899864,13cyclictest0-21swapper/210:58:372
3247899864,10cyclictest25213-21diskmemload10:48:462
3247299865,74cyclictest0-21swapper/010:20:290
3247299864,75cyclictest0-21swapper/009:50:280
3247299864,74cyclictest0-21swapper/008:24:210
3247299863,76cyclictest0-21swapper/010:04:300
3247299863,75cyclictest0-21swapper/007:31:300
3247299863,47cyclictest1287-21snmpd10:49:370
3247899854,25cyclictest0-21swapper/209:28:312
3247299854,74cyclictest0-21swapper/007:00:340
3247299854,73cyclictest0-21swapper/005:50:590
3247299853,76cyclictest0-21swapper/009:56:360
3247299853,76cyclictest0-21swapper/009:56:360
3247299853,76cyclictest0-21swapper/008:51:060
3247299853,75cyclictest0-21swapper/009:40:290
3247299853,75cyclictest0-21swapper/008:17:290
3247299853,75cyclictest0-21swapper/007:15:360
3247299853,50cyclictest13909-21cpuspeed_turbos08:10:360
3247899844,12cyclictest0-21swapper/209:35:282
32478998418,13cyclictest0-21swapper/206:00:392
3247299844,72cyclictest0-21swapper/007:25:460
3247299844,72cyclictest0-21swapper/006:15:370
3247299843,74cyclictest0-21swapper/008:44:570
3247299843,74cyclictest0-21swapper/007:50:430
3247299843,73cyclictest25214-21crond07:40:220
3247899834,72cyclictest0-21swapper/206:30:372
3247899834,27cyclictest0-21swapper/207:00:392
3247899834,27cyclictest0-21swapper/206:55:462
3247299833,74cyclictest0-21swapper/008:10:000
3247299833,73cyclictest1073-21latency_hist08:40:210
3247299833,72cyclictest30842-21grep06:40:580
3247299833,50cyclictest22255-21tr06:25:370
3247299833,50cyclictest22255-21tr06:25:370
3247899824,26cyclictest0-21swapper/207:13:582
3247299824,70cyclictest0-21swapper/007:05:410
3247299824,70cyclictest0-21swapper/007:05:410
3247299816,67cyclictest28852-21awk06:40:250
3247299814,69cyclictest0-21swapper/007:10:390
248599810,5rtkit-daemon2484-21rtkit-daemon09:10:383
248599810,5rtkit-daemon2484-21rtkit-daemon09:10:383
3247899804,69cyclictest0-21swapper/207:30:522
3247299804,69cyclictest0-21swapper/005:45:590
3247299804,59cyclictest0-21swapper/006:45:460
3247299803,70cyclictest32746-21basename05:40:380
3247899794,24cyclictest0-21swapper/207:20:242
3247899794,23cyclictest0-21swapper/205:58:582
248599790,5rtkit-daemon2484-21rtkit-daemon08:45:393
3247899784,25cyclictest0-21swapper/206:13:332
3247899784,13cyclictest0-21swapper/205:40:392
3247899783,8cyclictest7250irq/45-ahci06:50:452
3247299784,67cyclictest0-21swapper/006:06:170
3247299784,67cyclictest0-21swapper/005:40:280
248599780,5rtkit-daemon2484-21rtkit-daemon06:33:073
248599780,4rtkit-daemon2484-21rtkit-daemon09:20:303
248599780,4rtkit-daemon2484-21rtkit-daemon08:58:313
3247899773,25cyclictest0-21swapper/206:15:462
3247299773,68cyclictest0-21swapper/006:22:120
3247299773,67cyclictest0-21swapper/006:00:560
3247899764,24cyclictest0-21swapper/207:08:572
3247899764,24cyclictest0-21swapper/207:08:572
3247899764,15cyclictest0-21swapper/207:25:562
3247899764,14cyclictest0-21swapper/206:05:362
3247899764,12cyclictest0-21swapper/205:45:572
3247299763,67cyclictest0-21swapper/006:30:360
3247299763,67cyclictest0-21swapper/005:56:110
3247299763,45cyclictest0-21swapper/006:50:540
248599760,6rtkit-daemon0-21swapper/110:24:051
248599760,5rtkit-daemon2484-21rtkit-daemon10:54:043
248599760,4rtkit-daemon2484-21rtkit-daemon10:46:343
248599760,4rtkit-daemon2484-21rtkit-daemon09:28:373
248599750,6rtkit-daemon0-21swapper/110:35:421
248599750,6rtkit-daemon0-21swapper/110:35:421
248599750,6rtkit-daemon0-21swapper/110:25:431
248599750,4rtkit-daemon2484-21rtkit-daemon08:34:253
248599750,4rtkit-daemon2484-21rtkit-daemon08:34:253
3247899744,23cyclictest0-21swapper/206:20:362
3247899744,13cyclictest0-21swapper/205:51:012
32472997432,35cyclictest4822-21grep06:55:430
3247299743,64cyclictest0-21swapper/007:21:520
248599740,7rtkit-daemon0-21swapper/110:17:061
248599740,6rtkit-daemon0-21swapper/107:50:261
248599740,4rtkit-daemon2484-21rtkit-daemon08:39:243
248599730,6rtkit-daemon0-21swapper/108:08:181
3247299724,62cyclictest0-21swapper/006:15:250
248599710,5rtkit-daemon2484-21rtkit-daemon10:00:143
248599710,5rtkit-daemon2484-21rtkit-daemon10:00:143
248599710,4rtkit-daemon2484-21rtkit-daemon08:17:033
248599700,4rtkit-daemon2484-21rtkit-daemon07:20:503
248599680,4rtkit-daemon2484-21rtkit-daemon09:05:463
248599680,4rtkit-daemon2484-21rtkit-daemon07:40:423
248599670,5rtkit-daemon2484-21rtkit-daemon09:38:073
248599670,4rtkit-daemon2484-21rtkit-daemon09:46:373
248599670,4rtkit-daemon2484-21rtkit-daemon09:40:523
248599660,4rtkit-daemon2484-21rtkit-daemon11:01:563
248599660,4rtkit-daemon2484-21rtkit-daemon10:43:423
248599660,4rtkit-daemon2484-21rtkit-daemon10:06:283
248599660,4rtkit-daemon2484-21rtkit-daemon09:31:003
248599660,4rtkit-daemon2484-21rtkit-daemon09:01:533
248599660,4rtkit-daemon2484-21rtkit-daemon08:51:013
248599660,4rtkit-daemon2484-21rtkit-daemon08:20:483
248599660,4rtkit-daemon2484-21rtkit-daemon07:35:193
248599660,4rtkit-daemon2484-21rtkit-daemon07:26:273
248599660,4rtkit-daemon2484-21rtkit-daemon07:15:283
248599660,4rtkit-daemon2484-21rtkit-daemon07:14:433
248599660,4rtkit-daemon2484-21rtkit-daemon06:50:443
248599660,4rtkit-daemon2484-21rtkit-daemon06:36:443
248599660,4rtkit-daemon2484-21rtkit-daemon06:19:223
3247799655,50cyclictest0-21swapper/108:45:211
32477996545,13cyclictest0-21swapper/108:16:121
32477996545,12cyclictest18595-21munin-node10:40:371
32477996544,13cyclictest0-21swapper/109:29:101
32477996530,28cyclictest4055-21netstat09:30:431
248599650,4rtkit-daemon2484-21rtkit-daemon11:05:193
248599650,4rtkit-daemon2484-21rtkit-daemon10:03:143
248599650,4rtkit-daemon2484-21rtkit-daemon09:19:303
248599650,4rtkit-daemon2484-21rtkit-daemon08:44:023
248599650,4rtkit-daemon2484-21rtkit-daemon07:07:133
248599650,4rtkit-daemon2484-21rtkit-daemon07:07:133
248599650,4rtkit-daemon2484-21rtkit-daemon07:01:363
248599650,4rtkit-daemon2484-21rtkit-daemon06:48:443
248599650,4rtkit-daemon2484-21rtkit-daemon06:29:073
248599650,4rtkit-daemon2484-21rtkit-daemon06:29:073
248599650,4rtkit-daemon2484-21rtkit-daemon06:11:153
248599640,4rtkit-daemon2484-21rtkit-daemon10:59:043
248599630,5rtkit-daemon23949-21hddtemp_smartct07:35:423
32478996211,6cyclictest32457-21latency_hist05:40:272
32477996244,11cyclictest28276-21grep08:30:451
32477996244,11cyclictest28276-21grep08:30:451
3247999605,39cyclictest0-21swapper/310:18:583
3247999604,39cyclictest0-21swapper/307:52:593
32477995944,10cyclictest0-21swapper/109:10:371
32477995944,10cyclictest0-21swapper/109:10:371
32477995840,11cyclictest20010-21grep09:05:511
3247799584,46cyclictest0-21swapper/106:25:251
32479995715,19cyclictest9902-21sshd08:04:533
3247999563,39cyclictest0-21swapper/307:47:413
3247999563,39cyclictest0-21swapper/307:47:413
3247999563,37cyclictest0-21swapper/309:55:003
32477995638,12cyclictest0-21swapper/111:05:401
32477995635,14cyclictest0-21swapper/109:23:581
32477995635,13cyclictest0-21swapper/111:00:301
32477995634,14cyclictest0-21swapper/107:45:431
32477995634,14cyclictest0-21swapper/107:45:431
32477995634,14cyclictest0-21swapper/106:05:531
32477995611,28cyclictest0-21swapper/109:35:361
51792553,10sleep30-21swapper/305:50:393
3247999555,31cyclictest0-21swapper/306:45:243
3247999554,43cyclictest8594-21memory10:25:403
3247999554,36cyclictest0-21swapper/310:21:413
32479995537,11cyclictest10711-21fschecks_time06:00:453
3247799554,45cyclictest0-21swapper/108:20:391
3247799554,43cyclictest0-21swapper/107:56:151
32477995535,13cyclictest0-21swapper/108:28:541
3247799553,46cyclictest0-21swapper/110:01:041
56042542,11sleep30-21swapper/307:56:493
3247999545,26cyclictest10900-21diskstats08:05:383
3247999543,34cyclictest0-21swapper/310:12:293
3247999543,31cyclictest11686-21gltestperf10:30:353
32477995439,10cyclictest0-21swapper/110:05:441
32477995439,10cyclictest0-21swapper/109:58:251
32477995439,10cyclictest0-21swapper/109:58:251
32477995439,10cyclictest0-21swapper/109:45:501
32477995436,11cyclictest4511-21unixbench_multi05:46:011
32477995432,14cyclictest0-21swapper/110:45:331
32477995432,14cyclictest0-21swapper/109:00:501
32477995411,33cyclictest0-21swapper/105:50:401
297622542,11sleep10-21swapper/110:56:491
181812542,8sleep118184-21ssh09:51:171
32479995320,13cyclictest0-21swapper/305:40:283
3247799534,41cyclictest0-21swapper/109:40:311
32477995338,10cyclictest0-21swapper/110:53:551
32477995336,12cyclictest0-21swapper/106:25:351
32477995336,12cyclictest0-21swapper/106:25:351
32477995333,13cyclictest0-21swapper/108:10:471
32477995332,13cyclictest0-21swapper/106:10:381
32477995330,15cyclictest0-21swapper/108:55:311
3247999525,28cyclictest0-21swapper/305:45:553
3247999525,26cyclictest1419-21runrttasks10:39:333
3247999525,26cyclictest1419-21runrttasks10:39:333
3247999525,14cyclictest0-21swapper/308:29:023
3247999524,29cyclictest0-21swapper/308:10:433
3247999524,28cyclictest0-21swapper/306:20:383
3247799524,40cyclictest0-21swapper/110:10:211
3247799524,38cyclictest0-21swapper/108:35:301
32477995232,13cyclictest0-21swapper/107:05:401
32477995232,13cyclictest0-21swapper/107:05:401
32477995228,7cyclictest22875-21cat07:35:231
105432523,41sleep10-21swapper/106:00:451
3247799514,39cyclictest0-21swapper/108:00:321
32477995130,15cyclictest0-21swapper/108:45:191
3247799513,29cyclictest0-21swapper/107:10:401
3247999504,28cyclictest0-21swapper/305:55:593
3247999504,25cyclictest12433-21aten2.4-expect06:05:363
32477995035,11cyclictest0-21swapper/106:20:261
32477995034,11cyclictest0-21swapper/106:30:581
32477995030,13cyclictest0-21swapper/109:15:291
3247799503,41cyclictest0-21swapper/106:59:221
32477995029,12cyclictest1110-21gltestperf05:40:461
285142503,40sleep10-21swapper/106:36:201
3247999497,21cyclictest0-21swapper/306:55:583
3247799494,37cyclictest0-21swapper/108:50:301
32477994935,8cyclictest30730-21grep06:40:581
314412493,38sleep10-21swapper/106:45:271
3247799486,20cyclictest0-21swapper/107:30:231
3247799484,26cyclictest0-21swapper/107:35:411
32477994830,13cyclictest0-21swapper/107:43:231
158802482,12sleep10-21swapper/107:20:311
97152472,38sleep10-21swapper/106:00:241
83602472,11sleep10-21swapper/107:03:501
34442453,35sleep10-21swapper/106:52:011
32477994528,10cyclictest15245-21unixbench_singl07:15:571
3247999444,21cyclictest0-21swapper/305:40:393
3247799346,19cyclictest0-21swapper/105:40:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional