You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 18:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Wed Jul 15, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991000,4rtkit-daemon2193-21rtkit-daemon08:57:210
8499999819,60cyclictest475-21ssh09:10:342
8499999819,60cyclictest475-21ssh09:10:342
849999964,12cyclictest0-21swapper/209:05:392
849999954,71cyclictest0-21swapper/211:30:102
849999954,69cyclictest0-21swapper/210:30:042
8499999511,13cyclictest0-21swapper/211:15:422
8499999511,13cyclictest0-21swapper/211:15:422
849999944,69cyclictest0-21swapper/210:35:282
849999944,69cyclictest0-21swapper/210:35:282
849999944,69cyclictest0-21swapper/208:45:482
8499999418,56cyclictest0-21swapper/209:02:482
849999938,12cyclictest0-21swapper/208:39:412
849999938,12cyclictest0-21swapper/208:39:412
849999934,72cyclictest0-21swapper/208:55:382
849999925,12cyclictest1227-21runrttasks11:20:232
849999924,70cyclictest0-21swapper/210:05:392
849999924,66cyclictest0-21swapper/211:30:332
849999924,65cyclictest0-21swapper/211:07:122
849999924,14cyclictest0-21swapper/211:04:382
849999924,14cyclictest0-21swapper/209:24:332
849999924,13cyclictest0-21swapper/211:40:242
8499999218,56cyclictest14838-21ssh09:30:452
849999915,61cyclictest12431-21fschecks_time08:40:342
849999915,14cyclictest0-21swapper/209:15:432
8499999118,51cyclictest0-21swapper/207:10:492
8499999118,51cyclictest0-21swapper/207:10:492
849999904,77cyclictest30161-21grep10:40:442
849999904,72cyclictest0-21swapper/210:24:312
849999904,64cyclictest0-21swapper/211:50:262
849999904,64cyclictest0-21swapper/211:50:262
849999904,13cyclictest0-21swapper/209:40:252
849999904,13cyclictest0-21swapper/207:05:202
8499999010,69cyclictest0-21swapper/207:05:422
849999895,68cyclictest24062-21diskstats09:45:282
849999895,61cyclictest0-21swapper/210:45:392
849999894,63cyclictest0-21swapper/211:36:322
849999894,63cyclictest0-21swapper/210:34:322
849999894,63cyclictest0-21swapper/210:15:312
849999894,14cyclictest0-21swapper/210:00:022
849999894,14cyclictest0-21swapper/210:00:022
849999894,13cyclictest0-21swapper/209:35:452
849999893,20cyclictest1084-21lldpd06:54:382
849999885,63cyclictest0-21swapper/207:30:532
849999884,17cyclictest0-21swapper/210:04:432
849999884,14cyclictest0-21swapper/209:55:122
8499998822,45cyclictest0-21swapper/206:40:492
8499998812,10cyclictest0-21swapper/211:49:112
849999874,73cyclictest0-21swapper/211:10:392
849999874,68cyclictest0-21swapper/208:51:432
849999873,61cyclictest0-21swapper/208:27:192
219499870,5rtkit-daemon2193-21rtkit-daemon10:45:470
849999865,58cyclictest0-21swapper/210:55:322
849999864,67cyclictest0-21swapper/208:19:552
849999864,61cyclictest0-21swapper/210:14:522
849999864,61cyclictest0-21swapper/209:28:052
849999864,13cyclictest0-21swapper/208:00:302
849999864,11cyclictest4717-21ssh08:30:272
8499998616,48cyclictest0-21swapper/206:45:432
8499998615,9cyclictest32606-21tail07:15:302
8499998615,9cyclictest32606-21tail07:15:302
8499998610,61cyclictest0-21swapper/210:53:462
849999854,59cyclictest0-21swapper/208:15:172
849999854,12cyclictest0-21swapper/206:25:222
849999844,70cyclictest0-21swapper/208:05:492
101842830,6sleep00-21swapper/011:00:280
8500998129,46cyclictest0-21swapper/309:00:563
849999814,61cyclictest0-21swapper/207:20:542
849999814,56cyclictest0-21swapper/207:55:292
849999814,56cyclictest0-21swapper/207:55:292
219499810,4rtkit-daemon2193-21rtkit-daemon06:50:190
849999809,12cyclictest0-21swapper/206:35:442
8499998010,13cyclictest0-21swapper/207:50:402
219499800,5rtkit-daemon2193-21rtkit-daemon10:56:160
8500997926,46cyclictest0-21swapper/309:18:453
849999795,10cyclictest1227-21runrttasks06:27:152
849999794,67cyclictest0-21swapper/207:46:312
849999794,67cyclictest0-21swapper/207:40:302
849999794,67cyclictest0-21swapper/207:00:192
219499790,4rtkit-daemon2193-21rtkit-daemon07:14:330
219499790,4rtkit-daemon2193-21rtkit-daemon07:14:330
8500997827,43cyclictest0-21swapper/311:35:083
8500997826,44cyclictest0-21swapper/309:29:513
8500997823,47cyclictest0-21swapper/310:57:063
849999785,14cyclictest0-21swapper/207:36:572
849999783,21cyclictest32640-21ntpq08:20:462
8499997814,54cyclictest0-21swapper/207:30:192
219499780,4rtkit-daemon2193-21rtkit-daemon07:35:470
178302780,3sleep041ktimersoftd/010:24:450
8500997729,40cyclictest11672-21munin-node08:40:523
8500997728,18cyclictest0-21swapper/309:05:373
8500997726,45cyclictest0-21swapper/309:30:283
8500997725,44cyclictest16202-21cpuspeed_turbos06:40:333
8500997630,39cyclictest16239-21iostat08:45:373
8500997629,40cyclictest7949-21sort11:45:213
8500997626,41cyclictest0-21swapper/311:11:153
8500997625,43cyclictest0-21swapper/311:41:423
8500997623,45cyclictest7423-21chrt10:08:483
8500997621,40cyclictest0-21swapper/309:41:523
8499997630,39cyclictest11194-21aten2.4-expect06:30:332
8499997630,39cyclictest11194-21aten2.4-expect06:30:332
8500997532,36cyclictest21298-21kworker/3:210:40:333
8500997531,37cyclictest14998-21telnet10:20:273
8500997529,29cyclictest10566-21ssh08:37:353
8500997529,29cyclictest10566-21ssh08:37:353
8500997528,39cyclictest14135-21crond11:55:083
8500997528,39cyclictest14135-21crond11:55:083
8500997527,41cyclictest12928-21yum-updatesd-he11:05:343
8500997527,40cyclictest30541-21cpuspeed_turbos09:55:283
8500997527,40cyclictest30541-21cpuspeed_turbos09:55:283
8500997523,45cyclictest0-21swapper/310:54:583
8500997432,32cyclictest32065-21ssh10:45:273
8500997431,35cyclictest18617-21munin-node09:35:503
8500997430,37cyclictest0-21swapper/310:28:443
8500997430,37cyclictest0-21swapper/308:55:293
8500997429,30cyclictest0-21swapper/310:35:443
8500997429,30cyclictest0-21swapper/310:35:443
8500997428,27cyclictest19796-21ssh11:15:223
8500997428,27cyclictest19796-21ssh11:15:223
8500997427,29cyclictest0-21swapper/310:00:203
8500997425,41cyclictest236151sshd08:00:563
219499740,4rtkit-daemon2193-21rtkit-daemon09:48:340
8500997326,41cyclictest0-21swapper/309:20:473
8500997325,41cyclictest0-21swapper/311:05:093
8500997324,34cyclictest7928-21crond08:35:153
8500997230,33cyclictest12766-21awk10:15:373
8500997228,36cyclictest0-21swapper/308:55:153
8500997223,40cyclictest0-21swapper/309:50:193
8500997129,33cyclictest1227-21runrttasks07:45:543
8500997128,36cyclictest3127-21ssh11:36:533
8500997128,35cyclictest24340-21runrttasks10:33:553
8500997122,40cyclictest0-21swapper/310:10:283
219499710,24rtkit-daemon0-21swapper/309:47:271
8500997028,35cyclictest1876-21df_abs08:25:313
8500997027,36cyclictest29024-21taskset11:28:133
8500997021,41cyclictest0-21swapper/308:20:303
219499700,4rtkit-daemon2193-21rtkit-daemon10:14:030
8500996930,33cyclictest27580-21sleep07:05:193
8500996930,33cyclictest15451-21sshd06:38:003
8500996930,12cyclictest25083-21chrt11:21:073
8500996926,36cyclictest9292-21munin-node07:30:553
8500996922,40cyclictest0-21swapper/309:10:483
8500996922,40cyclictest0-21swapper/309:10:483
8500996919,42cyclictest0-21swapper/307:10:363
8500996919,42cyclictest0-21swapper/307:10:363
219499690,5rtkit-daemon2193-21rtkit-daemon07:50:010
219499690,4rtkit-daemon2193-21rtkit-daemon10:51:240
219499690,4rtkit-daemon2193-21rtkit-daemon08:30:450
219499690,4rtkit-daemon2193-21rtkit-daemon08:04:010
219499690,4rtkit-daemon2193-21rtkit-daemon06:40:560
8500996828,33cyclictest20017-21fschecks_count07:55:353
8500996828,33cyclictest20017-21fschecks_count07:55:353
219499680,5rtkit-daemon2193-21rtkit-daemon06:30:420
219499680,5rtkit-daemon2193-21rtkit-daemon06:30:420
219499680,4rtkit-daemon2193-21rtkit-daemon10:19:100
219499680,4rtkit-daemon2193-21rtkit-daemon08:16:450
219499680,4rtkit-daemon2193-21rtkit-daemon06:27:350
8500996730,29cyclictest8883-21wc06:25:333
8500996729,31cyclictest1227-21runrttasks08:09:243
8500996728,31cyclictest19070-21sshd07:53:563
8500996727,25cyclictest1183-21iostat_ios07:15:413
8500996727,25cyclictest1183-21iostat_ios07:15:413
8500996726,34cyclictest10327-21df_abs07:35:343
219499670,5rtkit-daemon2193-21rtkit-daemon08:07:010
219499670,5rtkit-daemon2193-21rtkit-daemon06:57:180
219499670,5rtkit-daemon2193-21rtkit-daemon06:38:040
219499670,4rtkit-daemon2193-21rtkit-daemon08:50:060
219499670,4rtkit-daemon2193-21rtkit-daemon07:22:100
219499670,4rtkit-daemon2193-21rtkit-daemon06:54:480
219499670,18rtkit-daemon2193-21rtkit-daemon10:03:260
8500996649,11cyclictest27373-21fschecks_time08:10:363
8500996649,11cyclictest11140-21aten_r1power_en06:30:323
8500996649,11cyclictest11140-21aten_r1power_en06:30:323
8500996630,27cyclictest23946-21hwlatdetect06:55:403
8500996629,30cyclictest20646-21munin-node06:50:403
8500996629,28cyclictest0-21swapper/306:45:353
849699665,51cyclictest0-21swapper/011:05:220
219499660,5rtkit-daemon2193-21rtkit-daemon10:25:330
219499660,4rtkit-daemon2193-21rtkit-daemon10:35:400
219499660,4rtkit-daemon2193-21rtkit-daemon10:35:400
219499660,4rtkit-daemon2193-21rtkit-daemon10:06:330
219499660,4rtkit-daemon2193-21rtkit-daemon09:01:580
219499660,4rtkit-daemon2193-21rtkit-daemon08:44:140
219499660,4rtkit-daemon2193-21rtkit-daemon08:14:300
219499660,4rtkit-daemon2193-21rtkit-daemon07:42:020
219499660,4rtkit-daemon2193-21rtkit-daemon07:34:320
219499660,4rtkit-daemon2193-21rtkit-daemon07:03:030
8500996547,11cyclictest6115-21iostat_ios07:25:413
8500996542,14cyclictest27804-21yum-updatesd-he07:05:373
8500996526,31cyclictest28976-21munin-node08:15:273
8500996525,26cyclictest1227-21runrttasks07:45:103
8500996524,13cyclictest23492-21aten2.4-expect09:45:223
219499650,5rtkit-daemon2193-21rtkit-daemon08:51:290
219499650,4rtkit-daemon2193-21rtkit-daemon10:41:400
219499650,4rtkit-daemon2193-21rtkit-daemon10:33:550
219499650,4rtkit-daemon2193-21rtkit-daemon09:56:190
219499650,4rtkit-daemon2193-21rtkit-daemon09:56:190
219499650,4rtkit-daemon2193-21rtkit-daemon09:06:510
219499650,4rtkit-daemon2193-21rtkit-daemon08:37:070
219499650,4rtkit-daemon2193-21rtkit-daemon08:37:070
219499650,4rtkit-daemon2193-21rtkit-daemon07:55:390
219499650,4rtkit-daemon2193-21rtkit-daemon07:55:390
219499650,4rtkit-daemon2193-21rtkit-daemon07:52:460
219499650,4rtkit-daemon2193-21rtkit-daemon07:29:170
219499650,4rtkit-daemon2193-21rtkit-daemon07:16:550
219499650,4rtkit-daemon2193-21rtkit-daemon07:16:550
219499640,6rtkit-daemon27513-21iostat_ios11:25:300
219499640,4rtkit-daemon2193-21rtkit-daemon09:51:570
219499640,4rtkit-daemon2193-21rtkit-daemon08:26:450
219499640,4rtkit-daemon2193-21rtkit-daemon08:24:300
219499640,4rtkit-daemon2193-21rtkit-daemon07:08:480
219499640,12rtkit-daemon2193-21rtkit-daemon09:10:131
8500996324,32cyclictest0-21swapper/307:20:323
219499630,6rtkit-daemon18188-21users11:10:460
219499630,4rtkit-daemon2193-21rtkit-daemon09:12:280
219499630,4rtkit-daemon2193-21rtkit-daemon09:12:280
219499630,13rtkit-daemon2193-21rtkit-daemon07:56:461
219499630,13rtkit-daemon2193-21rtkit-daemon07:56:461
219499630,13rtkit-daemon2193-21rtkit-daemon06:43:111
219499630,12rtkit-daemon2193-21rtkit-daemon10:19:481
219499630,12rtkit-daemon2193-21rtkit-daemon06:27:201
126192633,11sleep00-21swapper/009:28:350
219499620,6rtkit-daemon0-21swapper/111:42:070
219499620,4rtkit-daemon2193-21rtkit-daemon10:47:171
219499620,4rtkit-daemon2193-21rtkit-daemon09:01:431
219499620,13rtkit-daemon2193-21rtkit-daemon10:44:391
219499620,13rtkit-daemon2193-21rtkit-daemon08:46:221
219499620,12rtkit-daemon2193-21rtkit-daemon08:17:301
219499620,12rtkit-daemon2193-21rtkit-daemon07:31:321
219499620,12rtkit-daemon2193-21rtkit-daemon06:57:561
219499610,4rtkit-daemon2193-21rtkit-daemon10:05:561
219499610,13rtkit-daemon2193-21rtkit-daemon10:51:091
219499610,13rtkit-daemon2193-21rtkit-daemon07:42:541
219499610,13rtkit-daemon2193-21rtkit-daemon07:29:021
219499610,12rtkit-daemon2193-21rtkit-daemon10:28:031
219499610,12rtkit-daemon2193-21rtkit-daemon09:57:341
219499610,12rtkit-daemon2193-21rtkit-daemon09:57:341
219499610,12rtkit-daemon2193-21rtkit-daemon08:24:151
219499610,12rtkit-daemon2193-21rtkit-daemon07:23:021
219499610,12rtkit-daemon2193-21rtkit-daemon07:18:331
219499610,12rtkit-daemon2193-21rtkit-daemon07:18:331
219499610,12rtkit-daemon2193-21rtkit-daemon07:06:331
219499610,11rtkit-daemon2193-21rtkit-daemon06:30:271
219499610,11rtkit-daemon2193-21rtkit-daemon06:30:271
228782603,7sleep122882-21ssh09:44:041
219499600,5rtkit-daemon32001-21ssh11:31:450
219499600,12rtkit-daemon2193-21rtkit-daemon10:14:261
219499600,12rtkit-daemon2193-21rtkit-daemon10:04:111
219499600,12rtkit-daemon2193-21rtkit-daemon08:58:361
219499600,12rtkit-daemon2193-21rtkit-daemon08:14:151
219499600,12rtkit-daemon2193-21rtkit-daemon07:51:011
219499600,12rtkit-daemon2193-21rtkit-daemon07:02:481
219499600,11rtkit-daemon2193-21rtkit-daemon10:22:251
219499600,11rtkit-daemon2193-21rtkit-daemon08:38:521
219499600,11rtkit-daemon2193-21rtkit-daemon08:38:521
219499600,11rtkit-daemon2193-21rtkit-daemon06:54:331
8496995910,30cyclictest0-21swapper/009:30:280
219499590,6rtkit-daemon23347-21cpuspeed11:20:230
219499590,5rtkit-daemon2193-21rtkit-daemon09:14:581
219499590,5rtkit-daemon2193-21rtkit-daemon09:14:581
219499580,5rtkit-daemon2193-21rtkit-daemon08:04:381
219499580,5rtkit-daemon2193-21rtkit-daemon07:13:181
219499580,5rtkit-daemon2193-21rtkit-daemon07:13:181
219499580,4rtkit-daemon2193-21rtkit-daemon08:54:061
219499570,5rtkit-daemon2193-21rtkit-daemon08:44:441
219499570,5rtkit-daemon2193-21rtkit-daemon08:06:461
219499570,5rtkit-daemon2193-21rtkit-daemon07:47:091
219499570,4rtkit-daemon2193-21rtkit-daemon10:37:101
219499570,4rtkit-daemon2193-21rtkit-daemon10:37:101
140882574,10sleep00-21swapper/011:54:590
140882574,10sleep00-21swapper/011:54:590
219499560,5rtkit-daemon2193-21rtkit-daemon08:32:221
219499560,5rtkit-daemon2193-21rtkit-daemon08:25:451
219499560,5rtkit-daemon2193-21rtkit-daemon06:48:491
219499560,5rtkit-daemon2193-21rtkit-daemon06:37:341
219499560,4rtkit-daemon2193-21rtkit-daemon10:57:311
219499560,4rtkit-daemon2193-21rtkit-daemon09:53:491
219499550,5rtkit-daemon2193-21rtkit-daemon07:35:321
219499550,4rtkit-daemon2193-21rtkit-daemon10:31:171
849899535,30cyclictest0-21swapper/109:30:481
849699535,30cyclictest0-21swapper/011:35:320
849699534,43cyclictest0-21swapper/009:20:400
849699534,42cyclictest0-21swapper/011:45:370
60742533,9sleep00-21swapper/009:19:200
8500995234,12cyclictest8551-21sort06:25:213
193022523,9sleep00-21swapper/009:38:180
117502523,43sleep10-21swapper/111:50:291
117502523,43sleep10-21swapper/111:50:291
849899514,22cyclictest12928-21yum-updatesd-he11:05:201
849899514,12cyclictest0-21swapper/111:32:331
849899513,26cyclictest0-21swapper/111:26:211
849699515,29cyclictest0-21swapper/011:15:310
849699515,29cyclictest0-21swapper/011:15:310
849699514,29cyclictest0-21swapper/009:40:480
849899505,26cyclictest0-21swapper/109:35:161
849899504,28cyclictest0-21swapper/109:20:291
849899504,27cyclictest0-21swapper/109:20:151
849899504,12cyclictest0-21swapper/111:01:111
8498995022,12cyclictest0-21swapper/111:10:451
849899494,27cyclictest0-21swapper/111:15:431
849899494,27cyclictest0-21swapper/111:15:431
849899494,26cyclictest4746-21df_abs11:40:241
8498994931,12cyclictest0-21swapper/111:35:361
251632492,41sleep10-21swapper/111:21:271
849899484,11cyclictest0-21swapper/111:49:451
8498994820,14cyclictest0-21swapper/109:26:571
81712444,33sleep10-21swapper/106:21:351
63122444,33sleep00-21swapper/006:20:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional