You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 18:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Fri May 29, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6319911019,32cyclictest23056-21proc_pri12:34:460
631991007,34cyclictest1227-21runrttasks09:46:350
63499964,84cyclictest25468-21runrttasks11:50:441
63499944,73cyclictest0-21swapper/111:59:531
63199947,30cyclictest0-21swapper/010:44:520
63499935,80cyclictest0-21swapper/109:11:121
63499913,81cyclictest23569-21taskset09:28:381
631999135,11cyclictest32103-21grep08:44:570
63499903,67cyclictest0-21swapper/110:56:061
63499903,67cyclictest0-21swapper/110:56:061
63499894,67cyclictest0-21swapper/112:36:541
63499893,79cyclictest20746-21fschecks_time11:44:381
63499893,70cyclictest0-21swapper/110:48:251
63499883,77cyclictest15608-21sh10:01:071
63499883,77cyclictest0-21swapper/111:14:071
63499883,39cyclictest107550irq/46-eth012:23:291
63499876,72cyclictest0-21swapper/109:54:411
63499874,76cyclictest0-21swapper/109:14:481
63499874,56cyclictest0-21swapper/111:34:521
63499874,56cyclictest0-21swapper/111:34:521
63499873,77cyclictest0-21swapper/112:33:191
63499873,76cyclictest0-21swapper/112:15:341
63499873,76cyclictest0-21swapper/112:15:341
63499873,75cyclictest0-21swapper/110:34:391
63499864,74cyclictest0-21swapper/109:49:151
63499864,55cyclictest0-21swapper/109:43:161
63499863,75cyclictest17404-21grep11:39:391
63499854,74cyclictest0-21swapper/110:42:041
63499854,73cyclictest5389-21perl12:09:361
63499853,75cyclictest0-21swapper/111:04:361
63499853,47cyclictest28629-21ssh09:34:471
63499853,47cyclictest28629-21ssh09:34:471
63499845,54cyclictest0-21swapper/109:49:351
63499843,75cyclictest0-21swapper/110:50:421
63499843,73cyclictest0-21swapper/109:34:141
63499843,47cyclictest8406-21fschecks_time09:04:461
63499834,72cyclictest0-21swapper/111:27:011
63499834,72cyclictest0-21swapper/110:32:051
63499834,71cyclictest1080-21lldpd11:01:411
63499833,73cyclictest2290-21rm11:17:351
63499833,73cyclictest17708-21fschecks_count09:19:431
63499833,72cyclictest5240-21needreboot07:19:571
63499825,69cyclictest0-21swapper/110:21:511
63499825,61cyclictest22145-21yum10:10:011
63499824,58cyclictest0-21swapper/107:09:581
63499823,71cyclictest0-21swapper/110:25:471
63499814,70cyclictest0-21swapper/111:54:541
63499814,69cyclictest1925-21fschecks_time12:04:381
63499814,69cyclictest1227-21runrttasks12:26:071
63499813,71cyclictest0-21swapper/107:49:451
63499813,70cyclictest27520-21tail08:34:391
63499806,66cyclictest25576-21ssh10:15:151
63499806,66cyclictest25576-21ssh10:15:151
63499803,70cyclictest10687-21gltestperf11:29:421
63499803,53cyclictest0-21swapper/108:13:271
63499803,53cyclictest0-21swapper/108:13:271
63499795,67cyclictest0-21swapper/110:08:241
63499794,68cyclictest0-21swapper/108:59:561
63499793,8cyclictest8792-21uptime07:30:031
63499793,69cyclictest0-21swapper/111:23:401
63499793,60cyclictest0-21swapper/108:33:301
63499784,58cyclictest0-21swapper/108:47:451
63499773,66cyclictest0-21swapper/108:58:351
63499773,66cyclictest0-21swapper/108:58:351
63499764,60cyclictest0-21swapper/107:43:221
63499763,7cyclictest25240-21gltestperf08:24:471
63499763,66cyclictest16611-21fschecks_count07:59:471
63499754,63cyclictest0-21swapper/108:44:281
63499753,7cyclictest6835-21cat07:29:311
63499753,7cyclictest6835-21cat07:29:311
63499753,64cyclictest0-21swapper/108:05:511
63499753,63cyclictest0-21swapper/108:18:111
219499750,6rtkit-daemon0-21swapper/208:28:290
219499750,23rtkit-daemon29075-21munin-node08:28:143
63499743,54cyclictest0-21swapper/108:49:391
219499740,4rtkit-daemon0-21swapper/208:16:073
63499733,7cyclictest15780-21awk07:59:291
63499733,63cyclictest0-21swapper/107:17:011
63499733,62cyclictest1227-21runrttasks08:21:481
219499730,23rtkit-daemon0-21swapper/111:14:300
219499730,23rtkit-daemon0-21swapper/111:13:520
63499713,54cyclictest0-21swapper/107:09:321
219499700,7rtkit-daemon0-21swapper/207:24:313
219499690,7rtkit-daemon2193-21rtkit-daemon09:56:180
63699686,38cyclictest0-21swapper/312:14:213
63499684,57cyclictest0-21swapper/107:47:451
63499683,60cyclictest0-21swapper/107:36:321
631996841,18cyclictest0-21swapper/011:47:500
219499660,8rtkit-daemon0-21swapper/212:19:203
219499660,8rtkit-daemon0-21swapper/212:19:203
219499660,6rtkit-daemon0-21swapper/207:42:233
219499660,5rtkit-daemon14290-21ntp_states07:49:533
187652663,56sleep20-21swapper/210:05:152
219499650,8rtkit-daemon0-21swapper/312:04:583
219499650,5rtkit-daemon2193-21rtkit-daemon10:05:030
219499650,5rtkit-daemon0-21swapper/207:36:233
219499650,5rtkit-daemon0-21swapper/207:25:463
219499650,5rtkit-daemon0-21swapper/207:25:463
219499640,6rtkit-daemon0-21swapper/207:16:393
219499640,5rtkit-daemon862-21munin-node07:09:473
219499640,5rtkit-daemon12632-21yum-updatesd-he07:47:533
219499640,5rtkit-daemon0-21swapper/207:59:373
219499640,5rtkit-daemon0-21swapper/207:30:463
63199634,38cyclictest6245-21munin-node10:34:520
631996315,29cyclictest1632-21df_abs12:04:340
219499630,9rtkit-daemon0-21swapper/311:34:223
219499630,7rtkit-daemon0-21swapper/311:59:513
219499630,6rtkit-daemon0-21swapper/208:22:443
219499630,6rtkit-daemon0-21swapper/208:06:373
219499630,6rtkit-daemon0-21swapper/207:56:153
219499630,5rtkit-daemon0-21swapper/208:10:523
219499630,5rtkit-daemon0-21swapper/208:10:523
219499630,4rtkit-daemon2193-21rtkit-daemon11:53:583
219499630,4rtkit-daemon2193-21rtkit-daemon11:37:213
219499630,4rtkit-daemon2193-21rtkit-daemon11:37:213
219499630,4rtkit-daemon2193-21rtkit-daemon09:59:480
63599624,50cyclictest0-21swapper/212:12:432
631996243,11cyclictest0-21swapper/010:57:090
631996243,11cyclictest0-21swapper/010:57:090
219499620,4rtkit-daemon2193-21rtkit-daemon10:39:540
219499620,3rtkit-daemon0-21swapper/311:57:063
219499620,3rtkit-daemon0-21swapper/311:25:293
219499610,9rtkit-daemon0-21swapper/311:46:363
219499610,7rtkit-daemon0-21swapper/311:46:062
219499610,4rtkit-daemon2193-21rtkit-daemon09:11:200
219499610,3rtkit-daemon0-21swapper/311:21:303
219499600,7rtkit-daemon0-21swapper/012:19:570
219499600,5rtkit-daemon0-21swapper/212:19:273
219499600,4rtkit-daemon2193-21rtkit-daemon10:12:100
219499600,2rtkit-daemon0-21swapper/311:39:293
165392605,47sleep00-21swapper/009:18:410
233342592,9sleep20-21swapper/210:14:212
219499590,7rtkit-daemon0-21swapper/008:49:430
219499590,2rtkit-daemon0-21swapper/009:36:490
219499590,2rtkit-daemon0-21swapper/009:36:490
156632593,13sleep20-21swapper/211:37:002
156632593,13sleep20-21swapper/211:37:002
636995820,29cyclictest1547-21nscd10:47:503
219499580,9rtkit-daemon0-21swapper/010:14:320
219499580,9rtkit-daemon0-21swapper/010:14:320
636995719,31cyclictest19319-21gltestperf10:54:433
636995719,31cyclictest19319-21gltestperf10:54:433
636995710,39cyclictest0-21swapper/309:09:403
63199575,43cyclictest0-21swapper/011:08:490
53292574,47sleep20-21swapper/211:21:202
180992573,47sleep20-21swapper/210:54:162
63699564,46cyclictest0-21swapper/310:13:483
63699564,29cyclictest0-21swapper/309:14:433
636995617,32cyclictest0-21swapper/310:14:353
636995617,32cyclictest0-21swapper/310:14:353
63599565,42cyclictest0-21swapper/209:14:442
63599564,34cyclictest0-21swapper/209:48:382
63199565,35cyclictest0-21swapper/010:51:490
63199565,14cyclictest0-21swapper/011:24:360
63199563,47cyclictest0-21swapper/011:59:320
631995620,22cyclictest30386-21munin-node10:24:520
299262565,11sleep00-21swapper/010:23:470
269502562,46sleep00-21swapper/008:31:460
75602554,12sleep20-21swapper/207:29:472
636995521,27cyclictest0-21swapper/308:59:223
636995521,27cyclictest0-21swapper/308:59:223
63699552,47cyclictest34-21rcuc/309:50:083
63599554,44cyclictest0-21swapper/211:44:012
63599553,35cyclictest0-21swapper/212:34:522
635995527,22cyclictest20331-21idleruntime-cro09:24:262
63599552,9cyclictest24793-21seq11:03:562
635995519,20cyclictest0-21swapper/208:51:082
635995515,19cyclictest16200-21ntpdc12:24:462
63199554,44cyclictest0-21swapper/011:29:430
63199554,30cyclictest23807-21crond09:29:260
63199554,25cyclictest18533-21aten2.4-expect08:04:410
57302552,47sleep00-21swapper/011:22:470
14442553,46sleep20-21swapper/209:39:592
63699544,30cyclictest0-21swapper/310:34:353
63699544,19cyclictest0-21swapper/310:04:363
636995430,9cyclictest1227-21runrttasks09:55:083
63599545,28cyclictest0-21swapper/209:37:352
63599545,28cyclictest0-21swapper/209:37:352
63599544,35cyclictest0-21swapper/211:27:352
63599544,33cyclictest0-21swapper/211:58:102
635995423,25cyclictest0-21swapper/210:24:142
635995414,10cyclictest107550irq/46-eth012:19:512
246112543,44sleep00-21swapper/011:03:160
101692542,47sleep00-21swapper/012:15:470
101692542,47sleep00-21swapper/012:15:470
63699535,38cyclictest0-21swapper/312:24:353
63599534,43cyclictest0-21swapper/209:59:402
63599533,44cyclictest30737-21cpuspeed_turbos10:24:402
63199534,42cyclictest0-21swapper/009:39:540
631995332,13cyclictest27599-21head11:54:390
63199533,44cyclictest0-21swapper/012:29:360
63199533,44cyclictest0-21swapper/011:34:480
63199533,44cyclictest0-21swapper/011:34:480
237902532,10sleep30-21swapper/309:29:243
106582530,5chrt0-21swapper/211:29:412
63699525,39cyclictest0-21swapper/309:39:563
63699524,32cyclictest0-21swapper/310:25:413
63699524,27cyclictest0-21swapper/311:19:223
636995224,22cyclictest31003-21runrttasks11:11:573
63599529,25cyclictest0-21swapper/210:36:352
63599528,26cyclictest0-21swapper/208:34:282
63599524,40cyclictest0-21swapper/210:54:422
63599524,40cyclictest0-21swapper/210:54:422
63599524,39cyclictest0-21swapper/208:59:502
63599524,16cyclictest0-21swapper/211:59:542
635995236,10cyclictest12597-21grep10:44:442
63599523,44cyclictest0-21swapper/212:18:192
63599523,44cyclictest0-21swapper/212:18:192
63599523,41cyclictest3112-21grep12:04:532
63599522,36cyclictest0-21swapper/212:33:342
635995211,21cyclictest0-21swapper/209:09:542
63199524,31cyclictest0-21swapper/009:04:280
631995232,13cyclictest0-21swapper/011:39:360
631995223,13cyclictest0-21swapper/012:09:330
60722522,44sleep00-21swapper/007:23:160
208792523,7sleep320883-21sh12:32:273
177142522,9sleep30-21swapper/310:52:523
120962522,10sleep00-21swapper/007:43:430
98232512,41sleep00-21swapper/009:09:260
81202512,9sleep20-21swapper/209:49:552
63699515,29cyclictest0-21swapper/309:44:423
63699515,28cyclictest1227-21runrttasks10:43:243
63699514,39cyclictest17395-21cpuspeed_turbos09:19:393
63699514,29cyclictest0-21swapper/311:04:473
63599514,41cyclictest0-21swapper/209:27:592
63599514,29cyclictest0-21swapper/211:14:482
63599514,28cyclictest0-21swapper/207:19:522
63599514,27cyclictest0-21swapper/211:09:402
63599514,27cyclictest0-21swapper/209:04:552
63599514,25cyclictest0-21swapper/209:29:372
63199516,28cyclictest0-21swapper/009:29:500
63199515,30cyclictest0-21swapper/010:29:500
63199515,27cyclictest0-21swapper/009:52:200
631995133,11cyclictest3221-21tr08:54:410
631995133,11cyclictest3221-21tr08:54:410
63199513,35cyclictest0-21swapper/007:58:240
63199513,30cyclictest0-21swapper/011:49:530
306652513,10sleep30-21swapper/309:37:103
306652513,10sleep30-21swapper/309:37:103
209502512,10sleep00-21swapper/008:11:400
209502512,10sleep00-21swapper/008:11:400
125142512,10sleep00-21swapper/007:46:130
68422502,10sleep00-21swapper/007:29:320
63699504,28cyclictest0-21swapper/308:49:463
63699504,14cyclictest0-21swapper/311:03:163
636995033,10cyclictest3072-21cat10:29:543
636995030,13cyclictest0-21swapper/310:01:023
636995020,10cyclictest22577-21ssh12:34:373
636995016,18cyclictest25164-21kernelversion09:29:493
63599505,27cyclictest0-21swapper/211:54:162
63599504,40cyclictest0-21swapper/210:29:452
63599504,28cyclictest0-21swapper/208:14:402
63599504,25cyclictest0-21swapper/210:41:232
635995014,29cyclictest281ktimersoftd/210:14:452
635995014,29cyclictest281ktimersoftd/210:14:452
63199505,25cyclictest20340-21munin-run09:24:260
63199504,27cyclictest0-21swapper/012:24:380
3742504,39sleep00-21swapper/007:06:440
279562504,12sleep30-21swapper/308:34:433
63699494,28cyclictest0-21swapper/308:44:463
63699494,27cyclictest0-21swapper/310:24:063
63599494,27cyclictest0-21swapper/211:04:382
63599494,27cyclictest0-21swapper/208:24:532
63599494,27cyclictest0-21swapper/207:49:472
63599494,27cyclictest0-21swapper/207:09:522
635994928,14cyclictest0-21swapper/208:04:582
635994920,12cyclictest0-21swapper/208:36:082
63199494,28cyclictest0-21swapper/008:39:280
631994932,9cyclictest22264-21grep08:14:470
299822492,11sleep00-21swapper/008:42:140
269332492,10sleep30-21swapper/308:31:333
238432492,39sleep00-21swapper/008:20:180
149352492,9sleep00-21swapper/007:51:370
63599483,27cyclictest0-21swapper/208:44:532
63599483,26cyclictest0-21swapper/207:39:322
635994821,12cyclictest0-21swapper/209:54:352
635994818,12cyclictest0-21swapper/208:03:252
63199485,34cyclictest0-21swapper/007:25:110
63199485,34cyclictest0-21swapper/007:25:110
63199484,34cyclictest0-21swapper/007:14:320
63599472,32cyclictest0-21swapper/207:17:112
238602472,10sleep20-21swapper/208:20:322
126852472,38sleep20-21swapper/207:48:242
65472462,9sleep20-21swapper/207:26:322
65472462,9sleep20-21swapper/207:26:322
63199464,34cyclictest0-21swapper/007:59:520
210292462,10sleep20-21swapper/208:12:422
210292462,10sleep20-21swapper/208:12:422
73602452,37sleep30-21swapper/309:03:293
636994524,14cyclictest0-21swapper/309:09:283
63599454,24cyclictest0-21swapper/207:39:472
63599444,33cyclictest0-21swapper/208:59:282
63599444,33cyclictest0-21swapper/208:59:282
5302444,6sleep20-21swapper/207:08:432
154162442,9sleep20-21swapper/207:54:572
3522434,32sleep30-21swapper/307:06:273
63699424,32cyclictest0-21swapper/308:41:083
299462422,33sleep20-21swapper/208:41:482
63199413,33cyclictest0-21swapper/007:39:160
63199383,12cyclictest0-21swapper/007:19:320
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional