You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 15:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat May 30, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991670,5rtkit-daemon2193-21rtkit-daemon10:38:540
2854099974,74cyclictest0-21swapper/210:34:212
219499960,5rtkit-daemon2193-21rtkit-daemon09:21:040
2854099953,70cyclictest31420-21sendmail_mailqu11:43:522
2854099949,60cyclictest0-21swapper/211:20:252
2854099934,70cyclictest0-21swapper/211:43:112
28540999315,7cyclictest0-21swapper/211:55:492
2854099924,70cyclictest0-21swapper/211:35:472
28540999210,9cyclictest0-21swapper/212:08:392
2854099919,64cyclictest0-21swapper/210:03:562
2854099919,64cyclictest0-21swapper/210:03:562
2854099914,70cyclictest0-21swapper/209:28:132
2854099914,68cyclictest0-21swapper/210:22:582
28533999142,42cyclictest1227-21runrttasks09:13:440
28533999136,47cyclictest0-21swapper/012:08:380
2854099904,68cyclictest0-21swapper/211:48:372
2854099904,67cyclictest1227-21runrttasks09:42:102
2854099903,8cyclictest107550irq/46-eth011:13:452
2854099903,69cyclictest0-21swapper/209:15:032
2854099894,68cyclictest0-21swapper/212:18:032
2854099894,68cyclictest0-21swapper/210:53:372
2854099894,67cyclictest0-21swapper/211:58:392
2854099894,67cyclictest0-21swapper/209:48:382
2854099894,61cyclictest0-21swapper/208:07:392
2854099894,61cyclictest0-21swapper/208:07:392
2854099894,60cyclictest0-21swapper/212:03:492
2854099894,60cyclictest0-21swapper/210:08:502
2854099885,65cyclictest0-21swapper/208:43:522
2854099884,71cyclictest0-21swapper/210:58:582
2854099884,68cyclictest0-21swapper/212:28:392
2854099884,68cyclictest0-21swapper/210:29:102
2854099884,66cyclictest0-21swapper/209:34:022
2854099884,65cyclictest0-21swapper/208:08:482
2854099884,61cyclictest0-21swapper/210:50:242
28540998814,11cyclictest0-21swapper/209:13:312
2854099874,68cyclictest0-21swapper/211:26:562
2854099874,66cyclictest0-21swapper/209:43:422
2854099874,62cyclictest0-21swapper/212:33:372
2854099874,62cyclictest0-21swapper/210:14:492
2854099874,61cyclictest0-21swapper/212:28:142
2854099874,60cyclictest0-21swapper/211:31:512
2854099874,60cyclictest0-21swapper/209:54:482
2854099874,57cyclictest0-21swapper/208:48:452
2854099874,57cyclictest0-21swapper/208:48:452
2854099873,61cyclictest0-21swapper/211:09:592
2854099873,61cyclictest0-21swapper/209:32:002
28540998722,47cyclictest21844-21df_abs12:18:392
28540998718,48cyclictest0-21swapper/210:39:462
28540998718,46cyclictest0-21swapper/210:23:342
28540998710,9cyclictest0-21swapper/209:59:012
2854099864,62cyclictest0-21swapper/209:01:402
2854099864,21cyclictest0-21swapper/208:37:442
2854099864,18cyclictest0-21swapper/208:13:432
2854099863,59cyclictest0-21swapper/210:43:442
28540998619,50cyclictest0-21swapper/207:26:542
28540998618,46cyclictest0-21swapper/211:05:412
28533998633,46cyclictest0-21swapper/012:03:240
28533998629,49cyclictest0-21swapper/011:52:410
2854099854,64cyclictest0-21swapper/208:53:522
2854099854,59cyclictest0-21swapper/208:38:562
28533998533,45cyclictest0-21swapper/011:03:420
28533998531,46cyclictest0-21swapper/012:13:410
2854099844,63cyclictest0-21swapper/209:19:132
2854099844,62cyclictest0-21swapper/208:23:322
28533998436,17cyclictest0-21swapper/009:24:350
28533998434,43cyclictest0-21swapper/010:58:260
219499840,5rtkit-daemon2193-21rtkit-daemon09:58:553
219499840,5rtkit-daemon2193-21rtkit-daemon08:48:503
219499840,5rtkit-daemon2193-21rtkit-daemon08:48:503
2854099835,58cyclictest0-21swapper/207:58:462
2854099835,58cyclictest0-21swapper/207:49:082
2854099834,62cyclictest0-21swapper/207:58:342
28533998338,38cyclictest25571-21runrttasks09:59:310
28533998334,42cyclictest11523-21tr12:03:370
28533998331,46cyclictest0-21swapper/011:55:260
28533998331,20cyclictest0-21swapper/010:31:280
2854099824,56cyclictest0-21swapper/208:26:102
2854099823,63cyclictest0-21swapper/209:03:532
28533998239,37cyclictest12811-21cat11:18:250
28533998236,31cyclictest0-21swapper/011:33:250
28533998233,42cyclictest0-21swapper/009:54:020
28533998233,30cyclictest0-21swapper/009:33:520
28533998229,45cyclictest0-21swapper/007:18:350
219499820,5rtkit-daemon2193-21rtkit-daemon11:17:303
2854099814,69cyclictest0-21swapper/208:32:432
28533998135,32cyclictest0-21swapper/010:48:460
28533998134,41cyclictest0-21swapper/011:21:590
28533998133,42cyclictest0-21swapper/012:18:390
28533998132,43cyclictest0-21swapper/010:58:530
28533998129,45cyclictest0-21swapper/009:46:520
2854099803,60cyclictest0-21swapper/207:08:542
28533998034,40cyclictest0-21swapper/010:08:400
28533998034,39cyclictest1227-21runrttasks12:35:180
28533998029,45cyclictest0-21swapper/010:23:020
219499800,5rtkit-daemon2193-21rtkit-daemon12:33:423
219499800,5rtkit-daemon2193-21rtkit-daemon11:42:513
2854099794,68cyclictest0-21swapper/207:18:482
2854099794,57cyclictest0-21swapper/207:44:002
2854099794,15cyclictest0-21swapper/207:39:022
28540997918,53cyclictest10552-21crond07:38:342
28533997939,11cyclictest15539-21diskstats10:33:450
28533997936,37cyclictest0-21swapper/009:48:570
28533997935,37cyclictest4544-21crond10:18:280
28533997935,29cyclictest28054-21munin-node12:28:460
28533997933,40cyclictest0-21swapper/009:28:430
28533997933,16cyclictest0-21swapper/010:45:560
28533997928,18cyclictest0-21swapper/011:11:400
28533997924,48cyclictest0-21swapper/010:03:560
28533997924,48cyclictest0-21swapper/010:03:560
28533997839,32cyclictest11507-21grep09:38:580
28533997831,40cyclictest25129-21expr12:23:380
28533997827,44cyclictest18435-21ssh11:24:300
28533997826,46cyclictest0-21swapper/009:10:460
2854099774,55cyclictest0-21swapper/207:13:462
28540997719,40cyclictest0-21swapper/207:08:352
28540997715,9cyclictest107550irq/46-eth007:33:342
28533997744,25cyclictest0-21swapper/007:08:350
28533997729,42cyclictest0-21swapper/011:48:260
28533997634,35cyclictest9074-21sshd07:33:510
28533997634,26cyclictest7163-21munin-node08:38:530
28533997633,37cyclictest9054-21tail10:23:470
28533997633,37cyclictest0-21swapper/011:38:460
28533997633,37cyclictest0-21swapper/008:23:580
28533997623,47cyclictest0-21swapper/007:18:510
28533997531,39cyclictest22863-21aten2.4-expect08:03:470
28533997531,39cyclictest22863-21aten2.4-expect08:03:470
28533997528,30cyclictest0-21swapper/007:43:350
28533997428,31cyclictest0-21swapper/011:36:450
28533997337,30cyclictest25662-21df_abs08:08:490
28533997332,35cyclictest13500-21cpuspeed_turbos07:43:470
219499730,5rtkit-daemon2193-21rtkit-daemon09:14:043
28533997255,11cyclictest5610-21grep08:33:510
28533997225,40cyclictest0-21swapper/008:28:520
28533997223,43cyclictest0-21swapper/008:13:540
28533997222,44cyclictest0-21swapper/008:43:470
28533996947,13cyclictest21263-21crond09:08:300
28533996944,18cyclictest12861-21wc08:48:530
28533996944,18cyclictest12861-21wc08:48:530
28533996944,17cyclictest1227-21runrttasks07:11:000
28533996929,33cyclictest16707-21munin-node08:58:450
28533996928,35cyclictest0-21swapper/008:54:010
28533996849,13cyclictest0-21swapper/007:28:470
28533996825,37cyclictest0-21swapper/008:18:440
28533996820,41cyclictest0-21swapper/007:55:580
28533996818,44cyclictest0-21swapper/008:03:340
15412680,9sleep30-21swapper/310:13:423
28533996742,16cyclictest4279-21fschecks_count07:23:530
28533996643,13cyclictest15570-21munin-node07:48:490
28541996021,22cyclictest0-21swapper/312:03:563
141262582,10sleep10-21swapper/112:07:491
28541995723,26cyclictest361ktimersoftd/309:38:493
28538995737,13cyclictest0-21swapper/110:39:401
251882572,47sleep325270-21aten_r1power_vo08:08:463
209952573,8sleep121129-21perl07:58:521
2854199568,24cyclictest0-21swapper/309:18:443
2854199564,36cyclictest0-21swapper/309:09:153
236732563,11sleep30-21swapper/310:44:233
2854199554,36cyclictest0-21swapper/310:31:513
2854199554,35cyclictest0-21swapper/312:24:523
28541995523,28cyclictest0-21swapper/310:41:013
28541995518,9cyclictest29204-21ssh10:53:463
2853899555,43cyclictest7036-21cpuspeed_turbos09:33:451
2853899554,44cyclictest0-21swapper/108:09:041
219499550,6rtkit-daemon2193-21rtkit-daemon07:14:023
219499550,5rtkit-daemon2193-21rtkit-daemon07:38:533
322482543,7sleep132251-21ssh10:09:141
28541995412,24cyclictest0-21swapper/308:13:473
2853899545,44cyclictest0-21swapper/110:21:451
28538995437,10cyclictest12806-21tail10:28:501
28538995412,33cyclictest0-21swapper/110:28:271
94322533,8sleep321265-21diskmemload09:37:203
69822533,44sleep36985-21ssh10:20:043
2854199535,14cyclictest0-21swapper/311:24:173
28541995335,11cyclictest4781-21cpuspeed_turbos11:53:373
28541995322,13cyclictest0-21swapper/308:18:583
28541995321,14cyclictest0-21swapper/308:28:533
28541995317,29cyclictest15674-21sh09:45:273
2853899534,41cyclictest0-21swapper/111:43:541
2853899533,42cyclictest0-21swapper/109:13:571
28538995315,32cyclictest18-21rcuc/109:09:521
219499530,3rtkit-daemon9713-21ssh11:59:053
108282534,10sleep30-21swapper/310:26:453
2854199525,24cyclictest3786-21diskstats09:28:473
2854199525,14cyclictest0-21swapper/310:12:083
2854199525,13cyclictest0-21swapper/311:33:163
2854199524,27cyclictest0-21swapper/309:53:583
2854199524,26cyclictest0-21swapper/307:33:443
2854199524,14cyclictest0-21swapper/312:33:183
28541995220,13cyclictest0-21swapper/312:23:243
2853899529,36cyclictest21120-21runrttasks09:06:431
28538995215,31cyclictest18-21rcuc/111:36:521
219499520,4rtkit-daemon444-21ssh11:47:513
219499520,4rtkit-daemon2530-21ssh11:02:533
97692512,42sleep10-21swapper/108:43:451
2854199515,29cyclictest0-21swapper/307:33:343
2854199515,27cyclictest0-21swapper/308:33:483
2854199515,14cyclictest0-21swapper/309:26:273
2854199515,13cyclictest0-21swapper/310:48:353
2854199515,13cyclictest0-21swapper/310:04:153
2854199515,13cyclictest0-21swapper/310:04:153
2854199514,29cyclictest0-21swapper/312:08:563
2854199514,29cyclictest0-21swapper/311:13:263
2854199514,29cyclictest0-21swapper/309:03:493
2854199514,29cyclictest0-21swapper/308:53:493
2854199514,27cyclictest0-21swapper/307:28:363
2853899519,35cyclictest1864-21df_abs10:13:451
2853899518,36cyclictest0-21swapper/111:28:591
2853899514,39cyclictest0-21swapper/110:43:431
28538995132,14cyclictest0-21swapper/111:06:571
28538995121,24cyclictest0-21swapper/111:13:561
2854199504,28cyclictest0-21swapper/308:03:543
2854199504,28cyclictest0-21swapper/308:03:543
2854199504,27cyclictest0-21swapper/307:08:563
2854199503,38cyclictest20003-21latency_hist09:53:293
2853899506,38cyclictest201ktimersoftd/112:11:461
28538995031,13cyclictest0-21swapper/109:49:091
2853899503,41cyclictest0-21swapper/111:55:041
2853899503,40cyclictest6911-21df11:08:421
28538995015,8cyclictest22954-21timerandwakeup12:18:561
219499500,5rtkit-daemon2193-21rtkit-daemon11:48:583
145782502,10sleep30-21swapper/307:44:033
91452492,41sleep10-21swapper/108:41:241
2854199495,35cyclictest0-21swapper/308:43:433
2854199494,28cyclictest0-21swapper/311:03:563
2854199494,27cyclictest0-21swapper/312:13:453
2854199494,27cyclictest0-21swapper/308:58:473
2854199494,26cyclictest0-21swapper/311:23:033
2854199494,26cyclictest0-21swapper/308:03:343
2854199494,24cyclictest0-21swapper/310:35:343
28541994918,13cyclictest0-21swapper/311:33:513
2853899494,38cyclictest0-21swapper/112:33:551
2853899494,37cyclictest0-21swapper/111:58:551
28538994931,13cyclictest0-21swapper/111:49:031
28538994923,20cyclictest0-21swapper/108:17:171
28538994910,13cyclictest0-21swapper/109:19:051
205742492,40sleep10-21swapper/112:16:431
140022492,39sleep10-21swapper/109:43:471
2854199484,27cyclictest0-21swapper/308:38:453
2854199484,27cyclictest0-21swapper/307:54:073
28541994819,13cyclictest0-21swapper/307:52:353
28541994818,13cyclictest0-21swapper/307:18:473
2853899489,33cyclictest201ktimersoftd/112:28:471
2853899486,37cyclictest201ktimersoftd/110:54:001
2853899484,38cyclictest0-21swapper/108:58:311
2853899484,32cyclictest0-21swapper/109:53:541
28538994830,12cyclictest0-21swapper/110:03:471
28538994830,12cyclictest0-21swapper/110:03:471
2853899483,38cyclictest0-21swapper/110:58:501
2853899483,18cyclictest0-21swapper/110:02:301
28538994829,12cyclictest0-21swapper/112:23:561
28538994823,8cyclictest6523-21cat09:33:301
28538994811,33cyclictest18-21rcuc/109:41:211
2853899474,36cyclictest0-21swapper/110:48:561
2853899474,35cyclictest0-21swapper/109:23:441
28538994730,11cyclictest5637-21sed08:33:511
28541994626,11cyclictest2110-21crond08:28:323
2853899469,31cyclictest2115-21sadc08:28:321
28538994631,10cyclictest14048-21gltestperf07:43:531
2853899463,37cyclictest0-21swapper/111:18:361
28538994619,9cyclictest16509-21cat10:34:001
28538994616,24cyclictest17886-21cat07:53:341
2853899458,31cyclictest17396-21fschecks_time08:58:471
2853899454,34cyclictest0-21swapper/107:11:471
2853899453,11cyclictest0-21swapper/111:38:301
32482443,9sleep10-21swapper/107:21:411
2853899448,30cyclictest201ktimersoftd/108:18:481
2853899444,34cyclictest0-21swapper/107:14:011
28538994420,7cyclictest10653-21cat07:38:351
28538994410,29cyclictest16414-21munin-node11:23:521
2853899438,29cyclictest201ktimersoftd/108:03:461
2853899438,29cyclictest201ktimersoftd/108:03:461
2853899436,31cyclictest0-21swapper/108:49:581
2853899436,31cyclictest0-21swapper/108:49:581
28538994327,10cyclictest6865-21gltestperf07:28:541
28538994319,7cyclictest5909-21cat07:28:351
28538994228,9cyclictest11508-21perl07:38:511
43782402,32sleep10-21swapper/108:31:281
28541994027,7cyclictest0-21swapper/307:08:353
28538994024,10cyclictest18804-21tail07:53:541
2853899343,26cyclictest0-21swapper/107:08:351
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional