You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-28 - 07:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Tue Jul 28, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3010499994,70cyclictest0-21swapper/322:48:443
219499980,4rtkit-daemon2193-21rtkit-daemon21:01:383
30104999722,54cyclictest0-21swapper/323:23:583
30104999722,54cyclictest0-21swapper/323:23:583
3010499925,65cyclictest0-21swapper/320:45:403
3010499925,65cyclictest0-21swapper/320:45:403
3010499924,66cyclictest0-21swapper/322:29:393
3010499924,13cyclictest0-21swapper/318:48:563
3010499924,13cyclictest0-21swapper/318:24:013
3010499923,65cyclictest0-21swapper/320:18:523
3010499915,64cyclictest0-21swapper/321:43:413
3010499914,12cyclictest0-21swapper/322:19:503
30104999120,64cyclictest15807-21if_eth021:38:503
3010499904,64cyclictest0-21swapper/321:32:543
3010499904,60cyclictest0-21swapper/322:03:293
3010499904,60cyclictest0-21swapper/322:03:293
3010499904,12cyclictest0-21swapper/323:17:493
219499900,5rtkit-daemon2193-21rtkit-daemon21:23:070
3010499899,13cyclictest0-21swapper/321:18:413
3010499894,69cyclictest0-21swapper/323:33:483
3010499894,64cyclictest0-21swapper/321:25:343
3010499894,64cyclictest0-21swapper/321:25:343
3010499894,63cyclictest0-21swapper/323:00:193
3010499893,63cyclictest8522-21taskset23:06:023
30104998920,50cyclictest30388-21latency_hist21:13:303
3010499884,66cyclictest5315-21irqstats20:33:543
3010499884,66cyclictest0-21swapper/320:28:533
3010499884,61cyclictest0-21swapper/320:42:083
3010499884,61cyclictest0-21swapper/320:42:083
3010499884,12cyclictest0-21swapper/322:14:023
3010499884,12cyclictest0-21swapper/318:48:353
30104998818,55cyclictest0-21swapper/320:56:003
30104998816,46cyclictest0-21swapper/323:20:373
30104998813,9cyclictest29021-21ssh21:58:533
30104998813,9cyclictest29021-21ssh21:58:533
3010499874,62cyclictest0-21swapper/323:08:513
3010499874,60cyclictest0-21swapper/323:32:543
3010499874,60cyclictest0-21swapper/321:16:383
3010499874,59cyclictest0-21swapper/323:42:383
3010499874,13cyclictest0-21swapper/321:48:473
3010499874,11cyclictest421-21crond20:28:303
30104998718,47cyclictest0-21swapper/322:12:393
30104998714,50cyclictest0-21swapper/319:00:143
3010499869,10cyclictest107550irq/46-eth022:33:413
3010499864,14cyclictest0-21swapper/320:04:013
3010499863,61cyclictest0-21swapper/321:55:213
3010499854,58cyclictest0-21swapper/320:50:423
3010499854,12cyclictest0-21swapper/322:53:463
3010499854,12cyclictest0-21swapper/322:38:483
3010499854,12cyclictest0-21swapper/322:38:483
3010499853,67cyclictest0-21swapper/321:36:063
3010499853,64cyclictest14476-21runrttasks22:26:013
3010499844,64cyclictest0-21swapper/318:28:553
3010499844,57cyclictest0-21swapper/322:44:363
3010499844,57cyclictest0-21swapper/322:44:363
3010499844,57cyclictest0-21swapper/321:06:063
3010499844,14cyclictest0-21swapper/319:48:513
219499840,5rtkit-daemon2193-21rtkit-daemon23:31:020
219499830,26rtkit-daemon0-21swapper/021:25:370
219499830,26rtkit-daemon0-21swapper/021:25:370
3010499824,62cyclictest0-21swapper/320:15:113
3010499824,54cyclictest0-21swapper/319:14:073
3010499824,54cyclictest0-21swapper/318:56:283
3010499824,16cyclictest0-21swapper/318:15:343
30104998213,46cyclictest0-21swapper/319:53:443
3010499814,12cyclictest0-21swapper/318:43:363
3010499814,12cyclictest0-21swapper/318:43:363
30104998111,13cyclictest0-21swapper/319:35:203
3010499804,67cyclictest0-21swapper/318:33:493
3010499794,14cyclictest0-21swapper/319:45:073
3010499794,13cyclictest0-21swapper/319:38:513
3010499794,13cyclictest0-21swapper/319:05:143
30104997824,47cyclictest381-21processes19:24:023
3010499774,65cyclictest0-21swapper/319:28:553
3010499774,65cyclictest0-21swapper/318:19:413
3010499774,13cyclictest0-21swapper/319:58:443
3010499774,13cyclictest0-21swapper/319:58:443
3010499764,64cyclictest21533-21tail20:08:533
3010499764,15cyclictest0-21swapper/318:13:363
3010499754,63cyclictest0-21swapper/319:18:533
3010499754,63cyclictest0-21swapper/319:18:533
219499750,4rtkit-daemon2193-21rtkit-daemon20:36:472
3010499744,63cyclictest0-21swapper/319:09:033
219499730,5rtkit-daemon2193-21rtkit-daemon21:09:382
219499720,4rtkit-daemon2193-21rtkit-daemon22:11:132
219499710,4rtkit-daemon2193-21rtkit-daemon20:08:552
219499680,5rtkit-daemon2193-21rtkit-daemon23:08:182
219499680,5rtkit-daemon2193-21rtkit-daemon21:34:002
219499670,6rtkit-daemon2193-21rtkit-daemon20:16:032
219499670,5rtkit-daemon2193-21rtkit-daemon22:08:212
219499670,5rtkit-daemon2193-21rtkit-daemon22:08:212
219499670,5rtkit-daemon2193-21rtkit-daemon21:18:152
219499670,4rtkit-daemon2193-21rtkit-daemon23:38:252
219499670,4rtkit-daemon2193-21rtkit-daemon19:39:572
319622660,6sleep00-21swapper/022:03:460
319622660,6sleep00-21swapper/022:03:460
219499660,6rtkit-daemon2193-21rtkit-daemon21:50:512
219499660,5rtkit-daemon2193-21rtkit-daemon23:26:182
219499660,5rtkit-daemon2193-21rtkit-daemon23:26:182
219499660,5rtkit-daemon2193-21rtkit-daemon22:38:352
219499660,5rtkit-daemon2193-21rtkit-daemon22:38:352
219499660,5rtkit-daemon2193-21rtkit-daemon20:25:472
219499660,4rtkit-daemon2193-21rtkit-daemon23:02:192
219499660,4rtkit-daemon2193-21rtkit-daemon22:58:262
219499660,4rtkit-daemon2193-21rtkit-daemon21:44:372
219499660,4rtkit-daemon2193-21rtkit-daemon21:38:372
219499660,4rtkit-daemon2193-21rtkit-daemon19:56:032
3010399655,16cyclictest0-21swapper/223:13:482
219499650,5rtkit-daemon2193-21rtkit-daemon23:29:552
219499650,5rtkit-daemon2193-21rtkit-daemon22:52:492
219499650,4rtkit-daemon2193-21rtkit-daemon22:16:432
219499650,4rtkit-daemon2193-21rtkit-daemon21:01:462
219499650,4rtkit-daemon2193-21rtkit-daemon20:55:542
219499650,4rtkit-daemon2193-21rtkit-daemon20:49:162
219499650,4rtkit-daemon2193-21rtkit-daemon20:44:312
219499650,4rtkit-daemon2193-21rtkit-daemon20:44:312
219499650,4rtkit-daemon2193-21rtkit-daemon20:40:472
219499650,4rtkit-daemon2193-21rtkit-daemon20:40:472
219499650,4rtkit-daemon2193-21rtkit-daemon20:04:482
30103996415,24cyclictest12445-21sed23:13:242
219499640,5rtkit-daemon2193-21rtkit-daemon18:14:072
219499640,4rtkit-daemon2193-21rtkit-daemon22:45:492
219499640,4rtkit-daemon2193-21rtkit-daemon22:45:492
219499640,4rtkit-daemon2193-21rtkit-daemon21:58:442
219499640,4rtkit-daemon2193-21rtkit-daemon21:58:442
219499640,4rtkit-daemon2193-21rtkit-daemon21:53:362
219499640,4rtkit-daemon2193-21rtkit-daemon20:33:092
219499640,4rtkit-daemon2193-21rtkit-daemon20:19:322
3010399635,13cyclictest0-21swapper/221:18:482
219499630,5rtkit-daemon2193-21rtkit-daemon19:03:582
30102996245,11cyclictest20121-21runrttasks22:33:571
30101996241,12cyclictest24377-21ntp_kernel_pll_20:13:580
3010399614,38cyclictest0-21swapper/219:08:492
3010399604,13cyclictest0-21swapper/221:23:442
3010399604,13cyclictest0-21swapper/221:23:442
30103996014,24cyclictest0-21swapper/218:58:482
30102996041,12cyclictest0-21swapper/122:38:391
30102996041,12cyclictest0-21swapper/122:38:391
3010399593,39cyclictest0-21swapper/222:33:482
219499590,7rtkit-daemon0-21swapper/021:27:001
219499590,7rtkit-daemon0-21swapper/021:27:001
219499590,13rtkit-daemon2193-21rtkit-daemon21:03:462
104672593,48sleep00-21swapper/023:08:500
3010399583,37cyclictest0-21swapper/218:19:282
30103995725,14cyclictest0-21swapper/218:48:462
30102995728,12cyclictest0-21swapper/120:33:261
3010199574,45cyclictest0-21swapper/020:03:480
219499570,7rtkit-daemon0-21swapper/023:35:101
219499570,12rtkit-daemon2193-21rtkit-daemon23:19:552
219499570,12rtkit-daemon2193-21rtkit-daemon19:58:482
219499570,12rtkit-daemon2193-21rtkit-daemon19:58:482
98162563,48sleep09822-21ssh20:40:140
98162563,48sleep09822-21ssh20:40:140
3010399562,47cyclictest0-21swapper/218:24:402
30102995639,11cyclictest4070-21needreboot22:58:521
3010199565,43cyclictest0-21swapper/021:48:520
3010199565,42cyclictest0-21swapper/022:33:390
3010199564,45cyclictest0-21swapper/021:53:570
3010199564,30cyclictest1002-21sshd21:37:140
30101995637,13cyclictest0-21swapper/022:23:550
264172563,46sleep00-21swapper/023:33:410
3010399554,14cyclictest0-21swapper/221:30:232
30103995517,21cyclictest7355-21latency_hist18:33:362
30102995534,14cyclictest0-21swapper/121:39:551
30102995526,13cyclictest0-21swapper/121:36:461
3010199554,12cyclictest0-21swapper/022:28:590
30101995537,11cyclictest5544-21grep18:28:490
30101995531,9cyclictest10434-21tail19:44:050
169712554,45sleep00-21swapper/021:40:170
313092543,11sleep20-21swapper/223:40:212
3010299544,13cyclictest0-21swapper/121:33:271
30102995437,10cyclictest24770-21cut21:03:471
3010199545,24cyclictest0-21swapper/023:38:570
3010199544,42cyclictest0-21swapper/020:53:310
30101995434,13cyclictest0-21swapper/022:58:420
294022543,10sleep00-21swapper/021:09:450
255312544,43sleep00-21swapper/021:04:000
3010399534,20cyclictest0-21swapper/222:18:582
30103995311,20cyclictest0-21swapper/219:28:452
30102995338,10cyclictest0-21swapper/120:22:031
3010299533,25cyclictest9743-21hwlatdetect22:18:471
30102995324,13cyclictest0-21swapper/122:47:331
30102995324,13cyclictest0-21swapper/122:47:331
30102995317,9cyclictest5923-21timerwakeupswit20:34:031
3010199538,39cyclictest15-21rcuc/023:14:000
3010199535,39cyclictest0-21swapper/022:13:400
30101995338,9cyclictest18392-21sed20:53:500
30101995335,11cyclictest29669-21unixbench_multi21:59:030
30101995335,11cyclictest29669-21unixbench_multi21:59:030
30101995318,28cyclictest0-21swapper/021:28:540
243252533,44sleep10-21swapper/120:13:581
239072534,43sleep00-21swapper/019:06:300
217222533,43sleep00-21swapper/020:08:570
9292524,41sleep20-21swapper/219:25:182
82592522,10sleep10-21swapper/119:40:291
58032524,11sleep20-21swapper/219:34:332
3010399524,29cyclictest0-21swapper/222:28:412
30103995217,19cyclictest0-21swapper/222:24:002
3010299525,40cyclictest0-21swapper/118:38:481
3010299525,40cyclictest0-21swapper/118:38:481
3010299525,29cyclictest0-21swapper/122:53:391
3010299525,24cyclictest31788-21diskstats22:03:441
3010299525,24cyclictest31788-21diskstats22:03:441
3010299524,29cyclictest0-21swapper/123:23:441
3010299524,29cyclictest0-21swapper/123:23:441
3010199524,12cyclictest0-21swapper/020:21:310
30101995235,11cyclictest25858-21fschecks_count22:43:430
30101995235,11cyclictest25858-21fschecks_count22:43:430
30101995233,11cyclictest21857-21taskset23:26:520
30101995233,11cyclictest21857-21taskset23:26:520
30101995232,13cyclictest0-21swapper/020:33:530
30101995226,12cyclictest0-21swapper/021:46:100
30101995220,10cyclictest3519-21ssh22:08:540
23982523,9sleep00-21swapper/018:21:230
19532523,10sleep00-21swapper/022:56:320
181672522,9sleep10-21swapper/123:20:201
153262523,42sleep00-21swapper/019:54:140
324562512,43sleep10-21swapper/120:27:001
321222514,9sleep00-21swapper/020:25:500
312242513,9sleep00-21swapper/022:52:130
306172512,42sleep10-21swapper/122:49:521
3010399515,38cyclictest0-21swapper/219:14:082
3010299516,27cyclictest0-21swapper/121:03:251
3010299516,27cyclictest0-21swapper/120:50:171
3010299514,40cyclictest0-21swapper/121:17:181
30102995135,11cyclictest0-21swapper/123:11:511
30102995132,12cyclictest0-21swapper/122:23:541
3010299513,39cyclictest0-21swapper/123:28:361
30102995124,12cyclictest0-21swapper/122:02:431
30102995124,12cyclictest0-21swapper/122:02:431
30102995122,12cyclictest0-21swapper/122:29:021
3010199515,38cyclictest0-21swapper/020:28:490
3010199515,27cyclictest1227-21runrttasks20:43:430
3010199515,27cyclictest1227-21runrttasks20:43:430
30101995121,13cyclictest0-21swapper/019:29:040
30101995117,10cyclictest107550irq/46-eth019:33:530
30101995111,32cyclictest0-21swapper/023:03:360
219499510,4rtkit-daemon2193-21rtkit-daemon19:48:562
213452513,41sleep00-21swapper/018:59:290
166122514,41sleep00-21swapper/018:50:010
3010399505,27cyclictest0-21swapper/219:44:002
3010399504,28cyclictest0-21swapper/219:19:072
3010399504,28cyclictest0-21swapper/219:19:072
30103995010,12cyclictest0-21swapper/218:53:472
3010299505,28cyclictest0-21swapper/120:03:531
3010299505,27cyclictest0-21swapper/123:17:271
3010299505,26cyclictest0-21swapper/123:03:491
3010299504,28cyclictest0-21swapper/118:19:381
30102995030,13cyclictest0-21swapper/121:43:431
3010299503,43cyclictest0-21swapper/120:39:201
3010299503,43cyclictest0-21swapper/120:39:201
30102995023,12cyclictest0-21swapper/120:47:221
30102995023,12cyclictest0-21swapper/120:47:221
3010199505,27cyclictest0-21swapper/019:48:540
3010199504,39cyclictest0-21swapper/023:18:450
3010199504,38cyclictest0-21swapper/019:38:450
3010199504,28cyclictest0-21swapper/019:13:580
3010199504,25cyclictest22543-21ssh22:38:440
3010199504,25cyclictest22543-21ssh22:38:440
3010199503,11cyclictest0-21swapper/020:59:220
287812502,42sleep10-21swapper/119:17:521
310742493,40sleep00-21swapper/019:21:330
310742493,40sleep00-21swapper/019:21:330
3010299495,27cyclictest0-21swapper/119:08:571
3010299494,26cyclictest0-21swapper/120:56:121
3010299494,26cyclictest0-21swapper/119:05:201
3010299494,25cyclictest0-21swapper/118:14:041
3010299494,13cyclictest0-21swapper/121:08:431
30102994933,10cyclictest22838-21diskmemload22:14:001
30102994927,16cyclictest0-21swapper/121:54:571
30102994924,7cyclictest6204-21cat19:38:331
30102994919,12cyclictest0-21swapper/118:38:361
3010199495,13cyclictest0-21swapper/021:17:500
3010199494,37cyclictest0-21swapper/022:18:570
3010199494,28cyclictest0-21swapper/019:58:510
3010199494,28cyclictest0-21swapper/019:58:510
3010199494,27cyclictest0-21swapper/018:37:210
30101994931,11cyclictest11735-21unixbench_singl18:39:090
30101994931,11cyclictest11735-21unixbench_singl18:39:090
298102493,6sleep00-21swapper/018:10:160
196262493,39sleep10-21swapper/118:58:491
190182493,38sleep10-21swapper/118:55:141
144832493,10sleep20-21swapper/218:48:222
323572483,40sleep00-21swapper/018:17:120
3010299485,26cyclictest0-21swapper/122:09:571
3010299485,25cyclictest0-21swapper/123:43:071
3010299484,10cyclictest24348-21munin-run21:53:271
30102994832,9cyclictest13807-21cpuspeed_turbos19:53:461
3010199484,27cyclictest0-21swapper/018:53:450
30101994818,12cyclictest0-21swapper/018:24:110
15182482,7sleep11524-21aten_r1power_cu21:18:411
130312482,10sleep10-21swapper/119:50:321
48812472,39sleep10-21swapper/118:27:331
3010399474,26cyclictest0-21swapper/218:38:542
3010399474,26cyclictest0-21swapper/218:38:542
3010199474,26cyclictest0-21swapper/019:10:150
3010299464,28cyclictest0-21swapper/119:18:521
3010299464,28cyclictest0-21swapper/119:18:521
30102994630,9cyclictest9581-21gltestperf19:43:511
3010199468,32cyclictest0-21swapper/019:24:050
206722463,9sleep10-21swapper/120:08:341
179512462,38sleep10-21swapper/120:02:211
179512462,38sleep10-21swapper/120:02:211
3010399453,23cyclictest0-21swapper/218:33:482
3010299455,34cyclictest0-21swapper/118:44:071
3010299455,33cyclictest0-21swapper/119:28:331
30102994527,13cyclictest0-21swapper/118:29:041
30102994515,13cyclictest0-21swapper/118:48:531
142532453,36sleep00-21swapper/018:45:220
3010399444,12cyclictest0-21swapper/218:13:362
3010299444,33cyclictest0-21swapper/118:13:361
3010299434,33cyclictest0-21swapper/119:30:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional