You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 13:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Tue Jun 16, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2783321500,7sleep32852999cyclictest12:12:353
1454021210,2sleep2281ktimersoftd/210:17:292
285229910013,68cyclictest0-21swapper/009:27:460
189402970,4sleep2281ktimersoftd/209:34:322
2852299954,23cyclictest6309-21ssh10:52:390
2852299944,25cyclictest0-21swapper/010:42:550
2852299934,22cyclictest1005-21ssh12:19:300
28522999316,11cyclictest0-21swapper/009:02:470
2852299926,64cyclictest0-21swapper/010:47:460
2852299924,25cyclictest0-21swapper/010:57:420
28522999217,12cyclictest0-21swapper/011:37:280
28522999216,12cyclictest0-21swapper/010:37:380
2852299916,22cyclictest0-21swapper/011:17:540
2852299915,70cyclictest0-21swapper/011:02:430
28522999121,51cyclictest0-21swapper/008:57:510
28522999117,12cyclictest0-21swapper/009:12:430
28522999117,12cyclictest0-21swapper/009:12:430
2852299909,21cyclictest0-21swapper/012:09:530
2852299906,67cyclictest0-21swapper/008:08:000
2852299905,61cyclictest0-21swapper/010:07:560
2852299904,25cyclictest0-21swapper/012:06:200
2852299904,25cyclictest0-21swapper/010:02:250
2852299904,24cyclictest0-21swapper/011:27:450
2852299904,22cyclictest0-21swapper/010:12:440
2852299903,23cyclictest1104-21ssh09:08:050
28522999019,12cyclictest0-21swapper/012:15:060
28522999014,12cyclictest0-21swapper/009:32:430
2852299897,23cyclictest0-21swapper/011:22:570
2852299894,77cyclictest0-21swapper/012:00:400
2852299894,76cyclictest26718-21grep10:33:030
2852299894,76cyclictest26718-21grep10:33:030
2852299894,62cyclictest0-21swapper/007:32:570
2852299894,25cyclictest0-21swapper/011:47:400
2852299894,25cyclictest0-21swapper/011:35:200
2852299894,25cyclictest0-21swapper/011:14:360
2852299894,25cyclictest0-21swapper/011:14:360
2852299894,25cyclictest0-21swapper/010:24:330
2852299894,24cyclictest0-21swapper/009:55:000
2852299894,24cyclictest0-21swapper/009:55:000
2852299894,22cyclictest0-21swapper/010:30:150
2852299894,22cyclictest0-21swapper/010:30:150
2852299893,25cyclictest0-21swapper/010:02:320
28522998917,12cyclictest0-21swapper/009:42:510
2852299886,65cyclictest0-21swapper/008:53:350
2852299886,24cyclictest0-21swapper/009:41:140
2852299884,23cyclictest0-21swapper/010:21:490
28522998815,12cyclictest0-21swapper/011:42:580
2852299874,25cyclictest0-21swapper/011:55:310
2852299874,25cyclictest0-21swapper/011:55:310
2852299874,25cyclictest0-21swapper/009:24:050
2852299874,24cyclictest0-21swapper/008:21:440
2852299874,23cyclictest0-21swapper/011:12:220
2852299873,25cyclictest0-21swapper/007:28:180
28522998720,11cyclictest0-21swapper/009:17:560
28522998718,12cyclictest0-21swapper/007:42:490
2852299864,73cyclictest0-21swapper/008:02:340
2852299864,23cyclictest0-21swapper/009:49:070
2852299863,76cyclictest19433-21cpuspeed_turbos08:47:470
2852299863,28cyclictest0-21swapper/007:38:060
2852299856,15cyclictest0-21swapper/006:52:360
2852299844,28cyclictest0-21swapper/008:14:000
2852299834,27cyclictest0-21swapper/007:07:550
2852299834,27cyclictest0-21swapper/007:07:550
28522998319,12cyclictest0-21swapper/006:57:510
2852299825,60cyclictest0-21swapper/008:33:010
2852299814,26cyclictest0-21swapper/007:22:360
2852299814,21cyclictest0-21swapper/008:22:560
2852299804,29cyclictest0-21swapper/007:03:080
28522998025,47cyclictest1227-21runrttasks07:48:060
28522998025,47cyclictest1227-21runrttasks07:48:060
28522997923,50cyclictest0-21swapper/007:12:590
28522997914,12cyclictest0-21swapper/008:42:450
28522997911,9cyclictest107550irq/46-eth008:31:460
28522997911,9cyclictest107550irq/46-eth008:31:460
28522997816,13cyclictest0-21swapper/007:27:360
2852299774,24cyclictest0-21swapper/008:02:460
2852299769,8cyclictest107550irq/46-eth007:53:020
2852299754,12cyclictest0-21swapper/006:52:530
28522997520,8cyclictest15915-21timerwakeupswit08:38:040
219499690,5rtkit-daemon2193-21rtkit-daemon08:13:082
263842640,4sleep126406-21wc10:33:011
263842640,4sleep126406-21wc10:33:011
28528996342,13cyclictest0-21swapper/211:12:582
28528996342,13cyclictest0-21swapper/211:12:582
28528996246,10cyclictest0-21swapper/211:40:492
28528996141,13cyclictest0-21swapper/209:52:492
28528996141,13cyclictest0-21swapper/209:52:492
2852899613,37cyclictest0-21swapper/209:26:352
2852599614,51cyclictest0-21swapper/109:48:061
28528996045,10cyclictest0-21swapper/211:11:062
28528996044,11cyclictest0-21swapper/211:06:522
2852599605,14cyclictest0-21swapper/110:03:581
201152603,13sleep20-21swapper/209:37:432
2852999595,46cyclictest0-21swapper/309:32:473
28529995941,12cyclictest0-21swapper/312:07:503
28529995941,12cyclictest0-21swapper/309:02:523
28529995941,12cyclictest0-21swapper/308:57:553
2852999594,48cyclictest0-21swapper/310:47:563
2852999593,50cyclictest0-21swapper/311:12:523
2852999593,50cyclictest0-21swapper/311:12:523
28528995945,9cyclictest0-21swapper/210:55:532
28528995944,10cyclictest0-21swapper/209:48:292
28528995941,12cyclictest0-21swapper/211:25:442
28528995936,18cyclictest0-21swapper/212:07:462
2852599595,14cyclictest0-21swapper/111:22:211
2852599594,48cyclictest0-21swapper/108:07:441
219499590,6rtkit-daemon2193-21rtkit-daemon08:52:442
161272593,12sleep30-21swapper/309:31:353
115272593,48sleep30-21swapper/310:58:433
317392580,6sleep30-21swapper/306:57:523
2852999585,46cyclictest0-21swapper/311:27:503
28529995839,12cyclictest0-21swapper/312:17:453
28528995838,13cyclictest0-21swapper/211:42:472
28528995838,13cyclictest0-21swapper/209:12:502
28528995838,13cyclictest0-21swapper/209:12:502
2852599585,16cyclictest0-21swapper/109:56:151
2852599585,16cyclictest0-21swapper/109:56:151
28525995823,29cyclictest9140-21ssh10:57:171
2852999575,46cyclictest0-21swapper/311:47:063
2852999575,45cyclictest0-21swapper/309:53:563
2852999575,45cyclictest0-21swapper/309:53:563
2852999574,46cyclictest0-21swapper/308:27:523
2852999574,46cyclictest0-21swapper/308:27:523
28529995738,14cyclictest0-21swapper/309:57:453
2852999572,50cyclictest0-21swapper/311:57:393
28528995741,11cyclictest0-21swapper/211:30:332
28528995741,10cyclictest0-21swapper/209:59:242
2852599574,8cyclictest2539-21unixbench_multi11:33:011
2852599574,47cyclictest22345-21ssh12:02:511
2852599574,47cyclictest0-21swapper/112:19:001
2852599574,14cyclictest0-21swapper/109:38:471
2852599574,12cyclictest0-21swapper/112:13:231
28525995739,11cyclictest2710-21tr08:12:481
28525995723,14cyclictest0-21swapper/111:12:441
28525995723,14cyclictest0-21swapper/111:12:441
219499570,6rtkit-daemon2193-21rtkit-daemon09:07:432
42462564,46sleep10-21swapper/111:37:391
2852999565,45cyclictest0-21swapper/310:54:283
28529995640,11cyclictest0-21swapper/311:26:093
2852999564,46cyclictest0-21swapper/310:12:233
2852999564,46cyclictest0-21swapper/309:38:543
2852999564,45cyclictest0-21swapper/309:48:093
2852999564,45cyclictest0-21swapper/307:18:103
28529995638,13cyclictest0-21swapper/309:17:453
2852999563,47cyclictest0-21swapper/310:42:433
2852999563,47cyclictest0-21swapper/308:38:013
2852999562,48cyclictest0-21swapper/311:32:463
28528995640,10cyclictest10878-21munin-node11:47:502
28528995629,13cyclictest0-21swapper/210:33:082
28528995629,13cyclictest0-21swapper/210:33:082
2852599565,15cyclictest0-21swapper/112:08:591
28525995621,15cyclictest0-21swapper/110:31:271
28525995621,15cyclictest0-21swapper/110:31:271
28525995621,10cyclictest32641-21ssh11:31:571
28525995618,23cyclictest0-21swapper/111:02:121
219499560,6rtkit-daemon2193-21rtkit-daemon08:37:442
151142563,8sleep115211-21smartctl08:37:521
2852999555,44cyclictest0-21swapper/310:14:513
2852999554,45cyclictest27032-21ssh10:34:063
2852999554,45cyclictest27032-21ssh10:34:063
2852999554,44cyclictest0-21swapper/311:07:433
28529995537,13cyclictest0-21swapper/309:12:363
28529995537,13cyclictest0-21swapper/309:12:363
28529995537,12cyclictest0-21swapper/312:06:113
28529995537,11cyclictest7011-21ssh10:04:513
2852999553,46cyclictest0-21swapper/306:52:383
2852999552,47cyclictest0-21swapper/311:53:023
2852999552,47cyclictest0-21swapper/311:53:023
2852999552,47cyclictest0-21swapper/310:24:373
2852999552,47cyclictest0-21swapper/310:21:293
28528995540,10cyclictest0-21swapper/210:52:202
28528995537,12cyclictest0-21swapper/209:05:132
28528995536,12cyclictest0-21swapper/210:57:422
2852899553,35cyclictest0-21swapper/212:04:532
2852599556,28cyclictest0-21swapper/110:47:551
2852599555,31cyclictest0-21swapper/110:42:381
2852599555,29cyclictest0-21swapper/111:04:591
2852599555,16cyclictest0-21swapper/108:55:021
2852599553,46cyclictest201ktimersoftd/110:08:051
2852599553,29cyclictest0-21swapper/111:46:081
28525995522,15cyclictest0-21swapper/110:22:451
28525995521,14cyclictest0-21swapper/109:57:481
219499550,5rtkit-daemon2193-21rtkit-daemon08:47:512
2852999545,42cyclictest0-21swapper/311:17:473
2852999544,45cyclictest0-21swapper/311:49:133
28529995438,10cyclictest0-21swapper/307:42:463
28529995436,12cyclictest0-21swapper/309:12:313
2852999543,44cyclictest0-21swapper/308:17:453
2852999542,46cyclictest0-21swapper/308:56:283
2852899545,41cyclictest0-21swapper/210:32:292
2852899545,41cyclictest0-21swapper/210:32:292
28528995438,9cyclictest18785-21cut10:22:472
28528995438,11cyclictest0-21swapper/211:54:472
28528995438,11cyclictest0-21swapper/211:54:472
28528995427,13cyclictest0-21swapper/209:43:002
2852599545,44cyclictest0-21swapper/109:10:461
2852599544,31cyclictest0-21swapper/111:07:501
2852599544,31cyclictest0-21swapper/110:12:451
2852599544,29cyclictest0-21swapper/111:23:111
2852599544,25cyclictest0-21swapper/109:42:421
2852599543,35cyclictest0-21swapper/109:33:271
28525995426,10cyclictest16574-21ssh09:32:321
219499540,6rtkit-daemon2193-21rtkit-daemon10:17:402
219499540,5rtkit-daemon2193-21rtkit-daemon08:42:442
219499540,5rtkit-daemon2193-21rtkit-daemon08:28:072
219499540,5rtkit-daemon2193-21rtkit-daemon08:28:072
2852999536,42cyclictest0-21swapper/309:26:493
28529995337,11cyclictest0-21swapper/309:45:283
28529995335,13cyclictest0-21swapper/311:06:313
28529995313,31cyclictest0-21swapper/308:07:443
28528995338,10cyclictest0-21swapper/211:36:352
28528995337,11cyclictest0-21swapper/211:19:472
28528995337,11cyclictest0-21swapper/210:44:232
28528995334,13cyclictest0-21swapper/207:01:312
28528995334,12cyclictest0-21swapper/211:57:552
2852599536,41cyclictest0-21swapper/108:58:001
2852599536,24cyclictest7343-21fschecks_time09:17:511
2852599536,14cyclictest0-21swapper/109:03:001
2852599535,30cyclictest0-21swapper/111:47:511
2852599535,28cyclictest0-21swapper/110:37:461
2852599534,31cyclictest0-21swapper/111:57:581
2852599534,29cyclictest0-21swapper/107:42:351
2852599534,29cyclictest0-21swapper/107:17:491
2852599534,29cyclictest0-21swapper/106:52:571
2852599534,28cyclictest0-21swapper/110:17:401
28525995337,9cyclictest10230-21grep09:22:461
28525995320,13cyclictest0-21swapper/107:16:331
219499530,6rtkit-daemon2193-21rtkit-daemon08:02:532
219499530,5rtkit-daemon2193-21rtkit-daemon10:02:482
219499530,5rtkit-daemon2193-21rtkit-daemon08:58:062
219499530,5rtkit-daemon2193-21rtkit-daemon08:07:532
219499530,5rtkit-daemon2193-21rtkit-daemon07:53:092
217772532,11sleep20-21swapper/207:43:072
2852999524,42cyclictest0-21swapper/311:37:563
28529995236,10cyclictest1756-21fschecks_count07:02:543
28529995235,12cyclictest0-21swapper/310:27:593
28529995235,12cyclictest0-21swapper/310:27:593
2852899524,41cyclictest0-21swapper/212:17:582
2852899524,41cyclictest0-21swapper/208:18:042
28528995237,10cyclictest0-21swapper/210:08:292
28528995236,12cyclictest0-21swapper/212:16:272
2852599524,42cyclictest0-21swapper/109:12:581
2852599524,42cyclictest0-21swapper/109:12:581
2852599524,28cyclictest0-21swapper/107:59:111
2852599524,28cyclictest0-21swapper/107:46:391
2852599523,36cyclictest0-21swapper/107:33:441
2852599523,29cyclictest0-21swapper/108:43:001
2852599523,28cyclictest0-21swapper/107:23:031
28525995222,12cyclictest0-21swapper/107:12:361
28525995222,12cyclictest0-21swapper/107:12:361
28525995221,15cyclictest0-21swapper/107:53:041
219499520,5rtkit-daemon2193-21rtkit-daemon09:30:502
183632522,10sleep30-21swapper/308:43:063
2852999515,40cyclictest0-21swapper/306:57:363
2852999513,43cyclictest0-21swapper/310:39:223
2852999512,44cyclictest0-21swapper/307:47:483
2852999512,44cyclictest0-21swapper/307:47:483
2852899515,39cyclictest0-21swapper/209:18:012
28528995138,8cyclictest31339-21munin-run10:42:282
28528995132,12cyclictest0-21swapper/207:13:052
28528995111,33cyclictest0-21swapper/207:17:582
2852599515,29cyclictest0-21swapper/107:48:041
2852599515,29cyclictest0-21swapper/107:48:041
2852599515,29cyclictest0-21swapper/107:03:101
2852599514,30cyclictest0-21swapper/111:55:001
2852599514,30cyclictest0-21swapper/111:55:001
2852599514,28cyclictest0-21swapper/108:22:441
2852599514,28cyclictest0-21swapper/108:21:451
28525995132,11cyclictest31419-21cpuspeed_turbos06:57:491
2852599513,28cyclictest0-21swapper/108:06:421
191102513,11sleep10-21swapper/108:47:431
151802512,9sleep30-21swapper/307:30:553
2852999505,29cyclictest0-21swapper/308:26:463
28528995035,9cyclictest28744-21munin-node06:53:052
28528995022,23cyclictest0-21swapper/207:30:152
2852599504,28cyclictest0-21swapper/107:27:461
295482492,42sleep30-21swapper/308:01:143
2852999494,29cyclictest0-21swapper/307:08:073
2852999494,29cyclictest0-21swapper/307:08:073
28529994921,13cyclictest0-21swapper/307:38:063
2852999492,41cyclictest0-21swapper/307:33:003
28528994933,10cyclictest0-21swapper/207:02:492
28528994931,12cyclictest0-21swapper/207:07:532
28528994931,12cyclictest0-21swapper/207:07:532
28528994924,13cyclictest0-21swapper/207:32:532
2852599498,24cyclictest13725-21users08:33:081
28525994916,10cyclictest0-21swapper/108:27:451
28525994916,10cyclictest0-21swapper/108:27:451
219499490,5rtkit-daemon2193-21rtkit-daemon08:32:592
28529994833,11cyclictest0-21swapper/308:12:513
2852999483,38cyclictest0-21swapper/307:22:493
28528994834,9cyclictest0-21swapper/208:23:062
28528994832,11cyclictest0-21swapper/207:23:012
219499480,5rtkit-daemon2193-21rtkit-daemon08:01:012
2852999474,37cyclictest0-21swapper/308:02:463
28528994727,10cyclictest0-21swapper/206:52:372
28528994722,13cyclictest0-21swapper/207:48:062
28528994722,13cyclictest0-21swapper/207:48:062
79172462,10sleep30-21swapper/307:14:303
2852999462,39cyclictest0-21swapper/307:53:023
209202462,38sleep30-21swapper/308:48:103
28529994530,9cyclictest12288-21cpuspeed_turbos08:32:473
28528994529,11cyclictest0-21swapper/207:37:472
2852599448,25cyclictest0-21swapper/106:52:371
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional