You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-16 - 17:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Thu Jul 16, 2026 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1710422160,2sleep30-21swapper/307:10:193
1965621510,12sleep11718599cyclictest11:35:441
17184991492,125cyclictest0-21swapper/011:50:390
171849914254,64cyclictest7950irq/56-dwc_otg_10:40:360
17184991372,108cyclictest21951-21ls09:40:470
17184991372,106cyclictest18261-21apt10:55:330
17184991372,106cyclictest18261-21apt10:55:330
171849913653,47cyclictest7950irq/56-dwc_otg_11:25:320
171849913653,47cyclictest7950irq/56-dwc_otg_11:25:320
171849912634,69cyclictest7850irq/56-dwc_otg10:50:420
17184991234,97cyclictest0-21swapper/009:35:320
17184991223,96cyclictest0-21swapper/011:40:500
171849912112,8cyclictest7850irq/56-dwc_otg11:55:460
171849912112,8cyclictest7850irq/56-dwc_otg11:55:460
17184991202,97cyclictest0-21swapper/009:25:460
17184991193,26cyclictest7950irq/56-dwc_otg_09:20:480
171849911631,24cyclictest0-21swapper/011:10:340
17184991162,28cyclictest0-21swapper/011:35:490
17184991153,85cyclictest0-21swapper/009:10:490
17184991153,85cyclictest0-21swapper/009:10:490
17184991145,92cyclictest0-21swapper/010:45:440
17184991135,85cyclictest0-21swapper/010:05:410
17184991103,76cyclictest26890-21fschecks_time11:05:370
17184991094,9cyclictest8050irq/56-dwc_otg_09:30:330
17184991053,78cyclictest12264-21unixbench-2d12:05:510
17184991034,79cyclictest2576-21fschecks_count11:15:360
574121010,5sleep11718599cyclictest10:40:191
1815021010,2sleep318151-21ssh11:34:453
39982970,12sleep31718799cyclictest11:55:473
39982970,12sleep31718799cyclictest11:55:473
1718699972,9cyclictest10542-21apt-get11:25:312
1718699972,9cyclictest10542-21apt-get11:25:312
17184999429,56cyclictest0-21swapper/009:15:300
1718499942,30cyclictest521-21munin-node12:30:310
17186999218,67cyclictest10006-21ssh10:05:412
17186999110,64cyclictest0-21swapper/209:55:442
17184999131,54cyclictest101ktimersoftd/010:35:260
17184999119,18cyclictest1778-21ssh09:55:430
301422900,3sleep11718599cyclictest10:30:331
17186999012,63cyclictest7950irq/56-dwc_otg_12:05:472
1718499902,10cyclictest17769-21diskstats10:15:360
17184998932,44cyclictest7950irq/56-dwc_otg_08:00:190
1718699888,19cyclictest8050irq/56-dwc_otg_09:40:502
1718699884,9cyclictest8050irq/56-dwc_otg_09:20:482
17186998812,10cyclictest4018-21tail11:55:472
17186998812,10cyclictest4018-21tail11:55:472
17184998848,22cyclictest9714-21kworker/0:111:30:370
1718499882,74cyclictest0-21swapper/011:00:430
1718699873,18cyclictest14993-21ssh11:30:372
1718699863,19cyclictest2608-21fschecks_count11:15:362
1718699863,19cyclictest14786-21memory10:50:412
19732850,4sleep11971-21apt11:15:181
184162850,3sleep118394-21timerandwakeup08:40:461
17186998511,50cyclictest1745-21ssh10:35:262
112172850,12sleep31718799cyclictest10:45:493
1718699844,60cyclictest0-21swapper/211:10:322
1718699844,11cyclictest0-21swapper/210:20:372
17187998319,48cyclictest19791-21ls11:35:463
1718699833,10cyclictest0-21swapper/210:55:322
1718699833,10cyclictest0-21swapper/210:55:322
1718699832,17cyclictest19693-21ssh11:35:442
17186998321,54cyclictest7090-21sed10:40:502
17187998247,30cyclictest0-21swapper/311:10:343
1718699825,10cyclictest0-21swapper/209:30:332
1718699824,16cyclictest7661-21grep11:20:472
1718699824,12cyclictest9662-21grep09:25:462
1718699823,17cyclictest11306-21grep10:45:502
17186998212,63cyclictest0-21swapper/211:05:382
17184998221,3cyclictest0-21swapper/007:25:300
1718799817,27cyclictest21674-21ssh10:20:323
1718799812,48cyclictest26891-21grep11:05:373
1718499813,60cyclictest0-21swapper/011:20:490
171362810,4sleep317137-21/usr/sbin/munin09:35:393
1718699803,40cyclictest31742-21ssh11:50:392
1718699803,10cyclictest29187-21ssh09:10:412
1718699803,10cyclictest29187-21ssh09:10:412
17186998020,53cyclictest0-21swapper/211:40:502
1718499801,25cyclictest0-21swapper/010:21:490
1718499801,20cyclictest0-21swapper/009:45:340
8092790,2sleep30-21swapper/309:55:203
8092790,2sleep30-21swapper/309:55:203
1718699794,12cyclictest31665-21apt-get12:30:322
1718599793,58cyclictest12323-21unixbench_multi12:05:521
276082770,2sleep10-21swapper/111:45:391
1718699775,22cyclictest17743-21ssh10:15:332
1718599774,52cyclictest7950irq/56-dwc_otg_10:40:491
17184997718,25cyclictest0-21swapper/009:05:310
1718499771,67cyclictest0-21swapper/012:20:280
17185997633,11cyclictest23-21ksoftirqd/109:25:481
205032750,6sleep11718599cyclictest12:15:461
1718499741,23cyclictest14121-21cut08:30:350
294452730,2sleep30-21swapper/310:29:543
1718599733,39cyclictest26881-21fschecks_time11:05:361
17185997312,25cyclictest24121-21seq11:40:501
1718499732,32cyclictest11958-21latency_hist08:25:190
1718499731,31cyclictest25256-21/usr/sbin/munin07:30:420
1718599723,24cyclictest0-21swapper/110:45:501
17184997220,4cyclictest8050irq/56-dwc_otg_08:05:470
1718499721,22cyclictest0-21swapper/010:10:410
1718699714,10cyclictest0-21swapper/209:35:312
1718599713,38cyclictest11-21rcu_preempt12:30:331
17184997115,10cyclictest18953-21modprobe12:15:180
1718799708,21cyclictest0-21swapper/312:35:263
17187997023,14cyclictest7950irq/56-dwc_otg_11:50:423
1718599703,21cyclictest4003-21unixbench_multi11:55:471
1718599703,21cyclictest4003-21unixbench_multi11:55:471
17185997013,14cyclictest14813-21ssh10:50:431
1718499702,15cyclictest0-21swapper/007:40:480
1718499701,56cyclictest0-21swapper/008:35:370
1718499701,56cyclictest0-21swapper/008:35:370
1718499692,52cyclictest17799-21fschecks_time08:40:370
1718799686,14cyclictest7950irq/56-dwc_otg_12:05:303
17187996837,10cyclictest10561-21ssh11:25:323
17187996837,10cyclictest10561-21ssh11:25:323
17187996819,21cyclictest24207-21ssh11:40:523
17187996814,45cyclictest18294-21sh10:55:333
17187996814,45cyclictest18294-21sh10:55:333
17187996717,20cyclictest0-21swapper/311:15:373
17187996711,31cyclictest381ktimersoftd/309:20:473
1718699674,6cyclictest7850irq/56-dwc_otg08:05:482
1718499674,13cyclictest0-21swapper/012:29:440
1718499672,54cyclictest29555-21fschecks_time09:50:350
1718499672,54cyclictest29555-21fschecks_time09:50:350
1718499671,28cyclictest23411-21latency08:55:400
1718499671,21cyclictest0-21swapper/012:00:390
1718599662,12cyclictest7648-21ssh11:20:481
1718499666,50cyclictest0-21swapper/010:25:250
17184996617,16cyclictest0-21swapper/009:04:030
1718599659,42cyclictest8050irq/56-dwc_otg_09:55:441
1718599655,30cyclictest0-21swapper/111:15:361
17185996538,10cyclictest23-21ksoftirqd/111:30:351
1718599653,20cyclictest31887-21ntp_offset11:50:421
17186996412,9cyclictest8050irq/56-dwc_otg_09:50:282
17186996412,9cyclictest8050irq/56-dwc_otg_09:50:282
1718599645,27cyclictest23-21ksoftirqd/111:25:321
1718599645,27cyclictest23-21ksoftirqd/111:25:321
1718499641,50cyclictest12172-21aten_rbpower_vo08:25:320
1718799634,27cyclictest0-21swapper/310:40:353
1718699637,11cyclictest32644-21ssh09:15:302
1718699631,4cyclictest7850irq/56-dwc_otg07:30:452
1718599639,20cyclictest0-21swapper/110:55:321
1718599639,20cyclictest0-21swapper/110:55:321
1718599634,21cyclictest5667-21ssh09:20:491
17185996318,25cyclictest21659-21ssh10:20:301
1718499637,45cyclictest17182-21cyclictest07:20:410
1718499632,46cyclictest1540-21latency_hist10:35:200
1718499631,22cyclictest0-21swapper/008:00:360
1718499631,22cyclictest0-21swapper/008:00:360
1718499631,21cyclictest21663-21sh12:17:420
1718799625,6cyclictest0-21swapper/309:25:293
17187996219,27cyclictest22155-21sed09:40:513
1718599618,27cyclictest23-21ksoftirqd/109:10:421
1718599618,27cyclictest23-21ksoftirqd/109:10:421
1718599613,28cyclictest0-21swapper/109:35:331
1718499616,38cyclictest0-21swapper/011:45:460
1718799606,30cyclictest28379-21/usr/sbin/munin09:10:493
1718799606,30cyclictest28379-21/usr/sbin/munin09:10:493
17187996016,21cyclictest8050irq/56-dwc_otg_10:00:303
1718699609,11cyclictest8469-21ssh12:01:122
1718699601,5cyclictest7850irq/56-dwc_otg10:30:332
1718799593,39cyclictest0-21swapper/309:30:323
1718799591,30cyclictest0-21swapper/307:40:293
1718699591,5cyclictest7850irq/56-dwc_otg09:45:362
1718599595,25cyclictest0-21swapper/109:40:491
17184995916,27cyclictest7288-21apt-key12:40:190
1718799589,28cyclictest7695-21unixbench_singl11:20:483
1718799589,13cyclictest0-21swapper/309:00:303
1718699585,4cyclictest7950irq/56-dwc_otg_08:00:202
1718699581,11cyclictest8050irq/56-dwc_otg_12:20:342
1718599583,22cyclictest10000-21ntpq10:05:411
1718499582,42cyclictest0-21swapper/007:10:440
17184995819,10cyclictest0-21swapper/008:45:300
17187995718,20cyclictest1842-21processes09:55:443
17187995715,21cyclictest12254-21kworker/u8:010:35:253
1718699574,10cyclictest8050irq/56-dwc_otg_08:00:402
1718699574,10cyclictest8050irq/56-dwc_otg_08:00:402
1718799569,10cyclictest7950irq/56-dwc_otg_08:10:303
1718799563,27cyclictest0-21swapper/312:30:303
17187995612,10cyclictest8050irq/56-dwc_otg_10:10:313
1718699562,13cyclictest0-21swapper/212:26:392
1718499562,42cyclictest0-21swapper/008:10:400
1718799553,8cyclictest0-21swapper/310:50:523
1718599559,25cyclictest8050irq/56-dwc_otg_10:15:341
1718499551,42cyclictest5668-21/usr/sbin/munin10:00:400
1718499543,40cyclictest0-21swapper/007:45:290
1718499542,36cyclictest0-21swapper/007:15:290
1718499542,36cyclictest0-21swapper/007:15:290
1718799535,6cyclictest0-21swapper/307:20:323
1718699537,5cyclictest8050irq/56-dwc_otg_12:35:342
1718699536,11cyclictest0-21swapper/208:31:002
1718599536,25cyclictest12627-21ssh09:30:321
1718599534,33cyclictest0-21swapper/107:40:301
1718799524,9cyclictest17526-21ssh10:15:303
17184995229,7cyclictest21202-21aten_rbpower_vo08:50:320
17184995223,15cyclictest0-21swapper/007:50:280
1718499521,36cyclictest0-21swapper/008:15:340
64412510,4sleep16442-21latency_hist08:10:191
17184995117,18cyclictest27381-21unixbench_singl07:35:460
1718799503,11cyclictest0-21swapper/308:50:283
17187995011,18cyclictest381ktimersoftd/310:05:413
1718599503,24cyclictest0-21swapper/109:00:301
1718599497,19cyclictest0-21swapper/107:20:321
17185994815,3cyclictest7850irq/56-dwc_otg12:20:301
1718599477,8cyclictest0-21swapper/108:45:301
166102473,11sleep00-21swapper/007:06:210
1718799467,25cyclictest27589-21ssh12:25:313
1718799467,24cyclictest0-21swapper/308:05:333
1718799467,24cyclictest0-21swapper/307:50:303
1718799466,27cyclictest6953-21runrttasks12:00:323
1718799466,26cyclictest0-21swapper/308:15:333
17186994611,2cyclictest0-21swapper/210:00:382
1718599468,24cyclictest0-21swapper/108:25:241
1718599466,24cyclictest0-21swapper/107:15:311
1718599466,24cyclictest0-21swapper/107:15:311
1718799457,24cyclictest0-21swapper/308:35:323
1718799457,24cyclictest0-21swapper/308:35:323
1718699451,15cyclictest0-21swapper/212:17:442
1718599457,25cyclictest0-21swapper/108:15:331
1718599447,26cyclictest0-21swapper/109:45:241
1718599447,24cyclictest0-21swapper/108:10:241
17185994423,6cyclictest27819-21sh12:25:341
1718699438,5cyclictest7950irq/56-dwc_otg_08:20:332
1718699437,25cyclictest0-21swapper/208:25:312
1718599437,26cyclictest0-21swapper/108:30:311
232292420,3sleep323226-21ssh12:20:193
1718799426,5cyclictest7850irq/56-dwc_otg10:30:303
1718599423,16cyclictest0-21swapper/108:55:401
1718599417,25cyclictest0-21swapper/109:15:251
1718599416,13cyclictest0-21swapper/111:00:311
1718699403,6cyclictest0-21swapper/208:45:302
1718699402,24cyclictest8050irq/56-dwc_otg_10:25:352
1718699401,4cyclictest0-21swapper/207:50:292
17187993920,5cyclictest37-21rcuc/307:30:283
1718799389,14cyclictest7950irq/56-dwc_otg_11:45:313
1718699381,29cyclictest9978-21ls08:20:192
1718699381,29cyclictest13690-21cut10:10:362
1718599381,25cyclictest16530-21ls08:35:451
1718599381,25cyclictest16530-21ls08:35:451
1718799376,23cyclictest0-21swapper/312:20:303
1718599378,7cyclictest8050irq/56-dwc_otg_07:55:381
1718599374,17cyclictest0-21swapper/110:10:311
1718599373,22cyclictest22110-21ls08:50:451
17185993717,13cyclictest23-21ksoftirqd/110:00:301
17185993712,8cyclictest8050irq/56-dwc_otg_12:10:331
17187993616,12cyclictest37-21rcuc/307:35:443
1718799361,24cyclictest19539-21ls07:15:383
1718799361,24cyclictest19539-21ls07:15:383
1718699361,21cyclictest0-21swapper/208:40:322
1718599368,5cyclictest8050irq/56-dwc_otg_10:25:251
1718599364,5cyclictest0-21swapper/108:00:321
1718599364,5cyclictest0-21swapper/108:00:321
1718599361,28cyclictest11748-21ls08:25:191
1718799352,7cyclictest0-21swapper/311:00:313
1718799351,26cyclictest4457-21ls08:05:193
1718799351,26cyclictest4457-21ls08:05:193
1718599359,7cyclictest3407-21sh12:35:261
1718799341,7cyclictest2493950rm09:45:203
1718699346,15cyclictest0-21swapper/207:35:312
1718699342,7cyclictest27200-21ntp_states09:05:422
1718799337,14cyclictest0-21swapper/308:55:323
1718799337,13cyclictest0-21swapper/308:20:323
1718799334,5cyclictest23717-21unixbench_multi07:25:473
1718799331,24cyclictest19799-21latency08:45:393
1718799331,21cyclictest14820-21ls08:30:453
1718799331,17cyclictest1157-21swap09:15:453
1718599337,5cyclictest8050irq/56-dwc_otg_09:55:201
1718599337,5cyclictest8050irq/56-dwc_otg_09:55:201
1718599332,8cyclictest981-21sed07:55:201
1718799321,14cyclictest8050irq/56-dwc_otg_07:45:413
1718699322,8cyclictest8050irq/56-dwc_otg_07:15:352
1718699322,8cyclictest8050irq/56-dwc_otg_07:15:352
17186993221,8cyclictest27324-21fschecks_time11:45:352
17186993211,8cyclictest18018-21sh12:13:372
1718699321,13cyclictest0-21swapper/208:35:412
1718699321,13cyclictest0-21swapper/208:35:412
17186993211,11cyclictest29213-21grep07:40:462
1718599322,5cyclictest7688-21tr12:00:421
1718599321,3cyclictest7850irq/56-dwc_otg07:25:301
165702327,15sleep10-21swapper/107:05:571
20162310,3sleep32018-21timerwakeupswit07:55:483
1718799314,7cyclictest7950irq/56-dwc_otg_12:15:183
1718799314,12cyclictest7950irq/56-dwc_otg_07:10:333
1718799311,21cyclictest12318-21uniq08:25:353
1718699311,6cyclictest23346-21/usr/sbin/munin11:00:442
17186993113,6cyclictest25149-21interrupts09:00:382
1718699307,4cyclictest7950irq/56-dwc_otg_07:10:462
1718699304,3cyclictest7950irq/56-dwc_otg_07:25:292
1718699303,8cyclictest0-21swapper/207:20:312
1718699303,5cyclictest8050irq/56-dwc_otg_08:10:442
1718599305,11cyclictest7950irq/56-dwc_otg_07:30:431
1718599304,7cyclictest27646-21grep09:05:471
1718599301,8cyclictest0-21swapper/107:45:301
1718799297,19cyclictest0-21swapper/308:40:323
1718799292,8cyclictest0-21swapper/309:05:313
1718699292,6cyclictest8050irq/56-dwc_otg_07:50:192
1718699286,4cyclictest7850irq/56-dwc_otg08:55:312
1718699281,15cyclictest7950irq/56-dwc_otg_08:50:422
1718599285,13cyclictest8050irq/56-dwc_otg_07:35:301
165612273,15sleep20-21swapper/207:05:502
1718599263,6cyclictest0-21swapper/107:13:331
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional