You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 19:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Wed Sep 23, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8715991035,47cyclictest0-21swapper/011:55:380
3122321030,2sleep20-21swapper/209:24:232
871599971,82cyclictest0-21swapper/012:36:320
8715999418,20cyclictest7850irq/56-dwc_otg_11:35:400
76592920,2sleep30-21swapper/310:58:463
318052910,2sleep20-21swapper/210:05:502
8715998817,52cyclictest0-21swapper/010:55:240
8715998816,51cyclictest0-21swapper/008:11:140
8715998717,51cyclictest0-21swapper/007:15:540
8715998525,34cyclictest849-21ssh10:49:550
8715998525,34cyclictest849-21ssh10:49:550
8715998521,46cyclictest32730-21ssh09:25:480
8715998520,43cyclictest13229-21ssh09:41:550
8715998518,49cyclictest17409-21ssh10:29:220
8715998516,45cyclictest0-21swapper/010:05:380
8715998414,55cyclictest0-21swapper/012:33:500
8715998414,55cyclictest0-21swapper/012:33:500
222462840,4sleep2301ktimersoftd/207:45:492
8715998322,35cyclictest5230-21rm10:13:470
8715998321,41cyclictest22835-21cron09:55:250
8715998316,46cyclictest22676-21ssh09:12:590
8715998316,42cyclictest0-21swapper/011:25:260
8715998119,45cyclictest7270-21/usr/sbin/munin10:15:490
8715998117,49cyclictest29478-21sh12:06:520
8715998117,47cyclictest31836-21latency_hist09:25:260
8715998116,61cyclictest0-21swapper/010:00:420
8715998112,51cyclictest21140-21runrttasks07:44:240
8715998024,41cyclictest6774-21awk12:20:260
8715998019,40cyclictest14036-21awk07:25:250
8715998013,50cyclictest0-21swapper/007:25:380
55582800,5sleep05557-21missed_timers10:55:490
8715997937,10cyclictest12785-21apt-get11:05:360
8715997924,35cyclictest10491-21ssh09:39:150
8715997919,44cyclictest1254-21taskset08:16:070
8715997917,47cyclictest0-21swapper/012:04:270
8715997916,51cyclictest0-21swapper/011:35:050
8715997916,51cyclictest0-21swapper/011:35:050
8715997910,53cyclictest0-21swapper/009:47:210
8715997910,53cyclictest0-21swapper/009:47:210
8715997821,35cyclictest8902-21ssh12:21:420
8715997818,41cyclictest32040-21ssh11:30:080
8715997726,8cyclictest0-21swapper/009:30:400
8715997726,8cyclictest0-21swapper/009:30:400
8715997723,33cyclictest28018-21ssh10:42:110
8715997720,42cyclictest23417-21ssh09:55:420
8715997717,45cyclictest12544-21taskset08:49:020
8715997717,40cyclictest5185-21chrt08:28:370
8715997716,44cyclictest0-21swapper/010:24:130
8715997716,44cyclictest0-21swapper/010:24:130
871599762,6cyclictest7750irq/56-dwc_otg11:50:420
8715997616,42cyclictest353-21ssh12:10:590
8715997615,45cyclictest0-21swapper/011:47:180
8715997615,45cyclictest0-21swapper/011:47:180
8715997615,45cyclictest0-21swapper/011:45:120
8715997523,29cyclictest20230-21ssh11:15:130
8715997513,45cyclictest0-21swapper/008:08:480
224852740,2sleep20-21swapper/211:16:542
103022740,2sleep30-21swapper/311:01:123
871599737,28cyclictest0-21swapper/009:05:320
8715997320,39cyclictest20110-21ssh10:31:560
8715997317,40cyclictest26622-21seq07:59:040
8715997317,40cyclictest26622-21seq07:59:040
8715997316,41cyclictest23370-21/usr/sbin/munin07:50:500
8715997314,45cyclictest17382-21taskset07:32:310
8715997314,45cyclictest17382-21taskset07:32:310
8715997213,42cyclictest0-21swapper/011:17:440
269992720,2sleep30-21swapper/311:23:003
8715997116,41cyclictest26551-21ssh09:17:530
8715997017,41cyclictest3187-21taskset08:21:070
8715997017,41cyclictest3187-21taskset08:21:070
8715997015,42cyclictest0-21swapper/008:51:340
8715997014,42cyclictest24212-21ssh10:37:240
8715997013,39cyclictest12534-21runrttasks12:26:050
8715996918,30cyclictest0-21swapper/009:04:590
8715996914,44cyclictest10760-21runrttasks08:44:200
8715996815,41cyclictest0-21swapper/011:02:480
8715996723,28cyclictest16196-21chrt08:59:350
8715996615,39cyclictest0-21swapper/007:49:170
8715996613,40cyclictest0-21swapper/007:13:510
871599658,42cyclictest0-21swapper/008:03:570
8715996519,28cyclictest6929-21taskset08:31:310
8715996411,43cyclictest0-21swapper/008:38:510
319762640,2sleep20-21swapper/210:47:172
319762640,2sleep20-21swapper/210:47:172
120122640,4sleep212014-21cut11:45:402
120122640,4sleep212014-21cut11:45:402
8715996314,38cyclictest0-21swapper/007:39:360
137482630,2sleep30-21swapper/310:24:533
137482630,2sleep30-21swapper/310:24:533
93462620,2sleep10-21swapper/109:36:591
871699597,10cyclictest0-21swapper/111:35:391
871699593,13cyclictest0-21swapper/111:55:371
253472590,13sleep123-21ksoftirqd/111:20:481
871799588,25cyclictest0-21swapper/211:50:442
8716995710,29cyclictest0-21swapper/107:45:331
871899569,30cyclictest0-21swapper/308:05:413
871699568,31cyclictest0-21swapper/108:20:381
871699568,31cyclictest0-21swapper/108:20:381
871899558,30cyclictest0-21swapper/308:20:323
871899558,30cyclictest0-21swapper/308:20:323
871899548,29cyclictest0-21swapper/308:25:393
871699548,31cyclictest0-21swapper/107:50:391
871699547,29cyclictest0-21swapper/107:55:371
871699547,29cyclictest0-21swapper/107:55:371
871699542,5cyclictest0-21swapper/112:25:371
221462542,45sleep222153-21ssh10:35:372
871699533,13cyclictest0-21swapper/109:30:401
871699533,13cyclictest0-21swapper/109:30:401
871699531,9cyclictest7750irq/56-dwc_otg11:25:371
871899525,30cyclictest0-21swapper/309:05:323
871799527,22cyclictest0-21swapper/208:25:392
871699528,29cyclictest0-21swapper/111:45:391
871699528,29cyclictest0-21swapper/111:45:391
871699527,8cyclictest7950irq/56-dwc_otg_07:20:381
871699527,29cyclictest0-21swapper/110:40:381
871699518,29cyclictest0-21swapper/108:15:321
109592510,13sleep1871699cyclictest08:45:261
871799501,5cyclictest10473-21ssh10:20:412
871799501,5cyclictest10473-21ssh10:20:412
871699508,28cyclictest0-21swapper/108:35:401
871699501,37cyclictest18541-21ls10:30:461
871699498,31cyclictest0-21swapper/109:05:401
871699497,31cyclictest0-21swapper/111:30:421
871699497,31cyclictest0-21swapper/111:30:421
871699497,28cyclictest0-21swapper/112:20:391
871699488,7cyclictest0-21swapper/108:30:321
871699487,27cyclictest7750irq/56-dwc_otg07:15:261
8716994810,29cyclictest0-21swapper/109:00:401
871899478,26cyclictest15142-21ssh12:30:443
871899478,26cyclictest15142-21ssh12:30:443
871799471,4cyclictest20840-21ssh11:55:542
871699478,27cyclictest0-21swapper/110:00:411
871699478,27cyclictest0-21swapper/109:20:411
871899468,24cyclictest0-21swapper/307:15:323
871799461,31cyclictest7950irq/56-dwc_otg_08:40:412
871699468,25cyclictest0-21swapper/111:15:411
871799458,26cyclictest0-21swapper/208:05:412
871799458,19cyclictest0-21swapper/209:05:322
871799457,22cyclictest0-21swapper/208:20:322
871799457,22cyclictest0-21swapper/208:20:322
871799452,26cyclictest0-21swapper/207:15:322
8717994514,8cyclictest0-21swapper/212:05:552
871699453,30cyclictest0-21swapper/108:25:371
8716994525,6cyclictest21-21rcuc/109:58:161
8716994514,9cyclictest17938-21grep07:35:401
81102453,34sleep00-21swapper/007:06:100
150242450,2sleep20-21swapper/208:55:462
8717994431,4cyclictest0-21swapper/208:05:262
871799442,31cyclictest0-21swapper/207:25:392
871799441,30cyclictest10226-21ls10:20:262
871699448,29cyclictest0-21swapper/109:25:401
871699442,23cyclictest23757-21sh12:00:391
871699441,31cyclictest0-21swapper/109:50:431
871699441,28cyclictest29063-21uniq08:05:461
871899432,4cyclictest7950irq/56-dwc_otg_10:45:383
871899432,4cyclictest7950irq/56-dwc_otg_10:45:383
871799437,10cyclictest7950irq/56-dwc_otg_10:55:522
871799432,9cyclictest0-21swapper/209:55:372
8717994313,19cyclictest19984-21diskmemload11:22:562
871699432,6cyclictest7950irq/56-dwc_otg_07:25:381
871699432,6cyclictest0-21swapper/110:20:411
871699432,6cyclictest0-21swapper/110:20:411
871699431,30cyclictest31518-21ssh10:05:451
190482431,4sleep319095-21ntpq10:30:543
871899428,17cyclictest0-21swapper/310:50:563
871799421,29cyclictest0-21swapper/207:30:402
871799421,29cyclictest0-21swapper/207:30:402
8717994211,12cyclictest6305-21dpkg10:15:272
871699426,20cyclictest0-21swapper/107:40:381
871699424,6cyclictest0-21swapper/112:05:371
871699421,8cyclictest7850irq/56-dwc_otg_10:10:421
8716994210,5cyclictest7950irq/56-dwc_otg_12:15:421
8718994118,6cyclictest17937-21wget07:35:403
871799418,21cyclictest12113-21timerwakeupswit08:45:542
871799411,27cyclictest7736-21uniq08:35:432
871699418,22cyclictest0-21swapper/110:15:321
871699418,20cyclictest0-21swapper/107:15:331
871699417,22cyclictest21-21rcuc/109:50:241
871699417,22cyclictest21-21rcuc/109:50:241
871699415,21cyclictest25842-21latency_hist10:40:261
871699413,8cyclictest0-21swapper/107:30:381
871699413,8cyclictest0-21swapper/107:30:381
8716994122,6cyclictest23-21ksoftirqd/111:12:381
871699412,26cyclictest20645-21cut09:10:451
871699412,24cyclictest0-21swapper/110:49:231
871699412,24cyclictest0-21swapper/110:49:231
8716994122,11cyclictest8031-21aten_rbpower_en11:40:411
871699411,29cyclictest16090-21ls11:50:461
147412411,3sleep30-21swapper/311:48:563
147412411,3sleep30-21swapper/311:48:563
871899403,4cyclictest7950irq/56-dwc_otg_08:35:373
871899402,6cyclictest0-21swapper/308:15:383
871899401,5cyclictest0-21swapper/311:15:413
871899401,34cyclictest28797-21cpuspeed11:25:403
8718994010,13cyclictest0-21swapper/309:30:463
8718994010,13cyclictest0-21swapper/309:30:463
871799407,19cyclictest0-21swapper/209:35:442
871799402,21cyclictest0-21swapper/209:16:322
8717994018,6cyclictest20354-21ssh09:10:402
871799401,31cyclictest0-21swapper/209:50:432
871799401,27cyclictest0-21swapper/208:15:402
871799400,29cyclictest0-21swapper/211:25:542
871699407,19cyclictest7950irq/56-dwc_otg_08:50:261
871699405,21cyclictest7950irq/56-dwc_otg_11:05:381
871699404,25cyclictest0-21swapper/110:55:191
871699402,26cyclictest9964-21ls11:00:551
204762400,27sleep37950irq/56-dwc_otg_09:10:423
871899392,29cyclictest22822-21ssh10:35:493
8718993918,5cyclictest1180-21runrttasks11:41:423
871899391,26cyclictest7550-21uniq12:20:443
8717993921,10cyclictest27617-21ssh10:00:482
8717993919,5cyclictest27317-21unixbench_multi10:40:552
8717993914,12cyclictest7233-21aten_rbpower_cu12:20:392
871799391,26cyclictest9076-21timerwakeupswit11:40:552
871799391,25cyclictest24334-21ls12:00:492
871699397,6cyclictest7750irq/56-dwc_otg10:25:461
871699395,24cyclictest7750irq/56-dwc_otg09:41:211
871699393,9cyclictest0-21swapper/112:10:591
871699393,24cyclictest7750irq/56-dwc_otg09:17:501
8716993917,5cyclictest21-21rcuc/108:01:401
8716993916,5cyclictest5548-21sh10:55:491
871899382,22cyclictest0-21swapper/309:53:173
871899382,12cyclictest7750irq/56-dwc_otg11:10:523
871899381,24cyclictest15123-21ls09:45:263
871799388,18cyclictest0-21swapper/212:30:442
871799388,18cyclictest0-21swapper/212:30:442
8717993823,6cyclictest17140-21fschecks_time11:10:492
871799382,20cyclictest0-21swapper/212:38:102
8717993816,6cyclictest3456-21fschecks_time12:15:452
871799381,13cyclictest7950irq/56-dwc_otg_09:48:012
871799381,13cyclictest7950irq/56-dwc_otg_09:48:012
8718993729,5cyclictest19391-21ssh11:55:173
871899371,24cyclictest26743-21missed_timers10:40:473
871899371,23cyclictest3637-21timerwakeupswit10:10:583
871899371,16cyclictest7750irq/56-dwc_otg10:05:353
871799377,20cyclictest7850irq/56-dwc_otg_12:10:532
8717993721,8cyclictest7950irq/56-dwc_otg_11:07:482
8717993720,10cyclictest20891-21sh10:33:332
871799371,23cyclictest13452-21ls07:20:542
871799371,15cyclictest0-21swapper/209:32:242
871799371,15cyclictest0-21swapper/209:32:242
871699379,10cyclictest0-21swapper/112:30:541
871699379,10cyclictest0-21swapper/112:30:541
244572370,4sleep324440-21ssh09:15:423
871899369,15cyclictest0-21swapper/310:30:243
871899367,6cyclictest7850irq/56-dwc_otg_09:50:273
871899367,6cyclictest7850irq/56-dwc_otg_09:50:273
871899367,15cyclictest7950irq/56-dwc_otg_12:29:533
871899363,16cyclictest7950irq/56-dwc_otg_09:55:453
8718993626,6cyclictest23413-21latency_hist12:00:253
871899361,8cyclictest18084-21apt-get09:05:253
8718993616,7cyclictest7903-21idleruntime09:35:453
8718993611,18cyclictest27095-21sh10:00:383
8718993610,9cyclictest0-21swapper/312:38:373
871799369,11cyclictest7950irq/56-dwc_otg_11:30:512
871799369,11cyclictest7950irq/56-dwc_otg_11:30:512
871799368,26cyclictest0-21swapper/211:00:402
871799362,20cyclictest0-21swapper/208:13:562
871799362,16cyclictest0-21swapper/207:40:482
871799361,25cyclictest0-21swapper/211:37:322
8717993610,16cyclictest12338-21sensors_temp09:40:532
871699369,6cyclictest23-21ksoftirqd/112:38:301
871699363,24cyclictest0-21swapper/108:58:391
88422350,3sleep30-21swapper/310:17:563
871899359,12cyclictest0-21swapper/311:36:293
8718993524,7cyclictest24076-21fschecks_count12:00:463
871899351,5cyclictest0-21swapper/311:35:273
871899351,5cyclictest0-21swapper/311:35:273
8718993515,6cyclictest1180-21runrttasks08:54:233
8718993514,6cyclictest1180-21runrttasks12:14:013
871899351,23cyclictest19837-21cpuspeed07:40:403
871899351,23cyclictest0-21swapper/312:05:313
8718993510,12cyclictest7950irq/56-dwc_otg_07:20:553
871799351,19cyclictest7850irq/56-dwc_otg_09:05:252
871899349,15cyclictest4301-21grep12:15:563
871899345,15cyclictest7850irq/56-dwc_otg_09:20:513
871899343,15cyclictest7950irq/56-dwc_otg_07:45:403
8718993424,7cyclictest14777-21aten_rbpower_en08:55:423
871899341,7cyclictest0-21swapper/311:10:263
871799342,15cyclictest0-21swapper/208:32:292
871799342,14cyclictest23826-21if_wlan007:50:442
871799341,19cyclictest1550-21ssh10:50:432
871699345,5cyclictest7750irq/56-dwc_otg08:10:431
871699345,12cyclictest7950irq/56-dwc_otg_08:55:261
871899339,10cyclictest32359-21chrt08:15:273
871899332,17cyclictest14274-21aten_rbpower_cu07:25:393
871899332,13cyclictest0-21swapper/307:51:573
871899331,21cyclictest602-21switchtime09:25:533
871799336,4cyclictest0-21swapper/212:25:442
871799333,14cyclictest7950irq/56-dwc_otg_08:55:262
871799331,3cyclictest0-21swapper/209:25:532
871799331,27cyclictest26774-21ls08:00:262
871799331,27cyclictest26774-21ls08:00:262
8717993311,4cyclictest0-21swapper/210:25:482
871899329,7cyclictest167672chrt07:30:513
871899329,7cyclictest167672chrt07:30:513
871899324,13cyclictest7850irq/56-dwc_otg_08:50:263
871899313,4cyclictest7950irq/56-dwc_otg_08:00:463
871899303,13cyclictest7950irq/56-dwc_otg_08:40:443
871899301,16cyclictest7950irq/56-dwc_otg_08:30:303
871799302,14cyclictest7950irq/56-dwc_otg_07:35:562
871899298,4cyclictest7750irq/56-dwc_otg07:14:013
871899293,11cyclictest7950irq/56-dwc_otg_07:55:533
871899293,11cyclictest7950irq/56-dwc_otg_07:55:533
871799291,20cyclictest9859-21grep07:10:532
69072284,13sleep26999-21aten_rbpower_vo07:05:402
82732274,15sleep30-21swapper/307:08:123
81222273,15sleep10-21swapper/107:06:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional