You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 18:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sun Aug 02, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
309359912356,9cyclictest8050irq/56-dwc_otg_10:15:360
21442970,4sleep22147-21processes09:40:542
317592890,6sleep03093599cyclictest11:00:150
42282870,4sleep23093799cyclictest11:45:582
145202860,2sleep10-21swapper/112:00:281
3093799853,15cyclictest28936-21runrttasks10:15:362
14022850,2sleep00-21swapper/012:25:010
130012850,2sleep30-21swapper/309:55:343
30935998411,43cyclictest0-21swapper/008:50:390
220502840,7sleep13093699cyclictest10:46:381
196452830,2sleep00-21swapper/009:21:460
3093599821,22cyclictest2389-21ls12:25:480
3093599821,22cyclictest2389-21ls12:25:480
3093699792,45cyclictest7850irq/56-dwc_otg12:30:421
238112790,2sleep10-21swapper/110:09:021
269942770,2sleep00-21swapper/010:53:380
3093699764,66cyclictest25448-21kworker/u8:310:15:371
3093699763,11cyclictest0-21swapper/107:10:291
30938997517,36cyclictest0-21swapper/310:15:363
30935997412,54cyclictest0-21swapper/007:35:420
3093799738,5cyclictest7950irq/56-dwc_otg_10:35:272
3093699736,9cyclictest7950irq/56-dwc_otg_09:44:591
198672730,6sleep23093799cyclictest10:45:182
30937997210,49cyclictest18678-21ntp_kernel_err09:20:522
3093799715,40cyclictest7950irq/56-dwc_otg_10:10:402
30936997111,47cyclictest17655-21seq10:41:011
3093599711,8cyclictest28629-21apt-config10:15:280
204752710,2sleep20-21swapper/210:05:122
3093699702,52cyclictest8050irq/56-dwc_otg_07:30:491
3093699701,4cyclictest7850irq/56-dwc_otg10:35:471
3093799693,9cyclictest30940-21taskset07:10:312
3093699691,7cyclictest10577-21sed07:40:551
30936996913,38cyclictest8155-21latency_hist10:30:281
3093599682,32cyclictest0-21swapper/011:00:400
3093799671,8cyclictest4311-21/usr/sbin/munin07:25:462
30937996713,4cyclictest7950irq/56-dwc_otg_09:50:272
3093699672,45cyclictest0-21swapper/111:35:431
30935996730,6cyclictest0-21swapper/011:10:390
3093799662,13cyclictest0-21swapper/212:30:282
3093799662,13cyclictest0-21swapper/212:30:282
3093699669,44cyclictest0-21swapper/109:35:531
3093699666,9cyclictest8050irq/56-dwc_otg_11:09:291
30936996613,26cyclictest8050irq/56-dwc_otg_09:25:411
30936996613,26cyclictest8050irq/56-dwc_otg_09:25:411
30935996631,6cyclictest7850irq/56-dwc_otg09:50:270
3093599661,42cyclictest19595-21tail08:06:020
3093599661,42cyclictest19595-21tail08:06:020
30938996520,10cyclictest7950irq/56-dwc_otg_11:30:393
3093699656,9cyclictest8050irq/56-dwc_otg_10:24:541
3093699656,10cyclictest8050irq/56-dwc_otg_12:22:391
3093699653,41cyclictest7850irq/56-dwc_otg10:50:401
3093699651,7cyclictest0-21swapper/109:20:281
3093699651,7cyclictest0-21swapper/109:20:281
30935996537,7cyclictest4018-21cut07:25:410
30935996522,19cyclictest0-21swapper/007:10:300
3093599651,52cyclictest0-21swapper/011:50:470
3093799646,4cyclictest0-21swapper/211:37:222
3093699648,41cyclictest8050irq/56-dwc_otg_11:40:451
30936996414,40cyclictest14244-21unixbench-2d09:55:581
3093699641,3cyclictest0-21swapper/111:12:401
30936996411,25cyclictest7950irq/56-dwc_otg_12:00:411
3093799638,5cyclictest7850irq/56-dwc_otg11:45:282
3093799634,4cyclictest8050irq/56-dwc_otg_09:54:142
3093699635,6cyclictest7950irq/56-dwc_otg_07:35:571
3093699631,7cyclictest18037-21aten_rbpower_po09:20:441
30936996310,36cyclictest0-21swapper/111:00:401
3093599637,41cyclictest30941-21unixbench_multi09:35:570
3093599632,7cyclictest15223-21idleruntime-cro11:20:280
3093599632,56cyclictest19978-21idleruntime-cro10:45:280
3093599632,33cyclictest19890-21sed12:05:580
3093699627,45cyclictest8050irq/56-dwc_otg_11:45:591
3093699621,10cyclictest31370-21/usr/sbin/munin08:40:501
30935996233,16cyclictest8050irq/56-dwc_otg_12:05:280
30935996218,22cyclictest22708-21/usr/sbin/munin08:15:470
36672610,2sleep20-21swapper/211:05:332
3093799617,5cyclictest7950irq/56-dwc_otg_12:35:432
3093799612,5cyclictest8050irq/56-dwc_otg_11:12:082
3093799612,14cyclictest7850irq/56-dwc_otg10:48:342
3093699615,9cyclictest8050irq/56-dwc_otg_09:50:401
3093699614,6cyclictest7850irq/56-dwc_otg12:35:441
3093699613,5cyclictest3086-21timerwakeupswit12:25:591
3093699613,5cyclictest3086-21timerwakeupswit12:25:591
3093699613,14cyclictest8330-21ssh10:30:311
3093699613,11cyclictest8050irq/56-dwc_otg_12:09:541
3093699611,4cyclictest8050irq/56-dwc_otg_10:12:031
3093699611,4cyclictest7950irq/56-dwc_otg_11:28:031
3093599612,34cyclictest800-21fschecks_count10:20:470
3093599612,31cyclictest0-21swapper/007:55:480
97902600,6sleep03093599cyclictest07:40:440
30938996015,22cyclictest39-21ksoftirqd/310:25:403
3093799608,7cyclictest8050irq/56-dwc_otg_12:10:432
3093699603,9cyclictest8050irq/56-dwc_otg_07:20:471
3093699602,4cyclictest0-21swapper/111:50:451
3093599604,21cyclictest0-21swapper/011:40:400
3093799598,9cyclictest8050irq/56-dwc_otg_12:09:202
3093799596,6cyclictest7950irq/56-dwc_otg_09:35:542
3093799592,13cyclictest750-21snmpd12:25:212
3093699597,8cyclictest8050irq/56-dwc_otg_10:01:011
30936995910,35cyclictest7950irq/56-dwc_otg_11:25:281
3093599591,45cyclictest13368-21fschecks_count09:55:470
3093799587,4cyclictest7950irq/56-dwc_otg_12:02:022
3093799583,4cyclictest7950irq/56-dwc_otg_07:35:502
3093799583,10cyclictest7950irq/56-dwc_otg_11:25:282
3093799582,11cyclictest0-21swapper/212:34:572
3093799581,6cyclictest9549-21diskmemload10:56:232
3093799581,4cyclictest7950irq/56-dwc_otg_09:29:152
3093799581,4cyclictest7950irq/56-dwc_otg_09:29:152
3093799581,13cyclictest7950irq/56-dwc_otg_11:02:052
3093799581,10cyclictest8050irq/56-dwc_otg_10:53:442
3093699584,10cyclictest8050irq/56-dwc_otg_09:34:361
3093699583,10cyclictest8050irq/56-dwc_otg_09:15:281
3093699582,11cyclictest8050irq/56-dwc_otg_11:19:541
3093699581,44cyclictest0-21swapper/112:17:251
3093599585,29cyclictest20289-21gdbus10:45:300
3093599583,33cyclictest0-21swapper/009:50:570
3093599582,9cyclictest12090-21grep11:55:590
30935995814,32cyclictest22134-21fschecks_count09:25:450
30935995814,32cyclictest22134-21fschecks_count09:25:450
30935995814,25cyclictest26619-21ps08:25:550
3093799577,5cyclictest7850irq/56-dwc_otg08:10:452
3093799572,9cyclictest0-21swapper/209:55:472
3093799571,5cyclictest5872-21ssh10:26:102
30937995714,5cyclictest7850irq/56-dwc_otg12:19:552
3093699579,7cyclictest27463-21sort08:30:271
3093699579,5cyclictest5057-21unixbench_multi07:25:561
3093699579,4cyclictest0-21swapper/111:33:241
3093699572,8cyclictest23440-21vmstat08:15:581
3093599579,7cyclictest0-21swapper/011:20:580
3093599576,27cyclictest8916-21/usr/sbin/munin10:30:480
30935995730,15cyclictest27472-21/usr/sbin/munin12:15:570
3093599571,46cyclictest19688-21ls11:25:430
3093599571,30cyclictest8095-21aten_rbpower_vo09:05:430
3093599571,30cyclictest8095-21aten_rbpower_vo09:05:430
3093899569,29cyclictest0-21swapper/308:15:343
3093799565,4cyclictest7850irq/56-dwc_otg07:20:462
3093799562,5cyclictest12718-21cut10:35:472
3093799562,12cyclictest0-21swapper/211:51:582
3093799561,6cyclictest30325-21ps08:35:542
3093799561,6cyclictest30325-21ps08:35:542
3093799561,4cyclictest7950irq/56-dwc_otg_09:15:452
3093799561,4cyclictest7950irq/56-dwc_otg_09:15:452
3093699565,35cyclictest0-21swapper/109:48:561
3093699564,6cyclictest0-21swapper/112:15:061
3093699562,40cyclictest0-21swapper/108:30:471
30935995628,15cyclictest0-21swapper/007:15:570
3093599562,33cyclictest4651-21ssh11:05:550
3093599562,24cyclictest0-21swapper/010:05:280
30935995610,30cyclictest0-21swapper/008:40:410
3093799552,10cyclictest0-21swapper/208:48:252
3093799551,8cyclictest14686-21ssh11:19:262
30937995512,5cyclictest21123-21awk10:05:422
3093799551,11cyclictest0-21swapper/207:30:502
3093799551,10cyclictest7950irq/56-dwc_otg_10:24:562
3093699556,32cyclictest0-21swapper/110:56:141
3093699553,10cyclictest8050irq/56-dwc_otg_08:45:461
3093699551,11cyclictest24096-21wget08:20:431
3093599553,30cyclictest6920-21proc_pri09:00:530
3093799547,4cyclictest0-21swapper/209:13:182
3093799541,4cyclictest7850irq/56-dwc_otg08:50:472
3093799541,4cyclictest0-21swapper/209:34:592
3093799541,10cyclictest0-21swapper/211:33:162
3093699543,5cyclictest0-21swapper/107:15:571
3093599542,31cyclictest0-21swapper/010:05:540
3093599542,29cyclictest1496-21grep08:45:500
3093599542,28cyclictest727-21runrttasks10:29:120
30935995417,18cyclictest10607-21ssh12:35:500
3093599541,30cyclictest0-21swapper/009:15:370
3093599541,30cyclictest0-21swapper/009:15:370
3093899538,27cyclictest0-21swapper/309:40:413
30938995317,8cyclictest39-21ksoftirqd/310:40:273
30938995315,6cyclictest8050irq/56-dwc_otg_10:55:413
3093799531,4cyclictest9650irq/80-mmc008:35:282
3093799531,4cyclictest7850irq/56-dwc_otg11:26:542
3093699537,10cyclictest8050irq/56-dwc_otg_08:14:301
3093699533,3cyclictest0-21swapper/108:56:281
30936995320,30cyclictest727-21runrttasks08:00:281
30935995325,8cyclictest13139-21wget07:50:440
3093899528,30cyclictest17959-21ssh09:20:433
3093799524,8cyclictest8050irq/56-dwc_otg_11:56:482
3093799522,9cyclictest10526-21unixbench-2d07:40:552
3093799522,5cyclictest7950irq/56-dwc_otg_07:15:532
3093699521,2cyclictest0-21swapper/108:35:561
3093699521,2cyclictest0-21swapper/108:35:561
3093599522,30cyclictest24407-21switchtime11:30:550
30935995222,16cyclictest1878-21ssh09:40:500
3093599521,31cyclictest750-21snmpd09:10:560
3093899518,27cyclictest0-21swapper/308:40:413
3093899518,27cyclictest0-21swapper/308:30:333
3093699513,6cyclictest0-21swapper/107:45:421
3093599519,22cyclictest0-21swapper/008:35:520
3093599519,22cyclictest0-21swapper/008:35:520
3093599513,10cyclictest7850irq/56-dwc_otg09:30:400
30935995123,7cyclictest22680-21aten_rbpower_en12:10:430
3093599512,21cyclictest0-21swapper/012:33:430
3093799505,8cyclictest8050irq/56-dwc_otg_08:01:412
3093699501,9cyclictest0-21swapper/107:51:081
3093699501,10cyclictest19300-21rt-features08:05:591
3093699501,10cyclictest19300-21rt-features08:05:591
3093599509,29cyclictest0-21swapper/008:12:020
30935995016,4cyclictest27425-21sh11:35:410
3093599501,35cyclictest0-21swapper/011:45:440
3093599501,27cyclictest0-21swapper/007:30:530
3093799491,5cyclictest24053-21/usr/sbin/munin08:20:552
3093699498,5cyclictest3222-21ntp_kernel_pll_08:50:511
3093699493,7cyclictest0-21swapper/109:00:491
3093699492,8cyclictest727-21runrttasks08:05:281
3093599494,14cyclictest0-21swapper/007:45:410
30935994926,11cyclictest0-21swapper/008:00:570
3093599492,24cyclictest2673-21cat07:20:500
30935994920,21cyclictest0-21swapper/008:30:380
3093899486,20cyclictest8050irq/56-dwc_otg_07:55:443
3093899483,21cyclictest0-21swapper/307:10:303
3093799484,8cyclictest8050irq/56-dwc_otg_08:40:522
3093699481,4cyclictest0-21swapper/109:10:171
3093699481,4cyclictest0-21swapper/109:10:171
3093799474,4cyclictest8050irq/56-dwc_otg_09:05:412
3093799474,4cyclictest8050irq/56-dwc_otg_09:05:412
3093799471,6cyclictest7950irq/56-dwc_otg_08:19:492
3093599472,25cyclictest0-21swapper/010:38:540
3093599471,34cyclictest0-21swapper/008:20:360
3093899467,10cyclictest7950irq/56-dwc_otg_12:15:413
3093599469,17cyclictest0-21swapper/009:00:280
3093899457,24cyclictest61-21kswapd007:35:353
3093899451,9cyclictest8050irq/56-dwc_otg_09:15:553
3093899451,9cyclictest8050irq/56-dwc_otg_09:15:553
3093799456,3cyclictest0-21swapper/207:50:282
3093899446,18cyclictest0-21swapper/312:25:403
3093899446,18cyclictest0-21swapper/312:25:403
3093799444,29cyclictest7950irq/56-dwc_otg_08:55:482
3093799442,4cyclictest7950irq/56-dwc_otg_08:30:222
3093899438,13cyclictest7850irq/56-dwc_otg07:25:383
3093899436,24cyclictest6917-21ssh11:50:443
30938994336,5cyclictest10862-21ls09:10:563
3093899431,7cyclictest16570-21ssh11:20:563
8232420,2sleep30-21swapper/311:42:053
3093899424,23cyclictest0-21swapper/310:50:473
3093899421,9cyclictest0-21swapper/307:45:483
3093899421,25cyclictest17017-21fschecks_time08:00:493
3093899421,24cyclictest39-21ksoftirqd/311:45:513
3093899419,18cyclictest0-21swapper/308:55:433
3093899417,21cyclictest37-21rcuc/310:45:443
3093899413,13cyclictest0-21swapper/309:29:253
3093899413,13cyclictest0-21swapper/309:29:253
3093899411,26cyclictest0-21swapper/312:38:083
3093899408,17cyclictest0-21swapper/307:40:393
3093899404,7cyclictest8050irq/56-dwc_otg_07:30:393
30938994020,5cyclictest23830-21chrt10:09:043
3093899398,17cyclictest0-21swapper/309:00:423
3093899398,15cyclictest8050irq/56-dwc_otg_12:01:003
3093899393,6cyclictest39-21ksoftirqd/310:40:533
30937993911,17cyclictest19632-21unixbench_singl08:06:022
30937993911,17cyclictest19632-21unixbench_singl08:06:022
3093899388,7cyclictest0-21swapper/311:15:473
3093899386,6cyclictest7950irq/56-dwc_otg_11:35:583
3093899382,17cyclictest8050irq/56-dwc_otg_12:10:273
30938993811,10cyclictest7950irq/56-dwc_otg_12:15:283
30938993810,11cyclictest8050irq/56-dwc_otg_10:00:533
3093799382,20cyclictest0-21swapper/207:55:492
3093799381,9cyclictest14209-21grep07:50:592
3093899378,16cyclictest0-21swapper/308:50:413
3093899377,17cyclictest0-21swapper/311:55:423
3093899372,7cyclictest0-21swapper/309:35:393
3093899371,29cyclictest8720-21grep10:30:463
3093899371,26cyclictest7373-21latency_hist11:10:283
3093899371,22cyclictest0-21swapper/309:05:573
3093899371,22cyclictest0-21swapper/309:05:573
3093899369,13cyclictest7850irq/56-dwc_otg09:55:283
3093899367,6cyclictest39-21ksoftirqd/310:22:083
30938993623,7cyclictest727-21runrttasks09:30:593
3093899355,15cyclictest8050irq/56-dwc_otg_12:30:493
3093899355,15cyclictest8050irq/56-dwc_otg_11:10:533
3093899352,13cyclictest8050irq/56-dwc_otg_12:25:273
30938993516,6cyclictest39-21ksoftirqd/307:50:543
30938993512,12cyclictest0-21swapper/310:15:163
3093899348,15cyclictest0-21swapper/308:25:433
3093899348,12cyclictest7950irq/56-dwc_otg_09:45:513
3093899342,12cyclictest0-21swapper/308:05:453
3093899342,12cyclictest0-21swapper/308:05:453
30938993414,18cyclictest8050irq/56-dwc_otg_08:20:433
3093799341,10cyclictest0-21swapper/209:01:532
3093899339,12cyclictest0-21swapper/311:03:033
3093899337,7cyclictest8050irq/56-dwc_otg_11:25:583
3093899333,5cyclictest37-21rcuc/308:45:393
3093899324,5cyclictest7950irq/56-dwc_otg_07:15:413
30938993216,9cyclictest37-21rcuc/307:20:513
305242313,21sleep30-21swapper/307:08:433
3093899303,11cyclictest8050irq/56-dwc_otg_08:35:553
3093899303,11cyclictest8050irq/56-dwc_otg_08:35:553
3093899301,6cyclictest20957-21ntp_kernel_err08:10:503
304652283,14sleep10-21swapper/107:07:561
305572279,12sleep20-21swapper/207:09:062
304592243,13sleep00-21swapper/007:07:510
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional