You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 21:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Mon Jun 29, 2026 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
512022250,3sleep30-21swapper/307:05:373
512022250,3sleep30-21swapper/307:05:373
282362920,2sleep30-21swapper/309:22:503
6512860,5sleep1594599cyclictest11:25:301
106602860,5sleep3594799cyclictest12:16:173
594499856,68cyclictest0-21swapper/008:30:210
190062820,2sleep20-21swapper/210:30:162
143552820,5sleep3594799cyclictest09:00:363
259312790,2sleep0594499cyclictest11:55:370
172962760,5sleep1594599cyclictest10:27:291
275382740,2sleep10-21swapper/111:19:311
594499721,43cyclictest11508-21latency_hist11:00:110
594499714,55cyclictest9-21ksoftirqd/012:05:300
594499714,55cyclictest9-21ksoftirqd/012:05:300
5946996825,24cyclictest6558-21/usr/sbin/munin10:15:262
74912670,5sleep3594799cyclictest10:55:213
5944996631,19cyclictest7850irq/56-dwc_otg11:50:090
594499661,35cyclictest11328-21latency_hist07:25:100
5946996529,13cyclictest1951-21/usr/sbin/munin12:05:382
5946996529,13cyclictest1951-21/usr/sbin/munin12:05:382
5946996518,32cyclictest0-21swapper/208:52:482
5946996425,28cyclictest11625-21ssh12:18:012
5946996321,12cyclictest21423-21ssh09:15:252
5944996321,34cyclictest13-21rcuc/012:20:300
594499631,48cyclictest0-21swapper/009:15:100
594499631,48cyclictest0-21swapper/009:15:100
5946996232,19cyclictest24080-21/usr/sbin/munin10:35:332
5946996232,19cyclictest24080-21/usr/sbin/munin10:35:332
5946996219,21cyclictest7850irq/56-dwc_otg09:46:572
594499622,46cyclictest10072-21timerandwakeup12:15:380
594499621,52cyclictest0-21swapper/007:15:210
41452626,47sleep00-21swapper/007:05:230
41452626,47sleep00-21swapper/007:05:230
220622620,2sleep20-21swapper/211:12:072
594499614,30cyclictest0-21swapper/008:25:210
594499614,30cyclictest0-21swapper/008:25:210
5944996138,11cyclictest25286-21apt-get09:20:180
594699604,21cyclictest17074-21ssh09:10:232
594699604,21cyclictest17074-21ssh09:10:232
5946996031,11cyclictest7538-21apt-get07:15:142
5946996028,17cyclictest24287-21/usr/sbin/munin11:15:262
5946996025,13cyclictest12172-21ls08:55:332
5946996024,19cyclictest1717-21ssh10:09:442
594499601,46cyclictest13435-21cat11:40:360
5946995927,12cyclictest4381-21/usr/sbin/munin11:30:282
5944995927,14cyclictest0-21swapper/007:30:400
594499591,33cyclictest0-21swapper/009:50:220
594499591,25cyclictest0-21swapper/010:00:380
29422590,2sleep22939-21memory10:10:312
5946995843,13cyclictest20639-21/usr/sbin/munin07:50:232
5946995828,19cyclictest19463-21/usr/sbin/munin07:45:322
5946995825,17cyclictest28427-21ntp_states08:10:332
5946995824,8cyclictest7246-21ssh10:55:102
5946995823,25cyclictest2375-21ssh11:27:382
594499582,40cyclictest15877-21wget11:05:240
594499582,40cyclictest15877-21wget11:05:240
594499581,43cyclictest21225-21grep11:10:400
5946995720,20cyclictest7850irq/56-dwc_otg11:56:532
5946995719,24cyclictest6891-21ls09:35:372
594499579,23cyclictest0-21swapper/009:05:350
594499578,35cyclictest0-21swapper/011:30:320
594499573,39cyclictest0-21swapper/007:55:320
594499571,42cyclictest11577-21aten_rbpower_cu08:55:250
594499571,41cyclictest101ktimersoftd/010:20:390
594499571,35cyclictest3682-21cut10:50:280
5946995633,7cyclictest2521-21apt-get08:30:202
5946995625,12cyclictest16488-21/usr/sbin/munin11:45:222
5946995621,23cyclictest2800-21ssh10:49:482
5944995639,4cyclictest19828-21unixbench_multi07:45:360
5944995629,6cyclictest9641-21latency_hist09:40:100
594499562,40cyclictest0-21swapper/011:20:350
594499562,39cyclictest0-21swapper/010:45:190
594499562,38cyclictest7544-21munin-run07:15:090
594499561,43cyclictest26426-21grep08:05:300
5946995528,13cyclictest8325-21/usr/sbin/munin10:55:362
5946995523,18cyclictest9242-21chrt08:47:022
5946995523,12cyclictest21141-21munin-run12:30:102
594599555,10cyclictest7850irq/56-dwc_otg11:35:231
594599551,37cyclictest0-21swapper/107:40:231
594499553,49cyclictest24868-21kworker/0:010:15:180
5944995533,8cyclictest101ktimersoftd/011:15:290
5946995425,12cyclictest9748-21aten_rbpower_en07:20:252
5946995424,18cyclictest27010-21ssh12:35:462
5946995424,18cyclictest27010-21ssh12:35:462
5946995423,11cyclictest23934-21ssh11:54:152
5946995423,11cyclictest16150-21ssh12:23:432
5946995420,15cyclictest13134-21ssh11:00:572
5946995419,20cyclictest31785-21ssh11:24:422
5946995419,11cyclictest22364-21ssh09:55:232
5944995431,4cyclictest8050irq/56-dwc_otg_10:30:240
5944995426,5cyclictest7950irq/56-dwc_otg_07:35:380
5944995426,5cyclictest7950irq/56-dwc_otg_07:35:380
594499542,4cyclictest0-21swapper/010:35:320
594499542,4cyclictest0-21swapper/010:35:320
594499542,38cyclictest17675-21/usr/sbin/munin07:40:360
594499541,27cyclictest29966-21ssh09:25:240
594499541,27cyclictest29966-21ssh09:25:240
5946995321,15cyclictest30468-21ssh10:43:412
5944995331,9cyclictest9382-21timerwakeupswit11:35:380
594499532,5cyclictest0-21swapper/012:30:100
594499532,35cyclictest0-21swapper/009:55:290
5944995319,14cyclictest7975-21wget08:45:240
594499531,4cyclictest0-21swapper/008:35:330
5946995224,14cyclictest27422-21chrt09:21:202
5946995224,14cyclictest17700-21ssh11:06:432
5946995224,14cyclictest17700-21ssh11:06:432
5946995224,11cyclictest8311-21ssh12:14:332
5946995214,14cyclictest5553-21latency_hist09:35:102
5945995228,8cyclictest7850irq/56-dwc_otg12:10:221
594499527,22cyclictest9-21ksoftirqd/012:35:380
594499527,22cyclictest9-21ksoftirqd/012:35:380
594499523,31cyclictest13868-21latency09:00:280
5946995122,13cyclictest9916-21chrt11:36:182
5946995121,19cyclictest16717-21diskmemload09:28:092
5946995121,19cyclictest16717-21diskmemload09:28:092
5946995121,14cyclictest16751-21sh10:26:292
5946995121,11cyclictest7850irq/56-dwc_otg09:55:112
5946995119,11cyclictest8050irq/56-dwc_otg_09:43:482
5946995118,16cyclictest21364-21ssh12:30:112
5947995027,15cyclictest39-21ksoftirqd/310:10:213
5946995028,10cyclictest5551-21taskset08:36:042
5946995021,11cyclictest12116-21ssh10:20:472
5946995019,13cyclictest8050irq/56-dwc_otg_12:02:482
5944995024,4cyclictest0-21swapper/008:00:320
5944995022,18cyclictest0-21swapper/008:10:350
5944995014,18cyclictest9-21ksoftirqd/008:50:210
5946994913,24cyclictest8050irq/56-dwc_otg_10:00:542
594499496,26cyclictest9-21ksoftirqd/010:12:060
594499496,26cyclictest9-21ksoftirqd/007:50:330
5944994925,4cyclictest7850irq/56-dwc_otg11:55:100
5944994925,3cyclictest0-21swapper/010:25:300
594499491,42cyclictest0-21swapper/012:33:260
594499491,35cyclictest31258-21ls08:20:110
594499491,32cyclictest0-21swapper/009:30:310
594499491,24cyclictest30716-21ssh12:01:220
594499491,17cyclictest5907-21ssh12:10:360
594499491,11cyclictest0-21swapper/009:40:270
5946994824,10cyclictest14604-21ssh11:42:192
594599484,14cyclictest16717-21diskmemload12:30:211
5944994818,19cyclictest16717-21diskmemload11:05:110
5944994815,18cyclictest6460-21fschecks_time08:40:250
594499481,34cyclictest32258-21ssh10:06:170
594699478,25cyclictest7850irq/56-dwc_otg07:35:242
594699478,25cyclictest7850irq/56-dwc_otg07:35:242
5946994718,17cyclictest0-21swapper/208:30:062
5946994718,17cyclictest0-21swapper/208:30:062
5944994722,12cyclictest0-21swapper/010:40:360
594799467,24cyclictest0-21swapper/309:05:243
594599464,10cyclictest0-21swapper/111:05:211
594599464,10cyclictest0-21swapper/111:05:211
5945994631,13cyclictest221ktimersoftd/108:20:221
594799457,25cyclictest0-21swapper/310:00:233
5946994529,12cyclictest6301-21cpuspeed08:40:222
5946994517,18cyclictest12716-21taskset07:25:562
5946994517,14cyclictest32616-21taskset08:21:342
5946994516,14cyclictest23805-21chrt07:59:242
5944994525,6cyclictest7850irq/56-dwc_otg08:20:370
5944994524,6cyclictest8050irq/56-dwc_otg_11:25:190
594499452,18cyclictest0-21swapper/009:15:310
594799447,29cyclictest16526-21ssh11:45:243
594699447,24cyclictest0-21swapper/207:30:252
5946994421,10cyclictest27249-21chrt08:07:172
594599442,9cyclictest0-21swapper/107:20:221
594599441,7cyclictest8050irq/56-dwc_otg_07:55:211
5945994411,9cyclictest0-21swapper/110:30:211
5945994411,12cyclictest7850irq/56-dwc_otg10:00:271
5946994332,8cyclictest5975-21apt-get07:10:222
5946994319,13cyclictest18574-21date07:45:102
5946994316,8cyclictest727-21runrttasks09:07:132
594599437,23cyclictest0-21swapper/108:30:211
5945994323,9cyclictest7850irq/56-dwc_otg09:35:091
594499431,11cyclictest0-21swapper/009:49:080
225652430,3sleep10-21swapper/109:15:391
5947994215,17cyclictest381ktimersoftd/311:50:233
594699427,22cyclictest0-21swapper/209:00:212
5946994231,8cyclictest24129-21apt-get08:00:202
5946994227,12cyclictest29563-21wget08:15:232
5945994212,14cyclictest8050irq/56-dwc_otg_08:55:391
594799418,23cyclictest0-21swapper/309:25:233
594799418,23cyclictest0-21swapper/309:25:233
594799416,20cyclictest8050irq/56-dwc_otg_10:05:253
5945994132,7cyclictest8050irq/56-dwc_otg_11:00:191
594499412,19cyclictest0-21swapper/007:26:480
594799403,5cyclictest39-21ksoftirqd/311:30:223
119492400,1sleep10-21swapper/112:18:371
594799398,18cyclictest21810-21fschecks_time12:30:253
594799392,9cyclictest0-21swapper/311:55:213
594799392,22cyclictest0-21swapper/311:45:103
594599397,16cyclictest8050irq/56-dwc_otg_10:35:111
594599397,16cyclictest8050irq/56-dwc_otg_10:35:111
5945993920,10cyclictest13624-21sh09:45:061
5945993919,4cyclictest13626-21grep11:40:381
5945993914,8cyclictest8050irq/56-dwc_otg_12:26:471
594799388,18cyclictest37-21rcuc/309:35:233
594799381,3cyclictest8050irq/56-dwc_otg_08:10:213
594599389,9cyclictest27045-21ssh12:35:501
594599389,9cyclictest27045-21ssh12:35:501
5945993824,4cyclictest7850irq/56-dwc_otg10:49:301
594599381,26cyclictest29219-21ls12:00:241
5945993810,11cyclictest8050irq/56-dwc_otg_09:49:251
5947993719,4cyclictest37-21rcuc/311:15:363
594799371,24cyclictest25281-21latency_hist09:20:103
594799371,23cyclictest20154-21cpuspeed11:10:263
594599379,18cyclictest0-21swapper/112:20:231
594599374,18cyclictest221ktimersoftd/110:55:101
594599371,6cyclictest14513-21sed09:00:371
5945993716,6cyclictest7850irq/56-dwc_otg11:35:111
5945993714,10cyclictest8050irq/56-dwc_otg_09:29:331
5945993714,10cyclictest8050irq/56-dwc_otg_09:29:331
205322371,3sleep30-21swapper/309:52:343
594799366,25cyclictest0-21swapper/308:30:213
5947993616,4cyclictest9461-21latency_hist07:20:103
5947993616,4cyclictest20378-21/usr/sbin/munin10:30:393
5947993615,7cyclictest0-21swapper/312:25:383
594799361,4cyclictest0-21swapper/308:25:213
594799361,4cyclictest0-21swapper/308:25:213
594599365,15cyclictest7850irq/56-dwc_otg10:09:261
5945993628,6cyclictest30880-21rm11:23:031
5945993614,6cyclictest7950irq/56-dwc_otg_09:52:131
5945993612,4cyclictest0-21swapper/109:40:101
594599361,16cyclictest7850irq/56-dwc_otg07:40:111
594599361,16cyclictest7850irq/56-dwc_otg07:40:111
594799356,13cyclictest8050irq/56-dwc_otg_10:45:313
5947993527,6cyclictest39-21ksoftirqd/312:00:423
5947993527,5cyclictest16717-21diskmemload11:35:283
5947993515,5cyclictest7496-21/usr/sbin/munin10:15:373
594599358,14cyclictest7850irq/56-dwc_otg08:10:291
594599357,22cyclictest0-21swapper/108:00:221
594599356,17cyclictest221ktimersoftd/107:15:151
594599354,6cyclictest7850irq/56-dwc_otg08:35:281
5945993515,8cyclictest23-21ksoftirqd/111:12:551
5945993515,4cyclictest6579-21ssh10:15:221
5945993513,9cyclictest7850irq/56-dwc_otg12:08:371
5945993513,9cyclictest7850irq/56-dwc_otg12:08:371
594599351,20cyclictest0-21swapper/110:13:211
5945993510,8cyclictest7850irq/56-dwc_otg08:10:101
5945993510,4cyclictest12567-21unixbench-2d07:25:351
5945993510,10cyclictest7850irq/56-dwc_otg10:20:491
101282350,1sleep10-21swapper/110:58:011
594799345,19cyclictest8050irq/56-dwc_otg_09:45:353
5947993412,5cyclictest0-21swapper/310:35:403
5947993412,5cyclictest0-21swapper/310:35:403
594599348,5cyclictest21-21rcuc/107:45:281
594599346,4cyclictest0-21swapper/108:45:381
594599346,21cyclictest0-21swapper/107:30:251
594599346,14cyclictest31504-21latency_hist10:45:101
594599345,13cyclictest21-21rcuc/109:12:301
594599345,13cyclictest21-21rcuc/109:12:301
5945993413,4cyclictest0-21swapper/111:50:271
594799337,6cyclictest7950irq/56-dwc_otg_10:20:403
594799333,12cyclictest8050irq/56-dwc_otg_09:15:103
594799333,12cyclictest8050irq/56-dwc_otg_09:15:103
594799332,3cyclictest0-21swapper/311:20:213
594799332,21cyclictest32590-21kworker/3:009:40:193
594799332,16cyclictest0-21swapper/307:57:433
5947993317,6cyclictest6063-21ssh10:53:113
594799331,20cyclictest0-21swapper/307:40:383
5947993311,13cyclictest0-21swapper/310:40:403
594599339,7cyclictest221ktimersoftd/109:57:541
594599335,5cyclictest0-21swapper/109:05:281
594599332,19cyclictest0-21swapper/111:45:351
594599332,18cyclictest0-21swapper/108:44:461
5945993315,5cyclictest16717-21diskmemload12:00:021
5945993313,7cyclictest7850irq/56-dwc_otg09:20:591
594799326,4cyclictest0-21swapper/312:08:033
594799326,4cyclictest0-21swapper/312:08:033
594799326,14cyclictest0-21swapper/311:25:223
594799326,13cyclictest8050irq/56-dwc_otg_07:30:263
5947993216,4cyclictest727-21runrttasks09:33:573
5947993213,12cyclictest8547-21taskset12:14:583
594799321,22cyclictest0-21swapper/312:39:173
594799321,22cyclictest0-21swapper/312:39:173
5947993212,10cyclictest16717-21diskmemload11:01:513
594599327,15cyclictest0-21swapper/107:50:221
594599324,14cyclictest8050irq/56-dwc_otg_07:10:391
594599321,4cyclictest221ktimersoftd/108:30:111
594599321,4cyclictest221ktimersoftd/108:30:111
594599321,28cyclictest10679-21timerandwakeup08:50:351
594799316,15cyclictest0-21swapper/310:25:153
594799312,6cyclictest7950irq/56-dwc_otg_07:45:343
5947993116,11cyclictest0-21swapper/309:55:243
5947993112,4cyclictest39-21ksoftirqd/312:20:273
594599314,9cyclictest29590-21wget08:15:231
594799308,4cyclictest12001-21/usr/sbin/munin08:55:313
594799306,15cyclictest0-21swapper/308:15:233
594799303,18cyclictest0-21swapper/307:55:023
594799303,12cyclictest24116-21/usr/sbin/munin08:00:313
594799293,17cyclictest7950irq/56-dwc_otg_08:41:353
594799293,15cyclictest15124-21aten_rbpower_cu07:35:243
594799293,15cyclictest15124-21aten_rbpower_cu07:35:243
594799293,15cyclictest0-21swapper/307:20:243
594799291,5cyclictest6267-21fschecks_time07:10:283
594799291,10cyclictest15933-21wget11:05:253
594799291,10cyclictest15933-21wget11:05:253
594799287,10cyclictest0-21swapper/308:50:403
594799283,5cyclictest8050irq/56-dwc_otg_08:45:353
594799283,11cyclictest8050irq/56-dwc_otg_08:20:363
594799281,5cyclictest26200-21fschecks_count08:05:273
594799281,20cyclictest0-21swapper/307:29:003
55462289,12sleep10-21swapper/107:08:321
55462289,12sleep10-21swapper/107:08:321
594799271,18cyclictest0-21swapper/308:35:243
54492273,16sleep20-21swapper/207:07:152
54492273,16sleep20-21swapper/207:07:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional