You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 02:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Wed May 20, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1249122100,1sleep30-21swapper/319:05:173
14102991025,78cyclictest0-21swapper/019:10:030
1410499993,78cyclictest0-21swapper/219:10:032
233482930,2sleep10-21swapper/123:02:061
201862850,5sleep31410599cyclictest21:40:483
201862850,5sleep31410599cyclictest21:40:483
14102997526,28cyclictest8916-21tail22:05:300
14102997458,7cyclictest8050irq/56-dwc_otg_23:20:150
14102997458,7cyclictest8050irq/56-dwc_otg_23:20:150
14102997317,18cyclictest0-21swapper/021:00:120
97632700,2sleep00-21swapper/022:45:260
1410499696,5cyclictest8050irq/56-dwc_otg_00:00:012
1410299696,53cyclictest0-21swapper/023:00:130
1410299692,10cyclictest477-21sh22:35:140
245052680,2sleep30-21swapper/323:43:023
251952670,2sleep20-21swapper/200:22:582
1410299667,5cyclictest0-21swapper/019:50:120
1410599646,17cyclictest0-21swapper/323:20:153
1410599646,17cyclictest0-21swapper/323:20:153
1410499643,6cyclictest29878-21wget21:15:172
1410499643,5cyclictest7950irq/56-dwc_otg_20:00:242
1410299632,47cyclictest23452-21diskmemload00:20:280
14102996320,7cyclictest0-21swapper/023:35:140
1410499623,5cyclictest8050irq/56-dwc_otg_00:00:032
1410299621,48cyclictest1133-21runrttasks22:00:240
14102996214,6cyclictest0-21swapper/020:10:130
14102996214,6cyclictest0-21swapper/020:10:130
1410299621,30cyclictest0-21swapper/023:25:140
296722610,2sleep10-21swapper/100:28:371
1410299612,42cyclictest18087-21cat00:15:010
1410499607,12cyclictest8050irq/56-dwc_otg_21:48:452
1410399605,9cyclictest7850irq/56-dwc_otg23:30:111
14102996032,6cyclictest7950irq/56-dwc_otg_23:45:010
1410299602,37cyclictest0-21swapper/019:40:010
1410499597,10cyclictest8050irq/56-dwc_otg_23:05:002
1410499595,5cyclictest21607-21unixbench-2d22:20:292
1410499595,5cyclictest21607-21unixbench-2d22:20:292
1410399596,3cyclictest0-21swapper/122:30:121
1410299591,45cyclictest0-21swapper/021:50:190
1410499585,14cyclictest7950irq/56-dwc_otg_00:30:272
1410299581,47cyclictest0-21swapper/023:50:130
1410299581,46cyclictest0-21swapper/021:40:180
1410299581,46cyclictest0-21swapper/021:40:180
1410499572,14cyclictest29325-21ssh23:49:072
14102995733,12cyclictest101ktimersoftd/020:55:010
1410299572,36cyclictest0-21swapper/023:30:280
14102995721,3cyclictest0-21swapper/023:05:170
1410299571,39cyclictest13211-21uniq22:50:180
14102995712,5cyclictest0-21swapper/022:10:130
1410499562,4cyclictest7950irq/56-dwc_otg_20:35:012
1410399568,24cyclictest8050irq/56-dwc_otg_19:10:031
1410299569,27cyclictest18357-21seq21:40:010
14102995639,5cyclictest9-21ksoftirqd/000:35:180
1410299561,43cyclictest0-21swapper/000:25:260
1410299561,41cyclictest17810-21grep19:20:130
196222550,1sleep20-21swapper/222:19:122
1410499551,6cyclictest8050irq/56-dwc_otg_23:30:172
1410499551,4cyclictest9382-21/usr/sbin/munin23:25:182
14102995534,4cyclictest523-21rs:main0
14102995527,15cyclictest0-21swapper/022:25:170
14102995526,5cyclictest0-21swapper/000:00:170
1410299552,45cyclictest0-21swapper/023:14:550
1410299552,41cyclictest0-21swapper/023:45:290
1410299552,14cyclictest28613-21latency_hist19:50:010
14102995511,32cyclictest13-21rcuc/000:15:250
1410499543,16cyclictest2772-21fschecks_count00:35:182
1410499541,7cyclictest31288-21ssh21:55:012
1410299547,4cyclictest7950irq/56-dwc_otg_20:00:120
14102995446,2cyclictest0-21swapper/019:30:100
14102995436,5cyclictest26338-21grep21:10:260
1410299542,39cyclictest1192-21aten_rbpower_en23:15:160
1410299541,37cyclictest0-21swapper/023:00:010
192842530,2sleep30-21swapper/323:36:013
1410499532,14cyclictest0-21swapper/222:34:282
14102995335,7cyclictest7950irq/56-dwc_otg_00:30:220
1410299533,39cyclictest0-21swapper/021:55:120
14102995333,12cyclictest324452chrt21:17:510
14102995333,12cyclictest101ktimersoftd/020:20:280
14102995332,6cyclictest9450irq/48-DMA10:20:150
14102995329,5cyclictest7950irq/56-dwc_otg_21:05:180
14102995326,5cyclictest7950irq/56-dwc_otg_21:25:140
1410299532,42cyclictest0-21swapper/022:42:320
1410299532,40cyclictest0-21swapper/022:15:060
1410299532,39cyclictest0-21swapper/000:06:500
14102995230,4cyclictest2245-21taskset20:05:220
14102995228,7cyclictest8050irq/56-dwc_otg_22:20:140
14102995228,7cyclictest8050irq/56-dwc_otg_22:20:140
14102995226,17cyclictest10227-21grep21:30:150
1410299522,42cyclictest17992-21sort20:50:010
1410299522,42cyclictest17992-21sort20:50:010
1410299521,40cyclictest29002-21tune2fs22:30:170
106472520,2sleep30-21swapper/322:08:223
1410599513,18cyclictest0-21swapper/321:00:123
1410299516,34cyclictest9-21ksoftirqd/019:43:050
14102995137,4cyclictest26882-21ls21:50:000
1410299511,39cyclictest0-21swapper/019:55:210
1410299511,36cyclictest0-21swapper/019:15:140
1410599501,41cyclictest0-21swapper/319:45:123
1410399504,36cyclictest0-21swapper/119:50:121
1410499497,39cyclictest0-21swapper/220:50:272
1410299495,24cyclictest0-21swapper/023:55:220
1410299492,32cyclictest0-21swapper/020:40:220
1410299492,29cyclictest0-21swapper/020:30:290
14102994919,6cyclictest12886-21fschecks_count20:35:180
1410299491,37cyclictest19552-21tr19:25:110
1410599472,7cyclictest0-21swapper/322:20:143
1410599472,7cyclictest0-21swapper/322:20:143
1410499476,12cyclictest0-21swapper/221:25:132
1410399477,26cyclictest0-21swapper/122:00:061
1410399473,30cyclictest25500-21ssh21:10:141
136062473,7sleep20-21swapper/219:07:112
1410599467,25cyclictest0-21swapper/320:55:063
1410599462,5cyclictest8050irq/56-dwc_otg_19:10:153
1410499465,8cyclictest7950irq/56-dwc_otg_22:55:112
1410499463,28cyclictest8050irq/56-dwc_otg_22:00:292
14104994623,13cyclictest1133-21runrttasks20:55:122
1410399462,6cyclictest0-21swapper/122:35:131
14102994631,9cyclictest101ktimersoftd/020:55:040
1410599457,24cyclictest0-21swapper/320:35:063
1410599451,9cyclictest0-21swapper/320:10:133
1410599451,9cyclictest0-21swapper/320:10:133
1410499457,24cyclictest0-21swapper/220:40:142
1410399457,25cyclictest0-21swapper/121:05:141
1410399453,12cyclictest0-21swapper/119:45:121
14102994518,3cyclictest0-21swapper/020:15:120
136392453,35sleep00-21swapper/019:07:370
1410499447,25cyclictest0-21swapper/220:25:142
1410499447,25cyclictest0-21swapper/220:15:142
1410499447,23cyclictest0-21swapper/222:05:152
1410399447,24cyclictest0-21swapper/100:20:161
1410399446,31cyclictest0-21swapper/123:25:141
1410399445,36cyclictest7950irq/56-dwc_otg_22:55:131
1410399444,25cyclictest0-21swapper/120:15:141
1410599430,4cyclictest18369-21apt-get00:15:123
1410499431,4cyclictest0-21swapper/222:25:202
14103994318,6cyclictest9220-21latency_hist23:25:021
14103994318,6cyclictest9220-21latency_hist23:25:021
120052430,3sleep2301ktimersoftd/222:49:032
1410599426,22cyclictest0-21swapper/322:00:063
1410499427,5cyclictest7950irq/56-dwc_otg_21:40:182
1410499427,5cyclictest7950irq/56-dwc_otg_21:40:182
14103994216,4cyclictest27063-21latency_hist21:50:011
1410599412,10cyclictest8050irq/56-dwc_otg_21:55:153
1410399419,11cyclictest7850irq/56-dwc_otg22:45:281
1410399417,25cyclictest0-21swapper/122:10:071
20312400,2sleep10-21swapper/121:58:211
1410599401,24cyclictest11970-21ssh22:10:073
1410399407,25cyclictest0-21swapper/119:35:151
1410399407,23cyclictest0-21swapper/120:20:131
1410399407,22cyclictest0-21swapper/120:05:151
1410399404,8cyclictest7950irq/56-dwc_otg_00:10:131
1410399404,5cyclictest0-21swapper/120:00:121
1410399402,7cyclictest20226-21sh22:20:011
14103994014,22cyclictest0-21swapper/121:20:141
174272392,33sleep20-21swapper/200:13:532
1410599393,10cyclictest1141-21ssh23:15:163
14105993920,10cyclictest39-21ksoftirqd/320:20:233
14105993918,14cyclictest5396-21ssh22:40:243
1410499397,11cyclictest29-21rcuc/200:05:172
1410399392,7cyclictest0-21swapper/120:10:141
1410399392,7cyclictest0-21swapper/120:10:141
285462380,2sleep10-21swapper/123:09:021
226092380,2sleep20-21swapper/221:00:262
1410599388,11cyclictest8050irq/56-dwc_otg_20:55:013
1410599385,15cyclictest37-21rcuc/300:05:343
14105993817,5cyclictest39-21ksoftirqd/323:57:203
1410399386,22cyclictest0-21swapper/100:00:151
1410399386,17cyclictest8050irq/56-dwc_otg_21:50:121
1410599379,4cyclictest0-21swapper/323:25:273
1410599379,18cyclictest0-21swapper/322:31:563
1410599376,10cyclictest8050irq/56-dwc_otg_19:25:143
1410599375,23cyclictest10168-21ssh21:30:143
1410599375,22cyclictest14430-21ssh21:35:133
14105993717,5cyclictest29079-21latency_hist23:10:013
1410599371,6cyclictest14101-21cyclictest00:00:153
14105993710,16cyclictest30172-21ssh23:50:133
1410499371,25cyclictest5062-21ls23:20:012
1410399373,4cyclictest23-21ksoftirqd/100:35:121
14103993711,6cyclictest8050irq/56-dwc_otg_23:55:191
316902360,2sleep10-21swapper/119:55:281
1410599366,24cyclictest385-21diskmemload22:35:063
14105993617,5cyclictest25920-21sh00:24:183
14105993614,5cyclictest39-21ksoftirqd/321:15:013
14105993611,9cyclictest8050irq/56-dwc_otg_20:00:133
1410499367,19cyclictest0-21swapper/220:35:132
1410499367,13cyclictest8050irq/56-dwc_otg_22:10:292
14104993613,10cyclictest8050irq/56-dwc_otg_23:05:282
1410499361,24cyclictest24935-21ls19:40:012
1410399366,22cyclictest0-21swapper/120:35:061
1410399366,16cyclictest0-21swapper/119:20:131
1410399362,9cyclictest0-21swapper/120:55:131
1410399362,4cyclictest8050irq/56-dwc_otg_22:40:141
14103993622,10cyclictest20413-21ssh22:20:121
14103993622,10cyclictest20413-21ssh22:20:121
1410399361,4cyclictest0-21swapper/122:50:121
1410399361,24cyclictest31831-21timerandwakeup00:30:291
1410599358,13cyclictest0-21swapper/323:00:163
14105993515,5cyclictest39-21ksoftirqd/321:15:183
1410599351,22cyclictest28305-21ls21:50:283
1410499358,4cyclictest7950irq/56-dwc_otg_00:25:122
1410499357,15cyclictest0-21swapper/219:15:142
14104993517,5cyclictest31461-21sh23:50:292
1410399354,7cyclictest7850irq/56-dwc_otg00:10:011
1410399353,5cyclictest7850irq/56-dwc_otg23:15:131
14103993511,12cyclictest30756-21rm21:15:291
1410599349,5cyclictest39-21ksoftirqd/323:10:223
1410599341,6cyclictest8050irq/56-dwc_otg_21:20:183
14105993412,5cyclictest6206-21fschecks_time21:25:173
1410599341,21cyclictest31506-21ls19:55:273
1410399348,16cyclictest0-21swapper/120:30:141
1410399348,12cyclictest7950irq/56-dwc_otg_23:10:281
1410399347,4cyclictest0-21swapper/123:50:141
1410399346,14cyclictest8050irq/56-dwc_otg_21:30:011
1410399345,20cyclictest25957-21ssh23:45:061
1410399344,23cyclictest0-21swapper/122:07:151
1410399342,18cyclictest0-21swapper/123:35:281
1410599339,5cyclictest8050irq/56-dwc_otg_19:20:163
1410599336,18cyclictest39-21ksoftirqd/322:45:223
14105993328,3cyclictest8050irq/56-dwc_otg_22:25:193
1410599331,6cyclictest8050irq/56-dwc_otg_20:45:173
1410599331,6cyclictest8050irq/56-dwc_otg_20:45:173
14105993314,4cyclictest28704-21/usr/sbin/munin19:50:283
14105993313,4cyclictest39-21ksoftirqd/319:40:213
14105993313,4cyclictest25124-21diskmemload00:12:043
14105993311,4cyclictest39-21ksoftirqd/300:30:183
14105993311,12cyclictest11393-21ntpq20:30:233
14105993311,10cyclictest0-21swapper/322:17:213
1410499337,4cyclictest7950irq/56-dwc_otg_22:00:012
1410499335,6cyclictest0-21swapper/219:25:282
1410499334,14cyclictest8050irq/56-dwc_otg_23:20:302
1410499334,14cyclictest8050irq/56-dwc_otg_23:20:302
1410499332,19cyclictest17657-21/usr/sbin/munin23:35:292
1410499331,15cyclictest7950irq/56-dwc_otg_19:55:282
1410399337,15cyclictest0-21swapper/121:00:131
1410399333,16cyclictest8050irq/56-dwc_otg_21:40:271
1410399333,16cyclictest8050irq/56-dwc_otg_21:40:271
14103993319,7cyclictest8050irq/56-dwc_otg_21:30:121
14103993315,4cyclictest17624-21seq20:47:521
14103993315,4cyclictest17624-21seq20:47:521
14103993310,12cyclictest0-21swapper/100:16:161
1410599329,4cyclictest22622-21unixbench_singl19:30:283
1410599328,10cyclictest0-21swapper/300:37:173
1410599326,14cyclictest0-21swapper/320:05:153
14105993223,6cyclictest10466-21cron20:30:003
14105993214,10cyclictest381ktimersoftd/322:52:183
1410599321,15cyclictest39-21ksoftirqd/319:15:213
14105993211,4cyclictest26358-21fschecks_count23:45:203
1410499323,12cyclictest7950irq/56-dwc_otg_23:43:402
1410499321,25cyclictest13987-21timerwakeupswit22:50:282
1410499321,15cyclictest7850irq/56-dwc_otg19:40:192
14104993210,4cyclictest0-21swapper/220:10:012
1410399328,4cyclictest0-21swapper/123:44:351
1410399323,4cyclictest7950irq/56-dwc_otg_19:15:291
14103993220,8cyclictest14695-21fschecks_count21:35:171
1410399321,8cyclictest18134-21aten_rbpower_po20:50:151
1410399321,20cyclictest24907-21ssh22:25:181
1410599318,4cyclictest8050irq/56-dwc_otg_00:25:243
1410599313,4cyclictest8050irq/56-dwc_otg_22:59:143
14105993110,4cyclictest14804-21basename20:40:183
1410499317,15cyclictest0-21swapper/200:15:132
1410499316,4cyclictest0-21swapper/222:35:292
1410499312,6cyclictest7950irq/56-dwc_otg_20:25:002
1410499312,5cyclictest22410-21wc19:30:262
14104993116,4cyclictest25381-21sh21:10:042
14104993115,4cyclictest16365-21cut20:45:152
14104993115,4cyclictest16365-21cut20:45:152
1410499311,13cyclictest7950irq/56-dwc_otg_20:10:192
1410499311,13cyclictest7950irq/56-dwc_otg_20:10:192
14104993110,4cyclictest0-21swapper/221:23:072
1410399312,6cyclictest7950irq/56-dwc_otg_20:25:111
1410399311,5cyclictest0-21swapper/120:40:121
1410399311,21cyclictest22375-21timerandwakeup19:30:261
1410599307,14cyclictest0-21swapper/321:45:173
1410599303,4cyclictest13578-21cut23:30:143
1410499302,10cyclictest0-21swapper/222:45:002
14104993018,3cyclictest8050irq/56-dwc_otg_21:35:312
14105992911,9cyclictest37-21rcuc/319:37:183
1410499298,4cyclictest0-21swapper/221:34:122
1410499292,4cyclictest30198-21ssh23:10:232
14103992914,4cyclictest1133-21runrttasks19:27:461
261682280,4sleep121-21rcuc/119:40:271
1410599284,4cyclictest7950irq/56-dwc_otg_21:05:283
1410599281,6cyclictest7950irq/56-dwc_otg_20:15:143
1410499283,5cyclictest7850irq/56-dwc_otg21:10:012
1410499281,12cyclictest8050irq/56-dwc_otg_19:20:212
1410499274,9cyclictest7950irq/56-dwc_otg_19:50:122
138032278,13sleep10-21swapper/119:09:411
1410499262,6cyclictest8050irq/56-dwc_otg_19:45:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional