You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-08 - 21:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sat Aug 08, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2697921760,6sleep31422699cyclictest12:31:463
14224991342,82cyclictest0-21swapper/111:15:171
14225991253,93cyclictest17269-21sed11:40:302
14225991253,93cyclictest17269-21sed11:40:302
142249912213,85cyclictest11783-21latency_hist11:35:021
14223991202,58cyclictest7950irq/56-dwc_otg_11:20:320
14225991194,64cyclictest0-21swapper/211:15:172
14225991138,70cyclictest20654-21ssh11:05:302
14225991138,70cyclictest20654-21ssh11:05:302
142249911210,10cyclictest16729-21/usr/sbin/munin12:20:351
14224991084,11cyclictest17147-21threads11:40:281
14224991084,11cyclictest17147-21threads11:40:281
14224991074,87cyclictest0-21swapper/112:00:331
14223991065,85cyclictest0-21swapper/012:20:220
14224991058,30cyclictest7750irq/56-dwc_otg11:50:161
142239910516,59cyclictest0-21swapper/011:30:220
142239910410,72cyclictest26225-21kworker/0:012:35:330
2862521030,2sleep30-21swapper/310:35:253
142249910310,19cyclictest20650-21ls11:05:301
142249910310,19cyclictest20650-21ls11:05:301
142239910364,18cyclictest7750irq/56-dwc_otg12:00:190
14224991018,31cyclictest7750irq/56-dwc_otg11:20:311
14223991004,80cyclictest0-21swapper/011:10:140
1422399983,66cyclictest24370-21ssh11:50:180
100442980,4sleep10-21swapper/109:30:271
100442980,4sleep10-21swapper/109:30:271
1422499954,11cyclictest23754-21ssh11:10:141
101792950,34sleep01422399cyclictest10:53:230
14223999430,32cyclictest27935-21aten_rbpower_en11:15:180
1422599923,59cyclictest24873-21timerwakeupswit11:10:322
1422599913,66cyclictest1241-21ssh12:00:322
1422399914,55cyclictest17301-21ssh11:40:310
1422399914,55cyclictest17301-21ssh11:40:310
1422599903,64cyclictest11684-21ssh11:35:022
1422499909,9cyclictest0-21swapper/111:25:251
1422399903,61cyclictest0-21swapper/010:55:180
56082890,2sleep00-21swapper/011:26:410
248852880,2sleep20-21swapper/211:50:262
1422599884,63cyclictest4429-21ntpq11:25:262
1422399873,61cyclictest0-21swapper/011:45:180
1422399853,63cyclictest0-21swapper/011:05:320
1422399853,63cyclictest0-21swapper/011:05:320
85042840,7sleep01422399cyclictest09:29:130
1422599833,73cyclictest20470-21df_inode11:45:182
1422599812,52cyclictest571-21threads11:20:292
1422399811,53cyclictest0-21swapper/008:10:140
1422599803,57cyclictest11367-21apt-get10:55:182
1422599803,57cyclictest0-21swapper/211:35:042
1422399807,68cyclictest0-21swapper/009:45:150
1422599793,49cyclictest17004-21diskstats12:20:212
1422599784,68cyclictest30208-21timerwakeupswit12:35:312
14225997815,39cyclictest26892-21timerwakeupswit09:10:322
1422599781,51cyclictest24301-21/usr/sbin/munin09:05:222
14224997812,36cyclictest21-21rcuc/111:45:181
286082770,1sleep10-21swapper/107:50:021
48732760,2sleep10-21swapper/112:05:231
30532760,2sleep10-21swapper/110:44:491
14225997615,52cyclictest32339-21fschecks_time10:40:202
1422399762,62cyclictest0-21swapper/010:05:160
202322750,2sleep00-21swapper/008:55:180
1422399758,57cyclictest0-21swapper/008:00:090
324432740,1sleep30-21swapper/309:18:163
1422599731,47cyclictest11662-21ssh10:14:242
1422499735,31cyclictest0-21swapper/110:55:171
1422399733,45cyclictest0-21swapper/011:35:040
1422599712,43cyclictest6234-21ssh10:06:292
1422599705,50cyclictest15670-21ssh10:19:312
1422599705,50cyclictest15670-21ssh10:19:312
1422599701,47cyclictest20944-21cat09:45:022
1422499704,26cyclictest0-21swapper/112:35:321
1422399702,64cyclictest29937-21cat09:55:290
195362690,2sleep10-21swapper/110:24:221
1422599691,50cyclictest26053-21sed09:50:302
1422599686,50cyclictest20996-21ssh09:45:032
1422599684,46cyclictest7850irq/56-dwc_otg_08:55:092
1422599681,50cyclictest26905-21ssh10:33:232
1422599681,50cyclictest26905-21ssh10:33:232
1422599681,42cyclictest8402-21ssh09:29:012
1422599681,42cyclictest29365-21tune2fs09:55:202
1422399682,48cyclictest0-21swapper/010:10:120
14223996823,28cyclictest0-21swapper/007:35:130
14223996823,28cyclictest0-21swapper/007:35:130
1422599671,47cyclictest15293-21seq09:37:032
1422599671,46cyclictest3627-21rm10:04:062
1422599671,46cyclictest22639-21ssh10:27:432
1422599671,45cyclictest12506-21ssh09:34:212
1422599671,45cyclictest12506-21ssh09:34:212
1422599671,38cyclictest31514-21runrttasks07:55:282
1422599671,38cyclictest31514-21runrttasks07:55:282
1422399677,51cyclictest0-21swapper/007:10:150
1422399675,39cyclictest0-21swapper/008:15:170
1422399675,39cyclictest0-21swapper/008:15:170
1422399671,43cyclictest10467-21sed09:30:320
1422399671,43cyclictest10467-21sed09:30:320
1422599661,50cyclictest18128-21apt-get08:50:142
1422599661,50cyclictest18128-21apt-get08:50:142
1422599661,48cyclictest31179-21ssh09:15:482
1422599661,48cyclictest23295-21apt-get07:35:142
1422599661,48cyclictest23295-21apt-get07:35:142
1422599661,44cyclictest30800-21ssh10:38:202
1422599661,41cyclictest18520-21ssh10:22:222
1422399662,48cyclictest1391-21wget09:20:170
1422399662,37cyclictest0-21swapper/009:10:140
1422399661,47cyclictest16588-21grep07:15:220
1422599651,48cyclictest3025-21ssh09:21:252
1422599651,41cyclictest22035-21aten_rbpower_vo09:00:172
1422599641,51cyclictest5224-21ssh10:46:222
1422499641,18cyclictest0-21swapper/108:10:151
1422399647,33cyclictest0-21swapper/009:35:150
1422399641,46cyclictest17436-21grep08:45:310
1422599631,50cyclictest18612-21/usr/sbin/munin07:20:272
1422499639,23cyclictest11881-21sh11:35:041
1422399631,50cyclictest0-21swapper/010:32:340
1422399631,50cyclictest0-21swapper/010:32:340
1422599621,50cyclictest12208-21chrt08:31:572
1422599621,42cyclictest0-21swapper/207:45:122
1422599621,34cyclictest8340-21/usr/sbin/munin10:50:292
1422399622,38cyclictest30916-21sed09:15:310
1422399621,14cyclictest0-21swapper/009:05:020
1422699616,12cyclictest1243-21ssh12:00:333
1422599612,41cyclictest7950irq/56-dwc_otg_07:35:022
1422599612,34cyclictest4136-21irqstats08:10:232
1422599611,43cyclictest25098-21apt-get07:40:152
14223996134,12cyclictest0-21swapper/010:35:270
14223996114,18cyclictest0-21swapper/010:45:310
1422699603,12cyclictest25402-21diskmemload12:35:333
1422599601,44cyclictest19833-21cpu07:25:162
14223996039,5cyclictest7850irq/56-dwc_otg_10:00:230
14223996038,6cyclictest7850irq/56-dwc_otg_08:45:010
1422399601,48cyclictest0-21swapper/010:21:030
1422399601,43cyclictest11477-21cat08:30:230
1422699594,9cyclictest0-21swapper/311:25:283
1422599591,46cyclictest6341-21ssh12:06:552
1422599591,45cyclictest7850irq/56-dwc_otg_08:50:012
1422599591,36cyclictest14468-21df07:10:172
1422399592,43cyclictest0-21swapper/010:44:440
1422699585,21cyclictest0-21swapper/311:20:313
1422599587,48cyclictest29929-21grep07:50:302
1422599582,52cyclictest32600-21aten_rbpower_po08:00:162
1422599582,13cyclictest0-21swapper/208:20:142
1422599581,43cyclictest30150-21sh11:56:142
1422599581,42cyclictest7750irq/56-dwc_otg12:12:292
1422599581,40cyclictest7750irq/56-dwc_otg12:32:092
1422599581,36cyclictest1191-21snmpd07:17:392
1422399581,38cyclictest8820-21ssh12:10:210
1422699573,26cyclictest7750irq/56-dwc_otg11:35:023
1422599573,37cyclictest7950irq/56-dwc_otg_12:25:192
1422599573,37cyclictest7950irq/56-dwc_otg_12:25:192
1422599571,43cyclictest7950irq/56-dwc_otg_11:02:202
1422599571,39cyclictest10618-21taskset08:29:402
1422499572,16cyclictest1257-21ssh09:20:141
14223995737,7cyclictest0-21swapper/009:40:170
1422399572,41cyclictest0-21swapper/012:25:300
1422399572,41cyclictest0-21swapper/012:25:300
1422599561,4cyclictest12586-21ssh12:15:152
14223995628,12cyclictest7850irq/56-dwc_otg_11:55:210
14223995627,7cyclictest18971-21grep07:20:310
14223995625,15cyclictest7950irq/56-dwc_otg_11:00:200
1422399562,44cyclictest0-21swapper/010:25:400
1422399562,42cyclictest0-21swapper/007:50:260
1422399562,41cyclictest0-21swapper/008:50:280
1422399562,41cyclictest0-21swapper/008:50:280
1422399562,39cyclictest25599-21latency_hist09:10:020
1422399562,39cyclictest0-21swapper/009:50:190
1422699555,26cyclictest37-21rcuc/311:45:183
14226995535,14cyclictest25029-21unixbench_singl11:10:343
14226995512,24cyclictest0-21swapper/312:20:213
1422599551,40cyclictest0-21swapper/208:42:342
1422399553,38cyclictest0-21swapper/012:35:010
1422399552,42cyclictest15542-21diskmemload10:19:160
1422399552,42cyclictest15542-21diskmemload10:19:160
1422499548,28cyclictest0-21swapper/108:35:151
14223995446,2cyclictest0-21swapper/008:20:130
14223995427,14cyclictest5544-21unixbench_singl12:05:310
1422699535,11cyclictest0-21swapper/307:35:133
1422699535,11cyclictest0-21swapper/307:35:133
1422599531,48cyclictest5709-21entropy08:15:202
1422599531,48cyclictest5709-21entropy08:15:202
1422599531,48cyclictest13166-21/usr/sbin/munin08:35:222
14224995333,8cyclictest0-21swapper/110:35:171
1422399532,39cyclictest0-21swapper/008:05:320
1422699528,27cyclictest0-21swapper/309:00:083
14226995222,11cyclictest7850irq/56-dwc_otg_11:05:323
14226995222,11cyclictest7850irq/56-dwc_otg_11:05:323
1422699521,6cyclictest7950irq/56-dwc_otg_10:05:153
1422399529,8cyclictest7750irq/56-dwc_otg07:40:150
1422399528,29cyclictest0-21swapper/007:45:070
1422399523,36cyclictest0-21swapper/007:25:150
1422399521,39cyclictest13844-21unixbench_singl08:35:310
1422599512,45cyclictest2549-21grep08:05:252
1422399512,36cyclictest0-21swapper/007:55:180
1422399512,36cyclictest0-21swapper/007:55:180
1422399511,41cyclictest0-21swapper/008:25:160
1422699507,12cyclictest7950irq/56-dwc_otg_11:50:163
1422699503,17cyclictest27945-21aten_rbpower_en11:15:183
1422699503,10cyclictest31138-21kworker/3:010:55:183
1422399502,37cyclictest0-21swapper/007:30:290
128692500,25sleep37950irq/56-dwc_otg_10:15:263
128692500,25sleep37950irq/56-dwc_otg_10:15:263
1422499498,30cyclictest0-21swapper/109:35:151
14226994812,10cyclictest7850irq/56-dwc_otg_11:40:323
14226994812,10cyclictest7850irq/56-dwc_otg_11:40:323
1422499464,26cyclictest31205-21ls07:55:231
1422499464,26cyclictest31205-21ls07:55:231
14223994629,5cyclictest0-21swapper/012:15:060
1422699457,22cyclictest7950irq/56-dwc_otg_07:20:163
1422499458,24cyclictest0-21swapper/108:25:151
1422499457,24cyclictest0-21swapper/108:20:151
1422499448,27cyclictest0-21swapper/109:25:081
1422499442,27cyclictest7750irq/56-dwc_otg10:50:021
137912443,35sleep00-21swapper/007:07:540
96372430,3sleep30-21swapper/309:30:213
96372430,3sleep30-21swapper/309:30:213
1422699431,27cyclictest0-21swapper/307:45:073
1422499435,5cyclictest17152-21ssh09:40:141
1422699426,24cyclictest25065-21ssh09:50:163
1422699421,25cyclictest30868-21uniq07:55:193
1422699421,25cyclictest30868-21uniq07:55:193
1422499426,9cyclictest7850irq/56-dwc_otg_10:05:161
1422499425,8cyclictest30633-21/usr/sbin/munin09:15:281
1422499425,25cyclictest7750irq/56-dwc_otg10:00:021
1422499425,24cyclictest7750irq/56-dwc_otg10:16:341
1422499425,24cyclictest7750irq/56-dwc_otg10:16:341
1422499417,5cyclictest7850irq/56-dwc_otg_09:10:141
1422499416,20cyclictest7750irq/56-dwc_otg08:00:161
14224994119,5cyclictest21796-21sh10:26:041
1422699409,17cyclictest0-21swapper/309:05:163
1422699407,7cyclictest7750irq/56-dwc_otg08:50:143
1422699407,7cyclictest7750irq/56-dwc_otg08:50:143
1422699404,9cyclictest0-21swapper/308:40:123
14226994015,6cyclictest381ktimersoftd/310:43:213
1422499405,20cyclictest24395-21ssh10:30:191
1422499405,20cyclictest24395-21ssh10:30:191
1422499404,5cyclictest0-21swapper/108:15:141
1422499404,5cyclictest0-21swapper/108:15:141
1422499404,13cyclictest7750irq/56-dwc_otg08:40:211
14224994022,14cyclictest0-21swapper/112:10:161
14226993912,12cyclictest8038-21idleruntime-cro12:10:023
1422499396,23cyclictest0-21swapper/112:15:081
1422499395,25cyclictest15506-21ssh11:00:161
1422699385,19cyclictest0-21swapper/308:55:223
14226993821,5cyclictest24224-21ssh12:29:173
14226993821,5cyclictest24224-21ssh12:29:173
14226993813,5cyclictest62762switchtime09:25:273
1422699381,31cyclictest940-21ls08:00:293
14226993810,7cyclictest21472-21grep10:25:333
1422499386,23cyclictest0-21swapper/111:55:171
1422499385,5cyclictest7750irq/56-dwc_otg10:50:121
1422499382,20cyclictest0-21swapper/107:30:151
1422499381,3cyclictest7750irq/56-dwc_otg07:25:121
1422499381,16cyclictest0-21swapper/108:45:241
14224993811,5cyclictest0-21swapper/109:50:161
13802380,3sleep31373-21ssh10:00:273
1422699378,6cyclictest0-21swapper/309:37:283
14226993723,8cyclictest24273-21wget10:30:173
14226993723,8cyclictest24273-21wget10:30:173
14226993722,10cyclictest25402-21diskmemload11:35:043
1422699371,23cyclictest2396-21ls08:05:233
1422499374,20cyclictest4281-21rm10:05:021
14224993712,9cyclictest0-21swapper/107:35:131
14224993712,9cyclictest0-21swapper/107:35:131
1422499371,22cyclictest0-21swapper/108:55:181
1422699368,17cyclictest0-21swapper/309:45:153
1422699368,17cyclictest0-21swapper/309:40:163
1422699368,17cyclictest0-21swapper/307:40:173
1422699368,14cyclictest0-21swapper/310:46:333
1422699366,11cyclictest28458-21ssh11:55:153
14226993620,4cyclictest1640350wget10:20:173
14226993610,5cyclictest7950irq/56-dwc_otg_09:55:243
1422499369,12cyclictest8347-21/usr/sbin/munin10:10:251
1422499366,22cyclictest0-21swapper/109:47:591
1422499362,22cyclictest25566-21latency_hist09:10:021
139422365,21sleep20-21swapper/207:09:542
1422699358,5cyclictest7850irq/56-dwc_otg_10:50:183
1422699356,5cyclictest7950irq/56-dwc_otg_12:15:323
1422699354,14cyclictest7950irq/56-dwc_otg_09:13:593
14226993517,10cyclictest19876-21cpuspeed07:25:163
1422499358,14cyclictest7950irq/56-dwc_otg_12:30:161
1422499354,18cyclictest7950irq/56-dwc_otg_09:00:311
14224993517,11cyclictest221ktimersoftd/108:52:081
14224993517,11cyclictest221ktimersoftd/108:52:081
138842352,24sleep10-21swapper/107:09:081
1422699348,6cyclictest7950irq/56-dwc_otg_08:35:153
1422699348,10cyclictest7950irq/56-dwc_otg_11:00:243
14226993416,5cyclictest9813-21sh10:10:453
14224993416,6cyclictest11701-21processes08:30:271
1422699335,10cyclictest7950irq/56-dwc_otg_09:24:223
1422499336,5cyclictest7750irq/56-dwc_otg08:05:311
1422499332,17cyclictest0-21swapper/107:10:281
1422499331,22cyclictest7750irq/56-dwc_otg12:25:301
1422499331,22cyclictest7750irq/56-dwc_otg12:25:301
131442335,13sleep30-21swapper/307:05:223
1422699327,15cyclictest0-21swapper/307:10:153
1422699324,4cyclictest7850irq/56-dwc_otg_08:45:143
1422699322,12cyclictest7750irq/56-dwc_otg08:10:203
1422699321,12cyclictest9185-21wget08:25:163
1422499321,21cyclictest0-21swapper/107:40:291
1422699317,4cyclictest7850irq/56-dwc_otg_08:20:143
1422699313,5cyclictest7750irq/56-dwc_otg12:10:303
1422699312,17cyclictest0-21swapper/307:50:213
1422499317,13cyclictest7850irq/56-dwc_otg_07:20:201
1422499311,22cyclictest7850irq/56-dwc_otg_07:50:241
1422699303,11cyclictest7850irq/56-dwc_otg_07:15:223
14226993017,5cyclictest10892-21/usr/sbin/munin08:30:243
14226993017,10cyclictest0-21swapper/308:20:023
14226993017,10cyclictest0-21swapper/308:20:023
1422699298,9cyclictest7950irq/56-dwc_otg_07:35:023
1422499291,22cyclictest17640-21latency_hist07:20:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional