You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 18:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot4s.osadl.org (updated Sat Apr 25, 2026 12:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2157999752,21cyclictest12-21ksoftirqd/010:50:130
21579996517,9cyclictest131rcu_preempt10:55:110
21613996441,15cyclictest35966irq/58-eth010:10:123
2157999593,45cyclictest9445-21ssh10:05:120
2160399513,34cyclictest29203-21ssh09:40:142
21579994810,7cyclictest12-21ksoftirqd/011:30:120
2157999475,38cyclictest29189-21ssh09:40:130
2160399455,21cyclictest14816-21ssh09:50:172
2158999454,25cyclictest27479-21ssh10:15:161
21603994415,18cyclictest27-21ksoftirqd/209:30:132
2157999445,9cyclictest12-21ksoftirqd/012:00:130
21603994316,15cyclictest131rcu_preempt07:15:142
2160399422,22cyclictest7746-21ssh10:40:142
21603994133,3cyclictest27-21ksoftirqd/212:30:122
2160399413,21cyclictest4032-21ssh10:20:132
2160399411,32cyclictest31144-21ssh10:35:142
21603994011,9cyclictest24499-21kworker/2:009:20:122
2158999392,34cyclictest29183-21ssh09:40:131
2157999393,3cyclictest131rcu_preempt10:15:140
2157999392,3cyclictest131rcu_preempt09:05:150
2161399386,21cyclictest35966irq/58-eth011:20:153
2161399382,22cyclictest35966irq/58-eth007:10:133
2161399382,22cyclictest35966irq/58-eth007:10:133
21603993817,15cyclictest27-21ksoftirqd/209:25:142
21603993817,15cyclictest27-21ksoftirqd/209:25:142
2157999381,10cyclictest12-21ksoftirqd/010:25:130
2161399373,21cyclictest35966irq/58-eth009:25:143
2161399373,21cyclictest35966irq/58-eth009:25:143
2161399372,20cyclictest35966irq/58-eth009:55:143
2157999366,5cyclictest12-21ksoftirqd/011:50:130
2157999365,3cyclictest131rcu_preempt09:50:160
2158999356,21cyclictest22103-21ssh10:30:141
2160399333,10cyclictest2137-21apt-get10:55:112
2157999333,7cyclictest12-21ksoftirqd/012:05:120
21613993210,12cyclictest35966irq/58-eth010:20:133
2160399323,19cyclictest27346irq/40-dwc2_hso07:55:152
21603993212,11cyclictest18424-21ssh10:10:122
2157999322,6cyclictest12-21ksoftirqd/011:20:150
2160399312,8cyclictest330-21ssh10:00:142
21589993121,4cyclictest32647-21ssh11:30:131
2157999315,3cyclictest131rcu_preempt12:15:130
2157999313,4cyclictest12-21ksoftirqd/010:10:130
2161399304,16cyclictest0-21swapper/311:30:123
2160399301,17cyclictest25659-21apt-get10:50:132
2157999306,3cyclictest131rcu_preempt10:35:140
2160399296,12cyclictest27346irq/40-dwc2_hso12:05:122
2160399294,17cyclictest27346irq/40-dwc2_hso07:45:142
2160399294,13cyclictest27346irq/40-dwc2_hso11:20:162
2160399292,21cyclictest0-21swapper/209:05:162
2160399292,21cyclictest0-21swapper/208:05:152
2160399292,20cyclictest0-21swapper/208:10:142
2160399292,17cyclictest27346irq/40-dwc2_hso12:15:142
21603992913,13cyclictest8269-21cron07:30:012
21589992911,5cyclictest131rcu_preempt11:45:121
2157999294,9cyclictest12-21ksoftirqd/011:00:130
2157999291,20cyclictest20196-21ssh09:35:140
2161399283,17cyclictest35966irq/58-eth010:25:133
2160399286,12cyclictest27346irq/40-dwc2_hso10:45:132
2160399283,6cyclictest20157-21ssh11:05:142
2160399283,17cyclictest27346irq/40-dwc2_hso12:35:152
2160399283,17cyclictest27346irq/40-dwc2_hso11:35:142
2160399282,16cyclictest27346irq/40-dwc2_hso07:40:132
21603992821,3cyclictest27-21ksoftirqd/208:40:132
2158999283,6cyclictest21-21ksoftirqd/112:25:131
21589992810,3cyclictest131rcu_preempt09:30:311
2157999288,14cyclictest12-21ksoftirqd/010:30:150
2157999287,5cyclictest131rcu_preempt10:40:140
2157999285,4cyclictest131rcu_preempt11:40:130
21579992813,10cyclictest151rcuc/008:35:140
2161399275,12cyclictest35966irq/58-eth008:20:143
2161399271,15cyclictest35966irq/58-eth007:55:143
2160399274,15cyclictest27346irq/40-dwc2_hso07:50:132
2160399273,15cyclictest27346irq/40-dwc2_hso10:25:132
2160399273,13cyclictest27346irq/40-dwc2_hso11:45:132
2157999278,14cyclictest131rcu_preempt07:30:290
2157999275,3cyclictest131rcu_preempt10:20:120
2157999274,17cyclictest664-21ntpd09:00:140
2161399264,12cyclictest0-21swapper/311:25:133
2160399263,19cyclictest0-21swapper/209:55:152
2160399261,16cyclictest4887-21apt-get08:00:132
2160399261,16cyclictest4887-21apt-get08:00:132
2158999265,3cyclictest131rcu_preempt11:15:331
2157999265,3cyclictest131rcu_preempt12:20:130
2157999265,3cyclictest131rcu_preempt12:20:130
2157999262,18cyclictest16649-21ssh09:15:140
21613992514,7cyclictest35966irq/58-eth010:40:143
2161399251,14cyclictest35966irq/58-eth011:05:143
2161399251,13cyclictest35966irq/58-eth010:15:143
21613992511,11cyclictest35966irq/58-eth010:05:133
2160399253,15cyclictest27346irq/40-dwc2_hso08:20:152
2160399251,17cyclictest261rcuc/207:35:142
2158999258,6cyclictest131rcu_preempt12:08:451
2158999256,6cyclictest21-21ksoftirqd/111:25:301
2158999256,3cyclictest131rcu_preempt12:30:171
2158999255,3cyclictest131rcu_preempt08:00:261
2158999255,3cyclictest131rcu_preempt08:00:261
21589992511,7cyclictest21-21ksoftirqd/110:59:331
21589992511,4cyclictest21-21ksoftirqd/109:47:251
2157999257,4cyclictest131rcu_preempt08:20:320
2157999253,15cyclictest12-21ksoftirqd/012:10:250
21579992514,5cyclictest7534-21rm09:26:060
21579992514,5cyclictest7534-21rm09:26:060
21579992512,3cyclictest0-21swapper/007:25:260
2157999251,18cyclictest23663-21ssh11:25:140
2161399242,9cyclictest0-21swapper/309:40:133
21613992413,8cyclictest35966irq/58-eth010:45:133
2161399241,14cyclictest35966irq/58-eth008:10:133
2160399244,12cyclictest27346irq/40-dwc2_hso09:10:122
2158999249,4cyclictest21-21ksoftirqd/111:13:491
2158999245,3cyclictest131rcu_preempt10:50:321
2158999244,3cyclictest131rcu_preempt11:20:261
2158999242,7cyclictest21-21ksoftirqd/111:40:121
2158999242,5cyclictest21-21ksoftirqd/112:15:241
2158999241,3cyclictest131rcu_preempt10:10:281
2158999241,3cyclictest131rcu_preempt08:25:261
21589992412,10cyclictest0-21swapper/111:59:021
21589992410,3cyclictest131rcu_preempt12:10:261
2157999248,4cyclictest12-21ksoftirqd/011:14:580
2157999241,19cyclictest11218-21ssh12:30:120
21613992316,5cyclictest0-21swapper/312:07:453
2160399237,10cyclictest0-21swapper/208:35:142
2160399234,10cyclictest24546irq/40-fe98000011:40:132
2160399232,14cyclictest27346irq/40-dwc2_hso08:50:122
21603992312,9cyclictest14868-21ssh10:06:102
2160399231,14cyclictest27346irq/40-dwc2_hso08:30:142
2158999238,4cyclictest131rcu_preempt09:25:141
2158999238,4cyclictest131rcu_preempt09:25:141
2158999237,4cyclictest21-21ksoftirqd/109:38:401
2158999237,4cyclictest131rcu_preempt10:10:021
2158999236,5cyclictest21-21ksoftirqd/109:00:281
2158999233,3cyclictest131rcu_preempt11:53:111
2158999231,18cyclictest12972-21apt-get10:25:131
2158999231,12cyclictest21-21ksoftirqd/108:55:191
21589992311,10cyclictest0-21swapper/109:12:181
2157999239,7cyclictest0-21swapper/010:00:440
2157999239,3cyclictest12-21ksoftirqd/010:45:450
2157999238,8cyclictest151rcuc/007:10:130
2157999238,8cyclictest151rcuc/007:10:130
2157999231,4cyclictest131rcu_preempt07:35:140
2157999231,2cyclictest131rcu_preempt07:55:130
2157999231,19cyclictest9639-21ls09:45:270
2161399229,10cyclictest0-21swapper/311:15:013
2161399223,13cyclictest35966irq/58-eth012:20:133
2161399223,13cyclictest35966irq/58-eth012:20:133
2161399222,12cyclictest35966irq/58-eth011:15:153
2160399228,4cyclictest131rcu_preempt10:15:272
2160399228,11cyclictest18041-21kthreadcore08:45:222
2160399225,8cyclictest2756-21grep07:20:292
2160399223,11cyclictest23599-21cut12:00:202
2160399222,5cyclictest0-21swapper/208:15:132
2160399222,12cyclictest15029-21cut11:55:222
21603992214,5cyclictest4526-21ssh11:30:292
2158999229,10cyclictest0-21swapper/110:35:491
2158999228,4cyclictest21-21ksoftirqd/109:59:531
2158999228,4cyclictest131rcu_preempt09:20:191
2158999228,10cyclictest131rcu_preempt11:35:191
2158999227,8cyclictest21-21ksoftirqd/110:01:261
2158999227,7cyclictest21-21ksoftirqd/112:21:051
2158999227,7cyclictest21-21ksoftirqd/112:21:051
2158999225,10cyclictest21-21ksoftirqd/108:20:211
2158999223,8cyclictest21-21ksoftirqd/111:03:121
21589992217,3cyclictest630-21Async09:36:311
21589992216,3cyclictest201rcuc/107:40:131
21589992216,3cyclictest0-21swapper/110:40:141
2158999221,4cyclictest21-21ksoftirqd/107:50:311
2157999229,5cyclictest16474-21ssh11:38:260
2157999229,3cyclictest0-21swapper/009:14:160
2157999227,8cyclictest12-21ksoftirqd/012:38:130
2157999223,10cyclictest19900-21cut07:40:200
2157999221,2cyclictest131rcu_preempt11:15:150
2157999221,15cyclictest1-21systemd07:45:150
2161399219,7cyclictest0-21swapper/311:35:143
2161399217,10cyclictest35966irq/58-eth007:50:133
2161399212,14cyclictest35966irq/58-eth009:30:133
21613992112,6cyclictest0-21swapper/311:55:293
21613992111,7cyclictest35966irq/58-eth009:20:133
21613992110,7cyclictest35966irq/58-eth011:00:133
2160399217,6cyclictest16111-21latency_hist12:15:012
2160399217,10cyclictest0-21swapper/211:00:142
2160399213,15cyclictest5869-21fschecks_count09:45:152
2160399212,15cyclictest20574-21grep09:35:182
2160399212,15cyclictest11461-21kthreadcore07:30:212
2160399212,14cyclictest27346irq/40-dwc2_hso12:25:132
2160399212,11cyclictest19325-21kthreadcore09:15:222
2160399211,4cyclictest0-21swapper/207:10:152
2160399211,4cyclictest0-21swapper/207:10:142
2160399211,16cyclictest4062-21ssh11:50:182
2160399211,16cyclictest21674-21cat07:10:022
2160399211,11cyclictest30321-21usage_EthcTask12:20:322
2160399211,11cyclictest30321-21usage_EthcTask12:20:312
2160399211,10cyclictest22845-21sed10:30:202
21603992110,9cyclictest3396-21ssh11:12:492
2158999218,3cyclictest131rcu_preempt11:05:591
2158999217,4cyclictest21-21ksoftirqd/107:35:211
2158999217,4cyclictest0-21swapper/112:01:101
2158999216,11cyclictest131rcu_preempt08:30:301
2158999213,3cyclictest131rcu_preempt09:50:241
2158999212,4cyclictest21-21ksoftirqd/107:30:301
21589992116,3cyclictest0-21swapper/107:25:141
2158999211,17cyclictest11060-21apt-get08:40:121
21589992111,4cyclictest21-21ksoftirqd/112:35:211
2157999219,4cyclictest12-21ksoftirqd/008:50:280
2157999219,3cyclictest12-21ksoftirqd/012:25:140
2157999218,4cyclictest131rcu_preempt08:25:200
2157999216,8cyclictest0-21swapper/011:46:220
2157999214,4cyclictest31363-21xargs07:50:280
2157999214,11cyclictest0-21swapper/008:00:130
2157999214,11cyclictest0-21swapper/008:00:130
21579992112,3cyclictest0-21swapper/008:10:160
2161399209,8cyclictest0-21swapper/309:16:513
2161399208,9cyclictest0-21swapper/310:39:113
2161399204,3cyclictest0-21swapper/310:50:133
2161399202,11cyclictest0-21swapper/307:30:143
2161399202,11cyclictest0-21swapper/307:20:153
21613992011,6cyclictest0-21swapper/309:50:283
2160399203,14cyclictest29123-21fschecks_count08:25:172
2160399202,15cyclictest27598-21ssh11:25:292
2160399201,15cyclictest25616-21fschecks_count08:55:172
2160399201,10cyclictest5798-21sort11:15:172
2158999209,3cyclictest21-21ksoftirqd/110:45:451
2158999205,2cyclictest131rcu_preempt09:05:151
2158999203,2cyclictest131rcu_preempt10:21:581
2158999202,4cyclictest21-21ksoftirqd/109:17:181
2158999201,9cyclictest0-21swapper/108:35:151
2158999201,4cyclictest53646usb-storage08:15:051
2157999209,2cyclictest12-21ksoftirqd/011:05:220
2157999205,2cyclictest131rcu_preempt09:55:140
2157999204,5cyclictest31500-21fschecks_time07:20:170
2157999202,6cyclictest0-21swapper/009:31:430
2157999201,7cyclictest131rcu_preempt08:40:310
2157999201,5cyclictest0-21swapper/009:21:270
2157999201,3cyclictest131rcu_preempt08:55:200
2157999201,3cyclictest0-21swapper/011:55:210
2161399199,8cyclictest0-21swapper/311:41:143
2161399199,7cyclictest35966irq/58-eth010:30:133
2161399192,10cyclictest0-21swapper/308:15:053
21613991912,4cyclictest0-21swapper/312:30:183
21613991911,5cyclictest35966irq/58-eth010:00:283
21613991911,5cyclictest0-21swapper/312:00:183
2161399191,13cyclictest0-21swapper/308:40:023
2161399191,13cyclictest0-21swapper/307:25:243
21613991910,6cyclictest0-21swapper/312:25:203
21613991910,6cyclictest0-21swapper/312:14:153
2160399191,9cyclictest30410-21fschecks_count09:00:162
2158999199,2cyclictest21-21ksoftirqd/108:50:141
2158999196,7cyclictest21-21ksoftirqd/107:15:151
2158999194,9cyclictest131rcu_preempt07:20:181
2157999191,5cyclictest12-21ksoftirqd/008:30:270
21579991912,4cyclictest12-21ksoftirqd/008:15:200
21579991910,3cyclictest0-21swapper/008:45:290
2161399189,6cyclictest0-21swapper/309:35:273
2161399189,5cyclictest0-21swapper/309:10:143
2161399187,6cyclictest0-21swapper/311:45:223
2161399182,10cyclictest0-21swapper/309:00:143
2161399182,10cyclictest0-21swapper/308:55:153
2161399182,10cyclictest0-21swapper/308:50:143
2161399182,10cyclictest0-21swapper/308:25:143
2161399182,10cyclictest0-21swapper/308:00:163
2161399182,10cyclictest0-21swapper/308:00:153
2161399182,10cyclictest0-21swapper/307:35:153
2161399181,14cyclictest0-21swapper/310:59:393
2161399181,10cyclictest0-21swapper/308:30:163
21613991810,3cyclictest0-21swapper/312:37:103
2158999188,3cyclictest131rcu_preempt08:05:161
2158999184,5cyclictest21-21ksoftirqd/107:10:331
2158999184,5cyclictest21-21ksoftirqd/107:10:331
2158999181,3cyclictest131rcu_preempt07:55:261
2161399179,3cyclictest0-21swapper/312:15:053
2161399172,11cyclictest0-21swapper/311:50:153
2161399172,10cyclictest0-21swapper/307:15:143
2161399171,11cyclictest0-21swapper/309:45:133
2161399171,10cyclictest0-21swapper/308:05:153
2158999171,3cyclictest131rcu_preempt07:45:311
2158999170,14cyclictest19466-21ls08:45:281
2157999171,10cyclictest0-21swapper/007:15:140
2161399162,10cyclictest0-21swapper/308:40:133
2161399162,10cyclictest0-21swapper/307:45:153
2157999169,5cyclictest9726-21apt-get08:05:130
2161399151,8cyclictest35966irq/58-eth009:05:143
2158999159,4cyclictest21-21ksoftirqd/107:10:011
2161399147,4cyclictest36066irq/59-eth008:45:183
2157999141,10cyclictest21636-21grep07:10:010
2161399138,3cyclictest0-21swapper/307:44:433
2161399121,6cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional