You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 01:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot4s.osadl.org (updated Fri Jul 31, 2026 12:45:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17421997539,24cyclictest35966irq/58-eth009:30:153
17421996749,10cyclictest35966irq/58-eth009:45:143
17421996033,15cyclictest35966irq/58-eth012:35:143
17421995316,24cyclictest35966irq/58-eth010:00:133
17413995315,30cyclictest27-21ksoftirqd/212:35:142
1741399522,36cyclictest25108-21ssh09:40:112
17413995111,15cyclictest27-21ksoftirqd/211:25:122
17421995017,22cyclictest35966irq/58-eth010:05:133
1741399471,39cyclictest5289-21ssh11:35:122
1739799470,36cyclictest19780-21ssh09:55:120
1742199462,25cyclictest35966irq/58-eth007:40:133
1740599465,38cyclictest1777-21ssh11:15:131
1739799464,35cyclictest12322-21ssh12:15:120
1739799440,35cyclictest10784-21ssh11:20:140
1742199434,22cyclictest35966irq/58-eth008:05:153
1740599435,9cyclictest131rcu_preempt12:05:131
1742199414,26cyclictest35966irq/58-eth011:50:143
1742199412,23cyclictest35966irq/58-eth012:00:133
17397994123,8cyclictest12-21ksoftirqd/012:30:130
17397994123,6cyclictest12-21ksoftirqd/011:45:120
1742199401,24cyclictest35966irq/58-eth007:35:123
1741399404,24cyclictest27-21ksoftirqd/207:20:132
1739799404,27cyclictest12-21ksoftirqd/009:05:130
17421993915,11cyclictest35966irq/58-eth010:25:133
17421993915,11cyclictest35966irq/58-eth010:25:133
1740599386,28cyclictest7285-21ssh11:00:141
1739799383,24cyclictest12-21ksoftirqd/010:40:130
1742199373,16cyclictest35966irq/58-eth010:40:133
1742199363,19cyclictest35966irq/58-eth009:25:123
1742199361,21cyclictest35966irq/58-eth009:35:153
17413993611,18cyclictest27-21ksoftirqd/210:20:162
1742199352,21cyclictest35966irq/58-eth011:45:113
17405993511,3cyclictest131rcu_preempt09:35:141
1741399342,25cyclictest16043-21sh09:35:152
1739799341,28cyclictest30640-21ssh10:55:140
1742199335,16cyclictest0-21swapper/310:35:153
1742199335,16cyclictest0-21swapper/310:35:143
1742199332,21cyclictest35966irq/58-eth012:25:133
1742199331,19cyclictest35966irq/58-eth011:05:133
1741399333,8cyclictest0-21swapper/212:01:142
1741399332,6cyclictest0-21swapper/212:08:162
1740599330,24cyclictest27136-21ssh10:35:151
1740599330,24cyclictest27136-21ssh10:35:151
17397993313,11cyclictest131rcu_preempt07:20:140
1739799331,24cyclictest30348-21ssh09:25:130
1739799330,2cyclictest0-21swapper/008:20:130
1741399324,18cyclictest27346irq/40-dwc2_hso10:10:122
17413993226,3cyclictest23539-21kworker/u8:011:55:112
17405993213,17cyclictest21-21ksoftirqd/110:20:161
17397993222,5cyclictest2891-21diskmemload09:35:150
1741399318,19cyclictest0-21swapper/209:15:122
1741399312,24cyclictest29537-21ssh09:24:312
1741399311,19cyclictest30303-21ssh12:25:132
1740599312,25cyclictest1727-21ssh09:45:141
17405993111,13cyclictest630-21Async09:36:311
1739799313,15cyclictest0-21swapper/011:35:110
1742199301,19cyclictest35966irq/58-eth012:10:123
1742199301,19cyclictest35966irq/58-eth012:10:123
1742199301,18cyclictest35966irq/58-eth010:45:123
17405993025,3cyclictest201rcuc/110:45:121
1740599301,5cyclictest131rcu_preempt09:50:131
1740599301,24cyclictest6990-21ssh09:30:161
1739799302,17cyclictest2891-21diskmemload12:00:130
17421992910,15cyclictest35966irq/58-eth011:55:113
1741399293,20cyclictest0-21swapper/210:45:142
1741399293,17cyclictest27346irq/40-dwc2_hso12:15:142
1741399292,21cyclictest0-21swapper/208:35:142
1741399292,20cyclictest0-21swapper/210:30:132
1741399292,16cyclictest19789-21ssh09:55:142
1742199287,13cyclictest35966irq/58-eth010:30:123
1742199282,15cyclictest35966irq/58-eth009:20:153
1742199281,17cyclictest35966irq/58-eth011:15:143
1741399282,9cyclictest0-21swapper/209:05:132
1741399281,21cyclictest14296-21ssh11:40:162
1741399281,17cyclictest11521-21tr11:20:202
1740599282,23cyclictest2891-21diskmemload10:00:141
17405992820,6cyclictest6712-21kworker/u8:011:05:141
17405992815,10cyclictest21-21ksoftirqd/107:35:141
1742199274,12cyclictest35966irq/58-eth009:55:123
1741399274,15cyclictest27346irq/40-dwc2_hso08:15:142
1741399273,16cyclictest27346irq/40-dwc2_hso07:25:132
1741399271,11cyclictest3745-21ssh10:40:132
1740599274,16cyclictest21-21ksoftirqd/107:50:161
1739799273,10cyclictest131rcu_preempt10:35:160
1739799273,10cyclictest131rcu_preempt10:35:150
1739799272,17cyclictest12301-21ssh09:15:130
17421992612,7cyclictest35966irq/58-eth010:20:143
1742199261,13cyclictest35966irq/58-eth011:10:133
1742199261,13cyclictest35966irq/58-eth008:50:123
1741399263,7cyclictest0-21swapper/210:55:152
1741399262,9cyclictest10834-21ssh09:50:152
1741399262,9cyclictest0-21swapper/207:35:142
1740599268,11cyclictest21-21ksoftirqd/108:40:131
1740599262,18cyclictest24796-21apt-get08:25:121
1739799263,17cyclictest14325-21ssh11:40:180
1739799262,18cyclictest2581-21ssh11:32:150
1739799262,18cyclictest0-21swapper/011:00:150
1739799262,15cyclictest9089-21ssh10:25:130
1739799262,15cyclictest9089-21ssh10:25:130
17397992615,4cyclictest0-21swapper/007:45:130
1739799261,19cyclictest8694-21ssh11:55:120
1739799261,19cyclictest17561-21apt-get07:10:130
1742199252,17cyclictest0-21swapper/310:55:143
1741399253,16cyclictest27346irq/40-dwc2_hso12:30:142
1741399252,8cyclictest9686-21ssh09:49:152
1741399252,12cyclictest30358-21ssh09:25:132
1741399251,20cyclictest23999-21ssh10:15:182
17413992511,11cyclictest14832-21sh08:15:012
1739799256,9cyclictest0-21swapper/008:45:120
1742199243,18cyclictest0-21swapper/311:00:153
17421992410,8cyclictest35966irq/58-eth011:25:133
1741399244,16cyclictest27346irq/40-dwc2_hso08:20:132
1741399243,15cyclictest27346irq/40-dwc2_hso10:25:132
1741399243,15cyclictest27346irq/40-dwc2_hso10:25:122
17413992413,9cyclictest6105-21ssh11:52:202
1741399241,15cyclictest16564-21grep08:50:172
1741399240,15cyclictest32686-21ls10:00:282
1740599242,20cyclictest23140-21ssh11:45:121
1740599242,18cyclictest32175-21ssh11:50:141
17405992412,7cyclictest2891-21diskmemload11:55:111
1740599241,18cyclictest14405-21sh10:10:141
1739799245,13cyclictest21597-21ssh10:50:130
1739799243,16cyclictest23376-21ssh10:15:140
1739799241,17cyclictest16210-21ssh11:05:120
1741399232,7cyclictest0-21swapper/208:05:152
1741399232,6cyclictest0-21swapper/211:04:562
1741399232,11cyclictest0-21swapper/207:30:152
1741399231,9cyclictest2289866ssh10:50:212
17413992317,4cyclictest5951-21ssh12:10:222
17413992317,4cyclictest5951-21ssh12:10:212
1741399231,5cyclictest26233-21ls09:00:182
17413992313,8cyclictest0-21swapper/207:50:192
1741399231,2cyclictest131rcu_preempt09:30:142
17413992312,9cyclictest8460-21ssh11:17:452
17413992311,9cyclictest22408-21ssh11:07:072
17413992311,9cyclictest1620-21ssh11:31:052
17413992310,10cyclictest31835-21sh11:50:022
1740599239,4cyclictest21-21ksoftirqd/109:26:011
1740599232,6cyclictest0-21swapper/112:04:151
1740599232,18cyclictest25277-21fschecks_count09:40:151
1740599231,18cyclictest28703-21sh11:30:111
17405992310,3cyclictest0-21swapper/112:25:401
1739799232,18cyclictest151rcuc/012:10:130
1739799232,18cyclictest151rcuc/012:10:120
17397992313,7cyclictest19375-21cron09:55:010
17397992313,5cyclictest0-21swapper/012:25:130
1739799231,18cyclictest12-21ksoftirqd/012:05:140
1739799231,16cyclictest18094-21ssh10:30:120
1739799231,16cyclictest16538-21cut08:50:160
1742199225,6cyclictest0-21swapper/308:55:133
1742199222,13cyclictest35966irq/58-eth010:50:143
1742199222,13cyclictest0-21swapper/312:05:133
1741399224,15cyclictest27346irq/40-dwc2_hso11:10:132
17413992212,8cyclictest0-21swapper/208:00:172
1740599224,12cyclictest0-21swapper/108:30:131
1740599222,13cyclictest25246-21ssh11:10:141
1740599221,9cyclictest21596-21grep09:55:221
17405992213,6cyclictest29962-21cron09:25:011
1740599221,19cyclictest3950-21cut10:40:161
17405992211,3cyclictest21-21ksoftirqd/108:10:261
1739799225,4cyclictest16455-21kworker/0:107:40:320
1739799222,16cyclictest15942-21ssh12:35:150
1739799221,18cyclictest25247-21ssh11:10:150
1739799221,18cyclictest21379-21ssh09:20:150
1739799221,17cyclictest29717-21cut08:30:170
1739799221,17cyclictest14359-21ssh10:10:120
1742199219,10cyclictest0-21swapper/311:40:233
1742199218,10cyclictest0-21swapper/310:10:223
1742199214,11cyclictest35966irq/58-eth011:35:133
17421992113,5cyclictest35966irq/58-eth009:50:193
17421992113,5cyclictest35966irq/58-eth009:40:133
1741399214,12cyclictest27-21ksoftirqd/207:45:122
1741399212,4cyclictest0-21swapper/208:45:122
1741399212,16cyclictest28643-21kthreadcore10:35:232
1741399212,16cyclictest28643-21kthreadcore10:35:232
1741399211,5cyclictest0-21swapper/208:55:132
1741399211,13cyclictest21668-21ssh12:20:162
1740599219,9cyclictest21-21ksoftirqd/110:54:511
1740599217,12cyclictest0-21swapper/110:25:401
1740599217,12cyclictest0-21swapper/110:25:401
1740599217,10cyclictest21-21ksoftirqd/112:30:131
1740599212,16cyclictest30524-21ssh10:18:151
1740599211,14cyclictest15963-21ntp_192.168.11409:15:251
17405992110,2cyclictest21-21ksoftirqd/112:20:101
1739799213,8cyclictest8989-21kthreadcore08:40:210
1739799211,9cyclictest415-21irqstats11:50:190
1739799211,3cyclictest131rcu_preempt09:00:130
17397992113,6cyclictest15615-21cron09:35:010
1739799211,18cyclictest1951-21uniq09:45:160
1739799211,17cyclictest769-21ls08:00:140
1739799211,14cyclictest0-21swapper/009:40:120
1739799210,18cyclictest9149-21ls08:05:290
1742199202,11cyclictest0-21swapper/308:45:143
1741399209,3cyclictest5478-21cpuspeed10:05:152
1741399201,9cyclictest11340-21idleruntime-cro08:45:022
1741399201,16cyclictest28478-21threads08:25:282
1741399201,15cyclictest17781-21hwlatdetect07:10:172
1741399201,11cyclictest3291-21ssh09:10:132
1740599209,2cyclictest21-21ksoftirqd/112:10:221
1740599209,2cyclictest21-21ksoftirqd/112:10:221
1740599208,3cyclictest21-21ksoftirqd/112:15:171
1740599208,3cyclictest21-21ksoftirqd/111:29:171
1740599208,3cyclictest131rcu_preempt08:20:231
1740599201,15cyclictest8640-21tr08:05:241
17405992010,8cyclictest774-21cut10:55:231
17405992010,8cyclictest14298-21apt-get11:40:171
17405992010,7cyclictest4100-21cron07:30:011
17405992010,6cyclictest419-21sh08:00:021
17397992012,6cyclictest6533-21sshd08:39:220
1739799201,14cyclictest21290-21ssh12:20:110
1742199199,8cyclictest0-21swapper/312:32:073
1742199198,8cyclictest0-21swapper/310:17:313
1742199193,9cyclictest0-21swapper/311:32:153
1742199191,13cyclictest0-21swapper/308:15:233
1741399191,9cyclictest22747-21irqcore07:15:182
1741399191,6cyclictest0-21swapper/207:55:132
1741399191,15cyclictest14348-21irqcore07:40:172
1741399191,10cyclictest30689-21kthreadcore08:30:212
1740599194,3cyclictest131rcu_preempt07:10:151
17405991913,3cyclictest21-21ksoftirqd/109:00:201
17405991912,4cyclictest21-21ksoftirqd/107:35:021
17405991912,4cyclictest201rcuc/107:45:141
1740599191,16cyclictest8261-21kthreadcore11:35:221
1739799191,7cyclictest4043-21ps09:10:180
1739799191,13cyclictest24787-21find08:25:110
1739799190,11cyclictest32177-21unixbench_singl07:55:290
1742199189,6cyclictest0-21swapper/312:18:273
1742199182,10cyclictest0-21swapper/308:10:153
1742199182,10cyclictest0-21swapper/307:45:133
1742199181,12cyclictest0-21swapper/308:30:023
1742199181,10cyclictest0-21swapper/308:00:133
1742199181,10cyclictest0-21swapper/307:15:143
17421991810,6cyclictest0-21swapper/312:24:513
17421991810,6cyclictest0-21swapper/309:18:283
1740599187,9cyclictest0-21swapper/110:31:081
1740599187,8cyclictest16592-21irqrtprio12:35:201
1740599183,12cyclictest11354-21irqrtprio11:20:181
1740599182,10cyclictest0-21swapper/108:48:081
17405991813,3cyclictest21-21ksoftirqd/109:10:021
1740599181,15cyclictest29566-21kthreadcore07:20:211
1740599181,12cyclictest3290-21sh09:10:131
1739799184,4cyclictest131rcu_preempt07:25:200
1739799181,7cyclictest3776-21ntp_states10:20:280
1739799181,2cyclictest131rcu_preempt11:16:460
1739799181,13cyclictest19876-21df11:25:130
17397991810,6cyclictest0-21swapper/007:35:270
1739799180,3cyclictest0-21swapper/010:09:310
1742199179,6cyclictest0-21swapper/311:21:113
1742199179,6cyclictest0-21swapper/309:10:063
1742199172,10cyclictest0-21swapper/307:55:133
1742199171,12cyclictest0-21swapper/308:20:243
1741399170,9cyclictest17509-21grep07:10:022
1740599179,5cyclictest3469-21kthreadcore08:35:211
1740599176,2cyclictest21-21ksoftirqd/108:00:161
1740599175,3cyclictest21-21ksoftirqd/107:45:021
1740599172,12cyclictest24646-21ntp_states08:55:271
17405991711,4cyclictest0-21swapper/107:15:261
1739799176,2cyclictest131rcu_preempt08:55:190
1739799172,11cyclictest12742-21df_inode10:45:150
1739799171,6cyclictest19005-21unixbench_singl08:15:290
1739799171,2cyclictest131rcu_preempt08:10:130
1739799171,14cyclictest32466-21/usr/sbin/munin10:00:260
1742199161,9cyclictest0-21swapper/309:00:163
1742199161,9cyclictest0-21swapper/307:10:293
1740599169,5cyclictest17383-21cyclictest07:10:021
1740599161,13cyclictest17022-21kthreadcore08:15:221
1740599161,11cyclictest18327-21cut08:50:211
1739799162,12cyclictest23874-21kthreadcore07:15:190
17397991611,3cyclictest0-21swapper/007:50:170
1742199151,8cyclictest0-21swapper/307:30:143
1742199151,10cyclictest0-21swapper/309:05:133
1739799151,11cyclictest4335-21apt-get07:30:140
1742199149,3cyclictest0-21swapper/307:25:103
1742199146,5cyclictest35966irq/58-eth007:50:153
1742199141,11cyclictest0-21swapper/308:35:293
1739799141,9cyclictest17322-21latency_hist07:10:010
1742199138,3cyclictest0-21swapper/308:43:163
1742199131,10cyclictest0-21swapper/307:20:283
1742199111,8cyclictest0-21swapper/308:30:153
1742199111,7cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional