You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 22:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot4s.osadl.org (updated Tue Aug 11, 2026 12:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20711997717,9cyclictest131rcu_preempt09:35:171
2071999710,4cyclictest131rcu_preempt12:25:132
20730995947,5cyclictest35966irq/58-eth011:15:133
2071999571,34cyclictest17008-21ssh10:10:122
2071199561,46cyclictest24637-21ssh09:20:141
2071199542,41cyclictest20051-21ssh12:00:141
2071199537,25cyclictest131rcu_preempt10:25:131
2071199537,25cyclictest131rcu_preempt10:25:131
2071199528,10cyclictest0-21swapper/112:15:131
20703994713,9cyclictest131rcu_preempt12:25:130
2071199441,5cyclictest131rcu_preempt09:15:131
20711994214,18cyclictest21-21ksoftirqd/111:30:121
2073099411,35cyclictest0-21swapper/310:45:143
20711994114,22cyclictest201rcuc/111:00:141
2071199411,31cyclictest1955-21ssh11:50:121
2070399411,37cyclictest22068-21sh11:25:140
2073099401,35cyclictest0-21swapper/312:25:143
2071199404,26cyclictest5554-21ssh12:10:141
20711994017,16cyclictest25457-21sh11:45:151
2070399403,33cyclictest11021-21ssh11:55:150
2071999391,19cyclictest4105-21ssh11:15:142
2073099382,32cyclictest0-21swapper/311:50:113
2071999385,18cyclictest27-21ksoftirqd/210:44:342
2071999382,30cyclictest8869-21sh09:28:532
2073099371,31cyclictest0-21swapper/310:55:143
2071999372,8cyclictest131rcu_preempt11:05:132
20719993717,7cyclictest27-21ksoftirqd/211:00:142
2071999361,18cyclictest29247-21ssh12:21:442
20711993617,14cyclictest630-21Async09:36:311
2073099351,30cyclictest0-21swapper/309:30:133
2073099350,28cyclictest0-21swapper/310:35:133
2070399351,25cyclictest8945-21sh12:30:140
2073099345,17cyclictest35966irq/58-eth009:40:103
2071999340,18cyclictest4746-21ssh09:45:132
2070399341,14cyclictest0-21swapper/009:50:140
2073099331,27cyclictest0-21swapper/310:15:133
2071999339,4cyclictest131rcu_preempt09:40:122
2071999333,15cyclictest0-21swapper/212:00:142
2071999331,8cyclictest131rcu_preempt07:40:102
2073099323,24cyclictest0-21swapper/312:30:143
20730993215,11cyclictest35966irq/58-eth009:50:153
2073099321,26cyclictest35966irq/58-eth009:10:133
2071199322,21cyclictest21-21ksoftirqd/108:15:131
2070399326,4cyclictest17000-21apt-get10:10:130
2070399323,23cyclictest14974-21ssh10:45:150
2073099311,22cyclictest0-21swapper/311:25:143
2071999313,19cyclictest27346irq/40-dwc2_hso09:05:132
2071999313,19cyclictest27346irq/40-dwc2_hso09:05:132
2071199312,21cyclictest388-21ssh10:55:151
2070399315,19cyclictest12-21ksoftirqd/009:55:140
2070399314,24cyclictest10210-21ssh09:30:120
2070399313,5cyclictest12-21ksoftirqd/011:45:180
2070399312,21cyclictest8150-21ssh10:05:110
20703993116,12cyclictest23333-21apt-get08:20:130
2073099302,18cyclictest35966irq/58-eth010:50:143
2071999304,18cyclictest27346irq/40-dwc2_hso12:10:142
20719993014,11cyclictest261rcuc/212:15:132
2071199300,2cyclictest131rcu_preempt10:35:011
2070399303,7cyclictest12-21ksoftirqd/011:50:280
20703993011,12cyclictest6707-21sh09:10:140
2073099293,22cyclictest0-21swapper/312:35:133
2073099293,21cyclictest0-21swapper/311:45:133
20730992918,7cyclictest0-21swapper/311:10:163
2073099291,24cyclictest0-21swapper/311:00:133
2073099291,24cyclictest0-21swapper/310:05:103
2073099291,23cyclictest0-21swapper/312:20:123
2071999293,20cyclictest0-21swapper/211:10:142
2071999291,9cyclictest0-21swapper/210:28:342
2071999291,9cyclictest0-21swapper/210:28:342
20719992910,4cyclictest131rcu_preempt10:50:152
2070399299,15cyclictest27543-21apt-get11:10:140
2070399295,5cyclictest12-21ksoftirqd/012:20:200
2070399293,6cyclictest12-21ksoftirqd/010:50:150
2070399293,6cyclictest12-21ksoftirqd/010:20:120
20703992920,3cyclictest0-21swapper/009:20:130
2070399291,5cyclictest12-21ksoftirqd/012:35:180
2073099282,21cyclictest0-21swapper/310:20:123
2073099281,24cyclictest0-21swapper/310:30:013
2073099281,24cyclictest0-21swapper/310:30:013
2073099281,21cyclictest0-21swapper/311:55:153
2073099280,25cyclictest0-21swapper/309:25:123
2071999284,16cyclictest789-1kworker/u9:110:20:122
2071999282,21cyclictest0-21swapper/209:33:392
2071999282,11cyclictest21452-21ssh09:54:022
2071199282,19cyclictest21-21ksoftirqd/107:15:131
2071199281,8cyclictest31069-21tr10:35:211
2070399289,7cyclictest12-21ksoftirqd/009:45:230
2070399287,3cyclictest131rcu_preempt08:05:130
2070399282,7cyclictest12-21ksoftirqd/010:30:150
2070399282,20cyclictest29525-21ssh10:35:140
20703992816,3cyclictest6286-21diskmemload11:35:140
20730992716,8cyclictest35966irq/58-eth012:10:143
2073099271,22cyclictest0-21swapper/307:55:143
2073099271,21cyclictest0-21swapper/309:15:133
2073099270,23cyclictest0-21swapper/311:05:133
2073099270,22cyclictest0-21swapper/312:15:133
2071999277,10cyclictest25455-21sh11:45:152
2071999273,17cyclictest0-21swapper/207:55:052
2071999273,16cyclictest27346irq/40-dwc2_hso12:05:172
2071999271,18cyclictest5628-21kthreadcore07:25:222
2071199278,7cyclictest131rcu_preempt08:55:131
2073099269,12cyclictest35966irq/58-eth010:30:133
2073099261,20cyclictest0-21swapper/312:00:133
2073099261,20cyclictest0-21swapper/308:45:123
2073099261,20cyclictest0-21swapper/307:15:143
2073099260,23cyclictest0-21swapper/308:35:123
2073099260,22cyclictest0-21swapper/309:55:133
2071999266,12cyclictest13155-21ssh09:12:292
2071999262,9cyclictest0-21swapper/208:55:152
2071199262,18cyclictest29936-21ssh11:29:171
2071199262,15cyclictest201rcuc/109:45:141
20711992616,5cyclictest0-21swapper/112:05:171
2070399264,5cyclictest12-21ksoftirqd/009:25:250
2070399262,4cyclictest12-21ksoftirqd/010:20:010
2070399262,17cyclictest30954-21ssh11:30:140
20703992615,8cyclictest31937-21ssh09:40:260
20703992613,9cyclictest32364-21ssh10:00:210
20703992613,9cyclictest25674-21apt-get07:15:140
2070399261,19cyclictest15630-21ssh09:15:140
2073099259,11cyclictest0-21swapper/312:09:193
2073099252,19cyclictest0-21swapper/308:20:133
2073099251,21cyclictest0-21swapper/309:35:153
2073099251,20cyclictest0-21swapper/310:10:123
2073099251,20cyclictest0-21swapper/309:45:153
2073099251,20cyclictest0-21swapper/309:20:143
2073099251,19cyclictest0-21swapper/308:55:143
2071999255,10cyclictest131rcu_preempt09:20:192
2071999251,3cyclictest131rcu_preempt09:55:132
2071999251,20cyclictest29544-21fschecks_time09:00:162
2071999251,20cyclictest29544-21fschecks_time09:00:162
2071999251,14cyclictest131rcu_preempt07:10:202
2071999250,9cyclictest9537-21sed12:30:212
20711992514,5cyclictest31628-21ssh10:00:141
2070399257,9cyclictest12-21ksoftirqd/008:55:220
2070399256,5cyclictest12-21ksoftirqd/008:50:290
2070399254,6cyclictest12-21ksoftirqd/010:55:160
2070399254,6cyclictest12-21ksoftirqd/007:10:140
2070399254,4cyclictest12-21ksoftirqd/009:35:190
2070399253,6cyclictest12-21ksoftirqd/011:05:230
2070399253,4cyclictest12-21ksoftirqd/012:15:130
2070399252,10cyclictest12-21ksoftirqd/012:05:240
2070399251,5cyclictest12-21ksoftirqd/012:10:260
2070399251,18cyclictest13032-21ssh11:20:130
2073099242,18cyclictest0-21swapper/308:00:123
2073099241,20cyclictest0-21swapper/311:30:123
2073099241,19cyclictest0-21swapper/309:00:143
2073099241,19cyclictest0-21swapper/309:00:143
2073099241,19cyclictest0-21swapper/307:40:113
2073099241,19cyclictest0-21swapper/307:35:123
2073099240,21cyclictest0-21swapper/311:40:123
2073099240,21cyclictest0-21swapper/308:50:123
2073099240,21cyclictest0-21swapper/307:30:133
2071999247,14cyclictest27-21ksoftirqd/212:35:132
2071999243,6cyclictest0-21swapper/211:29:172
2071999242,3cyclictest131rcu_preempt11:40:142
2071999242,2cyclictest131rcu_preempt10:05:172
2071999242,17cyclictest0-21swapper/211:53:342
2071999241,19cyclictest0-21swapper/210:45:152
2071999241,14cyclictest27876-21kworker/2:010:00:312
2070399246,3cyclictest131rcu_preempt10:40:140
2070399244,6cyclictest12-21ksoftirqd/007:35:260
2070399243,6cyclictest12-21ksoftirqd/011:00:160
2070399243,6cyclictest12-21ksoftirqd/007:45:200
2070399243,4cyclictest12-21ksoftirqd/007:20:120
2070399242,6cyclictest12-21ksoftirqd/007:45:010
2070399242,5cyclictest12-21ksoftirqd/010:25:240
2070399242,5cyclictest12-21ksoftirqd/010:25:240
2070399241,8cyclictest12-21ksoftirqd/011:40:220
20703992414,7cyclictest23656-21ssh12:00:270
2070399241,16cyclictest4108-21sh11:15:140
2073099232,15cyclictest35966irq/58-eth007:25:133
2073099232,10cyclictest0-21swapper/311:36:343
2073099231,19cyclictest0-21swapper/311:20:183
2073099231,19cyclictest0-21swapper/310:40:133
2073099231,19cyclictest0-21swapper/308:05:123
2073099231,19cyclictest0-21swapper/307:20:113
2073099231,18cyclictest0-21swapper/308:40:123
2073099231,18cyclictest0-21swapper/307:50:143
2073099231,18cyclictest0-21swapper/307:45:133
20730992310,10cyclictest35966irq/58-eth010:00:153
2071999234,11cyclictest261rcuc/210:15:132
2071999232,6cyclictest0-21swapper/211:23:342
2071999232,16cyclictest0-21swapper/211:35:342
2071999232,16cyclictest0-21swapper/209:19:342
2071999232,10cyclictest0-21swapper/208:25:162
2071999232,10cyclictest0-21swapper/208:25:162
2071999231,19cyclictest11037-21ssh11:55:162
2071999231,15cyclictest13466-21awk08:10:012
2071999230,20cyclictest4774-21kthreadcore08:00:192
2071999230,18cyclictest20542-21ssh10:30:132
2071999230,10cyclictest2263-21kthreadcore10:55:222
2071199232,7cyclictest0-21swapper/111:36:571
20711992311,9cyclictest21-21ksoftirqd/109:02:351
20711992311,9cyclictest21-21ksoftirqd/109:02:351
2071199231,19cyclictest1327-21ls09:25:141
2070399235,7cyclictest131rcu_preempt08:15:160
2070399234,6cyclictest12-21ksoftirqd/007:55:230
2070399234,4cyclictest12-21ksoftirqd/009:00:190
2070399234,4cyclictest12-21ksoftirqd/009:00:190
2070399233,6cyclictest12-21ksoftirqd/009:05:240
2070399233,6cyclictest12-21ksoftirqd/009:05:240
2070399233,4cyclictest12-21ksoftirqd/008:30:200
2070399233,3cyclictest131rcu_preempt08:35:230
2070399231,5cyclictest12-21ksoftirqd/008:30:010
2070399231,5cyclictest12-21ksoftirqd/008:30:010
20703992315,4cyclictest14959-21apt-get08:45:120
2073099221,17cyclictest0-21swapper/308:25:163
2073099221,17cyclictest0-21swapper/308:25:163
2073099221,17cyclictest0-21swapper/307:10:113
2073099220,18cyclictest0-21swapper/308:30:133
2071999221,5cyclictest26838-21apt-get07:50:132
2071999221,4cyclictest131rcu_preempt10:35:172
2071999221,10cyclictest30919-21/usr/sbin/munin11:30:142
2071199224,12cyclictest22689-21ssh09:55:141
2071199222,15cyclictest27568-21ssh11:10:141
2071199221,9cyclictest131rcu_preempt11:40:141
20711992218,2cyclictest211ksoftirqd/112:25:021
20711992215,5cyclictest21-21ksoftirqd/110:20:121
2070399222,4cyclictest12-21ksoftirqd/007:50:190
2070399221,5cyclictest12-21ksoftirqd/008:10:220
2070399221,5cyclictest12-21ksoftirqd/007:25:180
2073099212,16cyclictest0-21swapper/308:10:133
2073099211,18cyclictest0-21swapper/309:05:123
2073099211,18cyclictest0-21swapper/309:05:123
2073099211,13cyclictest35966irq/58-eth008:15:113
2071999213,2cyclictest131rcu_preempt08:45:172
2071999211,6cyclictest22751-21cut08:50:222
2071999211,14cyclictest18511-21find08:15:122
2071999211,11cyclictest8299-21sed07:30:202
20719992110,9cyclictest0-21swapper/207:35:232
2071199217,2cyclictest131rcu_preempt08:00:121
2071199215,5cyclictest6387-21ssh09:10:011
2071199215,5cyclictest6387-21ssh09:10:011
2071199214,2cyclictest0-21swapper/111:58:561
2071199214,10cyclictest14706-21kworker/1:008:45:261
2071199212,3cyclictest131rcu_preempt10:42:051
2071199212,17cyclictest17878-21apt-get12:35:121
20711992115,3cyclictest131rcu_preempt10:05:101
2071199211,17cyclictest17155-21kthreadcore10:45:221
2071199211,15cyclictest3578-21ssh12:25:261
2070399215,5cyclictest12-21ksoftirqd/008:00:180
2070399212,6cyclictest12-21ksoftirqd/007:30:140
2071999206,11cyclictest22981-21ssh09:35:302
2071999201,9cyclictest10112-21wc08:40:022
2071999201,5cyclictest0-21swapper/208:40:132
20719992013,5cyclictest0-21swapper/207:15:172
2071999201,11cyclictest131rcu_preempt08:20:182
2071199204,13cyclictest17409-21irqcore10:10:171
2071199202,2cyclictest131rcu_preempt10:15:461
20711992012,5cyclictest13121-21sh11:20:141
2071199200,16cyclictest24343-21ls08:55:011
2071199200,14cyclictest12879-21ls12:30:311
2070399203,5cyclictest12-21ksoftirqd/008:40:210
2070399201,4cyclictest0-21swapper/007:10:020
2071999196,6cyclictest14564-21cut08:10:192
2071999193,10cyclictest131rcu_preempt07:45:132
2071999192,10cyclictest0-21swapper/208:30:132
2071999191,15cyclictest30492-21cpu07:20:142
2071199194,8cyclictest131rcu_preempt11:15:131
2071199192,2cyclictest131rcu_preempt10:50:131
2071199191,3cyclictest131rcu_preempt07:35:121
20711991913,4cyclictest0-21swapper/109:40:101
20711991913,4cyclictest0-21swapper/109:10:241
20711991912,5cyclictest17667-21threads09:50:281
2071199191,10cyclictest12277-21netstat08:05:231
2071199190,14cyclictest20915-21ls07:10:141
2071999180,9cyclictest20736-21latency_hist07:10:022
2071199189,7cyclictest2598-21users07:20:301
2071199183,12cyclictest25205-21sed08:20:201
2071199182,5cyclictest131rcu_preempt08:10:131
2071199181,2cyclictest131rcu_preempt09:32:441
2071199181,2cyclictest131rcu_preempt08:30:151
2071199181,2cyclictest131rcu_preempt07:30:151
2071199181,2cyclictest131rcu_preempt07:25:161
20711991812,4cyclictest21-21ksoftirqd/108:35:291
20711991812,3cyclictest21-21ksoftirqd/108:25:191
20711991812,3cyclictest21-21ksoftirqd/108:25:191
2071199174,9cyclictest21-21ksoftirqd/107:40:101
2071199173,11cyclictest1688-21kthreadcore07:55:231
2071199171,2cyclictest131rcu_preempt07:50:201
20711991710,5cyclictest25891-21unixbench_singl07:45:291
2073099161,12cyclictest0-21swapper/307:10:023
2071199164,7cyclictest21-21ksoftirqd/108:40:131
2071199141,10cyclictest20823-21latency_hist07:10:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional