You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 14:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Fri Apr 24, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24311732940,4chrt0-21swapper/012:06:120
2134271996758,6cyclictest2166606-21latency_hist07:40:010
2134275996558,5cyclictest2134118-21kworker/u8:2+flush-8:007:21:251
2134275996556,7cyclictest2196387-21cp08:10:001
2134275996251,8cyclictest2261012-21apt-get09:15:011
2134271995953,4cyclictest2231381-21kworker/u8:3+flush-8:009:56:230
2134280995745,9cyclictest2170774-21ntpq07:41:192
2134275995649,5cyclictest2176553-21kworker/u8:2+flush-8:010:36:221
2134275995649,5cyclictest2176553-21kworker/u8:2+flush-8:010:36:221
2134275995648,5cyclictest2176553-21kworker/u8:2+flush-8:008:36:091
2134271995647,7cyclictest2285649-21kworker/u8:1+flush-8:009:41:190
2134275995547,6cyclictest2176553-21kworker/u8:2+flush-8:009:01:091
2134271995548,5cyclictest2176553-21kworker/u8:2+flush-8:010:46:190
2134275995447,5cyclictest2176553-21kworker/u8:2+flush-8:008:21:111
2134271995449,4cyclictest2176553-21kworker/u8:2+events_unbound08:00:010
2134271995447,5cyclictest2176553-21kworker/u8:2+flush-8:009:21:200
2134271995446,6cyclictest2355119-21kworker/u8:3+events_unbound10:56:210
2134271995444,7cyclictest2236879-21diskstats08:51:100
2134271995444,7cyclictest2236879-21diskstats08:51:100
2134271995348,3cyclictest2330603-21kworker/u8:4+flush-8:010:31:090
2134275995245,5cyclictest2339458-21kworker/u8:1+flush-8:012:26:081
2134275995245,5cyclictest2339458-21kworker/u8:1+flush-8:012:26:081
2134275995241,8cyclictest2156472-21latency_hist07:30:011
2134271995248,3cyclictest2211840-21kworker/u8:1+flush-8:008:26:220
2134271995240,9cyclictest2448719-21ntpq12:21:170
2134275995145,4cyclictest2400141-21latency_hist11:35:011
2134271995146,4cyclictest2134118-21kworker/u8:2+flush-8:007:26:110
2134271995146,3cyclictest2330595-21kworker/u8:0+events_unbound10:41:270
2134271995141,8cyclictest2454852-21apt-get12:31:040
2134271995045,3cyclictest2196796-21kworker/u8:0+events_unbound08:20:010
2134271995043,4cyclictest2339458-21kworker/u8:1+flush-8:011:11:190
2134271995043,4cyclictest2231381-21kworker/u8:3+events_unbound08:46:080
2134271995039,8cyclictest2374084-21ntpq11:06:180
2134271994841,5cyclictest2176553-21kworker/u8:2+flush-8:009:46:180
2134271994841,4cyclictest2245819-21kworker/u8:0+events_unbound09:36:210
2134271994838,7cyclictest2339458-21kworker/u8:1+events_unbound12:01:200
2134275994735,9cyclictest280-21systemd-journal08:35:001
2134271994744,2cyclictest2176553-21kworker/u8:2+flush-8:009:01:230
2134271994744,1cyclictest2176553-21kworker/u8:2+events_unbound08:01:110
2134271994742,4cyclictest2102641-21kworker/u8:1+events_unbound07:11:080
2134271994741,4cyclictest2231381-21kworker/u8:3+events_unbound09:51:080
2134271994741,4cyclictest2176553-21kworker/u8:2+events_unbound10:36:070
2134271994741,4cyclictest2176553-21kworker/u8:2+events_unbound10:36:070
2134271994740,4cyclictest2196796-21kworker/u8:0+events_unbound08:31:240
2134280994635,8cyclictest280-21systemd-journal07:15:012
2134271994532,8cyclictest2146301-21latency_hist07:20:010
2134280994438,4cyclictest2355119-21kworker/u8:3+flush-8:012:01:102
2134275994434,8cyclictest2160805-21ntpq07:31:191
2134271994439,3cyclictest2339458-21kworker/u8:1+flush-8:011:21:140
2134271994339,3cyclictest2231381-21kworker/u8:3+flush-8:009:26:220
2134271994339,3cyclictest2176553-21kworker/u8:2+flush-8:008:36:220
2134271994335,6cyclictest2176553-21kworker/u8:2+flush-8:010:21:170
2134275994235,6cyclictest2211840-21kworker/u8:1+flush-8:008:51:111
2134275994235,6cyclictest2211840-21kworker/u8:1+flush-8:008:51:111
2134275994233,6cyclictest2330365-21latency_hist10:25:011
2134271994237,4cyclictest2374170-21kworker/u8:0+flush-8:011:36:230
2134271994237,4cyclictest2176553-21kworker/u8:2+flush-8:008:56:160
2134271994235,5cyclictest2355119-21kworker/u8:3+flush-8:011:51:110
2134271994235,5cyclictest2134118-21kworker/u8:2+flush-8:007:21:190
2134275994134,5cyclictest2286279-21apt-get09:41:051
2134271994137,3cyclictest2285649-21kworker/u8:1+events_unbound10:16:200
2134271994136,3cyclictest2374170-21kworker/u8:0+events_unbound11:16:060
2134271994136,3cyclictest2134118-21kworker/u8:2+events_unbound07:31:260
2134271994135,4cyclictest2330603-21kworker/u8:4+events_unbound10:26:170
2134271994135,4cyclictest2161400-21kworker/u8:3+events_unbound08:11:140
2134271994135,3cyclictest2355119-21kworker/u8:3+events_unbound11:56:170
2134275994034,4cyclictest2365393-21apt-get11:01:051
2134271994034,4cyclictest2339458-21kworker/u8:1+flush-8:012:16:150
2134271994031,7cyclictest2280234-21ntp_states09:31:220
2134275993933,4cyclictest2161400-21kworker/u8:3+flush-8:007:46:261
2134275993932,5cyclictest2359205-21ntpq10:51:181
2134271993935,3cyclictest2355119-21kworker/u8:3+events_unbound12:36:240
2134280993827,8cyclictest280-21systemd-journal08:19:592
2134275993831,5cyclictest2330595-21kworker/u8:0+flush-8:010:31:191
2134275993830,5cyclictest2394972-21latency_hist11:30:011
2134271993834,3cyclictest2231381-21kworker/u8:3+flush-8:010:11:240
2134271993831,4cyclictest2339458-21kworker/u8:1+flush-8:011:41:150
2134271993830,6cyclictest2399270-21ntpq11:31:180
2134271993828,7cyclictest2181490-21latency_hist07:55:010
21339432384,10sleep10-21swapper/107:08:131
2134275993732,4cyclictest2176553-21kworker/u8:2+events_unbound08:56:191
2134275993732,3cyclictest2245819-21kworker/u8:0+events_unbound09:06:091
2134275993728,7cyclictest2281320-21/usr/sbin/munin09:36:171
2134271993733,3cyclictest2355119-21kworker/u8:3+flush-8:012:26:140
2134271993733,3cyclictest2355119-21kworker/u8:3+flush-8:012:26:140
2134271993733,3cyclictest2176553-21kworker/u8:2+flush-8:010:51:230
2134271993732,3cyclictest2424863-21kworker/u8:2+events_unbound12:15:000
2134271993732,3cyclictest2374170-21kworker/u8:0+events_unbound11:46:090
2134271993732,3cyclictest2196796-21kworker/u8:0+events_unbound08:21:220
2134280993630,4cyclictest2161400-21kworker/u8:3+flush-8:007:46:232
2134275993632,3cyclictest2161400-21kworker/u8:3+flush-8:007:51:151
2134275993631,4cyclictest2330595-21kworker/u8:0+events_unbound10:41:251
2134275993629,6cyclictest2339458-21kworker/u8:1+flush-8:010:56:201
2134275993628,6cyclictest2415290-21apt-get11:51:051
2134275993626,7cyclictest280-21systemd-journal09:15:311
2134271993631,4cyclictest2231381-21kworker/u8:3+events_unbound09:16:210
2134271993625,7cyclictest2196796-21kworker/u8:0+events_unbound08:41:060
21334512364,9sleep20-21swapper/207:06:302
2134280993530,3cyclictest2139197-21systemd-run07:14:592
2134275993529,4cyclictest2424863-21kworker/u8:2+events_unbound12:06:071
2134275993528,5cyclictest280-21systemd-journal07:15:201
2134271993531,3cyclictest2176553-21kworker/u8:2+flush-8:010:06:070
2134271993531,3cyclictest2176553-21kworker/u8:2+flush-8:009:11:230
2134271993530,3cyclictest2151212-21kworker/u8:1+flush-8:007:41:150
2134280993429,4cyclictest2355119-21kworker/u8:3+flush-8:011:51:212
2134280993425,6cyclictest280-21systemd-journal11:40:012
2134275993430,2cyclictest2232414-21irqrtprio08:46:121
2134275993429,4cyclictest2339458-21kworker/u8:1+events_unbound11:06:081
2134275993429,4cyclictest2231381-21kworker/u8:3+events_unbound09:21:101
2134275993428,4cyclictest2330595-21kworker/u8:0+events_unbound10:30:011
2134275993427,5cyclictest280-21systemd-journal09:27:181
2134271993430,3cyclictest2339458-21kworker/u8:1+events_unbound11:01:280
2134280993327,4cyclictest2176553-21kworker/u8:2+flush-8:008:41:102
2134275993329,2cyclictest2162674-21irqrtprio07:36:131
2134275993328,3cyclictest2139540-21apt-config07:15:011
2134275993325,5cyclictest2444938-21apt-get12:21:051
2134271993329,3cyclictest2374170-21kworker/u8:0+events_unbound11:26:120
2134280993228,3cyclictest2339458-21kworker/u8:1+flush-8:012:26:232
2134280993228,3cyclictest2339458-21kworker/u8:1+flush-8:012:26:232
2134275993227,4cyclictest2161400-21kworker/u8:3+flush-8:008:16:231
2134275993224,5cyclictest2171606-21latency_hist07:45:011
2134275993223,6cyclictest280-21systemd-journal11:57:181
2134275993222,8cyclictest2200634-21ntpq08:11:191
2134280993124,5cyclictest280-21systemd-journal09:45:002
2134280993122,7cyclictest2156473-21apt-get07:29:592
2134275993126,4cyclictest2339458-21kworker/u8:1+events_unbound12:01:161
2134275993126,3cyclictest2296144-21apt-get09:51:051
2134280993026,2cyclictest2186814-21aten2_r5power_e08:01:072
2134280993024,4cyclictest280-21systemd-journal10:05:002
2134280993022,5cyclictest280-21systemd-journal09:35:352
2134275993024,5cyclictest2285649-21kworker/u8:1+flush-8:010:16:251
2134271993023,6cyclictest2172154-21cpuspeed_turbos07:46:090
2134280992926,2cyclictest2370358-21aten2_r5power_c11:06:072
2134280992924,3cyclictest2256527-21aten2_r5power_v09:11:082
2134280992921,5cyclictest280-21systemd-journal09:10:012
2134275992925,3cyclictest2176553-21kworker/u8:2+flush-8:009:46:241
2134275992923,4cyclictest2355119-21kworker/u8:3+flush-8:012:31:231
2134271992926,2cyclictest2231381-21kworker/u8:3+events_unbound10:01:220
2134271992925,2cyclictest0-21swapper/008:10:000
23435842280,6sleep3451irq_work/310:36:143
23435842280,6sleep3451irq_work/310:36:133
2134280992825,2cyclictest2181484-21cron07:55:002
2134280992824,2cyclictest2375397-21aten2_r5power_v11:11:082
2134275992824,2cyclictest2183971-21kthreadcore07:56:131
2134275992823,4cyclictest2355119-21kworker/u8:3+flush-8:012:36:111
2134275992823,3cyclictest2315178-21unixbench_multi10:06:251
2134275992822,4cyclictest2355119-21kworker/u8:3+flush-8:011:16:231
2134275992822,4cyclictest2339458-21kworker/u8:1+flush-8:012:16:201
2134275992822,4cyclictest2339458-21kworker/u8:1+flush-8:010:46:241
2134275992819,6cyclictest280-21systemd-journal09:57:181
2134280992723,2cyclictest2385492-21aten2_r5power_p11:21:062
2134280992723,2cyclictest2360683-21fschecks_count10:56:092
2134280992723,2cyclictest2291524-21fschecks_count09:46:102
2134280992723,2cyclictest0-21swapper/210:20:002
2134280992720,5cyclictest2151498-21cron07:25:002
2134275992721,5cyclictest2339458-21kworker/u8:1+events_unbound11:41:211
2134275992720,6cyclictest2339458-21kworker/u8:1+flush-8:011:21:201
2134275992716,8cyclictest280-21systemd-journal10:13:181
2134271992719,3cyclictest2176553-21kworker/u8:2+events_unbound09:06:180
2134280992623,2cyclictest2191955-21fschecks_count08:06:102
2134280992622,2cyclictest2226030-21unixbench_multi08:36:242
2134280992616,8cyclictest2201741-21cp08:15:012
2134275992622,3cyclictest2231381-21kworker/u8:3+events_unbound09:31:091
2134275992622,3cyclictest2196796-21kworker/u8:0+flush-8:008:41:221
2134275992621,4cyclictest2374170-21kworker/u8:0+events_unbound11:36:091
2134275992620,4cyclictest2374170-21kworker/u8:0+events_unbound11:11:241
2134275992620,4cyclictest2355119-21kworker/u8:3+flush-8:011:46:241
2134275992617,7cyclictest280-21systemd-journal12:15:001
2134280992520,4cyclictest2315181-21unixbench_multi10:06:242
2134280992520,4cyclictest2211840-21kworker/u8:1+flush-8:008:26:192
213428099246,4cyclictest24392972grep12:11:252
2134280992420,2cyclictest2464040-21unixbench_multi12:36:252
2134280992420,2cyclictest2276037-21cron09:30:002
2134280992419,4cyclictest2231381-21kworker/u8:3+events_unbound09:31:232
2134280992419,3cyclictest2449571-21cron12:25:002
2134280992419,3cyclictest2414572-21unixbench_multi11:46:252
2134280992419,3cyclictest2341187-21irqcore10:36:112
2134280992419,3cyclictest2341187-21irqcore10:36:112
2134280992419,3cyclictest2296361-21cpuspeed_turbos09:51:082
2134280992416,6cyclictest280-21systemd-journal10:00:002
2134280992416,6cyclictest2385283-21cat11:20:012
2134275992420,3cyclictest2176553-21kworker/u8:2+flush-8:008:01:251
2134275992418,4cyclictest20977-21cron10:05:001
21338252242,15sleep00-21swapper/007:06:400
2134280992320,2cyclictest885-21mta-sts-daemon12:31:132
2134280992320,2cyclictest2241778-21cpuspeed_turbos08:56:062
2134280992319,3cyclictest2339458-21kworker/u8:1+events_unbound10:46:222
2134280992317,4cyclictest2339924-21unixbench_singl10:31:242
2134280992218,2cyclictest2444570-21cron12:20:002
2134280992218,2cyclictest2430196-21aten2_r5power_p12:06:062
213428099221,19cyclictest2186033-21grep07:56:242
2134275992218,2cyclictest0-21swapper/108:26:121
2134280992118,2cyclictest2330786-21aten2_r5power_p10:26:072
2134280992117,2cyclictest2216927-21aten2_r5power_c08:31:072
213428099206,2cyclictest0-21swapper/208:21:272
2134280992016,2cyclictest0-21swapper/211:56:272
2134280992016,2cyclictest0-21swapper/209:16:082
22505312190,3sleep2161rcu_preempt09:01:232
2134280991915,2cyclictest2325844-21aten2_r5power_e10:21:052
2134280991915,2cyclictest0-21swapper/208:50:002
2134280991914,4cyclictest2409663-21unixbench_multi11:41:252
2134280991914,3cyclictest2270762-21unixbench_multi09:21:262
2134280991911,6cyclictest2163781-21cut07:36:142
2134280991910,6cyclictest2395287-21cat11:30:012
2134280991815,2cyclictest0-21swapper/211:35:012
213428099180,2cyclictest2156473-21apt-get07:30:032
21300672182,10sleep30-21swapper/307:06:193
213428099172,2cyclictest161rcu_preempt10:55:012
213428099172,14cyclictest0-21swapper/211:02:222
2134280991710,5cyclictest2348121-21tr10:41:162
23009872167,5sleep30-21swapper/309:55:183
213428099162,13cyclictest0-21swapper/210:10:572
2134280991613,2cyclictest0-21swapper/208:54:432
2134280991613,2cyclictest0-21swapper/208:54:432
24093712133,6sleep30-21swapper/311:41:233
23749752132,6sleep30-21swapper/311:10:023
23204842132,7sleep30-21swapper/310:15:003
22702782132,7sleep30-21swapper/309:21:193
22172422132,7sleep30-21swapper/308:31:113
22115902132,5sleep30-21swapper/308:25:013
21765592132,6sleep30-21swapper/307:50:023
24553462122,6sleep30-21swapper/312:31:123
24498272122,6sleep30-21swapper/312:25:183
24498272122,6sleep30-21swapper/312:25:173
24441912122,6sleep30-21swapper/312:16:273
24347512122,5sleep30-21swapper/312:10:013
24260612122,6sleep30-21swapper/312:01:143
24194942122,6sleep30-21swapper/311:51:273
24008142122,6sleep30-21swapper/311:36:103
23848072121,6sleep30-21swapper/311:20:013
23558892122,6sleep30-21swapper/310:51:123
23548762122,6sleep30-21swapper/310:47:193
23459402122,6sleep30-21swapper/310:41:133
23353632122,5sleep30-21swapper/310:30:013
23311382122,6sleep30-21swapper/310:26:123
23261772122,6sleep30-21swapper/310:21:103
23207782122,6sleep30-21swapper/310:15:443
23118472122,6sleep30-21swapper/310:06:133
23106182122,5sleep30-21swapper/310:05:013
23001522123,6sleep30-21swapper/309:51:243
22817822122,6sleep30-21swapper/309:36:123
22760742122,6sleep30-21swapper/309:30:023
22754662121,7sleep30-21swapper/309:26:253
22564182122,6sleep30-21swapper/309:11:083
22511572122,6sleep30-21swapper/309:05:023
22451132122,6sleep30-21swapper/308:56:153
22320682122,6sleep30-21swapper/308:46:123
22265792122,6sleep30-21swapper/308:40:023
22217532122,6sleep30-21swapper/308:35:233
22161542122,6sleep30-21swapper/308:26:253
22020452122,6sleep30-21swapper/308:16:063
21972372122,6sleep30-21swapper/308:11:123
21926092122,6sleep30-21swapper/308:06:153
21719402122,6sleep30-21swapper/307:46:073
21659962122,6sleep30-21swapper/307:36:253
21554532123,6sleep30-21swapper/307:26:183
21467772122,6sleep30-21swapper/307:20:043
21396372122,5sleep30-21swapper/307:15:023
24597602112,5sleep30-21swapper/312:36:053
24454612112,5sleep30-21swapper/312:21:133
24303492112,5sleep30-21swapper/312:06:083
24201212112,6sleep30-21swapper/311:55:073
24103412112,6sleep30-21swapper/311:45:573
23960062112,5sleep30-21swapper/311:31:133
23907242112,5sleep30-21swapper/311:26:113
23861352113,5sleep30-21swapper/311:21:133
23702422112,5sleep30-21swapper/311:05:203
23653962112,5sleep30-21swapper/311:01:073
23649302112,6sleep30-21swapper/310:58:463
22911242112,5sleep30-21swapper/309:45:033
22864702112,5sleep30-21swapper/309:41:093
22618212112,5sleep30-21swapper/309:16:093
22464312113,5sleep30-21swapper/309:00:203
22370862112,6sleep30-21swapper/308:51:133
22370862112,6sleep30-21swapper/308:51:123
21905462112,5sleep30-21swapper/308:01:213
21849452112,6sleep30-21swapper/307:56:163
21668442112,5sleep30-21swapper/307:40:023
21570382112,5sleep30-21swapper/307:31:083
21380682111,6sleep30-21swapper/307:11:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional