You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 13:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun Jul 05, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
214234721750,3sleep375-21kworker/3:1+events21:10:163
23054492890,1chrt2305453-21fschecks_count23:55:121
20766492850,3chrt75-21kworker/3:1+events20:05:103
20921662740,5chrt0-21swapper/320:20:153
2019302996864,3cyclictest2106335-21kworker/u8:2+events_unbound21:10:302
22360972620,2sleep375-21kworker/3:1+mm_percpu_wq22:45:143
20292592610,2sleep3451irq_work/319:15:183
20971132600,6sleep20-21swapper/220:25:152
2019294995747,8cyclictest2030077-21ntpq19:15:200
2019294995648,6cyclictest2175568-21latency_hist21:45:020
2019294995551,3cyclictest1963411-21kworker/u8:0+flush-8:019:25:250
2019297995344,6cyclictest2319772-21latency_hist00:10:001
2019294995347,4cyclictest2300195-21kworker/u8:0+flush-8:000:20:270
2019294995347,4cyclictest2300195-21kworker/u8:0+flush-8:000:20:270
2019294995342,8cyclictest2120041-21ntpq20:45:210
2019297995247,4cyclictest2195268-21kworker/u8:2+events_unbound00:25:261
2019297995246,4cyclictest2045806-21kworker/u8:1+events_unbound20:10:251
2019294995241,9cyclictest2274240-21ntpq23:20:220
2019297995141,8cyclictest2190430-21latency_hist22:00:011
2019294995146,4cyclictest674386-21kworker/u8:2+events_unbound20:05:140
2019294995145,4cyclictest674386-21kworker/u8:2+flush-8:019:45:120
2019294995142,6cyclictest2145733-21latency_hist21:15:000
2019297994944,4cyclictest2141264-21kworker/u8:3+flush-8:021:20:311
2019294994944,4cyclictest2045806-21kworker/u8:1+flush-8:021:00:310
2019294994943,4cyclictest2141264-21kworker/u8:3+flush-8:021:30:260
2019294994943,4cyclictest2141264-21kworker/u8:3+flush-8:021:30:250
2019294994938,9cyclictest2179566-21ntpq21:45:220
2019297994737,7cyclictest2205528-21latency_hist22:15:011
2019294994742,4cyclictest2081493-21kworker/u8:0+flush-8:020:50:120
2019294994741,5cyclictest2269573-21kworker/u8:3+events_unbound23:30:260
2019294994739,6cyclictest2323797-21ntpq00:10:220
2019297994636,8cyclictest2156200-21diskstats21:25:111
2019297994636,8cyclictest2156200-21diskstats21:25:111
2019294994635,9cyclictest2239300-21ntpq22:45:210
2019302994541,3cyclictest2229904-21kworker/u8:1+events_unbound23:10:132
2019294994536,7cyclictest2076336-21latency_hist20:05:000
2019302994439,4cyclictest2269573-21kworker/u8:3+events_unbound00:25:302
2019297994438,4cyclictest2170870-21apt-get21:40:081
2019297994437,5cyclictest1986896-21kworker/u8:1+flush-8:019:20:221
2019294994436,6cyclictest1704890-21systemd-journal19:15:000
2019297994333,8cyclictest1704890-21systemd-journal23:25:011
2019294994332,2cyclictest2141264-21kworker/u8:3+flush-8:022:05:250
2019302994238,3cyclictest2195268-21kworker/u8:2+events_unbound22:40:312
2019297994234,6cyclictest1704890-21systemd-journal20:39:411
2019294994236,4cyclictest2141264-21kworker/u8:3+flush-8:022:30:220
2019297994137,3cyclictest2081493-21kworker/u8:0+flush-8:020:25:231
2019297994136,3cyclictest674386-21kworker/u8:2+flush-8:019:55:171
2019294994135,5cyclictest2195268-21kworker/u8:2+flush-8:022:50:370
2019302994033,5cyclictest1704890-21systemd-journal22:25:012
2019294994035,4cyclictest2081493-21kworker/u8:0+events_unbound20:40:260
2019294994034,4cyclictest2195268-21kworker/u8:2+flush-8:000:25:120
2019302993935,3cyclictest2036478-21kworker/u8:3+events_unbound19:30:162
2019297993934,4cyclictest2269573-21kworker/u8:3+flush-8:023:35:241
2019297993933,4cyclictest2045806-21kworker/u8:1+flush-8:021:45:321
2019297993929,8cyclictest1704890-21systemd-journal23:01:501
2019297993928,9cyclictest2050421-21ntpq19:35:231
2019294993935,3cyclictest2220374-21kworker/u8:0+events_unbound23:15:240
2019294993934,4cyclictest2220374-21kworker/u8:0+flush-8:023:05:260
2019294993934,4cyclictest2195268-21kworker/u8:2+flush-8:000:15:210
2019294993934,3cyclictest2045806-21kworker/u8:1+events_unbound19:50:130
2019294993933,4cyclictest2106335-21kworker/u8:2+events_unbound20:55:250
2019302993834,3cyclictest2220374-21kworker/u8:0+events_unbound23:06:382
2019302993828,8cyclictest2225344-21cat22:35:002
2019297993730,5cyclictest2023266-21ntpq19:10:211
2019297993728,6cyclictest2120972-21latency_hist20:50:011
2019294993729,6cyclictest2042202-21ps19:30:150
20187912373,9sleep10-21swapper/119:06:101
20142552374,8sleep20-21swapper/219:05:022
2019294993631,4cyclictest2045806-21kworker/u8:1+flush-8:020:10:260
2019294993629,5cyclictest2349472-21apt-get00:40:010
2019302993531,3cyclictest2141264-21kworker/u8:3+events_unbound22:15:192
2019297993530,3cyclictest2196588-21irqrtprio22:05:151
2019294993530,3cyclictest2245722-21diskstats22:55:110
2019294993529,4cyclictest2045806-21kworker/u8:1+flush-8:022:00:120
2019294993527,6cyclictest2101649-21diskstats20:30:110
2019294993527,6cyclictest2036478-21kworker/u8:3+flush-8:020:20:200
21172182340,4sleep375-21kworker/3:1-events20:45:153
2019302993429,4cyclictest2141264-21kworker/u8:3+events_unbound21:22:142
2019297993426,6cyclictest2220612-21apt-get22:30:071
2019294993430,3cyclictest2195268-21kworker/u8:2+flush-8:023:35:160
2019294993430,3cyclictest2051333-21cron19:40:010
2019294993429,3cyclictest2165504-21kworker/u8:0+flush-8:021:35:280
2019294993426,2cyclictest2045806-21kworker/u8:1+events_unbound19:44:250
2019302993328,3cyclictest2081493-21kworker/u8:0+events_unbound20:45:072
2019297993329,3cyclictest2141264-21kworker/u8:3+flush-8:022:20:151
2019297993328,4cyclictest2229904-21kworker/u8:1+flush-8:022:56:211
2019297993325,6cyclictest1704890-21systemd-journal19:15:051
2019297993324,7cyclictest2056290-21latency_hist19:45:011
2019297993323,8cyclictest1704890-21systemd-journal00:35:241
2019294993329,3cyclictest2275385-21kworker/u8:1+events_unbound23:45:240
2019294993329,3cyclictest2106335-21kworker/u8:2+events_unbound21:05:250
2019294993329,3cyclictest2081493-21kworker/u8:0+events_unbound20:25:280
2019294993329,2cyclictest2068862-21kthreadcore19:55:180
2019302993228,3cyclictest674386-21kworker/u8:2+events_unbound19:35:142
2019297993220,9cyclictest1704890-21systemd-journal20:55:411
2019294993227,4cyclictest2081493-21kworker/u8:0+events_unbound20:35:250
2019294993227,3cyclictest2195268-21kworker/u8:2+flush-8:022:19:530
2019294993226,5cyclictest2269573-21kworker/u8:3+flush-8:023:40:190
2019302993127,3cyclictest2269573-21kworker/u8:3+events_unbound23:25:392
2019302993125,4cyclictest2254921-21unixbench_singl23:00:282
2019297993127,3cyclictest1963411-21kworker/u8:0+flush-8:019:25:131
2019297993126,4cyclictest2220374-21kworker/u8:0+events_unbound23:05:281
2019297993126,4cyclictest2045806-21kworker/u8:1+flush-8:021:00:131
2019297993125,4cyclictest2195268-21kworker/u8:2+events_unbound00:00:241
2019297993123,6cyclictest1704890-21systemd-journal22:02:421
2019294993127,3cyclictest2269573-21kworker/u8:3+flush-8:023:25:120
2019294993127,3cyclictest2141264-21kworker/u8:3+events_unbound21:15:290
2019294993127,3cyclictest2036478-21kworker/u8:3+flush-8:020:15:200
2019294993126,3cyclictest2225866-21fschecks_count22:35:140
2019294993126,3cyclictest2141264-21kworker/u8:3+flush-8:022:10:180
2019294993125,4cyclictest2195268-21kworker/u8:2+flush-8:000:00:200
2019302993027,2cyclictest2141264-21kworker/u8:3+events_unbound21:30:282
2019302993027,2cyclictest2141264-21kworker/u8:3+events_unbound21:30:282
2019297993025,3cyclictest2141264-21kworker/u8:3+events_unbound21:30:091
2019297993025,3cyclictest2141264-21kworker/u8:3+events_unbound21:30:091
2019297993024,4cyclictest2275412-21apt-get23:25:071
2019294993025,4cyclictest2269573-21kworker/u8:3+flush-8:023:50:210
2019294993025,4cyclictest2229904-21kworker/u8:1+events_unbound23:10:220
2019294993025,3cyclictest2036026-21apt-get19:25:010
2019302992925,3cyclictest2165504-21kworker/u8:0+events_unbound21:38:032
2019302992925,2cyclictest2131280-21aten2_r5power_v21:00:112
2019302992923,4cyclictest2195268-21kworker/u8:2+flush-8:023:40:312
2019297992925,3cyclictest2195268-21kworker/u8:2+flush-8:022:50:381
2019297992923,4cyclictest2260637-21aten2_r5power_p23:10:121
2019297992923,4cyclictest2106335-21kworker/u8:2+flush-8:020:40:121
2019297992923,4cyclictest2106335-21kworker/u8:2+events_unbound21:05:241
2019297992921,6cyclictest2145964-21/usr/sbin/munin21:15:231
2019297992920,7cyclictest2180736-21/usr/sbin/munin21:50:191
2019294992924,3cyclictest2229904-21kworker/u8:1+events_unbound23:00:130
2019294992923,4cyclictest2045806-21kworker/u8:1+events_unbound21:50:150
2019294992922,5cyclictest2195268-21kworker/u8:2+flush-8:000:30:220
2019302992825,2cyclictest2019510-21aten2_r5power_p19:10:092
2019297992824,3cyclictest2195268-21kworker/u8:2+events_unbound23:45:011
2019297992824,2cyclictest0-21swapper/123:15:211
2019297992824,2cyclictest0-21swapper/122:40:011
2019297992824,2cyclictest0-21swapper/120:30:121
2019297992823,3cyclictest2145352-21unixbench_singl21:10:301
2019297992816,9cyclictest1704890-21systemd-journal00:35:001
2019294992824,3cyclictest2300195-21kworker/u8:0+events_unbound00:05:340
2019294992822,4cyclictest2195268-21kworker/u8:2+flush-8:022:25:210
2019294992820,5cyclictest2165504-21kworker/u8:0+flush-8:021:55:220
2019302992723,3cyclictest2220374-21kworker/u8:0+events_unbound22:56:182
2019302992721,4cyclictest1704890-21systemd-journal21:30:002
2019302992721,4cyclictest1704890-21systemd-journal21:29:592
2019297992723,3cyclictest2045806-21kworker/u8:1+events_unbound20:00:241
2019297992721,5cyclictest2165504-21kworker/u8:0+flush-8:021:35:221
2019297992721,4cyclictest2195268-21kworker/u8:2+flush-8:000:10:261
2019302992623,2cyclictest2315343-21fschecks_count00:05:132
2019302992623,2cyclictest2031428-21aten2_r5power_v19:20:112
2019302992622,2cyclictest2070994-21unixbench_singl19:55:292
2019302992620,4cyclictest2200175-21unixbench_singl22:05:292
2019302992618,6cyclictest2349472-21apt-get00:40:002
201930299260,12cyclictest2305160-21apt-get23:55:092
2019297992622,2cyclictest0-21swapper/100:20:231
2019297992622,2cyclictest0-21swapper/100:20:221
2019297992621,4cyclictest2036478-21kworker/u8:3+events_unbound20:20:241
2019297992620,4cyclictest2235581-21apt-get22:45:081
2019294992621,4cyclictest2106335-21kworker/u8:2+events_unbound21:25:270
2019294992621,4cyclictest2106335-21kworker/u8:2+events_unbound21:25:260
22935992250,2sleep3481ktimers/323:40:213
2019302992522,2cyclictest2185937-21cpuspeed_turbos21:55:092
2019302992522,2cyclictest2175118-21unixbench_multi21:40:292
2019302992522,2cyclictest2036859-21fschecks_time19:25:132
2019302992518,5cyclictest2076589-21apt-get20:05:072
2019302992512,2cyclictest161rcu_preempt00:15:212
201930299250,8cyclictest2324753-21idleruntime-cro00:15:002
201930299250,14cyclictest2106097-21idleruntime-cro20:35:002
2019297992521,2cyclictest0-21swapper/120:10:001
2019297992520,4cyclictest2269573-21kworker/u8:3+events_unbound23:50:221
2019297992520,4cyclictest2195268-21kworker/u8:2+events_unbound22:40:191
2019297992518,5cyclictest2086460-21apt-get20:15:091
2019294992519,3cyclictest2235347-21systemd-run22:45:000
2019302992421,2cyclictest2180848-21aten2_r5power_p21:50:112
2019302992420,2cyclictest2110625-21unixbench_singl20:35:312
2019302992418,1cyclictest161rcu_preempt19:15:022
201930299240,13cyclictest2287517-21sed23:35:172
201930299240,13cyclictest2225828-21tr22:35:132
201930299240,13cyclictest2220349-21sh22:30:002
2019297992420,3cyclictest674386-21kworker/u8:2+events_unbound19:45:231
2019297992420,3cyclictest2269573-21kworker/u8:3+flush-8:023:49:521
2019297992419,4cyclictest2045806-21kworker/u8:1+flush-8:019:50:211
2019297992419,2cyclictest0-21swapper/120:50:211
2019297992414,8cyclictest1704890-21systemd-journal22:30:001
2019294992419,4cyclictest2305751-21sort23:55:150
201930299238,3cyclictest161rcu_preempt20:10:182
201930299236,3cyclictest161rcu_preempt00:30:172
201930299234,8cyclictest39-21ksoftirqd/220:15:222
2019302992319,3cyclictest2195609-21cron22:05:012
2019302992319,3cyclictest2195268-21kworker/u8:2+events_unbound22:50:242
2019302992319,2cyclictest2176120-21fschecks_count21:45:132
2019302992310,9cyclictest2056548-21apt-get19:45:092
2019302992310,2cyclictest161rcu_preempt00:01:122
201930299230,12cyclictest2140376-21grep21:05:282
2019297992319,2cyclictest0-21swapper/122:15:231
201930299229,2cyclictest161rcu_preempt23:33:272
201930299229,1cyclictest161rcu_preempt20:50:572
201930299228,2cyclictest161rcu_preempt21:17:092
2019302992216,4cyclictest2055835-21unixbench_multi19:40:282
2019302992216,4cyclictest1704890-21systemd-journal20:21:402
201930299221,1cyclictest0-21swapper/220:04:472
201930299220,8cyclictest2130899-21systemctl20:59:592
201930299220,11cyclictest2065309-21seq19:50:222
2019294992217,3cyclictest0-21swapper/021:20:210
2019294992216,4cyclictest2215414-21sh22:25:000
201930299212,3cyclictest0-21swapper/222:10:272
2019302992111,8cyclictest1704890-21systemd-journal23:24:592
201930299211,10cyclictest2299968-21apt23:50:002
201930299210,10cyclictest2304902-21apt23:54:592
201930299210,10cyclictest2115578-21grep20:40:262
2019297992117,2cyclictest0-21swapper/123:30:141
2019297992117,2cyclictest0-21swapper/119:30:241
2019297992115,4cyclictest0-21swapper/100:15:161
23188072200,2sleep3481ktimers/300:05:263
201930299206,3cyclictest161rcu_preempt00:20:172
201930299206,3cyclictest161rcu_preempt00:20:172
201930299200,3cyclictest2239867-21grep22:45:282
201930299190,8cyclictest2266174-21cut23:15:132
20189652194,9sleep30-21swapper/319:08:243
2019294991714,1cyclictest0-21swapper/019:10:020
22293932142,8sleep30-21swapper/322:35:253
21160022142,8sleep30-21swapper/320:44:593
23448182131,8sleep30-21swapper/300:35:113
22501122132,7sleep30-21swapper/323:00:013
22242302132,7sleep30-21swapper/322:30:183
21904062132,7sleep30-21swapper/322:00:003
21805202132,6sleep30-21swapper/321:50:023
21547722132,7sleep30-21swapper/321:20:243
21060892132,5sleep30-21swapper/320:35:013
20414612132,7sleep30-21swapper/319:30:083
23338912122,6sleep30-21swapper/300:20:283
23338912122,6sleep30-21swapper/300:20:273
23104682122,6sleep30-21swapper/300:00:133
22999882122,5sleep30-21swapper/323:50:003
22889732122,6sleep30-21swapper/323:35:203
22757972122,6sleep30-21swapper/323:25:133
22751412120,6sleep30-21swapper/323:25:003
22652772122,5sleep30-21swapper/323:15:023
22649162122,6sleep30-21swapper/323:10:533
22594722122,6sleep30-21swapper/323:05:263
22304862122,6sleep30-21swapper/322:40:023
22179302122,6sleep30-21swapper/322:25:183
22055542122,5sleep30-21swapper/322:15:013
21997772122,6sleep30-21swapper/322:05:273
21779832122,6sleep30-21swapper/321:45:203
21611502122,6sleep30-21swapper/321:30:113
21611502122,6sleep30-21swapper/321:30:103
21500232122,6sleep30-21swapper/321:15:303
21365732122,6sleep30-21swapper/321:05:153
21314032122,6sleep30-21swapper/321:00:133
21001832122,6sleep30-21swapper/320:25:213
20868292122,6sleep30-21swapper/320:15:153
20714312122,5sleep30-21swapper/320:00:023
20671972122,6sleep30-21swapper/319:55:153
20614232122,5sleep30-21swapper/319:50:013
20567942123,5sleep30-21swapper/319:45:133
20520852122,6sleep30-21swapper/319:40:153
20507052122,6sleep30-21swapper/319:35:293
20353482122,6sleep30-21swapper/319:20:283
23402202112,5sleep30-21swapper/300:30:153
23346572112,5sleep30-21swapper/300:25:013
23289072112,5sleep30-21swapper/300:15:263
23204882112,6sleep30-21swapper/300:10:153
23084382112,5sleep30-21swapper/323:55:183
22993022112,6sleep30-21swapper/323:45:283
22551432112,5sleep30-21swapper/323:02:423
22402712112,5sleep30-21swapper/322:50:023
22112002112,5sleep30-21swapper/322:20:163
22010942112,6sleep30-21swapper/322:10:133
21912752112,5sleep30-21swapper/322:00:123
21712912112,6sleep30-21swapper/321:40:143
21701192112,5sleep30-21swapper/321:35:293
21557692112,5sleep30-21swapper/321:25:023
21557692112,5sleep30-21swapper/321:25:013
21262562112,5sleep30-21swapper/320:55:123
21211962112,5sleep30-21swapper/320:50:023
21064232112,5sleep30-21swapper/320:35:133
20368792112,5sleep30-21swapper/319:25:143
20194272112,5sleep30-21swapper/319:10:093
22803892101,5sleep30-21swapper/323:30:113
20817722102,5sleep30-21swapper/320:10:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional