You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 15:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Thu Jun 25, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
194993122130,4sleep375-21kworker/3:1-events07:15:023
22657132620,5chrt0-21swapper/312:30:223
1944495995937,9cyclictest1704890-21systemd-journal11:10:002
1944486995652,3cyclictest2105771-21kworker/u8:1+events_unbound10:20:010
1944495995140,8cyclictest1704890-21systemd-journal07:55:012
1944491995143,5cyclictest1704890-21systemd-journal12:15:171
1944491995041,7cyclictest2055971-21latency_hist09:00:011
1944491995041,7cyclictest2055971-21latency_hist09:00:011
1944486994839,7cyclictest2059986-21ntpq09:00:280
1944486994535,8cyclictest2170869-21diskstats10:55:180
1944491994437,5cyclictest2100607-21apt-get09:45:011
1944491994434,8cyclictest2150794-21/usr/sbin/munin10:35:291
1944491994339,3cyclictest2144721-21kworker/u8:2+events_unbound11:15:301
1944486994334,6cyclictest2220677-21diskstats11:45:180
1944486994233,7cyclictest2026446-21/usr/sbin/munin08:30:330
1944486994233,7cyclictest1704890-21systemd-journal11:20:180
1944491994131,7cyclictest2239308-21ntpq12:00:311
1944486994032,5cyclictest1704890-21systemd-journal12:05:000
1944495993931,6cyclictest1961040-21grep07:20:352
1944491993935,3cyclictest2066101-21kworker/u8:4+events_unbound09:10:331
1944486993931,6cyclictest1976364-21apt-get07:40:010
1944495993831,5cyclictest1704890-21systemd-journal10:05:012
1944491993834,3cyclictest2066101-21kworker/u8:4+events_unbound11:32:391
1944491993829,6cyclictest1704890-21systemd-journal09:23:161
1944486993831,5cyclictest1704890-21systemd-journal12:30:180
1944486993828,8cyclictest1995484-21ntpq07:55:280
1944491993726,2cyclictest161rcu_preempt10:50:001
1944486993733,3cyclictest2036348-21kworker/u8:1+events_unbound08:50:240
1944486993730,5cyclictest1960537-21ntpq07:20:280
1944495993626,8cyclictest1956412-21cp07:20:002
1944491993633,2cyclictest1967070-21kworker/u8:3+events_unbound07:32:191
1944491993632,3cyclictest1967070-21kworker/u8:3+events_unbound09:05:341
1944491993626,8cyclictest2001591-21/usr/sbin/munin08:05:351
1944486993626,8cyclictest2094735-21ntpq09:35:290
1944491993527,6cyclictest1976364-21apt-get07:40:001
194448699352,14cyclictest2140443-21apt-config10:25:010
20403822340,3sleep10-21swapper/108:40:341
1944491993430,3cyclictest2066092-21kworker/u8:0+events_unbound10:16:301
1944491993430,2cyclictest2241051-21irqcore12:05:221
1944491993425,2cyclictest161rcu_preempt10:10:191
1944486993425,7cyclictest2161003-21diskstats10:45:190
1944486993425,7cyclictest2036360-21/usr/sbin/munin08:40:270
19440392343,10sleep10-21swapper/107:06:351
1944491993330,2cyclictest2175572-21kworker/u8:3+events_unbound11:27:101
1944491993329,3cyclictest2144721-21kworker/u8:2+events_unbound11:36:401
1944491993329,3cyclictest2066092-21kworker/u8:0+events_unbound09:34:391
1944491993326,5cyclictest1991810-21aten2_r5power_e07:55:171
1944491993324,7cyclictest2145833-21/usr/sbin/munin10:30:271
1944486993326,5cyclictest1976364-21apt-get07:40:000
1944486993325,6cyclictest2194443-21ntpq11:15:280
1944486993324,5cyclictest1-21systemd10:40:010
1944486993310,12cyclictest0-21swapper/011:05:170
1944495993223,7cyclictest1704890-21systemd-journal08:44:592
1944491993229,2cyclictest2066101-21kworker/u8:4+events_unbound10:21:001
1944491993227,4cyclictest1967070-21kworker/u8:3+flush-8:008:30:361
1944491993226,5cyclictest2144721-21kworker/u8:2+flush-8:012:10:361
1944491993225,5cyclictest1967070-21kworker/u8:3+flush-8:008:35:321
1944491993224,6cyclictest1981899-21aten2_r5power_c07:45:181
1944491993221,8cyclictest1704890-21systemd-journal11:00:011
1944491993220,3cyclictest161rcu_preempt11:20:221
1944491993218,8cyclictest161rcu_preempt07:40:321
1944491993216,4cyclictest0-21swapper/107:20:261
1944491993215,4cyclictest0-21swapper/108:20:341
1944486993224,6cyclictest2141153-21diskstats10:25:190
1944495993126,3cyclictest1944706-21aten2_r5power_e07:10:162
1944491993128,2cyclictest2066092-21kworker/u8:0+events_unbound09:16:411
1944491993127,2cyclictest2111568-21irqcore09:55:211
1944491993126,3cyclictest2042088-21irqrtprio08:45:241
1944491993122,2cyclictest161rcu_preempt12:35:251
1944491993122,2cyclictest161rcu_preempt12:35:241
1944491993122,2cyclictest161rcu_preempt08:50:281
1944491993121,1cyclictest161rcu_preempt12:20:311
1944491993120,2cyclictest161rcu_preempt12:30:251
1944491993120,2cyclictest161rcu_preempt10:40:241
1944491993120,2cyclictest161rcu_preempt10:25:211
1944491993119,2cyclictest421rcuog/209:50:351
1944491993119,2cyclictest161rcu_preempt10:05:011
1944491993119,2cyclictest161rcu_preempt09:00:321
1944486993127,3cyclictest2006534-21kworker/u8:2+flush-8:008:10:350
1944495993025,3cyclictest2260356-21aten2_r5power_v12:25:172
1944491993021,2cyclictest161rcu_preempt11:55:321
1944491993021,2cyclictest161rcu_preempt11:45:211
1944491993020,2cyclictest161rcu_preempt11:05:261
1944491993019,2cyclictest161rcu_preempt11:10:261
1944491993019,2cyclictest161rcu_preempt09:45:181
1944491993019,2cyclictest161rcu_preempt09:35:291
1944491993019,2cyclictest161rcu_preempt08:15:241
1944491993019,2cyclictest161rcu_preempt08:10:251
194448699308,9cyclictest2225330-21/usr/sbin/munin11:50:250
194448699304,14cyclictest589-21runrttasks09:20:170
194448699304,14cyclictest1985610-21ntpq07:45:300
1944486993026,3cyclictest2144721-21kworker/u8:2+flush-8:012:15:360
1944486993025,3cyclictest2074868-21needreboot09:15:260
1944486993025,2cyclictest2130442-21sshd10:14:180
1944486993024,4cyclictest2214730-21grep11:35:370
1944486993017,2cyclictest161rcu_preempt08:15:260
1944495992923,4cyclictest1967070-21kworker/u8:3+flush-8:007:45:212
1944495992922,5cyclictest1704890-21systemd-journal11:15:002
1944491992922,2cyclictest161rcu_preempt11:40:201
1944491992919,2cyclictest161rcu_preempt07:25:271
1944491992919,1cyclictest161rcu_preempt09:25:271
1944491992918,2cyclictest161rcu_preempt12:25:221
1944491992918,2cyclictest161rcu_preempt08:25:241
1944491992918,2cyclictest161rcu_preempt08:00:361
1944491992918,2cyclictest161rcu_preempt07:50:211
1944491992918,2cyclictest161rcu_preempt07:15:291
194448699295,14cyclictest2032482-21tr08:35:240
194448699293,12cyclictest2064422-21kthreadcore09:05:260
194448699292,26cyclictest2105773-21kworker/0:0+events11:40:270
1944486992922,6cyclictest1930271-21kworker/u8:1+flush-8:007:15:330
1944486992920,2cyclictest161rcu_preempt09:30:260
194448699291,27cyclictest2105773-21kworker/0:0+events10:00:310
1944486992911,3cyclictest161rcu_preempt08:05:170
194448699290,10cyclictest2111897-21ps09:55:230
1944495992820,6cyclictest1704890-21systemd-journal08:50:002
1944495992819,6cyclictest1704890-21systemd-journal09:35:012
1944491992819,2cyclictest161rcu_preempt11:00:251
1944491992818,2cyclictest161rcu_preempt10:50:311
1944491992817,2cyclictest161rcu_preempt07:10:201
1944491992816,3cyclictest161rcu_preempt10:05:201
194448699284,12cyclictest2166111-21/usr/sbin/munin10:50:220
194448699284,12cyclictest2053759-21kthreadcore08:55:260
194448699284,12cyclictest2053759-21kthreadcore08:55:260
194448699284,11cyclictest2045214-21ntpq08:45:320
194448699284,11cyclictest1965759-21python307:25:330
194448699283,12cyclictest2101947-21irqrtprio09:45:240
194448699283,11cyclictest1944930-21fschecks_count07:10:200
1944486992823,3cyclictest0-21swapper/009:45:010
1944486992818,8cyclictest2066384-21diskstats09:10:210
1944486992817,9cyclictest1996955-21diskstats08:00:190
1944486992813,3cyclictest0-21swapper/010:40:310
1944486992812,3cyclictest161rcu_preempt12:20:250
194448699281,16cyclictest2179406-21chrt11:00:300
194448699281,14cyclictest2189506-21ntpq11:10:270
1944486992810,3cyclictest161rcu_preempt09:53:440
1944495992724,2cyclictest2140934-21aten2_r5power_c10:25:182
1944495992723,2cyclictest2175819-21cpuspeed_turbos11:00:192
1944495992723,2cyclictest2056371-21aten2_r5power_v09:00:182
1944495992721,4cyclictest2174889-21unixbench_multi10:55:362
1944495992718,7cyclictest1704890-21systemd-journal09:30:012
194449599270,25cyclictest1-21systemd10:35:002
194448699278,6cyclictest2244430-21run-parts12:05:330
194448699272,14cyclictest589-21runrttasks07:50:150
194448699272,13cyclictest2146836-21cut10:30:240
194448699272,11cyclictest2231885-21kthreadcore11:55:260
194448699271,25cyclictest2264948-21kworker/0:2+events12:35:090
194448699271,25cyclictest2264948-21kworker/0:2+events12:35:080
1944495992622,2cyclictest2245709-21fschecks_count12:10:192
1944495992622,2cyclictest2130807-21aten2_r5power_c10:15:172
1944495992622,2cyclictest2121111-21cpuspeed_turbos10:05:192
1944495992622,2cyclictest2026700-21cpuspeed_turbos08:30:192
1944495992622,2cyclictest2001731-21aten2_r5power_v08:05:182
1944495992621,3cyclictest2230381-21aten2_r5power_p11:55:182
1944495992618,6cyclictest1704890-21systemd-journal10:55:012
1944491992617,2cyclictest161rcu_preempt11:50:251
194448699267,8cyclictest2263219-21kthreadcore12:25:260
194448699262,12cyclictest2246417-21kthreadcore12:10:240
194448699262,12cyclictest2018768-21cut08:20:260
194448699262,11cyclictest2121782-21uname10:05:230
1944486992612,4cyclictest2208858-21cut11:30:260
194448699261,11cyclictest2023669-21kthreadcore08:25:250
194448699260,13cyclictest1967402-21ps07:30:230
1944495992521,2cyclictest2250431-21aten2_r5power_e12:15:162
1944495992521,2cyclictest2215552-21aten2_r5power_p11:40:172
1944495992521,2cyclictest2035692-21unixbench_singl08:35:352
1944495992521,2cyclictest2021576-21aten2_r5power_p08:25:172
1944495992520,3cyclictest1971367-21cron07:34:592
194448699251,13cyclictest2081683-21ps09:25:230
194448699251,11cyclictest2201129-21sort11:25:230
19658972240,3chrt75-21kworker/3:1-events07:25:353
194449599247,2cyclictest22384402cut12:00:262
1944495992420,2cyclictest2256238-21kthreadcore12:20:262
1944495992417,5cyclictest0-21swapper/210:40:002
21181932230,3chrt75-21kworker/3:1-events10:00:253
1944495992319,2cyclictest1996736-21aten2_r5power_c08:00:182
1944495992316,5cyclictest1704890-21systemd-journal12:10:002
1944495992218,3cyclictest2075843-21cron09:20:012
1944495992218,2cyclictest2126037-21cpuspeed_turbos10:10:172
1944495992218,2cyclictest2101223-21aten2_r5power_v09:45:182
1944495992214,6cyclictest1704890-21systemd-journal12:40:002
1944495992214,6cyclictest1704890-21systemd-journal12:39:592
1944495992118,2cyclictest2225468-21aten2_r5power_v11:50:162
1944495992118,2cyclictest1962104-21fschecks_time07:25:202
1944495992117,2cyclictest2224641-21unixbench_multi11:45:352
1944495992116,3cyclictest2204845-21unixbench_multi11:25:362
1944495992111,8cyclictest2110719-21awk09:55:012
194448699211,7cyclictest1944522-21cat07:10:000
194449599202,12cyclictest2265177-21apt-get12:30:172
1944495992017,2cyclictest2135998-21fschecks_count10:20:202
1944495992017,2cyclictest1996035-21unixbench_singl07:55:362
1944495992015,4cyclictest0-21swapper/207:40:012
1944495992012,6cyclictest2046674-21sort08:50:202
1944495992010,2cyclictest421rcuog/211:30:272
194449599192,11cyclictest2011531-21apt-get08:15:182
1944495991915,2cyclictest2016671-21aten2_r5power_v08:20:182
1944495991915,2cyclictest0-21swapper/209:45:002
1944495991915,2cyclictest0-21swapper/209:05:262
1944495991914,4cyclictest0-21swapper/209:00:002
1944495991914,4cyclictest0-21swapper/208:59:592
1944495991914,3cyclictest2091100-21aten2_r5power_p09:35:192
19442452193,8sleep30-21swapper/307:09:183
194449599189,7cyclictest2009878-21tr08:10:262
194449599189,7cyclictest1977932-21tr07:40:222
194449599182,3cyclictest21954562date11:20:012
1944495991814,2cyclictest0-21swapper/211:35:152
1944495991810,6cyclictest2070843-21cron09:15:012
19440702184,10sleep20-21swapper/207:07:002
1944495991714,2cyclictest2161105-21fschecks_time10:45:192
1944495991713,2cyclictest0-21swapper/210:40:352
1944495991712,3cyclictest0-21swapper/209:55:342
1944495991712,3cyclictest0-21swapper/209:20:242
1944495991711,4cyclictest0-21swapper/211:20:232
21853412166,5sleep30-21swapper/311:10:023
22142372156,6sleep30-21swapper/311:35:303
20846452145,5sleep30-21swapper/309:25:263
22354842133,7sleep30-21swapper/312:00:183
22302672132,7sleep30-21swapper/311:55:163
22207982132,7sleep30-21swapper/311:45:213
22157142132,7sleep30-21swapper/311:40:193
22052732131,8sleep30-21swapper/311:29:593
21568192131,8sleep30-21swapper/310:40:243
21255772132,6sleep30-21swapper/310:10:023
21217712133,6sleep30-21swapper/310:05:243
21011122132,7sleep30-21swapper/309:45:173
20649052132,7sleep30-21swapper/309:05:293
20261912131,6sleep30-21swapper/308:30:003
20156112132,7sleep30-21swapper/308:15:363
22601992122,6sleep30-21swapper/312:25:023
22550072122,6sleep30-21swapper/312:20:003
22468582122,5sleep30-21swapper/312:10:253
22093742122,6sleep30-21swapper/311:30:323
21953632122,6sleep30-21swapper/311:20:013
21842022122,6sleep30-21swapper/311:05:273
21759102122,6sleep30-21swapper/311:00:233
21702882124,5sleep30-21swapper/310:54:203
21512012122,6sleep30-21swapper/310:35:213
21468432122,6sleep30-21swapper/310:30:243
21366602122,6sleep30-21swapper/310:20:253
20968262122,6sleep30-21swapper/309:40:233
20753262122,6sleep30-21swapper/309:15:363
20658892122,5sleep30-21swapper/309:10:013
20609102122,6sleep30-21swapper/309:05:013
20499352122,6sleep30-21swapper/308:50:283
20429902122,6sleep30-21swapper/308:45:263
20163142122,5sleep30-21swapper/308:20:023
19817382122,6sleep30-21swapper/307:45:023
19795132122,6sleep30-21swapper/307:40:253
19564362122,5sleep30-21swapper/307:20:023
22699802112,5sleep30-21swapper/312:35:023
22699802112,5sleep30-21swapper/312:35:023
22598512112,6sleep30-21swapper/312:23:343
22410682112,5sleep30-21swapper/312:05:243
22256052112,5sleep30-21swapper/311:50:193
21978232112,5sleep30-21swapper/311:20:243
21706222112,5sleep30-21swapper/310:55:173
21628842112,5sleep30-21swapper/310:45:263
21409082112,5sleep30-21swapper/310:25:193
21307502112,5sleep30-21swapper/310:15:153
21109782112,5sleep30-21swapper/309:55:173
21059912112,5sleep30-21swapper/309:50:153
20909732112,6sleep30-21swapper/309:35:063
20865792112,5sleep30-21swapper/309:30:253
20798782112,5sleep30-21swapper/309:20:303
20510382112,5sleep30-21swapper/308:55:013
20510382112,5sleep30-21swapper/308:55:003
20406642112,6sleep30-21swapper/308:40:363
20313652112,5sleep30-21swapper/308:35:033
20273612112,5sleep30-21swapper/308:30:253
20065442112,6sleep30-21swapper/308:10:143
20021442112,5sleep30-21swapper/308:05:243
19971622112,5sleep30-21swapper/308:00:233
19915002112,5sleep30-21swapper/307:55:023
19875042112,5sleep30-21swapper/307:50:233
19762062112,6sleep30-21swapper/307:38:203
19666892112,5sleep30-21swapper/307:30:163
19447462112,5sleep30-21swapper/307:10:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional