You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 16:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu May 14, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2120364996142,16cyclictest2175699-21munin-plugin-st09:50:012
212035599561,37cyclictest2175204-21unixbench_multi09:45:260
2120364995231,17cyclictest2182463-21grep10:05:222
212035599502,34cyclictest0-21swapper/008:15:240
212035599501,29cyclictest2192080-21fschecks_time10:35:160
212035599501,29cyclictest2192080-21fschecks_time10:35:150
2120366994936,10cyclictest391ktimers/310:55:143
212035599491,32cyclictest2213184-21/usr/sbin/munin11:35:210
212035599491,32cyclictest2213184-21/usr/sbin/munin11:35:210
2120364994820,4cyclictest0-21swapper/210:45:252
2120355994813,32cyclictest13550irq/42-30be0000.ethernet08:45:240
2120366994733,10cyclictest391ktimers/308:40:113
2120364994731,12cyclictest311ktimers/210:25:132
2120355994740,4cyclictest2207019-21cron11:20:010
212035599471,35cyclictest0-21swapper/009:50:100
212035599470,37cyclictest0-21swapper/011:45:130
2120359994634,8cyclictest2189051-21ntp_offset10:25:221
212035599451,39cyclictest2169212-21/usr/sbin/munin09:30:140
212035599451,25cyclictest2173597-21users09:40:270
2120355994438,4cyclictest2120346-21cyclictest10:15:010
212035599441,40cyclictest2162064-21latency_hist09:10:010
212035599441,40cyclictest2162064-21latency_hist09:10:000
212035599441,38cyclictest2202136-21/usr/sbin/munin11:05:100
212035599441,37cyclictest2194062-21/usr/sbin/munin10:40:170
212035599441,22cyclictest21896602sleep010:26:200
212035599431,39cyclictest2170882-21/usr/sbin/munin09:35:130
212035599431,39cyclictest21299792sleep007:35:160
212035599431,37cyclictest2231552-21/usr/sbin/munin12:30:090
212035599431,35cyclictest0-21swapper/011:55:110
212035599421,36cyclictest2210986-21/usr/sbin/munin11:30:130
212035599421,36cyclictest2210986-21/usr/sbin/munin11:30:120
212035599421,36cyclictest2199166-21meminfo10:55:200
2120366994134,4cyclictest2131125-21munin-plugin-st07:40:003
2120364994132,6cyclictest2159926-21unixbench_singl09:00:272
212035599412,33cyclictest2197019-21apt-get10:50:120
2120355994122,15cyclictest0-21swapper/009:15:000
212035599411,35cyclictest2177618-21/usr/sbin/munin09:55:110
212035599411,35cyclictest2131611-21/usr/sbin/munin07:40:160
212035599411,34cyclictest2136473-21apt-get07:55:130
212035599410,37cyclictest0-21swapper/008:20:120
212035599410,36cyclictest0-21swapper/008:40:140
2120364994032,3cyclictest0-21swapper/208:35:162
2120359994029,8cyclictest2144991-21sendmail08:20:011
212035599403,34cyclictest2196454-21cron10:46:000
212035599402,33cyclictest2127954-21apt-get07:30:100
212035599402,24cyclictest2217696-21munin-node11:50:110
2120355994018,19cyclictest13850irq/36-mmc112:40:000
2120355994018,19cyclictest13850irq/36-mmc112:40:000
212035599401,36cyclictest2210626-21sshd11:29:540
212035599401,36cyclictest2187965-21cron10:24:000
212035599401,36cyclictest2150775-21/usr/sbin/munin08:35:200
212035599401,36cyclictest2149688-21uptime08:30:250
212035599401,28cyclictest629-21snmpd07:50:390
212035599400,35cyclictest2222820-21apt-get12:05:120
212035599400,34cyclictest0-21swapper/008:10:100
2120364993929,6cyclictest0-21swapper/208:05:012
2120359993932,4cyclictest2134544-21munin-plugin-st07:50:011
2120359993929,7cyclictest2234277-21grep12:35:261
2120359993929,7cyclictest2234277-21grep12:35:251
212035599393,33cyclictest2139321-21cron08:01:000
212035599392,34cyclictest2157710-21/usr/sbin/munin08:55:230
212035599392,33cyclictest2207390-21/usr/sbin/munin11:20:150
212035599391,35cyclictest2228154-21/usr/sbin/munin12:20:100
212035599391,35cyclictest2226558-21irqstats12:15:170
212035599391,35cyclictest2214927-21/usr/sbin/munin11:40:220
212035599391,35cyclictest2190307-21df10:30:150
212035599391,35cyclictest2184862-21munin-node10:15:100
212035599391,35cyclictest2168093-21/usr/sbin/munin09:25:240
212035599391,35cyclictest2166378-21/usr/sbin/munin09:20:220
212035599391,35cyclictest2159208-21/usr/sbin/munin09:00:190
212035599391,35cyclictest2124662-21df_inode07:20:140
212035599391,33cyclictest2224517-21munin-node12:10:110
212035599391,33cyclictest2221407-21/usr/sbin/munin12:00:160
212035599391,32cyclictest2155443-21apt-get08:50:120
212035599390,34cyclictest0-21swapper/011:10:090
212035599390,30cyclictest0-21swapper/008:25:130
2120366993830,4cyclictest2121979-21cron07:15:013
2120366993830,4cyclictest2121979-21cron07:15:003
2120366993827,8cyclictest2172268-21sh09:40:013
2120364993828,6cyclictest0-21swapper/207:30:252
2120359993826,7cyclictest2127707-21cron07:30:001
212035599381,34cyclictest2181566-21/usr/sbin/munin10:05:120
212035599381,34cyclictest2180553-21grep10:00:250
212035599381,34cyclictest2164956-21/usr/sbin/munin09:15:250
212035599381,34cyclictest2133631-21/usr/sbin/munin07:45:200
212035599381,34cyclictest2123806-21unixbench_multi07:15:260
212035599381,34cyclictest2123806-21unixbench_multi07:15:250
212035599381,34cyclictest2120524-21/usr/sbin/munin07:10:120
212035599381,34cyclictest2120524-21/usr/sbin/munin07:10:110
212035599381,33cyclictest2200439-21apt-get11:00:120
212035599381,32cyclictest2126253-21/usr/sbin/munin07:25:120
212035599380,33cyclictest0-21swapper/012:25:100
2120364993726,7cyclictest0-21swapper/210:50:232
2120359993731,4cyclictest2203614-21latency_hist11:10:001
2120359993730,3cyclictest0-21swapper/110:20:171
212035599371,33cyclictest2140503-21/usr/sbin/munin08:05:180
2120366993625,7cyclictest0-21swapper/309:25:263
2120359993625,7cyclictest231ktimers/111:20:111
2120359993624,9cyclictest2141165-21grep08:05:261
212035599361,31cyclictest2120358-21latency_hist07:10:000
2120366993525,4cyclictest131rcu_preempt07:33:083
2120364993527,4cyclictest0-21swapper/210:05:012
2120364993524,7cyclictest2218709-21grep11:50:252
2120359993528,4cyclictest0-21swapper/107:40:161
2120359993527,4cyclictest0-21swapper/108:25:261
2120359993524,7cyclictest0-21swapper/109:25:271
212036699347,6cyclictest40-21ksoftirqd/312:34:593
2120366993423,8cyclictest391ktimers/312:05:133
2120366993423,6cyclictest0-21swapper/312:25:233
2120366993418,5cyclictest131rcu_preempt11:09:133
2120366993414,3cyclictest131rcu_preempt11:15:183
2120364993425,4cyclictest0-21swapper/211:10:142
2120364993424,6cyclictest2203186-21grep11:05:252
2120364993424,6cyclictest0-21swapper/209:10:012
2120364993424,6cyclictest0-21swapper/209:10:002
2120364993424,6cyclictest0-21swapper/208:15:232
2120364993423,6cyclictest0-21swapper/207:55:262
2120359993427,5cyclictest2219164-21cron11:55:001
2120359993427,4cyclictest0-21swapper/110:40:161
2120359993425,6cyclictest231ktimers/109:50:121
2120359993424,7cyclictest2153041-21grep08:40:261
212036699337,7cyclictest40-21ksoftirqd/308:20:203
2120366993325,4cyclictest0-21swapper/311:20:153
2120366993310,6cyclictest40-21ksoftirqd/310:50:003
2120364993325,4cyclictest0-21swapper/210:10:162
2120364993324,6cyclictest2155211-21cron08:50:002
2120364993324,5cyclictest0-21swapper/207:20:142
2120364993323,6cyclictest0-21swapper/208:05:252
2120359993326,4cyclictest2120346-21cyclictest08:55:341
2120359993326,4cyclictest0-21swapper/111:20:011
2120359993323,7cyclictest0-21swapper/108:00:241
2120359993323,6cyclictest0-21swapper/110:20:001
2120359993322,8cyclictest2121583-21grep07:10:251
2120359993322,8cyclictest2121583-21grep07:10:251
212036699327,6cyclictest40-21ksoftirqd/310:30:223
2120366993225,4cyclictest2205306-21auditctl11:15:003
2120366993214,4cyclictest131rcu_preempt09:55:023
2120366993214,10cyclictest131rcu_preempt10:15:213
2120366993210,11cyclictest131rcu_preempt07:17:353
2120366993210,11cyclictest131rcu_preempt07:17:353
2120364993222,7cyclictest0-21swapper/212:00:012
2120364993221,7cyclictest0-21swapper/212:20:162
2120359993223,6cyclictest2160329-21sh09:05:001
212036699319,7cyclictest40-21ksoftirqd/312:20:013
212036699319,6cyclictest40-21ksoftirqd/310:55:013
2120366993123,4cyclictest0-21swapper/311:45:263
2120366993123,4cyclictest0-21swapper/307:50:123
2120366993121,7cyclictest381rcuc/310:35:233
2120366993121,7cyclictest381rcuc/310:35:233
2120366993118,5cyclictest131rcu_preempt10:10:143
2120366993114,3cyclictest131rcu_preempt11:00:213
2120364993124,3cyclictest0-21swapper/212:00:252
2120364993122,6cyclictest0-21swapper/211:25:002
2120364993121,6cyclictest0-21swapper/209:25:262
2120364993121,6cyclictest0-21swapper/208:40:262
2120364993120,7cyclictest2166727-21grep09:20:252
2120359993121,5cyclictest0-21swapper/112:10:151
212036699307,5cyclictest40-21ksoftirqd/309:15:213
212036699304,8cyclictest40-21ksoftirqd/308:45:243
212036699303,9cyclictest40-21ksoftirqd/312:00:163
2120366993022,4cyclictest0-21swapper/310:25:253
2120366993021,7cyclictest2140661-21ntp_offset08:05:203
2120366993020,3cyclictest131rcu_preempt08:30:023
2120366993014,9cyclictest131rcu_preempt09:22:403
2120366993012,4cyclictest0-21swapper/310:00:043
2120364993023,4cyclictest0-21swapper/207:15:262
2120364993023,4cyclictest0-21swapper/207:15:252
2120364993019,8cyclictest438-21cron10:20:012
2120364993019,7cyclictest0-21swapper/212:20:012
2120359993022,6cyclictest231ktimers/109:40:121
2120359993021,6cyclictest2200221-21idleruntime-cro11:00:001
2120359993019,8cyclictest2215354-21grep11:40:251
212036699299,11cyclictest131rcu_preempt11:50:203
212036699296,7cyclictest40-21ksoftirqd/311:55:203
212036699296,13cyclictest0-21swapper/311:35:153
212036699296,13cyclictest0-21swapper/311:35:153
212036699294,6cyclictest40-21ksoftirqd/309:15:013
212036699293,7cyclictest40-21ksoftirqd/308:00:193
212036699291,9cyclictest40-21ksoftirqd/308:00:023
2120366992917,9cyclictest391ktimers/309:05:253
2120366992917,9cyclictest391ktimers/309:05:243
2120366992917,7cyclictest0-21swapper/307:20:243
2120366992916,5cyclictest131rcu_preempt08:50:153
2120366992914,4cyclictest131rcu_preempt11:41:053
2120366992913,9cyclictest131rcu_preempt12:10:123
2120366992913,9cyclictest131rcu_preempt08:10:123
2120366992912,9cyclictest131rcu_preempt07:45:123
2120366992911,10cyclictest131rcu_preempt09:30:153
2120359992922,4cyclictest0-21swapper/112:20:001
2120359992920,4cyclictest0-21swapper/112:00:011
2120359992918,7cyclictest0-21swapper/109:10:281
212036699285,7cyclictest40-21ksoftirqd/312:35:153
212036699285,7cyclictest40-21ksoftirqd/312:35:153
212036699284,9cyclictest40-21ksoftirqd/311:25:243
212036699284,6cyclictest40-21ksoftirqd/307:25:143
2120366992821,4cyclictest391ktimers/309:00:223
2120366992817,5cyclictest131rcu_preempt08:30:223
2120366992814,4cyclictest131rcu_preempt11:30:133
2120366992814,4cyclictest131rcu_preempt11:30:133
2120366992812,3cyclictest0-21swapper/312:20:143
2120366992811,3cyclictest131rcu_preempt10:44:453
2120366992811,10cyclictest131rcu_preempt08:58:223
2120366992810,3cyclictest381rcuc/309:40:123
2120364992821,4cyclictest0-21swapper/210:35:162
2120364992821,4cyclictest0-21swapper/210:35:162
2120364992820,5cyclictest2215485-21kworker/u8:3+events_unbound12:06:102
2120364992820,4cyclictest0-21swapper/207:15:012
2120364992820,4cyclictest0-21swapper/207:15:012
2120364992819,6cyclictest0-21swapper/207:30:012
2120364992819,5cyclictest0-21swapper/209:55:262
2120364992818,7cyclictest2171002-21tune2fs09:35:142
2120364992818,6cyclictest0-21swapper/211:00:262
2120364992818,6cyclictest0-21swapper/209:15:252
2120364992817,8cyclictest2130544-21runrttasks07:35:242
2120359992822,4cyclictest2197178-21grep10:50:151
2120359992819,4cyclictest2131148-21sendmail07:40:011
2120359992818,7cyclictest2129411-21sh07:35:001
212036699279,3cyclictest0-21swapper/310:20:133
212036699277,7cyclictest40-21ksoftirqd/309:45:243
212036699274,8cyclictest40-21ksoftirqd/308:15:223
2120366992715,4cyclictest131rcu_preempt08:35:163
2120366992715,3cyclictest131rcu_preempt09:55:113
2120364992718,5cyclictest0-21swapper/211:49:592
2120364992718,4cyclictest0-21swapper/207:45:232
2120359992719,4cyclictest0-21swapper/112:25:241
2120359992719,4cyclictest0-21swapper/110:30:171
2120359992719,3cyclictest0-21swapper/109:40:011
2120359992718,4cyclictest0-21swapper/109:55:471
2120359992717,6cyclictest2161611-21grep09:05:251
2120359992717,6cyclictest2161611-21grep09:05:251
212036699266,3cyclictest0-21swapper/307:40:123
2120364992620,4cyclictest0-21swapper/208:30:242
2120364992618,5cyclictest0-21swapper/212:39:592
2120364992618,5cyclictest0-21swapper/212:39:592
2120364992617,6cyclictest2212340-21sh11:35:002
2120364992617,6cyclictest2212340-21sh11:35:002
2120364992617,4cyclictest0-21swapper/209:45:002
2120359992618,4cyclictest0-21swapper/111:00:251
2120364992518,4cyclictest2132368-21tail07:40:252
2120364992517,5cyclictest0-21swapper/209:00:012
2120364992516,6cyclictest2188068-21cut10:25:012
2120364992516,5cyclictest0-21swapper/208:20:222
2120359992518,4cyclictest2214049-21latency_hist11:40:001
2120359992518,4cyclictest2214049-21latency_hist11:40:001
2120359992515,6cyclictest2167155-21cron09:24:591
2120359992515,6cyclictest2126014-21auditctl07:25:011
2120359992515,6cyclictest0-21swapper/112:05:251
2120359992514,7cyclictest0-21swapper/111:45:251
2120359992418,4cyclictest2146064-21timerandwakeup08:20:241
2120359992418,3cyclictest0-21swapper/109:30:241
2120359992416,5cyclictest0-21swapper/110:00:251
2120359992413,8cyclictest2142784-21grep08:10:241
212035999241,12cyclictest0-21swapper/110:09:311
2120364992316,4cyclictest438-21cron07:55:002
2120364992313,6cyclictest0-21swapper/212:25:242
212035999232,16cyclictest2193360-21cron10:39:591
212035999232,16cyclictest2193360-21cron10:39:591
2120359992314,6cyclictest2135406-21wc07:50:231
2120359992314,6cyclictest0-21swapper/112:20:251
2120359992314,5cyclictest0-21swapper/108:40:011
2120359992312,6cyclictest2136687-21fschecks_time07:55:151
2120359992310,9cyclictest1-21systemd08:45:341
2120364992215,5cyclictest0-21swapper/211:20:002
2120364992215,4cyclictest438-21cron12:15:002
2120364992212,7cyclictest2163340-21grep09:10:282
2120364992210,7cyclictest2199785-21grep10:55:252
212035999223,14cyclictest2155654-21grep08:50:161
2120359992216,3cyclictest0-21swapper/112:30:231
2120359992215,5cyclictest231ktimers/112:00:161
2120359992214,5cyclictest0-21swapper/111:10:231
2120359992211,8cyclictest2211931-21grep11:30:231
2120359992211,8cyclictest2211931-21grep11:30:231
2120364992114,3cyclictest0-21swapper/211:35:242
2120364992114,3cyclictest0-21swapper/211:35:232
2120364992114,3cyclictest0-21swapper/209:50:142
2120364992113,5cyclictest2232567-21tail12:30:222
2120364992113,5cyclictest0-21swapper/210:30:182
2120364992113,5cyclictest0-21swapper/208:50:192
2120364992113,4cyclictest0-21swapper/208:25:262
2120364992112,5cyclictest2170142-21grep09:30:242
2120364992111,6cyclictest0-21swapper/210:40:252
2120364992110,8cyclictest2209292-21diskstats11:25:132
212035999212,15cyclictest2210186-21unixbench_multi11:25:231
2120359992115,3cyclictest0-21swapper/110:10:231
2120359992114,4cyclictest2148831-21fschecks_time08:30:141
2120359992113,5cyclictest231ktimers/110:45:141
212036499208,8cyclictest2142797-21grep08:10:242
2120364992015,3cyclictest2214402-21sh11:40:132
2120359992013,5cyclictest0-21swapper/109:15:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional