You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 11:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Mar 14, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2045240995020,14cyclictest2049717-21/usr/sbin/munin19:20:113
2045240994815,15cyclictest2136139-21switchtime23:30:233
2045235994826,17cyclictest2119312-21grep22:40:252
2045229994734,10cyclictest121ktimers/020:10:140
2045229994528,15cyclictest151rcuc/021:25:120
2045240994415,12cyclictest2115695-21wc22:30:223
204523599443,9cyclictest2049195-21sendmail-msp19:20:012
2045235994414,9cyclictest2081982-21cron20:55:002
2045235994410,6cyclictest2111500-21/usr/sbin/munin22:20:142
2045232994436,5cyclictest2066446-21munin-plugin-st20:10:001
2045232994431,8cyclictest2155343-21grep00:25:261
2045240994333,6cyclictest0-21swapper/322:25:003
2045240994330,10cyclictest391ktimers/300:15:083
2045240994315,12cyclictest2072552-21sh20:25:243
204523599432,18cyclictest2122702-21grep22:50:252
2045235994312,4cyclictest0-21swapper/200:25:002
204523599431,10cyclictest2086269-21seq21:05:202
2045232994337,4cyclictest2082805-21kworker/u8:1+events_unbound21:00:401
2045232994335,5cyclictest2087124-21grep21:10:011
2045229994334,7cyclictest2086959-21kworker/u8:3+events_unbound23:17:050
2045229994333,7cyclictest2124854-21sendmail23:00:000
2045240994216,9cyclictest2130713-21ntpq23:15:183
2045235994232,7cyclictest2064257-21grep20:00:232
2045235994223,15cyclictest0-21swapper/222:10:152
2045235994215,24cyclictest0-21swapper/222:30:232
2045232994234,4cyclictest0-21swapper/119:35:011
2045232994231,8cyclictest438-21cron20:45:011
2045240994132,5cyclictest2074953-21cron20:35:013
2045240994113,11cyclictest2129684-21chrt23:11:513
204523599412,13cyclictest2080285-21cron20:49:592
2045229994132,6cyclictest2098597-21unixbench_multi21:40:250
2045235994032,5cyclictest2059624-21latency_hist19:50:012
2045235994014,3cyclictest0-21swapper/220:20:252
2045235994011,6cyclictest0-21swapper/221:20:252
2045235994011,6cyclictest0-21swapper/221:20:242
2045229994029,7cyclictest2137414-21fschecks_time23:35:160
2045240993925,11cyclictest2062767-21cron19:57:003
2045240993922,14cyclictest2095882-21apt-get21:35:113
2045240993922,12cyclictest0-21swapper/323:55:113
2045240993911,11cyclictest2087527-21cut21:10:153
204523599391,12cyclictest2056199-21apt19:40:002
2045235993910,4cyclictest0-21swapper/221:00:002
2045232993933,4cyclictest2128478-21kworker/u8:2+events_unbound23:27:081
2045232993927,8cyclictest2104434-21apt-config22:00:021
2045229993931,5cyclictest2102884-21fschecks_time21:55:140
2045240993828,7cyclictest2109730-21apt-get22:15:143
2045240993827,8cyclictest2078081-21sshd20:41:283
2045240993824,11cyclictest2134740-21cron23:26:013
2045240993823,10cyclictest2149506-21/usr/sbin/munin00:10:173
2045240993821,3cyclictest2068478-21df20:15:133
2045240993814,9cyclictest2152599-21egrep00:20:153
204523599382,12cyclictest2057913-21cron19:45:012
204523599382,12cyclictest2057913-21cron19:45:002
2045235993814,6cyclictest2117103-21grep22:35:202
2045232993830,4cyclictest0-21swapper/100:10:001
2045232993829,5cyclictest2069835-21cron20:20:011
2045232993829,4cyclictest0-21swapper/121:11:361
2045232993828,6cyclictest0-21swapper/120:40:001
2045240993731,3cyclictest2140645-21apt-get23:45:113
2045240993730,3cyclictest2116549-21apt-get22:35:123
2045240993725,7cyclictest2147918-21/usr/sbin/munin00:05:193
2045240993725,7cyclictest2067010-21/usr/sbin/munin20:10:193
2045240993724,10cyclictest2094297-21/usr/sbin/munin21:30:143
2045240993724,10cyclictest2063592-21/usr/sbin/munin20:00:163
2045240993722,11cyclictest2055168-21/usr/sbin/munin19:35:193
2045240993718,15cyclictest2106089-21cron22:05:003
2045235993729,5cyclictest2126144-21grep23:00:232
2045235993715,5cyclictest0-21swapper/223:20:012
2045235993714,4cyclictest2095652-21latency_hist21:35:002
2045232993728,6cyclictest2151917-21grep00:15:251
2045229993729,4cyclictest0-21swapper/022:25:000
2045229993728,6cyclictest2141715-21unixbench_singl23:45:240
2045240993625,8cyclictest2081600-21/usr/sbin/munin20:50:263
2045240993625,7cyclictest2139393-21/usr/sbin/munin23:40:193
2045240993624,9cyclictest2119975-21/usr/sbin/munin22:45:163
2045240993624,9cyclictest2119975-21/usr/sbin/munin22:45:153
2045240993623,10cyclictest2085825-21/usr/sbin/munin21:05:133
2045240993623,10cyclictest2084500-21/usr/sbin/munin21:00:213
2045240993622,9cyclictest0-21swapper/322:55:123
2045240993618,13cyclictest2090992-21fschecks_time21:20:163
2045240993618,13cyclictest2090992-21fschecks_time21:20:163
2045240993617,6cyclictest2125532-21meminfo23:00:173
2045240993614,5cyclictest2058597-21memory19:45:183
2045240993613,8cyclictest645-21runrttasks22:54:593
2045235993628,5cyclictest0-21swapper/223:35:002
2045235993614,3cyclictest20752452sleep220:35:142
2045235993613,4cyclictest311ktimers/222:05:182
2045232993630,4cyclictest2135025-21kworker/u8:0+events_unbound23:32:081
2045232993630,4cyclictest2116210-21kworker/u8:0+events_unbound23:02:031
2045232993626,5cyclictest0-21swapper/123:07:041
2045232993619,5cyclictest2121199-21kworker/u8:1+events_unbound23:36:231
2045232993616,8cyclictest131rcu_preempt22:05:111
2045229993628,4cyclictest2152779-21fschecks_time00:20:180
2045229993628,3cyclictest0-21swapper/020:36:270
2045229993627,6cyclictest0-21swapper/019:40:010
2045240993529,3cyclictest2157900-21apt-get00:35:113
2045240993529,3cyclictest2157900-21apt-get00:35:103
2045240993528,4cyclictest2097600-21apt-get21:40:123
2045240993528,3cyclictest2099302-21apt-get21:45:143
2045240993524,7cyclictest2145767-21apt-get00:00:133
2045240993523,8cyclictest391ktimers/323:05:133
2045240993518,13cyclictest2109154-21sh22:11:013
2045240993518,12cyclictest2051667-21/usr/sbin/munin19:25:173
2045235993525,6cyclictest0-21swapper/223:40:252
2045235993525,6cyclictest0-21swapper/221:10:242
2045232993528,5cyclictest2086959-21kworker/u8:3+events_unbound21:40:421
2045232993515,7cyclictest131rcu_preempt20:20:111
2045232993515,5cyclictest131rcu_preempt20:55:121
2045229993527,4cyclictest0-21swapper/000:00:010
2045240993428,3cyclictest2137225-21apt-get23:35:123
2045240993424,7cyclictest2156539-21/usr/sbin/munin00:30:173
2045240993424,7cyclictest2156539-21/usr/sbin/munin00:30:173
2045240993424,7cyclictest2143029-21/usr/sbin/munin23:50:223
2045240993424,7cyclictest2132684-21/usr/sbin/munin23:20:213
2045240993424,7cyclictest2080231-21sshd20:49:203
2045240993424,7cyclictest2060975-21cron19:51:003
2045240993424,7cyclictest2056785-21/usr/sbin/munin19:40:183
2045240993424,7cyclictest2056785-21/usr/sbin/munin19:40:183
2045240993424,7cyclictest2053025-21/usr/sbin/munin19:30:253
2045240993420,10cyclictest2106382-21/usr/sbin/munin22:05:133
2045240993419,12cyclictest2083329-21sendmail-mta20:55:453
2045240993415,14cyclictest2155900-21apt-config00:30:013
2045229993427,4cyclictest0-21swapper/022:05:010
2045229993426,4cyclictest0-21swapper/023:07:050
2045229993420,11cyclictest2045220-21cyclictest22:05:110
2045240993323,7cyclictest2118265-21/usr/sbin/munin22:40:113
2045240993323,7cyclictest2101260-21/usr/sbin/munin21:50:163
2045240993323,7cyclictest2071219-21cron20:21:003
2045240993323,7cyclictest2065241-21/usr/sbin/munin20:05:173
2045240993322,7cyclictest2075497-21/usr/sbin/munin20:35:163
2045240993322,6cyclictest2089394-21irqstats21:15:173
2045240993321,7cyclictest2102794-21/usr/sbin/munin21:55:123
204523599339,9cyclictest2078530-21sed20:45:022
2045235993323,6cyclictest2138701-21sh23:40:002
2045232993325,6cyclictest2086959-21kworker/u8:3+events_unbound22:55:231
2045232993325,4cyclictest0-21swapper/122:45:281
2045232993325,4cyclictest0-21swapper/122:45:271
204522999334,4cyclictest131rcu_preempt00:35:100
204522999334,4cyclictest131rcu_preempt00:35:100
2045229993326,4cyclictest2119730-21cron22:45:000
204522999332,5cyclictest131rcu_preempt22:50:120
2045240993222,7cyclictest2048266-21ntp_states19:15:223
2045240993221,8cyclictest2045501-21/usr/sbin/munin19:10:143
2045240993219,10cyclictest2113588-21/usr/sbin/munin22:25:183
2045235993222,5cyclictest0-21swapper/200:30:002
2045232993224,6cyclictest2027398-21kworker/u8:0+events_unbound19:55:241
2045232993221,7cyclictest2095176-21grep21:30:241
2045232993221,7cyclictest2061329-21basename19:55:011
2045240993118,9cyclictest0-21swapper/321:25:113
2045235993122,5cyclictest0-21swapper/220:00:002
2045235993121,7cyclictest0-21swapper/223:15:012
2045232993123,6cyclictest2103968-21kworker/u8:0+events_unbound22:11:491
2045232993121,6cyclictest0-21swapper/121:25:001
2045232993121,6cyclictest0-21swapper/121:25:001
204522999318,4cyclictest2078382-21auditctl20:45:000
2045229993124,3cyclictest0-21swapper/019:20:010
2045229993121,5cyclictest0-21swapper/020:25:160
2045235993023,4cyclictest0-21swapper/200:05:242
2045235993022,4cyclictest0-21swapper/222:00:022
204523299306,14cyclictest24-21ksoftirqd/119:25:211
2045232993022,6cyclictest2086959-21kworker/u8:3+events_unbound21:51:401
2045232993022,4cyclictest0-21swapper/122:25:211
2045232993022,4cyclictest0-21swapper/100:00:251
2045232993020,7cyclictest2047642-21tune2fs19:15:031
2045232993020,6cyclictest0-21swapper/122:39:591
2045232993020,6cyclictest0-21swapper/119:40:011
2045232993011,10cyclictest0-21swapper/123:53:131
2045229993025,2cyclictest13550irq/42-30be0000.ethernet20:05:230
2045229993024,4cyclictest2059236-21kworker/u8:3+events_unbound19:46:120
2045229993023,4cyclictest0-21swapper/022:10:240
2045229993023,4cyclictest0-21swapper/021:05:000
2045229993022,4cyclictest0-21swapper/021:20:010
2045229993022,4cyclictest0-21swapper/000:35:000
2045229993022,4cyclictest0-21swapper/000:35:000
2045229993021,4cyclictest0-21swapper/020:50:210
2045229993014,6cyclictest2059236-21kworker/u8:3+events_unbound20:00:120
204522999300,5cyclictest131rcu_preempt20:45:110
2045235992922,4cyclictest0-21swapper/219:55:012
2045232992923,4cyclictest2032551-21kworker/u8:2+events_unbound19:14:391
2045232992922,4cyclictest0-21swapper/122:35:011
2045232992917,5cyclictest131rcu_preempt19:40:151
2045232992917,5cyclictest131rcu_preempt19:40:151
2045232992912,6cyclictest131rcu_preempt21:35:131
204522999295,12cyclictest2126309-21kworker/0:1-events00:30:010
2045229992921,5cyclictest2071101-21unixbench_multi20:20:240
2045229992921,5cyclictest0-21swapper/000:05:010
2045229992920,6cyclictest0-21swapper/021:35:260
2045229992919,7cyclictest2091846-21grep21:20:260
2045229992919,7cyclictest2091846-21grep21:20:260
204522999291,7cyclictest20871342basename21:10:000
204522999291,5cyclictest438-21cron23:55:010
204522999291,5cyclictest131rcu_preempt23:00:110
2045235992820,6cyclictest2114683-21ls22:30:012
2045235992819,5cyclictest0-21swapper/221:50:012
2045232992822,4cyclictest221rcuc/123:55:521
2045232992821,5cyclictest2069736-21kworker/u8:0+events_unbound20:26:291
2045232992818,7cyclictest2157249-21grep00:30:231
2045232992818,7cyclictest2157249-21grep00:30:231
2045232992818,4cyclictest2027398-21kworker/u8:0+events_unbound20:02:401
2045232992816,4cyclictest2150471-21kworker/u8:2+events_unbound00:13:511
204523299281,12cyclictest0-21swapper/122:23:211
2045229992821,4cyclictest13550irq/42-30be0000.ethernet19:10:250
2045229992818,6cyclictest0-21swapper/023:10:230
2045229992818,6cyclictest0-21swapper/019:55:270
2045229992818,6cyclictest0-21swapper/019:20:220
2045229992817,8cyclictest121ktimers/023:20:100
2045229992817,7cyclictest2083717-21sendmail21:00:010
2045235992718,5cyclictest0-21swapper/220:25:242
2045232992719,5cyclictest0-21swapper/122:40:241
2045232992717,7cyclictest0-21swapper/121:45:161
204523299271,13cyclictest0-21swapper/121:29:221
2045229992721,4cyclictest2080111-21kworker/u8:2+events_unbound21:51:450
2045229992720,4cyclictest2087982-21grep21:10:220
2045229992719,5cyclictest0-21swapper/022:30:150
2045229992718,6cyclictest2061326-21munin-run19:55:000
204522999271,5cyclictest131rcu_preempt22:25:120
2045235992619,5cyclictest2128478-21kworker/u8:2+events_unbound23:26:262
2045235992619,4cyclictest0-21swapper/223:55:002
2045235992617,6cyclictest2090116-21grep21:15:242
2045235992616,7cyclictest2051465-21fschecks_count19:25:162
2045235992616,7cyclictest2046442-21grep19:10:252
2045235992613,9cyclictest204-21dbus-daemon23:22:052
204523299269,10cyclictest0-21swapper/119:47:131
204523299265,12cyclictest24-21ksoftirqd/100:20:221
2045232992619,5cyclictest2059236-21kworker/u8:3+events_unbound20:51:331
2045232992619,3cyclictest0-21swapper/123:20:221
2045232992618,4cyclictest0-21swapper/120:30:141
2045232992617,7cyclictest2128478-21kworker/u8:2+events_unbound23:45:071
2045232992617,7cyclictest2121199-21kworker/u8:1+events_unbound23:41:311
2045232992616,7cyclictest2079892-21grep20:45:261
2045232992616,6cyclictest0-21swapper/100:35:151
2045232992616,6cyclictest0-21swapper/100:35:141
204523299261,12cyclictest0-21swapper/121:18:211
204522999263,5cyclictest21405022sed23:45:000
2045229992617,5cyclictest0-21swapper/023:30:240
2045229992616,6cyclictest0-21swapper/019:40:250
2045229992616,6cyclictest0-21swapper/019:40:250
2045229992616,6cyclictest0-21swapper/000:05:230
2045229992615,8cyclictest2152351-21ls00:20:000
204522999261,4cyclictest131rcu_preempt22:45:140
204522999261,4cyclictest131rcu_preempt22:45:140
204522999261,11cyclictest0-21swapper/000:12:430
2045235992519,4cyclictest2027398-21kworker/u8:0+events_unbound19:20:222
2045235992514,6cyclictest2150152-21grep00:10:252
204523299256,12cyclictest131rcu_preempt23:15:171
204523299255,12cyclictest131rcu_preempt19:20:221
2045232992518,5cyclictest2086959-21kworker/u8:3+events_unbound22:16:011
2045232992517,6cyclictest2062652-21kworker/u8:1+events_unbound20:14:031
2045232992512,5cyclictest131rcu_preempt23:10:101
204523299251,12cyclictest0-21swapper/122:02:551
2045229992519,3cyclictest0-21swapper/022:15:260
2045229992518,4cyclictest0-21swapper/022:35:250
2045229992515,6cyclictest0-21swapper/021:45:260
2045235992418,3cyclictest0-21swapper/223:55:152
2045235992418,3cyclictest0-21swapper/200:20:012
2045235992416,5cyclictest0-21swapper/221:00:252
2045235992415,6cyclictest2092659-21grep21:25:162
2045229992417,4cyclictest2053238-21fschecks_time19:30:160
204522999241,19cyclictest0-21swapper/020:19:380
2045235992317,4cyclictest2128478-21kworker/u8:2+events_unbound23:48:452
2045235992316,4cyclictest311ktimers/219:35:012
2045235992316,4cyclictest0-21swapper/222:55:242
2045235992314,7cyclictest311ktimers/221:40:102
204522999231,18cyclictest0-21swapper/023:26:440
204522999230,21cyclictest0-21swapper/020:31:110
2045235992214,6cyclictest311ktimers/223:05:132
2045235992214,6cyclictest311ktimers/220:30:192
204523599221,3cyclictest20967942timerwakeupswit21:35:252
2045235992115,3cyclictest0-21swapper/220:10:212
2045235992115,3cyclictest0-21swapper/220:05:242
2045235992115,3cyclictest0-21swapper/200:35:232
2045235992115,3cyclictest0-21swapper/200:35:232
2045235992112,6cyclictest2102068-21sed21:50:262
204522999211,18cyclictest0-21swapper/021:30:570
204523599202,14cyclictest2147226-21cron00:05:002
2045235992010,7cyclictest2120655-21gunzip22:45:262
2045235992010,7cyclictest2120655-21gunzip22:45:262
2045235991912,5cyclictest311ktimers/220:15:222
2045235991911,5cyclictest311ktimers/200:30:112
2045235991911,5cyclictest311ktimers/200:30:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional