You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 19:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Apr 25, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1871069995447,5cyclictest1949625-21kworker/u8:2+events_unbound11:26:100
187106999540,51cyclictest0-21swapper/012:00:120
1871073994935,10cyclictest231ktimers/111:40:121
1871073994935,10cyclictest231ktimers/111:40:121
1871077994826,18cyclictest1895027-21grep08:15:262
1871069994838,5cyclictest1975202-21ls12:10:000
1871077994721,21cyclictest0-21swapper/211:05:262
1871073994737,7cyclictest1879714-21grep07:30:261
1871069994733,10cyclictest121ktimers/012:20:120
1871082994636,6cyclictest1-21systemd07:55:193
1871073994633,10cyclictest231ktimers/111:05:141
1871082994535,6cyclictest1869209-21kworker/u8:3+events_unbound08:10:233
187107799451,12cyclictest1884360-21ntp_states07:45:232
1871073994535,7cyclictest1938499-21grep10:20:251
1871073994535,7cyclictest1878025-21grep07:25:271
1871082994320,18cyclictest0-21swapper/307:45:273
1871082994233,4cyclictest0-21swapper/310:25:013
1871082994216,23cyclictest0-21swapper/311:10:003
187108299421,10cyclictest1970844-21ntp_kernel_pll_11:55:213
1871077994225,12cyclictest0-21swapper/208:40:252
187107799421,9cyclictest1976659-21/usr/sbin/munin12:10:252
187107799421,4cyclictest1951355-21apt-get11:00:132
1871073994231,9cyclictest231ktimers/107:15:141
1871069994227,11cyclictest121ktimers/010:20:120
187108299412,9cyclictest1948618-21wc10:50:243
1871077994134,4cyclictest1921708-21munin-plugin-st09:35:012
1871077994120,18cyclictest1940673-21idleruntime-cro10:30:012
187107799411,9cyclictest1950238-21/usr/sbin/munin10:55:212
187107799411,9cyclictest1922604-21/usr/sbin/munin09:35:242
187107799411,37cyclictest1942887-21/usr/sbin/munin10:35:172
187107799411,35cyclictest1982565-21df12:30:132
187107799411,35cyclictest1982565-21df12:30:132
187107799411,11cyclictest1909894-21df09:00:142
1871073994134,4cyclictest1940680-21idleruntime-cro10:30:011
187106999411,15cyclictest0-21swapper/010:10:120
187108299407,3cyclictest0-21swapper/311:45:223
187108299402,5cyclictest1960275-21fschecks_time11:25:163
187108299402,11cyclictest1924681-21head09:40:263
187108299401,9cyclictest1881824-21cron07:40:003
1871082994015,21cyclictest391ktimers/309:40:003
1871082994012,24cyclictest0-21swapper/308:30:013
1871082994011,26cyclictest0-21swapper/311:10:163
1871077994033,5cyclictest1978815-21munin-plugin-st12:20:002
187107799403,32cyclictest1890714-21df_inode08:05:162
187107799401,9cyclictest1944622-21/usr/sbin/munin10:40:182
1871077994018,17cyclictest0-21swapper/211:25:162
187107799401,7cyclictest1932487-21/usr/sbin/munin10:05:132
187107799401,11cyclictest1981099-21/usr/sbin/munin12:25:182
187107799401,10cyclictest1974306-21awk12:05:212
1871077994010,27cyclictest1876739-21basename07:25:012
1871073994030,7cyclictest1919532-21grep09:25:261
187108299398,7cyclictest1910707-21cat09:00:253
187108299398,3cyclictest0-21swapper/308:45:263
187108299398,3cyclictest0-21swapper/308:45:263
187108299397,4cyclictest1917519-21sendmail_mailqu09:20:233
187108299397,3cyclictest0-21swapper/312:25:183
1871082993929,6cyclictest1915938-21grep09:15:253
187108299391,8cyclictest1918525-21/usr/sbin/munin09:25:213
1871082993913,22cyclictest0-21swapper/310:25:563
187108299391,11cyclictest1895474-21apt08:20:013
187107799392,32cyclictest1966667-21cron11:45:002
187107799392,32cyclictest1966667-21cron11:45:002
187107799391,9cyclictest1962317-21/usr/sbin/munin11:30:192
187107799391,9cyclictest1941224-21/usr/sbin/munin10:30:182
187107799391,8cyclictest1948175-21idleruntime10:50:162
187107799391,8cyclictest1877072-21df07:25:152
187107799391,7cyclictest1911496-21/usr/sbin/munin09:05:152
187107799391,6cyclictest1972597-21/usr/sbin/munin12:00:212
187107799391,5cyclictest1873663-21/usr/sbin/munin07:15:162
187107799391,4cyclictest0-21swapper/211:55:132
187107799391,3cyclictest0-21swapper/210:00:132
187107799391,3cyclictest0-21swapper/208:55:132
187107799391,3cyclictest0-21swapper/208:25:132
187107799391,3cyclictest0-21swapper/207:35:132
187107799390,3cyclictest0-21swapper/208:45:142
187107799390,3cyclictest0-21swapper/208:45:132
187107799390,3cyclictest0-21swapper/207:10:122
1871073993930,4cyclictest0-21swapper/110:30:171
187108299389,6cyclictest0-21swapper/309:10:173
187108299382,10cyclictest1951472-21/usr/sbin/munin11:00:153
187108299381,9cyclictest1933374-21unixbench_multi10:05:243
187108299381,8cyclictest1926551-21grep09:45:243
187108299381,8cyclictest1926551-21grep09:45:243
187108299381,8cyclictest1895910-21cut08:20:183
187108299381,7cyclictest1927403-21cut09:50:203
1871082993811,3cyclictest0-21swapper/310:14:363
187108299381,12cyclictest1966666-21cron11:45:003
187108299381,12cyclictest1966666-21cron11:45:003
187108299381,11cyclictest1973065-21grep12:00:253
187108299381,11cyclictest1964980-21basename11:40:003
187108299381,11cyclictest1964980-21basename11:40:003
187108299381,11cyclictest1921172-21grep09:30:263
187108299381,10cyclictest1941679-21wc10:30:253
187107799384,31cyclictest1900268-21which08:30:242
187107799382,31cyclictest1963700-21cut11:35:172
187107799382,31cyclictest1963700-21cut11:35:172
1871077993820,14cyclictest0-21swapper/209:15:012
187107799381,8cyclictest1936298-21/usr/sbin/munin10:15:212
187107799381,5cyclictest1878780-21/usr/sbin/munin07:30:152
187107799381,4cyclictest1967280-21/usr/sbin/munin11:45:182
187107799381,4cyclictest1906654-21/usr/sbin/munin08:50:172
1871077993814,21cyclictest0-21swapper/209:25:192
187107799381,34cyclictest1957295-21/usr/sbin/munin11:15:242
187107799381,10cyclictest1923859-21/usr/sbin/munin09:40:172
187107799380,3cyclictest0-21swapper/208:20:142
1871073993828,7cyclictest0-21swapper/110:50:011
1871073993826,9cyclictest1903968-21grep08:40:251
187106999389,7cyclictest131rcu_preempt10:45:120
1871069993828,7cyclictest1954098-21grep11:05:260
187108299373,5cyclictest1946180-21grep10:45:153
187108299372,7cyclictest1875406-21fschecks_count07:20:173
187108299371,9cyclictest1962778-21grep11:30:243
187108299371,8cyclictest1885640-21cut07:50:173
187108299371,8cyclictest1885640-21cut07:50:173
1871082993711,3cyclictest0-21swapper/307:10:293
187108299371,10cyclictest1978110-21/usr/sbin/munin12:15:253
187108299371,10cyclictest1974212-21wc12:05:193
187108299371,10cyclictest1891667-21unixbench_singl08:05:263
187107799373,3cyclictest1934193-21df_inode10:10:142
187107799373,31cyclictest1955373-21proc_pri11:10:232
187107799372,3cyclictest1886507-21/usr/sbin/munin07:50:272
187107799372,3cyclictest1886507-21/usr/sbin/munin07:50:262
187107799371,5cyclictest1902019-21/usr/sbin/munin08:35:242
187107799371,4cyclictest1938439-21/usr/sbin/munin10:20:242
187107799371,4cyclictest1887781-21/usr/sbin/munin07:55:232
187107799371,3cyclictest0-21swapper/210:45:112
187107799371,3cyclictest0-21swapper/209:45:112
187107799371,3cyclictest0-21swapper/209:45:112
187107799371,3cyclictest0-21swapper/207:40:122
187107799371,31cyclictest1979396-21irqstats12:20:182
187107799371,11cyclictest1927261-21/usr/sbin/munin09:50:232
187107799371,10cyclictest1929368-21cat09:55:202
1871073993726,7cyclictest0-21swapper/108:00:001
187106999378,5cyclictest131rcu_preempt11:30:110
1871069993714,4cyclictest131rcu_preempt09:20:010
187108299369,3cyclictest1903912-21timerwakeupswit08:40:253
187108299362,9cyclictest1959383-21unixbench_multi11:20:273
187108299362,5cyclictest204-21dbus-daemon12:21:173
187108299361,9cyclictest1957042-21cat11:15:203
187108299361,9cyclictest1878804-21sort07:30:163
187108299361,7cyclictest1912533-21grep09:05:273
187108299361,5cyclictest1932139-21cron10:05:003
187108299361,11cyclictest1950005-21/usr/sbin/munin10:55:173
187108299361,10cyclictest1975752-21df_inode12:10:143
187108299361,10cyclictest1883160-21/usr/sbin/munin07:40:253
187108299361,10cyclictest1874604-21sed07:15:283
1871082993610,22cyclictest0-21swapper/312:35:273
187107799362,3cyclictest1984499-21irqstats12:35:192
187107799361,3cyclictest1916907-21/usr/sbin/munin09:20:132
187107799360,3cyclictest0-21swapper/209:15:132
1871073993628,4cyclictest0-21swapper/110:10:161
1871073993623,10cyclictest231ktimers/111:55:131
187108299357,3cyclictest0-21swapper/312:30:133
187108299357,3cyclictest0-21swapper/312:30:133
187108299352,12cyclictest1902714-21apt08:40:003
187108299351,10cyclictest1944101-21idleruntime-cro10:40:003
187108299351,10cyclictest1900614-21/usr/sbin/munin08:30:263
187108299351,10cyclictest1889347-21meminfo08:00:203
187107799351,4cyclictest1958443-21/usr/sbin/munin11:20:152
187107799351,3cyclictest0-21swapper/208:10:132
1871073993528,4cyclictest1893765-21debian-sa108:15:011
1871073993527,4cyclictest0-21swapper/111:10:161
1871073993527,4cyclictest0-21swapper/107:35:181
1871069993516,7cyclictest131rcu_preempt12:30:110
1871069993516,7cyclictest131rcu_preempt12:30:110
187108299341,9cyclictest1907048-21/usr/sbin/munin08:50:243
187108299341,7cyclictest1936812-21head10:15:263
187108299341,10cyclictest1930457-21sendmail10:00:003
1871073993427,4cyclictest0-21swapper/109:10:251
187106999348,4cyclictest131rcu_preempt07:20:130
1871069993428,4cyclictest1928607-21kworker/u8:3+events_unbound10:41:010
1871069993426,6cyclictest1921935-21kworker/u8:2+events_unbound10:15:570
1871069993425,6cyclictest1914673-21munin-run09:15:010
1871069993424,7cyclictest1922978-21grep09:35:260
1871069993423,7cyclictest0-21swapper/008:25:010
187108299332,11cyclictest1878419-21cron07:30:013
187108299331,11cyclictest1969055-21meminfo11:50:203
187108299331,11cyclictest1908183-21df_inode08:55:163
1871073993325,6cyclictest1963627-21fschecks_count11:35:161
1871073993325,6cyclictest1963627-21fschecks_count11:35:161
1871073993325,4cyclictest0-21swapper/108:55:181
1871073993324,6cyclictest0-21swapper/108:10:001
1871073993324,5cyclictest0-21swapper/110:40:271
187106999335,8cyclictest11-21ksoftirqd/007:55:140
1871069993323,4cyclictest131rcu_preempt09:20:240
187108299321,9cyclictest1944768-21memory10:40:203
187106999328,4cyclictest18802742ls07:35:010
187106999324,10cyclictest11-21ksoftirqd/008:10:120
1871069993225,5cyclictest1880362-21kworker/u8:0+events_unbound08:35:340
1871069993224,6cyclictest1914425-21kworker/u8:0+events_unbound09:45:540
1871069993224,6cyclictest1914425-21kworker/u8:0+events_unbound09:45:540
1871069993224,4cyclictest1921709-21idleruntime-cro09:35:010
1871069993224,4cyclictest0-21swapper/011:15:220
1871069993219,5cyclictest1869209-21kworker/u8:3+events_unbound08:27:290
1871073993123,6cyclictest1944059-21cron10:40:001
1871073993123,4cyclictest0-21swapper/109:40:161
1871073993118,9cyclictest204-21dbus-daemon09:35:511
1871069993123,5cyclictest0-21swapper/010:50:160
1871069993120,7cyclictest0-21swapper/007:50:000
187106999311,21cyclictest11-21ksoftirqd/012:15:000
1871069993112,12cyclictest11-21ksoftirqd/010:00:210
1871073993023,4cyclictest0-21swapper/112:05:241
1871073993023,4cyclictest0-21swapper/109:00:251
1871073993022,4cyclictest0-21swapper/112:30:231
1871073993022,4cyclictest0-21swapper/112:30:231
1871073993021,5cyclictest0-21swapper/111:30:241
1871073993020,6cyclictest0-21swapper/108:25:171
187106999308,14cyclictest11-21ksoftirqd/011:40:200
187106999308,14cyclictest11-21ksoftirqd/011:40:200
1871069993021,7cyclictest121ktimers/011:55:140
1871069993021,5cyclictest1909946-21grep09:00:160
1871069993018,4cyclictest131rcu_preempt08:55:010
1871073992922,4cyclictest0-21swapper/108:20:271
1871073992921,4cyclictest0-21swapper/110:15:261
1871073992918,7cyclictest1901010-21sh08:35:001
1871073992918,7cyclictest0-21swapper/107:55:001
1871073992918,7cyclictest0-21swapper/107:55:001
1871073992917,9cyclictest231ktimers/111:25:121
187106999299,13cyclictest11-21ksoftirqd/007:15:030
1871069992923,3cyclictest0-21swapper/008:40:250
1871069992921,6cyclictest1921935-21kworker/u8:2+events_unbound09:41:080
1871073992820,4cyclictest0-21swapper/112:20:151
187106999289,3cyclictest1878222-21kworker/u8:2+events_freezable_power_07:42:450
187106999288,4cyclictest131rcu_preempt07:10:360
187106999285,14cyclictest1964506-21unixbench_multi11:35:260
187106999285,14cyclictest1964506-21unixbench_multi11:35:260
1871069992824,2cyclictest0-21swapper/010:30:130
1871069992822,4cyclictest1968596-21kworker/u8:0+events_unbound12:26:200
1871069992820,4cyclictest0-21swapper/009:10:010
1871069992819,4cyclictest0-21swapper/010:56:040
1871073992721,4cyclictest1869209-21kworker/u8:3+events_unbound09:30:521
1871073992719,5cyclictest1880362-21kworker/u8:0+events_unbound07:40:121
1871073992718,6cyclictest1929143-21grep09:55:171
1871073992718,5cyclictest1978840-21sendmail-msp12:20:001
1871073992716,8cyclictest0-21swapper/110:00:251
1871073992715,8cyclictest1902720-21sh08:40:001
187106999278,11cyclictest11-21ksoftirqd/011:25:010
187106999277,11cyclictest11-21ksoftirqd/012:35:260
1871069992723,2cyclictest0-21swapper/009:50:160
1871069992720,5cyclictest1928607-21kworker/u8:3+events_unbound10:05:180
1871069992720,5cyclictest1880362-21kworker/u8:0+events_unbound08:15:050
1871069992720,4cyclictest13850irq/36-mmc110:40:000
1871069992719,6cyclictest1947357-21kworker/u8:0+events_unbound11:04:110
1871069992716,4cyclictest131rcu_preempt11:45:160
1871073992619,4cyclictest0-21swapper/107:10:391
1871073992618,4cyclictest0-21swapper/111:46:111
1871073992617,6cyclictest0-21swapper/112:00:151
187106999269,6cyclictest11-21ksoftirqd/009:55:170
1871069992612,11cyclictest1905226-21ntpq08:45:220
1871069992612,11cyclictest1905226-21ntpq08:45:220
187106999261,12cyclictest0-21swapper/007:39:140
1871073992519,4cyclictest231ktimers/111:05:011
1871073992517,4cyclictest0-21swapper/111:00:001
1871073992517,4cyclictest0-21swapper/109:20:261
1871073992517,4cyclictest0-21swapper/109:20:011
1871073992513,8cyclictest1985791-21grep12:40:001
187106999259,6cyclictest11-21ksoftirqd/008:30:160
187106999258,5cyclictest131rcu_preempt11:55:000
187106999257,10cyclictest11-21ksoftirqd/010:25:220
187106999252,7cyclictest11-21ksoftirqd/008:00:150
1871073992417,4cyclictest1958599-21fschecks_time11:20:181
1871073992412,4cyclictest1921935-21kworker/u8:2+events_unbound10:07:411
187106999249,6cyclictest11-21ksoftirqd/011:15:000
187106999244,11cyclictest131rcu_preempt08:10:000
1871069992418,4cyclictest1908428-21kworker/u8:1+events_unbound08:58:130
1871069992413,3cyclictest131rcu_preempt07:55:010
1871069992413,3cyclictest131rcu_preempt07:55:010
1871073992317,3cyclictest0-21swapper/109:45:211
1871073992317,3cyclictest0-21swapper/109:45:201
1871073992315,5cyclictest1958139-21munin-plugin-st11:20:001
1871073992315,4cyclictest0-21swapper/111:55:001
1871073992314,6cyclictest0-21swapper/108:15:261
1871073992216,3cyclictest0-21swapper/112:30:001
1871073992216,3cyclictest0-21swapper/108:50:231
1871073992215,4cyclictest1977110-21idleruntime-cro12:15:001
1871073992215,4cyclictest1906273-21latency_hist08:50:011
1871073992215,4cyclictest1906273-21latency_hist08:50:011
1871073992115,3cyclictest0-21swapper/109:55:001
187107399202,13cyclictest1885242-21cron07:50:001
1871073992014,3cyclictest0-21swapper/110:55:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional