You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 21:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Aug 29, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1847480996537,7cyclictest391ktimers/311:45:123
1847472995622,15cyclictest0-21swapper/207:15:012
184747299531,35cyclictest1900374-21df09:40:122
184747299493,29cyclictest1876491-21awk08:30:212
1847480994839,6cyclictest1904660-21unixbench_multi09:50:263
1847480994837,7cyclictest1913684-21sendmail10:20:003
184747299486,27cyclictest1877813-21/usr/sbin/munin08:35:172
1847472994827,17cyclictest0-21swapper/211:40:002
184747299471,41cyclictest1923280-21/usr/sbin/munin10:45:252
1847472994710,20cyclictest1956744-21latency_hist12:25:002
1847466994739,4cyclictest1934430-21latency_hist11:20:011
184747299451,37cyclictest1879378-21apt-get08:40:152
1847480994437,4cyclictest1868905-21munin-plugin-st08:10:003
184747299443,36cyclictest1872542-21sshd08:20:072
184747299441,40cyclictest1959115-21/usr/sbin/munin12:30:202
184747299441,40cyclictest1959115-21/usr/sbin/munin12:30:192
184747299441,27cyclictest1868013-21ntpq08:05:232
1847465994436,4cyclictest1888912-21unixbench_multi09:05:270
1847465994433,8cyclictest151rcuc/011:55:120
1847472994318,21cyclictest0-21swapper/208:10:162
184747299431,37cyclictest1944936-21/usr/sbin/munin11:50:142
184747299431,37cyclictest1910608-21diskstats10:10:142
184747299431,35cyclictest1898555-21apt-get09:35:142
1847466994331,9cyclictest1896169-21grep09:25:261
1847465994235,4cyclictest1934128-21apt-get11:20:010
184746599421,14cyclictest11-21ksoftirqd/008:55:120
1847472994134,4cyclictest1937770-21munin-plugin-st11:30:002
184747299411,37cyclictest1960982-21/usr/sbin/munin12:35:242
184747299411,37cyclictest1882963-21fschecks_time08:50:182
184747299411,37cyclictest1860614-21/usr/sbin/munin07:45:262
184747299411,35cyclictest1948988-21/usr/sbin/munin12:00:232
184747299411,34cyclictest1929258-21apt-get11:05:122
184747299411,34cyclictest1887900-21apt-get09:05:132
184747299410,32cyclictest0-21swapper/210:35:162
1847466994131,7cyclictest1890853-21grep09:10:261
1847465994133,5cyclictest1884234-21cron08:55:010
1847465994132,5cyclictest53-21kcompactd007:45:260
1847472994018,17cyclictest0-21swapper/210:50:162
184747299401,36cyclictest1916222-21/usr/sbin/munin10:25:242
184747299401,36cyclictest1914365-21meminfo10:20:202
184747299401,36cyclictest1895361-21/usr/sbin/munin09:25:162
184747299401,34cyclictest1933383-21/usr/sbin/munin11:15:252
184747299401,34cyclictest1874817-21ntp_states08:25:242
184747299400,37cyclictest1932070-21sshd11:10:522
184747299400,36cyclictest1862302-21sshd07:50:092
1847466994031,6cyclictest1851636-21idleruntime-cro07:20:001
1847465994030,7cyclictest1940732-21unixbench_singl11:35:260
1847472993927,8cyclictest1929019-21sh11:05:012
184747299392,32cyclictest1949942-21apt-get12:05:122
184747299391,35cyclictest1943641-21/usr/sbin/munin11:45:202
184747299391,35cyclictest1906217-21/usr/sbin/munin09:55:252
184747299391,34cyclictest1909644-21cat10:05:272
184747299391,34cyclictest1855491-21/usr/sbin/munin07:30:172
184747299391,33cyclictest1941418-21apt-get11:40:122
184747299391,33cyclictest1912644-21memory10:15:212
184747299391,33cyclictest1908706-21latency_hist10:05:012
184747299390,36cyclictest1889814-21apt-get09:10:132
184746599395,8cyclictest11-21ksoftirqd/011:50:120
1847465993933,4cyclictest1918628-21kworker/u8:3+events_unbound11:25:570
184747299383,30cyclictest1925956-21diskstats10:55:152
1847472993828,7cyclictest1858463-21sendmail07:40:002
184747299382,33cyclictest1872127-21cron08:18:002
184747299381,35cyclictest53-21kcompactd012:27:132
184747299381,34cyclictest1952127-21if_err_eth112:10:162
184747299381,34cyclictest1947638-21sshd11:55:572
184747299381,34cyclictest1921867-21cron10:41:012
184747299381,34cyclictest1918037-21/usr/sbin/munin10:30:242
184747299381,34cyclictest1918037-21/usr/sbin/munin10:30:232
184747299381,34cyclictest1897370-21/usr/sbin/munin09:30:192
184747299381,34cyclictest1859154-21meminfo07:40:212
184747299381,34cyclictest1852172-21/usr/sbin/munin07:20:192
184747299381,34cyclictest1850500-21/usr/sbin/munin07:15:182
184747299381,33cyclictest1853703-21/usr/sbin/munin07:25:172
184747299381,33cyclictest1853703-21/usr/sbin/munin07:25:162
184747299381,32cyclictest1953663-21df_inode12:15:152
184747299381,32cyclictest1934128-21apt-get11:20:052
184747299381,32cyclictest1904395-21/usr/sbin/munin09:50:242
184747299381,32cyclictest1864466-21/usr/sbin/munin07:55:202
1847472993812,23cyclictest204-21dbus-daemon08:00:162
1847465993830,6cyclictest1831759-21kworker/u8:2+events_unbound07:26:420
1847465993830,6cyclictest1831759-21kworker/u8:2+events_unbound07:26:420
1847480993722,11cyclictest391ktimers/312:05:113
184747299371,33cyclictest1891717-21sshd09:15:082
184747299371,33cyclictest1887222-21/usr/sbin/munin09:00:262
1847466993726,7cyclictest1865005-21tail07:55:251
1847465993731,4cyclictest1901689-21kworker/u8:2+events_unbound09:45:390
1847465993715,6cyclictest131rcu_preempt07:40:060
1847480993629,4cyclictest1849382-21munin-node07:15:013
1847480993627,5cyclictest1872323-21sendmail08:20:013
184747299362,29cyclictest1884480-21apt-get08:55:132
184747299361,32cyclictest1893968-21/usr/sbin/munin09:20:192
184747299361,32cyclictest1881204-21/usr/sbin/munin08:45:162
1847465993628,6cyclictest1908176-21kworker/u8:1+events_unbound10:00:420
1847480993527,5cyclictest1874016-21apt08:25:003
1847480993527,4cyclictest0-21swapper/309:40:143
1847480993522,9cyclictest0-21swapper/311:20:003
1847480993522,8cyclictest391ktimers/308:10:133
184747299351,31cyclictest1938446-21missed_timers11:30:212
1847466993528,4cyclictest0-21swapper/109:50:001
1847466993524,8cyclictest231ktimers/109:30:111
1847466993524,7cyclictest1942462-21grep11:40:261
1847466993522,9cyclictest231ktimers/107:35:131
1847465993528,5cyclictest1949520-21kworker/u8:2+events_unbound12:06:010
1847465993528,4cyclictest1955900-21proc_pri12:20:230
1847480993425,5cyclictest1884618-21fschecks_count08:55:163
1847465993427,5cyclictest1898229-21kworker/u8:0+events_unbound09:35:380
1847465993422,8cyclictest1887210-21grep09:00:260
1847465993416,9cyclictest131rcu_preempt10:55:160
184746599341,14cyclictest11-21ksoftirqd/010:05:130
1847466993322,7cyclictest0-21swapper/111:40:001
1847465993327,4cyclictest1930732-21munin-plugin-st11:10:000
1847465993322,7cyclictest1916617-21grep10:25:270
1847465993313,12cyclictest131rcu_preempt08:10:260
1847480993223,5cyclictest0-21swapper/309:30:013
1847466993224,4cyclictest0-21swapper/109:50:181
1847466993224,4cyclictest0-21swapper/109:10:011
1847466993221,7cyclictest0-21swapper/108:40:261
1847465993226,4cyclictest1865183-21kworker/u8:0+events_unbound08:35:300
1847465993223,7cyclictest1898229-21kworker/u8:0+events_unbound09:50:390
1847465993223,5cyclictest0-21swapper/008:05:260
1847466993124,4cyclictest0-21swapper/110:25:261
1847466993123,4cyclictest0-21swapper/111:05:261
1847466993122,4cyclictest0-21swapper/111:15:011
1847466993120,7cyclictest1856326-21grep07:30:251
184746599319,13cyclictest11-21ksoftirqd/012:30:210
184746599319,13cyclictest11-21ksoftirqd/012:30:210
1847465993120,8cyclictest151rcuc/012:15:120
1847465993110,11cyclictest0-21swapper/007:38:110
1847480993024,3cyclictest0-21swapper/311:20:263
1847480993024,3cyclictest0-21swapper/307:20:273
1847480993017,9cyclictest1849565-21gpgv07:15:023
1847466993021,5cyclictest0-21swapper/112:05:001
1847466993020,7cyclictest1894512-21grep09:20:241
1847465993022,5cyclictest0-21swapper/009:20:000
1847465993022,4cyclictest0-21swapper/007:35:000
1847465993021,6cyclictest1923899-21sh10:50:010
1847465993021,6cyclictest0-21swapper/007:15:010
184746599301,9cyclictest11-21ksoftirqd/010:15:130
1847465993019,5cyclictest131rcu_preempt10:45:000
1847465993018,8cyclictest204-21dbus-daemon09:30:380
184746599300,16cyclictest1901732-21cron09:45:000
1847480992919,7cyclictest1865941-21tune2fs08:00:173
184746699295,4cyclictest19063172cat09:55:251
1847466992923,4cyclictest1937446-21kworker/u8:0+events_unbound11:30:571
1847466992922,3cyclictest0-21swapper/112:40:011
184746599293,4cyclictest0-21swapper/012:35:140
1847465992923,4cyclictest1939086-21kworker/u8:2+events_unbound11:44:400
1847465992921,4cyclictest0-21swapper/011:20:260
1847465992921,4cyclictest0-21swapper/009:30:010
1847465992919,7cyclictest438-21cron10:00:000
184746599290,16cyclictest1853337-21cron07:25:010
1847480992822,3cyclictest1894433-21grep09:20:243
1847480992820,4cyclictest1875718-21sh08:30:003
1847480992819,4cyclictest0-21swapper/310:20:423
1847480992818,6cyclictest0-21swapper/309:20:003
1847466992819,5cyclictest0-21swapper/109:35:371
184746599289,12cyclictest131rcu_preempt10:50:180
184746599289,12cyclictest131rcu_preempt10:30:220
184746599289,12cyclictest131rcu_preempt10:30:220
184746599288,12cyclictest11-21ksoftirqd/009:25:010
184746599282,4cyclictest1944577-21cron11:50:000
1847465992814,12cyclictest1939086-21kworker/u8:2-flush-179:9611:30:470
1847465992811,7cyclictest11-21ksoftirqd/008:05:010
1847465992810,7cyclictest11-21ksoftirqd/011:00:240
1847480992717,5cyclictest0-21swapper/308:30:163
184746599279,5cyclictest131rcu_preempt07:55:150
184746599272,15cyclictest0-21swapper/010:36:250
1847480992620,3cyclictest0-21swapper/307:40:003
1847480992619,4cyclictest0-21swapper/312:10:183
1847480992618,4cyclictest0-21swapper/309:15:023
1847480992618,4cyclictest0-21swapper/309:00:173
1847480992618,4cyclictest0-21swapper/307:40:273
1847480992617,6cyclictest0-21swapper/310:35:283
1847480992617,5cyclictest0-21swapper/311:00:013
1847480992616,7cyclictest1946723-21tune2fs11:55:163
1847480992615,9cyclictest1889603-21sed09:10:013
1847466992619,4cyclictest0-21swapper/112:10:001
1847466992618,5cyclictest1908554-21sh10:05:001
184746599269,6cyclictest11-21ksoftirqd/012:10:240
184746599268,4cyclictest131rcu_preempt08:20:120
184746599268,11cyclictest131rcu_preempt08:15:150
184746599267,10cyclictest0-21swapper/008:28:160
184746599266,13cyclictest11-21ksoftirqd/012:00:140
1847465992619,4cyclictest0-21swapper/010:10:240
1847465992617,7cyclictest1856362-21kworker/u8:1+events_unbound07:50:140
184746599260,8cyclictest11-21ksoftirqd/008:40:150
1847480992519,3cyclictest0-21swapper/309:30:243
1847480992519,3cyclictest0-21swapper/308:35:273
1847480992518,4cyclictest1958444-21kthreadd12:30:003
1847480992517,5cyclictest1908176-21kworker/u8:1+events_unbound10:05:423
1847480992516,6cyclictest1928181-21ps11:00:233
1847480992515,6cyclictest0-21swapper/311:10:003
1847480992514,7cyclictest0-21swapper/311:15:003
184746699259,6cyclictest1919231-21fschecks_time10:35:181
1847466992519,3cyclictest0-21swapper/108:55:201
1847466992517,5cyclictest0-21swapper/111:55:261
1847466992515,8cyclictest1925213-21users10:50:261
1847466992514,8cyclictest1953663-21df_inode12:15:151
184746599258,11cyclictest131rcu_preempt10:20:240
1847465992518,5cyclictest1878977-21kworker/u8:2+events_unbound08:45:130
1847480992417,3cyclictest0-21swapper/310:45:003
1847480992416,5cyclictest0-21swapper/309:55:173
1847480992415,5cyclictest0-21swapper/307:55:173
1847480992415,4cyclictest0-21swapper/309:35:193
1847466992418,4cyclictest0-21swapper/107:40:271
1847466992418,3cyclictest1913665-21kthreadd10:20:011
1847466992418,3cyclictest0-21swapper/107:15:001
1847466992416,5cyclictest1915373-21cron10:25:011
1847466992416,5cyclictest0-21swapper/111:20:151
1847466992413,7cyclictest0-21swapper/111:50:241
184746599246,11cyclictest131rcu_preempt09:10:200
1847465992418,4cyclictest1865183-21kworker/u8:0+events_unbound08:31:150
184746599241,12cyclictest0-21swapper/012:25:250
1847480992316,5cyclictest1937446-21kworker/u8:0+events_unbound11:27:233
1847480992316,4cyclictest0-21swapper/311:35:263
1847480992316,3cyclictest0-21swapper/308:50:183
1847480992315,5cyclictest391ktimers/307:25:223
1847480992315,5cyclictest391ktimers/307:25:213
1847480992313,6cyclictest1960129-21cron12:35:003
1847480992313,6cyclictest1960129-21cron12:35:003
1847466992316,5cyclictest1943351-21fschecks_time11:45:161
1847466992316,4cyclictest1927299-21cron11:00:001
1847466992316,4cyclictest1882330-21kworker/u8:0+events_unbound08:52:181
1847466992316,4cyclictest1875248-21tail08:25:271
1847466992316,4cyclictest0-21swapper/112:25:261
1847480992217,3cyclictest0-21swapper/312:15:263
1847480992216,3cyclictest0-21swapper/312:35:173
1847480992216,3cyclictest0-21swapper/310:50:173
1847480992216,3cyclictest0-21swapper/310:45:233
1847480992216,3cyclictest0-21swapper/310:00:253
1847480992214,4cyclictest0-21swapper/311:50:253
1847480992214,4cyclictest0-21swapper/308:40:273
184746699225,4cyclictest131rcu_preempt07:55:011
184746699222,5cyclictest131rcu_preempt10:30:251
184746699222,5cyclictest131rcu_preempt10:30:251
1847466992215,5cyclictest1858127-21kworker/u8:0+events_unbound07:45:071
1847466992215,4cyclictest0-21swapper/108:05:181
1847466992214,5cyclictest1870129-21grep08:10:251
1847466992214,4cyclictest0-21swapper/108:40:001
1847466992213,6cyclictest0-21swapper/109:15:261
1847466992212,7cyclictest1936855-21ntpq11:25:201
184748099217,3cyclictest131rcu_preempt10:30:143
184748099217,3cyclictest131rcu_preempt10:30:133
1847480992114,4cyclictest1949237-21tail12:00:233
1847480992112,6cyclictest1942243-21cat11:40:243
184748099210,19cyclictest0-21swapper/310:25:143
184746699211,7cyclictest1882074-21sed08:45:261
1847466992116,3cyclictest1901802-21latency_hist09:45:011
1847466992115,3cyclictest0-21swapper/110:45:271
1847466992115,3cyclictest0-21swapper/109:00:261
1847466992114,4cyclictest1959674-21tail12:30:261
1847466992114,4cyclictest1959674-21tail12:30:251
1847466992114,4cyclictest1854138-21ntp_offset07:25:221
1847466992114,4cyclictest1854138-21ntp_offset07:25:221
1847466992113,6cyclictest231ktimers/112:10:121
1847466992113,5cyclictest1871827-21tail08:15:241
1847466992111,7cyclictest0-21swapper/107:20:191
1847480992015,3cyclictest1881076-21/usr/sbin/munin08:45:263
1847480992014,4cyclictest1863320-21grep07:50:263
184748099200,18cyclictest0-21swapper/307:45:113
1847466992014,4cyclictest231ktimers/110:14:451
1847466992014,4cyclictest1865935-21fschecks_time08:00:171
1847466992012,5cyclictest0-21swapper/108:30:261
184748099199,8cyclictest1938498-21sed11:30:203
1847480991914,3cyclictest1956568-21sh12:23:013
1847480991912,5cyclictest391ktimers/307:30:233
1847480991912,4cyclictest1903441-21idleruntime-cro09:50:003
1847466991914,3cyclictest1920851-21/usr/sbin/munin10:40:161
1847466991913,3cyclictest1927556-21/usr/sbin/munin11:00:161
1847466991911,6cyclictest0-21swapper/110:05:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional