You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 22:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Fri Jun 05, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1957125995425,25cyclictest1961292-21sendmail07:20:010
1957132995037,10cyclictest311ktimers/207:40:122
195712599471,36cyclictest0-21swapper/009:50:110
195712599461,40cyclictest0-21swapper/010:25:110
195712599461,36cyclictest0-21swapper/011:25:120
195712599461,34cyclictest0-21swapper/010:00:120
195712599451,41cyclictest1985398-21apt-get08:30:110
195712599451,39cyclictest2061210-21/usr/sbin/munin12:10:140
195712599451,39cyclictest1968469-21/usr/sbin/munin07:40:160
1957127994430,9cyclictest231ktimers/107:40:121
1957125994436,4cyclictest1958822-21apt-config07:15:010
1957125994423,16cyclictest0-21swapper/010:55:260
1957125994417,23cyclictest0-21swapper/007:30:170
195712599441,40cyclictest2015679-21awk09:55:250
195712599441,40cyclictest1982322-21/usr/sbin/munin08:20:170
1957127994330,9cyclictest231ktimers/110:45:111
195712599432,25cyclictest2019485-21cron10:09:590
195712599432,25cyclictest2019485-21cron10:09:590
1957125994319,22cyclictest0-21swapper/009:25:140
195712599431,39cyclictest2050302-21cron11:39:010
195712599431,29cyclictest2068448-21diskstats12:30:140
1957125994226,13cyclictest2068145-21latency_hist12:30:010
1957125994222,15cyclictest0-21swapper/010:20:250
195712599421,38cyclictest1974202-21/usr/sbin/munin07:55:240
195712599421,38cyclictest1974202-21/usr/sbin/munin07:55:230
195712599421,36cyclictest1993921-21apt-get08:55:110
195712599420,40cyclictest0-21swapper/010:30:210
1957127994129,8cyclictest231ktimers/111:35:121
195712599413,33cyclictest2028588-21/usr/sbin/munin10:35:180
195712599412,33cyclictest2033374-21apt-get10:50:120
195712599411,37cyclictest2003403-21/usr/sbin/munin09:20:230
195712599411,37cyclictest1971888-21fschecks_count07:50:160
195712599411,35cyclictest2030077-21/usr/sbin/munin10:40:120
195712599411,31cyclictest0-21swapper/011:20:110
195712599411,25cyclictest2002395-21apt-key09:20:010
195712599411,25cyclictest2002395-21apt-key09:20:000
195712599410,37cyclictest0-21swapper/011:05:110
195712599410,36cyclictest1988941-21diskstats08:40:160
195712599410,36cyclictest0-21swapper/012:05:130
1957132994011,5cyclictest131rcu_preempt11:05:122
1957127994027,11cyclictest231ktimers/108:05:121
195712599401,36cyclictest2012142-21/usr/sbin/munin09:45:250
195712599401,36cyclictest1978859-21/usr/sbin/munin08:10:170
195712599401,35cyclictest2006079-21apt09:30:090
195712599401,34cyclictest2070084-21grep12:35:130
195712599401,34cyclictest1999137-21/usr/sbin/munin09:10:120
195712599401,34cyclictest1999137-21/usr/sbin/munin09:10:110
195712599401,34cyclictest1980397-21/usr/sbin/munin08:15:150
195712599401,34cyclictest1966973-21/usr/sbin/munin07:35:210
195712599401,33cyclictest2031672-21apt-get10:45:110
195712599400,32cyclictest0-21swapper/012:00:100
1957132993933,4cyclictest1992216-21kworker/u8:1+events_unbound08:53:522
1957127993927,8cyclictest1958903-21ls07:15:011
195712599392,33cyclictest2019836-21/usr/sbin/munin10:10:120
195712599391,35cyclictest2051257-21/usr/sbin/munin11:40:210
195712599391,35cyclictest2022796-21sshd10:18:570
195712599391,35cyclictest1992527-21/usr/sbin/munin08:50:160
195712599391,35cyclictest1990631-21df08:45:140
195712599391,35cyclictest1970358-21/usr/sbin/munin07:45:190
195712599391,34cyclictest2064995-21/usr/sbin/munin12:20:150
195712599391,33cyclictest2007783-21/usr/sbin/munin09:35:110
195712599391,33cyclictest1987218-21df_inode08:35:170
195712599391,32cyclictest0-21swapper/008:05:130
1957136993825,8cyclictest0-21swapper/308:20:013
1957127993830,4cyclictest0-21swapper/108:50:011
195712599386,29cyclictest395-21dbus-daemon11:45:020
195712599382,33cyclictest1961866-21/usr/sbin/munin07:20:190
195712599381,34cyclictest2063071-21if_eth012:15:140
195712599381,34cyclictest2048437-21cron11:32:000
195712599381,34cyclictest1995991-21grep09:00:160
195712599381,34cyclictest1984041-21/usr/sbin/munin08:25:190
195712599381,33cyclictest2041405-21grep11:10:250
195712599381,33cyclictest2036904-21/usr/sbin/munin11:00:130
195712599381,32cyclictest2010097-21/usr/sbin/munin09:40:210
195712599381,31cyclictest2054263-21apt-get11:50:110
195712599381,31cyclictest2054263-21apt-get11:50:100
195712599381,31cyclictest2042113-21runrttasks11:15:120
195712599380,34cyclictest0-21swapper/011:55:110
195712599380,34cyclictest0-21swapper/011:55:100
1957136993727,6cyclictest0-21swapper/308:15:013
1957136993726,7cyclictest2068097-21apt-key12:30:003
195712599371,33cyclictest1975509-21irqstats08:00:170
195712599371,33cyclictest1963534-21/usr/sbin/munin07:25:170
1957136993626,7cyclictest2054034-21idleruntime-cro11:50:003
1957136993625,7cyclictest1968135-21taskset07:40:013
1957132993626,7cyclictest2048231-21grep11:30:272
1957127993630,4cyclictest2065951-21kworker/u8:1+events_unbound12:29:121
1957127993611,4cyclictest2038464-21cp11:05:011
195712599360,33cyclictest1997347-21cpu09:05:130
1957136993522,11cyclictest391ktimers/310:55:133
1957132993527,4cyclictest0-21swapper/211:45:222
195713299352,5cyclictest131rcu_preempt08:25:132
1957132993523,8cyclictest0-21swapper/207:15:002
195712799354,5cyclictest131rcu_preempt09:45:121
1957127993526,5cyclictest0-21swapper/111:45:011
1957127993525,5cyclictest0-21swapper/110:20:151
1957136993428,4cyclictest2001076-21kworker/u8:1+events_unbound09:43:543
1957132993426,5cyclictest645-21runrttasks11:15:112
1957132993426,4cyclictest2069268-21timerwakeupswit12:30:232
1957132993424,6cyclictest2027595-21unixbench_singl10:30:252
1957127993426,4cyclictest0-21swapper/110:40:241
1957127993426,4cyclictest0-21swapper/107:15:011
1957136993325,5cyclictest2009254-21cron09:40:013
1957132993325,4cyclictest0-21swapper/211:40:142
1957132993325,4cyclictest0-21swapper/208:45:172
1957132993325,4cyclictest0-21swapper/207:30:252
1957132993323,7cyclictest2060424-21grep12:05:242
195712799338,4cyclictest131rcu_preempt12:35:111
195712799333,4cyclictest131rcu_preempt07:30:121
1957127993324,4cyclictest0-21swapper/111:20:241
1957127993323,6cyclictest0-21swapper/111:30:271
1957127993321,8cyclictest0-21swapper/108:55:241
1957136993225,4cyclictest0-21swapper/307:55:253
1957136993225,4cyclictest0-21swapper/307:55:253
1957136993224,4cyclictest0-21swapper/309:00:233
1957136993224,4cyclictest0-21swapper/307:15:013
1957136993223,5cyclictest2030962-21grep10:40:233
1957136993221,7cyclictest1971097-21grep07:45:283
195713299322,5cyclictest131rcu_preempt08:05:132
1957132993225,4cyclictest0-21swapper/208:00:012
1957132993225,4cyclictest0-21swapper/208:00:012
1957132993224,4cyclictest0-21swapper/209:25:272
1957132993224,4cyclictest0-21swapper/207:15:022
1957127993225,5cyclictest1979654-21kworker/u8:2+events_unbound08:13:491
1957127993221,7cyclictest1998389-21grep09:05:241
1957136993124,4cyclictest0-21swapper/310:50:263
1957132993124,4cyclictest2002240-21idleruntime-cro09:20:002
1957132993124,4cyclictest2002240-21idleruntime-cro09:19:592
1957132993124,3cyclictest0-21swapper/211:05:012
1957132993122,5cyclictest0-21swapper/207:40:002
1957127993125,4cyclictest2000534-21idleruntime-cro09:15:001
1957127993125,4cyclictest2000534-21idleruntime-cro09:14:591
1957127993121,7cyclictest1982984-21grep08:20:261
1957127993120,7cyclictest2010514-21grep09:40:241
1957136993023,4cyclictest0-21swapper/310:20:253
1957136993023,4cyclictest0-21swapper/307:50:293
195713699302,24cyclictest2064402-21grep12:20:013
1957136993019,7cyclictest0-21swapper/311:10:253
1957132993023,5cyclictest1976174-21unixbench_multi08:00:242
1957132993023,3cyclictest0-21swapper/207:30:012
1957132993022,4cyclictest0-21swapper/210:20:242
1957132993022,4cyclictest0-21swapper/208:20:012
1957127993024,4cyclictest1992216-21kworker/u8:1+events_unbound08:54:411
1957127993020,7cyclictest2002912-21tune2fs09:20:161
1957127993020,5cyclictest0-21swapper/108:25:211
1957127993018,8cyclictest231ktimers/109:00:111
1957136992921,5cyclictest2050863-21fschecks_time11:40:153
1957136992920,6cyclictest1998390-21grep09:05:253
1957127992921,5cyclictest1968123-21sendmail07:40:011
1957127992921,4cyclictest0-21swapper/111:25:141
1957127992921,4cyclictest0-21swapper/110:00:241
1957127992915,9cyclictest204-21dbus-daemon07:28:431
1957136992821,4cyclictest0-21swapper/308:05:173
1957136992820,4cyclictest0-21swapper/311:30:273
1957136992820,4cyclictest0-21swapper/310:05:163
1957136992820,4cyclictest0-21swapper/310:05:153
1957136992820,4cyclictest0-21swapper/307:25:173
1957132992821,4cyclictest2017794-21auditctl10:05:002
1957132992821,4cyclictest0-21swapper/207:50:292
1957132992821,3cyclictest0-21swapper/210:19:592
1957132992820,4cyclictest0-21swapper/212:25:142
1957132992820,4cyclictest0-21swapper/209:05:252
1957127992820,4cyclictest2028025-21cron10:35:001
1957136992720,3cyclictest0-21swapper/311:00:163
1957136992718,7cyclictest2032059-21latency10:45:173
1957136992717,8cyclictest2069813-21cut12:35:003
1957136992717,7cyclictest1959647-21ntp_offset07:15:043
1957132992720,5cyclictest145-21jbd2/mmcblk1p2-809:20:412
1957132992719,5cyclictest0-21swapper/212:25:012
1957132992719,5cyclictest0-21swapper/211:55:242
1957132992719,5cyclictest0-21swapper/211:55:242
1957132992717,7cyclictest2000513-21sh09:15:002
1957132992717,7cyclictest2000513-21sh09:15:002
1957132992717,5cyclictest2015623-21grep09:55:252
1957136992619,4cyclictest0-21swapper/310:25:253
1957136992618,4cyclictest0-21swapper/312:10:003
1957136992617,6cyclictest0-21swapper/310:05:013
1957136992614,8cyclictest1995429-21basename09:00:013
1957136992612,10cyclictest391ktimers/311:20:113
1957132992620,3cyclictest0-21swapper/210:25:182
1957132992620,3cyclictest0-21swapper/209:55:002
1957132992619,4cyclictest2029495-21kworker/u8:0+events_unbound10:55:232
1957132992619,4cyclictest1988142-21grep08:35:262
1957132992617,6cyclictest2029245-21grep10:35:272
1957132992616,6cyclictest2044834-21grep11:20:242
1957132992616,6cyclictest0-21swapper/212:20:012
195713299261,14cyclictest0-21swapper/211:39:012
195712799265,3cyclictest131rcu_preempt08:20:011
1957127992619,5cyclictest2019182-21kworker/u8:2+events_unbound10:08:571
1957127992619,5cyclictest2019182-21kworker/u8:2+events_unbound10:08:571
1957127992618,4cyclictest0-21swapper/107:45:171
1957127992617,6cyclictest19734502sleep107:55:131
1957127992617,6cyclictest19734502sleep107:55:131
195712799261,11cyclictest0-21swapper/108:37:011
1957136992518,4cyclictest2057439-21sendmail11:59:593
1957136992518,4cyclictest2057439-21sendmail11:59:593
1957136992518,4cyclictest0-21swapper/309:19:593
1957136992518,4cyclictest0-21swapper/309:19:593
1957136992517,5cyclictest438-21cron07:35:003
1957136992517,4cyclictest0-21swapper/311:15:183
1957136992517,4cyclictest0-21swapper/308:45:273
1957136992514,8cyclictest2015142-21ntpq09:55:203
1957132992519,3cyclictest0-21swapper/212:10:242
1957132992519,3cyclictest0-21swapper/211:10:242
1957132992517,4cyclictest0-21swapper/212:35:122
195712799254,4cyclictest131rcu_preempt12:10:101
1957127992518,5cyclictest2058787-21kworker/u8:0+events_unbound12:02:071
1957127992518,4cyclictest0-21swapper/111:15:141
1957127992518,4cyclictest0-21swapper/110:50:261
1957127992517,5cyclictest2041441-21unixbench_singl11:10:251
1957127992515,7cyclictest2064278-21sendmail12:20:001
195712799251,4cyclictest131rcu_preempt09:50:111
1957127992514,8cyclictest438-21cron11:49:591
195712799251,3cyclictest0-21swapper/112:22:031
1957136992417,4cyclictest0-21swapper/310:30:253
1957136992417,4cyclictest0-21swapper/310:10:213
1957136992416,5cyclictest0-21swapper/308:40:013
1957136992416,4cyclictest0-21swapper/311:05:253
1957136992415,6cyclictest2013058-21grep09:50:143
1957136992415,5cyclictest0-21swapper/308:20:153
1957136992414,6cyclictest0-21swapper/309:25:253
1957132992417,4cyclictest2045256-21kworker/u8:2+events_unbound12:04:592
1957132992416,4cyclictest438-21cron09:50:002
195713299241,5cyclictest131rcu_preempt09:40:122
195713299241,5cyclictest0-21swapper/210:55:002
1957132992415,5cyclictest0-21swapper/210:50:012
1957132992414,7cyclictest1990173-21seq08:43:482
1957132992413,7cyclictest1995415-21sendmail09:00:012
195713299241,20cyclictest1979094-21ntp_kernel_err08:10:202
195712799248,6cyclictest24-21ksoftirqd/109:25:231
195712799248,5cyclictest24-21ksoftirqd/110:10:121
1957127992416,5cyclictest2054422-21fschecks_count11:50:151
1957127992416,5cyclictest2054422-21fschecks_count11:50:141
1957127992415,5cyclictest0-21swapper/111:05:261
195712799241,20cyclictest2008577-21cat09:35:251
1957136992316,4cyclictest0-21swapper/312:20:233
1957136992312,9cyclictest1961975-21memory07:20:213
1957136992310,9cyclictest2029733-21run-parts10:40:013
1957132992317,3cyclictest0-21swapper/209:35:172
1957132992314,6cyclictest0-21swapper/208:20:212
1957132992314,5cyclictest1954008-21kworker/2:1-events10:40:222
195713299231,3cyclictest2054442-21grep11:50:152
195713299231,3cyclictest2054442-21grep11:50:152
1957132992313,7cyclictest2019486-21cron10:10:002
1957132992313,7cyclictest2019486-21cron10:10:002
1957127992317,4cyclictest1998678-21kworker/u8:2+events_unbound09:15:251
1957127992317,4cyclictest1998678-21kworker/u8:2+events_unbound09:15:251
195712799231,4cyclictest0-21swapper/108:40:151
1957127992313,6cyclictest0-21swapper/110:40:011
1957127992313,6cyclictest0-21swapper/108:00:251
195712799231,13cyclictest0-21swapper/110:58:091
1957127992310,6cyclictest24-21ksoftirqd/112:05:201
1957136992216,3cyclictest0-21swapper/312:35:253
1957136992216,3cyclictest0-21swapper/309:30:173
1957136992214,5cyclictest145-21jbd2/mmcblk1p2-807:40:233
1957136992212,7cyclictest1992331-21df08:50:133
1957136992211,8cyclictest0-21swapper/308:25:153
1957132992216,4cyclictest145-21jbd2/mmcblk1p2-807:20:072
1957132992215,4cyclictest438-21cron09:05:002
1957132992212,5cyclictest2020908-21seq10:11:422
195713299221,13cyclictest0-21swapper/209:30:102
195712799223,4cyclictest131rcu_preempt11:55:111
195712799223,4cyclictest131rcu_preempt11:55:111
195712799221,4cyclictest131rcu_preempt10:25:101
1957136992115,3cyclictest0-21swapper/311:35:223
1957136992114,4cyclictest2061242-21fschecks_count12:10:153
1957136992112,6cyclictest2004309-21cat09:25:023
1957136992111,7cyclictest2012778-21wc09:50:013
1957136992111,7cyclictest0-21swapper/312:00:243
195713299212,3cyclictest131rcu_preempt08:30:232
1957132992113,6cyclictest311ktimers/207:45:172
1957132992113,6cyclictest2039961-21kworker/u8:1+events_unbound11:28:512
195712799219,5cyclictest24-21ksoftirqd/112:30:211
195712799214,6cyclictest24-21ksoftirqd/110:15:111
195712799211,13cyclictest0-21swapper/108:31:141
195713699204,3cyclictest131rcu_preempt11:25:163
1957136992014,3cyclictest0-21swapper/311:50:223
1957136992014,3cyclictest0-21swapper/311:50:223
1957136992011,6cyclictest0-21swapper/309:10:143
1957136992011,6cyclictest0-21swapper/309:10:143
1957136992011,5cyclictest2022439-21unixbench_multi10:15:243
195713699199,7cyclictest1985790-21sed08:30:183
1957136991913,3cyclictest645-21runrttasks08:40:123
1957136991811,5cyclictest391ktimers/308:00:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional