You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 11:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Jul 18, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1991487995341,8cyclictest2022914-21cron20:40:013
1991487994942,4cyclictest2098853-21sendmail00:20:003
1991482994937,7cyclictest2096659-21grep00:10:242
1991482994918,27cyclictest2018859-21sort20:25:252
199148299480,40cyclictest0-21swapper/222:35:122
1991477994734,9cyclictest231ktimers/119:45:131
1991477994734,9cyclictest231ktimers/119:45:121
1991482994625,15cyclictest1992619-21grep19:10:252
1991473994636,6cyclictest2103970-21sh00:35:000
1991482994534,6cyclictest0-21swapper/221:36:482
1991473994535,7cyclictest2015686-21grep20:15:270
199148299442,39cyclictest2098041-21/usr/sbin/munin00:15:242
199148299441,38cyclictest2093957-21apt-get00:05:122
1991487994333,7cyclictest0-21swapper/300:24:593
1991487994333,7cyclictest0-21swapper/300:24:593
1991487994330,8cyclictest0-21swapper/320:40:273
199148299433,35cyclictest2026570-21munin-node20:50:132
199148299431,39cyclictest2080122-21/usr/sbin/munin23:25:182
199148299431,35cyclictest0-21swapper/223:05:112
1991482994233,5cyclictest2016973-21proc_pri20:20:232
199148299420,32cyclictest0-21swapper/219:40:112
1991487994131,7cyclictest2055130-21unixbench_singl22:10:263
1991487994130,8cyclictest2088392-21idleruntime-cro23:50:013
1991482994134,4cyclictest2058977-21cron22:25:002
199148299413,33cyclictest2099088-21apt-get00:20:132
199148299413,33cyclictest2099088-21apt-get00:20:122
1991482994132,5cyclictest2006943-21unixbench_singl19:50:262
1991482994116,21cyclictest0-21swapper/223:45:152
199148299411,37cyclictest2090530-21apt-get23:55:112
199148299411,37cyclictest2033934-21/usr/sbin/munin21:10:182
199148299411,37cyclictest2015138-21/usr/sbin/munin20:15:212
199148299411,37cyclictest2007586-21/usr/sbin/munin19:55:132
199148299411,35cyclictest2068452-21/usr/sbin/munin22:50:242
199148299411,31cyclictest0-21swapper/220:30:112
199148299401,36cyclictest2072779-21sshd23:04:292
199148299401,36cyclictest2041119-21/usr/sbin/munin21:30:232
199148299401,36cyclictest2004706-21/usr/sbin/munin19:45:202
199148299401,36cyclictest2004706-21/usr/sbin/munin19:45:202
199148299401,35cyclictest2023278-21df_inode20:40:142
199148299401,34cyclictest2102622-21diskstats00:30:132
199148299401,34cyclictest2081584-21/usr/sbin/munin23:30:112
199148299401,34cyclictest2078521-21/usr/sbin/munin23:20:182
199148299401,34cyclictest2061239-21/usr/sbin/munin22:30:172
199148299401,34cyclictest2045558-21apt-get21:45:122
199148299401,34cyclictest2032306-21/usr/sbin/munin21:05:182
199148299401,33cyclictest2066032-21apt-get22:45:122
199148299401,31cyclictest0-21swapper/221:25:122
1991482994012,25cyclictest2000536-21latency_hist19:35:022
1991477994032,5cyclictest2028050-21munin-plugin-st20:55:011
1991473994032,4cyclictest2072829-21debian-sa123:05:000
1991487993929,7cyclictest2053381-21grep22:05:233
199148299393,32cyclictest2064327-21apt-get22:40:112
199148299393,32cyclictest2064327-21apt-get22:40:112
199148299393,31cyclictest2048917-21sed21:55:002
199148299391,36cyclictest53-21kcompactd023:41:572
199148299391,35cyclictest2075284-21/usr/sbin/munin23:10:212
199148299391,35cyclictest2059965-21/usr/sbin/munin22:25:252
199148299391,35cyclictest2056827-21unixbench_singl22:15:252
199148299391,35cyclictest2054205-21/usr/sbin/munin22:10:152
199148299391,35cyclictest2029253-21/usr/sbin/munin20:55:262
199148299391,35cyclictest2021969-21/usr/sbin/munin20:35:212
199148299391,35cyclictest2000946-21/usr/sbin/munin19:35:162
199148299391,33cyclictest2037160-21/usr/sbin/munin21:20:152
199148299391,32cyclictest0-21swapper/200:35:122
1991482993911,23cyclictest2052640-21if_err_eth022:05:152
1991477993930,5cyclictest0-21swapper/121:25:011
1991477993916,7cyclictest131rcu_preempt22:35:121
1991487993830,5cyclictest2038056-21unixbench_multi21:20:253
199148299383,32cyclictest1993590-21df_inode19:15:032
199148299383,20cyclictest629-21snmpd22:00:062
199148299383,20cyclictest629-21snmpd22:00:062
199148299381,34cyclictest2092701-21/usr/sbin/munin00:00:212
199148299381,34cyclictest2044386-21/usr/sbin/munin21:40:202
199148299381,34cyclictest2036117-21/usr/sbin/munin21:15:272
199148299381,34cyclictest2031225-21/usr/sbin/munin21:00:252
199148299381,34cyclictest1996255-21/usr/sbin/munin19:20:212
199148299381,33cyclictest2100806-21apt-get00:25:112
199148299381,33cyclictest2012092-21sshd20:05:302
1991473993828,6cyclictest0-21swapper/023:55:240
1991487993727,6cyclictest0-21swapper/300:30:003
199148299371,33cyclictest2077589-21cron23:16:012
199148299371,33cyclictest2025707-21/usr/sbin/munin20:45:262
199148299371,33cyclictest1997415-21/usr/sbin/munin19:25:122
1991482993711,23cyclictest0-21swapper/222:55:252
199148299370,32cyclictest2088622-21apt-get23:50:142
199148299370,32cyclictest0-21swapper/220:00:112
1991473993729,4cyclictest0-21swapper/021:55:010
1991487993629,4cyclictest2061066-21fschecks_count22:30:143
1991487993627,6cyclictest0-21swapper/322:50:003
1991487993626,6cyclictest0-21swapper/322:35:233
1991487993625,7cyclictest0-21swapper/321:15:273
1991487993625,7cyclictest0-21swapper/300:00:293
199148299361,32cyclictest2049760-21/usr/sbin/munin21:55:252
199148299361,32cyclictest2012999-21/usr/sbin/munin20:10:122
199148299360,33cyclictest0-21swapper/223:35:122
1991477993627,6cyclictest2003530-21grep19:40:251
1991477993625,6cyclictest0-21swapper/119:35:251
1991487993526,6cyclictest0-21swapper/319:50:263
1991487993522,7cyclictest0-21swapper/320:05:253
1991477993528,5cyclictest2027744-21kworker/u8:1+events_unbound20:56:411
199147399354,4cyclictest131rcu_preempt20:40:120
1991473993528,4cyclictest2046570-21unixbench_multi21:45:250
1991487993427,5cyclictest2067173-21kworker/u8:3+events_unbound23:12:073
1991487993426,4cyclictest0-21swapper/320:55:263
1991487993424,6cyclictest0-21swapper/321:15:013
1991487993423,7cyclictest0-21swapper/323:55:143
1991487993423,7cyclictest0-21swapper/323:20:243
1991487993423,7cyclictest0-21swapper/322:00:173
1991487993423,7cyclictest0-21swapper/322:00:163
1991477993428,4cyclictest2048366-21kworker/u8:1+events_unbound21:51:511
1991477993424,7cyclictest0-21swapper/119:35:001
1991477993423,8cyclictest438-21cron00:30:001
1991473993426,5cyclictest1995420-21munin-plugin-st19:20:000
1991473993426,4cyclictest0-21swapper/019:35:000
1991473993425,4cyclictest0-21swapper/022:15:000
199147399341,4cyclictest131rcu_preempt21:05:140
1991487993324,6cyclictest0-21swapper/323:40:013
1991487993324,6cyclictest0-21swapper/323:00:003
1991487993323,6cyclictest0-21swapper/323:10:013
1991487993323,6cyclictest0-21swapper/320:00:003
1991487993322,7cyclictest0-21swapper/322:20:013
199147799333,5cyclictest131rcu_preempt21:35:111
1991477993326,3cyclictest0-21swapper/121:05:251
1991477993325,4cyclictest0-21swapper/123:22:071
1991477993324,6cyclictest2103968-21cron00:34:591
199147399333,5cyclictest131rcu_preempt00:25:110
1991487993225,3cyclictest0-21swapper/320:45:173
1991487993224,4cyclictest0-21swapper/321:05:013
1991487993222,6cyclictest0-21swapper/323:50:163
1991487993222,6cyclictest0-21swapper/321:45:253
1991477993225,4cyclictest0-21swapper/121:00:261
1991473993226,4cyclictest2000361-21kworker/u8:2+events_unbound19:46:320
1991473993226,4cyclictest2000361-21kworker/u8:2+events_unbound19:46:320
1991473993225,3cyclictest0-21swapper/022:45:010
1991473993225,3cyclictest0-21swapper/022:45:010
1991473993224,4cyclictest0-21swapper/021:25:270
1991473993224,4cyclictest0-21swapper/019:40:240
1991487993124,4cyclictest0-21swapper/323:00:153
1991477993124,4cyclictest2057250-21sh22:20:001
1991477993123,4cyclictest0-21swapper/100:00:301
1991477993121,7cyclictest2053379-21unixbench_multi22:05:241
1991473993123,6cyclictest121ktimers/022:55:140
1991473993123,5cyclictest0-21swapper/023:20:010
1991487993022,5cyclictest0-21swapper/319:15:283
1991487993022,4cyclictest0-21swapper/321:35:163
1991487993022,4cyclictest0-21swapper/300:30:253
1991487993021,6cyclictest0-21swapper/300:05:263
1991487993020,6cyclictest0-21swapper/300:10:253
1991477993023,4cyclictest0-21swapper/121:50:011
1991477993021,6cyclictest2034070-21wc21:10:201
1991477993020,7cyclictest2064482-21grep22:40:161
1991477993020,7cyclictest2064482-21grep22:40:151
199147799301,4cyclictest131rcu_preempt23:45:111
199147799301,25cyclictest2098851-21ls00:19:591
1991473993023,3cyclictest0-21swapper/019:35:240
1991473993022,4cyclictest0-21swapper/023:25:160
1991473993021,5cyclictest1997573-21grep19:25:150
1991487992922,4cyclictest0-21swapper/321:05:263
1991487992921,4cyclictest0-21swapper/319:40:153
1991487992920,6cyclictest0-21swapper/320:10:153
1991487992920,5cyclictest0-21swapper/323:40:253
1991487992919,6cyclictest0-21swapper/319:35:243
1991487992916,9cyclictest2077955-21tr23:20:013
1991477992923,3cyclictest0-21swapper/100:10:131
1991477992922,4cyclictest0-21swapper/100:05:261
1991477992921,4cyclictest0-21swapper/119:15:041
1991477992918,8cyclictest164-21systemd-journal20:16:341
1991477992917,8cyclictest2058533-21grep22:20:241
1991473992923,3cyclictest0-21swapper/022:09:590
1991473992921,5cyclictest2062226-21kworker/u8:3+events_unbound22:37:010
1991473992919,7cyclictest0-21swapper/019:55:010
1991487992819,6cyclictest0-21swapper/322:50:153
1991487992818,6cyclictest0-21swapper/323:30:153
1991477992820,4cyclictest0-21swapper/122:10:271
1991477992820,4cyclictest0-21swapper/122:00:161
1991477992820,4cyclictest0-21swapper/122:00:161
1991477992820,4cyclictest0-21swapper/120:05:261
1991477992820,4cyclictest0-21swapper/100:35:251
1991477992819,6cyclictest2077949-21sendmail23:20:001
199147399282,5cyclictest131rcu_preempt00:00:130
1991473992822,4cyclictest2023170-21kworker/u8:0+events_unbound20:48:410
1991473992822,4cyclictest121ktimers/023:10:140
1991473992822,3cyclictest13550irq/42-30be0000.ethernet20:05:180
1991473992822,3cyclictest0-21swapper/000:35:250
1991473992821,5cyclictest2029720-21kworker/u8:2+events_unbound21:31:480
1991473992818,6cyclictest0-21swapper/023:20:240
1991473992817,7cyclictest2036318-21grep21:15:270
199147399281,25cyclictest0-21swapper/023:50:130
1991473992810,6cyclictest2029524-21sed20:55:260
1991487992719,5cyclictest0-21swapper/319:10:243
1991487992718,7cyclictest2028201-21latency_hist20:55:003
1991487992718,6cyclictest0-21swapper/321:40:243
1991487992717,6cyclictest0-21swapper/322:00:013
1991487992717,6cyclictest0-21swapper/319:20:253
1991477992721,3cyclictest0-21swapper/121:55:231
1991473992722,3cyclictest13550irq/42-30be0000.ethernet23:40:010
199147399272,22cyclictest2098869-21sendmail-msp00:19:590
1991473992721,4cyclictest2050102-21kworker/u8:2+events_unbound22:00:110
1991473992721,4cyclictest2050102-21kworker/u8:2+events_unbound22:00:110
1991473992715,8cyclictest2043627-21tr21:40:010
1991487992618,5cyclictest0-21swapper/319:30:263
1991477992617,5cyclictest2099225-21fschecks_count00:20:161
1991477992617,5cyclictest2099225-21fschecks_count00:20:161
1991477992615,8cyclictest231ktimers/120:25:121
1991477992615,8cyclictest2006350-21sed19:50:191
1991477992615,7cyclictest2017347-21grep20:20:251
199147399262,5cyclictest131rcu_preempt20:30:110
1991473992620,3cyclictest0-21swapper/020:00:000
1991473992617,6cyclictest2044852-21grep21:40:240
1991487992517,4cyclictest0-21swapper/321:30:263
1991487992515,7cyclictest2016124-21basename20:20:013
1991477992519,4cyclictest2067173-21kworker/u8:3+events_unbound22:56:151
1991477992517,5cyclictest0-21swapper/123:55:011
1991477992514,7cyclictest0-21swapper/121:40:251
199147799251,21cyclictest1995873-21cut19:20:161
1991473992517,4cyclictest0-21swapper/000:20:240
1991473992517,4cyclictest0-21swapper/000:20:240
1991473992516,6cyclictest1997140-21basename19:25:010
199147399251,4cyclictest2057249-21sh22:20:010
199147399251,3cyclictest2095658-21apt-get00:10:130
1991473992510,4cyclictest0-21swapper/023:30:020
1991487992418,3cyclictest2081360-21kthreadd23:30:003
1991487992418,3cyclictest0-21swapper/320:25:253
199147799249,4cyclictest221rcuc/123:40:221
1991477992419,3cyclictest2067961-21fschecks_time22:50:151
1991477992417,4cyclictest0-21swapper/119:25:241
1991477992415,6cyclictest0-21swapper/121:30:251
1991477992414,7cyclictest2074372-21seq23:08:081
1991477992414,6cyclictest2009508-21tune2fs20:00:151
1991477992413,7cyclictest0-21swapper/123:55:251
199147399243,4cyclictest131rcu_preempt21:00:130
1991473992416,5cyclictest2095424-21sh00:10:000
199147399241,19cyclictest0-21swapper/020:26:570
199147399241,19cyclictest0-21swapper/020:10:410
1991487992317,3cyclictest0-21swapper/322:40:233
1991487992317,3cyclictest0-21swapper/322:40:223
1991487992315,5cyclictest0-21swapper/321:50:203
1991487992312,8cyclictest2021235-21seq20:35:003
1991477992317,3cyclictest0-21swapper/120:10:241
1991477992317,3cyclictest0-21swapper/120:00:001
1991477992316,5cyclictest231ktimers/122:45:151
1991477992316,4cyclictest2022921-21sendmail20:40:011
1991477992316,3cyclictest0-21swapper/120:45:261
1991477992315,4cyclictest0-21swapper/120:40:261
1991477992312,6cyclictest2060831-21cut22:30:011
199147399233,5cyclictest131rcu_preempt22:20:120
1991473992317,4cyclictest13550irq/42-30be0000.ethernet22:00:010
1991473992314,6cyclictest2037982-21ls21:20:240
1991473992314,6cyclictest0-21swapper/023:10:010
1991487992215,3cyclictest0-21swapper/321:25:263
1991487992214,5cyclictest0-21swapper/320:20:233
1991487992214,5cyclictest0-21swapper/320:00:243
1991487992214,4cyclictest0-21swapper/322:25:153
1991477992213,6cyclictest231ktimers/122:35:011
1991477992213,6cyclictest2036482-21seq21:16:301
199147399221,9cyclictest2087550-21taskset23:45:210
1991473992216,3cyclictest0-21swapper/022:45:140
1991473992216,3cyclictest0-21swapper/020:00:220
1991473992215,3cyclictest0-21swapper/019:10:390
1991473992213,6cyclictest0-21swapper/020:50:260
1991473992212,7cyclictest2034627-21awk21:10:260
199147399221,19cyclictest0-21swapper/020:37:540
1991487992115,3cyclictest0-21swapper/319:45:163
1991487992115,3cyclictest0-21swapper/319:45:153
1991487992113,5cyclictest0-21swapper/300:35:243
1991487992112,6cyclictest0-21swapper/319:25:163
1991477992114,5cyclictest231ktimers/120:30:121
1991477992114,5cyclictest2070869-21kworker/u8:1+events_unbound23:00:171
1991477992114,4cyclictest0-21swapper/121:25:271
1991473992117,2cyclictest0-21swapper/023:40:150
1991473992115,4cyclictest2061570-21processes22:30:220
1991487992014,3cyclictest0-21swapper/322:20:243
1991477992013,4cyclictest0-21swapper/123:30:191
1991477991915,2cyclictest0-21swapper/123:10:121
1991477991910,6cyclictest2080757-21timerandwakeup23:25:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional