You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 01:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack4slot1s.osadl.org (updated Mon Aug 17, 2026 00:44:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1558721160,5sleep30-21swapper/322:49:093
783521040,2sleep30-21swapper/322:29:073
1691221000,3sleep30-21swapper/322:54:043
52282930,3sleep30-21swapper/323:49:033
52282930,3sleep30-21swapper/323:49:033
232442860,3sleep20-21swapper/223:09:102
232442860,3sleep20-21swapper/223:09:102
210672850,3sleep30-21swapper/323:04:093
137732690,2sleep10-21swapper/122:44:091
137732690,2sleep10-21swapper/122:44:091
17542670,3chrt0-21swapper/122:14:021
208872650,2sleep020886-21ls21:38:510
224972610,3chrt0-21swapper/123:09:011
224972610,3chrt0-21swapper/123:09:011
65872600,2chrt6584-21cron23:53:511
65872600,2chrt6584-21cron23:53:511
150112590,1sleep1271rcuc/100:14:091
299412570,2chrt29936-21cpuspeed23:29:060
147512550,3sleep30-21swapper/319:54:063
139772550,2sleep30-21swapper/321:19:043
139772550,2sleep30-21swapper/321:19:043
31706995345,4cyclictest0-21swapper/000:03:560
31706995345,4cyclictest0-21swapper/000:03:560
168042530,3sleep10-21swapper/100:19:081
168042530,3sleep10-21swapper/100:19:081
38512470,2sleep13850-21fschecks_time22:19:041
38512470,2sleep13850-21fschecks_time22:19:041
31706994517,26cyclictest3082-21grep23:44:020
266082450,3sleep10-21swapper/121:53:561
177572440,1chrt0-21swapper/121:29:071
3170799431,35cyclictest10705-21df_inode00:04:041
3170799431,35cyclictest10705-21df_inode00:04:041
31706994310,10cyclictest10919-21grep00:04:060
31706994310,10cyclictest10919-21grep00:04:060
264612430,3sleep30-21swapper/321:53:423
177342430,3sleep30-21swapper/320:03:513
177342430,3sleep30-21swapper/320:03:513
284542420,3sleep20-21swapper/220:29:152
31706994018,20cyclictest0-21swapper/020:39:100
31706994016,22cyclictest0-21swapper/022:44:130
31706994016,22cyclictest0-21swapper/022:44:130
3170699391,8cyclictest11978-21uniq21:14:050
31706993916,21cyclictest425-21/usr/sbin/munin20:44:130
3170699381,9cyclictest17659-21mailstats22:54:120
31706993714,3cyclictest0-21swapper/000:34:070
31706993713,3cyclictest0-21swapper/020:54:070
56842360,2sleep00-21swapper/023:49:090
56842360,2sleep00-21swapper/023:49:090
31706993613,2cyclictest0-21swapper/020:09:120
31706993611,3cyclictest0-21swapper/021:13:510
137372360,2sleep20-21swapper/200:09:162
31706993512,5cyclictest13964-21latency_hist19:53:520
31706993512,3cyclictest0-21swapper/023:19:070
31706993512,3cyclictest0-21swapper/023:19:070
31707993425,7cyclictest31120-21unixbench_singl23:29:181
31707993425,3cyclictest13973-21cat19:53:511
296452340,2sleep30-21swapper/321:59:123
296452340,2sleep30-21swapper/321:59:123
238792340,2chrt0-21swapper/121:44:111
238792340,2chrt0-21swapper/121:44:111
3170999331,23cyclictest10492-21taskset00:03:572
3170999331,23cyclictest10492-21taskset00:03:572
31707993325,6cyclictest12790-21sendmail22:43:511
31707993325,6cyclictest12790-21sendmail22:43:511
31707993324,7cyclictest1-21systemd19:44:181
31707993323,8cyclictest12940-21unixbench_singl21:14:151
31707993224,6cyclictest10132-21gltestperf21:09:051
31706993225,5cyclictest17211-21threads00:19:140
31706993225,5cyclictest17211-21threads00:19:140
31706993210,3cyclictest0-21swapper/021:04:130
31706993210,3cyclictest0-21swapper/021:04:130
31706993125,5cyclictest24749-21kernelversion23:14:080
31706993125,4cyclictest31700-21cyclictest20:34:050
31706993125,4cyclictest31700-21cyclictest20:34:050
31706993123,6cyclictest3431-21latency_hist22:18:520
31706993122,7cyclictest25573-21cut20:24:040
31706993122,7cyclictest25573-21cut20:24:040
31707993020,8cyclictest7176-21gltestperf23:54:061
31707993020,8cyclictest7176-21gltestperf23:54:061
31706993024,4cyclictest13723-21unixbench_singl00:09:160
31706993022,6cyclictest19095-21unixbench-2d20:04:160
31706993022,6cyclictest19095-21unixbench-2d20:04:160
31707992923,5cyclictest9853-21sshd19:39:301
31707992923,5cyclictest9853-21sshd19:39:301
31707992923,4cyclictest31700-21cyclictest22:36:001
31707992923,4cyclictest22923-21timerwakeupswit00:34:161
31707992922,5cyclictest13723-21unixbench_singl00:09:161
31706992923,4cyclictest7751-21gltestperf22:29:070
31706992923,4cyclictest0-21swapper/020:23:510
31706992923,4cyclictest0-21swapper/020:23:510
7512280,2sleep1904-21if_wlan020:44:061
31707992823,3cyclictest31185-21kworker/u9:1-xprtiod00:03:521
31707992823,3cyclictest31185-21kworker/u9:1-xprtiod00:03:521
31707992821,4cyclictest0-21swapper/120:19:031
31707992821,4cyclictest0-21swapper/120:19:031
31706992824,3cyclictest31700-21cyclictest00:26:280
31706992823,3cyclictest0-21swapper/021:43:510
31706992823,3cyclictest0-21swapper/021:43:510
31706992822,4cyclictest2262-21timerwakeupswit23:39:150
31706992822,4cyclictest2262-21timerwakeupswit23:39:150
31706992820,7cyclictest1320-21sshd22:11:180
11662280,3sleep20-21swapper/220:44:102
106662280,4sleep20-21swapper/219:44:042
31707992721,5cyclictest22678-21timerandwakeup20:14:141
31707992721,4cyclictest31700-21cyclictest20:38:561
31707992721,4cyclictest31700-21cyclictest20:38:561
31707992719,6cyclictest8112-21ntpq22:29:111
10042270,3sleep30-21swapper/320:44:073
31707992622,3cyclictest28984-21switchtime23:24:121
31707992620,4cyclictest24635-21idleruntime23:14:061
31707992620,4cyclictest19888-21needreboot21:34:111
31707992619,6cyclictest31700-21cyclictest21:39:031
31707992619,6cyclictest31700-21cyclictest21:39:031
31707992619,5cyclictest15901-21switchtime22:49:141
31706992621,4cyclictest27075-21idleruntime21:54:050
31706992620,5cyclictest10245-21switchtime22:34:140
31706992620,3cyclictest0-21swapper/023:24:120
31706992617,3cyclictest27925-21needreboot20:29:090
31706992613,11cyclictest940-21cron23:38:510
31707992521,2cyclictest0-21swapper/123:23:511
31707992521,2cyclictest0-21swapper/123:23:511
31707992518,5cyclictest6802-21ntp_kernel_pll_20:59:101
31707992518,5cyclictest6802-21ntp_kernel_pll_20:59:101
31707992518,5cyclictest550-21cron00:28:511
31707992518,4cyclictest0-21swapper/122:59:151
31707992518,4cyclictest0-21swapper/122:59:151
31706992520,3cyclictest0-21swapper/021:19:030
31706992520,3cyclictest0-21swapper/021:19:030
31706992519,5cyclictest11645-21kernelversion22:39:060
31706992519,5cyclictest11645-21kernelversion22:39:060
31706992519,4cyclictest0-21swapper/020:49:110
31706992518,5cyclictest22881-21kernelversion23:09:040
31706992518,5cyclictest22881-21kernelversion23:09:040
31706992517,5cyclictest0-21swapper/022:59:140
31706992517,5cyclictest0-21swapper/022:59:140
3171199248,11cyclictest104402sleep300:03:553
3171199248,11cyclictest104402sleep300:03:553
31707992420,3cyclictest27055-21idleruntime-cro20:28:511
31707992420,3cyclictest27055-21idleruntime-cro20:28:511
31707992419,3cyclictest27421-21ntp_kernel_pll_21:54:101
31707992418,3cyclictest0-21swapper/120:54:061
31707992417,5cyclictest1400-21sshd22:12:181
31707992416,6cyclictest15146-21ls19:54:131
31707992415,7cyclictest31309-21grep22:04:121
31706992419,3cyclictest0-21swapper/021:24:110
31706992419,3cyclictest0-21swapper/021:24:110
31706992418,5cyclictest22148-21kernelversion20:14:070
31706992418,3cyclictest0-21swapper/023:04:140
31706992417,5cyclictest5534-21/usr/sbin/munin22:24:160
3171199231,13cyclictest0-21swapper/300:04:063
3171199231,13cyclictest0-21swapper/300:04:063
31707992319,2cyclictest0-21swapper/121:24:091
31707992319,2cyclictest0-21swapper/121:24:091
31707992318,2cyclictest0-21swapper/120:04:061
31707992318,2cyclictest0-21swapper/120:04:061
31707992317,5cyclictest21270-21ntp_offset23:04:121
31707992317,4cyclictest0-21swapper/123:44:041
31707992317,4cyclictest0-21swapper/122:54:141
31707992316,5cyclictest1668-21kernelversion23:39:081
31707992316,5cyclictest1668-21kernelversion23:39:081
31707992315,6cyclictest16146-21sort19:59:031
31707992315,6cyclictest16146-21sort19:59:031
31707992314,7cyclictest21591-21cron00:33:511
31707992314,7cyclictest21591-21cron00:33:511
31706992319,2cyclictest0-21swapper/021:29:120
31706992319,2cyclictest0-21swapper/019:54:040
31706992318,3cyclictest0-21swapper/022:51:430
31706992318,3cyclictest0-21swapper/000:14:130
31706992317,3cyclictest0-21swapper/000:29:150
31706992317,3cyclictest0-21swapper/000:29:150
31706992316,5cyclictest6627-21latency20:59:080
31706992316,5cyclictest6627-21latency20:59:080
31706992316,5cyclictest25710-21wc21:49:120
31706992315,6cyclictest24057-21cat21:44:120
31706992315,6cyclictest24057-21cat21:44:120
239992230,4sleep20-21swapper/221:44:122
239992230,4sleep20-21swapper/221:44:122
31707992218,2cyclictest0-21swapper/121:19:141
31707992218,2cyclictest0-21swapper/121:19:141
31707992218,2cyclictest0-21swapper/120:29:051
31707992218,2cyclictest0-21swapper/120:09:051
31707992217,3cyclictest0-21swapper/121:59:041
31707992217,3cyclictest0-21swapper/121:59:041
31707992217,3cyclictest0-21swapper/100:39:111
31707992217,3cyclictest0-21swapper/100:39:111
31707992217,3cyclictest0-21swapper/100:39:111
31707992216,4cyclictest0-21swapper/120:39:151
31707992215,5cyclictest0-21swapper/120:49:101
31707992215,4cyclictest0-21swapper/122:24:081
31706992217,4cyclictest31700-21cyclictest19:41:340
31706992217,4cyclictest31700-21cyclictest19:41:340
31706992217,4cyclictest28883-21tail21:59:030
31706992217,4cyclictest28883-21tail21:59:030
31706992217,3cyclictest3615-21/usr/sbin/munin22:19:120
31706992217,3cyclictest3615-21/usr/sbin/munin22:19:120
31706992217,3cyclictest0-21swapper/023:54:160
31706992217,3cyclictest0-21swapper/023:54:160
31706992217,3cyclictest0-21swapper/019:59:060
31706992217,3cyclictest0-21swapper/019:59:060
31706992216,4cyclictest13681-21apache219:44:310
181812210,3sleep20-21swapper/220:04:062
181812210,3sleep20-21swapper/220:04:062
84812200,3sleep20-21swapper/221:04:082
84812200,3sleep20-21swapper/221:04:082
3171199203,9cyclictest0-21swapper/320:29:183
31706992016,2cyclictest0-21swapper/000:43:510
31706992016,2cyclictest0-21swapper/000:43:510
31706992016,2cyclictest0-21swapper/000:43:510
3171199193,9cyclictest0-21swapper/321:09:473
3171199191,12cyclictest20683-21chrt00:29:113
3171199191,12cyclictest20683-21chrt00:29:113
3170799191,16cyclictest9811-21ls21:08:571
3170799191,16cyclictest9811-21ls21:08:571
3170799191,10cyclictest32550-21uname23:34:131
31706991913,4cyclictest0-21swapper/022:04:050
3171199183,8cyclictest0-21swapper/322:39:183
3171199183,8cyclictest0-21swapper/322:39:183
3171199181,13cyclictest24429-21chrt00:39:123
3171199181,13cyclictest24429-21chrt00:39:123
3171199181,13cyclictest24429-21chrt00:39:123
3170999181,13cyclictest28860-21chrt21:59:032
3170999181,13cyclictest28860-21chrt21:59:032
3170999181,12cyclictest27016-21chrt21:54:052
3170999181,11cyclictest3228-21taskset23:44:032
3171199172,11cyclictest0-21swapper/323:29:103
3171199171,12cyclictest29544-21chrt20:34:063
3171199171,12cyclictest29544-21chrt20:34:063
3171199171,11cyclictest28213-21taskset23:24:023
3171199171,11cyclictest26862-21taskset23:19:123
3171199171,11cyclictest26862-21taskset23:19:123
3171199171,11cyclictest22625-21chrt00:34:133
3171199171,11cyclictest13050-21chrt19:49:123
3171199171,10cyclictest1471-21chrt23:39:063
3171199171,10cyclictest1471-21chrt23:39:063
3170999179,5cyclictest180502sleep200:24:002
3170999179,5cyclictest180502sleep200:24:002
3170999174,8cyclictest0-21swapper/219:59:032
3170999174,8cyclictest0-21swapper/219:59:032
31709991711,3cyclictest146492chrt19:54:052
3170999171,12cyclictest15514-21taskset21:24:022
3170999171,12cyclictest15514-21taskset21:24:022
3170999171,11cyclictest24846-21chrt21:49:022
3170999171,10cyclictest7591-21taskset23:54:122
3170999171,10cyclictest7591-21taskset23:54:122
3170999170,12cyclictest24779-21taskset00:39:152
3170999170,12cyclictest24779-21taskset00:39:152
3170999170,12cyclictest24779-21taskset00:39:152
3171199163,9cyclictest0-21swapper/320:54:443
3171199162,10cyclictest0-21swapper/320:39:023
3171199161,11cyclictest3620-21chrt22:19:023
3171199161,11cyclictest3620-21chrt22:19:023
3171199161,11cyclictest24461-21chrt23:14:053
3171199161,11cyclictest21196-21taskset21:39:023
3171199161,11cyclictest21196-21taskset21:39:023
3171199161,11cyclictest14449-21taskset00:14:033
3171199161,11cyclictest12593-21taskset00:09:053
3171199161,10cyclictest6803-21taskset20:59:103
3171199161,10cyclictest6803-21taskset20:59:103
3171199161,10cyclictest19570-21chrt22:59:143
3171199161,10cyclictest19570-21chrt22:59:143
3170999161,11cyclictest15395-21taskset00:14:142
3170999161,11cyclictest13085-21chrt22:44:022
3170999161,11cyclictest0-21swapper/222:13:562
3170999161,11cyclictest0-21swapper/220:19:132
3170999161,11cyclictest0-21swapper/220:19:132
3170999161,10cyclictest24363-21chrt23:14:042
3170999161,10cyclictest18118-21chrt21:29:122
115122160,3chrt0-21swapper/319:44:133
3171199152,10cyclictest0-21swapper/323:54:083
3171199152,10cyclictest0-21swapper/323:54:083
3171199152,10cyclictest0-21swapper/321:34:153
3171199151,8cyclictest0-21swapper/322:24:053
3171199151,11cyclictest1998-21chrt22:14:043
3171199151,10cyclictest30513-21chrt22:04:033
3171199151,10cyclictest27169-21chrt21:54:063
3171199151,10cyclictest24781-21chrt20:19:153
3171199151,10cyclictest24781-21chrt20:19:153
3171199151,10cyclictest23720-21chrt21:44:093
3171199151,10cyclictest23720-21chrt21:44:093
3170999153,9cyclictest0-21swapper/222:14:182
3170999151,8cyclictest0-21swapper/223:04:092
3170999151,8cyclictest0-21swapper/200:04:042
3170999151,8cyclictest0-21swapper/200:04:042
3170999151,11cyclictest13472-21chrt21:18:552
3170999151,10cyclictest9359-21chrt19:39:102
3170999151,10cyclictest9359-21chrt19:39:102
3170999151,10cyclictest8296-21taskset22:29:142
3170999151,10cyclictest27155-21chrt20:28:542
3170999151,10cyclictest27155-21chrt20:28:542
3170999151,10cyclictest20150-21chrt20:09:052
3170999151,10cyclictest0-21swapper/223:19:072
3170999151,10cyclictest0-21swapper/223:19:072
3170999151,10cyclictest0-21swapper/222:53:562
194732151,2sleep30-21swapper/320:07:383
194732151,2sleep30-21swapper/320:07:383
3171199149,3cyclictest176292chrt00:21:073
3171199149,3cyclictest176292chrt00:21:073
3171199142,8cyclictest92842sleep321:04:303
3171199142,8cyclictest92842sleep321:04:303
3171199141,9cyclictest2732-21chrt20:49:053
3171199141,9cyclictest20540-21chrt20:09:103
3171199141,9cyclictest18202-21taskset00:24:043
3171199141,9cyclictest17963-21chrt21:29:093
3170999149,3cyclictest29932chrt20:49:082
3170999148,3cyclictest218032sleep221:39:102
3170999148,3cyclictest218032sleep221:39:102
3170999146,5cyclictest50492sleep220:54:122
3170999141,9cyclictest5509-21chrt22:24:002
3170999141,9cyclictest5509-21chrt22:24:002
3170999141,9cyclictest31739-21chrt22:04:182
3170999141,9cyclictest31132-21taskset20:39:032
3170999141,9cyclictest22569-21chrt00:34:122
3170999141,9cyclictest21762-21chrt20:14:032
3170999141,9cyclictest12298-21chrt19:49:032
3170999141,9cyclictest11258-21chrt22:39:032
3170999141,9cyclictest10592-21taskset21:09:102
3170999141,8cyclictest6357-21taskset20:59:052
3170999141,8cyclictest6357-21taskset20:59:052
3170999141,8cyclictest19235-21taskset22:59:092
3170999141,8cyclictest19235-21taskset22:59:092
3170999141,8cyclictest0-21swapper/222:44:062
3170999141,8cyclictest0-21swapper/222:44:062
3170999141,8cyclictest0-21swapper/222:34:082
3170999141,10cyclictest0-21swapper/223:49:012
3170999141,10cyclictest0-21swapper/223:49:012
3170999141,10cyclictest0-21swapper/221:19:022
3170999141,10cyclictest0-21swapper/221:19:022
213602141,2sleep20-21swapper/200:30:562
213602141,2sleep20-21swapper/200:30:562
3171199138,3cyclictest8232chrt23:37:213
3171199131,8cyclictest26077-21chrt20:24:093
3171199131,8cyclictest26077-21chrt20:24:093
3171199131,10cyclictest16302-21chrt21:24:113
3171199131,10cyclictest16302-21chrt21:24:113
3170999138,3cyclictest9912chrt23:38:532
3170999131,9cyclictest30448-21chrt20:34:412
3170999131,9cyclictest30448-21chrt20:34:412
3170999131,9cyclictest0-21swapper/223:24:052
3170999131,8cyclictest19233-21taskset21:34:032
3170999131,10cyclictest17532-21taskset22:54:112
3171199121,9cyclictest4397-21chrt23:45:013
3171199121,9cyclictest13619-21chrt22:44:073
3171199121,9cyclictest13619-21chrt22:44:073
3171199121,9cyclictest10641-21chrt22:35:143
3171199121,8cyclictest22751-21chrt23:09:033
3171199121,8cyclictest22751-21chrt23:09:033
3171199121,8cyclictest1191-21chrt22:09:383
3171199121,10cyclictest0-21swapper/321:18:533
3170999123,8cyclictest0-21swapper/223:40:172
3170999123,8cyclictest0-21swapper/223:40:172
3170999121,9cyclictest31253-21chrt23:30:372
3170999121,8cyclictest5638-21chrt22:24:042
3170999121,8cyclictest18826-21chrt00:24:112
225212121,4sleep30-21swapper/320:14:133
3171199111,8cyclictest8837-21taskset19:39:033
3171199111,8cyclictest8837-21taskset19:39:033
plot10:48:588
setyrange[0.8:*]5
setylabel"Numberoflatencysamples"6
setxrange[0:400]4
setxlabel"Latencyus-Maximumusplottedon2
settitle"Latencyrack4slot1s"0
setterminalpbmcolor1
setoutput"r4s1s.ppm"7
setlogscaley3
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional