You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 23:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Tue Jun 23, 2026 12:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
579121240,3sleep1271rcuc/111:18:241
579121240,3sleep1271rcuc/111:18:241
579121240,3sleep1271rcuc/111:18:241
49321230,2sleep1281ktimers/108:13:161
49321230,2sleep1281ktimers/108:13:161
49321230,2sleep1281ktimers/108:13:161
98421200,5sleep1575-21thd09:40:391
98421200,5sleep1575-21thd09:40:391
2273021180,1sleep10-21swapper/109:13:141
3089721070,3sleep20-21swapper/208:08:142
3089721070,3sleep20-21swapper/208:08:142
2250221020,2chrt0-21swapper/110:38:161
2250221020,2chrt0-21swapper/110:38:161
44922890,3sleep20-21swapper/209:48:242
44922890,3sleep20-21swapper/209:48:242
44922890,3sleep20-21swapper/209:48:242
270852820,12sleep1281ktimers/109:23:191
270852820,12sleep1281ktimers/109:23:191
49482600,2chrt0-21swapper/308:23:233
49482600,2chrt0-21swapper/308:23:233
192022570,3sleep119197-21mailstats10:28:231
192022570,3sleep119197-21mailstats10:28:231
192022570,3sleep119197-21mailstats10:28:231
313442540,2sleep30-21swapper/308:08:193
313442540,2sleep30-21swapper/308:08:193
319212520,2sleep20-21swapper/212:28:242
319212520,2sleep20-21swapper/212:28:242
319212520,2sleep20-21swapper/212:28:242
114102520,2sleep111413-21grep10:08:171
114102520,2sleep111413-21grep10:08:171
114102520,2sleep111413-21grep10:08:171
14192510,3sleep11526-21vmstat12:33:261
14192510,3sleep11526-21vmstat12:33:261
64142480,2sleep00-21swapper/009:53:250
64142480,2sleep00-21swapper/009:53:250
299482470,2sleep30-21swapper/310:58:163
214272460,3sleep20-21swapper/212:03:112
214272460,3sleep20-21swapper/212:03:112
303132400,3sleep30-21swapper/308:06:383
303132400,3sleep30-21swapper/308:06:383
277272380,2sleep127731-21needreboot12:18:191
277272380,2sleep127731-21needreboot12:18:191
277272380,2sleep127731-21needreboot12:18:191
161652380,2sleep30-21swapper/307:28:153
161652380,2sleep30-21swapper/307:28:153
161652380,2sleep30-21swapper/307:28:153
9052370,3sleep20-21swapper/211:08:122
9052370,3sleep20-21swapper/211:08:122
9052370,3sleep20-21swapper/211:08:122
148422360,2chrt0-21swapper/310:18:163
148422360,2chrt0-21swapper/310:18:163
10326993628,6cyclictest13483-21processes10:13:221
10326993628,6cyclictest13483-21processes10:13:221
10326993628,6cyclictest13483-21processes10:13:221
111842350,2sleep111194-21awk08:43:041
111842350,2sleep111194-21awk08:43:041
111842350,2sleep111194-21awk08:43:041
10326993531,3cyclictest14521-21kernelversion11:43:161
10326993531,3cyclictest14521-21kernelversion11:43:161
319712340,2chrt0-21swapper/309:38:123
319712340,2chrt0-21swapper/309:38:123
285752340,3chrt28580-21sendmail08:03:020
285752340,3chrt28580-21sendmail08:03:020
10326993428,5cyclictest13124-21latency_hist08:48:091
10326993428,5cyclictest13124-21latency_hist08:48:091
10326993428,5cyclictest13124-21latency_hist08:48:091
10326993427,5cyclictest2962-21threads08:18:241
10326993427,5cyclictest2962-21threads08:18:241
10319993427,5cyclictest16883-21threads11:48:250
10319993427,5cyclictest16883-21threads11:48:250
10319993424,7cyclictest25162-21needreboot09:18:190
10319993424,7cyclictest25162-21needreboot09:18:190
10319993424,7cyclictest25162-21needreboot09:18:190
256762330,2sleep125678-21grep09:18:241
256762330,2sleep125678-21grep09:18:241
256762330,2sleep125678-21grep09:18:241
10326993327,4cyclictest21707-21switchtime09:08:211
10326993327,4cyclictest21707-21switchtime09:08:211
10326993326,5cyclictest27402-21kernelversion07:58:161
10326993326,5cyclictest27402-21kernelversion07:58:161
10326993326,5cyclictest25285-21latency_hist12:13:141
10326993326,5cyclictest25285-21latency_hist12:13:141
10326993326,5cyclictest22488-21threads12:03:231
10326993326,5cyclictest22488-21threads12:03:231
10326993325,6cyclictest7494-21latency_hist08:33:111
10326993325,6cyclictest7494-21latency_hist08:33:111
10326993325,6cyclictest7494-21latency_hist08:33:111
10319993326,5cyclictest32641-21needreboot09:38:190
10319993326,5cyclictest32641-21needreboot09:38:190
10319993326,5cyclictest20517-21latency_hist09:08:010
10319993326,5cyclictest20517-21latency_hist09:08:010
10319993326,5cyclictest15747-21tail08:53:180
10319993326,5cyclictest15747-21tail08:53:180
10319993326,5cyclictest15747-21tail08:53:180
114042320,2sleep111409-21sed11:33:231
114042320,2sleep111409-21sed11:33:231
10326993227,3cyclictest21100-21latency_hist07:43:011
10326993227,3cyclictest21100-21latency_hist07:43:011
10326993225,5cyclictest32497-21latency_hist12:33:031
10326993225,5cyclictest32497-21latency_hist12:33:031
10326993225,5cyclictest32497-21latency_hist12:33:031
10326993225,5cyclictest30761-21latency_hist12:28:101
10326993225,5cyclictest30761-21latency_hist12:28:101
10326993225,5cyclictest30761-21latency_hist12:28:101
10326993224,6cyclictest550-21cron10:48:041
10326993224,6cyclictest550-21cron10:48:041
25882310,3sleep10-21swapper/112:38:161
25882310,3sleep10-21swapper/112:38:161
10319993125,4cyclictest13524-21sed08:48:160
10319993125,4cyclictest13524-21sed08:48:160
10319993125,4cyclictest13524-21sed08:48:160
96442300,2sleep09646-21fschecks_time08:38:150
96442300,2sleep09646-21fschecks_time08:38:150
96442300,2sleep09646-21fschecks_time08:38:150
10326993025,3cyclictest29775-21gltestperf10:58:151
10326993025,3cyclictest29775-21gltestperf10:58:151
58472290,2sleep06010-21perl08:28:150
58472290,2sleep06010-21perl08:28:150
58472290,2sleep06010-21perl08:28:150
1033499291,5cyclictest4140-21chrt11:15:362
1033499291,5cyclictest4140-21chrt11:15:362
1033499291,5cyclictest4140-21chrt11:15:362
10326992923,4cyclictest9855-21idleruntime08:38:161
10326992923,4cyclictest9855-21idleruntime08:38:161
10326992923,4cyclictest9855-21idleruntime08:38:161
10319992923,4cyclictest26124-21timerwakeupswit07:53:240
10319992923,4cyclictest26124-21timerwakeupswit07:53:240
10319992922,5cyclictest24191-21threads07:48:230
10319992922,5cyclictest24191-21threads07:48:230
10319992922,5cyclictest1531-21sshd08:15:390
10319992922,5cyclictest1531-21sshd08:15:390
10319992922,5cyclictest1531-21sshd08:15:390
10319992922,5cyclictest1109-21gltestperf11:08:130
10319992922,5cyclictest1109-21gltestperf11:08:130
10319992922,5cyclictest1109-21gltestperf11:08:130
312332280,3sleep10-21swapper/111:03:041
312332280,3sleep10-21swapper/111:03:041
260632280,2sleep026173-21switchtime12:13:230
260632280,2sleep026173-21switchtime12:13:230
193342280,3sleep20-21swapper/210:28:242
193342280,3sleep20-21swapper/210:28:242
193342280,3sleep20-21swapper/210:28:242
10326992822,3cyclictest0-21swapper/108:08:151
10326992822,3cyclictest0-21swapper/108:08:151
10326992821,5cyclictest4538-21unixbench_singl09:48:241
10326992821,5cyclictest4538-21unixbench_singl09:48:241
10326992821,5cyclictest4538-21unixbench_singl09:48:241
10326992821,5cyclictest15394-21gltestperf08:53:141
10326992821,5cyclictest15394-21gltestperf08:53:141
10326992821,5cyclictest15394-21gltestperf08:53:141
10326992821,5cyclictest11041-21fschecks_time10:08:141
10326992821,5cyclictest11041-21fschecks_time10:08:141
10326992820,6cyclictest31249-21unixbench-2d09:33:241
10326992820,6cyclictest31249-21unixbench-2d09:33:241
10319992821,6cyclictest20920-21ntp_offset10:33:200
10319992821,6cyclictest20920-21ntp_offset10:33:200
10319992821,5cyclictest22922-21sshd07:47:380
10319992821,5cyclictest22922-21sshd07:47:380
10319992820,6cyclictest8457-21fschecks_count11:28:130
10319992820,6cyclictest8457-21fschecks_count11:28:130
98112270,9chrt281ktimers/110:03:231
98112270,9chrt281ktimers/110:03:231
10326992723,3cyclictest603-21latency_hist11:08:021
10326992723,3cyclictest603-21latency_hist11:08:021
10326992723,3cyclictest603-21latency_hist11:08:021
10326992721,4cyclictest545-21in:imuxsock08:08:011
10326992721,4cyclictest545-21in:imuxsock08:08:011
10326992721,4cyclictest21506-21cpuspeed12:03:121
10326992721,4cyclictest21506-21cpuspeed12:03:121
10326992720,5cyclictest4222-21sshd11:16:391
10326992720,5cyclictest4222-21sshd11:16:391
10326992720,5cyclictest4222-21sshd11:16:391
10326992720,5cyclictest4120-21cut08:23:141
10326992720,5cyclictest4120-21cut08:23:141
10326992720,5cyclictest24959-21latency_hist07:53:091
10326992720,5cyclictest24959-21latency_hist07:53:091
10326992719,6cyclictest17169-21ntp_kernel_err10:23:191
10326992719,6cyclictest17169-21ntp_kernel_err10:23:191
10326992719,6cyclictest16071-21cut11:48:151
10326992719,6cyclictest16071-21cut11:48:151
10326992718,7cyclictest22178-21gunzip07:43:211
10326992718,7cyclictest22178-21gunzip07:43:211
10319992722,3cyclictest0-21swapper/010:33:010
10319992722,3cyclictest0-21swapper/010:33:010
10319992722,3cyclictest0-21swapper/010:33:010
10319992720,6cyclictest7213-21ntp_offset11:23:190
10319992719,5cyclictest0-21swapper/009:33:240
10319992719,5cyclictest0-21swapper/009:33:240
10340992621,3cyclictest431rcuc/310:39:113
10340992621,3cyclictest431rcuc/310:39:113
10326992621,3cyclictest8272-21head09:58:241
10326992621,3cyclictest8272-21head09:58:241
10326992621,3cyclictest8272-21head09:58:241
10326992620,3cyclictest0-21swapper/110:53:151
10326992618,6cyclictest10307-21cyclictest07:28:231
10326992618,6cyclictest10307-21cyclictest07:28:231
10326992618,6cyclictest10307-21cyclictest07:28:231
10319992622,2cyclictest0-21swapper/011:23:120
10319992622,2cyclictest0-21swapper/011:23:120
10319992622,2cyclictest0-21swapper/011:23:120
10319992621,3cyclictest0-21swapper/012:03:220
10319992621,3cyclictest0-21swapper/012:03:220
10319992621,3cyclictest0-21swapper/009:13:200
10319992621,3cyclictest0-21swapper/009:13:200
10319992621,3cyclictest0-21swapper/009:13:200
10319992620,4cyclictest23928-21cpuspeed10:43:100
10319992620,4cyclictest23928-21cpuspeed10:43:100
10319992619,5cyclictest12948-21rt-features11:38:220
10319992619,5cyclictest12948-21rt-features11:38:220
10319992619,4cyclictest0-21swapper/011:33:130
10319992619,4cyclictest0-21swapper/011:33:130
1031999261,8cyclictest114092sed11:33:230
1031999261,8cyclictest114092sed11:33:230
1033499251,8cyclictest14681-21chrt10:18:152
1033499251,8cyclictest14681-21chrt10:18:152
1033499251,6cyclictest7959-21chrt11:26:052
1033499251,6cyclictest7959-21chrt11:26:052
1033499251,6cyclictest7959-21chrt11:26:052
1033499251,6cyclictest28362-21chrt08:00:462
1033499251,6cyclictest28362-21chrt08:00:462
1033499251,5cyclictest24024-21chrt09:14:592
1033499251,5cyclictest24024-21chrt09:14:592
1033499251,5cyclictest24024-21chrt09:14:592
1033499251,4cyclictest0-21swapper/211:53:162
1033499251,4cyclictest0-21swapper/211:53:162
1033499251,4cyclictest0-21swapper/209:38:242
1033499251,4cyclictest0-21swapper/209:38:242
10326992520,3cyclictest0-21swapper/112:13:171
10326992520,3cyclictest0-21swapper/112:13:171
10326992520,3cyclictest0-21swapper/110:18:241
10326992520,3cyclictest0-21swapper/110:18:241
10326992519,4cyclictest20065-21unixbench_multi09:03:221
10326992519,4cyclictest20065-21unixbench_multi09:03:221
10326992519,3cyclictest0-21swapper/110:53:441
10326992518,5cyclictest19355-21sshd11:57:541
10326992518,5cyclictest19355-21sshd11:57:541
10326992518,4cyclictest0-21swapper/111:28:241
10326992518,4cyclictest0-21swapper/111:28:241
10326992517,6cyclictest17345-21latency_hist08:58:141
10326992517,6cyclictest17345-21latency_hist08:58:141
10326992517,6cyclictest17345-21latency_hist08:58:141
10326992516,7cyclictest18748-21latency_hist09:03:061
10326992516,7cyclictest18748-21latency_hist09:03:061
10319992521,3cyclictest10307-21cyclictest10:13:190
10319992521,3cyclictest10307-21cyclictest10:13:190
10319992521,3cyclictest10307-21cyclictest10:13:190
10319992520,3cyclictest0-21swapper/011:13:170
10319992520,3cyclictest0-21swapper/011:13:170
10319992520,3cyclictest0-21swapper/011:13:170
10319992520,3cyclictest0-21swapper/010:23:150
10319992520,3cyclictest0-21swapper/010:23:150
10319992519,5cyclictest4737-21sshd09:50:400
10319992519,5cyclictest4737-21sshd09:50:400
10319992519,5cyclictest4737-21sshd09:50:400
10319992518,5cyclictest30997-21gltestperf08:08:150
10319992518,5cyclictest30997-21gltestperf08:08:150
10319992518,5cyclictest10601-21cat10:08:010
10319992518,5cyclictest10601-21cat10:08:010
10319992518,5cyclictest10601-21cat10:08:010
10319992518,5cyclictest10601-21cat10:08:010
1033499248,13cyclictest207272chrt07:38:352
1033499248,13cyclictest207272chrt07:38:352
1033499248,13cyclictest15152chrt08:15:262
1033499248,13cyclictest15152chrt08:15:262
1033499248,13cyclictest15152chrt08:15:262
1033499244,2cyclictest0-21swapper/209:46:152
1033499244,2cyclictest0-21swapper/209:46:152
1033499242,4cyclictest0-21swapper/212:38:242
1033499242,4cyclictest0-21swapper/212:38:242
1033499241,9cyclictest26347-21chrt12:13:242
1033499241,9cyclictest26347-21chrt12:13:242
1033499241,8cyclictest8500-21chrt10:00:502
1033499241,8cyclictest8500-21chrt10:00:502
1033499241,8cyclictest8500-21chrt10:00:502
1033499241,7cyclictest31415-21chrt09:33:492
1033499241,7cyclictest31415-21chrt09:33:492
1033499241,7cyclictest30453-21chrt08:08:022
1033499241,7cyclictest30453-21chrt08:08:022
1033499241,6cyclictest24943-21chrt12:12:402
1033499241,6cyclictest24943-21chrt12:12:402
1033499241,6cyclictest15402-21chrt11:44:542
1033499241,6cyclictest15402-21chrt11:44:542
1033499241,5cyclictest16995-21chrt07:28:302
1033499241,5cyclictest16995-21chrt07:28:302
1033499241,5cyclictest16995-21chrt07:28:302
1033499241,5cyclictest12927-21chrt08:47:022
1033499241,5cyclictest12927-21chrt08:47:022
1033499241,5cyclictest12927-21chrt08:47:022
1033499241,4cyclictest0-21swapper/211:08:202
1033499241,4cyclictest0-21swapper/211:08:202
1033499241,4cyclictest0-21swapper/211:08:202
1033499241,4cyclictest0-21swapper/211:08:202
1033499241,4cyclictest0-21swapper/209:08:212
1033499241,4cyclictest0-21swapper/209:08:212
1033499241,4cyclictest0-21swapper/209:08:212
1033499241,3cyclictest0-21swapper/210:34:322
1033499241,3cyclictest0-21swapper/210:34:322
1033499240,6cyclictest3288-21chrt08:19:122
1033499240,6cyclictest3288-21chrt08:19:122
1033499240,6cyclictest17157-21chrt11:48:322
1033499240,6cyclictest17157-21chrt11:48:322
10326992419,3cyclictest0-21swapper/111:23:211
10326992419,3cyclictest0-21swapper/111:23:211
10326992419,3cyclictest0-21swapper/111:23:211
10326992419,3cyclictest0-21swapper/109:43:131
10326992419,3cyclictest0-21swapper/109:43:131
10326992418,4cyclictest10307-21cyclictest10:48:261
10326992418,4cyclictest10307-21cyclictest10:48:261
10326992418,4cyclictest0-21swapper/111:43:011
10326992418,4cyclictest0-21swapper/111:43:011
10326992417,5cyclictest22280-21fschecks_time10:38:141
10326992416,6cyclictest23251-21cat09:13:181
10326992416,6cyclictest23251-21cat09:13:181
10326992416,6cyclictest23251-21cat09:13:181
10319992420,3cyclictest10307-21cyclictest09:58:240
10319992420,3cyclictest10307-21cyclictest09:58:240
10319992420,3cyclictest10307-21cyclictest09:58:240
10319992419,3cyclictest29787-21grep10:58:150
10319992419,3cyclictest29787-21grep10:58:150
10319992419,3cyclictest20787-21unixbench_multi11:58:220
10319992419,3cyclictest20787-21unixbench_multi11:58:220
10319992419,3cyclictest0-21swapper/012:08:160
10319992419,3cyclictest0-21swapper/012:08:160
10319992419,3cyclictest0-21swapper/007:33:240
10319992419,3cyclictest0-21swapper/007:33:240
10319992419,3cyclictest0-21swapper/007:33:240
10319992418,5cyclictest19803-21fschecks_time11:58:130
10319992418,5cyclictest19803-21fschecks_time11:58:130
10319992418,4cyclictest0-21swapper/012:28:010
10319992418,4cyclictest0-21swapper/012:28:010
10319992418,4cyclictest0-21swapper/012:28:010
10319992418,3cyclictest0-21swapper/008:58:160
10319992418,3cyclictest0-21swapper/008:58:160
10319992418,3cyclictest0-21swapper/008:58:160
10319992417,5cyclictest15309-21ntp_offset10:18:210
10319992417,5cyclictest15309-21ntp_offset10:18:210
10319992417,5cyclictest0-21swapper/008:18:250
10319992417,5cyclictest0-21swapper/008:18:250
10319992413,8cyclictest31533-21ntp_kernel_pll_12:28:200
10319992413,8cyclictest31533-21ntp_kernel_pll_12:28:200
10319992413,8cyclictest31533-21ntp_kernel_pll_12:28:200
6652231,2sleep00-21swapper/012:33:170
6652231,2sleep00-21swapper/012:33:170
10340992319,3cyclictest431rcuc/311:31:053
10340992319,3cyclictest431rcuc/311:31:053
10340992319,3cyclictest431rcuc/311:04:323
10340992319,3cyclictest431rcuc/311:04:323
10340992319,3cyclictest431rcuc/311:04:323
10340992319,3cyclictest431rcuc/308:15:043
10340992319,3cyclictest431rcuc/308:15:043
10340992319,3cyclictest431rcuc/308:15:043
1033499233,5cyclictest0-21swapper/210:38:172
1033499233,5cyclictest0-21swapper/210:38:172
1033499232,5cyclictest0-21swapper/211:38:252
1033499232,5cyclictest0-21swapper/211:38:252
1033499232,4cyclictest0-21swapper/212:23:152
1033499232,4cyclictest0-21swapper/212:23:152
1033499232,4cyclictest0-21swapper/212:23:152
1033499232,4cyclictest0-21swapper/211:33:212
1033499232,4cyclictest0-21swapper/211:33:212
1033499232,4cyclictest0-21swapper/207:43:142
1033499232,4cyclictest0-21swapper/207:43:142
1033499231,8cyclictest19048-21chrt07:35:582
1033499231,8cyclictest19048-21chrt07:35:582
1033499231,8cyclictest19048-21chrt07:35:582
1033499231,8cyclictest0-21swapper/208:58:112
1033499231,8cyclictest0-21swapper/208:58:112
1033499231,8cyclictest0-21swapper/208:58:112
1033499231,7cyclictest7145-21chrt08:30:132
1033499231,7cyclictest7145-21chrt08:30:132
1033499231,7cyclictest7145-21chrt08:30:132
1033499231,7cyclictest29854-21chrt09:32:442
1033499231,7cyclictest29854-21chrt09:32:442
1033499231,7cyclictest27022-21chrt10:48:262
1033499231,7cyclictest27022-21chrt10:48:262
1033499231,7cyclictest27022-21chrt10:48:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional