You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 12:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Thu Jun 18, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1434621350,3sleep014349-21grep20:53:190
1434621350,3sleep014349-21grep20:53:190
1434621350,3sleep014349-21grep20:53:190
124921250,2sleep10-21swapper/123:13:101
124921250,2sleep10-21swapper/123:13:101
667921040,2chrt6678-21fschecks_count23:28:080
311582880,2sleep00-21swapper/021:38:180
311582880,2sleep00-21swapper/021:38:180
207872820,3chrt0-21swapper/221:13:072
207872820,3chrt0-21swapper/221:13:072
271142740,4sleep20-21swapper/220:03:082
271142740,4sleep20-21swapper/220:03:082
74302680,3chrt0-21swapper/322:03:093
74252680,2chrt0-21swapper/023:28:160
74252680,2chrt0-21swapper/023:28:160
74252680,2chrt0-21swapper/023:28:160
137422660,3sleep20-21swapper/219:27:582
137422660,3sleep20-21swapper/219:27:582
82082640,3sleep30-21swapper/323:32:583
82082640,3sleep30-21swapper/323:32:583
82082640,3sleep30-21swapper/323:32:583
55082630,3sleep20-21swapper/221:58:092
55082630,3sleep20-21swapper/221:58:092
55082630,3sleep20-21swapper/221:58:092
233102630,3sleep20-21swapper/222:43:202
233102630,3sleep20-21swapper/222:43:202
233102630,3sleep20-21swapper/222:43:202
77682600,2sleep20-21swapper/222:03:122
77682600,2sleep20-21swapper/222:03:122
77682600,2sleep20-21swapper/222:03:122
68862590,8sleep16888-21sed23:28:091
68862590,8sleep16888-21sed23:28:091
68862590,8sleep16888-21sed23:28:091
327312580,3sleep20-21swapper/200:38:052
327312580,3sleep20-21swapper/200:38:052
327312580,3sleep20-21swapper/200:38:052
39882570,3sleep20-21swapper/221:53:112
39882570,3sleep20-21swapper/221:53:112
129902550,3chrt0-21swapper/220:51:562
129902550,3chrt0-21swapper/220:51:562
243722540,2sleep20-21swapper/219:53:192
243722540,2sleep20-21swapper/219:53:192
156902530,9sleep0171ktimers/023:52:570
156902530,9sleep0171ktimers/023:52:570
156902530,9sleep0171ktimers/023:52:570
255212490,5sleep10-21swapper/100:18:101
255212490,5sleep10-21swapper/100:18:101
255212490,5sleep10-21swapper/100:18:101
201372480,3sleep20-21swapper/200:03:122
201372480,3sleep20-21swapper/200:03:122
201372480,3sleep20-21swapper/200:03:122
8676994538,5cyclictest1-21systemd22:22:561
8676994538,5cyclictest1-21systemd22:22:561
25662440,3sleep30-21swapper/321:48:183
25662440,3sleep30-21swapper/321:48:183
25662440,3sleep30-21swapper/321:48:183
281792420,4sleep20-21swapper/200:23:182
281792420,4sleep20-21swapper/200:23:182
281792420,4sleep20-21swapper/200:23:182
254512400,2sleep30-21swapper/319:58:103
175062390,3sleep30-21swapper/319:38:003
175062390,3sleep30-21swapper/319:38:003
8676993833,3cyclictest24314-21cron21:22:561
8676993833,3cyclictest24314-21cron21:22:561
8676993833,3cyclictest24314-21cron21:22:561
209752380,3sleep30-21swapper/300:03:453
209752380,3sleep30-21swapper/300:03:453
209752380,3sleep30-21swapper/300:03:453
237052370,3sleep30-21swapper/321:18:193
237052370,3sleep30-21swapper/321:18:193
237052370,3sleep30-21swapper/321:18:193
164022360,4sleep30-21swapper/323:53:123
164022360,4sleep30-21swapper/323:53:123
164022360,4sleep30-21swapper/323:53:123
8676993527,6cyclictest25806-21netstat19:58:151
8673993529,3cyclictest4399-21latency_hist23:22:560
8673993529,3cyclictest4399-21latency_hist23:22:560
273472350,1sleep00-21swapper/021:28:170
273472350,1sleep00-21swapper/021:28:170
259392350,3sleep20-21swapper/221:24:382
259392350,3sleep20-21swapper/221:24:382
171962350,2sleep30-21swapper/322:28:133
171962350,2sleep30-21swapper/322:28:133
171962350,2sleep30-21swapper/322:28:133
8676993426,6cyclictest6488-21netstat20:33:121
8676993426,6cyclictest6488-21netstat20:33:121
283532340,2chrt0-21swapper/322:58:123
283532340,2chrt0-21swapper/322:58:123
130572340,2chrt13055-21sed22:18:090
130572340,2chrt13055-21sed22:18:090
115452340,3chrt0-21swapper/320:48:073
115452340,3chrt0-21swapper/320:48:073
8676993327,4cyclictest8652-21cyclictest20:08:061
8676993327,4cyclictest8652-21cyclictest20:08:061
8676993327,4cyclictest7303-21fschecks_time22:03:081
8676993327,4cyclictest7303-21fschecks_time22:03:081
8676993326,5cyclictest14678-21systemd-journal20:08:351
8676993326,5cyclictest14678-21systemd-journal20:08:351
8676993326,4cyclictest14678-21systemd-journal22:15:121
8676993326,4cyclictest14678-21systemd-journal22:15:121
8676993326,4cyclictest14678-21systemd-journal22:15:121
8676993325,5cyclictest10798-21needreboot19:18:131
8676993325,5cyclictest10798-21needreboot19:18:131
8676993325,5cyclictest10798-21needreboot19:18:131
8673993326,5cyclictest575-21thd22:48:110
8673993326,5cyclictest575-21thd22:48:110
8673993326,5cyclictest575-21thd22:48:110
8673993326,5cyclictest31444-21ntp_offset20:13:150
8673993326,5cyclictest31444-21ntp_offset20:13:150
8673993320,11cyclictest0-21swapper/019:33:080
8676993226,4cyclictest18007-21sshd22:31:121
8676993226,4cyclictest18007-21sshd22:31:121
8676993226,4cyclictest18007-21sshd22:31:121
8676993225,6cyclictest14678-21systemd-journal23:36:121
8676993225,6cyclictest14678-21systemd-journal23:36:121
8676993225,6cyclictest14678-21systemd-journal23:36:121
8676993225,5cyclictest26231-21latency_hist21:27:581
8676993225,5cyclictest26231-21latency_hist21:27:581
8676993224,5cyclictest674-21gpm20:43:131
8676993224,5cyclictest674-21gpm20:43:131
8676993224,5cyclictest0-21swapper/100:03:131
8676993224,5cyclictest0-21swapper/100:03:131
8676993224,5cyclictest0-21swapper/100:03:131
8673993226,5cyclictest11411-21latency_hist20:48:050
8673993226,5cyclictest11411-21latency_hist20:48:050
8673993226,4cyclictest0-21swapper/023:02:560
8673993226,4cyclictest0-21swapper/023:02:560
8673993225,5cyclictest15255-21sshd19:29:120
8673993225,5cyclictest15255-21sshd19:29:120
8673993224,5cyclictest22806-21sshd00:08:230
8673993224,5cyclictest22806-21sshd00:08:230
8673993224,5cyclictest22806-21sshd00:08:230
8673993219,11cyclictest0-21swapper/019:53:090
8673993219,11cyclictest0-21swapper/019:53:090
83352320,3sleep30-21swapper/320:38:143
83352320,3sleep30-21swapper/320:38:143
303072320,3sleep30-21swapper/321:38:083
303072320,3sleep30-21swapper/321:38:083
194382320,3sleep30-21swapper/300:02:573
194382320,3sleep30-21swapper/300:02:573
150412320,4sleep20-21swapper/220:57:592
150412320,4sleep20-21swapper/220:57:592
150412320,4sleep20-21swapper/220:57:592
8676993127,3cyclictest8652-21cyclictest21:08:171
8676993127,3cyclictest8652-21cyclictest21:08:171
8676993126,3cyclictest547-21rs:main1
8676993126,3cyclictest547-21rs:main1
8676993125,5cyclictest22593-21kernelversion22:43:121
8676993125,5cyclictest22593-21kernelversion22:43:121
8676993124,5cyclictest749-21runrttasks23:48:141
8676993124,5cyclictest749-21runrttasks23:48:141
8676993124,5cyclictest749-21runrttasks23:48:141
8676993124,5cyclictest30862-21cpu00:33:061
8676993124,5cyclictest30862-21cpu00:33:061
8676993124,5cyclictest27863-21fschecks_count22:58:091
8676993124,5cyclictest27863-21fschecks_count22:58:091
8673993126,4cyclictest14678-21systemd-journal00:07:230
8673993126,4cyclictest14678-21systemd-journal00:07:230
8673993126,4cyclictest14678-21systemd-journal00:07:230
8673993125,4cyclictest14181-21fschecks_count23:48:080
8673993125,4cyclictest14181-21fschecks_count23:48:080
8673993124,5cyclictest30195-21sshd23:03:120
8673993124,5cyclictest30195-21sshd23:03:120
8673993124,5cyclictest30195-21sshd23:03:120
8673993124,5cyclictest30195-21sshd23:03:120
8673993124,5cyclictest18524-21fschecks_time22:33:080
8673993124,5cyclictest18524-21fschecks_time22:33:080
8673993124,5cyclictest18524-21fschecks_time22:33:080
8673993122,6cyclictest20370-21uname19:43:180
8673993122,6cyclictest20370-21uname19:43:180
64952310,1sleep3431rcuc/320:33:123
64952310,1sleep3431rcuc/320:33:123
8678993025,3cyclictest351rcuc/221:06:252
8678993025,3cyclictest351rcuc/221:06:252
8678993025,3cyclictest351rcuc/221:06:252
8676993023,6cyclictest550-21cron21:03:041
8676993023,6cyclictest550-21cron21:03:041
8676993023,6cyclictest550-21cron21:03:041
8676993022,6cyclictest11624-21sshd23:39:121
8676993022,6cyclictest11624-21sshd23:39:121
8676993022,6cyclictest11624-21sshd23:39:121
8673993026,2cyclictest0-21swapper/000:03:100
8673993025,3cyclictest8652-21cyclictest22:48:150
8673993025,3cyclictest8652-21cyclictest22:48:150
8673993025,3cyclictest8652-21cyclictest22:48:150
8673993025,3cyclictest14678-21systemd-journal00:27:570
8673993025,3cyclictest14678-21systemd-journal00:27:570
8673993025,3cyclictest14678-21systemd-journal00:27:570
8673993024,4cyclictest8652-21cyclictest19:33:170
8673993024,4cyclictest8652-21cyclictest19:33:170
8673993021,7cyclictest18840-21latency_hist21:08:030
8673993021,7cyclictest18840-21latency_hist21:08:030
8673993021,7cyclictest18840-21latency_hist21:08:030
8676992924,4cyclictest13876-21latency_hist19:28:051
8676992924,4cyclictest13876-21latency_hist19:28:051
8676992923,4cyclictest19275-21wc19:42:561
8676992923,4cyclictest19275-21wc19:42:561
8676992922,5cyclictest2421-21idleruntime20:23:101
8676992922,5cyclictest2421-21idleruntime20:23:101
8676992922,5cyclictest2421-21idleruntime20:23:101
8676992921,6cyclictest30914-21fschecks_time20:13:091
8676992921,6cyclictest30914-21fschecks_time20:13:091
867399295,4cyclictest700-21192.168.115.40-manager22:02:590
867399295,4cyclictest700-21192.168.115.40-manager22:02:590
867399295,4cyclictest700-21192.168.115.40-manager22:02:590
8673992924,4cyclictest10448-21fschecks_count23:38:080
8673992924,4cyclictest10448-21fschecks_count23:38:080
8673992922,5cyclictest10056-21sh23:38:090
8673992922,5cyclictest10056-21sh23:38:090
8673992922,5cyclictest10056-21sh23:38:090
8673992919,8cyclictest22155-21sort22:43:080
8673992919,8cyclictest22155-21sort22:43:080
8673992919,8cyclictest22155-21sort22:43:080
867899285,13cyclictest0-21swapper/200:03:102
8676992823,3cyclictest9040-21cpuspeed22:08:071
8676992823,3cyclictest9040-21cpuspeed22:08:071
8676992823,3cyclictest9040-21cpuspeed22:08:071
8676992822,4cyclictest1237-21cron21:47:561
8676992822,4cyclictest1237-21cron21:47:561
8676992821,5cyclictest31947-21latency_hist21:43:021
8676992821,5cyclictest31947-21latency_hist21:43:021
8676992821,5cyclictest26553-21ntp_kernel_pll_22:53:141
8676992820,6cyclictest17023-21ls22:28:111
8673992822,5cyclictest615-21kernelversion20:18:100
8673992822,5cyclictest18475-21netstat23:58:140
8673992822,4cyclictest23163-21kernelversion21:18:110
8673992822,4cyclictest23163-21kernelversion21:18:110
8673992822,4cyclictest23163-21kernelversion21:18:110
8673992821,5cyclictest0-21swapper/019:42:560
8673992821,5cyclictest0-21swapper/019:42:560
8676992723,3cyclictest8652-21cyclictest22:58:171
8676992723,3cyclictest8652-21cyclictest22:58:171
8676992723,3cyclictest20514-21gltestperf22:38:101
8676992723,3cyclictest20514-21gltestperf22:38:101
8676992722,4cyclictest876-21ntp_offset20:18:141
8676992721,5cyclictest21338-21latency21:13:111
8676992721,5cyclictest21338-21latency21:13:111
8676992720,4cyclictest0-21swapper/123:08:121
8676992719,6cyclictest3668-21grep23:18:171
8676992719,6cyclictest3668-21grep23:18:171
8673992723,3cyclictest8652-21cyclictest00:33:160
8673992723,3cyclictest8652-21cyclictest00:33:160
8673992723,3cyclictest8652-21cyclictest00:33:160
8673992720,5cyclictest16779-21gltestperf22:28:090
8673992720,5cyclictest16779-21gltestperf22:28:090
8673992718,7cyclictest4925-21cat20:28:190
8673992718,7cyclictest4925-21cat20:28:190
243412270,4sleep30-21swapper/300:13:183
243412270,4sleep30-21swapper/300:13:183
243412270,4sleep30-21swapper/300:13:183
8676992621,4cyclictest1616-21sendmail-mta20:48:141
8676992621,4cyclictest1616-21sendmail-mta20:48:141
8676992619,5cyclictest24337-21switchtime00:13:181
8676992619,5cyclictest24337-21switchtime00:13:181
8676992619,5cyclictest24337-21switchtime00:13:181
8676992618,6cyclictest31818-21ls00:33:171
8676992618,6cyclictest31818-21ls00:33:171
8676992618,6cyclictest31818-21ls00:33:171
8673992622,2cyclictest0-21swapper/019:18:160
8673992622,2cyclictest0-21swapper/019:18:160
8673992622,2cyclictest0-21swapper/019:18:160
8673992621,3cyclictest8652-21cyclictest23:08:190
8673992621,3cyclictest0-21swapper/023:23:090
8673992620,4cyclictest0-21swapper/023:53:180
8673992620,4cyclictest0-21swapper/023:53:180
8673992620,4cyclictest0-21swapper/023:53:180
8673992619,5cyclictest6652-21sendmail_mailqu20:33:150
8673992619,5cyclictest6652-21sendmail_mailqu20:33:150
8673992618,6cyclictest21664-21gunzip21:13:160
8673992618,6cyclictest21664-21gunzip21:13:160
867899255,14cyclictest0-21swapper/200:03:032
8678992519,4cyclictest351rcuc/200:19:332
8678992519,4cyclictest351rcuc/200:19:332
8678992519,4cyclictest351rcuc/200:19:332
8676992521,2cyclictest0-21swapper/122:38:121
8676992520,3cyclictest0-21swapper/120:28:181
8676992520,3cyclictest0-21swapper/120:28:181
8676992519,4cyclictest18793-21timerandwakeup23:58:191
8676992519,4cyclictest18793-21timerandwakeup23:58:191
8676992518,5cyclictest0-21swapper/121:48:161
8676992518,5cyclictest0-21swapper/121:48:161
8676992518,5cyclictest0-21swapper/121:48:161
8673992521,3cyclictest27647-21grep20:03:130
8673992521,3cyclictest27647-21grep20:03:130
8673992519,4cyclictest1018-21fschecks_count23:13:090
8673992519,4cyclictest1018-21fschecks_count23:13:090
8673992519,4cyclictest0-21swapper/021:23:190
8673992519,4cyclictest0-21swapper/021:23:190
8673992519,4cyclictest0-21swapper/020:58:120
8673992519,4cyclictest0-21swapper/020:58:120
8673992518,5cyclictest8652-21cyclictest20:03:000
8673992518,5cyclictest3820-21kernelversion21:53:100
8673992518,5cyclictest3820-21kernelversion21:53:100
8673992518,5cyclictest29600-21sshd21:33:500
8673992518,5cyclictest0-21swapper/020:38:100
8673992518,5cyclictest0-21swapper/020:38:100
301942250,3sleep30-21swapper/320:09:123
301942250,3sleep30-21swapper/320:09:123
226822250,2sleep122685-21grep00:08:221
226822250,2sleep122685-21grep00:08:221
226822250,2sleep122685-21grep00:08:221
8679992420,3cyclictest431rcuc/322:50:463
8679992420,3cyclictest431rcuc/322:50:463
8679992420,3cyclictest431rcuc/322:50:463
8679992419,3cyclictest431rcuc/320:57:173
8679992419,3cyclictest431rcuc/320:57:173
8679992419,3cyclictest431rcuc/320:57:173
8679992419,3cyclictest431rcuc/320:30:563
8679992419,3cyclictest431rcuc/320:30:563
8676992419,3cyclictest0-21swapper/122:28:091
8676992418,4cyclictest14245-21sed19:28:091
8676992418,4cyclictest14245-21sed19:28:091
8676992418,4cyclictest14245-21sed19:28:091
8676992418,3cyclictest0-21swapper/100:42:571
8676992418,3cyclictest0-21swapper/100:42:571
8676992417,5cyclictest28774-21kernelversion21:33:121
8676992417,4cyclictest0-21swapper/120:58:181
8676992417,4cyclictest0-21swapper/120:58:181
8676992417,4cyclictest0-21swapper/119:43:181
8676992417,4cyclictest0-21swapper/119:43:181
8676992415,7cyclictest13150-21ls23:43:161
8676992415,7cyclictest13150-21ls23:43:161
8673992420,2cyclictest0-21swapper/022:33:160
8673992420,2cyclictest0-21swapper/022:33:160
8673992419,4cyclictest572-21cups-browsed22:03:160
8673992419,4cyclictest572-21cups-browsed22:03:160
8673992419,4cyclictest572-21cups-browsed22:03:160
8673992419,3cyclictest20568-21cron21:12:560
8673992419,3cyclictest20568-21cron21:12:560
8673992418,5cyclictest2895-21rt-features20:23:170
8673992418,5cyclictest2895-21rt-features20:23:170
8673992418,5cyclictest2895-21rt-features20:23:170
8673992418,4cyclictest9061-21sshd23:33:120
8673992418,4cyclictest21702-21gltestperf19:48:090
8673992418,4cyclictest21702-21gltestperf19:48:090
8673992418,4cyclictest21702-21gltestperf19:48:090
8673992418,4cyclictest0-21swapper/020:08:110
8673992418,4cyclictest0-21swapper/020:08:110
8673992418,3cyclictest0-21swapper/000:38:150
8673992418,3cyclictest0-21swapper/000:38:150
8673992417,5cyclictest24059-21needreboot00:13:140
8673992417,5cyclictest24059-21needreboot00:13:140
8673992417,5cyclictest24059-21needreboot00:13:140
325352240,3sleep30-21swapper/321:43:113
325352240,3sleep30-21swapper/321:43:113
104562240,4sleep30-21swapper/323:38:083
104562240,4sleep30-21swapper/323:38:083
8679992317,4cyclictest431rcuc/321:58:593
8679992317,4cyclictest431rcuc/321:58:593
8678992319,3cyclictest351rcuc/221:45:362
8678992319,3cyclictest351rcuc/221:45:362
8678992319,3cyclictest351rcuc/221:40:052
8678992319,3cyclictest351rcuc/221:40:052
8678992318,4cyclictest351rcuc/221:15:052
8678992318,4cyclictest351rcuc/221:15:052
867699238,13cyclictest14678-21systemd-journal19:55:101
867699238,13cyclictest14678-21systemd-journal19:55:101
8676992319,2cyclictest0-21swapper/122:43:191
8676992319,2cyclictest0-21swapper/122:43:191
8676992319,2cyclictest0-21swapper/122:43:191
8676992318,4cyclictest14678-21systemd-journal23:03:101
8676992318,4cyclictest14678-21systemd-journal23:03:101
8676992318,4cyclictest14678-21systemd-journal23:03:101
8676992318,4cyclictest14678-21systemd-journal23:03:101
8676992318,3cyclictest0-21swapper/122:08:101
8676992318,3cyclictest0-21swapper/122:08:101
8676992318,3cyclictest0-21swapper/122:08:101
8676992318,3cyclictest0-21swapper/121:58:181
8676992318,2cyclictest0-21swapper/120:38:201
8676992318,2cyclictest0-21swapper/120:38:201
8676992317,4cyclictest25906-21fschecks_count22:53:091
8676992317,4cyclictest25906-21fschecks_count22:53:091
8676992317,4cyclictest25906-21fschecks_count22:53:091
8676992317,4cyclictest17798-21cpuspeed23:58:081
8676992317,4cyclictest17798-21cpuspeed23:58:081
8676992317,4cyclictest17798-21cpuspeed23:58:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional