You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 11:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Wed Jul 01, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1564221170,3sleep30-21swapper/300:08:133
1564221170,3sleep30-21swapper/300:08:133
1564221170,3sleep30-21swapper/300:08:133
726821160,3sleep30-21swapper/319:23:313
3165521100,3sleep30-21swapper/321:58:083
3165521100,3sleep30-21swapper/321:58:083
3165521100,3sleep30-21swapper/321:58:083
256392840,3sleep30-21swapper/320:13:283
184602760,3sleep00-21swapper/019:53:320
184602760,3sleep00-21swapper/019:53:320
184602760,3sleep00-21swapper/019:53:320
54602750,3sleep30-21swapper/320:48:133
54602750,3sleep30-21swapper/320:48:133
48872750,2chrt0-21swapper/023:38:230
167582650,3sleep20-21swapper/200:13:182
167582650,3sleep20-21swapper/200:13:182
167582650,3sleep20-21swapper/200:13:182
218742630,3sleep20-21swapper/222:58:172
218742630,3sleep20-21swapper/222:58:172
218742630,3sleep20-21swapper/222:58:172
110142630,4chrt0-21swapper/221:03:082
110142630,4chrt0-21swapper/221:03:082
2499996256,3cyclictest0-21swapper/000:03:410
2499996256,3cyclictest0-21swapper/000:03:410
2499996256,3cyclictest0-21swapper/000:03:410
279392590,3sleep10-21swapper/121:48:091
279392590,3sleep10-21swapper/121:48:091
213452580,7sleep0171ktimers/000:23:330
213452580,7sleep0171ktimers/000:23:330
233292570,3chrt0-21swapper/200:29:182
233292570,3chrt0-21swapper/200:29:182
312442560,3sleep30-21swapper/320:28:273
312442560,3sleep30-21swapper/320:28:273
273442560,2chrt24407-21kworker/0:0-events_power_efficient20:18:230
273442560,2chrt24407-21kworker/0:0-events_power_efficient20:18:230
319772490,3sleep20-21swapper/223:23:252
319772490,3sleep20-21swapper/223:23:252
43072480,3chrt0-21swapper/323:38:103
43072480,3chrt0-21swapper/323:38:103
239072470,3chrt0-21swapper/320:08:303
239072470,3chrt0-21swapper/320:08:303
267092430,1sleep00-21swapper/021:43:220
267092430,1sleep00-21swapper/021:43:220
264242430,3sleep00-21swapper/000:38:290
264242430,3sleep00-21swapper/000:38:290
264242430,3sleep00-21swapper/000:38:290
249999434,29cyclictest14256-21cut00:03:220
147312430,3sleep00-21swapper/019:43:300
147312430,3sleep00-21swapper/019:43:300
12872430,3sleep01290-21latency_hist22:03:200
12872430,3sleep01290-21latency_hist22:03:200
299032420,4chrt0-21swapper/323:18:243
299032420,4chrt0-21swapper/323:18:243
2499994234,6cyclictest26063-21sendmail21:43:080
2499994234,6cyclictest26063-21sendmail21:43:080
218342420,2sleep30-21swapper/321:28:293
218342420,2sleep30-21swapper/321:28:293
124492420,2sleep111758-21/usr/sbin/munin19:38:261
124492420,2sleep111758-21/usr/sbin/munin19:38:261
250099402,30cyclictest13817-21cat00:03:161
250099402,30cyclictest13817-21cat00:03:161
250099402,30cyclictest13817-21cat00:03:161
227452400,3sleep00-21swapper/000:28:280
227452400,3sleep00-21swapper/000:28:280
121702390,2sleep20-21swapper/219:38:222
121702390,2sleep20-21swapper/219:38:222
106122380,3sleep10-21swapper/123:53:231
106122380,3sleep10-21swapper/123:53:231
106122380,3sleep10-21swapper/123:53:231
310412370,2sleep00-21swapper/023:22:550
310412370,2sleep00-21swapper/023:22:550
106722370,3chrt0-21swapper/219:33:272
106722370,3chrt0-21swapper/219:33:272
106722370,3chrt0-21swapper/219:33:272
291852360,3sleep30-21swapper/321:48:323
291852360,3sleep30-21swapper/321:48:323
261802360,2sleep30-21swapper/323:08:233
261802360,2sleep30-21swapper/323:08:233
261802360,2sleep30-21swapper/323:08:233
2499993628,6cyclictest545-21in:imuxsock00:14:470
2499993628,6cyclictest545-21in:imuxsock00:14:470
2499993628,6cyclictest20871-21cut21:28:190
2499993628,6cyclictest20871-21cut21:28:190
212772360,2sleep021409-21/usr/sbin/munin20:03:210
212772360,2sleep021409-21/usr/sbin/munin20:03:210
141022360,2chrt0-21swapper/200:03:212
141022360,2chrt0-21swapper/200:03:212
141022360,2chrt0-21swapper/200:03:212
2499993528,5cyclictest12829-21fschecks_time22:33:210
2499993528,5cyclictest12829-21fschecks_time22:33:210
2500993425,7cyclictest14809-21sh21:13:111
2500993425,7cyclictest14809-21sh21:13:111
2500993425,7cyclictest14809-21sh21:13:111
2499993425,7cyclictest29649-21threads20:23:310
2499993425,7cyclictest29649-21threads20:23:310
88712330,3chrt0-21swapper/223:48:262
88712330,3chrt0-21swapper/223:48:262
52722330,3sleep20-21swapper/223:38:292
2500993313,5cyclictest0-21swapper/100:33:291
2500993313,5cyclictest0-21swapper/100:33:291
2499993324,7cyclictest11872-21needreboot21:03:250
2499993324,7cyclictest11872-21needreboot21:03:250
2499993324,7cyclictest11872-21needreboot21:03:250
62222320,3chrt0-21swapper/220:48:242
62222320,3chrt0-21swapper/220:48:242
62222320,3chrt0-21swapper/220:48:242
311582320,3sleep00-21swapper/020:28:240
311582320,3sleep00-21swapper/020:28:240
250199323,19cyclictest15130-21chrt00:03:332
250199323,19cyclictest15130-21chrt00:03:332
250199323,19cyclictest15130-21chrt00:03:332
2500993226,4cyclictest1-21systemd19:58:301
2500993225,5cyclictest16155-21latency_hist00:13:191
2500993225,5cyclictest16155-21latency_hist00:13:191
2500993225,5cyclictest16155-21latency_hist00:13:191
2499993224,6cyclictest31802-21kernelversion23:23:230
2499993224,6cyclictest31802-21kernelversion23:23:230
39792310,3chrt0-21swapper/222:08:282
39792310,3chrt0-21swapper/222:08:282
39792310,3chrt0-21swapper/222:08:282
2500993126,3cyclictest0-21swapper/122:58:191
2500993126,3cyclictest0-21swapper/122:58:191
2500993126,3cyclictest0-21swapper/122:58:191
2500993123,6cyclictest12422-21latency_hist22:33:111
2500993123,6cyclictest12422-21latency_hist22:33:111
2499993125,4cyclictest11776-21cron23:58:080
2499993125,4cyclictest11776-21cron23:58:080
2499993125,4cyclictest11776-21cron23:58:080
2499993125,4cyclictest0-21swapper/020:43:080
2499993123,6cyclictest5592-21cpu20:48:190
250299301,21cyclictest14259-21chrt00:03:223
2500993025,3cyclictest1076-21cron22:03:081
2500993025,3cyclictest1076-21cron22:03:081
2500993025,3cyclictest0-21swapper/100:03:301
2500993025,3cyclictest0-21swapper/100:03:301
2500993025,3cyclictest0-21swapper/100:03:301
2500993024,4cyclictest26045-21latency_hist21:43:081
2500993024,4cyclictest26045-21latency_hist21:43:081
2500993023,5cyclictest15153-21needreboot22:38:261
2500993023,5cyclictest15153-21needreboot22:38:261
2500993022,6cyclictest2005-21needreboot22:03:271
2500993022,6cyclictest2005-21needreboot22:03:271
2500993021,7cyclictest29152-21threads21:48:311
2500993021,7cyclictest29152-21threads21:48:311
2500993019,6cyclictest1-21systemd19:53:181
2500993019,6cyclictest1-21systemd19:53:181
249999309,9cyclictest16-21ksoftirqd/022:05:080
249999309,9cyclictest16-21ksoftirqd/022:05:080
249999308,6cyclictest16-21ksoftirqd/023:49:110
249999308,6cyclictest16-21ksoftirqd/023:49:110
2499993026,3cyclictest90-1pr/ttyS020:15:350
2499993024,4cyclictest32536-21fschecks_count20:33:210
2499993024,4cyclictest32536-21fschecks_count20:33:210
2499993024,4cyclictest32536-21fschecks_count20:33:210
2499993024,4cyclictest0-21swapper/022:13:190
2499993024,4cyclictest0-21swapper/022:13:190
2499993024,4cyclictest0-21swapper/022:13:190
2499993012,3cyclictest171ktimers/022:15:480
2499993012,3cyclictest171ktimers/022:15:480
2499993011,7cyclictest16-21ksoftirqd/022:24:390
2499993011,7cyclictest16-21ksoftirqd/022:24:390
2499993011,7cyclictest16-21ksoftirqd/022:24:390
2499993011,7cyclictest16-21ksoftirqd/022:24:390
138522300,3sleep013885-21awk21:08:290
138522300,3sleep013885-21awk21:08:290
138522300,3sleep013885-21awk21:08:290
2500992923,4cyclictest28978-21cut20:23:231
2500992923,4cyclictest28978-21cut20:23:231
2500992922,5cyclictest550-21cron21:33:211
2500992922,5cyclictest550-21cron21:33:211
2500992922,5cyclictest25468-21latency_hist23:08:081
2500992922,5cyclictest25468-21latency_hist23:08:081
2500992921,6cyclictest8456-21threads20:53:301
2500992921,6cyclictest8456-21threads20:53:301
249999298,4cyclictest171ktimers/022:40:080
249999298,4cyclictest171ktimers/022:40:080
249999294,8cyclictest16-21ksoftirqd/023:59:120
249999294,8cyclictest16-21ksoftirqd/023:59:120
249999294,7cyclictest16-21ksoftirqd/020:59:060
249999294,7cyclictest16-21ksoftirqd/020:59:060
2499992923,4cyclictest749-21runrttasks23:03:220
2499992923,4cyclictest749-21runrttasks23:03:220
2499992922,5cyclictest16085-21sshd00:12:190
2499992922,5cyclictest16085-21sshd00:12:190
2499992922,5cyclictest16085-21sshd00:12:190
2499992922,5cyclictest11597-21wc22:28:300
2499992922,5cyclictest11597-21wc22:28:300
2499992921,2cyclictest181rcu_preempt20:47:340
2499992920,2cyclictest181rcu_preempt19:52:090
2499992920,2cyclictest181rcu_preempt19:52:090
2499992914,2cyclictest181rcu_preempt20:50:060
2499992914,2cyclictest181rcu_preempt20:50:060
2499992914,2cyclictest181rcu_preempt20:50:060
120982290,3sleep20-21swapper/223:58:192
120982290,3sleep20-21swapper/223:58:192
120982290,3sleep20-21swapper/223:58:192
69882280,3sleep30-21swapper/322:18:183
69882280,3sleep30-21swapper/322:18:183
250299281,21cyclictest13791-21chrt00:03:143
250299281,21cyclictest13791-21chrt00:03:143
2500992824,3cyclictest1476-21ntp_offset23:28:271
2500992822,5cyclictest5314-21cut22:13:211
2500992822,5cyclictest5314-21cut22:13:211
250099281,10cyclictest47732timerwakeupswit20:43:321
250099281,10cyclictest47732timerwakeupswit20:43:321
2499992821,5cyclictest27029-21sshd23:09:180
2499992821,5cyclictest27029-21sshd23:09:180
2499992821,5cyclictest27029-21sshd23:09:180
2499992815,3cyclictest90-1pr/ttyS000:37:210
2499992815,3cyclictest90-1pr/ttyS000:37:210
2499992810,4cyclictest201rcuc/023:15:100
2499992810,4cyclictest201rcuc/023:15:100
250199271,9cyclictest19091-21chrt21:23:222
250199271,9cyclictest19091-21chrt21:23:222
2500992721,5cyclictest26460-21ntp_offset00:38:301
2500992721,5cyclictest26460-21ntp_offset00:38:301
2500992721,5cyclictest26460-21ntp_offset00:38:301
2500992721,4cyclictest8167-21latency_hist23:48:161
2500992721,4cyclictest8167-21latency_hist23:48:161
2500992721,3cyclictest0-21swapper/123:08:291
2500992721,3cyclictest0-21swapper/123:08:291
2500992721,3cyclictest0-21swapper/123:08:291
2500992720,4cyclictest8580-21latency19:28:231
2500992720,4cyclictest8580-21latency19:28:231
2500992720,4cyclictest8580-21latency19:28:231
2500992718,7cyclictest20607-21cpu21:28:171
2500992718,7cyclictest20607-21cpu21:28:171
2500992718,7cyclictest1-21systemd00:32:181
2500992718,7cyclictest1-21systemd00:32:181
249999278,9cyclictest16-21ksoftirqd/023:03:190
249999278,9cyclictest16-21ksoftirqd/023:03:190
249999278,5cyclictest171ktimers/020:12:320
249999278,5cyclictest171ktimers/020:12:320
249999276,7cyclictest16-21ksoftirqd/019:38:210
249999276,7cyclictest16-21ksoftirqd/019:38:210
249999273,6cyclictest201rcuc/019:34:070
249999273,6cyclictest201rcuc/019:34:070
249999273,6cyclictest201rcuc/019:34:070
2499992722,4cyclictest2497-21cyclictest23:43:190
2499992722,4cyclictest2497-21cyclictest23:43:190
2499992722,3cyclictest22315-21sed22:58:210
2499992721,5cyclictest735-21systemd-logind21:53:310
2499992721,5cyclictest735-21systemd-logind21:53:310
2499992721,5cyclictest735-21systemd-logind21:53:310
2499992721,4cyclictest8709-21needreboot19:28:250
2499992721,4cyclictest8709-21needreboot19:28:250
2499992721,4cyclictest8709-21needreboot19:28:250
2499992721,3cyclictest0-21swapper/021:28:290
2499992721,3cyclictest0-21swapper/021:28:290
2499992718,7cyclictest15479-21if_eth021:13:240
2499992718,7cyclictest15479-21if_eth021:13:240
2499992718,7cyclictest15479-21if_eth021:13:240
2499992718,2cyclictest181rcu_preempt22:23:200
2499992718,2cyclictest181rcu_preempt22:23:200
2499992710,4cyclictest171ktimers/020:53:360
2499992710,4cyclictest171ktimers/020:53:360
192342270,3chrt0-21swapper/000:18:310
192342270,3chrt0-21swapper/000:18:310
188792270,5sleep00-21swapper/021:23:200
250199269,13cyclictest3402chrt21:58:312
250199269,13cyclictest3402chrt21:58:312
250199261,6cyclictest18503-21taskset21:22:252
250199261,6cyclictest18503-21taskset21:22:252
2500992621,3cyclictest0-21swapper/122:48:081
2500992621,3cyclictest0-21swapper/122:48:081
2500992620,5cyclictest2428-21missed_timers20:38:241
2500992619,6cyclictest3695-21kernelversion22:08:241
2500992619,5cyclictest1346-21avahi-daemon21:03:291
2500992619,5cyclictest1346-21avahi-daemon21:03:291
2500992619,5cyclictest1346-21avahi-daemon21:03:291
2500992618,6cyclictest749-21runrttasks19:53:211
2500992618,6cyclictest749-21runrttasks19:53:211
2500992618,6cyclictest749-21runrttasks19:53:211
2500992618,5cyclictest7320-21latency_hist20:53:141
2500992618,5cyclictest7320-21latency_hist20:53:141
2500992618,5cyclictest7320-21latency_hist20:53:141
2500992617,7cyclictest8414-21cut23:48:221
2500992617,7cyclictest8414-21cut23:48:221
249999268,6cyclictest16-21ksoftirqd/021:53:190
249999268,6cyclictest16-21ksoftirqd/021:53:190
249999266,3cyclictest166392fschecks_time22:43:210
249999266,3cyclictest166392fschecks_time22:43:210
2499992621,4cyclictest20410-21gltestperf22:53:240
2499992621,4cyclictest20410-21gltestperf22:53:240
2499992620,4cyclictest19605-21gltestperf19:58:220
2499992620,3cyclictest0-21swapper/022:58:290
2499992619,4cyclictest0-21swapper/019:23:300
35202251,19sleep10-21swapper/123:33:301
35202251,19sleep10-21swapper/123:33:301
325862250,3sleep20-21swapper/220:33:212
325862250,3sleep20-21swapper/220:33:212
325862250,3sleep20-21swapper/220:33:212
250199258,14cyclictest262962chrt20:15:162
250199255,2cyclictest0-21swapper/221:39:382
250199255,2cyclictest0-21swapper/221:39:382
250199251,9cyclictest17826-21chrt22:45:552
250199251,9cyclictest17826-21chrt22:45:552
250199251,9cyclictest17766-21chrt00:14:552
250199251,9cyclictest17766-21chrt00:14:552
250199251,9cyclictest15139-21chrt19:45:412
250199251,9cyclictest15139-21chrt19:45:412
250199251,9cyclictest12526-21chrt21:03:562
250199251,9cyclictest12526-21chrt21:03:562
250199251,9cyclictest12526-21chrt21:03:562
250199251,6cyclictest7914-21chrt23:46:452
250199251,6cyclictest7914-21chrt23:46:452
250199251,6cyclictest24521-21chrt20:11:222
250199251,6cyclictest24521-21chrt20:11:222
250199251,6cyclictest19810-21chrt22:52:302
250199251,6cyclictest19810-21chrt22:52:302
250199251,6cyclictest19729-21chrt00:21:102
250199251,6cyclictest19729-21chrt00:21:102
250199251,6cyclictest18869-21chrt19:55:462
250199251,6cyclictest18869-21chrt19:55:462
250199251,6cyclictest18869-21chrt19:55:462
250199251,6cyclictest14128-21chrt22:36:342
250199251,6cyclictest14128-21chrt22:36:342
250199251,5cyclictest0-21swapper/222:33:092
250199251,5cyclictest0-21swapper/222:33:092
250199251,4cyclictest29682sleep222:08:082
250199251,4cyclictest29682sleep222:08:082
2500992520,3cyclictest0-21swapper/121:23:081
2500992520,3cyclictest0-21swapper/121:23:081
2500992519,5cyclictest13868-21fschecks_count19:43:211
2500992519,5cyclictest13868-21fschecks_count19:43:211
2500992519,4cyclictest829-21df_inode23:28:201
2500992519,4cyclictest829-21df_inode23:28:201
2500992519,4cyclictest22692-21ntp_states22:58:271
2500992519,4cyclictest22692-21ntp_states22:58:271
2500992519,4cyclictest22692-21ntp_states22:58:271
2500992518,6cyclictest23877-21rt-features20:08:291
2500992518,6cyclictest23877-21rt-features20:08:291
2500992518,5cyclictest22815-21latency_hist20:08:081
2500992518,5cyclictest22815-21latency_hist20:08:081
2500992517,6cyclictest1576-21latency_hist20:38:081
2500992517,6cyclictest1576-21latency_hist20:38:081
2500992517,6cyclictest1576-21latency_hist20:38:081
249999257,5cyclictest171ktimers/022:48:250
249999257,5cyclictest171ktimers/022:48:250
249999255,6cyclictest16-21ksoftirqd/021:33:220
249999255,6cyclictest16-21ksoftirqd/021:33:220
2499992521,2cyclictest0-21swapper/023:33:300
2499992521,2cyclictest0-21swapper/023:33:300
250199242,5cyclictest0-21swapper/220:53:212
250199242,5cyclictest0-21swapper/220:53:212
250199241,9cyclictest28895-21chrt23:14:212
250199241,9cyclictest28895-21chrt23:14:212
250199241,8cyclictest16030-21chrt22:42:052
250199241,8cyclictest16030-21chrt22:42:052
250199241,8cyclictest15807-21taskset21:13:292
250199241,8cyclictest15807-21taskset21:13:292
250199241,8cyclictest15807-21taskset21:13:292
250199241,8cyclictest14460-21chrt21:09:312
250199241,8cyclictest14460-21chrt21:09:312
250199241,8cyclictest14460-21chrt21:09:312
250199241,7cyclictest24157-21chrt21:38:012
250199241,7cyclictest24157-21chrt21:38:012
250199241,6cyclictest6491-21chrt22:15:112
250199241,6cyclictest6491-21chrt22:15:112
250199241,6cyclictest31621-21chrt21:57:552
250199241,6cyclictest31621-21chrt21:57:552
250199241,6cyclictest31621-21chrt21:57:552
250199241,6cyclictest27180-21chrt23:11:152
250199241,6cyclictest27180-21chrt23:11:152
250199241,6cyclictest27180-21chrt23:11:152
250199241,6cyclictest25197-21chrt00:34:212
250199241,6cyclictest25197-21chrt00:34:212
250199241,6cyclictest17072-21chrt19:51:362
250199241,6cyclictest17072-21chrt19:51:362
250199241,5cyclictest2307-21chrt20:38:232
250199241,5cyclictest0-21swapper/221:48:242
250199241,5cyclictest0-21swapper/221:48:242
250199240,6cyclictest9385-21chrt19:29:092
250199240,6cyclictest9385-21chrt19:29:092
250199240,6cyclictest9385-21chrt19:29:092
2500992420,2cyclictest0-21swapper/121:53:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional