You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 08:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Mon May 11, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
104642870,2sleep30-21swapper/320:57:373
104642870,2sleep30-21swapper/320:57:373
156392820,4sleep10-21swapper/100:02:471
156392820,4sleep10-21swapper/100:02:471
286612780,4sleep128662-21tail23:12:381
286612780,4sleep128662-21tail23:12:381
222672750,3sleep30-21swapper/300:22:353
222672750,3sleep30-21swapper/300:22:353
264122730,2sleep126410-21ps00:32:421
264122730,2sleep126410-21ps00:32:421
183682710,4sleep018371-21tr00:12:350
183682710,4sleep018371-21tr00:12:350
285622700,2sleep10-21swapper/100:37:451
285622700,2sleep10-21swapper/100:37:451
308822680,2chrt30752-21latency_hist20:27:270
308822680,2chrt30752-21latency_hist20:27:270
125062680,1sleep10-21swapper/123:57:331
125062680,1sleep10-21swapper/123:57:331
125062680,1sleep10-21swapper/123:57:331
303812580,2chrt0-21swapper/223:17:382
303812580,2chrt0-21swapper/223:17:382
110772560,2sleep30-21swapper/319:32:393
110772560,2sleep30-21swapper/319:32:393
112392540,3sleep20-21swapper/223:52:392
112392540,3sleep20-21swapper/223:52:392
39042530,3sleep30-21swapper/323:32:423
39042530,3sleep30-21swapper/323:32:423
165632520,3sleep30-21swapper/322:42:213
165632520,3sleep30-21swapper/322:42:213
159262520,11sleep1271rcuc/121:12:351
222122500,2sleep10-21swapper/122:57:231
222122500,2sleep10-21swapper/122:57:231
163582500,3sleep30-21swapper/319:47:353
163582500,3sleep30-21swapper/319:47:353
245932490,2sleep30-21swapper/320:07:453
245932490,2sleep30-21swapper/320:07:453
142152480,4sleep30-21swapper/300:02:253
142152480,4sleep30-21swapper/300:02:253
142152480,4sleep30-21swapper/300:02:253
3028994633,5cyclictest0-21swapper/000:02:260
3028994633,5cyclictest0-21swapper/000:02:260
3028994633,5cyclictest0-21swapper/000:02:260
190152460,3chrt0-21swapper/222:47:352
190152460,3chrt0-21swapper/222:47:352
222272450,4chrt0-21swapper/320:02:383
222272450,4chrt0-21swapper/320:02:383
222272450,4chrt0-21swapper/320:02:383
98892420,3chrt0-21swapper/222:22:392
98892420,3chrt0-21swapper/222:22:392
200282420,2sleep30-21swapper/319:57:363
303099381,25cyclictest14254-21chrt00:02:282
303099381,25cyclictest14254-21chrt00:02:282
303099381,25cyclictest14254-21chrt00:02:282
302899382,26cyclictest14606-21fschecks_time00:02:350
302899382,26cyclictest14606-21fschecks_time00:02:350
69952370,3chrt0-21swapper/320:47:443
69952370,3chrt0-21swapper/320:47:443
3028993528,5cyclictest3696-21missed_timers23:32:380
3028993528,5cyclictest3696-21missed_timers23:32:380
315572340,2sleep20-21swapper/220:27:372
315572340,2sleep20-21swapper/220:27:372
3028993429,3cyclictest25137-21cut21:37:360
3028993429,3cyclictest25137-21cut21:37:360
3028993428,4cyclictest26165-21processes20:12:410
3028993428,4cyclictest26165-21processes20:12:410
115802340,1sleep10-21swapper/121:02:261
115802340,1sleep10-21swapper/121:02:261
3029993327,4cyclictest617-21lldpd20:37:431
3029993327,4cyclictest617-21lldpd20:37:431
3029993325,6cyclictest13032-21cpu22:32:341
3028993327,4cyclictest1648-21ntpd19:37:410
3028993325,6cyclictest29048-21kernelversion21:47:370
3028993325,6cyclictest29048-21kernelversion21:47:370
3028993325,6cyclictest29048-21kernelversion21:47:370
3029993225,5cyclictest32498-21cut21:57:351
3029993225,5cyclictest32498-21cut21:57:351
3029993223,7cyclictest306-21latency_hist20:32:271
3029993223,7cyclictest306-21latency_hist20:32:271
3028993228,3cyclictest28657-21gzip23:12:380
3028993228,3cyclictest28657-21gzip23:12:380
140662320,3sleep30-21swapper/321:07:383
140662320,3sleep30-21swapper/321:07:383
8412310,2sleep00-21swapper/021:57:440
8412310,2sleep00-21swapper/021:57:440
304992310,1sleep130519-21cat21:52:361
304992310,1sleep130519-21cat21:52:361
304992310,1sleep130519-21cat21:52:361
3029993126,4cyclictest2115-21cut22:02:361
3029993126,4cyclictest2115-21cut22:02:361
3029993124,5cyclictest22130-21kernelversion20:02:371
3029993124,5cyclictest22130-21kernelversion20:02:371
3029993124,5cyclictest22130-21kernelversion20:02:371
3029993120,9cyclictest13371-21latency_hist21:07:231
3029993120,9cyclictest13371-21latency_hist21:07:231
3029993120,9cyclictest13371-21latency_hist21:07:231
3028993126,3cyclictest17092-21latency_hist21:17:220
3028993123,6cyclictest5698-21sh23:37:430
3028993123,6cyclictest5698-21sh23:37:430
3028993123,6cyclictest28379-21unixbench-2d20:17:450
3028993123,6cyclictest28379-21unixbench-2d20:17:450
3029993024,5cyclictest25740-21switchtime21:37:441
3029993024,5cyclictest25740-21switchtime21:37:441
3029993024,5cyclictest25740-21switchtime21:37:441
3029993024,5cyclictest25740-21switchtime21:37:441
3029993023,5cyclictest20960-21threads00:17:451
3029993023,5cyclictest20960-21threads00:17:451
3029993023,5cyclictest12422-21cut19:37:351
3029993022,6cyclictest25341-21latency_hist00:32:211
3029993022,6cyclictest25341-21latency_hist00:32:211
3029993022,6cyclictest25341-21latency_hist00:32:211
3028993021,7cyclictest15170-21fschecks_time22:37:350
3028993021,7cyclictest15170-21fschecks_time22:37:350
3028993021,7cyclictest14255-21needreboot21:07:410
3028993021,7cyclictest14255-21needreboot21:07:410
3032992919,6cyclictest2748-21chrt23:31:223
3032992919,6cyclictest2748-21chrt23:31:223
3032992916,8cyclictest6556-21chrt23:42:033
3032992916,8cyclictest6556-21chrt23:42:033
3029992924,3cyclictest17657-21head21:17:371
3029992924,3cyclictest17657-21head21:17:371
3029992924,3cyclictest0-21swapper/121:37:331
3029992924,3cyclictest0-21swapper/121:37:331
3029992924,3cyclictest0-21swapper/121:37:331
3028992923,3cyclictest0-21swapper/023:17:350
3028992923,3cyclictest0-21swapper/023:17:350
3028992921,6cyclictest13503-21latency_hist21:07:310
3028992921,6cyclictest13503-21latency_hist21:07:310
3028992921,6cyclictest13503-21latency_hist21:07:310
236962290,2sleep123870-21idleruntime20:07:351
236962290,2sleep123870-21idleruntime20:07:351
96442280,3chrt9632-21gltestperf22:22:370
96442280,3chrt9632-21gltestperf22:22:370
3032992818,6cyclictest28113-21chrt21:44:533
3032992818,6cyclictest28113-21chrt21:44:533
3032992818,6cyclictest28113-21chrt21:44:533
3032992816,8cyclictest26739-21chrt20:14:043
3032992816,8cyclictest26739-21chrt20:14:043
3029992822,4cyclictest18271-21idleruntime19:52:341
3029992822,4cyclictest18271-21idleruntime19:52:341
3029992820,6cyclictest6637-21ls22:12:441
3029992820,6cyclictest6637-21ls22:12:441
3029992819,7cyclictest11071-21kernelversion23:52:381
3029992819,7cyclictest11071-21kernelversion23:52:381
3028992823,3cyclictest22702-21gltestperf22:57:350
3028992823,3cyclictest22702-21gltestperf22:57:350
3028992822,3cyclictest0-21swapper/023:27:220
3028992822,3cyclictest0-21swapper/023:27:220
3028992822,3cyclictest0-21swapper/023:27:220
3028992815,11cyclictest25831-21/usr/sbin/munin21:37:440
3028992815,11cyclictest25831-21/usr/sbin/munin21:37:440
3028992815,11cyclictest25831-21/usr/sbin/munin21:37:440
3028992815,11cyclictest25831-21/usr/sbin/munin21:37:440
3032992718,6cyclictest4975-21chrt22:08:333
3032992718,6cyclictest4975-21chrt22:08:333
3032992718,6cyclictest4975-21chrt22:08:333
3032992718,6cyclictest10754-21chrt22:24:573
3032992718,6cyclictest10754-21chrt22:24:573
3032992717,7cyclictest10048-21chrt23:48:263
3032992717,7cyclictest10048-21chrt23:48:263
3032992717,6cyclictest28715-21chrt00:37:553
3032992717,6cyclictest28715-21chrt00:37:553
3032992717,6cyclictest19542-21chrt00:15:043
3032992717,6cyclictest19542-21chrt00:15:043
3032992717,6cyclictest16875-21chrt21:14:383
3032992717,6cyclictest15749-21chrt00:04:103
3032992717,6cyclictest15749-21chrt00:04:103
3032992716,8cyclictest31391-21chrt23:20:563
3032992716,8cyclictest31391-21chrt23:20:563
3032992716,7cyclictest2016-21chrt20:36:553
3032992716,7cyclictest2016-21chrt20:36:553
3032992716,7cyclictest19392-21chrt19:55:393
3032992716,7cyclictest19392-21chrt19:55:393
3032992715,7cyclictest18885-21chrt21:21:293
3032992715,7cyclictest18885-21chrt21:21:293
3029992722,3cyclictest0-21swapper/119:27:401
3029992722,3cyclictest0-21swapper/119:27:401
3029992721,5cyclictest4129-21kernelversion22:07:371
3029992721,5cyclictest4129-21kernelversion22:07:371
3029992721,5cyclictest4129-21kernelversion22:07:371
3029992721,4cyclictest7875-21kernelversion22:17:371
3029992721,4cyclictest7875-21kernelversion22:17:371
3029992721,3cyclictest0-21swapper/119:42:351
3029992721,3cyclictest0-21swapper/119:42:351
3029992721,3cyclictest0-21swapper/100:27:221
3029992721,3cyclictest0-21swapper/100:27:221
3029992719,6cyclictest14727-21awk22:37:221
3028992723,3cyclictest18970-21wc21:22:210
3028992723,3cyclictest18970-21wc21:22:210
3028992721,5cyclictest30582-21fschecks_count21:52:360
3028992721,5cyclictest30582-21fschecks_count21:52:360
3028992721,5cyclictest30582-21fschecks_count21:52:360
3028992720,5cyclictest21806-21sshd22:52:470
3028992720,5cyclictest21806-21sshd22:52:470
3028992719,6cyclictest4421-21fschecks_time20:42:350
3028992719,6cyclictest4421-21fschecks_time20:42:350
3028992719,6cyclictest10076-21sshd23:48:480
3028992719,6cyclictest10076-21sshd23:48:480
3028992718,7cyclictest21808-21fschecks_count20:02:350
3028992718,7cyclictest21808-21fschecks_count20:02:350
3028992718,7cyclictest21808-21fschecks_count20:02:350
3028992715,10cyclictest550-21cron21:32:370
3032992617,6cyclictest30584-21chrt20:25:133
3032992617,6cyclictest30584-21chrt20:25:133
3032992617,6cyclictest22627-21chrt21:31:263
3032992617,6cyclictest22627-21chrt21:31:263
3032992617,6cyclictest22627-21chrt21:31:263
3032992616,7cyclictest616-21chrt23:23:103
3032992616,7cyclictest616-21chrt23:23:103
3032992616,7cyclictest616-21chrt23:23:103
3032992616,7cyclictest31684-21chrt21:52:533
3032992616,7cyclictest31684-21chrt21:52:533
3032992616,7cyclictest31684-21chrt21:52:533
3032992616,7cyclictest25748-21chrt23:05:213
3032992616,7cyclictest25748-21chrt23:05:213
3032992616,7cyclictest25748-21chrt23:05:213
3032992616,6cyclictest8928-21chrt22:21:033
3032992616,6cyclictest8928-21chrt22:21:033
3032992616,6cyclictest12735-21chrt22:31:323
3032992616,6cyclictest12735-21chrt22:31:323
3032992615,8cyclictest9497-21chrt20:56:173
3032992615,8cyclictest9497-21chrt20:56:173
3032992615,7cyclictest28740-21taskset23:12:403
3032992615,7cyclictest28740-21taskset23:12:403
3032992615,7cyclictest27539-21chrt23:09:273
3032992615,7cyclictest27539-21chrt23:09:273
3032992615,7cyclictest23799-21chrt22:59:303
3032992615,7cyclictest23799-21chrt22:59:303
3032992615,6cyclictest8217-21chrt19:26:323
3032992615,6cyclictest8217-21chrt19:26:323
3032992614,8cyclictest28565-21chrt20:18:383
3032992614,8cyclictest28565-21chrt20:18:383
3032992613,9cyclictest20250-21chrt22:51:463
3032992613,9cyclictest20250-21chrt22:51:463
3029992621,3cyclictest0-21swapper/122:42:331
3029992621,3cyclictest0-21swapper/122:42:331
3029992621,3cyclictest0-21swapper/121:12:221
3029992621,3cyclictest0-21swapper/121:12:221
3029992620,3cyclictest24271-21/usr/sbin/munin23:02:451
3029992620,3cyclictest24271-21/usr/sbin/munin23:02:451
3029992620,3cyclictest24271-21/usr/sbin/munin23:02:451
3029992616,7cyclictest20049-21processes21:22:421
3029992616,7cyclictest20049-21processes21:22:421
3028992621,3cyclictest26671-21timerwakeupswit00:32:440
3028992621,3cyclictest26671-21timerwakeupswit00:32:440
3028992620,4cyclictest10718-21systemctl20:57:420
3028992620,4cyclictest10718-21systemctl20:57:420
3028992620,4cyclictest0-21swapper/000:22:220
3028992620,4cyclictest0-21swapper/000:22:220
3028992619,5cyclictest0-21swapper/022:17:350
3028992619,5cyclictest0-21swapper/022:17:350
3028992618,6cyclictest21022-21/usr/sbin/munin21:27:340
3028992617,7cyclictest26802-21needreboot23:07:410
3028992617,7cyclictest26802-21needreboot23:07:410
66542250,2sleep00-21swapper/022:12:440
66542250,2sleep00-21swapper/022:12:440
3032992517,5cyclictest1172-21chrt21:58:403
3032992517,5cyclictest1172-21chrt21:58:403
3032992516,6cyclictest32435-21chrt20:30:043
3032992516,6cyclictest32435-21chrt20:30:043
3032992516,6cyclictest26928-21chrt00:33:533
3032992516,6cyclictest26928-21chrt00:33:533
3032992516,6cyclictest26266-21chrt21:40:233
3032992516,6cyclictest26266-21chrt21:40:233
3032992516,6cyclictest26266-21chrt21:40:233
3032992516,6cyclictest26266-21chrt21:40:233
3032992516,6cyclictest21303-21chrt00:18:453
3032992516,6cyclictest21303-21chrt00:18:453
3032992516,6cyclictest14353-21chrt22:33:013
3032992516,6cyclictest13180-21chrt21:05:293
3032992516,6cyclictest13180-21chrt21:05:293
3032992516,6cyclictest13180-21chrt21:05:293
3032992515,6cyclictest8380-21chrt23:46:173
3032992515,6cyclictest8380-21chrt23:46:173
3032992514,7cyclictest5652-21chrt20:45:033
3032992514,7cyclictest5652-21chrt20:45:033
3032992514,7cyclictest3215-21chrt20:37:433
3032992514,7cyclictest3215-21chrt20:37:433
3032992513,8cyclictest30083-21chrt21:51:163
3032992513,8cyclictest30083-21chrt21:51:163
3032992513,8cyclictest30083-21chrt21:51:163
3029992520,3cyclictest0-21swapper/123:07:411
3029992520,3cyclictest0-21swapper/123:07:411
3029992520,3cyclictest0-21swapper/123:02:221
3029992520,3cyclictest0-21swapper/123:02:221
3029992519,5cyclictest727-21sshd23:24:341
3029992519,5cyclictest727-21sshd23:24:341
3029992519,5cyclictest727-21sshd23:24:341
3029992518,5cyclictest5824-21mailstats23:37:441
3029992518,5cyclictest5824-21mailstats23:37:441
3029992518,4cyclictest0-21swapper/120:32:341
3029992518,4cyclictest0-21swapper/120:32:341
3029992517,6cyclictest3149-21sort23:32:331
3029992516,7cyclictest19265-21ls22:47:371
3029992516,7cyclictest19265-21ls22:47:371
3028992520,3cyclictest0-21swapper/019:22:440
3028992520,3cyclictest0-21swapper/019:22:440
3028992519,5cyclictest24854-21sshd20:08:480
3028992519,5cyclictest24854-21sshd20:08:480
3028992519,5cyclictest10592-21fschecks_count19:32:340
3028992519,5cyclictest10592-21fschecks_count19:32:340
3028992517,6cyclictest20793-21sshd21:26:480
3028992517,6cyclictest16846-21missed_timers00:07:380
3028992517,6cyclictest16846-21missed_timers00:07:380
3028992515,8cyclictest23158-21cut21:32:360
275092250,4chrt27513-21tail20:17:351
275092250,4chrt27513-21tail20:17:351
205572250,4sleep20-21swapper/219:57:432
3032992417,4cyclictest24428-21chrt21:35:403
3032992417,4cyclictest24428-21chrt21:35:403
3032992417,4cyclictest24428-21chrt21:35:403
3032992415,6cyclictest20659-21chrt21:25:033
3032992415,6cyclictest20659-21chrt21:25:033
3032992413,8cyclictest6908-21taskset22:14:073
3032992413,8cyclictest6908-21taskset22:14:073
3032992413,7cyclictest3247-21chrt22:05:153
3032992413,7cyclictest3247-21chrt22:05:153
3032992412,8cyclictest9870-21chrt19:28:293
3032992412,8cyclictest9870-21chrt19:28:293
3032992412,7cyclictest13632-21taskset19:38:583
3029992419,3cyclictest10018-21ntp_kernel_err22:22:411
3029992419,3cyclictest10018-21ntp_kernel_err22:22:411
3029992419,3cyclictest0-21swapper/121:27:371
3029992419,3cyclictest0-21swapper/121:27:371
3029992419,3cyclictest0-21swapper/121:27:371
3029992419,2cyclictest0-21swapper/120:22:391
3029992419,2cyclictest0-21swapper/120:22:391
3029992418,3cyclictest0-21swapper/120:42:441
3029992418,3cyclictest0-21swapper/120:42:441
3029992417,6cyclictest26608-21/usr/sbin/munin21:42:411
3029992417,6cyclictest26608-21/usr/sbin/munin21:42:411
3029992417,6cyclictest26608-21/usr/sbin/munin21:42:411
3029992417,5cyclictest30569-21ntp_kernel_err23:17:411
3029992417,5cyclictest30569-21ntp_kernel_err23:17:411
3029992416,6cyclictest6645-21/usr/sbin/munin19:22:401
3029992416,6cyclictest6645-21/usr/sbin/munin19:22:401
3029992415,7cyclictest29486-21cat21:47:431
3029992415,7cyclictest29486-21cat21:47:431
3029992415,7cyclictest29486-21cat21:47:431
3029992412,3cyclictest181rcu_preempt22:37:341
3029992412,3cyclictest181rcu_preempt22:37:341
3029992412,3cyclictest181rcu_preempt19:32:371
3029992412,3cyclictest181rcu_preempt19:32:371
3028992420,3cyclictest3021-21cyclictest20:48:340
3028992420,3cyclictest3021-21cyclictest20:48:340
3028992420,2cyclictest0-21swapper/022:52:220
3028992420,2cyclictest0-21swapper/022:52:220
3028992419,4cyclictest27757-21gltestperf00:37:350
3028992419,4cyclictest27757-21gltestperf00:37:350
3028992418,5cyclictest3329-21timerandwakeup20:37:440
3028992418,5cyclictest3329-21timerandwakeup20:37:440
3028992418,5cyclictest22700-21cron21:32:210
3028992418,5cyclictest22700-21cron21:32:210
185312240,2sleep10-21swapper/100:12:361
185312240,2sleep10-21swapper/100:12:361
3032992315,6cyclictest18184-21taskset22:44:063
3032992315,6cyclictest18184-21taskset22:44:063
3032992315,4cyclictest121842sleep323:56:583
3032992315,4cyclictest121842sleep323:56:583
3032992313,6cyclictest24194-21chrt00:27:383
3032992313,6cyclictest24194-21chrt00:27:383
3032992313,6cyclictest24194-21chrt00:27:383
3029992318,4cyclictest8412-21kernelversion20:52:361
3029992318,4cyclictest8412-21kernelversion20:52:361
3029992318,4cyclictest16897-21needreboot00:07:401
3029992318,4cyclictest16897-21needreboot00:07:401
3029992317,4cyclictest0-21swapper/122:27:421
3029992315,6cyclictest2212-21sort23:27:411
3028992319,2cyclictest0-21swapper/019:52:210
3028992319,2cyclictest0-21swapper/019:52:210
3028992318,3cyclictest0-21swapper/020:29:040
3028992318,3cyclictest0-21swapper/020:29:040
3028992318,3cyclictest0-21swapper/000:27:450
3028992318,3cyclictest0-21swapper/000:27:450
3028992318,3cyclictest0-21swapper/000:27:450
3028992317,4cyclictest11566-21switchtime23:52:450
3028992317,4cyclictest11566-21switchtime23:52:450
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional