You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 04:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sat Jan 10, 2026 00:44:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1537521370,3sleep30-21swapper/321:00:503
1537521370,3sleep30-21swapper/321:00:503
1453421330,2chrt142-21systemd-journal22:25:471
246252960,1sleep10-21swapper/121:25:491
123872810,3sleep30-21swapper/322:20:433
123872810,3sleep30-21swapper/322:20:433
38542780,1sleep10-21swapper/120:30:491
80972760,3sleep30-21swapper/323:35:443
80972760,3sleep30-21swapper/323:35:443
277772660,2sleep127780-21sed20:10:351
277772660,2sleep127780-21sed20:10:351
100562600,2chrt10058-21grep19:20:461
5619995951,4cyclictest0-21swapper/000:00:440
5619995951,4cyclictest0-21swapper/000:00:440
181342550,7sleep1281ktimers/122:35:481
181342550,7sleep1281ktimers/122:35:481
4532510,3sleep10-21swapper/121:50:371
185282500,2sleep20-21swapper/200:05:342
185282500,2sleep20-21swapper/200:05:342
127872500,2chrt0-21swapper/323:50:283
127872500,2chrt0-21swapper/323:50:283
5619994821,16cyclictest21307-21taskset21:19:290
5619994821,16cyclictest21307-21taskset21:19:290
28612480,3sleep20-21swapper/220:30:342
5619994722,9cyclictest4956-21taskset23:26:080
5619994722,9cyclictest4956-21taskset23:26:080
5619994722,9cyclictest16968-21taskset22:33:450
5619994721,14cyclictest29882-21taskset23:06:380
5619994721,14cyclictest29882-21taskset23:06:380
5619994720,11cyclictest6111-21taskset20:36:270
5619994720,11cyclictest6111-21taskset20:36:270
5619994720,11cyclictest6111-21taskset20:36:270
5619994720,11cyclictest12656-21seq23:49:000
5619994720,11cyclictest12656-21seq23:49:000
5619994719,18cyclictest4460-21runrttasks20:34:180
5619994718,12cyclictest21766-21chrt00:11:030
5619994718,12cyclictest21766-21chrt00:11:030
5619994625,12cyclictest0-21swapper/022:29:150
5619994620,11cyclictest32375-21seq21:46:550
5619994620,11cyclictest32375-21seq21:46:550
5619994619,15cyclictest749-21runrttasks20:43:270
5619994619,11cyclictest26706-21taskset21:31:480
5619994619,11cyclictest26706-21taskset21:31:480
5619994619,11cyclictest16463-21seq00:00:050
5619994619,11cyclictest16463-21seq00:00:050
5619994619,11cyclictest16463-21seq00:00:050
233932460,4sleep30-21swapper/319:55:503
233932460,4sleep30-21swapper/319:55:503
5619994521,9cyclictest18862-21taskset22:39:120
5619994521,9cyclictest18862-21taskset22:39:120
5619994521,14cyclictest13063-21chrt22:21:280
5619994521,14cyclictest13063-21chrt22:21:280
5619994521,10cyclictest10437-21taskset19:21:090
5619994520,15cyclictest3800-21taskset21:57:480
5619994520,15cyclictest3800-21taskset21:57:480
5619994520,15cyclictest3800-21taskset21:57:480
5619994520,12cyclictest23843-21chrt00:18:430
5619994520,12cyclictest23843-21chrt00:18:430
5619994520,12cyclictest23843-21chrt00:18:430
5619994519,11cyclictest2598-21taskset20:29:190
5619994519,11cyclictest19447-21taskset21:14:390
5619994519,11cyclictest19447-21taskset21:14:390
5619994519,10cyclictest630-21taskset20:23:530
5619994519,10cyclictest630-21taskset20:23:530
5619994518,12cyclictest28567-21taskset21:36:450
5619994518,12cyclictest28567-21taskset21:36:450
5619994518,11cyclictest5656-21seq22:02:220
5619994518,11cyclictest5656-21seq22:02:220
5619994518,11cyclictest1418-21taskset23:18:550
5619994518,11cyclictest1418-21taskset23:18:550
5619994517,13cyclictest7662-21taskset22:09:150
5619994517,13cyclictest7662-21taskset22:09:150
5619994421,9cyclictest29170-21taskset20:11:590
5619994420,13cyclictest31229-21taskset20:19:260
5619994420,13cyclictest31229-21taskset20:19:260
5619994420,13cyclictest31229-21taskset20:19:260
5619994420,10cyclictest15570-21taskset21:02:480
5619994420,10cyclictest15570-21taskset21:02:480
5619994419,11cyclictest18049-21taskset19:42:590
5619994419,11cyclictest18049-21taskset19:42:590
5619994419,10cyclictest23006-21taskset21:22:070
5619994419,10cyclictest23006-21taskset21:22:070
5619994418,11cyclictest21775-21chrt19:52:570
5619994417,12cyclictest8883-21seq23:38:390
5619994417,12cyclictest8883-21seq23:38:390
5619994416,13cyclictest17341-21seq21:06:380
5619994416,13cyclictest17341-21seq21:06:380
5619994416,12cyclictest24465-21taskset22:54:060
5619994322,6cyclictest31227-21taskset00:37:280
5619994322,6cyclictest31227-21taskset00:37:280
5619994322,6cyclictest31227-21taskset00:37:280
5619994320,8cyclictest13645-21taskset20:57:200
5619994320,8cyclictest13645-21taskset20:57:200
5619994320,8cyclictest13645-21taskset20:57:200
5619994319,7cyclictest16133-21seq19:37:340
5619994319,7cyclictest16133-21seq19:37:340
5619994319,11cyclictest30505-21taskset21:41:500
5619994319,11cyclictest30505-21taskset21:41:500
5619994319,10cyclictest25595-21taskset00:22:010
5619994319,10cyclictest25595-21taskset00:22:010
5619994318,11cyclictest27544-21taskset20:10:050
5619994318,11cyclictest27544-21taskset20:10:050
5619994318,11cyclictest10208-21sensors_temp23:40:480
5619994318,11cyclictest10208-21sensors_temp23:40:480
5619994317,8cyclictest3301-21chrt23:23:470
5619994317,8cyclictest3301-21chrt23:23:470
5619994317,12cyclictest9276-21chrt22:11:030
5619994317,12cyclictest9276-21chrt22:11:030
5619994317,12cyclictest14220-21chrt19:31:550
5619994317,12cyclictest14220-21chrt19:31:550
5619994317,11cyclictest9953-21taskset20:47:420
5619994317,11cyclictest11753-21taskset20:51:550
5619994317,11cyclictest11753-21taskset20:51:550
5619994220,7cyclictest28151-21fschecks_count00:30:400
5619994220,7cyclictest28151-21fschecks_count00:30:400
5619994220,7cyclictest28151-21fschecks_count00:30:400
5619994218,10cyclictest19799-21taskset19:46:300
5619994218,10cyclictest19799-21taskset19:46:300
5619994217,8cyclictest31835-21taskset23:12:440
5619994217,8cyclictest31835-21taskset23:12:440
5619994217,12cyclictest25492-21chrt20:02:340
5619994217,12cyclictest25492-21chrt20:02:340
5619994216,11cyclictest24904-21taskset21:27:340
5619994216,10cyclictest22500-21taskset22:47:460
5619994216,10cyclictest22500-21taskset22:47:460
5619994215,11cyclictest14482-21taskset23:53:330
5619994215,11cyclictest14482-21taskset23:53:330
5619994215,10cyclictest20137-21taskset00:09:040
5619994215,10cyclictest20137-21taskset00:09:040
24532420,3chrt0-21swapper/120:27:241
167622420,2sleep116552-40mandb00:00:401
167622420,2sleep116552-40mandb00:00:401
167622420,2sleep116552-40mandb00:00:401
5619994120,12cyclictest26297-21taskset22:58:430
5619994120,12cyclictest26297-21taskset22:58:430
5619994120,12cyclictest26297-21taskset22:58:430
5619994118,11cyclictest22501-21gltestperf19:55:410
5619994118,11cyclictest22501-21gltestperf19:55:410
5619994118,10cyclictest20753-21taskset22:44:160
5619994118,10cyclictest20753-21taskset22:44:160
5619994117,8cyclictest12466-21seq19:28:210
5619994115,9cyclictest7071-21taskset23:34:180
5619994115,9cyclictest7071-21taskset23:34:180
5619994115,12cyclictest27639-21taskset00:29:190
5619994115,12cyclictest27639-21taskset00:29:190
5619994115,11cyclictest28193-21taskset23:03:490
5619994115,11cyclictest28193-21taskset23:03:490
5619994015,11cyclictest1858-21taskset21:51:480
5619993924,12cyclictest11108-21users22:15:490
5619993924,12cyclictest11108-21users22:15:490
178372390,2sleep30-21swapper/321:10:353
178372390,2sleep30-21swapper/321:10:353
5621993729,6cyclictest22710-21cron22:50:281
5621993729,6cyclictest22710-21cron22:50:281
562399341,25cyclictest16616-21chrt00:00:333
562399341,25cyclictest16616-21chrt00:00:333
562399341,25cyclictest16616-21chrt00:00:333
70092330,3sleep30-21swapper/322:05:473
70092330,3sleep30-21swapper/322:05:473
5622993226,4cyclictest314832sleep200:40:282
5622993226,4cyclictest314832sleep200:40:282
5622993226,4cyclictest314832sleep200:40:282
5621993226,4cyclictest735-21systemd-logind22:40:471
5621993226,4cyclictest735-21systemd-logind22:40:471
5621993224,6cyclictest13614-21missed_timers23:50:421
5621993224,6cyclictest13614-21missed_timers23:50:421
5621993223,7cyclictest29804-21netstat21:40:451
5621993223,7cyclictest29804-21netstat21:40:451
259412320,2sleep126018-21grep21:30:441
259412320,2sleep126018-21grep21:30:441
562199311,25cyclictest17411-21strings00:00:451
562199311,25cyclictest17411-21strings00:00:451
562299301,24cyclictest16840-21chrt00:00:402
562299301,24cyclictest16840-21chrt00:00:402
562299301,24cyclictest16840-21chrt00:00:402
562399291,7cyclictest21223-21chrt00:10:463
562399291,7cyclictest21223-21chrt00:10:463
562399281,7cyclictest20792-21taskset22:44:473
562399281,7cyclictest20792-21taskset22:44:473
5621992824,2cyclictest0-21swapper/123:10:491
5621992824,2cyclictest0-21swapper/123:10:491
5621992824,2cyclictest0-21swapper/119:40:271
5621992824,2cyclictest0-21swapper/119:40:271
5621992822,5cyclictest10336-21kernelversion22:15:411
5621992822,5cyclictest10336-21kernelversion22:15:411
5621992822,3cyclictest0-21swapper/123:25:411
5621992822,3cyclictest0-21swapper/123:25:411
5621992821,5cyclictest28123-21cut00:30:401
5621992821,5cyclictest28123-21cut00:30:401
5621992821,5cyclictest28123-21cut00:30:401
5621992820,6cyclictest5724-21cut23:30:401
5621992820,6cyclictest5724-21cut23:30:401
5621992819,7cyclictest17530-21grep19:40:471
5621992819,7cyclictest17530-21grep19:40:471
5621992819,7cyclictest16233-21cut21:05:391
5621992819,7cyclictest16233-21cut21:05:391
562399278,15cyclictest26102chrt20:29:273
562399272,15cyclictest0-21swapper/300:00:423
562399272,15cyclictest0-21swapper/300:00:423
562399271,7cyclictest18138-21chrt19:44:083
562399271,7cyclictest18138-21chrt19:44:083
562399271,6cyclictest30081-21chrt23:09:113
562399271,6cyclictest30081-21chrt23:09:113
562399271,4cyclictest0-21swapper/320:35:293
5621992722,3cyclictest15793-21latency_hist21:05:281
5621992722,3cyclictest15793-21latency_hist21:05:281
5621992722,2cyclictest0-21swapper/122:10:271
5621992722,2cyclictest0-21swapper/122:10:271
5621992721,5cyclictest23012-21needreboot00:15:451
5621992721,5cyclictest23012-21needreboot00:15:451
5621992721,5cyclictest23012-21needreboot00:15:451
5621992721,4cyclictest595-21sshd23:01:231
5621992721,4cyclictest595-21sshd23:01:231
5621992721,3cyclictest0-21swapper/120:35:481
5621992721,3cyclictest0-21swapper/120:35:481
5621992721,3cyclictest0-21swapper/120:35:481
5621992720,5cyclictest20256-21idleruntime-cro00:10:271
5621992720,5cyclictest20256-21idleruntime-cro00:10:271
5621992719,6cyclictest550-21cron22:00:391
5621992719,6cyclictest550-21cron22:00:391
5621992719,6cyclictest10384-21ls23:40:491
5621992719,6cyclictest10384-21ls23:40:491
562399261,6cyclictest3406-21chrt23:25:113
562399261,6cyclictest3406-21chrt23:25:113
562399261,3cyclictest199672sleep319:48:423
562399261,3cyclictest199672sleep319:48:423
5621992621,3cyclictest0-21swapper/120:00:281
5621992621,3cyclictest0-21swapper/120:00:281
5621992620,5cyclictest31197-21fschecks_count21:45:381
5621992620,5cyclictest31197-21fschecks_count21:45:381
5621992620,5cyclictest20228-21kernelversion21:15:421
5621992620,5cyclictest20228-21kernelversion21:15:421
5621992620,4cyclictest0-21swapper/122:30:491
5621992619,5cyclictest9541-21threads20:45:491
5621992619,5cyclictest21341-21wc00:10:471
5621992619,5cyclictest21341-21wc00:10:471
5621992618,6cyclictest7386-21/usr/sbin/munin23:35:441
5621992618,6cyclictest7386-21/usr/sbin/munin23:35:441
5621992618,6cyclictest4408-21fschecks_count22:00:381
5621992618,6cyclictest4408-21fschecks_count22:00:381
562399251,8cyclictest29461-21chrt00:33:453
562399251,8cyclictest29461-21chrt00:33:453
562399251,8cyclictest29461-21chrt00:33:453
562399251,8cyclictest22569-21chrt22:48:413
562399251,8cyclictest22569-21chrt22:48:413
562399251,5cyclictest401-21chrt20:21:153
562399251,5cyclictest401-21chrt20:21:153
562399251,5cyclictest16836-21chrt22:32:043
562399251,5cyclictest11459-21chrt22:20:063
562399251,5cyclictest11459-21chrt22:20:063
562399251,4cyclictest269042sleep321:34:233
562399251,4cyclictest269042sleep321:34:233
562399251,4cyclictest0-21swapper/322:03:213
562399251,4cyclictest0-21swapper/322:03:213
562399251,4cyclictest0-21swapper/319:35:393
562399251,4cyclictest0-21swapper/319:35:393
562399250,5cyclictest21210-21chrt21:18:153
562399250,5cyclictest21210-21chrt21:18:153
5621992520,3cyclictest0-21swapper/121:10:381
5621992520,3cyclictest0-21swapper/121:10:381
5621992519,3cyclictest0-21swapper/120:40:441
5621992517,6cyclictest12253-21/usr/sbin/munin20:55:461
5621992517,6cyclictest12253-21/usr/sbin/munin20:55:461
5621992517,6cyclictest12253-21/usr/sbin/munin20:55:461
24522250,4sleep20-21swapper/223:20:442
24522250,4sleep20-21swapper/223:20:442
222872250,3sleep10-21swapper/121:20:421
222872250,3sleep10-21swapper/121:20:421
562399247,14cyclictest107752chrt23:43:443
562399247,14cyclictest107752chrt23:43:443
562399242,3cyclictest0-21swapper/322:54:243
562399241,8cyclictest4986-21taskset23:26:323
562399241,8cyclictest4986-21taskset23:26:323
562399241,7cyclictest9441-21chrt22:13:113
562399241,7cyclictest9441-21chrt22:13:113
562399241,7cyclictest7957-21chrt20:41:003
562399241,7cyclictest32384-21taskset21:47:023
562399241,7cyclictest32384-21taskset21:47:023
562399241,7cyclictest14356-21chrt23:51:563
562399241,7cyclictest14356-21chrt23:51:563
562399241,5cyclictest6849-21chrt23:31:263
562399241,5cyclictest6849-21chrt23:31:263
562399241,5cyclictest6202-21chrt20:37:393
562399241,5cyclictest6202-21chrt20:37:393
562399241,5cyclictest6202-21chrt20:37:393
562399241,5cyclictest31656-21chrt00:40:373
562399241,5cyclictest31656-21chrt00:40:373
562399241,5cyclictest31656-21chrt00:40:373
562399241,5cyclictest28516-21chrt21:36:083
562399241,5cyclictest28516-21chrt21:36:083
562399241,5cyclictest23889-21chrt00:19:183
562399241,5cyclictest23889-21chrt00:19:183
562399241,5cyclictest23889-21chrt00:19:183
562399241,5cyclictest0-21swapper/320:15:343
562399241,4cyclictest38232sleep321:58:073
562399241,4cyclictest38232sleep321:58:073
562399241,4cyclictest38232sleep321:58:073
562399241,4cyclictest311922chrt20:18:573
562399241,4cyclictest311922chrt20:18:573
562399241,4cyclictest311922chrt20:18:573
562399241,4cyclictest272222chrt20:05:553
562399241,4cyclictest272222chrt20:05:553
562399241,4cyclictest142032chrt19:31:423
562399241,4cyclictest142032chrt19:31:423
562399241,4cyclictest135522sleep320:56:083
562399241,4cyclictest135522sleep320:56:083
562399241,4cyclictest135522sleep320:56:083
562399241,4cyclictest125032sleep319:28:483
562399241,4cyclictest11897-21chrt20:53:473
562399241,4cyclictest11897-21chrt20:53:473
562399241,4cyclictest0-21swapper/322:35:443
562399241,4cyclictest0-21swapper/322:35:443
562399241,4cyclictest0-21swapper/320:45:433
562399241,4cyclictest0-21swapper/300:25:493
562399241,4cyclictest0-21swapper/300:25:493
562399241,3cyclictest0-21swapper/322:25:373
562399240,8cyclictest10571-21chrt19:22:533
562399240,7cyclictest18539-21chrt21:10:433
562399240,7cyclictest18539-21chrt21:10:433
562399240,5cyclictest28033-21chrt23:01:473
562399240,5cyclictest28033-21chrt23:01:473
562399240,3cyclictest216682sleep319:51:363
5621992420,3cyclictest31481-21systemctl00:40:281
5621992420,3cyclictest31481-21systemctl00:40:281
5621992420,3cyclictest31481-21systemctl00:40:281
5621992420,2cyclictest0-21swapper/123:45:421
5621992420,2cyclictest0-21swapper/123:45:421
5621992420,2cyclictest0-21swapper/122:55:491
5621992420,2cyclictest0-21swapper/122:55:491
5621992420,2cyclictest0-21swapper/122:55:491
5621992420,2cyclictest0-21swapper/122:50:411
5621992419,3cyclictest0-21swapper/119:50:391
5621992419,2cyclictest0-21swapper/122:00:271
5621992418,4cyclictest28475-21needreboot20:10:441
5621992417,5cyclictest25321-21unixbench_singl20:00:521
5621992417,5cyclictest25321-21unixbench_singl20:00:521
5621992415,7cyclictest8943-21sort22:10:481
5621992415,7cyclictest8943-21sort22:10:481
562399231,8cyclictest25593-21chrt00:21:593
562399231,8cyclictest25593-21chrt00:21:593
562399231,5cyclictest26123-21chrt22:56:283
562399231,5cyclictest26123-21chrt22:56:283
562399231,5cyclictest26123-21chrt22:56:283
562399231,5cyclictest25426-21chrt20:01:453
562399231,5cyclictest25426-21chrt20:01:453
562399231,4cyclictest319282chrt23:13:573
562399231,4cyclictest319282chrt23:13:573
562399231,4cyclictest200902sleep300:08:293
562399231,4cyclictest200902sleep300:08:293
562399231,4cyclictest0-21swapper/323:15:443
562399231,4cyclictest0-21swapper/323:15:443
562399231,4cyclictest0-21swapper/321:40:413
562399231,4cyclictest0-21swapper/321:40:413
562399231,4cyclictest0-21swapper/321:25:373
562399231,3cyclictest18532sleep321:51:443
5621992319,2cyclictest0-21swapper/119:30:381
5621992319,2cyclictest0-21swapper/119:30:381
5621992317,4cyclictest3502-21latency_hist23:25:291
5621992317,4cyclictest3502-21latency_hist23:25:291
5621992316,4cyclictest0-21swapper/120:52:241
5621992316,4cyclictest0-21swapper/120:52:241
5621992315,6cyclictest24788-21sort00:20:431
5621992315,6cyclictest24788-21sort00:20:431
218062230,3sleep20-21swapper/222:45:462
218062230,3sleep20-21swapper/222:45:462
562399221,4cyclictest0-21swapper/321:20:463
562399221,4cyclictest0-21swapper/321:20:463
5621992218,2cyclictest0-21swapper/119:45:411
5621992218,2cyclictest0-21swapper/119:45:411
5621992217,3cyclictest0-21swapper/123:15:421
5621992217,3cyclictest0-21swapper/123:15:421
5621992217,3cyclictest0-21swapper/120:20:391
5621992217,3cyclictest0-21swapper/120:20:391
5621992217,3cyclictest0-21swapper/100:25:491
5621992217,3cyclictest0-21swapper/100:25:491
5621992216,4cyclictest0-21swapper/121:35:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional