You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 06:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Wed Jul 22, 2026 00:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1805021030,3chrt0-21swapper/322:18:483
1805021030,3chrt0-21swapper/322:18:483
11222780,3sleep01124-21idleruntime20:08:410
11222780,3sleep01124-21idleruntime20:08:410
11222780,3sleep01124-21idleruntime20:08:410
22542660,3sleep30-21swapper/323:03:473
22542660,3sleep30-21swapper/323:03:473
261252610,2sleep00-21swapper/019:48:440
179182590,3sleep20-21swapper/222:18:472
179182590,3sleep20-21swapper/222:18:472
268662550,2chrt281ktimers/119:48:521
93392500,2chrt9340-21timerandwakeup20:28:521
93392500,2chrt9340-21timerandwakeup20:28:521
1296799471,33cyclictest20857-21chrt20:59:380
1296799471,33cyclictest20857-21chrt20:59:380
1296799471,33cyclictest20857-21chrt20:59:380
1296799471,33cyclictest19671-21chrt19:30:460
1296799471,33cyclictest19671-21chrt19:30:460
1296799471,32cyclictest18068-21taskset23:46:450
1296799471,32cyclictest18068-21taskset23:46:450
1296799471,31cyclictest23780-21taskset00:03:260
1296799471,31cyclictest23780-21taskset00:03:260
1296799470,33cyclictest16625-21taskset22:15:040
1296799470,33cyclictest16625-21taskset22:15:040
1296799470,33cyclictest16625-21taskset22:15:040
1296799470,32cyclictest8671-21chrt23:22:010
1296799470,32cyclictest8671-21chrt23:22:010
1296799470,30cyclictest15476-21taskset20:47:180
1296799470,30cyclictest15476-21taskset20:47:180
1296799461,32cyclictest30988-21taskset20:02:220
1296799461,32cyclictest30988-21taskset20:02:220
1296799461,31cyclictest749-21runrttasks19:57:590
1296799461,31cyclictest749-21runrttasks19:57:590
1296799461,30cyclictest11537-21chrt20:35:140
1296799461,30cyclictest11537-21chrt20:35:140
1296799461,29cyclictest31043-21chrt00:20:300
1296799461,29cyclictest31043-21chrt00:20:300
1296799461,29cyclictest31043-21chrt00:20:300
1296799461,27cyclictest1763-21chrt21:37:130
1296799461,27cyclictest1763-21chrt21:37:130
1296799461,27cyclictest1763-21chrt21:37:130
1296799460,32cyclictest14733-21chrt22:09:410
1296799460,32cyclictest14733-21chrt22:09:410
1296799460,32cyclictest14733-21chrt22:09:410
1296799460,31cyclictest12999-21taskset22:06:400
1296799460,31cyclictest12999-21taskset22:06:400
1296799460,31cyclictest12999-21taskset22:06:400
77972450,3sleep30-21swapper/323:18:463
77972450,3sleep30-21swapper/323:18:463
1296899453,33cyclictest23898-21cat00:03:321
1296899453,33cyclictest23898-21cat00:03:321
1296799451,31cyclictest26668-21taskset21:16:380
1296799451,31cyclictest26668-21taskset21:16:380
1296799451,31cyclictest21628-21seq19:37:010
1296799451,31cyclictest21628-21seq19:37:010
1296799451,30cyclictest28094-21chrt22:48:120
1296799451,30cyclictest28094-21chrt22:48:120
1296799451,30cyclictest28094-21chrt22:48:120
1296799451,30cyclictest27311-21seq00:10:330
1296799451,30cyclictest27311-21seq00:10:330
1296799451,30cyclictest27311-21seq00:10:330
1296799450,43cyclictest700-21192.168.115.40-manager21:24:570
1296799450,43cyclictest700-21192.168.115.40-manager21:24:570
1296799450,43cyclictest700-21192.168.115.40-manager21:24:570
1296799450,42cyclictest700-21192.168.115.40-manager20:39:250
1296799450,42cyclictest700-21192.168.115.40-manager20:39:250
1296799450,32cyclictest24630-21chrt21:09:590
1296799450,32cyclictest24630-21chrt21:09:590
1296799450,27cyclictest4135-21taskset20:16:530
1296799450,27cyclictest4135-21taskset20:16:530
50392440,4sleep20-21swapper/200:38:412
50392440,4sleep20-21swapper/200:38:412
50392440,4sleep20-21swapper/200:38:412
1296799441,40cyclictest700-21192.168.115.40-manager22:53:300
1296799441,40cyclictest700-21192.168.115.40-manager22:53:300
1296799441,31cyclictest24125-21taskset22:35:180
1296799441,31cyclictest24125-21taskset22:35:180
1296799441,27cyclictest1067-21taskset23:00:510
1296799441,27cyclictest1067-21taskset23:00:510
1296799440,42cyclictest700-21192.168.115.40-manager22:54:000
1296799440,42cyclictest700-21192.168.115.40-manager22:54:000
1296799440,42cyclictest700-21192.168.115.40-manager21:20:560
1296799440,42cyclictest700-21192.168.115.40-manager21:20:560
1296799440,30cyclictest5575-21taskset21:47:420
1296799440,30cyclictest5575-21taskset21:47:420
1296799440,28cyclictest32413-21taskset21:33:190
1296799440,28cyclictest32413-21taskset21:33:190
1296799440,28cyclictest32413-21taskset21:33:190
1296799440,27cyclictest17298-21taskset20:51:460
1296799440,27cyclictest17298-21taskset20:51:460
230842430,4sleep20-21swapper/221:08:282
230842430,4sleep20-21swapper/221:08:282
1296799431,29cyclictest2334-21taskset00:30:100
1296799431,29cyclictest2334-21taskset00:30:100
1296799431,28cyclictest9759-21seq20:31:200
1296799431,28cyclictest9759-21seq20:31:200
1296799431,28cyclictest9280-21chrt21:57:070
1296799431,28cyclictest9280-21chrt21:57:070
1296799431,28cyclictest9280-21chrt21:57:070
1296799431,26cyclictest68642chrt23:17:510
1296799431,26cyclictest68642chrt23:17:510
1296799431,25cyclictest0-21swapper/021:59:550
1296799431,25cyclictest0-21swapper/021:59:550
1296799431,25cyclictest0-21swapper/021:59:550
1296799431,25cyclictest0-21swapper/000:16:470
1296799431,25cyclictest0-21swapper/000:16:470
1296799431,25cyclictest0-21swapper/000:16:470
1296799430,40cyclictest700-21192.168.115.40-manager19:23:530
1296799430,31cyclictest671-21seq00:27:580
1296799430,31cyclictest671-21seq00:27:580
1296799430,30cyclictest23285-21runrttasks19:39:220
1296799430,30cyclictest23285-21runrttasks19:39:220
1296799430,30cyclictest10660-21taskset23:28:030
1296799430,30cyclictest10660-21taskset23:28:030
1296799430,30cyclictest10660-21taskset23:28:030
1296799430,27cyclictest25532-21taskset00:06:370
1296799430,27cyclictest25532-21taskset00:06:370
1296799430,27cyclictest25532-21taskset00:06:370
1296799430,27cyclictest25532-21taskset00:06:370
1296799421,29cyclictest26143-21runrttasks22:42:210
1296799421,29cyclictest26143-21runrttasks22:42:210
1296799421,26cyclictest7744-21taskset20:24:440
1296799421,26cyclictest7744-21taskset20:24:440
1296799421,26cyclictest19854-21taskset23:50:470
1296799421,26cyclictest19854-21taskset23:50:470
1296799421,26cyclictest19854-21taskset23:50:470
1296799420,30cyclictest22719-21taskset21:04:200
1296799420,30cyclictest22719-21taskset21:04:200
1296799420,28cyclictest7432-21runrttasks21:52:410
1296799420,28cyclictest7432-21runrttasks21:52:410
1296799420,28cyclictest7432-21runrttasks21:52:410
1296799420,28cyclictest4210-21taskset00:35:200
1296799420,28cyclictest4210-21taskset00:35:200
1296799420,28cyclictest25283-21taskset19:45:490
1296799420,28cyclictest25283-21taskset19:45:490
1296799420,28cyclictest25283-21taskset19:45:490
1296799411,27cyclictest749-21runrttasks00:42:410
1296799411,27cyclictest749-21runrttasks00:42:410
1296799411,27cyclictest749-21runrttasks00:42:410
1296799411,27cyclictest47162chrt23:09:310
1296799411,27cyclictest47162chrt23:09:310
1296799411,27cyclictest18738-21seq22:23:120
1296799411,27cyclictest18738-21seq22:23:120
1296799411,26cyclictest32615-21seq20:04:020
1296799411,26cyclictest32615-21seq20:04:020
1296799411,26cyclictest19241-21runrttasks20:57:490
1296799411,26cyclictest19241-21runrttasks20:57:490
1296799410,29cyclictest5867-21seq20:19:540
1296799410,29cyclictest5867-21seq20:19:540
1296799410,29cyclictest3112-21chrt23:07:500
1296799410,29cyclictest3112-21chrt23:07:500
1296799410,29cyclictest12380-21chrt23:31:090
1296799410,29cyclictest12380-21chrt23:31:090
1296799410,29cyclictest12380-21chrt23:31:090
1296799410,28cyclictest3415-21runrttasks21:39:290
1296799410,28cyclictest3415-21runrttasks21:39:290
1296799410,28cyclictest3415-21runrttasks21:39:290
1296799410,27cyclictest16157-21chrt23:41:270
244072400,3sleep20-21swapper/221:08:532
244072400,3sleep20-21swapper/221:08:532
318982390,2sleep129-21ksoftirqd/122:58:301
318982390,2sleep129-21ksoftirqd/122:58:301
166312390,1sleep10-21swapper/119:23:401
1296799391,35cyclictest20432-21sshd22:25:440
1296799391,35cyclictest20432-21sshd22:25:440
1296799391,35cyclictest20432-21sshd22:25:440
1296799391,25cyclictest21552-21users23:53:520
1296799391,25cyclictest21552-21users23:53:520
1296799391,25cyclictest21552-21users23:53:520
206112370,2sleep10-21swapper/123:53:431
206112370,2sleep10-21swapper/123:53:431
206112370,2sleep10-21swapper/123:53:431
1296799371,34cyclictest0-21swapper/023:34:010
1296799371,34cyclictest0-21swapper/023:34:010
1296799371,34cyclictest0-21swapper/023:34:010
1296899363,27cyclictest24705-21strings00:03:471
1296899363,27cyclictest24705-21strings00:03:471
1296899363,27cyclictest24705-21strings00:03:471
1296899363,27cyclictest24705-21strings00:03:471
1296799361,32cyclictest22272-21seq22:30:270
1296799361,32cyclictest22272-21seq22:30:270
121642350,3sleep30-21swapper/322:03:453
121642350,3sleep30-21swapper/322:03:453
121642350,3sleep30-21swapper/322:03:453
18132340,3sleep30-21swapper/300:28:493
18132340,3sleep30-21swapper/300:28:493
12968993426,6cyclictest9862-21gltestperf21:58:411
12968993426,6cyclictest9862-21gltestperf21:58:411
12968993426,6cyclictest9862-21gltestperf21:58:411
1297099332,23cyclictest23905-21chrt00:03:333
1297099332,23cyclictest23905-21chrt00:03:333
12968993327,5cyclictest749-21runrttasks21:15:561
12968993327,5cyclictest749-21runrttasks21:15:561
12968993226,5cyclictest4929-21switchtime21:43:501
12968993226,5cyclictest4929-21switchtime21:43:501
12968993224,6cyclictest12959-21cyclictest22:43:281
12968993224,6cyclictest12959-21cyclictest22:43:281
12968993223,7cyclictest30982-21fschecks_count21:28:421
12968993223,7cyclictest30982-21fschecks_count21:28:421
12968993223,7cyclictest30982-21fschecks_count21:28:421
12968993223,7cyclictest2899-21processes21:38:491
12968993223,7cyclictest2899-21processes21:38:491
12968993223,7cyclictest2899-21processes21:38:491
28372310,4chrt0-21swapper/221:38:482
28372310,4chrt0-21swapper/221:38:482
28372310,4chrt0-21swapper/221:38:482
12968993127,3cyclictest24910-21sh21:13:271
12968993127,3cyclictest24910-21sh21:13:271
12968993124,5cyclictest12959-21cyclictest20:37:131
12968993124,5cyclictest12959-21cyclictest20:37:131
12968993121,8cyclictest11250-21latency_hist22:03:401
12968993121,8cyclictest11250-21latency_hist22:03:401
12968993121,8cyclictest11250-21latency_hist22:03:401
159072300,3sleep115215-21/usr/sbin/munin22:13:441
159072300,3sleep115215-21/usr/sbin/munin22:13:441
159072300,3sleep115215-21/usr/sbin/munin22:13:441
12968993023,5cyclictest27853-21latency_hist00:13:391
12968993023,5cyclictest27853-21latency_hist00:13:391
12968993023,5cyclictest27853-21latency_hist00:13:391
12968992924,3cyclictest0-21swapper/122:23:471
12968992924,3cyclictest0-21swapper/122:23:471
12968992924,3cyclictest0-21swapper/122:23:471
12968992923,5cyclictest4340-21switchtime23:08:481
12968992923,5cyclictest4340-21switchtime23:08:481
12968992922,5cyclictest13539-21fschecks_count22:08:431
12968992922,5cyclictest13539-21fschecks_count22:08:431
12968992922,5cyclictest13539-21fschecks_count22:08:431
12968992922,5cyclictest12666-21needreboot20:38:441
12968992922,5cyclictest12666-21needreboot20:38:441
12968992919,8cyclictest1704-21fschecks_count23:03:411
12968992919,8cyclictest1704-21fschecks_count23:03:411
140042280,2sleep30-21swapper/320:43:413
140042280,2sleep30-21swapper/320:43:413
12968992823,3cyclictest12959-21cyclictest19:43:411
12968992823,3cyclictest12959-21cyclictest19:43:411
12968992823,3cyclictest12959-21cyclictest19:43:411
12968992822,3cyclictest0-21swapper/100:43:391
12968992822,3cyclictest0-21swapper/100:43:391
12968992821,4cyclictest0-21swapper/120:23:491
12968992821,4cyclictest0-21swapper/120:23:491
12968992820,6cyclictest29721-21gltestperf19:58:421
12968992820,6cyclictest29721-21gltestperf19:58:421
12968992820,6cyclictest13071-21gltestperf23:33:411
12968992820,6cyclictest13071-21gltestperf23:33:411
12968992820,6cyclictest13071-21gltestperf23:33:411
12969992716,8cyclictest0-21swapper/200:03:332
12969992716,8cyclictest0-21swapper/200:03:332
12968992721,5cyclictest21371-21kernelversion22:28:441
12968992721,5cyclictest21371-21kernelversion22:28:441
12968992721,4cyclictest30409-21fschecks_time22:53:401
12968992721,4cyclictest30409-21fschecks_time22:53:401
12968992720,6cyclictest22459-21kernelversion19:38:421
12968992720,6cyclictest22459-21kernelversion19:38:421
12968992720,5cyclictest550-21cron22:43:391
12968992720,5cyclictest550-21cron22:43:391
12968992720,5cyclictest550-21cron22:43:391
12968992719,6cyclictest27945-21ls19:53:391
12968992719,6cyclictest27945-21ls19:53:391
12968992719,6cyclictest0-21swapper/100:18:421
12968992719,6cyclictest0-21swapper/100:18:421
12968992719,6cyclictest0-21swapper/100:18:421
12968992718,7cyclictest4654-21fschecks_count20:18:421
12968992718,7cyclictest4654-21fschecks_count20:18:421
12968992622,2cyclictest0-21swapper/123:18:281
12968992622,2cyclictest0-21swapper/123:18:281
12968992621,3cyclictest0-21swapper/122:08:281
12968992621,3cyclictest0-21swapper/122:08:281
12968992621,3cyclictest0-21swapper/122:08:281
12968992620,4cyclictest12959-21cyclictest19:33:471
12968992620,4cyclictest12959-21cyclictest19:33:471
12968992618,6cyclictest7046-21unixbench_multi21:48:511
12968992618,6cyclictest7046-21unixbench_multi21:48:511
12968992618,6cyclictest7046-21unixbench_multi21:48:511
12968992618,6cyclictest12959-21cyclictest23:33:321
12968992618,6cyclictest12959-21cyclictest23:33:321
12968992618,6cyclictest12959-21cyclictest23:33:321
12968992520,3cyclictest5335-21missed_timers00:38:441
12968992520,3cyclictest18605-21cut19:28:421
12968992520,3cyclictest18605-21cut19:28:421
12968992519,4cyclictest0-21swapper/123:48:481
12968992519,4cyclictest0-21swapper/123:48:481
12968992519,4cyclictest0-21swapper/123:48:481
12968992517,5cyclictest0-21swapper/122:18:441
12968992517,5cyclictest0-21swapper/122:18:441
12968992516,7cyclictest14638-21netstat20:43:481
12968992516,7cyclictest14638-21netstat20:43:481
274252240,3sleep10-21swapper/121:18:411
274252240,3sleep10-21swapper/121:18:411
12968992420,3cyclictest16112-21gltestperf20:48:411
12968992420,3cyclictest16112-21gltestperf20:48:411
12968992420,2cyclictest0-21swapper/123:48:271
12968992420,2cyclictest0-21swapper/123:48:271
12968992420,2cyclictest0-21swapper/123:23:281
12968992420,2cyclictest0-21swapper/123:23:281
12968992418,4cyclictest0-21swapper/122:33:501
12968992418,4cyclictest0-21swapper/122:33:501
12968992417,4cyclictest0-21swapper/100:13:501
12968992417,4cyclictest0-21swapper/100:13:501
12968992417,4cyclictest0-21swapper/100:13:501
12968992416,6cyclictest1019-21fschecks_time20:08:401
12968992416,6cyclictest1019-21fschecks_time20:08:401
12968992416,6cyclictest1019-21fschecks_time20:08:401
52262230,3sleep30-21swapper/321:43:513
52262230,3sleep30-21swapper/321:43:513
12970992317,4cyclictest207562chrt22:28:333
12970992317,4cyclictest207562chrt22:28:333
12970992317,4cyclictest207562chrt22:28:333
12968992318,3cyclictest0-21swapper/100:33:401
12968992317,4cyclictest12959-21cyclictest21:23:451
12968992317,4cyclictest12959-21cyclictest21:23:451
12968992317,4cyclictest12959-21cyclictest21:23:451
12968992317,3cyclictest0-21swapper/123:38:431
12968992218,2cyclictest0-21swapper/121:33:501
12968992218,2cyclictest0-21swapper/121:33:501
12968992218,2cyclictest0-21swapper/121:33:501
12968992218,2cyclictest0-21swapper/121:04:261
12968992218,2cyclictest0-21swapper/121:04:261
12968992217,3cyclictest0-21swapper/120:03:411
12968992217,3cyclictest0-21swapper/120:03:411
12968992216,5cyclictest32008-21kernelversion00:23:421
12968992216,5cyclictest32008-21kernelversion00:23:421
12968992216,4cyclictest0-21swapper/100:33:401
12968992216,4cyclictest0-21swapper/100:33:401
12968992216,3cyclictest0-21swapper/123:23:511
12968992216,3cyclictest0-21swapper/123:23:511
12968992216,3cyclictest0-21swapper/123:23:511
12968992216,3cyclictest0-21swapper/120:18:271
12968992216,3cyclictest0-21swapper/120:18:271
12970992113,4cyclictest39302sleep321:43:393
12970992113,4cyclictest39302sleep321:43:393
12970992113,4cyclictest39302sleep321:43:393
1297099203,15cyclictest0-21swapper/300:03:443
1297099203,15cyclictest0-21swapper/300:03:443
1297099203,15cyclictest0-21swapper/300:03:443
1297099203,15cyclictest0-21swapper/300:03:443
12968992015,3cyclictest60-21kcompactd020:58:441
12968992015,3cyclictest60-21kcompactd020:58:441
12968992015,3cyclictest60-21kcompactd020:58:441
12968992015,3cyclictest0-21swapper/120:53:511
12968992015,3cyclictest0-21swapper/120:53:511
12968992013,4cyclictest0-21swapper/122:58:521
12968992013,4cyclictest0-21swapper/122:58:521
301612190,3chrt0-21swapper/322:53:383
301612190,3chrt0-21swapper/322:53:383
12968991914,3cyclictest0-21swapper/100:28:451
309532180,3sleep30-21swapper/322:53:463
309532180,3sleep30-21swapper/322:53:463
1297099181,12cyclictest25959-21chrt19:48:423
12969991813,3cyclictest88942sleep221:53:522
12969991813,3cyclictest88942sleep221:53:522
12969991813,3cyclictest88942sleep221:53:522
12969991813,3cyclictest251672chrt00:03:522
12969991813,3cyclictest251672chrt00:03:522
12969991813,3cyclictest251672chrt00:03:522
12969991813,3cyclictest251672chrt00:03:522
12969991812,4cyclictest221412sleep219:38:402
12969991812,4cyclictest221412sleep219:38:402
276152170,4sleep30-21swapper/319:53:363
276152170,4sleep30-21swapper/319:53:363
12970991712,3cyclictest238922chrt22:33:523
12970991712,3cyclictest238922chrt22:33:523
12970991711,4cyclictest208502sleep323:53:443
12970991711,4cyclictest208502sleep323:53:443
12970991711,4cyclictest208502sleep323:53:443
1297099171,13cyclictest6542-21chrt23:13:523
1297099171,13cyclictest6542-21chrt23:13:523
1297099171,12cyclictest18612-21chrt23:48:413
1297099171,12cyclictest18612-21chrt23:48:413
1297099171,12cyclictest18612-21chrt23:48:413
1297099171,12cyclictest16471-21chrt23:43:353
1297099171,11cyclictest9994-21taskset23:23:493
1297099171,11cyclictest9994-21taskset23:23:493
1297099171,11cyclictest9994-21taskset23:23:493
1297099171,11cyclictest5341-21chrt23:13:403
12969991712,3cyclictest169492sleep220:48:512
12969991712,3cyclictest169492sleep220:48:512
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional