You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 00:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sat May 16, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2028521200,2sleep30-21swapper/308:42:493
2028521200,2sleep30-21swapper/308:42:493
2028521200,2sleep30-21swapper/308:42:493
2365121040,3sleep30-21swapper/307:27:403
122352980,2sleep30-21swapper/308:22:433
122352980,2sleep30-21swapper/308:22:433
122352980,2sleep30-21swapper/308:22:433
163072920,2sleep016309-21fschecks_time11:27:400
163072920,2sleep016309-21fschecks_time11:27:400
56182860,4chrt0-21swapper/310:57:483
56182860,4chrt0-21swapper/310:57:483
231162840,6sleep123119-21gltestperf08:52:401
231162840,6sleep123119-21gltestperf08:52:401
256692660,3sleep30-21swapper/307:32:423
285522640,3sleep117874-21cyclictest10:32:461
285522640,3sleep117874-21cyclictest10:32:461
310842610,3sleep30-21swapper/312:07:393
261822610,2sleep126184-21grep10:27:391
261822610,2sleep126184-21grep10:27:391
183342580,3sleep30-21swapper/308:37:513
183342580,3sleep30-21swapper/308:37:513
183342580,3sleep30-21swapper/308:37:513
181712540,3sleep20-21swapper/208:37:502
181712540,3sleep20-21swapper/208:37:502
181712540,3sleep20-21swapper/208:37:502
291732500,2chrt0-21swapper/312:02:363
318222490,4sleep20-21swapper/210:42:402
318222490,4sleep20-21swapper/210:42:402
318222490,4sleep20-21swapper/210:42:402
30822490,1sleep13084-21fschecks_time10:52:401
87422470,3sleep20-21swapper/211:07:402
4192470,3sleep30-21swapper/309:17:473
4192470,3sleep30-21swapper/309:17:473
211062460,2sleep30-21swapper/310:12:473
211062460,2sleep30-21swapper/310:12:473
229222450,4sleep30-21swapper/311:42:513
229222450,4sleep30-21swapper/311:42:513
229222450,4sleep30-21swapper/311:42:513
171452450,3sleep30-21swapper/308:37:393
171452450,3sleep30-21swapper/308:37:393
171452450,3sleep30-21swapper/308:37:393
164162440,1sleep10-21swapper/110:02:271
164162440,1sleep10-21swapper/110:02:271
188452420,3sleep10-21swapper/111:32:491
188452420,3sleep10-21swapper/111:32:491
36912380,3sleep20-21swapper/209:27:382
23452370,3sleep12341-21cpuspeed12:17:381
23452370,3sleep12341-21cpuspeed12:17:381
17876993731,4cyclictest28740-21latency_hist07:42:271
17876993729,6cyclictest30397-21netstat10:37:461
17876993729,6cyclictest30397-21netstat10:37:461
17876993728,7cyclictest25758-21kernelversion07:32:431
54672350,2sleep05601-21grep09:32:400
54672350,2sleep05601-21grep09:32:400
186612350,2sleep118664-21fschecks_count10:07:411
186612350,2sleep118664-21fschecks_count10:07:411
97762340,3sleep20-21swapper/208:17:412
97762340,3sleep20-21swapper/208:17:412
96532340,2sleep30-21swapper/312:37:303
96532340,2sleep30-21swapper/312:37:303
96532340,2sleep30-21swapper/312:37:303
21092340,3sleep30-21swapper/307:57:353
21092340,3sleep30-21swapper/307:57:353
205372340,3sleep20-21swapper/208:45:222
205372340,3sleep20-21swapper/208:45:222
205372340,3sleep20-21swapper/208:45:222
17876993427,5cyclictest22530-21threads07:22:491
17876993427,5cyclictest22530-21threads07:22:491
17875993424,3cyclictest13945-21cat11:22:270
17875993424,3cyclictest13945-21cat11:22:270
210232330,2sleep121020-21grep10:12:441
210232330,2sleep121020-21grep10:12:441
17876993327,4cyclictest12050-21kernelversion08:22:411
17876993327,4cyclictest12050-21kernelversion08:22:411
17876993327,4cyclictest12050-21kernelversion08:22:411
17876993326,5cyclictest8226-21threads09:37:501
17875993327,5cyclictest17874-21cyclictest08:02:450
17875993327,5cyclictest17874-21cyclictest08:02:450
17876993226,5cyclictest21559-21latency_hist11:42:321
17876993226,5cyclictest21559-21latency_hist11:42:321
17876993226,4cyclictest9597-21latency_hist12:37:271
17876993226,4cyclictest9597-21latency_hist12:37:271
17876993226,4cyclictest9597-21latency_hist12:37:271
17876993224,6cyclictest17715-21latency_hist11:32:281
17876993224,6cyclictest17715-21latency_hist11:32:281
17876993223,7cyclictest31859-21threads07:47:501
17876993223,7cyclictest31859-21threads07:47:501
17876993223,6cyclictest550-21cron09:17:351
17876993223,6cyclictest550-21cron09:17:351
17875993225,5cyclictest17462-21gltestperf08:37:410
17875993225,5cyclictest17462-21gltestperf08:37:410
17875993225,5cyclictest17462-21gltestperf08:37:410
17875993224,6cyclictest2905-21latency_hist10:52:380
17875993224,6cyclictest2905-21latency_hist10:52:380
67332310,3sleep30-21swapper/312:27:453
67332310,3sleep30-21swapper/312:27:453
67332310,3sleep30-21swapper/312:27:453
303812310,2chrt0-21swapper/209:12:392
303812310,2chrt0-21swapper/209:12:392
17876993125,4cyclictest24288-21fschecks_count10:22:401
17876993125,4cyclictest24288-21fschecks_count10:22:401
88702300,3chrt0-21swapper/308:12:503
88702300,3chrt0-21swapper/308:12:503
78382300,4chrt0-21swapper/309:37:443
28292300,1chrt0-21swapper/112:17:421
28292300,1chrt0-21swapper/112:17:421
17876993024,4cyclictest575-21thd09:27:401
17876993024,4cyclictest575-21thd09:27:401
17876993024,4cyclictest575-21thd09:27:401
17876993023,5cyclictest5571-21processes10:57:481
17876993023,5cyclictest5571-21processes10:57:481
17875993021,7cyclictest1897-21gltestperf09:22:400
17875993021,7cyclictest1897-21gltestperf09:22:400
1787599300,11cyclictest28687-21chrt12:00:000
1787599300,11cyclictest28687-21chrt12:00:000
131662300,1sleep113303-21sed11:17:491
131662300,1sleep113303-21sed11:17:491
280462290,3sleep30-21swapper/311:57:463
17876992921,6cyclictest14148-21netstat08:27:451
17876992921,6cyclictest14148-21netstat08:27:451
17876992921,6cyclictest14148-21netstat08:27:451
17875992922,5cyclictest32384-21sshd07:51:140
17875992922,5cyclictest32384-21sshd07:51:140
17876992822,5cyclictest9924-21sshd11:09:141
17876992822,5cyclictest9924-21sshd11:09:141
17876992822,4cyclictest14678-21systemd-journal08:47:281
17876992822,4cyclictest14678-21systemd-journal08:47:281
17876992822,4cyclictest14678-21systemd-journal08:47:281
17876992821,5cyclictest23378-21unixbench-2d10:17:491
17876992821,5cyclictest23378-21unixbench-2d10:17:491
17876992818,7cyclictest14424-21cut11:22:411
17876992818,7cyclictest14424-21cut11:22:411
17876992818,7cyclictest14424-21cut11:22:411
17875992822,5cyclictest22211-21latency11:42:420
17875992822,5cyclictest22211-21latency11:42:420
17875992822,5cyclictest22211-21latency11:42:420
17875992821,5cyclictest29246-21fschecks_time07:42:380
17875992821,5cyclictest29246-21fschecks_time07:42:380
17875992820,6cyclictest20558-21fschecks_time10:12:390
17875992820,6cyclictest17874-21cyclictest08:27:490
17875992820,6cyclictest17874-21cyclictest08:27:490
17875992820,6cyclictest17874-21cyclictest08:27:490
1787599281,9cyclictest0-21swapper/011:08:500
1787599281,9cyclictest0-21swapper/011:08:500
1787599280,12cyclictest7788-21cat12:32:300
1787599280,12cyclictest7788-21cat12:32:300
1787599280,12cyclictest7788-21cat12:32:300
1787599280,12cyclictest30172-21cat09:12:330
1787599280,12cyclictest30172-21cat09:12:330
1787599280,12cyclictest11238-21taskset08:21:320
1787599280,12cyclictest11238-21taskset08:21:320
17876992718,7cyclictest11255-21gunzip11:12:461
17876992718,7cyclictest11255-21gunzip11:12:461
17876992718,7cyclictest11255-21gunzip11:12:461
17876992717,7cyclictest11500-21latency_hist08:22:331
17876992717,7cyclictest11500-21latency_hist08:22:331
17875992722,4cyclictest17874-21cyclictest12:42:270
17875992722,4cyclictest17874-21cyclictest12:42:270
17875992721,5cyclictest4197-21cpu12:22:390
17875992721,5cyclictest4197-21cpu12:22:390
17875992721,5cyclictest4197-21cpu12:22:390
17875992721,5cyclictest27783-21unixbench_singl09:02:510
17875992721,5cyclictest27783-21unixbench_singl09:02:510
17875992721,5cyclictest10429-21sshd09:43:100
17875992721,5cyclictest10429-21sshd09:43:100
17875992721,5cyclictest10429-21sshd09:43:100
17875992720,5cyclictest21415-21kernelversion08:47:420
17875992720,5cyclictest21415-21kernelversion08:47:420
17875992719,6cyclictest8635-21rt-features08:12:490
17875992719,6cyclictest8635-21rt-features08:12:490
17875992719,6cyclictest25768-21latency07:32:430
1787599271,8cyclictest0-21swapper/007:53:570
1787599271,8cyclictest0-21swapper/007:53:570
1787599271,7cyclictest0-21swapper/007:23:380
1787599271,7cyclictest0-21swapper/007:23:380
1787599270,17cyclictest15539-21taskset11:23:530
1787599270,17cyclictest15539-21taskset11:23:530
1787599270,17cyclictest15539-21taskset11:23:530
1787599270,16cyclictest26960-21taskset11:56:460
1787599270,16cyclictest26960-21taskset11:56:460
1787599270,16cyclictest17928-21taskset10:03:060
1787599270,16cyclictest17928-21taskset10:03:060
1787599270,12cyclictest18754-21chrt08:41:420
1787599270,12cyclictest18754-21chrt08:41:420
1787599270,12cyclictest18754-21chrt08:41:420
1787599270,10cyclictest4205-21/usr/sbin/munin09:27:440
1787599270,10cyclictest4205-21/usr/sbin/munin09:27:440
1787599270,10cyclictest4205-21/usr/sbin/munin09:27:440
247882260,2sleep124795-21vmstat11:47:511
247882260,2sleep124795-21vmstat11:47:511
17876992621,3cyclictest0-21swapper/108:32:471
17876992621,3cyclictest0-21swapper/108:32:471
17876992621,3cyclictest0-21swapper/108:32:471
17876992620,5cyclictest11478-21kernelversion09:47:431
17876992620,5cyclictest11478-21kernelversion09:47:431
17876992620,5cyclictest11478-21kernelversion09:47:431
17876992620,4cyclictest31249-21fschecks_time12:07:411
17876992620,4cyclictest31249-21fschecks_time12:07:411
17876992619,4cyclictest0-21swapper/108:12:291
17876992619,4cyclictest0-21swapper/108:12:291
17876992618,6cyclictest17874-21cyclictest10:47:441
17875992620,4cyclictest0-21swapper/010:52:480
17875992620,4cyclictest0-21swapper/010:52:480
17875992618,6cyclictest6444-21latency08:07:430
17875992618,6cyclictest6444-21latency08:07:430
17875992618,6cyclictest27787-21latency_hist10:32:370
17875992618,6cyclictest27787-21latency_hist10:32:370
1787599261,7cyclictest0-21swapper/008:56:310
1787599261,7cyclictest0-21swapper/008:56:310
17875992616,3cyclictest0-21swapper/012:02:390
17875992616,3cyclictest0-21swapper/012:02:390
1787599260,17cyclictest20688-21seq08:47:200
1787599260,17cyclictest20688-21seq08:47:200
1787599260,17cyclictest20688-21seq08:47:200
1787599260,16cyclictest13030-21taskset08:25:200
1787599260,16cyclictest13030-21taskset08:25:200
1787599260,16cyclictest13030-21taskset08:25:200
1787599260,12cyclictest24917-21runrttasks07:31:150
1787599260,12cyclictest21868-21taskset10:15:520
1787599260,12cyclictest21868-21taskset10:15:520
1787599260,12cyclictest12604-21taskset09:52:140
1787599260,12cyclictest12604-21taskset09:52:140
1787599260,12cyclictest12604-21taskset09:52:140
1787599260,11cyclictest6089-21taskset10:58:260
1787599260,11cyclictest6089-21taskset10:58:260
1787599260,11cyclictest32714-21latency_hist12:12:310
1787599260,11cyclictest32714-21latency_hist12:12:310
1787599260,11cyclictest20274-21wc10:12:350
1787599260,11cyclictest1068-21chrt09:19:000
1787599260,11cyclictest1068-21chrt09:19:000
17876992521,2cyclictest0-21swapper/112:42:271
17876992521,2cyclictest0-21swapper/112:42:271
17876992520,3cyclictest0-21swapper/108:37:501
17876992520,3cyclictest0-21swapper/108:37:501
17876992520,3cyclictest0-21swapper/108:37:501
17876992520,2cyclictest0-21swapper/111:02:481
17876992520,2cyclictest0-21swapper/111:02:481
17876992520,2cyclictest0-21swapper/111:02:481
17876992520,2cyclictest0-21swapper/109:02:271
17876992519,3cyclictest0-21swapper/112:27:271
17876992519,3cyclictest0-21swapper/112:27:271
17876992519,3cyclictest0-21swapper/112:27:271
17876992519,3cyclictest0-21swapper/109:47:141
17876992519,3cyclictest0-21swapper/109:47:141
17876992519,3cyclictest0-21swapper/109:47:141
17876992518,5cyclictest5606-21fschecks_time09:32:401
17876992518,5cyclictest5606-21fschecks_time09:32:401
17876992518,5cyclictest28893-21sendmail12:02:271
17876992518,5cyclictest28893-21sendmail12:02:271
17876992516,7cyclictest29648-21head07:42:431
17876992516,7cyclictest29648-21head07:42:431
17875992519,4cyclictest0-21swapper/012:17:390
17875992519,4cyclictest0-21swapper/012:17:390
17875992517,6cyclictest0-21swapper/010:42:500
17875992517,6cyclictest0-21swapper/010:42:500
17875992517,6cyclictest0-21swapper/010:42:500
1787599250,8cyclictest27602-21/usr/sbin/munin07:37:430
1787599250,8cyclictest23977-21cat10:22:310
1787599250,8cyclictest23977-21cat10:22:310
1787599250,12cyclictest3442-21taskset07:58:040
1787599250,12cyclictest3442-21taskset07:58:040
1787599250,11cyclictest9543-21seq12:36:500
1787599250,11cyclictest9543-21seq12:36:500
1787599250,11cyclictest9543-21seq12:36:500
1787599250,11cyclictest31695-21runrttasks09:14:420
1787599250,11cyclictest31695-21runrttasks09:14:420
1787599250,11cyclictest21170-21taskset11:39:210
1787599250,11cyclictest21170-21taskset11:39:210
1787599250,10cyclictest25531-21taskset10:24:420
1787599250,10cyclictest25531-21taskset10:24:420
17876992420,2cyclictest0-21swapper/111:42:501
17876992420,2cyclictest0-21swapper/111:42:501
17876992420,2cyclictest0-21swapper/111:42:501
17876992420,2cyclictest0-21swapper/110:07:351
17876992420,2cyclictest0-21swapper/110:07:351
17876992419,2cyclictest0-21swapper/112:27:491
17876992419,2cyclictest0-21swapper/112:27:491
17876992419,2cyclictest0-21swapper/112:27:491
17876992418,4cyclictest0-21swapper/110:57:271
17876992418,4cyclictest0-21swapper/110:57:271
17876992417,5cyclictest2318-21fschecks_count07:57:411
17876992417,5cyclictest2318-21fschecks_count07:57:411
17876992415,6cyclictest14668-21latency_hist09:57:351
17876992415,6cyclictest14668-21latency_hist09:57:351
17875992417,3cyclictest0-21swapper/011:47:430
17875992417,3cyclictest0-21swapper/011:47:430
1787599240,9cyclictest25928-21seq08:57:540
1787599240,9cyclictest19393-21seq11:35:280
1787599240,9cyclictest19393-21seq11:35:280
1787599240,11cyclictest8088-21seq11:04:570
1787599240,11cyclictest8088-21seq11:04:570
1787599240,11cyclictest8088-21seq11:04:570
1787599240,11cyclictest30987-21runrttasks10:38:030
1787599240,11cyclictest30987-21runrttasks10:38:030
1787599240,10cyclictest8558-21runrttasks09:38:410
1787599240,10cyclictest163242sleep010:01:490
1787599240,10cyclictest163242sleep010:01:490
1787599240,10cyclictest14177-21chrt09:53:090
1787599240,10cyclictest14177-21chrt09:53:090
129752240,3sleep30-21swapper/309:52:403
129752240,3sleep30-21swapper/309:52:403
17876992318,3cyclictest0-21swapper/107:52:451
17876992318,3cyclictest0-21swapper/107:52:451
17876992318,3cyclictest0-21swapper/107:27:431
17876992317,4cyclictest0-21swapper/109:22:491
17876992317,4cyclictest0-21swapper/109:22:491
17876992317,3cyclictest0-21swapper/109:07:421
17876992317,3cyclictest0-21swapper/109:07:421
17875992316,5cyclictest11115-21ntp_kernel_pll_11:12:440
17875992316,5cyclictest11115-21ntp_kernel_pll_11:12:440
17875992316,5cyclictest11115-21ntp_kernel_pll_11:12:440
1787599230,9cyclictest29192-21runrttasks10:33:530
1787599230,9cyclictest29192-21runrttasks10:33:530
17876992218,2cyclictest0-21swapper/110:42:501
17876992218,2cyclictest0-21swapper/110:42:501
17876992218,2cyclictest0-21swapper/110:42:501
17876992217,3cyclictest28178-21idleruntime-cro09:07:271
17876992217,3cyclictest28178-21idleruntime-cro09:07:271
17876992217,3cyclictest0-21swapper/109:12:441
17876992217,3cyclictest0-21swapper/109:12:441
17876992216,3cyclictest0-21swapper/112:02:391
17876992216,3cyclictest0-21swapper/112:02:391
17876992214,6cyclictest27055-21date11:57:271
17876992214,6cyclictest27055-21date11:57:271
17876992212,8cyclictest14678-21systemd-journal08:50:021
17876992212,8cyclictest14678-21systemd-journal08:50:021
17875992216,4cyclictest0-21swapper/012:17:470
17875992216,4cyclictest0-21swapper/012:17:470
17876992117,2cyclictest0-21swapper/108:12:401
17876992117,2cyclictest0-21swapper/108:12:401
17876992116,2cyclictest0-21swapper/108:02:401
17876992116,2cyclictest0-21swapper/108:02:401
17880992011,5cyclictest214272chrt11:42:263
17880992011,5cyclictest214272chrt11:42:263
1788099191,13cyclictest20447-21chrt10:12:383
1788099191,13cyclictest20447-21chrt10:12:383
1788099191,13cyclictest14168-21chrt08:27:463
1788099191,13cyclictest14168-21chrt08:27:463
1788099191,13cyclictest14168-21chrt08:27:463
1788099183,8cyclictest0-21swapper/310:48:143
1788099183,8cyclictest0-21swapper/310:48:143
1788099181,12cyclictest31880-21chrt07:47:503
1788099181,12cyclictest31880-21chrt07:47:503
1788099181,12cyclictest23187-21chrt07:27:283
1788099181,12cyclictest23187-21chrt07:27:283
1788099181,12cyclictest11976-21chrt09:47:493
1788099181,11cyclictest30412-21chrt10:37:463
1788099181,11cyclictest30412-21chrt10:37:463
1788099174,7cyclictest0-21swapper/312:07:403
1788099174,7cyclictest0-21swapper/312:07:403
1787799171,14cyclictest58752sleep212:27:282
1787799171,14cyclictest58752sleep212:27:282
1787799171,14cyclictest58752sleep212:27:282
1787799171,12cyclictest23517-21chrt08:52:452
1787799171,12cyclictest23517-21chrt08:52:452
1787799171,12cyclictest0-21swapper/207:42:362
1787799171,12cyclictest0-21swapper/207:42:362
1787799171,11cyclictest16069-21chrt11:27:382
17877991710,5cyclictest27010-21chrt10:27:482
17877991710,5cyclictest27010-21chrt10:27:482
1788099163,9cyclictest0-21swapper/309:29:143
1788099163,9cyclictest0-21swapper/309:29:143
1788099163,9cyclictest0-21swapper/309:29:143
1788099162,11cyclictest0-21swapper/310:07:303
1788099162,11cyclictest0-21swapper/310:07:303
1788099161,11cyclictest0-21swapper/312:22:403
1788099161,11cyclictest0-21swapper/312:22:403
1788099161,11cyclictest0-21swapper/312:22:403
1788099161,11cyclictest0-21swapper/308:47:493
1788099161,11cyclictest0-21swapper/308:47:493
1788099161,10cyclictest9848-21taskset08:17:413
1788099161,10cyclictest9848-21taskset08:17:413
1788099161,10cyclictest8907-21chrt11:07:413
1788099161,10cyclictest8907-21chrt11:07:413
1788099161,10cyclictest4867-21chrt10:57:403
1788099161,10cyclictest0-21swapper/312:17:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional