You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 11:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sun Jan 11, 2026 00:44:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16812900,3sleep10-21swapper/119:46:371
16812900,3sleep10-21swapper/119:46:371
271512810,3chrt27154-21needreboot20:55:441
271512810,3chrt27154-21needreboot20:55:441
283102700,1sleep3431rcuc/321:00:363
283102700,1sleep3431rcuc/321:00:363
74232670,3sleep10-21swapper/121:30:411
74232670,3sleep10-21swapper/121:30:411
84072650,1sleep30-21swapper/320:05:443
69502650,3sleep10-21swapper/121:29:501
69502650,3sleep10-21swapper/121:29:501
302132540,2sleep20-21swapper/223:55:512
302132540,2sleep20-21swapper/223:55:512
302132540,2sleep20-21swapper/223:55:512
19866995041,6cyclictest0-21swapper/000:00:420
19866995041,6cyclictest0-21swapper/000:00:420
7252490,3sleep30-21swapper/319:45:423
7252490,3sleep30-21swapper/319:45:423
19866994940,6cyclictest0-21swapper/000:00:340
19866994940,6cyclictest0-21swapper/000:00:340
19866994940,6cyclictest0-21swapper/000:00:340
134822490,2chrt0-21swapper/300:40:393
134822490,2chrt0-21swapper/300:40:393
240432450,3sleep10-21swapper/120:45:551
240432450,3sleep10-21swapper/120:45:551
19866994135,4cyclictest13595-21fschecks_count20:20:410
19866994135,4cyclictest13595-21fschecks_count20:20:410
146222400,3chrt0-21swapper/323:15:443
146222400,3chrt0-21swapper/323:15:443
1986999381,27cyclictest30845-21chrt00:00:353
1986999381,27cyclictest30845-21chrt00:00:353
1986999381,27cyclictest30845-21chrt00:00:353
300962370,2sleep30-21swapper/322:30:413
300962370,2sleep30-21swapper/322:30:413
1986799373,29cyclictest31031-21df_inode00:00:401
1986799373,29cyclictest31031-21df_inode00:00:401
19867993731,4cyclictest25969-21ntp_kernel_pll_19:25:461
19867993731,4cyclictest25969-21ntp_kernel_pll_19:25:461
194942370,3sleep20-21swapper/220:35:422
194942370,3sleep20-21swapper/220:35:422
154762360,3sleep20-21swapper/220:25:412
300502350,5sleep130211-21unixbench-2d23:55:511
19867993520,2cyclictest181rcu_preempt21:50:521
19866993527,6cyclictest1041-21netstat19:45:460
19866993527,6cyclictest1041-21netstat19:45:460
19867993424,7cyclictest18618-21fschecks_count22:00:411
19867993424,7cyclictest18618-21fschecks_count22:00:411
176772340,2sleep10-21swapper/123:25:311
176772340,2sleep10-21swapper/123:25:311
57752330,2sleep30-21swapper/320:00:303
57752330,2sleep30-21swapper/320:00:303
32272330,1sleep03390-21unixbench_multi19:50:510
32272330,1sleep03390-21unixbench_multi19:50:510
19867993326,5cyclictest8478-21/usr/sbin/munin23:00:461
19867993326,5cyclictest8478-21/usr/sbin/munin23:00:461
19867993326,5cyclictest4247-21fschecks_count19:55:421
19867993326,5cyclictest4247-21fschecks_count19:55:421
19867993326,5cyclictest25028-21latency_hist19:25:281
19867993326,5cyclictest25028-21latency_hist19:25:281
19867993322,4cyclictest90-1pr/ttyS000:26:041
19867993322,4cyclictest90-1pr/ttyS000:26:041
19866993327,4cyclictest545-21in:imuxsock20:20:290
19866993327,4cyclictest545-21in:imuxsock20:20:290
110332330,3sleep30-21swapper/323:05:473
19867993226,4cyclictest20809-21kernelversion22:05:431
19867993225,5cyclictest17572-21threads21:55:501
19867993225,5cyclictest17572-21threads21:55:501
19866993226,4cyclictest23716-21gltestperf19:20:400
19866993226,4cyclictest23716-21gltestperf19:20:400
19866993224,6cyclictest6802-21fschecks_count22:55:400
19866993224,6cyclictest6802-21fschecks_count22:55:400
303592310,1sleep130504-21fschecks_time21:05:421
303592310,1sleep130504-21fschecks_time21:05:421
19867993126,3cyclictest2554-21gltestperf19:50:411
19867993126,3cyclictest2554-21gltestperf19:50:411
19867993126,3cyclictest0-21swapper/121:35:411
19867993126,3cyclictest0-21swapper/121:35:411
19867993126,3cyclictest0-21swapper/121:35:411
19867993125,4cyclictest572-21cups-browsed22:20:291
19867993125,4cyclictest572-21cups-browsed22:20:291
19867993125,4cyclictest572-21cups-browsed22:20:291
19867993123,6cyclictest5825-21sort00:20:281
19867993123,6cyclictest5825-21sort00:20:281
19867993123,6cyclictest5825-21sort00:20:281
19867993123,6cyclictest24452-21ls23:40:521
19867993123,6cyclictest24452-21ls23:40:521
1986799311,26cyclictest31465-21wc00:00:441
1986799311,26cyclictest31465-21wc00:00:441
236232300,6sleep123624-21fschecks_time19:20:401
19867993025,3cyclictest10005-21gltestperf20:10:441
19867993024,4cyclictest32398-21gltestperf21:10:411
19867993024,4cyclictest32398-21gltestperf21:10:411
19867993023,5cyclictest3255-21cron21:20:411
19867993023,5cyclictest3255-21cron21:20:411
19867993023,5cyclictest25678-21cut23:45:421
19867993023,5cyclictest25678-21cut23:45:421
19867993019,2cyclictest181rcu_preempt21:46:321
19867993019,2cyclictest181rcu_preempt21:46:321
19867993019,2cyclictest181rcu_preempt19:37:031
19867993019,2cyclictest181rcu_preempt19:37:031
19867993019,2cyclictest181rcu_preempt19:37:031
19867993015,3cyclictest181rcu_preempt23:10:441
19867993015,3cyclictest181rcu_preempt23:10:441
19867993014,6cyclictest181rcu_preempt20:54:581
19867993014,6cyclictest181rcu_preempt20:54:581
19866993025,4cyclictest26592-21head22:20:440
19866993025,4cyclictest26592-21head22:20:440
19866993025,3cyclictest25683-21cron22:20:290
19866993025,3cyclictest25683-21cron22:20:290
19866993025,3cyclictest25683-21cron22:20:290
19866993025,3cyclictest16300-21gltestperf23:20:420
19866993025,3cyclictest16300-21gltestperf23:20:420
19866993023,5cyclictest550-21cron20:40:390
19866993021,7cyclictest28931-21latency_hist23:55:340
19866993018,6cyclictest23672-21fschecks_time23:40:420
19866993018,6cyclictest23672-21fschecks_time23:40:420
19867992923,3cyclictest19860-21cyclictest19:30:491
19867992922,5cyclictest5248-21kernelversion22:50:431
19867992922,5cyclictest5248-21kernelversion22:50:431
19867992918,2cyclictest181rcu_preempt23:08:501
1986699296,14cyclictest24726-21kworker/0:0+events_freezable19:36:120
1986699296,14cyclictest24726-21kworker/0:0+events_freezable19:36:120
1986699296,14cyclictest24726-21kworker/0:0+events_freezable19:36:120
19866992925,3cyclictest19183-21ntp_offset22:00:480
19866992925,3cyclictest19183-21ntp_offset22:00:480
19866992923,4cyclictest1648-21ntpd23:10:460
19866992923,4cyclictest1648-21ntpd23:10:460
19866992921,6cyclictest12313-21needreboot00:35:470
19866992921,6cyclictest12313-21needreboot00:35:470
39732280,2chrt0-21swapper/122:45:511
39732280,2chrt0-21swapper/122:45:511
1986799288,18cyclictest281ktimers/121:44:591
1986799288,18cyclictest281ktimers/121:44:591
1986799285,3cyclictest181rcu_preempt23:37:351
1986799285,3cyclictest181rcu_preempt23:37:351
1986799284,5cyclictest281ktimers/120:24:171
1986799284,5cyclictest281ktimers/120:24:171
19867992822,5cyclictest11283-21sshd00:33:511
19867992822,5cyclictest11283-21sshd00:33:511
19867992820,6cyclictest856-21latency_hist22:40:311
19867992820,6cyclictest856-21latency_hist22:40:311
19867992818,2cyclictest181rcu_preempt23:33:581
19867992818,2cyclictest181rcu_preempt23:33:581
19867992818,2cyclictest181rcu_preempt20:04:171
19867992818,2cyclictest181rcu_preempt20:04:171
19867992816,2cyclictest181rcu_preempt20:30:501
19867992816,2cyclictest181rcu_preempt20:30:501
19866992823,3cyclictest547-21rs:main0
19866992823,3cyclictest547-21rs:main0
19866992820,6cyclictest25687-21head23:45:420
19866992820,6cyclictest25687-21head23:45:420
138672280,5sleep30-21swapper/323:15:283
138672280,5sleep30-21swapper/323:15:283
1986799276,5cyclictest271rcuc/123:17:531
1986799276,5cyclictest271rcuc/123:17:531
19867992723,3cyclictest28164-21head22:25:421
19867992723,3cyclictest28164-21head22:25:421
19867992722,3cyclictest19860-21cyclictest20:40:491
19867992721,4cyclictest1283-21fschecks_time22:40:421
19867992721,4cyclictest1283-21fschecks_time22:40:421
19867992720,5cyclictest22911-21ntp_offset22:10:481
19867992720,5cyclictest22911-21ntp_offset22:10:481
19867992718,7cyclictest20711-21cat20:40:291
19867992718,7cyclictest20711-21cat20:40:291
19867992718,6cyclictest19860-21cyclictest21:20:361
19867992718,6cyclictest19860-21cyclictest21:20:361
19867992717,2cyclictest181rcu_preempt20:27:321
19867992716,4cyclictest181rcu_preempt22:56:191
19867992716,4cyclictest181rcu_preempt22:56:191
19867992715,7cyclictest90-1pr/ttyS020:17:191
19867992715,7cyclictest90-1pr/ttyS020:17:191
19867992714,3cyclictest90-1pr/ttyS023:25:531
19867992714,3cyclictest90-1pr/ttyS023:25:531
19867992714,2cyclictest181rcu_preempt00:05:431
19867992714,2cyclictest181rcu_preempt00:05:431
19867992713,2cyclictest181rcu_preempt00:10:491
19867992713,2cyclictest181rcu_preempt00:10:491
19867992712,3cyclictest181rcu_preempt20:05:411
19867992712,2cyclictest181rcu_preempt00:40:281
19867992712,2cyclictest181rcu_preempt00:40:281
19866992722,3cyclictest0-21swapper/019:55:510
19866992722,3cyclictest0-21swapper/019:55:510
19866992721,5cyclictest16723-21sshd20:27:480
19866992721,4cyclictest25366-21ntp_offset20:50:460
19866992721,4cyclictest25366-21ntp_offset20:50:460
1986999265,10cyclictest0-21swapper/300:00:473
1986999265,10cyclictest0-21swapper/300:00:473
19867992622,3cyclictest90-1pr/ttyS023:50:501
19867992619,5cyclictest29720-21cpuspeed22:30:381
19867992619,5cyclictest29720-21cpuspeed22:30:381
19866992621,3cyclictest0-21swapper/021:55:290
19867992514,5cyclictest90-1pr/ttyS021:01:271
19866992521,3cyclictest6183-21fschecks_count00:20:410
19866992521,3cyclictest6183-21fschecks_count00:20:410
19866992521,3cyclictest21047-21ntp_offset22:05:460
19866992520,4cyclictest1880-21fschecks_time21:15:400
19866992520,4cyclictest1880-21fschecks_time21:15:400
19866992520,3cyclictest0-21swapper/021:20:490
19866992520,3cyclictest0-21swapper/021:20:490
19866992519,5cyclictest25616-21idleruntime19:25:420
19866992519,5cyclictest25616-21idleruntime19:25:420
19866992519,4cyclictest23471-21cpu23:40:400
19866992519,4cyclictest0-21swapper/022:25:500
19866992519,4cyclictest0-21swapper/022:25:500
19866992515,8cyclictest9205-21netstat23:00:460
19866992515,8cyclictest9205-21netstat23:00:460
19866992510,12cyclictest26655-21fschecks_count20:55:400
19866992510,12cyclictest26655-21fschecks_count20:55:400
1986799247,7cyclictest29-21ksoftirqd/119:41:541
1986799245,5cyclictest281ktimers/122:20:421
1986799245,5cyclictest281ktimers/122:20:421
19867992415,2cyclictest181rcu_preempt00:20:491
19867992415,2cyclictest181rcu_preempt00:20:491
19866992419,4cyclictest14372-21gltestperf23:15:420
19866992419,4cyclictest14372-21gltestperf23:15:420
19866992418,5cyclictest3245-21gltestperf22:45:420
19866992418,5cyclictest3245-21gltestperf22:45:420
19866992417,5cyclictest9549-21latency_hist00:30:300
19866992417,5cyclictest9549-21latency_hist00:30:300
19866992417,5cyclictest10822-21unixbench-2d20:10:530
19866992319,2cyclictest0-21swapper/022:50:380
19866992319,2cyclictest0-21swapper/022:50:380
19866992318,4cyclictest11497-21latency21:40:430
19866992318,4cyclictest11497-21latency21:40:430
19866992318,3cyclictest0-21swapper/021:40:390
19866992318,3cyclictest0-21swapper/021:40:390
19866992318,3cyclictest0-21swapper/021:40:390
19866992318,3cyclictest0-21swapper/020:35:410
19866992318,3cyclictest0-21swapper/020:35:410
19866992318,3cyclictest0-21swapper/000:30:490
19866992318,3cyclictest0-21swapper/000:30:490
19866992318,3cyclictest0-21swapper/000:10:480
19866992318,3cyclictest0-21swapper/000:10:480
19866992317,4cyclictest5809-21latency_hist00:20:280
19866992317,4cyclictest5809-21latency_hist00:20:280
19866992317,4cyclictest5809-21latency_hist00:20:280
19866992317,4cyclictest0-21swapper/021:05:500
19866992317,4cyclictest0-21swapper/021:05:500
19866992315,6cyclictest19014-21unixbench_multi23:25:510
19866992315,6cyclictest19014-21unixbench_multi23:25:510
16972230,3chrt0-21swapper/322:40:463
16972230,3chrt0-21swapper/322:40:463
282382220,4sleep30-21swapper/322:25:433
282382220,4sleep30-21swapper/322:25:433
1986899221,11cyclictest0-21swapper/200:00:422
1986899221,11cyclictest0-21swapper/200:00:422
1986699221,9cyclictest31017-21grep19:40:410
19866992218,3cyclictest17471-21systemctl21:55:490
19866992218,3cyclictest17471-21systemctl21:55:490
19866992218,2cyclictest0-21swapper/022:40:420
19866992218,2cyclictest0-21swapper/022:40:420
19866992218,2cyclictest0-21swapper/019:30:390
19866992217,4cyclictest30002-21gltestperf22:30:410
19866992217,4cyclictest30002-21gltestperf22:30:410
19866992217,3cyclictest0-21swapper/021:10:510
19866992217,3cyclictest0-21swapper/021:10:510
19866992217,3cyclictest0-21swapper/020:30:410
19866992217,3cyclictest0-21swapper/020:30:410
19866992216,5cyclictest22374-21cut22:10:410
19866992216,5cyclictest22374-21cut22:10:410
19866992216,4cyclictest14066-21unixbench_singl21:45:520
19866992216,4cyclictest14066-21unixbench_singl21:45:520
19866992213,7cyclictest8023-21fschecks_time20:05:410
193322220,3sleep3431rcuc/322:00:503
193322220,3sleep3431rcuc/322:00:503
324712210,3sleep30-21swapper/321:10:413
324712210,3sleep30-21swapper/321:10:413
19866992117,2cyclictest0-21swapper/021:30:510
19866992117,2cyclictest0-21swapper/021:30:510
19866992117,2cyclictest0-21swapper/020:45:540
19866992117,2cyclictest0-21swapper/020:45:540
19866992117,2cyclictest0-21swapper/000:05:420
19866992117,2cyclictest0-21swapper/000:05:420
19866992115,4cyclictest0-21swapper/023:35:480
19866992115,3cyclictest0-21swapper/020:00:430
19866992115,3cyclictest0-21swapper/020:00:430
19866992112,7cyclictest23133-21cron19:20:290
19866992111,6cyclictest5852-21/usr/sbin/munin21:25:440
19866992111,6cyclictest5852-21/usr/sbin/munin21:25:440
19866992110,9cyclictest29127-21ntp_states21:00:490
19866992015,3cyclictest11557-21unixbench_multi23:05:530
92262190,3sleep20-21swapper/221:35:412
92262190,3sleep20-21swapper/221:35:412
92262190,3sleep20-21swapper/221:35:412
1986999193,9cyclictest0-21swapper/300:30:503
1986999193,9cyclictest0-21swapper/300:30:503
19866991915,2cyclictest0-21swapper/023:30:420
19866991915,2cyclictest0-21swapper/023:30:420
1986999183,9cyclictest0-21swapper/300:11:503
1986999183,9cyclictest0-21swapper/300:11:503
1986999183,8cyclictest0-21swapper/323:51:503
1986899183,9cyclictest0-21swapper/219:40:472
1986899183,11cyclictest0-21swapper/219:20:472
1986899183,11cyclictest0-21swapper/219:20:472
1986999173,9cyclictest0-21swapper/321:01:493
1986999172,11cyclictest0-21swapper/320:35:513
1986999172,11cyclictest0-21swapper/320:35:513
1986999171,12cyclictest21221-21taskset20:40:423
1986999171,11cyclictest21664-21chrt22:06:493
1986999171,11cyclictest0-21swapper/321:40:403
1986999171,11cyclictest0-21swapper/321:40:403
1986999171,10cyclictest0-21swapper/321:30:513
1986999171,10cyclictest0-21swapper/321:30:513
1986899173,9cyclictest0-21swapper/223:15:502
1986899173,9cyclictest0-21swapper/223:15:502
1986899172,9cyclictest0-21swapper/223:31:502
1986899172,9cyclictest0-21swapper/223:31:502
1986899172,11cyclictest0-21swapper/220:00:452
1986899172,11cyclictest0-21swapper/220:00:452
1986899171,12cyclictest27436-21taskset19:30:422
1986899171,12cyclictest27343-21chrt23:50:412
1986899171,11cyclictest32281-21chrt21:10:402
1986899171,11cyclictest32281-21chrt21:10:402
1986899171,11cyclictest0-21swapper/223:35:502
1986899171,11cyclictest0-21swapper/223:35:502
1986899171,11cyclictest0-21swapper/221:26:502
1986899171,11cyclictest0-21swapper/221:26:502
1986899171,11cyclictest0-21swapper/221:20:442
1986899171,11cyclictest0-21swapper/221:20:442
1986899171,10cyclictest26470-21chrt20:55:362
1986899171,10cyclictest26470-21chrt20:55:362
1986999163,9cyclictest0-21swapper/319:30:483
1986999161,12cyclictest1036-21taskset00:05:453
1986999161,12cyclictest1036-21taskset00:05:453
1986999161,11cyclictest25120-21chrt20:50:433
1986999161,11cyclictest25120-21chrt20:50:433
1986999161,11cyclictest23252-21chrt22:10:513
1986999161,11cyclictest23252-21chrt22:10:513
1986999161,11cyclictest16224-21taskset20:25:503
1986999161,10cyclictest9408-21chrt21:35:423
1986999161,10cyclictest25870-21chrt19:25:443
1986999161,10cyclictest25870-21chrt19:25:443
1986999161,10cyclictest23423-21chrt20:45:453
1986999161,10cyclictest23423-21chrt20:45:453
1986999161,10cyclictest20201-21chrt23:30:443
1986999161,10cyclictest20201-21chrt23:30:443
1986999161,10cyclictest0-21swapper/321:15:433
1986999161,10cyclictest0-21swapper/321:15:433
1986899169,4cyclictest180302chrt23:25:402
1986899169,4cyclictest180302chrt23:25:402
1986899162,11cyclictest0-21swapper/222:00:322
1986899162,11cyclictest0-21swapper/222:00:322
1986899161,11cyclictest8304-21taskset20:05:432
1986899161,11cyclictest7540-21chrt22:55:492
1986899161,11cyclictest7540-21chrt22:55:492
1986899161,11cyclictest4770-21chrt22:50:382
1986899161,11cyclictest4770-21chrt22:50:382
1986899161,11cyclictest27163-21chrt20:55:452
1986899161,11cyclictest27163-21chrt20:55:452
1986899161,11cyclictest24170-21chrt23:40:482
1986899161,11cyclictest24170-21chrt23:40:482
1986899161,11cyclictest0-21swapper/200:35:432
1986899161,11cyclictest0-21swapper/200:35:432
1986899161,10cyclictest31718-21taskset22:35:472
1986899161,10cyclictest31718-21taskset22:35:472
1986899161,10cyclictest29935-21taskset22:30:402
1986899161,10cyclictest29935-21taskset22:30:402
1986899161,10cyclictest17747-21chrt20:30:442
1986899161,10cyclictest17747-21chrt20:30:442
1986899161,10cyclictest16222-21chrt23:20:412
1986899161,10cyclictest16222-21chrt23:20:412
1986999153,8cyclictest0-21swapper/323:21:513
1986999153,8cyclictest0-21swapper/323:21:513
1986999151,9cyclictest22064-21taskset23:35:423
1986999151,9cyclictest22064-21taskset23:35:423
1986999151,9cyclictest21693-21chrt19:15:393
1986999151,9cyclictest0-21swapper/322:15:453
1986999151,9cyclictest0-21swapper/322:15:453
1986999151,9cyclictest0-21swapper/322:15:453
1986999151,7cyclictest25416-21chrt23:45:393
1986999151,7cyclictest25416-21chrt23:45:393
1986999151,11cyclictest17439-21chrt20:30:413
1986999151,11cyclictest17439-21chrt20:30:413
1986999151,10cyclictest3936-21chrt19:55:313
1986999151,10cyclictest3936-21chrt19:55:313
1986999151,10cyclictest31560-21chrt21:06:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional