You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 10:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Thu May 07, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
45682950,4sleep30-21swapper/300:37:313
45682950,4sleep30-21swapper/300:37:313
45682950,4sleep30-21swapper/300:37:313
209552840,3chrt0-21swapper/322:27:343
209552840,3chrt0-21swapper/322:27:343
252232820,3chrt25226-21grep22:37:400
78722730,3chrt0-21swapper/320:27:303
78722730,3chrt0-21swapper/320:27:303
120252730,4chrt0-21swapper/322:02:423
120252730,4chrt0-21swapper/322:02:423
236992680,2sleep123703-21switchtime21:07:401
236992680,2sleep123703-21switchtime21:07:401
275122640,2chrt0-21swapper/300:12:303
24502560,2sleep30-21swapper/320:12:313
24502560,2sleep30-21swapper/320:12:313
275242520,1chrt0-21swapper/019:52:300
12344995236,12cyclictest0-21swapper/000:02:310
12344995236,12cyclictest0-21swapper/000:02:310
134542500,1sleep00-21swapper/022:07:330
134542500,1sleep00-21swapper/022:07:330
134542500,1sleep00-21swapper/022:07:330
269682490,2sleep20-21swapper/219:52:242
269682490,2sleep20-21swapper/219:52:242
21942480,1sleep12252-21fschecks_count20:12:301
21942480,1sleep12252-21fschecks_count20:12:301
12344994840,4cyclictest0-21swapper/000:02:220
12344994840,4cyclictest0-21swapper/000:02:220
38792470,3sleep30-21swapper/321:42:323
38792470,3sleep30-21swapper/321:42:323
229652450,4sleep30-21swapper/322:32:373
77522430,3sleep10-21swapper/123:17:421
77522430,3sleep10-21swapper/123:17:421
291592430,2sleep30-21swapper/321:22:383
291592430,2sleep30-21swapper/321:22:383
291592430,2sleep30-21swapper/321:22:383
205052430,4sleep30-21swapper/323:52:363
205052430,4sleep30-21swapper/323:52:363
322692420,2sleep30-21swapper/322:57:373
322692420,2sleep30-21swapper/322:57:373
239982420,2chrt24000-21latency_hist22:37:240
69122410,3chrt0-21swapper/320:22:403
69122410,3chrt0-21swapper/320:22:403
6952400,2sleep00-21swapper/000:27:320
6952400,2sleep00-21swapper/000:27:320
6952400,2sleep00-21swapper/000:27:320
259312400,3chrt0-21swapper/322:42:253
12344994025,13cyclictest28117-21sh21:22:300
12344994025,13cyclictest28117-21sh21:22:300
12344994025,13cyclictest28117-21sh21:22:300
251982390,2sleep30-21swapper/300:07:203
251982390,2sleep30-21swapper/300:07:203
211582380,4sleep30-21swapper/321:02:323
211582380,4sleep30-21swapper/321:02:323
12345993829,7cyclictest15023-21gltestperf22:12:311
1234799372,24cyclictest23458-21taskset00:02:253
1234799372,24cyclictest23458-21taskset00:02:253
146022350,3sleep30-21swapper/322:12:223
146022350,3sleep30-21swapper/322:12:223
146022350,3sleep30-21swapper/322:12:223
12344993530,4cyclictest20599-21cut22:27:310
12344993521,3cyclictest90-1pr/ttyS000:15:090
12344993520,9cyclictest60-21kcompactd023:16:170
12344993520,9cyclictest60-21kcompactd023:16:170
181442340,2sleep016-21ksoftirqd/020:52:400
12344993419,8cyclictest90-1pr/ttyS020:17:060
12344993419,8cyclictest90-1pr/ttyS020:17:060
224082330,3sleep20-21swapper/223:57:382
224082330,3sleep20-21swapper/223:57:382
12345993327,4cyclictest0-21swapper/120:42:181
12345993327,4cyclictest0-21swapper/120:42:181
12345993327,3cyclictest0-21swapper/100:02:561
12345993327,3cyclictest0-21swapper/100:02:561
12345993325,6cyclictest28613-21fschecks_time21:22:301
12345993325,6cyclictest28613-21fschecks_time21:22:301
12345993325,6cyclictest28613-21fschecks_time21:22:301
12345993324,7cyclictest916-21netstat20:07:371
12345993323,8cyclictest3901-21kernelversion21:42:321
12345993323,8cyclictest3901-21kernelversion21:42:321
12344993326,5cyclictest4508-21latency_hist23:12:180
12344993326,5cyclictest4508-21latency_hist23:12:180
12344993324,7cyclictest32283-21fschecks_time21:32:290
14482320,3sleep20-21swapper/221:37:252
14482320,3sleep20-21swapper/221:37:252
12345993225,5cyclictest4523-21gltestperf00:37:301
12345993225,5cyclictest4523-21gltestperf00:37:301
12345993225,5cyclictest4523-21gltestperf00:37:301
12344993228,3cyclictest15797-21latency_hist23:42:180
12344993228,3cyclictest15797-21latency_hist23:42:180
12344993228,3cyclictest15797-21latency_hist23:42:180
12344993226,5cyclictest9212-21fschecks_count21:57:310
12344993226,5cyclictest9212-21fschecks_count21:57:310
12344993226,5cyclictest9212-21fschecks_count21:57:310
12344993218,4cyclictest90-1pr/ttyS022:56:090
12344993218,4cyclictest90-1pr/ttyS022:56:090
9492310,2sleep00-21swapper/020:07:380
12345993123,6cyclictest21889-21threads21:02:411
12345993123,6cyclictest21889-21threads21:02:411
12344993124,5cyclictest9393-21cron20:32:180
12344993124,5cyclictest9393-21cron20:32:180
12344993117,5cyclictest90-1pr/ttyS022:30:090
12344993117,5cyclictest90-1pr/ttyS022:30:090
55072300,3sleep20-21swapper/223:12:362
55072300,3sleep20-21swapper/223:12:362
278132300,3sleep20-21swapper/221:18:312
278132300,3sleep20-21swapper/221:18:312
278132300,3sleep20-21swapper/221:18:312
262412300,3chrt0-21swapper/000:07:370
262412300,3chrt0-21swapper/000:07:370
262412300,3chrt0-21swapper/000:07:370
1234799305,19cyclictest138722chrt23:36:363
1234799305,19cyclictest138722chrt23:36:363
12345993024,5cyclictest19190-21fschecks_time20:57:301
12345993024,5cyclictest19190-21fschecks_time20:57:301
12345993024,5cyclictest19190-21fschecks_time20:57:301
12345993022,6cyclictest19541-21latency_hist23:52:301
12345993021,7cyclictest4001-21latency_hist00:37:211
12344993024,5cyclictest30040-21unixbench-2d19:57:400
12344993024,5cyclictest30040-21unixbench-2d19:57:400
12344993024,5cyclictest16741-21netstat23:42:350
12344993024,5cyclictest16741-21netstat23:42:350
12344993024,5cyclictest16741-21netstat23:42:350
12344993020,7cyclictest21470-21latency_hist23:57:200
12344993020,7cyclictest21470-21latency_hist23:57:200
12344993017,3cyclictest181rcu_preempt20:37:300
12344993017,3cyclictest181rcu_preempt20:37:300
12344993016,3cyclictest90-1pr/ttyS022:03:090
12344993016,3cyclictest90-1pr/ttyS022:03:090
12344993015,3cyclictest181rcu_preempt23:47:390
12344993015,3cyclictest181rcu_preempt23:47:390
12345992920,7cyclictest13016-21cut22:07:301
12345992920,7cyclictest13016-21cut22:07:301
12344992925,3cyclictest12343-21cyclictest21:52:300
12344992925,3cyclictest12343-21cyclictest21:52:300
12344992925,3cyclictest12343-21cyclictest21:52:300
12344992922,5cyclictest12343-21cyclictest20:59:480
12344992922,5cyclictest12343-21cyclictest20:59:480
12344992922,5cyclictest12343-21cyclictest20:59:480
12344992915,2cyclictest181rcu_preempt20:47:380
12344992915,2cyclictest181rcu_preempt20:22:390
12344992915,2cyclictest181rcu_preempt20:22:390
1234799287,16cyclictest308182chrt00:22:193
1234799287,16cyclictest308182chrt00:22:193
1234799281,3cyclictest11955-21chrt23:31:183
1234799281,3cyclictest11955-21chrt23:31:183
12345992821,5cyclictest25875-21kernelversion00:07:321
12345992821,5cyclictest25875-21kernelversion00:07:321
12345992821,5cyclictest25875-21kernelversion00:07:321
12345992820,6cyclictest21410-21latency_hist19:37:251
12345992819,7cyclictest10391-21/usr/sbin/munin23:27:381
12345992819,7cyclictest10391-21/usr/sbin/munin23:27:381
12344992823,3cyclictest12343-21cyclictest23:28:350
12344992823,3cyclictest12343-21cyclictest23:28:350
12344992822,5cyclictest17406-21processes22:17:380
12344992822,5cyclictest17406-21processes22:17:380
12344992821,5cyclictest9244-21ntp_kernel_err23:22:360
12344992821,5cyclictest9244-21ntp_kernel_err23:22:360
12344992821,5cyclictest9244-21ntp_kernel_err23:22:360
12344992821,2cyclictest181rcu_preempt19:37:260
12344992821,2cyclictest181rcu_preempt19:37:260
12344992814,8cyclictest12343-21cyclictest21:16:070
12344992814,8cyclictest12343-21cyclictest21:16:070
12344992814,2cyclictest181rcu_preempt19:22:310
12344992814,2cyclictest181rcu_preempt19:22:310
12344992814,2cyclictest181rcu_preempt19:22:310
12344992813,2cyclictest181rcu_preempt22:22:340
12344992813,2cyclictest181rcu_preempt22:22:340
1234799278,15cyclictest69202chrt21:52:123
1234799278,15cyclictest69202chrt21:52:123
1234799278,15cyclictest69202chrt21:52:123
1234799276,17cyclictest0-21swapper/320:50:143
1234799275,18cyclictest323412chrt20:06:163
1234799275,18cyclictest323412chrt20:06:163
1234799275,18cyclictest323412chrt20:06:163
1234799271,4cyclictest9372sleep321:32:473
1234799271,4cyclictest9372sleep321:32:473
1234799271,4cyclictest8619-21chrt23:22:293
1234799271,4cyclictest8619-21chrt23:22:293
1234799271,4cyclictest8619-21chrt23:22:293
12345992721,4cyclictest8037-21gltestperf20:27:311
12345992721,4cyclictest8037-21gltestperf20:27:311
12345992720,5cyclictest545-21in:imuxsock22:17:181
12345992720,5cyclictest545-21in:imuxsock22:17:181
12345992720,5cyclictest545-21in:imuxsock22:17:181
12345992719,6cyclictest8922-21latency_hist21:57:261
12345992719,6cyclictest8922-21latency_hist21:57:261
12345992719,6cyclictest8922-21latency_hist21:57:261
12345992718,7cyclictest4624-21needreboot20:17:361
12345992718,7cyclictest4624-21needreboot20:17:361
12345992718,7cyclictest18721-21threads19:27:411
12345992718,7cyclictest18721-21threads19:27:411
12344992722,3cyclictest0-21swapper/021:27:310
12344992721,3cyclictest0-21swapper/022:52:300
12344992720,2cyclictest181rcu_preempt19:42:280
12344992720,2cyclictest181rcu_preempt19:42:280
12344992715,3cyclictest181rcu_preempt00:37:370
12344992715,3cyclictest181rcu_preempt00:37:370
12344992715,3cyclictest181rcu_preempt00:37:370
12344992715,2cyclictest181rcu_preempt20:42:380
12344992715,2cyclictest181rcu_preempt20:42:380
12344992714,2cyclictest181rcu_preempt23:02:380
12344992714,2cyclictest181rcu_preempt23:02:380
12344992713,2cyclictest181rcu_preempt22:42:310
12344992713,2cyclictest181rcu_preempt22:42:310
12344992713,2cyclictest181rcu_preempt22:42:310
12344992713,2cyclictest181rcu_preempt20:32:360
12344992713,2cyclictest181rcu_preempt20:32:360
12344992713,2cyclictest181rcu_preempt20:22:240
12344992713,2cyclictest181rcu_preempt20:22:240
12344992712,3cyclictest181rcu_preempt00:32:410
12344992710,3cyclictest0-21swapper/021:17:320
12344992710,3cyclictest0-21swapper/021:17:320
12344992710,3cyclictest0-21swapper/021:17:320
1234799261,4cyclictest3668-21chrt00:33:573
12345992621,4cyclictest21951-21gltestperf23:57:321
12345992621,4cyclictest21951-21gltestperf23:57:321
12345992620,4cyclictest0-21swapper/122:32:181
12345992620,4cyclictest0-21swapper/122:32:181
12345992619,5cyclictest2798-21vmstat21:37:421
12345992619,5cyclictest2798-21vmstat21:37:421
12345992619,4cyclictest0-21swapper/123:22:341
12345992619,4cyclictest0-21swapper/123:22:341
12345992619,4cyclictest0-21swapper/123:22:341
1234499269,10cyclictest16-21ksoftirqd/020:04:070
1234499269,10cyclictest16-21ksoftirqd/020:04:070
1234499269,10cyclictest16-21ksoftirqd/020:04:070
1234499267,5cyclictest16-21ksoftirqd/022:16:160
1234499267,5cyclictest16-21ksoftirqd/022:16:160
1234499267,5cyclictest16-21ksoftirqd/022:16:160
12344992619,2cyclictest181rcu_preempt19:47:310
12344992619,2cyclictest181rcu_preempt19:47:310
12344992618,2cyclictest181rcu_preempt21:37:300
12344992618,2cyclictest181rcu_preempt21:37:300
12344992618,2cyclictest181rcu_preempt21:07:090
12344992618,2cyclictest181rcu_preempt21:07:090
12344992615,3cyclictest181rcu_preempt22:57:410
12344992615,3cyclictest181rcu_preempt22:57:410
12344992611,3cyclictest181rcu_preempt21:32:350
12344992611,3cyclictest181rcu_preempt21:32:350
12344992611,2cyclictest181rcu_preempt22:47:300
1234799251,9cyclictest18587-21taskset22:22:273
1234799251,7cyclictest10531-21chrt22:00:243
1234799251,7cyclictest10531-21chrt22:00:243
1234799251,7cyclictest10531-21chrt22:00:243
1234799251,4cyclictest81062sleep323:20:203
1234799251,4cyclictest81062sleep323:20:203
1234799251,4cyclictest318332sleep321:31:583
1234799251,4cyclictest318332sleep321:31:583
1234799251,4cyclictest291712sleep322:48:373
1234799251,4cyclictest291712sleep322:48:373
1234799251,4cyclictest267852sleep319:51:573
1234799251,4cyclictest267852sleep319:51:573
1234799251,4cyclictest2566-21chrt23:06:213
1234799251,4cyclictest2566-21chrt23:06:213
1234799251,4cyclictest246442sleep319:43:163
1234799251,4cyclictest246442sleep319:43:163
1234799251,4cyclictest156042sleep323:39:543
1234799251,4cyclictest156042sleep323:39:543
1234799251,4cyclictest156042sleep323:39:543
1234799251,4cyclictest14254-21chrt20:42:383
1234799251,4cyclictest14254-21chrt20:42:383
1234799251,4cyclictest128632sleep320:38:563
1234799251,4cyclictest128632sleep320:38:563
1234799251,3cyclictest267782sleep300:09:173
1234799251,3cyclictest267782sleep300:09:173
1234799251,3cyclictest267782sleep300:09:173
1234799251,3cyclictest260862sleep321:15:143
1234799251,3cyclictest260862sleep321:15:143
1234799251,3cyclictest0-21swapper/323:48:553
1234799251,3cyclictest0-21swapper/323:48:553
1234799251,3cyclictest0-21swapper/300:29:583
1234799251,3cyclictest0-21swapper/300:29:583
1234799251,3cyclictest0-21swapper/300:29:583
1234799251,10cyclictest24020-21chrt21:07:463
1234799251,10cyclictest24020-21chrt21:07:463
12345992521,2cyclictest0-21swapper/121:12:311
12345992521,2cyclictest0-21swapper/121:12:311
12345992520,3cyclictest0-21swapper/121:52:311
12345992520,3cyclictest0-21swapper/121:52:311
12345992519,4cyclictest545-21in:imuxsock22:57:171
12345992519,4cyclictest545-21in:imuxsock22:57:171
12345992519,4cyclictest32616-21sshd00:27:091
12345992519,4cyclictest32616-21sshd00:27:091
12345992518,5cyclictest32283-21fschecks_time21:32:291
12345992518,5cyclictest23914-21missed_timers19:42:331
12345992518,5cyclictest23914-21missed_timers19:42:331
12345992518,5cyclictest19958-21sshd22:25:091
12345992518,5cyclictest19958-21sshd22:25:091
12345992518,5cyclictest19958-21sshd22:25:091
12345992518,5cyclictest17275-21needreboot22:17:351
12345992518,5cyclictest17275-21needreboot22:17:351
12345992518,5cyclictest15607-21gltestperf20:47:311
12345992518,4cyclictest0-21swapper/122:02:311
12345992518,4cyclictest0-21swapper/122:02:311
12345992518,4cyclictest0-21swapper/122:02:311
12345992517,6cyclictest29849-21fschecks_count22:52:301
12344992517,2cyclictest181rcu_preempt00:22:310
12344992517,2cyclictest181rcu_preempt00:22:310
12344992516,2cyclictest181rcu_preempt23:32:370
12344992516,2cyclictest181rcu_preempt23:32:370
12344992515,2cyclictest181rcu_preempt21:07:310
12344992515,2cyclictest181rcu_preempt21:07:310
12344992513,2cyclictest181rcu_preempt21:57:340
12344992513,2cyclictest181rcu_preempt21:57:340
12344992513,2cyclictest181rcu_preempt21:57:340
12344992511,2cyclictest181rcu_preempt23:17:370
12344992511,2cyclictest181rcu_preempt23:17:370
1234799241,7cyclictest6269-21chrt23:15:463
1234799241,7cyclictest6269-21chrt23:15:463
1234799241,7cyclictest20114-21chrt22:27:103
1234799241,7cyclictest20114-21chrt22:27:103
1234799241,7cyclictest20114-21chrt22:27:103
1234799241,7cyclictest17940-21chrt22:18:293
1234799241,4cyclictest8511-21chrt21:53:413
1234799241,4cyclictest8511-21chrt21:53:413
1234799241,4cyclictest8511-21chrt21:53:413
1234799241,4cyclictest5397-21chrt20:19:263
1234799241,4cyclictest5397-21chrt20:19:263
1234799241,4cyclictest30192-21chrt19:57:523
1234799241,4cyclictest30192-21chrt19:57:523
1234799241,4cyclictest28012sleep321:37:413
1234799241,4cyclictest28012sleep321:37:413
1234799241,4cyclictest27257-21chrt22:42:583
1234799241,4cyclictest27257-21chrt22:42:583
1234799241,4cyclictest27257-21chrt22:42:583
1234799241,4cyclictest227522sleep319:38:103
1234799241,4cyclictest227522sleep319:38:103
1234799241,4cyclictest204662sleep321:00:153
1234799241,4cyclictest204662sleep321:00:153
1234799241,4cyclictest204662sleep321:00:153
1234799241,4cyclictest18523-21chrt20:54:123
1234799241,4cyclictest173442sleep323:43:043
1234799241,4cyclictest173442sleep323:43:043
1234799241,4cyclictest173442sleep323:43:043
1234799241,4cyclictest17340-21chrt19:25:273
1234799241,4cyclictest17340-21chrt19:25:273
1234799241,4cyclictest17340-21chrt19:25:273
1234799241,4cyclictest15403-21chrt22:12:353
1234799241,4cyclictest15403-21chrt22:12:353
1234799241,4cyclictest15403-21chrt22:12:353
1234799241,4cyclictest10921-21chrt20:33:013
1234799241,4cyclictest10921-21chrt20:33:013
1234799241,3cyclictest41632sleep323:07:583
1234799241,3cyclictest41632sleep323:07:583
1234799241,3cyclictest190172sleep319:28:053
1234799241,3cyclictest190172sleep319:28:053
1234799240,4cyclictest310422sleep322:53:433
1234799240,4cyclictest310422sleep322:53:433
1234799240,4cyclictest278342sleep321:18:483
1234799240,4cyclictest278342sleep321:18:483
1234799240,4cyclictest278342sleep321:18:483
12345992419,3cyclictest25537-21gltestperf19:47:311
12345992419,3cyclictest25537-21gltestperf19:47:311
12345992419,3cyclictest0-21swapper/123:42:381
12345992419,3cyclictest0-21swapper/123:42:381
12345992419,3cyclictest0-21swapper/123:42:381
12345992418,4cyclictest0-21swapper/122:07:381
12345992418,4cyclictest0-21swapper/122:07:381
12345992417,5cyclictest28326-21latency_hist21:22:281
12345992417,5cyclictest28326-21latency_hist21:22:281
12345992417,5cyclictest28326-21latency_hist21:22:281
12345992417,4cyclictest0-21swapper/123:32:391
12345992417,4cyclictest0-21swapper/123:32:391
12345992417,4cyclictest0-21swapper/121:52:181
12345992416,6cyclictest27174-21fschecks_count19:52:281
1234499245,3cyclictest171ktimers/000:17:300
1234499245,3cyclictest171ktimers/000:17:300
12344992419,3cyclictest201rcuc/019:32:320
318932230,4chrt0-21swapper/300:22:393
318932230,4chrt0-21swapper/300:22:393
1234799231,3cyclictest284212sleep319:54:023
1234799231,3cyclictest15422sleep320:08:173
1234799230,4cyclictest20896-21chrt19:33:153
12345992317,4cyclictest1346-21avahi-daemon23:02:391
12345992317,4cyclictest1346-21avahi-daemon23:02:391
12345992316,6cyclictest1-21systemd22:58:091
12345992316,6cyclictest1-21systemd22:58:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional