You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 13:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Wed Mar 25, 2026 00:44:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1444921420,2sleep014453-21latency19:21:530
83932970,3sleep20-21swapper/220:31:572
83932970,3sleep20-21swapper/220:31:572
95002940,3sleep30-21swapper/320:36:453
95002940,3sleep30-21swapper/320:36:453
208492810,3sleep20-21swapper/219:37:592
208492810,3sleep20-21swapper/219:37:592
70122790,2chrt0-21swapper/321:56:443
70122790,2chrt0-21swapper/321:56:443
19822770,3sleep30-21swapper/321:41:533
19822770,3sleep30-21swapper/321:41:533
19822770,3sleep30-21swapper/321:41:533
322222720,3sleep30-21swapper/321:36:513
322222720,3sleep30-21swapper/321:36:513
227932620,1sleep113522-21kworker/u9:2+xprtiod00:02:301
227932620,1sleep113522-21kworker/u9:2+xprtiod00:02:301
34282610,1sleep30-21swapper/323:11:543
34282610,1sleep30-21swapper/323:11:543
197932600,2sleep10-21swapper/121:02:001
197932600,2sleep10-21swapper/121:02:001
166442590,2sleep016645-21fschecks_count22:21:500
166442590,2sleep016645-21fschecks_count22:21:500
166442590,2sleep016645-21fschecks_count22:21:500
165732580,3chrt0-21swapper/319:26:583
165732580,3chrt0-21swapper/319:26:583
142942580,2chrt14277-21switchtime20:46:590
142942580,2chrt14277-21switchtime20:46:590
93022560,4sleep30-21swapper/322:01:513
93022560,4sleep30-21swapper/322:01:513
93022560,4sleep30-21swapper/322:01:513
69342560,3sleep30-21swapper/320:27:003
69342560,3sleep30-21swapper/320:27:003
69342560,3sleep30-21swapper/320:27:003
193942560,2sleep20-21swapper/223:56:392
10228995138,9cyclictest0-21swapper/100:01:441
10228995138,9cyclictest0-21swapper/100:01:441
10228995138,9cyclictest0-21swapper/100:01:441
10215995121,9cyclictest10213-21cyclictest22:16:440
28682500,3sleep20-21swapper/223:11:492
28682500,3sleep20-21swapper/223:11:492
10215994843,2cyclictest0-21swapper/000:01:540
10215994843,2cyclictest0-21swapper/000:01:540
147092460,3sleep10-21swapper/119:21:581
262362450,3chrt0-21swapper/321:21:393
262362450,3chrt0-21swapper/321:21:393
199242450,3sleep20-21swapper/221:02:002
199242450,3sleep20-21swapper/221:02:002
73852440,2sleep20-21swapper/221:56:522
73852440,2sleep20-21swapper/221:56:522
73852440,2sleep20-21swapper/221:56:522
10228994426,9cyclictest60-21kcompactd019:47:021
10215994419,14cyclictest28368-21chrt19:58:350
10215994419,14cyclictest28368-21chrt19:58:350
10215994418,10cyclictest19109-21chrt19:34:310
10215994418,10cyclictest19109-21chrt19:34:310
10215994418,10cyclictest16133-21taskset22:20:280
10215994418,10cyclictest16133-21taskset22:20:280
10215994416,8cyclictest29021-21ntp_states21:26:580
10215994415,11cyclictest18864-21cat21:01:470
10215994415,11cyclictest18864-21cat21:01:470
10215994335,6cyclictest0-21swapper/020:07:030
10215994335,6cyclictest0-21swapper/020:07:030
10215994318,14cyclictest26065-21chrt21:20:190
10215994318,14cyclictest26065-21chrt21:20:190
10215994317,16cyclictest11728-21runrttasks23:34:300
10215994317,16cyclictest11728-21runrttasks23:34:300
10215994317,10cyclictest5323-21taskset20:23:060
10215994316,17cyclictest6064-21seq23:18:540
10215994316,17cyclictest6064-21seq23:18:540
10215994316,16cyclictest11416-21taskset20:41:470
10215994316,16cyclictest11416-21taskset20:41:470
184512420,2sleep118476-21ntp_states23:51:561
10215994225,11cyclictest0-21swapper/021:09:050
10215994218,9cyclictest27315-21taskset22:50:000
10215994218,10cyclictest20814-21sed23:57:020
10215994218,10cyclictest20814-21sed23:57:020
10215994218,10cyclictest20814-21sed23:57:020
10215994216,16cyclictest19892-21chrt22:30:380
10215994216,16cyclictest19892-21chrt22:30:380
10215994216,13cyclictest28041-21taskset21:26:310
10215994216,13cyclictest28041-21taskset21:26:310
10215994216,10cyclictest7618-21sed20:31:430
10215994216,10cyclictest7618-21sed20:31:430
10215994216,10cyclictest7618-21sed20:31:430
269142410,1sleep20-21swapper/222:47:002
10662410,3sleep30-21swapper/323:06:513
10662410,3sleep30-21swapper/323:06:513
10215994135,4cyclictest700-21192.168.115.40-manager23:48:390
10215994135,4cyclictest700-21192.168.115.40-manager23:48:390
10215994116,15cyclictest29260-21chrt22:56:030
10215994116,15cyclictest29260-21chrt22:56:030
10215994115,11cyclictest10801-21latency_hist22:06:470
10215994115,11cyclictest10801-21latency_hist22:06:470
10215994115,11cyclictest10801-21latency_hist22:06:470
10215994114,8cyclictest0-21swapper/023:23:390
10215994114,8cyclictest0-21swapper/023:23:390
10215994114,11cyclictest9298-21run-parts23:27:000
10215994114,11cyclictest9298-21run-parts23:27:000
67612400,2sleep20-21swapper/220:26:592
67612400,2sleep20-21swapper/220:26:592
67612400,2sleep20-21swapper/220:26:592
10228994021,10cyclictest545-21in:imuxsock22:01:501
10228994021,10cyclictest545-21in:imuxsock22:01:501
10228994021,10cyclictest545-21in:imuxsock22:01:501
10215994017,8cyclictest2267-21ntp_states21:41:580
10215994017,8cyclictest2267-21ntp_states21:41:580
10215994017,8cyclictest2267-21ntp_states21:41:580
10215994017,14cyclictest953-21seq21:37:440
10215994017,14cyclictest953-21seq21:37:440
10215994016,9cyclictest24249-21chrt21:16:010
10215994015,8cyclictest0-21swapper/019:41:420
10215994015,8cyclictest0-21swapper/019:41:420
10215994015,12cyclictest22473-21sed19:42:000
10215994015,12cyclictest22473-21sed19:42:000
10215994015,10cyclictest9262-21chrt20:35:530
10215994015,10cyclictest9262-21chrt20:35:530
10215994015,10cyclictest20130-21unixbench_singl21:02:020
10215994015,10cyclictest20130-21unixbench_singl21:02:020
10215994013,11cyclictest30174-21cpu21:31:490
10215994013,11cyclictest30174-21cpu21:31:490
10215993930,8cyclictest700-21192.168.115.40-manager23:53:390
10215993916,9cyclictest15909-21ntp_states20:51:560
10215993915,7cyclictest3647-21taskset20:20:470
10215993915,7cyclictest3647-21taskset20:20:470
10215993915,7cyclictest3647-21taskset20:20:470
10215993915,7cyclictest12221-21awk23:36:510
10215993915,7cyclictest12221-21awk23:36:510
10215993915,7cyclictest12221-21awk23:36:510
10215993915,11cyclictest25571-21chrt22:46:300
10215993915,11cyclictest25571-21chrt22:46:300
10215993914,7cyclictest0-21swapper/023:15:560
10215993914,7cyclictest0-21swapper/023:15:560
10215993913,7cyclictest0-21swapper/022:00:340
10215993913,7cyclictest0-21swapper/022:00:340
10215993913,7cyclictest0-21swapper/022:00:340
10215993913,12cyclictest30927-21chrt22:58:320
10215993913,12cyclictest30927-21chrt22:58:320
10215993832,3cyclictest700-21192.168.115.40-manager00:20:400
10215993832,3cyclictest700-21192.168.115.40-manager00:20:400
10215993816,8cyclictest12397-21taskset22:10:250
10215993816,8cyclictest12397-21taskset22:10:250
10215993816,11cyclictest30175-21chrt20:02:370
10215993816,11cyclictest30175-21chrt20:02:370
10215993815,11cyclictest25211-21sh19:51:490
10215993815,11cyclictest25211-21sh19:51:490
10215993815,11cyclictest13031-21chrt20:46:020
10215993815,11cyclictest13031-21chrt20:46:020
10215993813,8cyclictest750-21cat23:06:450
10215993813,8cyclictest750-21cat23:06:450
10215993813,8cyclictest750-21cat23:06:450
10228993721,3cyclictest181rcu_preempt21:46:311
10228993721,3cyclictest181rcu_preempt21:46:311
10228993721,3cyclictest181rcu_preempt21:46:311
10215993720,14cyclictest2181-21/usr/sbin/munin00:37:010
10215993720,14cyclictest2181-21/usr/sbin/munin00:37:010
10215993715,9cyclictest0-21swapper/021:47:360
10215993715,9cyclictest0-21swapper/021:47:360
10215993713,8cyclictest1657-21chrt20:14:150
10215993713,11cyclictest749-21runrttasks21:56:210
10215993713,11cyclictest749-21runrttasks21:56:210
10228993621,9cyclictest90-1pr/ttyS020:01:501
10228993621,9cyclictest90-1pr/ttyS020:01:501
1021599369,11cyclictest749-21runrttasks22:40:350
1021599369,11cyclictest749-21runrttasks22:40:350
10215993613,9cyclictest32298-21taskset00:29:330
10215993612,11cyclictest11154-21chrt20:41:080
218602350,2sleep20-21swapper/221:07:032
10215993529,4cyclictest700-21192.168.115.40-manager00:14:400
10215993529,4cyclictest700-21192.168.115.40-manager00:14:400
10215993525,8cyclictest700-21192.168.115.40-manager23:44:140
10215993525,8cyclictest700-21192.168.115.40-manager23:44:140
10215993523,9cyclictest1903-21sshd00:36:010
10215993515,7cyclictest24910-21seq00:10:440
10215993515,7cyclictest24910-21seq00:10:440
10215993514,11cyclictest2270-21taskset23:08:050
10215993514,11cyclictest2270-21taskset23:08:050
28322340,3sleep20-21swapper/200:36:552
28322340,3sleep20-21swapper/200:36:552
18882340,3sleep20-21swapper/221:41:522
18882340,3sleep20-21swapper/221:41:522
18882340,3sleep20-21swapper/221:41:522
10215993425,7cyclictest0-21swapper/000:22:100
10215993425,7cyclictest0-21swapper/000:22:100
10228993316,5cyclictest90-1pr/ttyS022:11:581
10228993315,2cyclictest0-21swapper/119:37:021
10228993315,2cyclictest0-21swapper/119:37:021
10215993329,3cyclictest700-21192.168.115.40-manager19:28:020
10215993329,3cyclictest700-21192.168.115.40-manager19:28:020
73062320,2sleep20-21swapper/223:21:582
73062320,2sleep20-21swapper/223:21:582
1024799324,18cyclictest0-21swapper/300:01:493
1024799324,18cyclictest0-21swapper/300:01:493
1024799324,18cyclictest0-21swapper/300:01:493
10228993227,4cyclictest10213-21cyclictest23:32:001
10228993227,4cyclictest10213-21cyclictest23:32:001
10228993225,5cyclictest15014-21threads23:42:001
10228993225,5cyclictest15014-21threads23:42:001
1022899322,4cyclictest700-21192.168.115.40-manager21:25:051
1022899322,4cyclictest700-21192.168.115.40-manager21:25:051
10215993222,7cyclictest24523-21sshd19:47:020
10215993221,9cyclictest0-21swapper/022:32:370
10215993221,9cyclictest0-21swapper/022:32:370
53362310,2sleep20-21swapper/221:51:492
53362310,2sleep20-21swapper/221:51:492
220432310,4sleep30-21swapper/321:07:043
1024099312,22cyclictest0-21swapper/200:01:492
1024099312,22cyclictest0-21swapper/200:01:492
1024099312,22cyclictest0-21swapper/200:01:492
10228993126,3cyclictest4472-21latency_hist23:16:411
10228993126,3cyclictest4472-21latency_hist23:16:411
1022899312,5cyclictest700-21192.168.115.40-manager22:42:081
1022899312,5cyclictest700-21192.168.115.40-manager22:42:081
10228993123,2cyclictest181rcu_preempt00:37:001
10228993123,2cyclictest181rcu_preempt00:37:001
10228993118,4cyclictest90-1pr/ttyS023:21:531
10228993118,4cyclictest90-1pr/ttyS023:21:531
10228993117,8cyclictest90-1pr/ttyS020:46:521
10228993117,8cyclictest90-1pr/ttyS020:46:521
10228993117,4cyclictest90-1pr/ttyS019:51:581
10228993117,4cyclictest90-1pr/ttyS019:51:581
10228993115,4cyclictest90-1pr/ttyS020:16:471
10228993115,4cyclictest90-1pr/ttyS020:16:471
10228993115,4cyclictest90-1pr/ttyS020:16:471
10228993115,4cyclictest90-1pr/ttyS000:11:501
10228993115,4cyclictest90-1pr/ttyS000:11:501
10228993113,5cyclictest281ktimers/120:53:041
10228993023,5cyclictest15254-21needreboot22:16:551
10228993023,5cyclictest15254-21needreboot22:16:551
1022899302,15cyclictest281ktimers/121:31:351
10228993019,8cyclictest12361-21cut23:36:521
10228993019,8cyclictest12361-21cut23:36:521
10228993019,8cyclictest12361-21cut23:36:521
10228993017,4cyclictest90-1pr/ttyS021:36:501
10228993017,4cyclictest90-1pr/ttyS021:36:501
10228993015,9cyclictest14701-21kworker/u9:2-flush-179:022:21:531
10228993015,9cyclictest14701-21kworker/u9:2-flush-179:022:21:531
10228993015,9cyclictest14701-21kworker/u9:2-flush-179:022:21:531
1022899293,6cyclictest281ktimers/120:31:341
1022899293,6cyclictest281ktimers/120:31:341
1022899293,6cyclictest281ktimers/120:31:341
10228992925,3cyclictest28621-21wc20:01:381
10228992925,3cyclictest28621-21wc20:01:381
10228992924,4cyclictest572-21cups-browsed22:56:591
10228992924,4cyclictest572-21cups-browsed22:56:591
10228992922,5cyclictest90-1pr/ttyS000:16:521
10228992922,5cyclictest90-1pr/ttyS000:16:521
10228992922,5cyclictest31852-21unixbench-2d20:07:001
10228992922,5cyclictest31852-21unixbench-2d20:07:001
10228992916,4cyclictest68-21kswapd000:26:511
10228992916,4cyclictest60-21kcompactd000:31:511
10228992915,8cyclictest90-1pr/ttyS022:01:491
10228992915,8cyclictest90-1pr/ttyS022:01:491
10228992915,8cyclictest18607-21kworker/u9:0-rpciod21:11:411
10228992915,3cyclictest90-1pr/ttyS021:16:581
10228992915,3cyclictest90-1pr/ttyS021:16:581
10228992914,9cyclictest90-1pr/ttyS022:37:021
10228992914,9cyclictest90-1pr/ttyS022:37:021
10228992913,9cyclictest90-1pr/ttyS023:46:541
10228992913,9cyclictest90-1pr/ttyS023:46:541
42442280,1sleep14393-21if_eth020:21:521
1022899287,5cyclictest271rcuc/123:21:291
1022899287,5cyclictest271rcuc/123:21:291
10228992821,5cyclictest271rcuc/120:33:261
10228992821,5cyclictest271rcuc/120:33:261
10228992820,6cyclictest550-21cron23:01:511
10228992820,6cyclictest550-21cron23:01:511
10228992820,6cyclictest550-21cron23:01:511
10228992810,3cyclictest0-21swapper/121:12:011
6362270,1sleep20-21swapper/223:06:382
6362270,1sleep20-21swapper/223:06:382
6362270,1sleep20-21swapper/223:06:382
301262270,2chrt0-21swapper/222:56:532
301262270,2chrt0-21swapper/222:56:532
1022899279,2cyclictest0-21swapper/100:06:551
1022899279,2cyclictest0-21swapper/100:06:551
10228992723,3cyclictest17367-21gltestperf20:56:501
10228992723,3cyclictest17367-21gltestperf20:56:501
10228992722,3cyclictest18644-21gltestperf22:26:531
10228992722,3cyclictest18644-21gltestperf22:26:531
10228992719,2cyclictest181rcu_preempt19:41:521
10228992719,2cyclictest181rcu_preempt19:41:521
10228992719,2cyclictest181rcu_preempt00:22:001
10228992719,2cyclictest181rcu_preempt00:22:001
10228992718,2cyclictest181rcu_preempt22:51:501
10228992718,2cyclictest181rcu_preempt22:51:501
10228992716,2cyclictest181rcu_preempt22:06:561
10228992716,2cyclictest181rcu_preempt22:06:561
10228992715,3cyclictest90-1pr/ttyS019:31:581
10228992715,3cyclictest90-1pr/ttyS019:31:581
1022899269,4cyclictest0-21swapper/121:31:591
1022899269,4cyclictest0-21swapper/121:31:591
10228992620,5cyclictest15980-21fschecks_time19:26:501
10228992620,5cyclictest15980-21fschecks_time19:26:501
10228992618,2cyclictest181rcu_preempt22:46:581
10228992617,7cyclictest20690-21kernelversion22:31:531
10228992617,7cyclictest20690-21kernelversion22:31:531
10228992616,4cyclictest90-1pr/ttyS021:51:521
10228992616,4cyclictest90-1pr/ttyS021:51:521
10228992611,4cyclictest90-1pr/ttyS023:07:011
10228992611,4cyclictest90-1pr/ttyS023:07:011
10228992611,4cyclictest60-21kcompactd021:51:321
10228992611,4cyclictest60-21kcompactd021:51:321
226962250,2sleep20-21swapper/221:11:492
182752250,2sleep30-21swapper/320:56:593
182752250,2sleep30-21swapper/320:56:593
10240992516,5cyclictest3132sleep200:31:482
1022899256,4cyclictest181rcu_preempt20:13:401
10228992513,3cyclictest90-1pr/ttyS022:00:011
10228992510,7cyclictest0-21swapper/123:26:511
10228992510,7cyclictest0-21swapper/123:26:511
1022899248,3cyclictest181rcu_preempt20:41:511
1022899248,3cyclictest181rcu_preempt20:41:511
1022899246,8cyclictest90-1pr/ttyS020:36:511
1022899246,8cyclictest90-1pr/ttyS020:36:511
1022899246,8cyclictest90-1pr/ttyS020:36:511
159762230,3chrt0-21swapper/223:46:502
151242230,3sleep30-21swapper/323:42:013
151242230,3sleep30-21swapper/323:42:013
1024799225,11cyclictest0-21swapper/300:02:003
1024799225,11cyclictest0-21swapper/300:02:003
1024099221,14cyclictest16526-21taskset19:26:572
1024099221,14cyclictest16526-21taskset19:26:572
273662210,4chrt0-21swapper/321:21:593
273662210,4chrt0-21swapper/321:21:593
1024099215,12cyclictest0-21swapper/200:02:002
1024099215,12cyclictest0-21swapper/200:02:002
10240992114,4cyclictest181242sleep222:26:382
10240992114,4cyclictest181242sleep222:26:382
10240992114,4cyclictest181242sleep222:26:382
1024799203,9cyclictest0-21swapper/321:12:003
1024099205,8cyclictest0-21swapper/223:39:092
1024099205,8cyclictest0-21swapper/223:39:092
1024099205,8cyclictest0-21swapper/223:39:092
10240992014,4cyclictest27272-21chrt21:21:582
10240992014,4cyclictest27272-21chrt21:21:582
1024799193,9cyclictest0-21swapper/319:54:023
1024799193,9cyclictest0-21swapper/319:54:023
1024799191,8cyclictest0-21swapper/319:31:483
1024799191,8cyclictest0-21swapper/319:31:483
10247991913,4cyclictest143532sleep319:21:523
1024799191,13cyclictest24726-21chrt22:41:593
1024799191,13cyclictest24726-21chrt22:41:593
1024799191,13cyclictest13179-21taskset20:46:423
1024799191,13cyclictest13179-21taskset20:46:423
282162180,3sleep20-21swapper/219:57:002
282162180,3sleep20-21swapper/219:57:002
1024799184,11cyclictest0-21swapper/300:37:013
1024799184,11cyclictest0-21swapper/300:37:013
1024799182,9cyclictest0-21swapper/322:13:023
1024799181,12cyclictest9439-21chrt23:27:013
1024799181,12cyclictest9439-21chrt23:27:013
1024799181,12cyclictest29039-21chrt20:01:523
1024799181,12cyclictest29039-21chrt20:01:523
1024799181,12cyclictest1171-21chrt00:31:573
1024099181,12cyclictest12315-21chrt20:41:582
1024099181,12cyclictest12315-21chrt20:41:582
1024799173,11cyclictest0-21swapper/322:33:023
1024799173,11cyclictest0-21swapper/322:33:023
1024799171,12cyclictest31414-21chrt00:26:553
1024799171,12cyclictest10013-21chrt20:36:533
1024799171,12cyclictest10013-21chrt20:36:533
1024799171,12cyclictest10013-21chrt20:36:533
1024799171,11cyclictest28834-21chrt21:26:543
1024799171,11cyclictest23031-21taskset22:37:003
1024799171,11cyclictest23031-21taskset22:37:003
1024799171,11cyclictest16125-21chrt23:46:513
1024799171,11cyclictest16125-21chrt23:46:513
1024799171,11cyclictest0-21swapper/300:11:503
1024799171,11cyclictest0-21swapper/300:11:503
1024799171,10cyclictest15910-21chrt20:51:563
1024099171,12cyclictest28420-21taskset22:51:592
1024099171,12cyclictest28420-21taskset22:51:592
1024099171,12cyclictest10566-21chrt20:37:002
1024099171,12cyclictest10566-21chrt20:37:002
1024099171,12cyclictest10566-21chrt20:37:002
1024099171,11cyclictest32613-21chrt20:11:522
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional