You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-01 - 15:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Wed Apr 01, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3033521410,2sleep130340-21gltestperf09:41:591
3033521410,2sleep130340-21gltestperf09:41:591
285782810,3sleep20-21swapper/211:02:082
285782810,3sleep20-21swapper/211:02:082
181512710,2sleep30-21swapper/309:07:083
181512710,2sleep30-21swapper/309:07:083
41302620,4sleep04132-21tail08:31:590
74842570,4sleep07489-21timerwakeupswit11:32:090
74842570,4sleep07489-21timerwakeupswit11:32:090
287662520,2sleep20-21swapper/209:37:022
287662520,2sleep20-21swapper/209:37:022
24252520,2chrt2424-21cron11:21:451
24252520,2chrt2424-21cron11:21:451
24252520,2chrt2424-21cron11:21:451
155962480,3chrt0-21swapper/311:56:483
155962480,3chrt0-21swapper/311:56:483
90562470,3chrt0-21swapper/110:11:581
90562470,3chrt0-21swapper/110:11:581
318802440,3sleep00-21swapper/008:17:240
318802440,3sleep00-21swapper/008:17:240
318802440,3sleep00-21swapper/008:17:240
245672440,2chrt0-21swapper/010:52:050
95792420,3sleep30-21swapper/308:46:593
95792420,3sleep30-21swapper/308:46:593
141152410,2sleep014291-21timerwakeupswit08:57:090
141152410,2sleep014291-21timerwakeupswit08:57:090
6397993931,6cyclictest201rcuc/011:47:460
6397993931,6cyclictest201rcuc/011:47:460
6397993911,5cyclictest171ktimers/012:41:470
6397993911,5cyclictest171ktimers/012:41:470
130712390,2sleep113070-21sed07:27:081
130712390,2sleep113070-21sed07:27:081
6398993831,5cyclictest9906-21latency_hist11:41:561
6398993831,5cyclictest9906-21latency_hist11:41:561
6398993831,5cyclictest9906-21latency_hist11:41:561
273012380,3sleep30-21swapper/312:26:593
273012380,3sleep30-21swapper/312:26:593
163242380,3sleep30-21swapper/309:02:093
163242380,3sleep30-21swapper/309:02:093
284252370,3chrt0-21swapper/309:36:593
284252370,3chrt0-21swapper/309:36:593
6397993627,7cyclictest11063-21threads07:22:080
6398993526,7cyclictest10125-21needreboot08:47:031
6398993526,7cyclictest10125-21needreboot08:47:031
59962340,3sleep15999-21grep08:36:591
59962340,3sleep15999-21grep08:36:591
27612340,1sleep10-21swapper/109:53:251
27612340,1sleep10-21swapper/109:53:251
6397993325,6cyclictest550-21cron09:21:570
6397993325,6cyclictest550-21cron09:21:570
6397993325,6cyclictest550-21cron09:21:570
232892330,2sleep023290-21grep07:56:580
232892330,2sleep023290-21grep07:56:580
6400993224,4cyclictest0-21swapper/310:35:443
6400993224,4cyclictest0-21swapper/310:35:443
6398993227,4cyclictest545-21in:imuxsock09:41:461
6398993227,4cyclictest545-21in:imuxsock09:41:461
6397993225,5cyclictest2660-21sshd11:21:550
6397993225,5cyclictest2660-21sshd11:21:550
6397993223,7cyclictest11164-21threads11:42:070
6397993223,7cyclictest11164-21threads11:42:070
6397993223,7cyclictest11164-21threads11:42:070
6397993223,2cyclictest181rcu_preempt12:23:560
6397993223,2cyclictest181rcu_preempt12:23:560
195062320,1sleep019544-21ntp_states09:12:040
6400993120,7cyclictest4014-21chrt11:22:593
6400993120,7cyclictest4014-21chrt11:22:593
6400993120,7cyclictest15114-21chrt07:32:533
6400993119,8cyclictest19819-21chrt10:41:313
6400993119,8cyclictest19819-21chrt10:41:313
6400993119,8cyclictest19819-21chrt10:41:313
6398993126,3cyclictest0-21swapper/111:26:451
6398993126,3cyclictest0-21swapper/111:26:451
6398993124,5cyclictest22003-21needreboot12:12:021
6398993124,5cyclictest22003-21needreboot12:12:021
6398993124,5cyclictest10250-21cut07:21:581
6397993115,4cyclictest181rcu_preempt10:38:330
6397993115,4cyclictest181rcu_preempt10:38:330
6397993115,4cyclictest181rcu_preempt10:38:330
6397993113,16cyclictest201rcuc/011:57:460
6397993113,16cyclictest201rcuc/011:57:460
6397993113,16cyclictest201rcuc/011:57:460
6397993113,16cyclictest201rcuc/011:57:460
86032300,4sleep08608-21gltestperf11:36:590
86032300,4sleep08608-21gltestperf11:36:590
6400993021,6cyclictest26779-21chrt12:26:473
6400993021,6cyclictest26779-21chrt12:26:473
6400993020,7cyclictest3589-21chrt08:31:343
6400993020,7cyclictest3589-21chrt08:31:343
6400993020,7cyclictest23275-21chrt10:47:463
6400993020,7cyclictest13941-21chrt10:22:453
6400993020,7cyclictest13941-21chrt10:22:453
6400993020,7cyclictest13941-21chrt10:22:453
6400993020,6cyclictest11588-21chrt07:25:293
6400993019,8cyclictest9728-21chrt11:39:313
6400993019,8cyclictest9728-21chrt11:39:313
6400993019,7cyclictest922-21chrt09:48:533
6400993019,7cyclictest922-21chrt09:48:533
6400993019,7cyclictest922-21chrt09:48:533
6400993019,7cyclictest4679-21chrt09:59:103
6400993019,7cyclictest4679-21chrt09:59:103
6400993019,7cyclictest22830-21chrt12:14:493
6400993019,7cyclictest22830-21chrt12:14:493
6400993019,7cyclictest20188-21chrt09:13:353
6400993019,7cyclictest11659-21chrt11:45:063
6400993019,7cyclictest11659-21chrt11:45:063
6400993019,7cyclictest11659-21chrt11:45:063
6400993019,6cyclictest12882-21chrt08:55:543
6400993018,8cyclictest17303-21chrt12:00:503
6400993018,8cyclictest17303-21chrt12:00:503
6400993018,8cyclictest17303-21chrt12:00:503
6400993018,8cyclictest17303-21chrt12:00:503
6400993018,8cyclictest14753-21chrt09:01:013
6400993018,8cyclictest14753-21chrt09:01:013
6398993025,3cyclictest29772-21cut11:07:001
6398993025,3cyclictest29772-21cut11:07:001
6398993025,3cyclictest13665-21latency_hist11:51:451
6398993025,3cyclictest13665-21latency_hist11:51:451
6398993023,5cyclictest1337-21acpi09:51:561
6398993023,5cyclictest1337-21acpi09:51:561
6398993023,5cyclictest1337-21acpi09:51:561
6398993021,7cyclictest21776-21latency_hist10:46:471
6398993021,7cyclictest21776-21latency_hist10:46:471
6397993021,7cyclictest30733-21netstat09:42:030
6397993021,7cyclictest30733-21netstat09:42:030
180922300,3sleep30-21swapper/312:01:593
180922300,3sleep30-21swapper/312:01:593
180922300,3sleep30-21swapper/312:01:593
6400992920,7cyclictest31534-21chrt09:45:073
6400992920,7cyclictest31534-21chrt09:45:073
6400992920,6cyclictest8894-21chrt08:42:323
6400992920,6cyclictest8894-21chrt08:42:323
6400992920,6cyclictest20832-21chrt12:08:023
6400992920,6cyclictest20832-21chrt12:08:023
6400992919,7cyclictest8587-21chrt10:11:083
6400992919,7cyclictest8587-21chrt10:11:083
6400992919,7cyclictest5273-21chrt08:34:153
6400992919,7cyclictest317-21chrt11:14:593
6400992919,7cyclictest317-21chrt11:14:593
6400992919,7cyclictest30061-21chrt08:13:013
6400992919,7cyclictest30061-21chrt08:13:013
6400992919,7cyclictest24437-21chrt07:57:453
6400992919,7cyclictest24437-21chrt07:57:453
6400992919,6cyclictest25746-21chrt09:27:463
6400992919,6cyclictest25746-21chrt09:27:463
6400992919,6cyclictest20872-21chrt07:49:493
6400992919,6cyclictest20872-21chrt07:49:493
6400992918,8cyclictest16967-21chrt07:37:473
6400992918,8cyclictest16967-21chrt07:37:473
6400992918,6cyclictest25187-21chrt10:53:253
6398992924,3cyclictest6395-21cyclictest08:20:061
6398992924,3cyclictest6395-21cyclictest08:20:061
6398992924,3cyclictest6395-21cyclictest08:20:061
6398992923,4cyclictest6395-21cyclictest10:27:171
639799298,5cyclictest201rcuc/008:49:100
639799298,5cyclictest201rcuc/008:49:100
6397992923,3cyclictest0-21swapper/012:07:060
6397992923,3cyclictest0-21swapper/012:07:060
6397992922,5cyclictest25496-21kernelversion08:02:000
6397992921,6cyclictest31987-21netstat11:12:020
6397992921,6cyclictest31987-21netstat11:12:020
6397992920,3cyclictest181rcu_preempt09:36:420
6397992920,3cyclictest181rcu_preempt09:36:420
6397992920,3cyclictest181rcu_preempt09:36:420
291392290,3sleep10-21swapper/108:11:581
291392290,3sleep10-21swapper/108:11:581
207562290,4sleep20-21swapper/210:42:022
207562290,4sleep20-21swapper/210:42:022
6400992819,6cyclictest24768-21chrt12:20:403
6400992819,6cyclictest24768-21chrt12:20:403
6400992819,6cyclictest24768-21chrt12:20:403
6400992819,6cyclictest13205-21chrt07:27:183
6400992819,6cyclictest13205-21chrt07:27:183
6400992818,7cyclictest27601-21chrt09:32:403
6400992818,7cyclictest27601-21chrt09:32:403
6400992818,7cyclictest27601-21chrt09:32:403
6400992818,7cyclictest10448-21chrt10:16:063
6400992818,7cyclictest10448-21chrt10:16:063
6400992818,6cyclictest30371-21chrt12:35:353
6400992818,6cyclictest30371-21chrt12:35:353
6400992818,6cyclictest29077-21chrt11:05:143
6400992818,6cyclictest29077-21chrt11:05:143
6400992818,6cyclictest24104-21chrt09:25:373
6400992818,6cyclictest24104-21chrt09:25:373
6400992818,6cyclictest24104-21chrt09:25:373
6400992818,6cyclictest13570-21chrt11:50:453
6400992818,6cyclictest13570-21chrt11:50:453
6400992818,5cyclictest12226-21chrt10:19:563
6400992818,5cyclictest12226-21chrt10:19:563
6400992818,5cyclictest12226-21chrt10:19:563
6400992817,7cyclictest27013-21chrt10:57:553
6400992817,7cyclictest27013-21chrt10:57:553
6400992817,7cyclictest21404-21chrt10:42:393
6400992817,7cyclictest21404-21chrt10:42:393
6400992817,6cyclictest22672-21chrt07:53:593
6400992817,6cyclictest22672-21chrt07:53:593
6400992817,6cyclictest1528-21chrt08:24:063
6400992816,8cyclictest26595-21chrt08:06:183
6398992824,3cyclictest16615-21switchtime07:37:081
6398992824,3cyclictest16615-21switchtime07:37:081
6398992822,4cyclictest14558-21needreboot11:52:041
6398992822,4cyclictest14558-21needreboot11:52:041
6398992821,5cyclictest3550-21sshd08:31:031
6398992821,5cyclictest3550-21sshd08:31:031
6398992819,7cyclictest17709-21sort12:01:551
6398992819,7cyclictest17709-21sort12:01:551
6397992823,4cyclictest572-21cups-browsed08:37:070
6397992823,4cyclictest572-21cups-browsed08:37:070
6397992823,3cyclictest15430-21idleruntime-cro07:36:450
6397992822,4cyclictest171ktimers/011:06:500
6397992822,4cyclictest171ktimers/011:06:500
639799282,17cyclictest16-21ksoftirqd/007:56:090
639799282,17cyclictest16-21ksoftirqd/007:56:090
6397992820,6cyclictest19650-21fschecks_count12:06:580
6397992818,3cyclictest181rcu_preempt07:41:080
6397992818,3cyclictest181rcu_preempt07:41:080
6397992817,4cyclictest181rcu_preempt09:27:060
6397992817,4cyclictest181rcu_preempt09:27:060
6400992720,4cyclictest2842-21chrt09:54:273
6400992720,4cyclictest2842-21chrt09:54:273
6400992718,6cyclictest7690-21chrt11:32:163
6400992718,6cyclictest7690-21chrt11:32:163
6400992718,6cyclictest7063-21chrt08:38:133
6400992718,6cyclictest7063-21chrt08:38:133
6400992718,6cyclictest30710-21chrt11:07:153
6400992718,6cyclictest30710-21chrt11:07:153
6400992718,6cyclictest18845-21chrt07:42:423
6400992718,6cyclictest18845-21chrt07:42:423
6400992717,7cyclictest27448-21chrt08:07:023
6400992717,6cyclictest6127-21chrt11:31:113
6400992717,6cyclictest6127-21chrt11:31:113
6400992717,6cyclictest2372-21chrt11:21:063
6400992717,6cyclictest2372-21chrt11:21:063
6400992717,6cyclictest2372-21chrt11:21:063
6400992716,7cyclictest6618-21chrt10:04:443
6400992716,7cyclictest6618-21chrt10:04:443
6400992716,7cyclictest6618-21chrt10:04:443
6400992716,7cyclictest15893-21taskset10:28:523
6398992720,5cyclictest6395-21cyclictest11:37:331
6398992720,5cyclictest6395-21cyclictest11:37:331
639799278,8cyclictest12023-21df07:26:570
639799278,8cyclictest12023-21df07:26:570
639799274,4cyclictest201rcuc/008:21:560
6397992724,2cyclictest90-1pr/ttyS009:51:420
6397992724,2cyclictest90-1pr/ttyS009:51:420
6397992724,2cyclictest90-1pr/ttyS009:51:420
6397992723,3cyclictest60-21kcompactd008:09:400
6397992722,3cyclictest21321-21sed10:42:080
6397992722,3cyclictest21321-21sed10:42:080
6397992721,5cyclictest6604-21sshd10:04:340
6397992721,5cyclictest6604-21sshd10:04:340
6397992721,5cyclictest6604-21sshd10:04:340
6397992721,3cyclictest0-21swapper/009:07:070
6397992721,3cyclictest0-21swapper/009:07:070
6397992720,5cyclictest24371-21unixbench-2d12:17:080
6397992720,5cyclictest24371-21unixbench-2d12:17:080
6397992720,5cyclictest24371-21unixbench-2d12:17:080
6397992720,5cyclictest14646-21cut10:27:000
6397992718,6cyclictest11796-21irqstats08:51:590
6397992718,2cyclictest181rcu_preempt12:34:180
6397992718,2cyclictest181rcu_preempt12:34:180
6397992716,3cyclictest181rcu_preempt09:40:570
6397992716,3cyclictest181rcu_preempt09:40:570
6397992711,8cyclictest16-21ksoftirqd/007:43:080
6397992711,8cyclictest16-21ksoftirqd/007:43:080
307622270,3sleep30-21swapper/312:36:563
307622270,3sleep30-21swapper/312:36:563
6400992614,8cyclictest22088-21chrt09:18:583
6400992614,8cyclictest22088-21chrt09:18:583
6398992622,3cyclictest1313-21unixbench_singl08:22:091
6398992621,4cyclictest142-21systemd-journal08:09:031
6398992620,4cyclictest27137-21fschecks_count12:26:581
6398992620,3cyclictest0-21swapper/112:36:451
6398992620,3cyclictest0-21swapper/112:36:451
6398992620,3cyclictest0-21swapper/110:57:001
6398992620,3cyclictest0-21swapper/110:57:001
6398992619,5cyclictest24482-21needreboot10:52:031
6398992618,6cyclictest16556-21fschecks_time10:31:571
6398992618,6cyclictest16556-21fschecks_time10:31:571
6398992617,7cyclictest550-21cron08:01:451
6398992617,7cyclictest550-21cron08:01:451
6398992617,7cyclictest12322-21threads08:52:071
639899261,11cyclictest6195-21latency_hist11:31:451
639899261,11cyclictest6195-21latency_hist11:31:451
6397992622,3cyclictest90-1pr/ttyS012:28:170
6397992622,3cyclictest90-1pr/ttyS012:28:170
6397992621,4cyclictest142-21systemd-journal11:20:220
6397992620,5cyclictest13428-21processes10:22:090
6397992620,5cyclictest13428-21processes10:22:090
6397992620,5cyclictest13428-21processes10:22:090
6397992618,6cyclictest26210-21sort10:57:010
6397992618,6cyclictest26210-21sort10:57:010
6397992615,9cyclictest19482-21cpu12:06:560
6397992615,4cyclictest181rcu_preempt10:13:050
6397992615,4cyclictest181rcu_preempt10:13:050
6400992518,4cyclictest31965-21chrt08:18:323
6400992518,4cyclictest31965-21chrt08:18:323
6400992518,4cyclictest31965-21chrt08:18:323
6398992521,2cyclictest0-21swapper/110:46:591
6398992521,2cyclictest0-21swapper/110:41:561
6398992521,2cyclictest0-21swapper/110:41:561
6398992520,4cyclictest13429-21fschecks_time08:56:591
6398992520,4cyclictest13429-21fschecks_time08:56:591
6398992520,3cyclictest6778-21latency_hist10:06:451
6398992520,3cyclictest6778-21latency_hist10:06:451
6398992520,3cyclictest6778-21latency_hist10:06:451
6398992520,3cyclictest15416-21cut09:01:591
6398992520,3cyclictest15416-21cut09:01:591
6398992520,3cyclictest0-21swapper/110:06:581
6398992520,3cyclictest0-21swapper/110:06:581
6398992518,5cyclictest21163-21kernelversion09:17:001
6398992518,5cyclictest21163-21kernelversion09:17:001
6398992518,5cyclictest19178-21latency_hist07:46:451
6398992518,5cyclictest19178-21latency_hist07:46:451
6397992522,2cyclictest0-21swapper/012:14:460
6397992522,2cyclictest0-21swapper/012:14:460
6397992518,5cyclictest7209-21fschecks_time10:06:590
6397992518,5cyclictest7209-21fschecks_time10:06:590
6397992518,5cyclictest4513-21/usr/sbin/munin11:27:050
6397992518,5cyclictest4513-21/usr/sbin/munin11:27:050
6397992518,5cyclictest14131-21fschecks_time11:51:590
6397992518,5cyclictest14131-21fschecks_time11:51:590
6397992517,6cyclictest29604-21fschecks_count11:06:590
6397992517,6cyclictest29604-21fschecks_count11:06:590
6397992517,3cyclictest181rcu_preempt10:17:040
6397992517,3cyclictest181rcu_preempt10:17:040
6397992517,3cyclictest181rcu_preempt10:17:040
6397992516,2cyclictest181rcu_preempt08:42:040
6397992516,2cyclictest181rcu_preempt08:42:040
6397992514,9cyclictest142-21systemd-journal09:06:450
6397992514,9cyclictest142-21systemd-journal09:06:450
6398992419,3cyclictest6395-21cyclictest11:59:361
6398992419,3cyclictest6395-21cyclictest11:59:361
6398992419,3cyclictest17978-21head12:01:581
6398992419,3cyclictest17978-21head12:01:581
6398992419,3cyclictest17978-21head12:01:581
6398992419,3cyclictest142-21systemd-journal11:11:551
6398992419,3cyclictest142-21systemd-journal11:11:551
6398992419,3cyclictest0-21swapper/111:06:561
6398992419,3cyclictest0-21swapper/111:06:561
6398992418,4cyclictest0-21swapper/110:17:061
6398992418,4cyclictest0-21swapper/110:17:061
6398992418,4cyclictest0-21swapper/110:17:061
6398992418,3cyclictest0-21swapper/109:32:071
6398992418,3cyclictest0-21swapper/109:32:071
6398992418,3cyclictest0-21swapper/109:32:071
639799244,10cyclictest22248-21taskset09:21:010
639799244,10cyclictest22248-21taskset09:21:010
639799242,4cyclictest700-21192.168.115.40-manager10:36:140
639799242,4cyclictest700-21192.168.115.40-manager10:36:140
6397992420,2cyclictest0-21swapper/009:57:070
6397992420,2cyclictest0-21swapper/009:57:070
6397992419,3cyclictest201rcuc/007:50:160
6397992419,3cyclictest201rcuc/007:50:160
6397992419,3cyclictest0-21swapper/011:22:070
6397992419,3cyclictest0-21swapper/011:22:070
6397992419,3cyclictest0-21swapper/010:47:070
6397992412,6cyclictest90-1pr/ttyS008:12:180
6397992412,6cyclictest90-1pr/ttyS008:12:180
6398992319,2cyclictest0-21swapper/109:27:061
6398992319,2cyclictest0-21swapper/109:27:061
6398992318,3cyclictest0-21swapper/109:11:581
6398992316,5cyclictest17876-21switchtime09:07:061
6398992316,5cyclictest17876-21switchtime09:07:061
6398992313,8cyclictest142-21systemd-journal12:26:461
639899231,17cyclictest4527-21taskset09:57:111
639899231,17cyclictest4527-21taskset09:57:111
6397992315,2cyclictest181rcu_preempt12:02:040
6397992315,2cyclictest181rcu_preempt09:52:500
6397992315,2cyclictest181rcu_preempt09:52:500
639899221,7cyclictest27322-21gltestperf12:26:591
639899221,7cyclictest27322-21gltestperf12:26:591
6398992216,4cyclictest0-21swapper/112:07:061
6398992216,4cyclictest0-21swapper/112:07:061
6398992214,6cyclictest749-21runrttasks08:01:581
6398992213,7cyclictest142-21systemd-journal08:45:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional