You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-01 - 10:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Mon Jun 01, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
157312870,3sleep30-21swapper/321:58:043
157312870,3sleep30-21swapper/321:58:043
89812690,1sleep2351rcuc/223:07:582
89812690,1sleep2351rcuc/223:07:582
74592690,3sleep30-21swapper/300:33:013
74592690,3sleep30-21swapper/300:33:013
165112690,2sleep016510-21load23:27:580
165112690,2sleep016510-21load23:27:580
165112690,2sleep016510-21load23:27:580
244462680,2chrt24445-21wc20:57:470
244462680,2chrt24445-21wc20:57:470
89232600,2chrt0-21swapper/220:13:062
89232600,2chrt0-21swapper/220:13:062
32422600,2chrt3241-21interrupts22:52:571
32422600,2chrt3241-21interrupts22:52:571
17482600,2chrt0-21swapper/022:48:020
17482600,2chrt0-21swapper/022:48:020
309332580,3sleep30-21swapper/321:13:013
309332580,3sleep30-21swapper/321:13:013
309332580,3sleep30-21swapper/321:13:013
267042530,1chrt0-21swapper/222:28:022
147192530,2sleep00-21swapper/021:57:530
147192530,2sleep00-21swapper/021:57:530
66982520,2sleep30-21swapper/320:08:053
66982520,2sleep30-21swapper/320:08:053
36472520,3sleep30-21swapper/322:53:033
36472520,3sleep30-21swapper/322:53:033
163972490,2sleep30-21swapper/323:27:573
163972490,2sleep30-21swapper/323:27:573
163972490,2sleep30-21swapper/323:27:573
294062480,3sleep20-21swapper/222:37:422
294062480,3sleep20-21swapper/222:37:422
252742470,4sleep20-21swapper/220:58:012
252742470,4sleep20-21swapper/220:58:012
18178994740,5cyclictest0-21swapper/000:02:580
18178994740,5cyclictest0-21swapper/000:02:580
18178994740,5cyclictest0-21swapper/000:02:580
173722470,2sleep20-21swapper/222:03:052
173722470,2sleep20-21swapper/222:03:052
302972450,2chrt0-21swapper/300:03:103
302972450,2chrt0-21swapper/300:03:103
302972450,2chrt0-21swapper/300:03:103
18178994439,3cyclictest0-21swapper/000:02:480
18178994439,3cyclictest0-21swapper/000:02:480
291172390,3sleep20-21swapper/200:02:532
291172390,3sleep20-21swapper/200:02:532
291172390,3sleep20-21swapper/200:02:532
18178993933,4cyclictest29356-21latency_hist22:37:400
18178993933,4cyclictest29356-21latency_hist22:37:400
18178993932,5cyclictest1257-21sendmail21:22:410
9122380,3sleep30-21swapper/300:17:543
9122380,3sleep30-21swapper/300:17:543
18178993816,5cyclictest201rcuc/023:22:390
18178993816,5cyclictest201rcuc/023:22:390
55852370,3sleep016-21ksoftirqd/022:58:030
55852370,3sleep016-21ksoftirqd/022:58:030
18178993716,19cyclictest201rcuc/021:55:570
59862360,2sleep06044-21cut21:33:010
59862360,2sleep06044-21cut21:33:010
290232360,3sleep20-21swapper/221:08:022
290232360,3sleep20-21swapper/221:08:022
290232360,3sleep20-21swapper/221:08:022
18178993513,5cyclictest201rcuc/023:55:310
90882340,1sleep09147-21ntp_kernel_pll_23:08:010
90882340,1sleep09147-21ntp_kernel_pll_23:08:010
18178993427,6cyclictest10164-21unixbench-2d21:43:040
18178993427,6cyclictest10164-21unixbench-2d21:43:040
18178993427,6cyclictest10164-21unixbench-2d21:43:040
18178993411,6cyclictest171ktimers/019:54:390
18178993411,6cyclictest171ktimers/019:54:390
1818399332,22cyclictest28885-21chrt00:02:463
1818399332,22cyclictest28885-21chrt00:02:463
18179993326,5cyclictest25922-21processes19:33:021
18179993326,5cyclictest25922-21processes19:33:021
18179993325,5cyclictest10310-21latency_hist00:42:481
18178993328,4cyclictest4991-21sh21:32:400
18178993328,4cyclictest4991-21sh21:32:400
18178993328,4cyclictest4991-21sh21:32:400
18178993327,4cyclictest171ktimers/022:30:140
18178993324,7cyclictest14337-21threads20:28:040
18178993324,7cyclictest14337-21threads20:28:040
18178993324,7cyclictest10415-21fschecks_count23:12:520
18178993324,7cyclictest10415-21fschecks_count23:12:520
18178993320,3cyclictest90-1pr/ttyS019:34:050
18178993320,3cyclictest90-1pr/ttyS019:34:050
18178993318,4cyclictest90-1pr/ttyS000:17:050
18178993318,4cyclictest90-1pr/ttyS000:17:050
28212320,7chrt2824-21wc19:58:010
18179993226,4cyclictest31836-21latency_hist21:17:431
18179993226,4cyclictest31836-21latency_hist21:17:431
18179993226,4cyclictest31836-21latency_hist21:17:431
18179993226,4cyclictest27321-21cut19:37:541
18179993226,4cyclictest27321-21cut19:37:541
18178993227,3cyclictest0-21swapper/020:47:410
18178993227,3cyclictest0-21swapper/020:47:410
18178993216,4cyclictest181rcu_preempt23:38:460
18178993216,4cyclictest181rcu_preempt23:38:460
122652320,2sleep20-21swapper/220:23:032
122652320,2sleep20-21swapper/220:23:032
293922310,2sleep10-21swapper/122:37:421
293922310,2sleep10-21swapper/122:37:421
205182310,3sleep00-21swapper/022:12:560
205182310,3sleep00-21swapper/022:12:560
18179993126,3cyclictest0-21swapper/122:02:411
18179993126,3cyclictest0-21swapper/122:02:411
18179993125,3cyclictest26781-21kworker/u9:4-xprtiod00:03:001
18179993125,3cyclictest26781-21kworker/u9:4-xprtiod00:03:001
18179993125,3cyclictest26781-21kworker/u9:4-xprtiod00:03:001
1817899319,3cyclictest201rcuc/020:38:350
1817899318,4cyclictest0-21swapper/021:02:420
1817899318,4cyclictest0-21swapper/021:02:420
18178993125,3cyclictest0-21swapper/020:08:050
18178993125,3cyclictest0-21swapper/020:08:050
18178993123,6cyclictest2610-21latency_hist00:22:410
18178993123,6cyclictest2610-21latency_hist00:22:410
18178993123,6cyclictest23576-21fschecks_count23:47:530
18178993123,6cyclictest23576-21fschecks_count23:47:530
18178993123,3cyclictest181rcu_preempt00:33:020
18178993123,3cyclictest181rcu_preempt00:33:020
18178993122,3cyclictest181rcu_preempt21:48:550
18178993122,3cyclictest181rcu_preempt21:48:550
18178993117,3cyclictest74-21hwrng21:23:050
18178993117,3cyclictest74-21hwrng21:23:050
15542310,1sleep11614-21ntpq22:48:001
15542310,1sleep11614-21ntpq22:48:001
18179993024,4cyclictest18177-21cyclictest23:17:511
18179993024,4cyclictest18177-21cyclictest23:17:511
18179993023,5cyclictest24414-21unixbench-2d19:28:051
18179993023,5cyclictest24414-21unixbench-2d19:28:051
18179993023,5cyclictest23751-21idleruntime-cro22:22:411
18179993023,5cyclictest23751-21idleruntime-cro22:22:411
18179993023,5cyclictest23751-21idleruntime-cro22:22:411
18179993023,5cyclictest21691-21fschecks_count23:42:551
18179993023,5cyclictest21691-21fschecks_count23:42:551
18179993023,5cyclictest21691-21fschecks_count23:42:551
18178993024,5cyclictest28620-21sendmail19:42:410
18178993024,5cyclictest28620-21sendmail19:42:410
18178993023,5cyclictest201rcuc/022:06:110
18178993023,5cyclictest201rcuc/022:06:110
18178993015,4cyclictest90-1pr/ttyS022:56:040
18178993015,4cyclictest90-1pr/ttyS022:56:040
18179992924,2cyclictest0-21swapper/100:22:411
18179992924,2cyclictest0-21swapper/100:22:411
18178992923,4cyclictest1346-21avahi-daemon22:23:020
18178992923,4cyclictest1346-21avahi-daemon22:23:020
18178992923,4cyclictest1346-21avahi-daemon22:23:020
323752280,3sleep30-21swapper/319:52:413
323752280,3sleep30-21swapper/319:52:413
323752280,3sleep30-21swapper/319:52:413
1818199283,9cyclictest0-21swapper/221:54:502
18179992820,6cyclictest2376-21gltestperf19:57:541
18179992820,6cyclictest10484-21fschecks_time23:12:531
18179992820,6cyclictest10484-21fschecks_time23:12:531
18179992820,2cyclictest181rcu_preempt22:27:141
18179992820,2cyclictest181rcu_preempt22:27:141
18179992820,2cyclictest181rcu_preempt22:27:141
1817899288,11cyclictest16-21ksoftirqd/020:50:020
1817899288,11cyclictest16-21ksoftirqd/020:50:020
1817899288,11cyclictest16-21ksoftirqd/020:50:020
18178992823,3cyclictest0-21swapper/000:38:050
18178992821,5cyclictest15495-21sshd23:25:060
18178992821,5cyclictest15495-21sshd23:25:060
18178992821,5cyclictest15495-21sshd23:25:060
18178992820,6cyclictest8783-21date21:42:410
18178992820,6cyclictest8783-21date21:42:410
18178992820,6cyclictest8783-21date21:42:410
18178992819,2cyclictest181rcu_preempt23:07:530
18178992819,2cyclictest181rcu_preempt23:07:530
18178992815,3cyclictest60-21kcompactd020:24:050
18178992815,3cyclictest60-21kcompactd020:24:050
18178992814,4cyclictest90-1pr/ttyS019:30:050
18178992814,4cyclictest90-1pr/ttyS019:30:050
128892280,4sleep30-21swapper/323:18:003
128892280,4sleep30-21swapper/323:18:003
18179992722,3cyclictest31078-21gltestperf19:47:551
18179992722,3cyclictest31078-21gltestperf19:47:551
18179992722,3cyclictest31078-21gltestperf19:47:551
18179992721,5cyclictest13563-21fschecks_time20:27:551
18179992721,5cyclictest13563-21fschecks_time20:27:551
18179992721,4cyclictest18177-21cyclictest20:48:021
18179992721,4cyclictest18177-21cyclictest20:48:021
18179992721,4cyclictest18177-21cyclictest20:48:021
18179992719,6cyclictest8638-21switchtime20:13:051
18179992719,6cyclictest8638-21switchtime20:13:051
18179992718,7cyclictest17287-21cut20:37:531
1817999271,12cyclictest0-21swapper/123:35:361
1817999271,12cyclictest0-21swapper/123:35:361
1817999271,12cyclictest0-21swapper/123:35:361
1817899277,4cyclictest181rcu_preempt00:08:200
1817899277,4cyclictest181rcu_preempt00:08:200
1817899277,4cyclictest181rcu_preempt00:08:200
18178992723,2cyclictest0-21swapper/020:18:030
18178992723,2cyclictest0-21swapper/020:18:030
18178992720,5cyclictest5319-21sshd20:04:280
18178992720,5cyclictest5319-21sshd20:04:280
18178992718,3cyclictest181rcu_preempt20:15:050
18178992718,3cyclictest181rcu_preempt20:15:050
18178992717,3cyclictest181rcu_preempt21:06:100
18178992717,3cyclictest181rcu_preempt21:06:100
18178992711,3cyclictest181rcu_preempt00:28:040
18178992711,3cyclictest181rcu_preempt00:28:040
18178992711,3cyclictest181rcu_preempt00:28:040
18181992620,4cyclictest10804-21chrt20:18:052
18181992620,4cyclictest10804-21chrt20:18:052
18181992619,4cyclictest93342sleep221:42:552
18181992619,4cyclictest93342sleep221:42:552
18181992619,4cyclictest93342sleep221:42:552
18179992622,2cyclictest0-21swapper/121:32:401
18179992622,2cyclictest0-21swapper/121:32:401
18179992622,2cyclictest0-21swapper/121:32:401
18179992620,4cyclictest6896-21gltestperf00:32:541
18179992620,4cyclictest14678-21systemd-journal00:02:401
18179992620,4cyclictest14678-21systemd-journal00:02:401
1817999261,9cyclictest0-21swapper/100:35:381
1817999261,9cyclictest0-21swapper/100:35:381
18179992619,5cyclictest5381-21ntp_offset22:58:001
18179992619,5cyclictest5381-21ntp_offset22:58:001
18179992617,6cyclictest15442-21fschecks_time20:32:541
18179992617,6cyclictest15442-21fschecks_time20:32:541
18179992614,10cyclictest14678-21systemd-journal19:47:411
18179992614,10cyclictest14678-21systemd-journal19:47:411
18179992614,10cyclictest14678-21systemd-journal19:47:411
1817999261,3cyclictest181rcu_preempt21:03:121
1817999261,3cyclictest181rcu_preempt21:03:121
1817899265,3cyclictest201rcuc/019:43:150
1817899265,3cyclictest201rcuc/019:43:150
1817899265,3cyclictest201rcuc/019:43:150
18178992622,3cyclictest31238-21latency_hist22:42:410
18178992622,3cyclictest31238-21latency_hist22:42:410
18178992621,3cyclictest0-21swapper/022:07:580
18178992621,3cyclictest0-21swapper/022:07:580
18178992621,3cyclictest0-21swapper/022:07:580
18178992620,4cyclictest31738-21gltestperf22:42:530
18178992620,4cyclictest31738-21gltestperf22:42:530
18178992620,3cyclictest0-21swapper/021:13:030
18178992620,3cyclictest0-21swapper/021:13:030
18178992620,3cyclictest0-21swapper/021:13:030
18178992616,4cyclictest181rcu_preempt19:22:570
18178992616,4cyclictest181rcu_preempt19:22:570
113422260,2sleep111344-21date20:22:461
113422260,2sleep111344-21date20:22:461
18179992521,2cyclictest0-21swapper/122:02:581
18179992521,2cyclictest0-21swapper/122:02:581
18179992520,3cyclictest0-21swapper/122:47:531
18179992519,4cyclictest13327-21missed_timers21:52:561
18179992518,4cyclictest0-21swapper/121:37:541
18179992518,4cyclictest0-21swapper/121:37:541
18179992518,4cyclictest0-21swapper/121:37:541
18179992517,6cyclictest16175-21fschecks_time23:27:551
18179992517,6cyclictest16175-21fschecks_time23:27:551
18179992517,6cyclictest16175-21fschecks_time23:27:551
18179992516,7cyclictest22239-21processes19:23:031
18179992516,7cyclictest22239-21processes19:23:031
18179992515,7cyclictest9731-21tr21:43:001
18179992515,7cyclictest9731-21tr21:43:001
18179992515,7cyclictest9731-21tr21:43:001
18178992521,2cyclictest0-21swapper/022:22:520
18178992521,2cyclictest0-21swapper/022:22:520
18178992521,2cyclictest0-21swapper/022:22:520
18178992518,2cyclictest181rcu_preempt00:23:050
18178992518,2cyclictest181rcu_preempt00:23:050
18178992517,2cyclictest181rcu_preempt21:07:530
18178992517,2cyclictest181rcu_preempt21:07:530
18178992517,2cyclictest181rcu_preempt21:07:530
223162240,3sleep30-21swapper/322:17:543
223162240,3sleep30-21swapper/322:17:543
223162240,3sleep30-21swapper/322:17:543
1817999247,3cyclictest90-1pr/ttyS020:03:051
1817999247,3cyclictest90-1pr/ttyS020:03:051
18179992418,4cyclictest19301-21gltestperf20:42:551
18179992418,4cyclictest19301-21gltestperf20:42:551
18179992418,4cyclictest1062-21systemctl19:53:041
18179992418,4cyclictest1062-21systemctl19:53:041
18179992418,4cyclictest0-21swapper/120:23:041
18179992418,4cyclictest0-21swapper/120:23:041
18179992418,3cyclictest0-21swapper/123:48:021
18179992418,3cyclictest0-21swapper/123:48:021
18179992417,5cyclictest31158-21sshd22:42:051
18179992417,5cyclictest31158-21sshd22:42:051
18179992417,5cyclictest28603-21head21:07:561
18179992417,5cyclictest28603-21head21:07:561
18179992417,5cyclictest28603-21head21:07:561
18179992417,5cyclictest22799-21fschecks_count20:52:541
18179992417,5cyclictest22799-21fschecks_count20:52:541
18179992416,6cyclictest31567-21fschecks_count00:12:501
18179992416,6cyclictest31567-21fschecks_count00:12:501
18179992416,6cyclictest31567-21fschecks_count00:12:501
18179992415,7cyclictest6983-21latency_hist21:37:471
18179992415,7cyclictest6983-21latency_hist21:37:471
1817899249,13cyclictest14678-21systemd-journal19:52:410
1817899249,13cyclictest14678-21systemd-journal19:52:410
1817899249,13cyclictest14678-21systemd-journal19:52:410
1817899242,5cyclictest171ktimers/020:36:260
1817899242,5cyclictest171ktimers/020:36:260
18178992416,2cyclictest181rcu_preempt23:43:040
18178992416,2cyclictest181rcu_preempt23:43:040
18178992416,2cyclictest181rcu_preempt23:43:040
18179992318,4cyclictest7204-21needreboot23:02:581
18179992318,4cyclictest7204-21needreboot23:02:581
18179992318,2cyclictest0-21swapper/100:23:041
18179992318,2cyclictest0-21swapper/100:23:041
18179992317,4cyclictest14309-21fschecks_time23:22:541
18179992317,4cyclictest14309-21fschecks_time23:22:541
18179992317,4cyclictest14309-21fschecks_time23:22:541
18179992317,4cyclictest0-21swapper/122:17:521
18179992317,4cyclictest0-21swapper/122:17:521
18179992317,4cyclictest0-21swapper/122:07:551
18179992317,4cyclictest0-21swapper/122:07:551
18179992317,4cyclictest0-21swapper/122:07:551
18179992316,4cyclictest0-21swapper/120:57:571
18179992316,4cyclictest0-21swapper/120:57:571
1817999231,4cyclictest211222sleep123:40:331
1817999231,4cyclictest211222sleep123:40:331
18178992318,3cyclictest0-21swapper/023:32:540
18178992318,3cyclictest0-21swapper/023:32:540
18178992318,3cyclictest0-21swapper/023:32:540
18179992218,3cyclictest90-1pr/ttyS000:27:581
18179992218,3cyclictest90-1pr/ttyS000:27:581
18179992216,4cyclictest0-21swapper/121:17:541
18179992214,6cyclictest805-21latency_hist00:17:451
18179992214,6cyclictest805-21latency_hist00:17:451
18179992214,6cyclictest32569-21sort22:43:021
18179992212,8cyclictest26087-21cut22:27:541
18179992210,5cyclictest0-21swapper/120:12:401
18179992210,5cyclictest0-21swapper/120:12:401
95582210,4sleep30-21swapper/300:38:043
18181992113,4cyclictest28652sleep222:52:552
18181992113,4cyclictest28652sleep222:52:552
18179992112,7cyclictest14678-21systemd-journal21:27:411
18179992112,7cyclictest14678-21systemd-journal21:27:411
67022200,3sleep30-21swapper/300:32:533
67022200,3sleep30-21swapper/300:32:533
67022200,3sleep30-21swapper/300:32:533
1818399201,14cyclictest4956-21taskset00:27:553
1817999207,4cyclictest181rcu_preempt21:48:021
1817999207,4cyclictest181rcu_preempt21:48:021
1818399190,13cyclictest32185-21chrt00:12:553
1818199191,12cyclictest31830-21taskset21:17:432
1818199191,12cyclictest31830-21taskset21:17:432
1818199191,12cyclictest31830-21taskset21:17:432
18179991915,2cyclictest0-21swapper/123:07:561
18179991915,2cyclictest0-21swapper/123:07:561
18179991914,3cyclictest0-21swapper/123:53:041
1818399181,13cyclictest18847-21chrt22:07:573
1818399181,13cyclictest18847-21chrt22:07:573
1818399181,13cyclictest18847-21chrt22:07:573
1818399181,12cyclictest3971-21chrt21:27:573
1818399181,12cyclictest3971-21chrt21:27:573
1818399181,12cyclictest3971-21chrt21:27:573
1818399181,12cyclictest26967-21chrt21:02:563
1818399181,12cyclictest26967-21chrt21:02:563
1818399181,12cyclictest24732-21taskset22:23:003
1818399181,12cyclictest24732-21taskset22:23:003
1818399181,12cyclictest24732-21taskset22:23:003
1818399181,11cyclictest22204-21chrt23:43:003
1818399181,11cyclictest22204-21chrt23:43:003
1818399181,11cyclictest22204-21chrt23:43:003
1818199183,9cyclictest0-21swapper/223:34:052
1818199183,9cyclictest0-21swapper/223:34:052
1818199183,9cyclictest0-21swapper/223:34:052
1818199182,10cyclictest0-21swapper/200:02:482
1818199182,10cyclictest0-21swapper/200:02:482
1818199181,12cyclictest27134-21chrt19:37:532
1818199181,12cyclictest27134-21chrt19:37:532
252152171,2sleep30-21swapper/323:52:503
1818399172,12cyclictest0-21swapper/321:08:053
1818399172,12cyclictest0-21swapper/321:08:053
1818399172,12cyclictest0-21swapper/321:08:053
1818399171,8cyclictest0-21swapper/320:37:513
1818399171,12cyclictest965-21taskset22:47:523
1818399171,12cyclictest965-21taskset22:47:523
1818399171,12cyclictest20804-21chrt20:47:533
1818399171,12cyclictest12974-21chrt21:52:533
1818399171,12cyclictest10202-21chrt20:17:583
1818399171,12cyclictest10202-21chrt20:17:583
1818399171,11cyclictest9278-21chrt23:08:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional