You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 20:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Fri Jun 05, 2026 12:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
953221200,3sleep20-21swapper/209:17:502
953221200,3sleep20-21swapper/209:17:502
953221200,3sleep20-21swapper/209:17:502
53942880,2chrt0-21swapper/210:32:552
168022700,3sleep20-21swapper/208:08:072
168022700,3sleep20-21swapper/208:08:072
277932580,1sleep20-21swapper/210:03:082
277932580,1sleep20-21swapper/210:03:082
51092520,2sleep05105-21cat10:32:450
51092520,2sleep05105-21cat10:32:450
309102520,3sleep30-21swapper/311:38:093
309102520,3sleep30-21swapper/311:38:093
309102520,3sleep30-21swapper/311:38:093
309102520,3sleep30-21swapper/311:38:093
30022520,1sleep03184-21idleruntime11:52:580
30022520,1sleep03184-21idleruntime11:52:580
30022520,1sleep03184-21idleruntime11:52:580
30022520,1sleep03184-21idleruntime11:52:580
225972490,2sleep122594-21latency_hist09:52:461
225972490,2sleep122594-21latency_hist09:52:461
31662480,3sleep30-21swapper/307:32:583
233902480,2sleep0171ktimers/011:18:080
233902480,2sleep0171ktimers/011:18:080
276602450,2sleep10-21swapper/110:03:071
276602450,2sleep10-21swapper/110:03:071
27751994334,7cyclictest23854-21idleruntime-cro11:22:451
27751994334,7cyclictest23854-21idleruntime-cro11:22:451
202032430,1chrt281ktimers/111:12:501
202032430,1chrt281ktimers/111:12:501
188952430,3sleep10-21swapper/112:33:061
188952430,3sleep10-21swapper/112:33:061
47472420,2sleep04838-21latency_hist11:57:570
47472420,2sleep04838-21latency_hist11:57:570
47472420,2sleep04838-21latency_hist11:57:570
47472420,2sleep04838-21latency_hist11:57:570
244622420,3chrt0-21swapper/309:57:473
244622420,3chrt0-21swapper/309:57:473
103352410,2sleep110396-21grep09:18:061
103352410,2sleep110396-21grep09:18:061
27750994031,7cyclictest29461-21idleruntime-cro11:37:450
27750994031,7cyclictest29461-21idleruntime-cro11:37:450
27750994031,7cyclictest29461-21idleruntime-cro11:37:450
239202400,2sleep20-21swapper/208:28:012
239202400,2sleep20-21swapper/208:28:012
318982380,4sleep30-21swapper/310:17:453
318982380,4sleep30-21swapper/310:17:453
318982380,4sleep30-21swapper/310:17:453
27751993827,9cyclictest26952-21threads11:28:061
27751993827,9cyclictest26952-21threads11:28:061
27751993629,5cyclictest5105-21cat10:32:451
27751993629,5cyclictest5105-21cat10:32:451
271642360,1sleep20-21swapper/208:37:582
271642360,1sleep20-21swapper/208:37:582
200872360,3sleep20-21swapper/208:18:002
200872360,3sleep20-21swapper/208:18:002
160782360,1sleep115945-21/usr/sbin/munin12:27:571
160782360,1sleep115945-21/usr/sbin/munin12:27:571
127492360,4sleep20-21swapper/207:58:022
127492360,4sleep20-21swapper/207:58:022
27750993527,6cyclictest14436-21head12:22:570
27750993527,6cyclictest14436-21head12:22:570
27750993527,6cyclictest14436-21head12:22:570
27750993526,7cyclictest9223-21netstat12:08:020
27750993526,7cyclictest9223-21netstat12:08:020
27750993526,7cyclictest9223-21netstat12:08:020
88302340,3sleep00-21swapper/009:13:050
88302340,3sleep00-21swapper/009:13:050
88302340,3sleep00-21swapper/009:13:050
27750993427,5cyclictest5156-21unixbench_multi09:03:060
27750993427,5cyclictest5156-21unixbench_multi09:03:060
21692340,3chrt0-21swapper/010:23:000
21692340,3chrt0-21swapper/010:23:000
21692340,3chrt0-21swapper/010:23:000
164582340,3sleep20-21swapper/209:33:052
164582340,3sleep20-21swapper/209:33:052
27750993325,6cyclictest6242-21latency_hist07:42:440
27750993322,9cyclictest0-21swapper/008:12:550
27750993322,9cyclictest0-21swapper/008:12:550
27751993224,6cyclictest12362-21proc_pri09:23:041
27751993224,6cyclictest12362-21proc_pri09:23:041
27750993225,5cyclictest2624-21latency08:57:590
27750993225,5cyclictest2624-21latency08:57:590
31892310,4sleep10-21swapper/111:52:581
31892310,4sleep10-21swapper/111:52:581
31892310,4sleep10-21swapper/111:52:581
31892310,4sleep10-21swapper/111:52:581
317442310,4chrt0-21swapper/208:48:072
317442310,4chrt0-21swapper/208:48:072
317442310,4chrt0-21swapper/208:48:072
27751993127,3cyclictest18335-21missed_timers08:13:001
27751993127,3cyclictest18335-21missed_timers08:13:001
27751993124,5cyclictest17660-21cron12:32:441
27751993124,5cyclictest17660-21cron12:32:441
27751993124,5cyclictest17660-21cron12:32:441
27751993123,6cyclictest13252-21threads12:18:061
27751993123,6cyclictest13252-21threads12:18:061
27751993123,6cyclictest13252-21threads12:18:061
27750993124,5cyclictest27349-21gltestperf08:38:000
27750993124,5cyclictest27349-21gltestperf08:38:000
190602310,2chrt0-21swapper/212:33:072
190602310,2chrt0-21swapper/212:33:072
27751993025,4cyclictest1346-21avahi-daemon08:38:071
27751993025,4cyclictest1346-21avahi-daemon08:38:071
27751993023,5cyclictest550-21cron09:12:591
27751993023,5cyclictest550-21cron09:12:591
27751993023,5cyclictest550-21cron09:12:591
27751993023,5cyclictest27749-21cyclictest08:32:551
27751993023,5cyclictest27749-21cyclictest08:32:551
27751993022,6cyclictest29621-21needreboot08:43:031
27751993022,6cyclictest29621-21needreboot08:43:031
27751993021,7cyclictest12284-21cpuspeed12:17:551
27751993021,7cyclictest12284-21cpuspeed12:17:551
27751993021,7cyclictest12284-21cpuspeed12:17:551
27751993020,7cyclictest24571-21kernelversion11:23:001
27751993020,7cyclictest24571-21kernelversion11:23:001
2775199301,10cyclictest146782systemd-journal09:47:431
2775199301,10cyclictest146782systemd-journal09:47:431
27750993025,3cyclictest6884-21sed12:02:570
27750993025,3cyclictest6884-21sed12:02:570
27750993025,3cyclictest6884-21sed12:02:570
27750993024,5cyclictest550-21cron10:13:000
27750993024,5cyclictest550-21cron10:13:000
27750993024,5cyclictest550-21cron10:13:000
27750993023,5cyclictest545-21in:imuxsock09:57:460
27750993023,5cyclictest545-21in:imuxsock09:57:460
27750993023,5cyclictest15172-21threads12:23:060
27750993023,5cyclictest15172-21threads12:23:060
27750993023,5cyclictest14678-21systemd-journal09:22:450
27750993023,5cyclictest14678-21systemd-journal09:22:450
27750993023,4cyclictest0-21swapper/007:58:040
27750993023,4cyclictest0-21swapper/007:58:040
27750993022,6cyclictest14269-21cut08:02:570
27750993022,6cyclictest14269-21cut08:02:570
206522300,3sleep30-21swapper/312:38:073
206522300,3sleep30-21swapper/312:38:073
43892290,3sleep30-21swapper/310:28:063
43892290,3sleep30-21swapper/310:28:063
27751992924,3cyclictest306-21needreboot10:18:001
27751992924,3cyclictest306-21needreboot10:18:001
27751992923,5cyclictest28555-21ntp_offset11:33:051
27751992923,5cyclictest28555-21ntp_offset11:33:051
27751992923,5cyclictest28555-21ntp_offset11:33:051
27750992925,3cyclictest27749-21cyclictest09:28:020
27750992925,3cyclictest27749-21cyclictest09:28:020
27750992925,3cyclictest27749-21cyclictest09:28:020
27750992922,5cyclictest27749-21cyclictest08:28:060
27750992922,5cyclictest27749-21cyclictest08:28:060
27750992922,4cyclictest27749-21cyclictest08:53:110
27750992921,6cyclictest12994-21sshd09:25:140
27750992921,6cyclictest12994-21sshd09:25:140
27750992921,6cyclictest1024-21cut07:27:580
27750992921,6cyclictest1024-21cut07:27:580
179512290,2sleep30-21swapper/312:32:573
179512290,2sleep30-21swapper/312:32:573
179512290,2sleep30-21swapper/312:32:573
27751992821,5cyclictest19856-21cut08:17:571
27751992821,5cyclictest19856-21cut08:17:571
27751992820,6cyclictest24776-21fschecks_count09:57:571
27751992820,6cyclictest24776-21fschecks_count09:57:571
27751992819,7cyclictest30328-21fschecks_count10:12:551
27751992819,7cyclictest30328-21fschecks_count10:12:551
27750992822,3cyclictest0-21swapper/010:58:060
27750992822,3cyclictest0-21swapper/010:58:060
27750992822,3cyclictest0-21swapper/010:58:060
27750992821,5cyclictest32764-21needreboot10:18:010
27750992821,5cyclictest32764-21needreboot10:18:010
27750992821,5cyclictest21180-21sshd08:22:130
27750992821,5cyclictest21180-21sshd08:22:130
27750992819,7cyclictest30368-21fschecks_count10:12:550
27750992819,7cyclictest30368-21fschecks_count10:12:550
27751992723,3cyclictest27749-21cyclictest09:03:061
27751992723,3cyclictest27749-21cyclictest09:03:061
27751992722,3cyclictest0-21swapper/107:53:041
27751992722,3cyclictest0-21swapper/107:53:041
27751992721,5cyclictest8298-21latency09:12:581
27751992721,5cyclictest17338-21ntp_offset11:03:041
27751992721,5cyclictest17338-21ntp_offset11:03:041
27751992718,7cyclictest9499-21grep07:48:091
27751992718,7cyclictest9499-21grep07:48:091
27750992722,3cyclictest0-21swapper/011:12:570
27750992722,3cyclictest0-21swapper/011:12:570
27750992720,5cyclictest19246-21cut09:42:570
27750992720,5cyclictest16111-21processes09:33:030
27750992720,5cyclictest16111-21processes09:33:030
27750992719,6cyclictest21800-21gltestperf08:22:580
27750992719,6cyclictest21800-21gltestperf08:22:580
27751992621,3cyclictest8146-21idleruntime09:12:571
27751992620,5cyclictest2602-21kernelversion08:57:591
27751992620,5cyclictest2602-21kernelversion08:57:591
27751992620,4cyclictest1346-21avahi-daemon09:38:061
27751992620,4cyclictest1346-21avahi-daemon09:38:061
27751992620,4cyclictest12254-21fschecks_count07:57:571
27751992620,4cyclictest12254-21fschecks_count07:57:571
27751992619,5cyclictest13577-21fschecks_count09:27:581
27751992619,5cyclictest13577-21fschecks_count09:27:581
27751992619,5cyclictest13577-21fschecks_count09:27:581
27751992617,7cyclictest8182-21sort10:38:081
27751992617,7cyclictest8182-21sort10:38:081
27750992621,4cyclictest20827-21kernelversion11:13:000
27750992621,4cyclictest20827-21kernelversion11:13:000
27750992620,4cyclictest6556-21needreboot09:08:020
27750992620,4cyclictest6556-21needreboot09:08:020
27750992620,4cyclictest6556-21needreboot09:08:020
27750992619,5cyclictest27749-21cyclictest12:28:060
27750992619,5cyclictest27749-21cyclictest12:28:060
27750992619,5cyclictest27749-21cyclictest12:28:060
27750992619,5cyclictest19155-21sshd08:15:140
27750992619,5cyclictest19155-21sshd08:15:140
27750992619,5cyclictest14678-21systemd-journal07:56:260
27750992619,5cyclictest14678-21systemd-journal07:56:260
27750992617,7cyclictest9620-21kernelversion10:42:590
27750992617,7cyclictest9620-21kernelversion10:42:590
27750992617,7cyclictest9620-21kernelversion10:42:590
217662260,3sleep20-21swapper/209:48:052
217662260,3sleep20-21swapper/209:48:052
54792250,3sleep20-21swapper/207:38:082
318942250,3sleep131895-21uname07:22:591
318942250,3sleep131895-21uname07:22:591
27751992520,4cyclictest3758-21gltestperf10:27:581
27751992520,3cyclictest0-21swapper/110:58:071
27751992520,3cyclictest0-21swapper/110:58:071
27751992520,3cyclictest0-21swapper/110:58:071
27751992519,5cyclictest23086-21gltestperf09:52:571
27751992519,5cyclictest23086-21gltestperf09:52:571
27751992519,4cyclictest674-21gpm09:34:421
27751992519,4cyclictest674-21gpm09:34:421
27751992516,7cyclictest5354-21sort11:58:001
27751992516,7cyclictest5354-21sort11:58:001
27751992516,7cyclictest5354-21sort11:58:001
27751992516,7cyclictest5354-21sort11:58:001
27751992516,7cyclictest32358-21fschecks_time10:17:571
27751992516,7cyclictest32358-21fschecks_time10:17:571
27751992516,7cyclictest32358-21fschecks_time10:17:571
27750992520,3cyclictest0-21swapper/012:03:040
27750992520,3cyclictest0-21swapper/012:03:040
27750992520,3cyclictest0-21swapper/012:03:040
27750992518,5cyclictest25920-21sshd09:58:130
27750992518,5cyclictest25920-21sshd09:58:130
27750992518,5cyclictest12390-21fschecks_count12:17:560
27750992518,5cyclictest12390-21fschecks_count12:17:560
27750992518,5cyclictest12390-21fschecks_count12:17:560
27750992518,5cyclictest0-21swapper/007:22:580
27750992518,5cyclictest0-21swapper/007:22:580
27750992517,6cyclictest26617-21needreboot11:28:020
27750992517,6cyclictest26617-21needreboot11:28:020
27750992516,7cyclictest6995-21cat10:37:450
27750992516,7cyclictest6995-21cat10:37:450
27750992516,7cyclictest21770-21grep09:48:050
27750992516,7cyclictest21770-21grep09:48:050
27751992420,2cyclictest0-21swapper/111:48:021
27751992420,2cyclictest0-21swapper/111:48:021
27751992419,3cyclictest14047-21unixbench_multi10:53:081
27751992419,3cyclictest14047-21unixbench_multi10:53:081
27751992419,3cyclictest0-21swapper/112:42:451
27751992419,3cyclictest0-21swapper/112:42:451
27751992419,3cyclictest0-21swapper/112:08:071
27751992419,3cyclictest0-21swapper/112:08:071
27751992419,3cyclictest0-21swapper/112:08:071
27751992419,3cyclictest0-21swapper/112:07:451
27751992419,3cyclictest0-21swapper/112:07:451
27751992419,3cyclictest0-21swapper/112:07:451
27751992419,3cyclictest0-21swapper/111:42:571
27751992419,3cyclictest0-21swapper/111:42:571
27751992419,3cyclictest0-21swapper/111:42:571
27751992419,3cyclictest0-21swapper/111:42:571
27751992419,3cyclictest0-21swapper/107:32:591
27751992418,4cyclictest22146-21needreboot08:23:031
27751992418,4cyclictest22146-21needreboot08:23:031
27751992418,4cyclictest0-21swapper/111:58:041
27751992418,4cyclictest0-21swapper/111:58:041
27751992418,4cyclictest0-21swapper/111:58:041
27751992418,4cyclictest0-21swapper/110:37:451
27751992418,4cyclictest0-21swapper/110:37:451
27751992416,6cyclictest11978-21threads10:48:061
27751992416,6cyclictest11978-21threads10:48:061
27751992416,6cyclictest11978-21threads10:48:061
2775099241,9cyclictest26682-21grep10:02:570
2775099241,9cyclictest26682-21grep10:02:570
27750992419,3cyclictest0-21swapper/011:43:070
27750992419,3cyclictest0-21swapper/011:43:070
27750992419,3cyclictest0-21swapper/011:43:070
27750992419,3cyclictest0-21swapper/011:43:070
27750992418,3cyclictest0-21swapper/008:48:050
27750992418,3cyclictest0-21swapper/008:48:050
27750992418,3cyclictest0-21swapper/008:48:050
27750992417,5cyclictest0-21swapper/008:42:570
27750992417,5cyclictest0-21swapper/008:42:570
27751992319,2cyclictest0-21swapper/107:38:111
27751992318,3cyclictest0-21swapper/108:02:551
27751992318,3cyclictest0-21swapper/108:02:551
27751992318,2cyclictest0-21swapper/108:32:571
27751992317,3cyclictest0-21swapper/110:42:571
27751992317,3cyclictest0-21swapper/110:42:571
27751992317,3cyclictest0-21swapper/110:42:571
27751992316,4cyclictest0-21swapper/108:48:071
27751992316,4cyclictest0-21swapper/108:48:071
27751992316,4cyclictest0-21swapper/108:48:071
27750992319,3cyclictest16904-21gltestperf11:02:580
27750992319,3cyclictest16904-21gltestperf11:02:580
27750992319,2cyclictest0-21swapper/012:38:040
27750992319,2cyclictest0-21swapper/012:38:040
27750992319,2cyclictest0-21swapper/007:32:570
27750992318,3cyclictest0-21swapper/011:27:580
27750992318,3cyclictest0-21swapper/011:27:580
27750992318,3cyclictest0-21swapper/009:47:570
27750992317,4cyclictest60-21kcompactd010:51:260
27750992317,4cyclictest60-21kcompactd010:51:260
27750992317,4cyclictest60-21kcompactd010:51:260
27750992317,4cyclictest30914-21unixbench_singl11:38:090
27750992317,4cyclictest30914-21unixbench_singl11:38:090
27750992317,4cyclictest30914-21unixbench_singl11:38:090
27750992317,4cyclictest30914-21unixbench_singl11:38:090
27750992317,4cyclictest0-21swapper/012:32:590
27750992317,4cyclictest0-21swapper/012:32:590
27750992316,4cyclictest0-21swapper/010:42:520
27750992316,4cyclictest0-21swapper/010:42:520
27753992217,3cyclictest221382sleep208:23:022
27753992217,3cyclictest221382sleep208:23:022
27751992218,2cyclictest0-21swapper/108:12:551
27751992218,2cyclictest0-21swapper/108:12:551
27751992216,4cyclictest0-21swapper/110:23:051
27751992216,4cyclictest0-21swapper/110:23:051
27751992216,4cyclictest0-21swapper/108:52:581
27751992215,5cyclictest6156-21cut09:07:581
27750992217,3cyclictest0-21swapper/007:48:090
27750992217,3cyclictest0-21swapper/007:48:090
27750992216,3cyclictest0-21swapper/007:42:560
27750992216,3cyclictest0-21swapper/007:42:560
27750992213,7cyclictest13362-21sort10:53:010
27750992213,7cyclictest13362-21sort10:53:010
27753992114,4cyclictest179082chrt09:38:042
27753992114,4cyclictest179082chrt09:38:042
27751992117,2cyclictest0-21swapper/111:43:071
27751992117,2cyclictest0-21swapper/111:43:071
27751992117,2cyclictest0-21swapper/107:43:091
27751992117,2cyclictest0-21swapper/107:43:091
27750992117,2cyclictest0-21swapper/008:33:140
27750992116,3cyclictest0-21swapper/009:38:010
312782200,4sleep30-21swapper/308:48:003
312782200,4sleep30-21swapper/308:48:003
312782200,4sleep30-21swapper/308:48:003
2775499201,11cyclictest29527-21chrt10:08:083
2775499201,11cyclictest29527-21chrt10:08:083
27751992015,3cyclictest0-21swapper/111:17:541
27751992015,3cyclictest0-21swapper/111:17:541
2775199191,15cyclictest1861-21ls07:28:081
2775199191,15cyclictest1861-21ls07:28:081
27750991914,3cyclictest0-21swapper/009:42:590
27754991813,3cyclictest163062sleep308:08:003
27754991813,3cyclictest163062sleep308:08:003
2775499171,11cyclictest8440-21taskset07:47:583
2775499171,11cyclictest8440-21taskset07:47:583
2775499171,11cyclictest7505-21taskset10:37:593
2775499171,11cyclictest7505-21taskset10:37:593
2775499171,11cyclictest26453-21taskset11:28:003
2775499171,11cyclictest26453-21taskset11:28:003
2775499171,11cyclictest21182-21chrt09:47:583
2775499171,11cyclictest21182-21chrt09:47:583
2775499171,11cyclictest17312-21taskset11:03:033
2775499171,11cyclictest17312-21taskset11:03:033
2775499171,11cyclictest1170-21taskset11:47:583
2775499171,11cyclictest1170-21taskset11:47:583
2775499171,11cyclictest1170-21taskset11:47:583
2775499171,11cyclictest1170-21taskset11:47:583
27753991712,3cyclictest215312sleep211:13:072
27753991712,3cyclictest215312sleep211:13:072
2775399171,12cyclictest2239-21taskset08:57:562
2775399171,12cyclictest2239-21taskset08:57:562
2775399171,12cyclictest10645-21chrt12:12:572
2775399171,12cyclictest10645-21chrt12:12:572
2775499169,4cyclictest257002sleep309:58:073
2775499169,4cyclictest257002sleep309:58:073
2775499161,8cyclictest0-21swapper/309:02:543
2775499161,11cyclictest5759-21chrt09:07:503
2775499161,11cyclictest5759-21chrt09:07:503
2775499161,11cyclictest24300-21chrt11:22:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional