You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 08:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Tue Jun 09, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1786621050,3sleep20-21swapper/220:32:582
306632930,2sleep20-21swapper/223:58:092
306632930,2sleep20-21swapper/223:58:092
223182870,2sleep20-21swapper/223:37:592
223182870,2sleep20-21swapper/223:37:592
223182870,2sleep20-21swapper/223:37:592
4662860,3sleep20-21swapper/222:38:052
4662860,3sleep20-21swapper/222:38:052
94962810,3chrt0-21swapper/223:03:012
94962810,3chrt0-21swapper/223:03:012
94962810,3chrt0-21swapper/223:03:012
102552760,3sleep20-21swapper/221:38:042
102552760,3sleep20-21swapper/221:38:042
208742670,3sleep10-21swapper/122:07:531
208742670,3sleep10-21swapper/122:07:531
58732630,2sleep00-21swapper/019:58:150
171812590,3chrt0-21swapper/120:28:111
171812590,3chrt0-21swapper/120:28:111
224662550,2chrt22467-21/usr/sbin/munin20:43:100
224662550,2chrt22467-21/usr/sbin/munin20:43:100
141932550,2sleep30-21swapper/321:48:053
141932550,2sleep30-21swapper/321:48:053
42912530,3chrt0-21swapper/322:48:073
42912530,3chrt0-21swapper/322:48:073
223992510,2sleep20-21swapper/219:18:012
2041399492,41cyclictest749-21runrttasks00:02:591
2041399492,41cyclictest749-21runrttasks00:02:591
2041399492,41cyclictest749-21runrttasks00:02:591
84492480,2sleep20-21swapper/200:27:522
84492480,2sleep20-21swapper/200:27:522
20412994839,5cyclictest0-21swapper/000:02:530
20412994839,5cyclictest0-21swapper/000:02:530
20412994720,3cyclictest0-21swapper/022:32:480
20412994720,3cyclictest0-21swapper/022:32:480
115032470,2sleep20-21swapper/220:13:132
115032470,2sleep20-21swapper/220:13:132
7702460,4sleep1774-21latency_hist19:47:511
7702460,4sleep1774-21latency_hist19:47:511
46162460,2sleep30-21swapper/300:17:483
46162460,2sleep30-21swapper/300:17:483
46162460,2sleep30-21swapper/300:17:483
156742460,2sleep20-21swapper/221:53:022
156742460,2sleep20-21swapper/221:53:022
7962450,3sleep20-21swapper/219:47:522
7962450,3sleep20-21swapper/219:47:522
20412994422,20cyclictest21135-21cut22:07:590
20412994422,20cyclictest21135-21cut22:07:590
200722440,3sleep30-21swapper/320:38:023
200722440,3sleep30-21swapper/320:38:023
20412994219,2cyclictest0-21swapper/021:38:060
20412994219,2cyclictest0-21swapper/021:38:060
149762420,2sleep014708-21/usr/sbin/munin23:18:000
149762420,2sleep014708-21/usr/sbin/munin23:18:000
149762420,2sleep014708-21/usr/sbin/munin23:18:000
20413994133,6cyclictest23788-21cron19:22:481
20412994126,12cyclictest0-21swapper/000:03:120
20412994126,12cyclictest0-21swapper/000:03:120
20412994126,12cyclictest0-21swapper/000:03:120
198442400,1chrt0-21swapper/123:28:131
198442400,1chrt0-21swapper/123:28:131
185022400,3sleep30-21swapper/323:27:593
185022400,3sleep30-21swapper/323:27:593
119712400,2sleep30-21swapper/320:17:483
119712400,2sleep30-21swapper/320:17:483
67162390,3sleep30-21swapper/300:22:583
67162390,3sleep30-21swapper/300:22:583
20413993931,6cyclictest2186-21/usr/sbin/munin21:18:031
20413993931,6cyclictest2186-21/usr/sbin/munin21:18:031
55102360,2sleep05681-21fschecks_time22:52:590
303822360,2sleep1271rcuc/123:58:041
303822360,2sleep1271rcuc/123:58:041
303072360,4sleep20-21swapper/222:32:582
303072360,4sleep20-21swapper/222:32:582
241692360,2sleep20-21swapper/219:23:002
241692360,2sleep20-21swapper/219:23:002
108792360,2sleep110961-21/usr/sbin/munin00:33:031
108792360,2sleep110961-21/usr/sbin/munin00:33:031
83692350,1sleep18498-21sed21:33:051
83692350,1sleep18498-21sed21:33:051
20413993523,9cyclictest30844-21kernelversion22:33:031
20413993523,9cyclictest30844-21kernelversion22:33:031
23372340,3chrt0-21swapper/322:43:043
23372340,3chrt0-21swapper/322:43:043
20412993428,5cyclictest26161-21fschecks_count23:48:010
178812340,2sleep20-21swapper/223:23:122
178812340,2sleep20-21swapper/223:23:122
20413993325,6cyclictest20341-21munin-node22:08:111
20413993325,6cyclictest20341-21munin-node22:08:111
20412993325,6cyclictest2381-21cut21:18:000
20412993325,6cyclictest2381-21cut21:18:000
76902320,4sleep07694-21timerwakeupswit20:03:100
76902320,4sleep07694-21timerwakeupswit20:03:100
20413993223,7cyclictest2533-21gltestperf21:18:011
20413993222,8cyclictest19598-21latency_hist20:37:531
20413993222,8cyclictest19598-21latency_hist20:37:531
20412993225,5cyclictest8680-21cut20:08:040
20412993225,5cyclictest8680-21cut20:08:040
20412993225,5cyclictest8680-21cut20:08:040
20412993224,6cyclictest22281-21fschecks_count19:18:000
20412993224,6cyclictest0-21swapper/019:42:480
20413993125,4cyclictest17616-21gltestperf21:58:001
20413993125,4cyclictest17616-21gltestperf21:58:001
20413993122,7cyclictest5661-21fschecks_time22:52:591
20413993122,7cyclictest26743-21netstat23:48:061
20413993122,7cyclictest26743-21netstat23:48:061
20413993122,7cyclictest26743-21netstat23:48:061
20413993122,7cyclictest26743-21netstat23:48:061
20413993121,7cyclictest1072-21fschecks_count19:48:011
20413993121,7cyclictest1072-21fschecks_count19:48:011
20413993121,7cyclictest1072-21fschecks_count19:48:011
20412993126,4cyclictest18890-21gltestperf23:28:020
20412993123,6cyclictest29407-21latency_hist19:37:480
20412993123,6cyclictest29407-21latency_hist19:37:480
20412993123,5cyclictest23101-21cut22:13:000
20412993123,5cyclictest23101-21cut22:13:000
20412993122,7cyclictest1609-21needreboot19:48:070
20412993122,7cyclictest1609-21needreboot19:48:070
20412993122,7cyclictest1609-21needreboot19:48:070
119382310,1sleep012073-21threads23:08:110
119382310,1sleep012073-21threads23:08:110
119382310,1sleep012073-21threads23:08:110
20413993025,3cyclictest20409-21cyclictest23:28:011
20413993025,3cyclictest20409-21cyclictest23:28:011
20413993023,5cyclictest16951-21latency_hist23:23:021
20413993023,5cyclictest16951-21latency_hist23:23:021
20413993023,5cyclictest16951-21latency_hist23:23:021
20413993023,4cyclictest0-21swapper/122:42:481
20413993023,4cyclictest0-21swapper/122:42:481
20413993022,6cyclictest13874-21sendmail20:22:481
20413993022,6cyclictest13874-21sendmail20:22:481
20412993025,3cyclictest23977-21latency_hist23:42:490
20412993025,3cyclictest23977-21latency_hist23:42:490
20412993025,3cyclictest23977-21latency_hist23:42:490
20412993024,4cyclictest1346-21avahi-daemon22:33:090
20412993024,4cyclictest1346-21avahi-daemon22:33:090
20412993023,5cyclictest23735-21gltestperf20:48:030
20412993023,5cyclictest23735-21gltestperf20:48:030
20412993022,6cyclictest2700-21timerandwakeup22:43:100
20412993022,6cyclictest2700-21timerandwakeup22:43:100
20412993021,7cyclictest858-21timerwakeupswit22:38:090
20412993021,7cyclictest858-21timerwakeupswit22:38:090
20413992922,5cyclictest25210-21kernelversion22:18:011
20413992922,5cyclictest25210-21kernelversion22:18:011
20412992922,5cyclictest749-21runrttasks00:33:090
20412992922,5cyclictest749-21runrttasks00:33:090
20413992823,2cyclictest0-21swapper/121:28:001
20413992823,2cyclictest0-21swapper/121:28:001
20413992823,2cyclictest0-21swapper/100:38:041
20413992823,2cyclictest0-21swapper/100:38:041
20413992822,5cyclictest29502-21threads22:28:091
20413992822,5cyclictest29502-21threads22:28:091
20413992821,5cyclictest20409-21cyclictest19:36:581
20413992821,5cyclictest20409-21cyclictest19:36:581
20413992820,6cyclictest24083-21sort20:48:061
20413992820,6cyclictest24083-21sort20:48:061
20413992818,8cyclictest7256-21needreboot20:03:051
20413992818,8cyclictest7256-21needreboot20:03:051
20412992823,3cyclictest0-21swapper/022:58:020
20412992823,3cyclictest0-21swapper/022:58:020
20412992823,3cyclictest0-21swapper/022:58:020
20412992818,8cyclictest16473-21kernelversion20:28:030
20412992818,8cyclictest16473-21kernelversion20:28:030
286482270,3sleep20-21swapper/219:33:092
286482270,3sleep20-21swapper/219:33:092
20413992723,3cyclictest20409-21cyclictest00:18:231
20413992723,3cyclictest20409-21cyclictest00:18:231
20413992723,2cyclictest0-21swapper/120:08:121
20413992723,2cyclictest0-21swapper/120:08:121
20413992723,2cyclictest0-21swapper/120:08:121
20413992721,5cyclictest7668-21latency_hist21:32:481
20413992721,5cyclictest7668-21latency_hist21:32:481
20413992721,5cyclictest7668-21latency_hist21:32:481
20413992721,5cyclictest26731-21sshd20:55:031
20413992721,5cyclictest26731-21sshd20:55:031
20413992721,5cyclictest25649-21systemctl22:18:071
20413992721,5cyclictest25649-21systemctl22:18:071
20413992721,5cyclictest25649-21systemctl22:18:071
20413992721,5cyclictest20409-21cyclictest22:27:591
20413992721,5cyclictest20409-21cyclictest22:27:591
20413992720,5cyclictest29668-21latency_hist23:57:551
20413992720,5cyclictest29668-21latency_hist23:57:551
20413992720,5cyclictest2516-21sshd00:10:041
20413992720,5cyclictest2516-21sshd00:10:041
20413992719,6cyclictest24524-21basename22:17:481
20413992718,7cyclictest15776-21awk20:27:481
20413992718,7cyclictest15776-21awk20:27:481
20413992718,7cyclictest15776-21awk20:27:481
20412992723,3cyclictest20409-21cyclictest21:27:480
20412992723,3cyclictest20409-21cyclictest21:27:480
20412992723,3cyclictest20409-21cyclictest21:27:480
20412992722,3cyclictest24379-21gltestperf19:23:010
20412992722,3cyclictest24379-21gltestperf19:23:010
20412992722,3cyclictest0-21swapper/021:03:030
20412992722,3cyclictest0-21swapper/021:03:030
20412992721,5cyclictest21350-21sendmail20:42:480
20412992721,5cyclictest21350-21sendmail20:42:480
20412992720,5cyclictest15614-21sshd20:26:030
20412992720,5cyclictest15614-21sshd20:26:030
20412992720,5cyclictest15614-21sshd20:26:030
20412992719,6cyclictest25525-21fschecks_time20:53:010
20412992719,6cyclictest25525-21fschecks_time20:53:010
20412992717,7cyclictest32318-21processes19:43:090
20412992717,7cyclictest32318-21processes19:43:090
20413992622,3cyclictest16055-21needreboot21:53:071
20413992622,3cyclictest16055-21needreboot21:53:071
20413992619,6cyclictest23572-21vmstat23:38:131
20413992619,6cyclictest23572-21vmstat23:38:131
20413992619,6cyclictest23572-21vmstat23:38:131
20413992618,6cyclictest5567-21latency_hist22:52:591
20413992618,6cyclictest5027-21grep21:23:091
20413992618,6cyclictest29335-21cut21:03:001
20413992618,6cyclictest29335-21cut21:03:001
20413992618,5cyclictest0-21swapper/123:33:091
20413992618,5cyclictest0-21swapper/123:33:091
20413992618,5cyclictest0-21swapper/123:33:091
20413992617,7cyclictest597-21gltestperf21:13:011
20413992617,7cyclictest597-21gltestperf21:13:011
20412992621,3cyclictest0-21swapper/023:22:480
20412992621,3cyclictest0-21swapper/023:22:480
20412992621,3cyclictest0-21swapper/023:22:480
20412992621,3cyclictest0-21swapper/000:42:480
20412992621,3cyclictest0-21swapper/000:42:480
20412992621,2cyclictest0-21swapper/000:33:000
20412992621,2cyclictest0-21swapper/000:33:000
20412992620,4cyclictest26996-21gltestperf22:23:030
20412992620,3cyclictest0-21swapper/020:33:080
20412992620,3cyclictest0-21swapper/020:33:080
20412992619,5cyclictest7971-21unixbench_singl00:23:110
20412992619,5cyclictest7971-21unixbench_singl00:23:110
197472260,2sleep30-21swapper/323:28:113
197472260,2sleep30-21swapper/323:28:113
168592261,5sleep30-21swapper/320:28:103
168592261,5sleep30-21swapper/320:28:103
166642260,3sleep20-21swapper/223:22:592
166642260,3sleep20-21swapper/223:22:592
166642260,3sleep20-21swapper/223:22:592
2041499252,18cyclictest31767-21chrt00:02:592
2041499252,18cyclictest31767-21chrt00:02:592
2041499252,18cyclictest31767-21chrt00:02:592
20413992521,2cyclictest0-21swapper/100:13:041
20413992521,2cyclictest0-21swapper/100:13:041
20413992521,2cyclictest0-21swapper/100:13:041
20413992516,7cyclictest9716-21sort00:28:111
20413992516,7cyclictest9716-21sort00:28:111
20412992521,3cyclictest27911-21ntp_offset20:58:060
20412992521,3cyclictest27911-21ntp_offset20:58:060
20412992519,4cyclictest26393-21latency_hist22:22:480
20412992519,4cyclictest26393-21latency_hist22:22:480
20412992519,4cyclictest24643-21/usr/sbin/munin22:17:570
20412992519,4cyclictest24643-21/usr/sbin/munin22:17:570
20412992519,4cyclictest24643-21/usr/sbin/munin22:17:570
20412992519,4cyclictest0-21swapper/023:32:480
20412992519,4cyclictest0-21swapper/023:32:480
20412992519,3cyclictest0-21swapper/022:28:010
20412992519,3cyclictest0-21swapper/022:28:010
20412992518,5cyclictest12687-21kernelversion20:18:030
20412992518,5cyclictest12687-21kernelversion20:18:030
20412992516,7cyclictest27190-21grep23:48:110
20412992516,7cyclictest27190-21grep23:48:110
20412992516,7cyclictest27190-21grep23:48:110
20412992516,7cyclictest27190-21grep23:48:110
20413992419,3cyclictest0-21swapper/121:38:091
20413992419,3cyclictest0-21swapper/121:38:091
20413992419,2cyclictest0-21swapper/122:58:001
20413992419,2cyclictest0-21swapper/122:58:001
20413992419,2cyclictest0-21swapper/122:58:001
20413992418,3cyclictest0-21swapper/121:43:101
20413992418,3cyclictest0-21swapper/121:43:101
20413992417,5cyclictest3535-21ntp_kernel_pll_19:53:061
20413992417,5cyclictest3535-21ntp_kernel_pll_19:53:061
20413992417,5cyclictest11797-21ntp_offset23:08:081
20413992417,5cyclictest11797-21ntp_offset23:08:081
20413992417,5cyclictest11797-21ntp_offset23:08:081
20413992417,4cyclictest0-21swapper/123:13:101
20413992417,4cyclictest0-21swapper/123:13:101
20413992417,4cyclictest0-21swapper/123:13:101
20413992417,4cyclictest0-21swapper/121:17:581
20413992417,4cyclictest0-21swapper/121:17:581
20412992419,4cyclictest16628-21unixbench_singl21:53:120
20412992419,4cyclictest16628-21unixbench_singl21:53:120
20412992419,3cyclictest0-21swapper/022:52:580
20412992418,5cyclictest1434-21gltestperf00:08:030
20412992418,5cyclictest1434-21gltestperf00:08:030
20412992418,5cyclictest10834-21cron23:07:480
20412992418,5cyclictest10834-21cron23:07:480
20412992418,5cyclictest10834-21cron23:07:480
20412992418,3cyclictest0-21swapper/021:48:010
20412992418,3cyclictest0-21swapper/021:48:010
208852230,4sleep20-21swapper/222:07:542
208852230,4sleep20-21swapper/222:07:542
20413992319,2cyclictest0-21swapper/120:58:011
20413992319,2cyclictest0-21swapper/120:58:011
20413992318,4cyclictest26812-21systemctl19:28:101
20413992318,4cyclictest26812-21systemctl19:28:101
20413992318,3cyclictest0-21swapper/122:43:041
20413992318,3cyclictest0-21swapper/122:43:041
20413992317,4cyclictest20409-21cyclictest19:38:011
20413992317,3cyclictest0-21swapper/120:43:111
20413992317,3cyclictest0-21swapper/120:43:111
20413992314,7cyclictest5218-21cut19:58:041
20412992319,3cyclictest754-21if_err_eth021:13:020
20412992319,3cyclictest754-21if_err_eth021:13:020
20412992319,2cyclictest0-21swapper/023:33:030
20412992319,2cyclictest0-21swapper/023:33:030
20412992319,2cyclictest0-21swapper/023:33:030
20412992318,3cyclictest0-21swapper/023:53:060
20412992318,3cyclictest0-21swapper/023:53:060
20412992318,3cyclictest0-21swapper/019:28:120
20412992318,3cyclictest0-21swapper/019:28:120
20412992317,4cyclictest0-21swapper/023:43:100
20412992310,11cyclictest14678-21systemd-journal21:37:480
20412992310,11cyclictest14678-21systemd-journal21:37:480
20415992216,4cyclictest87822sleep321:33:113
20415992216,4cyclictest87822sleep321:33:113
20415992215,3cyclictest211052sleep322:07:593
20415992215,3cyclictest211052sleep322:07:593
20413992216,5cyclictest5914-21kernelversion22:53:021
20413992216,5cyclictest5914-21kernelversion22:53:021
20413992216,5cyclictest5914-21kernelversion22:53:021
20413992215,5cyclictest9855-21needreboot23:03:071
20413992215,5cyclictest9855-21needreboot23:03:071
20413992215,5cyclictest9855-21needreboot23:03:071
20412992217,3cyclictest0-21swapper/021:18:020
20412992217,3cyclictest0-21swapper/021:18:020
20412992217,3cyclictest0-21swapper/021:13:060
20412992217,3cyclictest0-21swapper/020:13:120
20412992217,3cyclictest0-21swapper/020:13:120
20412992217,3cyclictest0-21swapper/019:53:060
20412992217,3cyclictest0-21swapper/019:53:060
20412992216,4cyclictest6752-21ntp_offset21:28:060
20412992216,4cyclictest6752-21ntp_offset21:28:060
20412992216,4cyclictest6752-21ntp_offset21:28:060
2041599215,11cyclictest0-21swapper/300:02:593
2041599215,11cyclictest0-21swapper/300:02:593
2041599215,11cyclictest0-21swapper/300:02:593
20413992116,3cyclictest0-21swapper/120:13:021
20413992116,3cyclictest0-21swapper/120:13:021
20413992116,3cyclictest0-21swapper/100:23:101
20413992116,3cyclictest0-21swapper/100:23:101
20413992115,4cyclictest0-21swapper/123:43:031
20413992115,4cyclictest0-21swapper/123:43:031
2041399211,11cyclictest19699-21/usr/sbin/munin20:38:001
2041399211,11cyclictest19699-21/usr/sbin/munin20:38:001
20412992117,3cyclictest14678-21systemd-journal23:27:490
20412992116,3cyclictest0-21swapper/021:43:110
20412992116,3cyclictest0-21swapper/021:43:110
20412992116,3cyclictest0-21swapper/000:13:020
20412992116,3cyclictest0-21swapper/000:13:020
20412992116,3cyclictest0-21swapper/000:13:020
20412992114,5cyclictest17921-21needreboot21:58:030
20412992114,5cyclictest17921-21needreboot21:58:030
20412992113,6cyclictest6563-21cat00:22:500
20412992113,6cyclictest6563-21cat00:22:500
20413992015,3cyclictest0-21swapper/121:48:151
20413992015,3cyclictest0-21swapper/121:48:151
2041399201,16cyclictest24168-21cut19:23:001
2041399201,16cyclictest24168-21cut19:23:001
20412991914,3cyclictest0-21swapper/022:57:560
20412991914,3cyclictest0-21swapper/022:57:560
20412991914,3cyclictest0-21swapper/022:57:560
2041499183,9cyclictest0-21swapper/220:10:032
2041499183,9cyclictest0-21swapper/220:10:032
2041499183,9cyclictest0-21swapper/220:10:032
2041499181,12cyclictest4617-21taskset22:48:102
2041499181,12cyclictest4617-21taskset22:48:102
2041599171,11cyclictest7224-21taskset00:23:033
2041599171,11cyclictest7224-21taskset00:23:033
2041599171,11cyclictest4996-21chrt19:58:023
2041599171,11cyclictest4388-21chrt21:23:013
2041599171,11cyclictest4388-21chrt21:23:013
2041599171,11cyclictest4388-21chrt21:23:013
2041599171,11cyclictest27136-21chrt20:57:563
2041599171,11cyclictest27136-21chrt20:57:563
2041599171,11cyclictest24438-21chrt20:48:113
2041599171,11cyclictest24438-21chrt20:48:113
2041499171,12cyclictest3167-21chrt00:13:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional