You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 21:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Wed Apr 08, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
929521340,3chrt0-21swapper/212:27:042
929521340,3chrt0-21swapper/212:27:042
237982960,3sleep20-21swapper/210:12:052
237982960,3sleep20-21swapper/210:12:052
237982960,3sleep20-21swapper/210:12:052
33712790,3chrt0-21swapper/212:11:522
33712790,3chrt0-21swapper/212:11:522
228232770,2chrt22827-21missed_timers08:42:071
228232770,2chrt22827-21missed_timers08:42:071
224752630,4chrt0-21swapper/208:42:042
224752630,4chrt0-21swapper/208:42:042
8962600,3chrt0-21swapper/212:02:112
8962600,3chrt0-21swapper/212:02:112
36252570,3sleep10-21swapper/109:17:091
36252570,3sleep10-21swapper/109:17:091
36252570,3sleep10-21swapper/109:17:091
23122550,1sleep1271rcuc/109:12:141
23122550,1sleep1271rcuc/109:12:141
104462500,9sleep1281ktimers/112:27:151
104462500,9sleep1281ktimers/112:27:151
80262470,1sleep18158-21/usr/sbin/munin10:57:031
80262470,1sleep18158-21/usr/sbin/munin10:57:031
104842460,2sleep20-21swapper/209:37:042
104842460,2sleep20-21swapper/209:37:042
104842460,2sleep20-21swapper/209:37:042
252852450,2chrt0-21swapper/311:42:063
252852450,2chrt0-21swapper/311:42:063
252852450,2chrt0-21swapper/311:42:063
235932450,4sleep1271rcuc/110:12:041
235932450,4sleep1271rcuc/110:12:041
235932450,4sleep1271rcuc/110:12:041
113182450,2sleep10-21swapper/108:12:051
113182450,2sleep10-21swapper/108:12:051
127552440,2sleep30-21swapper/311:07:133
127552440,2sleep30-21swapper/311:07:133
317922430,2chrt0-21swapper/210:32:112
317922430,2chrt0-21swapper/210:32:112
294422420,2sleep30-21swapper/310:27:053
294422420,2sleep30-21swapper/310:27:053
138442390,2sleep00-21swapper/011:12:060
138442390,2sleep00-21swapper/011:12:060
136432390,3sleep30-21swapper/312:37:103
136432390,3sleep30-21swapper/312:37:103
136432390,3sleep30-21swapper/312:37:103
118212380,2sleep0700-21192.168.115.40-manager08:12:130
118212380,2sleep0700-21192.168.115.40-manager08:12:130
101122370,3chrt0-21swapper/312:27:133
101122370,3chrt0-21swapper/312:27:133
88522350,2sleep20-21swapper/210:57:112
88522350,2sleep20-21swapper/210:57:112
277172350,3chrt0-21swapper/311:47:133
21092993527,6cyclictest17598-21threads08:27:151
21092993527,6cyclictest17598-21threads08:27:151
159412350,2sleep30-21swapper/311:17:063
159412350,2sleep30-21swapper/311:17:063
159412350,2sleep30-21swapper/311:17:063
159412350,2sleep30-21swapper/311:17:063
120732350,2sleep20-21swapper/208:12:142
120732350,2sleep20-21swapper/208:12:142
226992340,1sleep022821-21missed_timers08:42:070
226992340,1sleep022821-21missed_timers08:42:070
21092993427,5cyclictest28652-21fschecks_count11:52:041
21092993427,5cyclictest28652-21fschecks_count11:52:041
21092993425,7cyclictest19906-21fschecks_count10:02:041
21092993425,7cyclictest19906-21fschecks_count10:02:041
21092993425,7cyclictest19906-21fschecks_count10:02:041
21086993425,7cyclictest29462-21switchtime11:52:130
21086993425,7cyclictest29462-21switchtime11:52:130
21086993425,7cyclictest14325-21cut09:47:040
21086993425,7cyclictest14325-21cut09:47:040
90712330,2sleep09073-21cat08:07:010
90712330,2sleep09073-21cat08:07:010
24112320,1sleep02500-21fschecks_count10:42:030
24112320,1sleep02500-21fschecks_count10:42:030
21086993224,6cyclictest21685-21needreboot11:32:090
319402310,2sleep30-21swapper/307:41:523
319402310,2sleep30-21swapper/307:41:523
319402310,2sleep30-21swapper/307:41:523
319402310,2sleep30-21swapper/307:41:523
21092993124,5cyclictest1-21systemd10:41:511
21092993124,5cyclictest1-21systemd10:41:511
21092993124,5cyclictest1-21systemd10:41:511
21092993123,6cyclictest9169-21needreboot09:32:081
21092993123,6cyclictest9169-21needreboot09:32:081
21086993124,6cyclictest2224-21kernelversion12:07:070
21086993124,6cyclictest2224-21kernelversion12:07:070
21086993124,5cyclictest4866-21needreboot10:47:090
21086993124,5cyclictest4866-21needreboot10:47:090
129822310,2chrt12981-21/usr/sbin/munin09:42:091
129822310,2chrt12981-21/usr/sbin/munin09:42:091
21092993023,5cyclictest13827-21gltestperf11:12:051
21092993023,5cyclictest13827-21gltestperf11:12:051
21092993022,6cyclictest20082-21cron08:36:511
21092993022,6cyclictest20082-21cron08:36:511
21086993025,3cyclictest0-21swapper/011:27:050
21086993024,5cyclictest986-21unixbench-2d12:02:120
21086993024,5cyclictest986-21unixbench-2d12:02:120
21086993023,6cyclictest20151-21threads11:27:140
21086993023,6cyclictest20151-21threads11:27:140
21086993023,5cyclictest8148-21processes12:22:110
21086993023,5cyclictest8148-21processes12:22:110
21086993022,6cyclictest13329-21kernelversion08:17:060
21086993022,6cyclictest13329-21kernelversion08:17:060
21086993022,6cyclictest13329-21kernelversion08:17:060
326562290,2chrt0-21swapper/207:42:072
326562290,2chrt0-21swapper/207:42:072
320802290,2sleep0171ktimers/009:07:070
21092992922,5cyclictest9112-21latency_hist12:27:001
21092992922,5cyclictest9112-21latency_hist12:27:001
21092992921,6cyclictest643-21gunzip12:02:101
21092992921,6cyclictest643-21gunzip12:02:101
21092992921,5cyclictest17513-21fschecks_time11:22:051
21092992921,5cyclictest17513-21fschecks_time11:22:051
21092992921,5cyclictest17513-21fschecks_time11:22:051
21086992924,3cyclictest21074-21cyclictest09:27:140
21086992924,3cyclictest21074-21cyclictest09:27:140
21086992922,5cyclictest29070-21sshd08:57:190
21086992922,5cyclictest29070-21sshd08:57:190
21086992922,5cyclictest29070-21sshd08:57:190
21086992922,5cyclictest21259-21sshd10:05:190
21086992922,5cyclictest21259-21sshd10:05:190
21086992922,5cyclictest21259-21sshd10:05:190
21086992919,7cyclictest10613-21cut09:37:050
21086992919,7cyclictest10613-21cut09:37:050
21086992919,7cyclictest10613-21cut09:37:050
49032280,2sleep15044-21fschecks_time09:22:041
49032280,2sleep15044-21fschecks_time09:22:041
49032280,2sleep15044-21fschecks_time09:22:041
21092992822,5cyclictest7333-21sshd10:52:191
21092992822,5cyclictest7333-21sshd10:52:191
21092992822,4cyclictest21074-21cyclictest10:21:591
21092992822,4cyclictest21074-21cyclictest10:21:591
21092992821,5cyclictest17816-21latency_hist09:57:011
21092992821,5cyclictest17816-21latency_hist09:57:011
21092992819,7cyclictest3634-21fschecks_count07:52:031
21092992819,7cyclictest3634-21fschecks_count07:52:031
21086992821,5cyclictest23585-21fschecks_count10:12:040
21086992821,5cyclictest23585-21fschecks_count10:12:040
21086992821,5cyclictest23585-21fschecks_count10:12:040
21086992820,6cyclictest629-21cut07:42:120
21086992820,6cyclictest629-21cut07:42:120
21086992820,6cyclictest21074-21cyclictest11:44:130
21086992820,6cyclictest21074-21cyclictest11:44:130
21086992820,6cyclictest21074-21cyclictest11:44:130
21086992820,6cyclictest19113-21needreboot08:32:080
21086992820,6cyclictest19113-21needreboot08:32:080
21086992819,7cyclictest6781-21fschecks_count09:27:040
21086992819,7cyclictest6781-21fschecks_count09:27:040
21092992721,4cyclictest566-21sendmail_mailst07:42:121
21092992721,4cyclictest566-21sendmail_mailst07:42:121
21092992721,4cyclictest2577-21swap07:47:121
21092992721,4cyclictest2577-21swap07:47:121
21092992720,5cyclictest1346-21avahi-daemon10:27:131
21092992720,5cyclictest1346-21avahi-daemon10:27:131
21092992720,4cyclictest0-21swapper/111:27:141
21092992720,4cyclictest0-21swapper/111:27:141
21092992717,8cyclictest550-21cron10:46:541
21092992717,8cyclictest550-21cron10:46:541
73122260,4chrt0-21swapper/309:27:083
73122260,4chrt0-21swapper/309:27:083
21092992620,5cyclictest2834-21timerwakeupswit12:07:141
21092992620,5cyclictest2834-21timerwakeupswit12:07:141
21092992618,6cyclictest20470-21fschecks_count08:37:041
21092992618,6cyclictest20470-21fschecks_count08:37:041
21086992621,3cyclictest3239-21systemctl10:42:120
21086992621,3cyclictest3239-21systemctl10:42:120
21086992620,4cyclictest31712-21sshd07:39:330
21086992620,4cyclictest31712-21sshd07:39:330
21086992620,4cyclictest31712-21sshd07:39:330
21086992620,4cyclictest31712-21sshd07:39:330
21086992620,4cyclictest1700-21head09:12:080
21086992620,4cyclictest1700-21head09:12:080
21086992619,5cyclictest5826-21if_wlan007:57:050
21086992619,5cyclictest5826-21if_wlan007:57:050
21086992619,5cyclictest4345-21sshd09:19:190
21086992619,5cyclictest4345-21sshd09:19:190
21086992619,5cyclictest4345-21sshd09:19:190
21086992618,6cyclictest20448-21fschecks_count08:37:040
21086992618,6cyclictest20448-21fschecks_count08:37:040
21108992519,3cyclictest74382sleep312:22:023
21092992521,3cyclictest3870-21gltestperf12:12:041
21092992521,2cyclictest0-21swapper/111:47:021
21092992521,2cyclictest0-21swapper/111:47:021
21092992521,2cyclictest0-21swapper/111:47:021
21092992520,3cyclictest0-21swapper/111:57:031
21092992520,3cyclictest0-21swapper/111:57:031
21092992520,3cyclictest0-21swapper/111:57:031
21092992520,3cyclictest0-21swapper/109:02:141
21092992520,3cyclictest0-21swapper/109:02:141
21092992519,5cyclictest142-21systemd-journal10:47:051
21092992519,5cyclictest142-21systemd-journal10:47:051
21092992519,4cyclictest5701-21fschecks_time12:17:041
21092992519,4cyclictest5701-21fschecks_time12:17:041
21092992519,4cyclictest31830-21gltestperf09:07:051
21092992519,4cyclictest21074-21cyclictest12:32:041
21092992519,4cyclictest21074-21cyclictest12:32:041
21092992519,4cyclictest17030-21cron11:21:511
21092992519,4cyclictest17030-21cron11:21:511
21092992519,4cyclictest17030-21cron11:21:511
21092992519,4cyclictest17030-21cron11:21:511
21092992519,4cyclictest0-21swapper/108:57:111
21092992519,4cyclictest0-21swapper/108:57:111
21092992519,4cyclictest0-21swapper/108:57:111
21092992518,5cyclictest23138-21fschecks_time11:37:041
21092992518,5cyclictest23138-21fschecks_time11:37:041
21092992517,6cyclictest9358-21fschecks_time08:07:031
21092992517,6cyclictest9358-21fschecks_time08:07:031
21092992517,6cyclictest16400-21cat08:26:521
21092992517,6cyclictest16400-21cat08:26:521
21086992521,2cyclictest0-21swapper/007:32:040
21086992521,2cyclictest0-21swapper/007:32:040
21086992520,4cyclictest31225-21systemctl11:57:110
21086992520,4cyclictest31225-21systemctl11:57:110
21086992520,4cyclictest31225-21systemctl11:57:110
21086992519,5cyclictest7412-21sshd10:53:190
21086992519,5cyclictest7412-21sshd10:53:190
21086992519,3cyclictest0-21swapper/012:17:120
21086992519,3cyclictest0-21swapper/012:17:120
21086992518,5cyclictest17484-21fschecks_time11:22:050
21086992518,5cyclictest17484-21fschecks_time11:22:050
179892250,3chrt0-21swapper/009:57:030
179892250,3chrt0-21swapper/009:57:030
21092992420,2cyclictest0-21swapper/108:21:511
21092992420,2cyclictest0-21swapper/108:21:511
21092992420,2cyclictest0-21swapper/108:21:511
21092992419,3cyclictest0-21swapper/107:26:511
21092992418,5cyclictest21074-21cyclictest10:22:061
21092992418,5cyclictest21074-21cyclictest10:22:061
21092992418,5cyclictest21074-21cyclictest10:22:061
21092992417,5cyclictest25892-21latency_hist08:51:591
21092992417,5cyclictest25892-21latency_hist08:51:591
21092992417,5cyclictest25892-21latency_hist08:51:591
21092992416,6cyclictest26529-21/usr/sbin/munin07:27:091
21092992416,6cyclictest26529-21/usr/sbin/munin07:27:091
21086992420,2cyclictest0-21swapper/010:42:010
21086992419,4cyclictest10215-21latency_hist09:36:530
21086992419,4cyclictest10215-21latency_hist09:36:530
21086992419,3cyclictest29827-21ntp_offset10:27:100
21086992419,3cyclictest29827-21ntp_offset10:27:100
21086992419,3cyclictest0-21swapper/011:47:120
21086992419,3cyclictest0-21swapper/009:52:070
21086992419,3cyclictest0-21swapper/009:52:070
21086992419,3cyclictest0-21swapper/007:52:060
21086992419,3cyclictest0-21swapper/007:52:060
21086992418,5cyclictest24621-21latency08:47:060
21086992418,5cyclictest24621-21latency08:47:060
21086992418,5cyclictest24621-21latency08:47:060
21086992418,4cyclictest3276-21latency_hist07:51:520
21086992418,4cyclictest3276-21latency_hist07:51:520
21086992418,4cyclictest142-21systemd-journal09:45:030
21086992418,4cyclictest142-21systemd-journal09:45:030
21086992418,3cyclictest0-21swapper/008:52:130
21086992418,3cyclictest0-21swapper/008:52:130
21086992417,5cyclictest29895-21fschecks_time09:02:040
21086992417,5cyclictest29895-21fschecks_time09:02:040
21086992417,4cyclictest0-21swapper/010:57:120
21086992417,4cyclictest0-21swapper/010:57:120
21086992417,4cyclictest0-21swapper/010:32:130
21086992417,4cyclictest0-21swapper/010:32:130
21086992416,6cyclictest3838-21fschecks_time12:12:040
226212230,4sleep30-21swapper/308:42:053
226212230,4sleep30-21swapper/308:42:053
21092992318,2cyclictest0-21swapper/107:57:041
21092992318,2cyclictest0-21swapper/107:57:041
21092992317,5cyclictest30925-21needreboot07:37:071
21092992317,5cyclictest30925-21needreboot07:37:071
21092992317,5cyclictest30925-21needreboot07:37:071
21092992317,5cyclictest30925-21needreboot07:37:071
21092992317,3cyclictest0-21swapper/109:57:031
21092992317,3cyclictest0-21swapper/109:57:031
21092992316,6cyclictest10028-21cut11:02:031
21092992316,6cyclictest10028-21cut11:02:031
21092992316,6cyclictest10028-21cut11:02:031
21092992315,6cyclictest21571-21sort11:32:071
2108699234,4cyclictest181rcu_preempt10:15:460
2108699234,4cyclictest181rcu_preempt10:15:460
21086992319,2cyclictest0-21swapper/007:27:090
21086992319,2cyclictest0-21swapper/007:27:090
21086992318,2cyclictest0-21swapper/011:17:100
21086992318,2cyclictest0-21swapper/011:17:100
21086992318,2cyclictest0-21swapper/011:17:100
21086992318,2cyclictest0-21swapper/011:17:100
21086992317,4cyclictest0-21swapper/010:18:180
21086992317,4cyclictest0-21swapper/010:18:180
97732220,3sleep30-21swapper/308:07:083
97732220,3sleep30-21swapper/308:07:083
21092992218,2cyclictest0-21swapper/112:37:051
21092992218,2cyclictest0-21swapper/112:37:051
21092992218,2cyclictest0-21swapper/112:37:051
21092992217,3cyclictest28732-21sed07:32:041
21092992217,3cyclictest28732-21sed07:32:041
21092992217,3cyclictest0-21swapper/109:37:161
21092992217,3cyclictest0-21swapper/109:37:161
21092992217,3cyclictest0-21swapper/109:37:161
21092992216,4cyclictest0-21swapper/110:17:001
21092992215,5cyclictest28334-21latency_hist11:51:551
21086992217,4cyclictest23216-21gltestperf11:37:050
21086992217,4cyclictest23216-21gltestperf11:37:050
21086992215,4cyclictest0-21swapper/010:22:050
21086992215,4cyclictest0-21swapper/010:22:050
21086992215,4cyclictest0-21swapper/010:22:050
17282220,3chrt0-21swapper/307:47:023
72342210,3sleep20-21swapper/209:27:072
72342210,3sleep20-21swapper/209:27:072
21092992117,2cyclictest0-21swapper/109:27:141
21092992117,2cyclictest0-21swapper/109:27:141
21092992117,2cyclictest0-21swapper/108:02:101
21092992117,2cyclictest0-21swapper/108:02:101
21092992112,7cyclictest12712-21ls11:07:131
21092992112,7cyclictest12712-21ls11:07:131
21086992117,2cyclictest0-21swapper/007:22:080
21086992116,3cyclictest0-21swapper/011:02:100
21086992116,3cyclictest0-21swapper/011:02:100
21086992116,3cyclictest0-21swapper/011:02:100
2109299207,11cyclictest30961-21sort10:32:021
2109299207,11cyclictest30961-21sort10:32:021
21092992014,3cyclictest0-21swapper/109:47:231
21092992014,3cyclictest0-21swapper/109:47:231
21092992014,3cyclictest0-21swapper/108:52:131
21092992014,3cyclictest0-21swapper/108:52:131
2108699201,7cyclictest14884-21grep08:22:030
2108699201,7cyclictest14884-21grep08:22:030
21086992015,3cyclictest0-21swapper/012:32:040
21086992015,3cyclictest0-21swapper/012:32:040
21086992014,4cyclictest0-21swapper/012:37:040
21086992014,4cyclictest0-21swapper/012:37:040
21086992014,4cyclictest0-21swapper/012:37:040
21086992014,3cyclictest0-21swapper/012:27:060
21086992014,3cyclictest0-21swapper/012:27:060
21086992013,4cyclictest0-21swapper/011:07:120
21086992013,4cyclictest0-21swapper/011:07:120
2108699201,16cyclictest10762-21ls08:11:520
2108699201,16cyclictest10762-21ls08:11:520
2108699201,10cyclictest5275-21/usr/sbin/munin09:22:060
2110899191,11cyclictest30873-21chrt11:57:063
2110899191,11cyclictest30873-21chrt11:57:063
2110899191,11cyclictest30873-21chrt11:57:063
2110099191,11cyclictest25574-21chrt10:17:032
2110099191,11cyclictest25574-21chrt10:17:032
21092991915,2cyclictest0-21swapper/110:12:121
21086991914,3cyclictest0-21swapper/008:27:140
21086991914,3cyclictest0-21swapper/008:27:140
2110899181,14cyclictest21397-21chrt10:06:513
2110899181,14cyclictest21397-21chrt10:06:513
2110899181,14cyclictest21397-21chrt10:06:513
2110899181,13cyclictest2281-21chrt10:42:013
2110899181,13cyclictest2281-21chrt10:42:013
2110899181,13cyclictest2281-21chrt10:42:013
2110899181,12cyclictest9022-21chrt10:57:123
2110899181,12cyclictest9022-21chrt10:57:123
2110899181,11cyclictest17492-21chrt11:22:053
2110899181,11cyclictest17492-21chrt11:22:053
2110899181,11cyclictest17492-21chrt11:22:053
2110899171,13cyclictest5471-21taskset09:22:093
2110899171,13cyclictest5471-21taskset09:22:093
2110899171,13cyclictest5471-21taskset09:22:093
2110899171,13cyclictest32610-21chrt09:07:143
2110899171,11cyclictest12202-21chrt09:41:593
2110899171,11cyclictest12202-21chrt09:41:593
2110899171,11cyclictest12202-21chrt09:41:593
2110899171,11cyclictest10389-21chrt11:02:073
2110899171,11cyclictest10389-21chrt11:02:073
2110899171,11cyclictest10389-21chrt11:02:073
2110899171,10cyclictest9054-21chrt08:07:003
2110899171,10cyclictest9054-21chrt08:07:003
2110099171,13cyclictest14369-21taskset09:47:042
2110099171,13cyclictest14369-21taskset09:47:042
2110899163,9cyclictest0-21swapper/311:12:193
2110899163,9cyclictest0-21swapper/311:12:193
2110899163,9cyclictest0-21swapper/310:44:193
2110899163,9cyclictest0-21swapper/310:44:193
2110899163,9cyclictest0-21swapper/309:02:183
2110899163,9cyclictest0-21swapper/309:02:183
2110899163,9cyclictest0-21swapper/307:32:193
2110899163,9cyclictest0-21swapper/307:32:193
2110899162,10cyclictest26032-21chrt08:52:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional