You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 10:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Fri Apr 10, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3049421110,3sleep20-21swapper/221:37:042
3049421110,3sleep20-21swapper/221:37:042
3049421110,3sleep20-21swapper/221:37:042
1425821080,3sleep30-21swapper/322:17:173
1425821080,3sleep30-21swapper/322:17:173
671421070,3sleep20-21swapper/221:57:182
671421070,3sleep20-21swapper/221:57:182
3197021070,10sleep031976-21mailstats20:12:120
2174521060,2sleep20-21swapper/221:12:112
2174521060,2sleep20-21swapper/221:12:112
73372970,2sleep30-21swapper/320:32:173
73372970,2sleep30-21swapper/320:32:173
5782960,3sleep30-21swapper/320:17:053
5782960,3sleep30-21swapper/320:17:053
253922900,2sleep20-21swapper/200:16:552
253922900,2sleep20-21swapper/200:16:552
95342870,2sleep09535-21sshd20:40:050
95342870,2sleep09535-21sshd20:40:050
261012850,1sleep00-21swapper/000:17:090
261012850,1sleep00-21swapper/000:17:090
261012850,1sleep00-21swapper/000:17:090
254212650,4sleep00-21swapper/019:57:000
254212650,4sleep00-21swapper/019:57:000
8899996454,7cyclictest0-21swapper/000:01:570
8899996454,7cyclictest0-21swapper/000:01:570
8899996454,7cyclictest0-21swapper/000:01:570
211912640,3sleep30-21swapper/300:02:173
211912640,3sleep30-21swapper/300:02:173
200172620,11sleep0171ktimers/019:42:050
200172620,11sleep0171ktimers/019:42:050
5352580,3chrt0-21swapper/223:07:162
5352580,3chrt0-21swapper/223:07:162
121272550,3sleep20-21swapper/220:47:072
121272550,3sleep20-21swapper/220:47:072
225352510,3sleep30-21swapper/322:42:053
188592480,2sleep20-21swapper/223:57:132
188592480,2sleep20-21swapper/223:57:132
188592480,2sleep20-21swapper/223:57:132
186342450,2sleep0201rcuc/021:02:160
186342450,2sleep0201rcuc/021:02:160
186342450,2sleep0201rcuc/021:02:160
889999445,33cyclictest20559-21memory00:02:090
889999445,33cyclictest20559-21memory00:02:090
212772430,3chrt0-21swapper/200:02:402
212772430,3chrt0-21swapper/200:02:402
203312430,3sleep20-21swapper/219:42:072
203312430,3sleep20-21swapper/219:42:072
293532420,3sleep20-21swapper/220:07:032
293532420,3sleep20-21swapper/220:07:032
142392420,4chrt0-21swapper/219:27:032
142392420,4chrt0-21swapper/219:27:032
8906994116,23cyclictest24185-21latency_hist22:47:001
8906994116,23cyclictest24185-21latency_hist22:47:001
244992410,3sleep30-21swapper/300:12:133
244992410,3sleep30-21swapper/300:12:133
8906993914,3cyclictest0-21swapper/121:42:071
8906993914,3cyclictest0-21swapper/121:42:071
8906993914,3cyclictest0-21swapper/121:42:071
185172390,3sleep20-21swapper/219:37:082
185172390,3sleep20-21swapper/219:37:082
223762380,2sleep30-21swapper/319:47:113
223762380,2sleep30-21swapper/319:47:113
218632380,3sleep00-21swapper/021:12:130
218632380,3sleep00-21swapper/021:12:130
8906993729,6cyclictest5991-21latency_hist20:31:541
8906993729,6cyclictest5991-21latency_hist20:31:541
8906993713,6cyclictest1-21systemd21:01:061
8899993732,3cyclictest23367-21idleruntime-cro19:51:530
8899993732,3cyclictest23367-21idleruntime-cro19:51:530
275372370,3sleep30-21swapper/320:02:063
275372370,3sleep30-21swapper/320:02:063
8906993628,6cyclictest29663-21gltestperf00:27:071
8906993628,6cyclictest29663-21gltestperf00:27:071
8906993627,7cyclictest19496-21processes22:32:141
8906993627,7cyclictest19496-21processes22:32:141
8906993614,2cyclictest0-21swapper/121:22:061
8906993614,2cyclictest0-21swapper/121:22:061
8899993627,7cyclictest29875-21latency_hist23:02:020
8899993627,7cyclictest29875-21latency_hist23:02:020
8899993627,7cyclictest29875-21latency_hist23:02:020
310222360,2sleep031024-21latency_hist00:31:560
310222360,2sleep031024-21latency_hist00:31:560
257222360,1sleep125908-21gltestperf00:17:071
257222360,1sleep125908-21gltestperf00:17:071
257222360,1sleep125908-21gltestperf00:17:071
253842360,4sleep30-21swapper/319:56:593
253842360,4sleep30-21swapper/319:56:593
8906993527,5cyclictest25783-21gltestperf19:57:071
8906993527,5cyclictest25783-21gltestperf19:57:071
8899993526,7cyclictest24791-21kernelversion22:47:110
8899993526,7cyclictest24791-21kernelversion22:47:110
8899993424,8cyclictest5374-21latency_hist21:56:530
8899993424,8cyclictest5374-21latency_hist21:56:530
243892340,3sleep20-21swapper/219:52:122
243892340,3sleep20-21swapper/219:52:122
197402340,3sleep019214-21/usr/sbin/munin21:07:080
197402340,3sleep019214-21/usr/sbin/munin21:07:080
8906993327,5cyclictest28765-21fschecks_count21:32:061
8906993327,5cyclictest28765-21fschecks_count21:32:061
8906993327,3cyclictest0-21swapper/120:21:531
8906993327,3cyclictest0-21swapper/120:21:531
8906993325,6cyclictest17506-21needreboot22:27:121
8906993325,6cyclictest17506-21needreboot22:27:121
8899993325,6cyclictest857-21fschecks_time00:37:040
8899993325,6cyclictest857-21fschecks_time00:37:040
8899993325,6cyclictest857-21fschecks_time00:37:040
83282330,2chrt8325-21ps22:02:140
83282330,2chrt8325-21ps22:02:140
83282330,2chrt8325-21ps22:02:140
8906993226,4cyclictest20338-21tail00:02:071
8906993226,4cyclictest20338-21tail00:02:071
8899993225,5cyclictest27655-21sshd22:55:060
8899993225,5cyclictest27655-21sshd22:55:060
8899993224,6cyclictest11399-21sshd20:44:520
8899993224,6cyclictest11399-21sshd20:44:520
889999321,13cyclictest169602ntp_states23:52:130
85832320,3sleep20-21swapper/222:02:162
85832320,3sleep20-21swapper/222:02:162
85832320,3sleep20-21swapper/222:02:162
237562320,3sleep20-21swapper/221:17:142
237562320,3sleep20-21swapper/221:17:142
237562320,3sleep20-21swapper/221:17:142
235972320,2sleep20-21swapper/222:42:172
235972320,2sleep20-21swapper/222:42:172
8906993122,7cyclictest18568-21kernelversion23:57:081
8906993122,7cyclictest18568-21kernelversion23:57:081
8906993122,7cyclictest18568-21kernelversion23:57:081
8899993126,4cyclictest13421-21cron20:51:530
8899993126,4cyclictest13421-21cron20:51:530
8906993023,5cyclictest8189-21tr22:02:121
8906993023,5cyclictest8189-21tr22:02:121
8906993023,5cyclictest8189-21tr22:02:121
8906993023,5cyclictest24593-21threads19:52:141
8906993023,5cyclictest24593-21threads19:52:141
211442300,4chrt0-21swapper/222:37:092
211442300,4chrt0-21swapper/222:37:092
211442300,4chrt0-21swapper/222:37:092
8906992924,3cyclictest0-21swapper/120:16:531
8906992923,4cyclictest9762-21latency_hist20:41:551
8906992923,4cyclictest9762-21latency_hist20:41:551
8899992924,3cyclictest8883-21cyclictest23:02:110
8899992924,3cyclictest8883-21cyclictest23:02:110
8899992923,4cyclictest550-21cron21:41:550
8899992923,4cyclictest550-21cron21:41:550
8899992923,4cyclictest550-21cron21:41:550
8899992923,4cyclictest14718-21latency_hist22:21:530
8899992923,4cyclictest14718-21latency_hist22:21:530
8899992922,5cyclictest17927-21latency_hist19:37:000
8899992921,6cyclictest7584-21sshd20:34:060
8899992921,6cyclictest7584-21sshd20:34:060
8899992921,6cyclictest15879-21head20:57:070
8899992916,10cyclictest14020-21cron19:26:530
8899992916,10cyclictest14020-21cron19:26:530
292482290,2sleep10-21swapper/120:07:031
292482290,2sleep10-21swapper/120:07:031
8906992823,3cyclictest8883-21cyclictest22:12:131
8906992823,3cyclictest8883-21cyclictest22:12:131
8906992821,5cyclictest3378-21fschecks_time23:17:071
8906992821,5cyclictest3378-21fschecks_time23:17:071
8906992821,5cyclictest2772-21gltestperf20:22:061
8906992821,5cyclictest2772-21gltestperf20:22:061
8906992821,5cyclictest13885-21fschecks_time20:52:061
8906992821,5cyclictest0-21swapper/123:01:531
8906992821,5cyclictest0-21swapper/123:01:531
8906992821,5cyclictest0-21swapper/123:01:531
8899992824,3cyclictest3337-21fschecks_time23:17:070
8899992824,3cyclictest3337-21fschecks_time23:17:070
8899992822,5cyclictest9243-21kernelversion23:32:070
8899992822,5cyclictest9243-21kernelversion23:32:070
8899992822,5cyclictest28744-21sshd20:04:030
8899992822,5cyclictest28744-21sshd20:04:030
8899992822,4cyclictest735-21systemd-logind00:12:140
8899992822,4cyclictest735-21systemd-logind00:12:140
8899992821,5cyclictest8883-21cyclictest22:24:060
8899992821,5cyclictest8883-21cyclictest22:24:060
8899992821,5cyclictest8883-21cyclictest22:24:060
8906992722,2cyclictest0-21swapper/123:56:531
8906992721,5cyclictest10597-21needreboot20:42:101
8906992721,5cyclictest10597-21needreboot20:42:101
8899992721,4cyclictest30267-21latency_hist21:36:530
8899992721,4cyclictest30267-21latency_hist21:36:530
8899992721,3cyclictest0-21swapper/019:27:130
8899992721,3cyclictest0-21swapper/019:27:130
8899992720,5cyclictest3859-21sshd20:24:050
8899992720,5cyclictest3859-21sshd20:24:050
8899992720,5cyclictest32657-21gltestperf21:42:070
8899992720,5cyclictest32657-21gltestperf21:42:070
8899992720,5cyclictest32657-21gltestperf21:42:070
8899992720,5cyclictest1032-21idleruntime-cro23:11:530
8899992720,5cyclictest1032-21idleruntime-cro23:11:530
8899992718,7cyclictest15028-21needreboot23:47:110
8899992718,7cyclictest15028-21needreboot23:47:110
8899992717,7cyclictest18940-21fschecks_time22:32:060
8899992717,7cyclictest18940-21fschecks_time22:32:060
8906992621,3cyclictest0-21swapper/119:36:531
8906992620,5cyclictest1761-21kernelversion23:12:081
8906992620,5cyclictest10394-21timerandwakeup22:07:151
8906992620,5cyclictest10394-21timerandwakeup22:07:151
8906992619,5cyclictest12904-21kernelversion19:22:081
8906992619,5cyclictest12904-21kernelversion19:22:081
8906992618,6cyclictest22843-21latency_hist21:16:551
8906992618,6cyclictest22843-21latency_hist21:16:551
8899992620,5cyclictest18421-21if_eth019:37:070
8899992620,5cyclictest18421-21if_eth019:37:070
8899992620,4cyclictest26541-21latency_hist21:26:530
8899992620,4cyclictest26541-21latency_hist21:26:530
8899992619,5cyclictest22760-21gltestperf22:42:070
8899992619,5cyclictest22760-21gltestperf22:42:070
305962260,3sleep30-21swapper/321:37:053
305962260,3sleep30-21swapper/321:37:053
305962260,3sleep30-21swapper/321:37:053
8906992520,3cyclictest8883-21cyclictest23:42:081
8906992520,3cyclictest8883-21cyclictest23:42:081
8906992520,3cyclictest0-21swapper/119:31:531
8906992520,3cyclictest0-21swapper/119:31:531
8906992519,4cyclictest749-21runrttasks20:47:071
8906992519,4cyclictest749-21runrttasks20:47:071
8906992519,4cyclictest0-21swapper/121:37:061
8906992519,4cyclictest0-21swapper/121:37:061
8906992519,4cyclictest0-21swapper/121:37:061
8906992519,3cyclictest0-21swapper/121:02:071
8906992519,3cyclictest0-21swapper/121:02:071
8906992519,3cyclictest0-21swapper/121:02:071
8906992518,5cyclictest5004-21/usr/sbin/munin23:22:081
8906992518,5cyclictest5004-21/usr/sbin/munin23:22:081
8906992518,5cyclictest5004-21/usr/sbin/munin23:22:081
8906992517,7cyclictest27809-21gltestperf00:22:091
8906992517,7cyclictest27809-21gltestperf00:22:091
8906992517,7cyclictest27809-21gltestperf00:22:091
8906992516,7cyclictest7885-21threads23:27:161
8906992516,7cyclictest7885-21threads23:27:161
8906992516,7cyclictest7885-21threads23:27:161
8906992516,6cyclictest0-21swapper/122:01:531
8906992516,6cyclictest0-21swapper/122:01:531
8899992520,3cyclictest10953-21grep23:37:070
8899992520,3cyclictest10953-21grep23:37:070
8899992519,5cyclictest1192-21needreboot20:17:110
8899992519,5cyclictest1192-21needreboot20:17:110
8899992518,5cyclictest24099-21timerwakeupswit21:17:180
8899992518,5cyclictest24099-21timerwakeupswit21:17:180
8899992518,5cyclictest24099-21timerwakeupswit21:17:180
8899992517,6cyclictest7549-21needreboot23:27:120
8899992517,6cyclictest7549-21needreboot23:27:120
8899992517,6cyclictest7549-21needreboot23:27:120
38252250,3sleep20-21swapper/221:52:032
38252250,3sleep20-21swapper/221:52:032
194242250,3sleep20-21swapper/221:07:052
8906992420,2cyclictest0-21swapper/122:21:531
8906992420,2cyclictest0-21swapper/122:21:531
8906992420,2cyclictest0-21swapper/100:32:141
8906992420,2cyclictest0-21swapper/100:32:141
8906992419,4cyclictest142-21systemd-journal21:54:061
8906992419,4cyclictest142-21systemd-journal21:54:061
8906992419,3cyclictest0-21swapper/120:32:061
8906992419,3cyclictest0-21swapper/120:32:061
8906992418,3cyclictest0-21swapper/123:07:061
8906992418,3cyclictest0-21swapper/123:07:061
8906992418,3cyclictest0-21swapper/123:02:061
8906992418,3cyclictest0-21swapper/123:02:061
8906992417,5cyclictest20455-21missed_timers19:42:081
8906992417,5cyclictest20455-21missed_timers19:42:081
8906992416,6cyclictest18832-21grep19:37:141
8906992416,6cyclictest18832-21grep19:37:141
8906992412,10cyclictest21149-21grep22:37:091
8906992412,10cyclictest21149-21grep22:37:091
8906992412,10cyclictest21149-21grep22:37:091
889999245,3cyclictest181rcu_preempt00:23:540
889999245,3cyclictest181rcu_preempt00:23:540
889999245,3cyclictest181rcu_preempt00:23:540
8899992419,3cyclictest0-21swapper/021:47:070
8899992419,3cyclictest0-21swapper/021:47:070
8899992419,3cyclictest0-21swapper/020:52:140
8899992418,3cyclictest0-21swapper/000:32:070
8899992418,3cyclictest0-21swapper/000:32:070
8899992417,5cyclictest7228-21latency_hist22:01:530
8899992417,5cyclictest7228-21latency_hist22:01:530
264352240,3sleep20-21swapper/200:17:152
264352240,3sleep20-21swapper/200:17:152
264352240,3sleep20-21swapper/200:17:152
8906992319,2cyclictest0-21swapper/121:17:061
8906992319,2cyclictest0-21swapper/121:17:061
8906992319,2cyclictest0-21swapper/121:17:061
8906992318,4cyclictest10415-21latency_hist23:36:531
8906992318,4cyclictest10415-21latency_hist23:36:531
8906992318,2cyclictest0-21swapper/123:37:051
8906992318,2cyclictest0-21swapper/123:37:051
8906992317,5cyclictest15618-21needreboot22:22:121
8906992317,5cyclictest15618-21needreboot22:22:121
8906992317,5cyclictest15618-21needreboot22:22:121
8906992316,5cyclictest8883-21cyclictest00:37:111
8906992316,5cyclictest8883-21cyclictest00:37:111
8906992316,5cyclictest8883-21cyclictest00:37:111
8906992315,5cyclictest0-21swapper/121:47:171
8906992315,5cyclictest0-21swapper/121:47:171
8899992319,2cyclictest0-21swapper/022:12:050
8899992319,2cyclictest0-21swapper/022:12:050
8906992218,2cyclictest0-21swapper/121:07:141
8906992218,2cyclictest0-21swapper/121:07:141
8906992217,3cyclictest0-21swapper/122:47:091
8906992217,3cyclictest0-21swapper/122:47:091
8906992217,3cyclictest0-21swapper/120:07:071
8906992216,4cyclictest0-21swapper/119:47:141
8906992216,4cyclictest0-21swapper/119:47:141
8906992210,10cyclictest27213-21/usr/sbin/munin21:27:081
8899992218,3cyclictest12856-21head23:42:080
8899992218,3cyclictest12856-21head23:42:080
8899992217,3cyclictest0-21swapper/020:27:090
8899992217,3cyclictest0-21swapper/020:27:090
8899992216,4cyclictest0-21swapper/022:37:090
8899992216,4cyclictest0-21swapper/022:37:090
8899992216,4cyclictest0-21swapper/022:37:090
8899992212,8cyclictest729-21dbus-daemon22:07:140
8899992212,8cyclictest729-21dbus-daemon22:07:140
890699218,5cyclictest181rcu_preempt23:47:071
890699218,5cyclictest181rcu_preempt23:47:071
8906992117,2cyclictest0-21swapper/122:56:531
8906992117,2cyclictest0-21swapper/122:56:531
8906992116,4cyclictest24931-21unixbench_singl00:12:171
8906992116,4cyclictest24931-21unixbench_singl00:12:171
8899992117,2cyclictest0-21swapper/021:27:150
8899992116,4cyclictest8883-21cyclictest22:31:370
8899992116,4cyclictest8883-21cyclictest22:31:370
8899992116,3cyclictest0-21swapper/020:07:120
8899992115,4cyclictest0-21swapper/023:12:060
8899992114,5cyclictest5173-21cut23:22:050
8899992114,5cyclictest5173-21cut23:22:050
8899992114,5cyclictest5173-21cut23:22:050
8906992015,3cyclictest0-21swapper/100:07:091
8899992016,2cyclictest0-21swapper/019:57:140
8899992016,2cyclictest0-21swapper/019:57:140
8899992015,3cyclictest0-21swapper/000:07:150
8909991913,3cyclictest102442chrt20:42:053
8909991913,3cyclictest102442chrt20:42:053
890999181,13cyclictest7265-21chrt22:01:533
890999181,13cyclictest7265-21chrt22:01:533
890999181,11cyclictest31641-21chrt00:32:073
890999181,11cyclictest31641-21chrt00:32:073
8908991811,4cyclictest24522sleep200:41:592
8908991811,4cyclictest24522sleep200:41:592
8908991811,4cyclictest24522sleep200:41:592
80282180,3sleep30-21swapper/322:02:093
80282180,3sleep30-21swapper/322:02:093
80282180,3sleep30-21swapper/322:02:093
890999171,13cyclictest16558-21chrt23:52:073
890999171,11cyclictest2930-21chrt20:22:073
890999171,11cyclictest2930-21chrt20:22:073
890999171,11cyclictest19963-21chrt19:42:043
890999171,11cyclictest19963-21chrt19:42:043
890899175,7cyclictest0-21swapper/222:20:232
890899175,7cyclictest0-21swapper/222:20:232
890899174,10cyclictest0-21swapper/223:42:202
890899174,10cyclictest0-21swapper/223:42:202
890899171,12cyclictest12374-21chrt23:41:572
890899171,12cyclictest12374-21chrt23:41:572
890899171,11cyclictest15507-21chrt20:57:042
890999161,9cyclictest0-21swapper/300:01:583
890999161,9cyclictest0-21swapper/300:01:583
890999161,9cyclictest0-21swapper/300:01:583
890999161,11cyclictest7202-21chrt23:27:073
890999161,11cyclictest7202-21chrt23:27:073
890999161,11cyclictest7202-21chrt23:27:073
890999161,11cyclictest4388-21chrt23:17:183
890999161,11cyclictest4388-21chrt23:17:183
890999161,11cyclictest26265-21taskset00:17:123
890999161,11cyclictest26265-21taskset00:17:123
890999161,11cyclictest26265-21taskset00:17:123
890999161,11cyclictest25730-21taskset19:57:073
890999161,11cyclictest25730-21taskset19:57:073
890999161,11cyclictest22896-21chrt00:07:153
890999161,11cyclictest17809-21chrt21:02:073
890999161,11cyclictest17809-21chrt21:02:073
890999161,11cyclictest17809-21chrt21:02:073
890999161,11cyclictest12666-21taskset19:22:063
890999161,11cyclictest12666-21taskset19:22:063
890999161,11cyclictest0-21swapper/323:42:073
890999161,11cyclictest0-21swapper/323:42:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional