You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 12:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Wed Jun 03, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2794321080,3sleep00-21swapper/022:57:540
175392830,2sleep017537-21perl21:02:570
175392830,2sleep017537-21perl21:02:570
175392830,2sleep017537-21perl21:02:570
198792730,3sleep30-21swapper/300:02:553
198792730,3sleep30-21swapper/300:02:553
287162690,10sleep0171ktimers/021:33:040
287162690,10sleep0171ktimers/021:33:040
287162690,10sleep0171ktimers/021:33:040
44222670,4chrt4423-21grep20:27:560
44222670,4chrt4423-21grep20:27:560
272972610,3chrt0-21swapper/221:28:002
272972610,3chrt0-21swapper/221:28:002
272972610,3chrt0-21swapper/221:28:002
121712530,2chrt12168-21timerwakeupswit22:13:051
121712530,2chrt12168-21timerwakeupswit22:13:051
121712530,2chrt12168-21timerwakeupswit22:13:051
154042490,2sleep10-21swapper/120:57:531
154042490,2sleep10-21swapper/120:57:531
64412470,3sleep00-21swapper/020:32:580
64412470,3sleep00-21swapper/020:32:580
302852450,3sleep30-21swapper/320:08:093
302852450,3sleep30-21swapper/320:08:093
113732450,3sleep00-21swapper/023:38:030
113732450,3sleep00-21swapper/023:38:030
113732450,3sleep00-21swapper/023:38:030
1260099431,17cyclictest19746-21cut00:02:471
1260099431,17cyclictest19746-21cut00:02:471
1260099431,17cyclictest19746-21cut00:02:471
12600994215,4cyclictest10964-21latency_hist22:12:491
12600994215,4cyclictest10964-21latency_hist22:12:491
12600994215,4cyclictest10964-21latency_hist22:12:491
308402400,1sleep00-21swapper/023:03:050
308402400,1sleep00-21swapper/023:03:050
308402400,1sleep00-21swapper/023:03:050
261242390,2sleep30-21swapper/300:18:033
261242390,2sleep30-21swapper/300:18:033
261242390,2sleep30-21swapper/300:18:033
197282390,2sleep119732-21ls19:42:501
197282390,2sleep119732-21ls19:42:501
197282390,2sleep119732-21ls19:42:501
12600993917,3cyclictest18809-21cut22:32:561
12600993917,3cyclictest18809-21cut22:32:561
12593993928,5cyclictest21337-21latency_hist19:47:420
12593993928,5cyclictest21337-21latency_hist19:47:420
12600993817,2cyclictest0-21swapper/119:57:561
12600993817,2cyclictest0-21swapper/119:57:561
140332370,3sleep20-21swapper/222:18:052
140332370,3sleep20-21swapper/222:18:052
12600993629,4cyclictest0-21swapper/100:02:551
12600993629,4cyclictest0-21swapper/100:02:551
12600993527,6cyclictest17765-21cron23:57:431
12593993529,4cyclictest572-21cups-browsed20:43:040
12593993529,4cyclictest572-21cups-browsed20:43:040
12593993426,6cyclictest17021-21latency_hist19:32:440
12593993426,6cyclictest17021-21latency_hist19:32:440
12593993426,6cyclictest17021-21latency_hist19:32:440
12593993419,9cyclictest12591-21cyclictest22:54:580
12593993326,5cyclictest18771-21fschecks_time22:32:560
12593993326,5cyclictest18771-21fschecks_time22:32:560
12593993326,5cyclictest18771-21fschecks_time22:32:560
1259399332,27cyclictest19998-21df_inode00:02:560
1259399332,27cyclictest19998-21df_inode00:02:560
1260299322,23cyclictest19782-21chrt00:02:492
1260299322,23cyclictest19782-21chrt00:02:492
1260299322,23cyclictest19782-21chrt00:02:492
12593993225,5cyclictest2782-21latency_hist23:17:450
12593993225,5cyclictest2782-21latency_hist23:17:450
12593993225,5cyclictest11344-21latency_hist22:12:560
1260399311,20cyclictest19797-21taskset00:02:503
1260399311,20cyclictest19797-21taskset00:02:503
1260399311,20cyclictest19797-21taskset00:02:503
12600993124,5cyclictest29960-21fschecks_count23:02:551
12593993125,5cyclictest10218-21threads22:08:060
12593993125,5cyclictest10218-21threads22:08:060
12593993124,5cyclictest26175-21netstat00:18:030
12593993124,5cyclictest26175-21netstat00:18:030
12593993124,5cyclictest26175-21netstat00:18:030
12593993123,6cyclictest2065-21latency_hist20:22:430
12593993123,6cyclictest18281-21timerwakeupswit19:33:010
12593993119,10cyclictest22763-21threads00:08:100
12593993119,10cyclictest22763-21threads00:08:100
12593993119,10cyclictest22763-21threads00:08:100
12593993025,3cyclictest20558-21fschecks_count22:37:550
12593993025,3cyclictest20558-21fschecks_count22:37:550
12593993025,3cyclictest20558-21fschecks_count22:37:550
12593993021,7cyclictest1440-21gltestperf23:12:560
12593993015,9cyclictest12591-21cyclictest23:59:260
12593993015,9cyclictest12591-21cyclictest23:59:260
12593993015,9cyclictest12591-21cyclictest23:59:260
12600992924,3cyclictest27685-21cron22:57:421
12600992924,3cyclictest27685-21cron22:57:421
12600992923,4cyclictest1346-21avahi-daemon23:43:031
12600992923,4cyclictest1346-21avahi-daemon23:43:031
12600992923,4cyclictest10790-21gltestperf23:37:551
12600992923,4cyclictest10790-21gltestperf23:37:551
12600992923,4cyclictest10790-21gltestperf23:37:551
12600992920,7cyclictest23004-21needreboot22:43:001
12600992920,7cyclictest23004-21needreboot22:43:001
12593992923,4cyclictest28459-21unixbench_singl20:03:060
12593992923,4cyclictest28459-21unixbench_singl20:03:060
12593992922,5cyclictest583-21sshd23:09:220
160542280,4sleep30-21swapper/320:57:583
160542280,4sleep30-21swapper/320:57:583
12600992824,2cyclictest0-21swapper/122:57:571
12600992822,4cyclictest24215-21proc_pri19:53:021
12600992822,4cyclictest24215-21proc_pri19:53:021
12600992821,5cyclictest6566-21latency20:32:591
12600992821,5cyclictest6566-21latency20:32:591
12600992820,6cyclictest638-21fschecks_count00:37:561
12600992820,6cyclictest638-21fschecks_count00:37:561
12600992819,7cyclictest31152-21fschecks_time20:12:551
12600992819,7cyclictest31152-21fschecks_time20:12:551
12593992823,3cyclictest0-21swapper/021:43:050
12593992822,5cyclictest25442-21unixbench_singl22:48:070
12593992822,5cyclictest25442-21unixbench_singl22:48:070
12593992822,5cyclictest12666-21threads20:48:060
12593992822,5cyclictest12666-21threads20:48:060
12593992822,4cyclictest0-21swapper/021:18:060
12593992821,5cyclictest9215-21wc22:07:540
12593992821,5cyclictest9215-21wc22:07:540
12593992821,5cyclictest22822-21kernelversion22:42:570
12593992821,5cyclictest22822-21kernelversion22:42:570
12600992723,3cyclictest23231-21gltestperf21:17:581
12600992722,3cyclictest22112-21sed22:42:431
12600992722,3cyclictest22112-21sed22:42:431
12600992722,3cyclictest0-21swapper/123:12:431
12600992722,3cyclictest0-21swapper/123:12:431
12600992720,5cyclictest4613-21latency_hist23:22:431
12600992720,5cyclictest4613-21latency_hist23:22:431
12600992718,7cyclictest30135-21cron21:37:451
12600992718,7cyclictest30135-21cron21:37:451
12600992718,7cyclictest30135-21cron21:37:451
12593992721,5cyclictest21146-21netstat22:38:000
12593992721,5cyclictest21146-21netstat22:38:000
12593992721,4cyclictest28196-21gltestperf22:57:570
12593992721,4cyclictest28196-21gltestperf22:57:570
12593992721,4cyclictest12591-21cyclictest22:00:560
12593992721,4cyclictest12591-21cyclictest22:00:560
12593992721,4cyclictest12591-21cyclictest22:00:560
12593992720,5cyclictest14789-21latency_hist22:22:540
12593992720,5cyclictest14789-21latency_hist22:22:540
12600992621,4cyclictest950-21unixbench-2d21:43:061
12600992621,3cyclictest20564-21cut22:37:551
12600992621,3cyclictest20564-21cut22:37:551
12600992621,3cyclictest20564-21cut22:37:551
12600992620,5cyclictest27378-21ntp_offset21:28:021
12600992620,5cyclictest27378-21ntp_offset21:28:021
12600992620,5cyclictest27378-21ntp_offset21:28:021
12600992619,4cyclictest0-21swapper/119:32:511
12600992619,4cyclictest0-21swapper/119:32:511
12600992619,4cyclictest0-21swapper/119:32:511
12600992617,7cyclictest23394-21cat00:12:421
12600992617,7cyclictest23394-21cat00:12:421
12600992617,7cyclictest23394-21cat00:12:421
12593992621,4cyclictest12591-21cyclictest21:27:510
12593992621,4cyclictest12591-21cyclictest21:27:510
12593992620,5cyclictest32367-21fschecks_count21:42:550
12593992620,5cyclictest31427-21kernelversion20:12:580
12593992620,5cyclictest31427-21kernelversion20:12:580
12593992620,5cyclictest24104-21kernelversion00:12:590
12593992620,5cyclictest24104-21kernelversion00:12:590
12593992619,6cyclictest25447-21fschecks_count19:57:560
12593992619,6cyclictest25447-21fschecks_count19:57:560
12593992617,7cyclictest16753-21latency_hist22:27:530
12593992617,7cyclictest16753-21latency_hist22:27:530
12593992617,7cyclictest16753-21latency_hist22:27:530
12593992617,7cyclictest16303-21grep20:58:020
12593992617,7cyclictest16303-21grep20:58:020
12600992521,2cyclictest0-21swapper/120:42:431
12600992520,3cyclictest0-21swapper/123:28:051
12600992520,3cyclictest0-21swapper/123:28:051
12600992520,3cyclictest0-21swapper/123:28:051
12600992520,3cyclictest0-21swapper/120:28:041
12600992520,3cyclictest0-21swapper/120:28:041
12600992519,4cyclictest30530-21ntp_offset23:03:011
12600992519,4cyclictest30530-21ntp_offset23:03:011
12600992519,4cyclictest30530-21ntp_offset23:03:011
12600992518,5cyclictest12591-21cyclictest19:47:561
12600992518,5cyclictest12591-21cyclictest19:47:561
12600992517,6cyclictest15038-21fschecks_time22:22:571
12600992517,6cyclictest15038-21fschecks_time22:22:571
12600992517,6cyclictest14941-21needreboot23:47:591
12600992517,6cyclictest14941-21needreboot23:47:591
12593992520,4cyclictest29775-21latency00:27:590
12593992520,4cyclictest29775-21latency00:27:590
12593992519,5cyclictest8959-21gltestperf23:32:570
12593992519,5cyclictest8959-21gltestperf23:32:570
12593992519,4cyclictest14603-21sed23:47:550
12593992519,4cyclictest0-21swapper/023:53:050
12593992518,5cyclictest8741-21wc20:38:040
12593992517,6cyclictest27753-21sort21:28:060
12593992517,6cyclictest27753-21sort21:28:060
12593992517,6cyclictest27753-21sort21:28:060
81942240,2sleep20-21swapper/222:03:052
81942240,2sleep20-21swapper/222:03:052
81942240,2sleep20-21swapper/222:03:052
12600992420,2cyclictest0-21swapper/121:07:561
12600992420,2cyclictest0-21swapper/121:07:561
12600992420,2cyclictest0-21swapper/121:07:561
12600992419,3cyclictest0-21swapper/122:48:041
12600992419,3cyclictest0-21swapper/122:48:041
12600992418,4cyclictest0-21swapper/123:32:561
12600992418,4cyclictest0-21swapper/123:32:561
12600992417,5cyclictest0-21swapper/122:27:531
12600992417,5cyclictest0-21swapper/122:27:531
12600992417,5cyclictest0-21swapper/122:27:531
12600992416,6cyclictest29553-21date00:27:571
12600992416,6cyclictest29553-21date00:27:571
12593992420,3cyclictest12591-21cyclictest23:27:560
12593992420,3cyclictest12591-21cyclictest23:27:560
12593992420,3cyclictest12591-21cyclictest23:27:560
12593992419,4cyclictest20229-21timerwakeupswit21:08:060
12593992419,4cyclictest20229-21timerwakeupswit21:08:060
12593992419,4cyclictest20229-21timerwakeupswit21:08:060
12593992419,3cyclictest21353-21gltestperf21:12:570
12593992419,3cyclictest21353-21gltestperf21:12:570
12593992419,3cyclictest21353-21gltestperf21:12:570
12593992418,5cyclictest27862-21kernelversion00:23:000
12593992418,5cyclictest27862-21kernelversion00:23:000
12593992418,4cyclictest0-21swapper/023:48:050
12593992418,4cyclictest0-21swapper/023:48:050
12593992418,3cyclictest0-21swapper/022:17:550
12593992418,3cyclictest0-21swapper/022:17:550
12593992418,3cyclictest0-21swapper/022:17:550
12593992418,3cyclictest0-21swapper/021:47:570
12593992418,3cyclictest0-21swapper/021:47:570
12593992418,3cyclictest0-21swapper/020:08:080
12593992418,3cyclictest0-21swapper/020:08:080
12593992418,3cyclictest0-21swapper/019:48:050
12593992418,3cyclictest0-21swapper/019:48:050
12593992418,3cyclictest0-21swapper/000:33:050
12593992418,3cyclictest0-21swapper/000:33:050
12593992416,6cyclictest31286-21cut21:38:030
248522230,3sleep30-21swapper/300:13:073
248522230,3sleep30-21swapper/300:13:073
12602992319,3cyclictest351rcuc/220:54:082
12602992319,3cyclictest351rcuc/220:54:082
12602992318,3cyclictest351rcuc/221:27:282
12602992318,3cyclictest351rcuc/221:27:282
12600992319,2cyclictest0-21swapper/100:17:591
12600992319,2cyclictest0-21swapper/100:17:591
12600992319,2cyclictest0-21swapper/100:17:591
12600992318,3cyclictest0-21swapper/122:28:051
12600992318,2cyclictest0-21swapper/120:52:561
12600992318,2cyclictest0-21swapper/120:52:561
12600992317,4cyclictest0-21swapper/121:48:061
12600992317,4cyclictest0-21swapper/121:48:061
12600992317,4cyclictest0-21swapper/100:23:041
12600992317,4cyclictest0-21swapper/100:23:041
12600992316,5cyclictest28166-21sort20:03:051
12600992316,5cyclictest28166-21sort20:03:051
12600992316,5cyclictest21396-21gltestperf21:12:571
12600992316,5cyclictest21396-21gltestperf21:12:571
12600992316,5cyclictest21396-21gltestperf21:12:571
12600992315,5cyclictest11011-21head20:43:061
12600992315,5cyclictest11011-21head20:43:061
12593992319,2cyclictest0-21swapper/023:17:540
12593992319,2cyclictest0-21swapper/023:17:540
12593992318,3cyclictest0-21swapper/020:23:000
12593992318,3cyclictest0-21swapper/020:23:000
12593992318,3cyclictest0-21swapper/000:38:050
12593992318,3cyclictest0-21swapper/000:38:050
12593992317,5cyclictest5203-21gltestperf23:22:570
12593992317,5cyclictest5203-21gltestperf23:22:570
12593992317,5cyclictest5203-21gltestperf23:22:570
12593992317,4cyclictest0-21swapper/023:42:560
12593992317,4cyclictest0-21swapper/021:52:590
12593992317,4cyclictest0-21swapper/021:52:590
12593992316,4cyclictest0-21swapper/022:02:590
33832220,3sleep30-21swapper/323:17:553
33832220,3sleep30-21swapper/323:17:553
12603992218,3cyclictest431rcuc/322:08:543
12603992218,3cyclictest431rcuc/322:08:543
12603992218,3cyclictest431rcuc/322:08:543
12603992217,3cyclictest431rcuc/322:04:083
12603992217,3cyclictest431rcuc/322:04:083
12603992217,3cyclictest431rcuc/322:04:083
12602992216,4cyclictest351rcuc/219:29:162
12602992216,4cyclictest351rcuc/219:29:162
12602992216,4cyclictest351rcuc/219:29:162
12600992217,4cyclictest749-21runrttasks00:33:041
12600992217,4cyclictest749-21runrttasks00:33:041
12600992217,3cyclictest0-21swapper/100:13:021
12600992217,3cyclictest0-21swapper/100:13:021
12600992217,2cyclictest0-21swapper/121:53:021
12600992217,2cyclictest0-21swapper/121:53:021
12600992216,4cyclictest0-21swapper/121:02:581
12600992216,4cyclictest0-21swapper/121:02:581
12600992216,4cyclictest0-21swapper/121:02:581
12600992216,4cyclictest0-21swapper/120:22:461
12600992215,5cyclictest20859-21unixbench_multi19:43:011
12600992215,5cyclictest20859-21unixbench_multi19:43:011
12600992214,6cyclictest30728-21awk20:12:431
12600992214,6cyclictest30728-21awk20:12:431
12600992214,5cyclictest0-21swapper/120:22:561
12600992214,5cyclictest0-21swapper/120:22:561
12600992213,7cyclictest31653-21sshd21:38:191
12600992213,7cyclictest31653-21sshd21:38:191
12600992213,7cyclictest18727-21sshd19:36:161
12593992216,5cyclictest23909-21kernelversion19:52:570
12593992216,5cyclictest23909-21kernelversion19:52:570
12593992215,4cyclictest0-21swapper/020:52:560
12593992215,4cyclictest0-21swapper/020:52:560
12603992117,3cyclictest431rcuc/322:43:273
12603992117,3cyclictest431rcuc/322:43:273
12602992116,4cyclictest351rcuc/223:26:242
12602992116,4cyclictest351rcuc/223:26:242
12602992116,4cyclictest351rcuc/223:26:242
12602992115,4cyclictest351rcuc/220:49:402
12602992115,4cyclictest351rcuc/220:49:402
12600992117,2cyclictest0-21swapper/122:07:541
12600992117,2cyclictest0-21swapper/122:07:541
12600992117,2cyclictest0-21swapper/122:02:431
12600992117,2cyclictest0-21swapper/122:02:431
12600992117,2cyclictest0-21swapper/122:02:431
12600992116,3cyclictest0-21swapper/120:48:041
12600992116,3cyclictest0-21swapper/120:48:041
12600992115,4cyclictest0-21swapper/123:23:041
12600992115,4cyclictest0-21swapper/123:23:041
12600992115,4cyclictest0-21swapper/123:23:041
12593992116,3cyclictest0-21swapper/019:27:420
12593992116,3cyclictest0-21swapper/019:27:420
103062210,3sleep20-21swapper/223:37:442
103062210,3sleep20-21swapper/223:37:442
12603992016,3cyclictest431rcuc/323:17:203
12603992016,3cyclictest431rcuc/323:17:203
12603992016,3cyclictest431rcuc/319:44:583
12603992016,3cyclictest431rcuc/319:44:583
12602992016,3cyclictest351rcuc/222:49:492
12602992016,3cyclictest351rcuc/222:49:492
12602992016,3cyclictest351rcuc/220:42:462
12602992015,4cyclictest351rcuc/221:18:392
12602992015,3cyclictest351rcuc/220:26:502
12602992015,3cyclictest351rcuc/220:26:502
12602992015,3cyclictest351rcuc/219:36:322
12602992015,3cyclictest351rcuc/200:05:512
12602992015,3cyclictest351rcuc/200:05:512
12600992014,4cyclictest1812-21ntp_kernel_pll_23:13:021
12600992014,4cyclictest1812-21ntp_kernel_pll_23:13:021
12600992014,4cyclictest0-21swapper/119:23:021
12600992014,4cyclictest0-21swapper/119:23:021
12600992012,6cyclictest26410-21cron21:27:421
12600992012,6cyclictest26410-21cron21:27:421
12600992012,5cyclictest7517-21cut22:02:561
1259399201,17cyclictest19643-21/usr/sbin/munin19:42:500
1259399201,17cyclictest19643-21/usr/sbin/munin19:42:500
1259399201,17cyclictest19643-21/usr/sbin/munin19:42:500
87002190,4sleep30-21swapper/323:32:553
1260399191,14cyclictest26980-21chrt21:27:573
1260399191,14cyclictest26980-21chrt21:27:573
1260399191,14cyclictest26980-21chrt21:27:573
12602991915,3cyclictest351rcuc/223:17:232
12602991915,3cyclictest351rcuc/223:17:232
12602991915,3cyclictest351rcuc/223:00:182
12602991915,3cyclictest351rcuc/223:00:182
12602991915,3cyclictest351rcuc/222:15:322
12602991915,3cyclictest351rcuc/222:15:322
12602991915,3cyclictest351rcuc/222:15:322
12602991914,4cyclictest351rcuc/221:17:232
12602991914,4cyclictest351rcuc/221:17:232
12602991914,4cyclictest351rcuc/221:17:232
12602991914,3cyclictest351rcuc/223:43:472
12602991914,3cyclictest351rcuc/223:43:472
12602991914,3cyclictest351rcuc/221:55:552
12602991914,3cyclictest351rcuc/221:55:552
12602991914,3cyclictest351rcuc/221:39:132
12602991914,3cyclictest351rcuc/221:39:132
12602991914,3cyclictest351rcuc/219:50:552
12602991914,3cyclictest351rcuc/219:50:552
12602991913,4cyclictest351rcuc/222:09:202
12602991913,4cyclictest351rcuc/222:09:202
12602991913,4cyclictest351rcuc/222:09:202
12602991913,4cyclictest351rcuc/200:42:412
12602991913,4cyclictest351rcuc/200:42:412
12602991913,4cyclictest235162chrt22:43:052
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional