You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 01:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sat Jun 13, 2026 00:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2009221420,3chrt0-21swapper/020:53:100
2009221420,3chrt0-21swapper/020:53:100
2009221420,3chrt0-21swapper/020:53:100
2561321190,2chrt25485-40mandb00:03:010
2561321190,2chrt25485-40mandb00:03:010
2561321190,2chrt25485-40mandb00:03:010
2561321190,2chrt25485-40mandb00:03:010
269972980,3sleep30-21swapper/300:03:493
269972980,3sleep30-21swapper/300:03:493
269512840,1chrt25485-40mandb00:03:221
269512840,1chrt25485-40mandb00:03:221
300652820,3chrt0-21swapper/300:13:093
300652820,3chrt0-21swapper/300:13:093
300652820,3chrt0-21swapper/300:13:093
246732730,3sleep30-21swapper/322:33:033
246732730,3sleep30-21swapper/322:33:033
204342720,3sleep30-21swapper/323:48:053
204342720,3sleep30-21swapper/323:48:053
148222640,3chrt0-21swapper/223:33:042
225492610,3sleep30-21swapper/323:53:073
225492610,3sleep30-21swapper/323:53:073
284292570,3chrt0-21swapper/322:43:043
284292570,3chrt0-21swapper/322:43:043
284292570,3chrt0-21swapper/322:43:043
180792570,2sleep20-21swapper/223:42:572
180792570,2sleep20-21swapper/223:42:572
26702560,2sleep12668-21latency_hist00:28:031
26702560,2sleep12668-21latency_hist00:28:031
131362540,3chrt0-21swapper/323:28:073
131362540,3chrt0-21swapper/323:28:073
277822530,2sleep1181rcu_preempt00:08:091
277822530,2sleep1181rcu_preempt00:08:091
277822530,2sleep1181rcu_preempt00:08:091
14705995223,10cyclictest20854-21taskset20:56:521
14705995223,10cyclictest20854-21taskset20:56:521
14705995223,10cyclictest20854-21taskset20:56:521
275172510,2sleep20-21swapper/221:13:102
275172510,2sleep20-21swapper/221:13:102
14705995124,10cyclictest0-21swapper/100:13:581
14705995124,10cyclictest0-21swapper/100:13:581
14705995124,10cyclictest0-21swapper/100:13:581
319282490,4sleep131923-21gzip00:18:101
14705994939,4cyclictest0-21swapper/100:02:581
14705994939,4cyclictest0-21swapper/100:02:581
14705994939,4cyclictest0-21swapper/100:02:581
14705994939,4cyclictest0-21swapper/100:02:581
14705994923,8cyclictest3461-21cron21:37:521
14705994923,8cyclictest3461-21cron21:37:521
14705994923,8cyclictest3461-21cron21:37:521
14705994923,10cyclictest23060-21taskset19:33:431
14705994923,10cyclictest23060-21taskset19:33:431
14705994923,10cyclictest23060-21taskset19:33:431
14705994922,9cyclictest19036-21taskset20:52:261
14705994922,9cyclictest19036-21taskset20:52:261
14705994922,10cyclictest7655-21taskset20:21:111
14705994922,10cyclictest7655-21taskset20:21:111
14705994920,11cyclictest5768-21seq20:15:561
14705994920,11cyclictest5768-21seq20:15:561
14705994920,11cyclictest5768-21seq20:15:561
14705994823,9cyclictest26893-21seq19:44:521
14705994823,9cyclictest26893-21seq19:44:521
14705994822,15cyclictest10749-21seq21:54:131
14705994822,15cyclictest10749-21seq21:54:131
14705994822,15cyclictest10749-21seq21:54:131
14705994820,13cyclictest17743-21chrt23:40:111
14705994820,13cyclictest17743-21chrt23:40:111
14705994819,13cyclictest29404-21taskset22:43:211
14705994819,13cyclictest29404-21taskset22:43:211
14705994819,13cyclictest29404-21taskset22:43:211
61952470,4chrt6198-21unixbench-2d23:08:151
61952470,4chrt6198-21unixbench-2d23:08:151
14705994721,10cyclictest25739-21taskset22:34:211
14705994721,10cyclictest25739-21taskset22:34:211
14705994721,10cyclictest22918-21wc21:02:561
14705994721,10cyclictest22918-21wc21:02:561
14705994719,11cyclictest24071-21taskset22:31:541
14705994719,11cyclictest24071-21taskset22:31:541
14705994718,12cyclictest14135-21taskset23:31:461
14705994718,12cyclictest14135-21taskset23:31:461
130262470,3chrt0-21swapper/223:28:062
130262470,3chrt0-21swapper/223:28:062
244652460,3sleep30-21swapper/323:58:103
244652460,3sleep30-21swapper/323:58:103
244652460,3sleep30-21swapper/323:58:103
244652460,3sleep30-21swapper/323:58:103
14705994622,7cyclictest19732-21seq23:46:331
14705994622,7cyclictest19732-21seq23:46:331
14705994620,11cyclictest28817-21taskset19:50:411
14705994620,11cyclictest28817-21taskset19:50:411
14705994620,11cyclictest19507-21taskset19:25:551
14705994619,12cyclictest11377-21chrt20:30:281
14705994619,12cyclictest11377-21chrt20:30:281
14705994618,13cyclictest30651-21taskset19:55:181
14705994618,13cyclictest30651-21taskset19:55:181
14705994618,11cyclictest22465-21latency_hist22:28:021
14705994618,11cyclictest22465-21latency_hist22:28:021
14705994521,9cyclictest31368-21taskset22:49:411
14705994521,9cyclictest31368-21taskset22:49:411
14705994521,9cyclictest31368-21taskset22:49:411
14705994521,8cyclictest14929-21taskset22:07:581
14705994521,8cyclictest14929-21taskset22:07:581
14705994521,8cyclictest14929-21taskset22:07:581
14705994521,10cyclictest20049-21taskset22:18:241
14705994521,10cyclictest20049-21taskset22:18:241
14705994521,10cyclictest10192-21taskset23:19:401
14705994521,10cyclictest10192-21taskset23:19:401
14705994521,10cyclictest10192-21taskset23:19:401
14705994520,9cyclictest12189-21seq23:26:031
14705994520,9cyclictest12189-21seq23:26:031
14705994520,11cyclictest5955-21taskset00:35:521
14705994520,11cyclictest5955-21taskset00:35:521
14705994520,11cyclictest3905-21taskset20:11:161
14705994520,11cyclictest3905-21taskset20:11:161
14705994519,8cyclictest23458-21chrt23:56:351
14705994519,8cyclictest23458-21chrt23:56:351
14705994519,12cyclictest12524-21users21:58:171
14705994519,12cyclictest12524-21users21:58:171
14705994519,11cyclictest8938-21taskset21:50:111
14705994519,11cyclictest8938-21taskset21:50:111
14705994519,11cyclictest8938-21taskset21:50:111
14705994519,11cyclictest8390-21chrt23:15:471
14705994519,11cyclictest8390-21chrt23:15:471
14705994519,11cyclictest8390-21chrt23:15:471
14705994519,11cyclictest30428-21latency_hist21:22:591
14705994519,11cyclictest30428-21latency_hist21:22:591
14705994519,11cyclictest30428-21latency_hist21:22:591
14705994516,12cyclictest32383-21runrttasks19:58:391
14705994516,12cyclictest32383-21runrttasks19:58:391
136292450,3sleep20-21swapper/220:38:012
136292450,3sleep20-21swapper/220:38:012
14705994420,13cyclictest16437-21seq22:09:491
14705994420,13cyclictest16437-21seq22:09:491
14705994420,13cyclictest16437-21seq22:09:491
14705994419,11cyclictest853-21seq22:55:241
14705994419,11cyclictest853-21seq22:55:241
14705994419,11cyclictest853-21seq22:55:241
14705994419,11cyclictest4062-21taskset00:30:481
14705994419,11cyclictest4062-21taskset00:30:481
14705994419,11cyclictest4062-21taskset00:30:481
14705994419,10cyclictest27692-21taskset22:40:321
14705994419,10cyclictest27692-21taskset22:40:321
14705994418,9cyclictest4611-21taskset23:05:211
14705994418,9cyclictest4611-21taskset23:05:211
14705994418,9cyclictest4611-21taskset23:05:211
14705994418,9cyclictest32036-21taskset21:26:161
14705994418,9cyclictest32036-21taskset21:26:161
14705994418,9cyclictest32036-21taskset21:26:161
14705994418,9cyclictest1493-21chrt21:31:351
14705994418,9cyclictest1493-21chrt21:31:351
14705994418,9cyclictest1493-21chrt21:31:351
14705994418,11cyclictest28126-21chrt21:14:141
14705994418,11cyclictest28126-21chrt21:14:141
14705994418,10cyclictest2819-21runrttasks23:01:351
14705994418,10cyclictest2819-21runrttasks23:01:351
14705994418,10cyclictest2819-21runrttasks23:01:351
14705994417,11cyclictest9528-21chrt20:25:381
14705994417,11cyclictest9528-21chrt20:25:381
14705994417,11cyclictest25027-21taskset19:40:061
14705994417,11cyclictest25027-21taskset19:40:061
134812440,3sleep30-21swapper/320:37:543
134812440,3sleep30-21swapper/320:37:543
199812430,1sleep019971-21unixbench_singl22:18:130
199812430,1sleep019971-21unixbench_singl22:18:130
14705994319,8cyclictest18576-21basename22:17:541
14705994319,8cyclictest18576-21basename22:17:541
14705994319,8cyclictest18576-21basename22:17:541
14705994319,10cyclictest749-21runrttasks21:43:521
14705994319,10cyclictest749-21runrttasks21:43:521
14705994318,8cyclictest26200-21chrt21:08:311
14705994318,8cyclictest26200-21chrt21:08:311
14705994318,12cyclictest21659-21chrt23:52:251
14705994318,12cyclictest21659-21chrt23:52:251
14705994318,12cyclictest21659-21chrt23:52:251
14705994318,11cyclictest13268-21taskset20:35:531
14705994318,11cyclictest13268-21taskset20:35:531
14705994315,12cyclictest21361-21seq19:30:491
14705994315,12cyclictest21361-21seq19:30:491
242702420,4chrt0-21swapper/319:38:083
242702420,4chrt0-21swapper/319:38:083
14705994232,7cyclictest700-21192.168.115.40-manager21:38:531
14705994232,7cyclictest700-21192.168.115.40-manager21:38:531
14705994232,7cyclictest700-21192.168.115.40-manager21:38:531
14705994217,10cyclictest7000-21needreboot00:38:071
14705994217,10cyclictest7000-21needreboot00:38:071
14705994217,10cyclictest7000-21needreboot00:38:071
1470499423,34cyclictest26125-21cat00:03:100
1470499423,34cyclictest26125-21cat00:03:100
301252410,3sleep030128-21ntp_kernel_pll_00:13:100
301252410,3sleep030128-21ntp_kernel_pll_00:13:100
301252410,3sleep030128-21ntp_kernel_pll_00:13:100
14705994129,10cyclictest16580-21threads20:43:131
14705994129,10cyclictest16580-21threads20:43:131
14705994129,10cyclictest16580-21threads20:43:131
14705994117,7cyclictest0-21swapper/120:41:481
14705994117,7cyclictest0-21swapper/120:41:481
14705994116,12cyclictest1922-21taskset20:04:391
14705994116,12cyclictest1922-21taskset20:04:391
14705994116,11cyclictest24574-21chrt21:06:341
14705994116,11cyclictest24574-21chrt21:06:341
14705994116,11cyclictest24574-21chrt21:06:341
213352400,2chrt21336-21fschecks_count20:58:050
213352400,2chrt21336-21fschecks_count20:58:050
1470799401,29cyclictest25583-21chrt00:02:592
1470799401,29cyclictest25583-21chrt00:02:592
1470799401,29cyclictest25583-21chrt00:02:592
1470799401,29cyclictest25583-21chrt00:02:592
14705993932,5cyclictest700-21192.168.115.40-manager23:35:571
204492380,4sleep30-21swapper/319:28:073
204492380,4sleep30-21swapper/319:28:073
114602370,2sleep30-21swapper/321:58:063
114602370,2sleep30-21swapper/321:58:063
110292370,3sleep20-21swapper/220:28:122
110292370,3sleep20-21swapper/220:28:122
14704993628,6cyclictest550-21cron20:47:520
14704993628,6cyclictest550-21cron20:47:520
14704993628,6cyclictest550-21cron20:47:520
292682340,4sleep029271-21grep22:43:130
292682340,4sleep029271-21grep22:43:130
292682340,4sleep029271-21grep22:43:130
207302340,2sleep30-21swapper/323:48:093
207302340,2sleep30-21swapper/323:48:093
207302340,2sleep30-21swapper/323:48:093
14704993427,5cyclictest2934-21latency_hist23:02:520
14704993427,5cyclictest2934-21latency_hist23:02:520
14704993427,5cyclictest2934-21latency_hist23:02:520
87502330,2sleep30-21swapper/323:18:023
87502330,2sleep30-21swapper/323:18:023
87502330,2sleep30-21swapper/323:18:023
320842330,2sleep30-21swapper/319:58:153
320842330,2sleep30-21swapper/319:58:153
133472330,3sleep20-21swapper/222:03:032
133472330,3sleep20-21swapper/222:03:032
133472330,3sleep20-21swapper/222:03:032
6862310,3sleep00-21swapper/021:28:080
6862310,3sleep00-21swapper/021:28:080
6862310,3sleep00-21swapper/021:28:080
56462310,4sleep20-21swapper/223:08:082
56462310,4sleep20-21swapper/223:08:082
42932310,3sleep00-21swapper/020:13:030
42932310,3sleep00-21swapper/020:13:030
14704993123,6cyclictest1098-21latency_hist22:57:540
14704993123,6cyclictest1098-21latency_hist22:57:540
14704993123,6cyclictest1098-21latency_hist22:57:540
86092300,3sleep30-21swapper/321:48:133
86092300,3sleep30-21swapper/321:48:133
86092300,3sleep30-21swapper/321:48:133
319502300,4sleep20-21swapper/219:58:132
319502300,4sleep20-21swapper/219:58:132
258362300,2sleep025946-21timerandwakeup21:08:150
258362300,2sleep025946-21timerandwakeup21:08:150
14704993025,4cyclictest9165-21gltestperf23:18:040
14704993023,5cyclictest24702-21idleruntime22:33:030
14704993023,5cyclictest24702-21idleruntime22:33:030
14704993023,5cyclictest24552-21sshd21:06:170
14704993023,5cyclictest24552-21sshd21:06:170
14704993023,5cyclictest24552-21sshd21:06:170
14704993022,6cyclictest11706-21threads23:23:130
14704993022,6cyclictest11706-21threads23:23:130
14704992924,3cyclictest90-1pr/ttyS023:54:570
14704992924,3cyclictest90-1pr/ttyS023:54:570
14704992924,3cyclictest22474-21tr19:33:090
14704992924,3cyclictest22474-21tr19:33:090
14704992924,3cyclictest22474-21tr19:33:090
14704992922,5cyclictest6848-21unixbench_singl21:43:160
14704992922,5cyclictest6848-21unixbench_singl21:43:160
14704992922,5cyclictest20691-21processes19:28:120
14704992922,5cyclictest20691-21processes19:28:120
14704992922,5cyclictest19166-21unixbench-2d19:23:130
14704992922,5cyclictest14702-21cyclictest23:15:060
14704992922,5cyclictest14702-21cyclictest23:15:060
177152280,4sleep00-21swapper/020:48:040
177152280,4sleep00-21swapper/020:48:040
14704992823,4cyclictest14678-21systemd-journal20:04:160
14704992823,4cyclictest14678-21systemd-journal20:04:160
14704992821,5cyclictest31936-21needreboot00:18:100
14704992820,6cyclictest18455-21fschecks_time23:43:050
14704992820,6cyclictest18455-21fschecks_time23:43:050
320112270,3sleep30-21swapper/300:18:123
206032270,3sleep30-21swapper/322:23:023
206032270,3sleep30-21swapper/322:23:023
14704992719,6cyclictest14702-21cyclictest22:07:550
14704992719,6cyclictest14702-21cyclictest22:07:550
14704992719,6cyclictest14702-21cyclictest22:07:550
14704992718,7cyclictest6697-21latency20:18:060
14704992718,7cyclictest6697-21latency20:18:060
14704992622,2cyclictest0-21swapper/023:13:060
14704992620,5cyclictest10659-21ntp_offset20:28:080
14704992620,5cyclictest10659-21ntp_offset20:28:080
14704992619,5cyclictest31714-21latency_hist22:52:570
14704992619,5cyclictest31714-21latency_hist22:52:570
14704992619,5cyclictest31714-21latency_hist22:52:570
14704992618,6cyclictest3290-21netstat00:28:090
14704992618,6cyclictest3290-21netstat00:28:090
14704992618,6cyclictest3290-21netstat00:28:090
14704992618,6cyclictest25584-21sort19:43:010
14704992618,6cyclictest25584-21sort19:43:010
14704992617,7cyclictest16287-21unixbench_singl22:08:140
14704992617,7cyclictest16287-21unixbench_singl22:08:140
14704992617,7cyclictest16287-21unixbench_singl22:08:140
282092250,3sleep20-21swapper/200:08:142
282092250,3sleep20-21swapper/200:08:142
282092250,3sleep20-21swapper/200:08:142
239312250,3chrt23934-21tr19:38:050
239312250,3chrt23934-21tr19:38:050
14704992520,3cyclictest90-1pr/ttyS021:37:530
14704992520,3cyclictest90-1pr/ttyS021:37:530
14704992520,3cyclictest90-1pr/ttyS021:37:530
14704992520,3cyclictest0-21swapper/021:52:510
14704992520,3cyclictest0-21swapper/021:52:510
14704992520,3cyclictest0-21swapper/021:52:510
14704992518,5cyclictest28411-21latency_hist21:18:030
14704992518,5cyclictest28411-21latency_hist21:18:030
14704992419,3cyclictest0-21swapper/021:23:060
14704992419,3cyclictest0-21swapper/021:23:060
14704992419,3cyclictest0-21swapper/021:23:060
14704992419,3cyclictest0-21swapper/020:33:140
14704992419,3cyclictest0-21swapper/020:33:140
14704992418,3cyclictest0-21swapper/000:23:050
14704992418,3cyclictest0-21swapper/000:23:050
14704992417,5cyclictest30984-21latency_hist19:57:590
14704992417,5cyclictest30984-21latency_hist19:57:590
14704992417,5cyclictest15349-21latency_hist20:42:520
14704992417,5cyclictest15349-21latency_hist20:42:520
14704992416,5cyclictest25090-21ntp_kernel_pll_22:33:090
14704992416,5cyclictest25090-21ntp_kernel_pll_22:33:090
14704992412,10cyclictest5751-21fschecks_count21:43:040
14704992411,12cyclictest25568-21kworker/u10:0-rpciod21:18:060
14704992411,12cyclictest25568-21kworker/u10:0-rpciod21:18:060
14704992411,12cyclictest25568-21kworker/u10:0-rpciod21:18:060
14704992319,2cyclictest0-21swapper/023:18:120
14704992319,2cyclictest0-21swapper/023:18:120
14704992319,2cyclictest0-21swapper/023:18:120
14704992319,2cyclictest0-21swapper/021:43:030
14704992318,3cyclictest5386-21awk00:33:130
14704992318,3cyclictest5386-21awk00:33:130
14704992316,5cyclictest0-21swapper/000:38:130
14704992316,5cyclictest0-21swapper/000:38:130
14704992316,5cyclictest0-21swapper/000:38:130
14704992314,7cyclictest22641-21fschecks_count22:28:040
14704992312,9cyclictest15744-21kworker/u9:0+rpciod20:17:520
14704992312,9cyclictest15744-21kworker/u9:0+rpciod20:17:520
14704992312,9cyclictest15744-21kworker/u9:0+rpciod20:17:520
14707992217,3cyclictest351rcuc/220:14:132
14707992217,3cyclictest351rcuc/220:14:132
14707992217,3cyclictest351rcuc/220:14:132
14704992218,2cyclictest0-21swapper/023:38:130
14704992218,2cyclictest0-21swapper/023:38:130
14704992217,3cyclictest0-21swapper/023:52:520
14704992217,3cyclictest0-21swapper/023:52:520
14704992217,3cyclictest0-21swapper/023:52:520
14704992217,3cyclictest0-21swapper/023:28:050
14704992217,3cyclictest0-21swapper/023:28:050
14704992217,3cyclictest0-21swapper/022:13:080
14704992217,3cyclictest0-21swapper/022:13:080
14704992217,3cyclictest0-21swapper/022:13:080
14704992217,3cyclictest0-21swapper/019:58:080
14704992217,3cyclictest0-21swapper/019:58:080
14704992216,4cyclictest0-21swapper/023:08:140
14704992214,6cyclictest22319-21latency_hist22:27:530
14707992117,3cyclictest351rcuc/219:31:162
14707992117,3cyclictest351rcuc/219:31:162
1470499217,12cyclictest14678-21systemd-journal21:42:520
14704992117,2cyclictest0-21swapper/023:03:130
14704992117,2cyclictest0-21swapper/023:03:130
14704992117,2cyclictest0-21swapper/023:03:130
14704992117,2cyclictest0-21swapper/022:38:110
14704992117,2cyclictest0-21swapper/022:38:110
14704992117,2cyclictest0-21swapper/019:48:050
14704992117,2cyclictest0-21swapper/019:48:050
14704992116,3cyclictest11543-21gltestperf21:58:070
14704992116,3cyclictest11543-21gltestperf21:58:070
14704992116,3cyclictest0-21swapper/020:23:050
14704992116,3cyclictest0-21swapper/020:23:050
14704992116,3cyclictest0-21swapper/000:12:520
14704992116,3cyclictest0-21swapper/000:12:520
14704992116,3cyclictest0-21swapper/000:12:520
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional