You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 21:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Mon Jun 29, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1789521160,3sleep20-21swapper/211:53:222
1789521160,3sleep20-21swapper/211:53:222
680321130,2sleep00-21swapper/009:58:190
641421110,2sleep30-21swapper/309:58:103
641421110,2sleep30-21swapper/309:58:103
296432960,3sleep30-21swapper/310:58:243
296432960,3sleep30-21swapper/310:58:243
296432960,3sleep30-21swapper/310:58:243
279602900,3sleep30-21swapper/309:28:193
88282870,3sleep30-21swapper/311:28:273
88282870,3sleep30-21swapper/311:28:273
88282870,3sleep30-21swapper/311:28:273
145942790,2chrt0-21swapper/210:18:232
145942790,2chrt0-21swapper/210:18:232
145942790,2chrt0-21swapper/210:18:232
183422760,2chrt0-21swapper/309:03:153
183422760,2chrt0-21swapper/309:03:153
269552730,4chrt0-21swapper/309:23:293
269552730,4chrt0-21swapper/309:23:293
153162670,2sleep00-21swapper/011:48:140
153162670,2sleep00-21swapper/011:48:140
153162670,2sleep00-21swapper/011:48:140
14932660,2chrt1496-21cpuspeed08:18:180
14932660,2chrt1496-21cpuspeed08:18:180
14932660,2chrt1496-21cpuspeed08:18:180
243092620,3chrt0-21swapper/310:43:293
243092620,3chrt0-21swapper/310:43:293
243092620,3chrt0-21swapper/310:43:293
303642600,3chrt0-21swapper/009:33:270
303642600,3chrt0-21swapper/009:33:270
161162540,1chrt0-21swapper/011:48:260
161162540,1chrt0-21swapper/011:48:260
161162540,1chrt0-21swapper/011:48:260
173432510,2sleep20-21swapper/207:33:212
173432510,2sleep20-21swapper/207:33:212
161722510,2sleep20-21swapper/210:23:222
161722510,2sleep20-21swapper/210:23:222
161722510,2sleep20-21swapper/210:23:222
139782490,2sleep20-21swapper/208:48:312
139782490,2sleep20-21swapper/208:48:312
9778994523,20cyclictest1346-21avahi-daemon12:39:570
9778994523,20cyclictest1346-21avahi-daemon12:39:570
9778994523,20cyclictest1346-21avahi-daemon12:39:570
9778994418,3cyclictest0-21swapper/010:53:300
9778994418,3cyclictest0-21swapper/010:53:300
9778994418,3cyclictest0-21swapper/010:53:300
9778994416,5cyclictest3536-21sshd11:13:470
9778994416,5cyclictest3536-21sshd11:13:470
9778994416,5cyclictest15718-21timerandwakeup08:53:280
9778994416,5cyclictest15718-21timerandwakeup08:53:280
121202440,2chrt12122-21latency_hist10:13:150
121202440,2chrt12122-21latency_hist10:13:150
86502430,3sleep20-21swapper/210:03:202
32682430,3sleep20-21swapper/208:23:142
32682430,3sleep20-21swapper/208:23:142
32682430,3sleep20-21swapper/208:23:142
69552420,3sleep30-21swapper/311:23:293
69552420,3sleep30-21swapper/311:23:293
211352420,3sleep20-21swapper/209:08:292
211352420,3sleep20-21swapper/209:08:292
269752410,1sleep00-21swapper/012:18:210
269752410,1sleep00-21swapper/012:18:210
9778994016,4cyclictest0-21swapper/012:28:290
9778994016,4cyclictest0-21swapper/012:28:290
9778994016,4cyclictest0-21swapper/012:28:290
9778994016,4cyclictest0-21swapper/012:28:290
9780993928,3cyclictest181rcu_preempt11:35:351
9780993928,3cyclictest181rcu_preempt11:35:351
9780993928,3cyclictest181rcu_preempt11:35:351
9780993829,2cyclictest181rcu_preempt10:08:031
9780993829,2cyclictest181rcu_preempt10:08:031
9780993829,2cyclictest181rcu_preempt10:08:031
59972380,3sleep20-21swapper/208:28:252
59972380,3sleep20-21swapper/208:28:252
59972380,3sleep20-21swapper/208:28:252
45132380,3sleep30-21swapper/311:18:223
45132380,3sleep30-21swapper/311:18:223
45132380,3sleep30-21swapper/311:18:223
159092370,2sleep116037-21missed_timers11:48:241
159092370,2sleep116037-21missed_timers11:48:241
159092370,2sleep116037-21missed_timers11:48:241
9780993630,4cyclictest18190-21wc09:03:071
9780993630,4cyclictest18190-21wc09:03:071
240102360,3sleep30-21swapper/309:18:193
240102360,3sleep30-21swapper/309:18:193
222512360,3sleep20-21swapper/210:38:252
222512360,3sleep20-21swapper/210:38:252
222512360,3sleep20-21swapper/210:38:252
9778993529,4cyclictest18227-21timerwakeupswit07:33:310
9778993529,4cyclictest18227-21timerwakeupswit07:33:310
9778993525,8cyclictest17970-21netstat11:53:240
9778993525,8cyclictest17970-21netstat11:53:240
269382350,4sleep20-21swapper/207:58:222
269382350,4sleep20-21swapper/207:58:222
212292350,2sleep30-21swapper/309:08:293
212292350,2sleep30-21swapper/309:08:293
9780993428,4cyclictest18536-21needreboot10:28:251
9780993428,4cyclictest18536-21needreboot10:28:251
9780993428,4cyclictest18536-21needreboot10:28:251
9780993426,6cyclictest28473-21fschecks_count08:03:181
9780993426,6cyclictest28473-21fschecks_count08:03:181
9778993427,5cyclictest20529-21processes10:33:270
9778993427,5cyclictest20529-21processes10:33:270
9778993425,7cyclictest1199-21fschecks_time09:43:180
9778993425,7cyclictest1199-21fschecks_time09:43:180
9778993425,7cyclictest1199-21fschecks_time09:43:180
90922340,3chrt11374-21kworker/u9:3+xprtiod08:38:200
90922340,3chrt11374-21kworker/u9:3+xprtiod08:38:200
262122340,3sleep00-21swapper/010:48:280
262122340,3sleep00-21swapper/010:48:280
262122340,3sleep00-21swapper/010:48:280
245722340,1sleep124730-21users10:43:321
245722340,1sleep124730-21users10:43:321
245722340,1sleep124730-21users10:43:321
9778993326,5cyclictest21193-21gltestperf07:43:210
9778993326,5cyclictest21193-21gltestperf07:43:210
71842330,2sleep0171ktimers/008:33:170
71842330,2sleep0171ktimers/008:33:170
71842330,2sleep0171ktimers/008:33:170
221092330,3sleep00-21swapper/010:38:240
221092330,3sleep00-21swapper/010:38:240
221092330,3sleep00-21swapper/010:38:240
9780993227,3cyclictest702-21latency_hist09:43:061
9780993227,3cyclictest702-21latency_hist09:43:061
9780993226,4cyclictest27934-21ntp_states10:53:271
9780993226,4cyclictest27934-21ntp_states10:53:271
9780993226,4cyclictest27934-21ntp_states10:53:271
9780993219,3cyclictest181rcu_preempt07:38:331
9780993219,3cyclictest181rcu_preempt07:38:331
9778993225,4cyclictest0-21swapper/008:38:300
9778993225,4cyclictest0-21swapper/008:38:300
9778993225,4cyclictest0-21swapper/008:38:300
9778993221,4cyclictest0-21swapper/011:28:190
9780993125,5cyclictest31988-21cron12:33:071
9780993125,5cyclictest31988-21cron12:33:071
9780993125,5cyclictest31988-21cron12:33:071
9780993125,5cyclictest31988-21cron12:33:071
9780993125,4cyclictest1909-21latency_hist08:18:211
9780993125,4cyclictest1909-21latency_hist08:18:211
9780993125,4cyclictest1909-21latency_hist08:18:211
9778993123,6cyclictest12933-21sshd11:38:470
9778993123,6cyclictest12933-21sshd11:38:470
9778993123,6cyclictest12933-21sshd11:38:470
978099309,10cyclictest29-21ksoftirqd/109:46:441
978099309,10cyclictest29-21ksoftirqd/109:46:441
978099309,10cyclictest29-21ksoftirqd/109:46:441
9780993021,7cyclictest15746-21kernelversion07:28:191
9780993021,7cyclictest15746-21kernelversion07:28:191
9780993016,2cyclictest181rcu_preempt08:08:281
9780993016,2cyclictest181rcu_preempt08:08:281
9780993016,2cyclictest181rcu_preempt08:08:281
9778993024,5cyclictest27154-21netstat07:58:240
9778993024,5cyclictest27154-21netstat07:58:240
9778993023,5cyclictest25230-21latency_hist10:48:140
9778993023,5cyclictest25230-21latency_hist10:48:140
9778993023,5cyclictest25230-21latency_hist10:48:140
9778993022,6cyclictest19575-21unixbench-2d09:03:280
9778993022,6cyclictest19575-21unixbench-2d09:03:280
9778993022,6cyclictest19575-21unixbench-2d09:03:280
9778993021,7cyclictest13611-21cut07:23:200
9778993021,7cyclictest13611-21cut07:23:200
9778993021,7cyclictest13611-21cut07:23:200
37332300,3sleep30-21swapper/312:43:203
37332300,3sleep30-21swapper/312:43:203
37332300,3sleep30-21swapper/312:43:203
312272300,3sleep20-21swapper/212:28:282
312272300,3sleep20-21swapper/212:28:282
312272300,3sleep20-21swapper/212:28:282
312272300,3sleep20-21swapper/212:28:282
978099295,3cyclictest271rcuc/107:36:291
978099295,3cyclictest271rcuc/107:36:291
9780992924,4cyclictest20791-21idleruntime-cro12:03:061
9780992924,4cyclictest20791-21idleruntime-cro12:03:061
9780992922,5cyclictest1381-21threads11:08:301
9780992922,5cyclictest1381-21threads11:08:301
9780992920,7cyclictest8145-21latency_hist11:28:191
9780992920,7cyclictest6133-21latency_hist11:23:191
9780992920,7cyclictest6133-21latency_hist11:23:191
9780992919,2cyclictest181rcu_preempt08:24:441
9780992919,2cyclictest181rcu_preempt08:24:441
9780992919,2cyclictest181rcu_preempt08:24:441
9778992922,5cyclictest32391-21sshd11:05:470
9778992922,5cyclictest32391-21sshd11:05:470
9778992916,11cyclictest0-21swapper/009:28:190
978099286,3cyclictest271rcuc/112:04:361
978099286,3cyclictest271rcuc/112:04:361
978099286,3cyclictest271rcuc/112:04:361
978099285,4cyclictest281ktimers/110:00:191
978099285,4cyclictest281ktimers/110:00:191
9780992822,5cyclictest14338-21sshd08:51:461
9780992822,5cyclictest14338-21sshd08:51:461
9780992822,4cyclictest749-21runrttasks08:43:161
9780992822,4cyclictest749-21runrttasks08:43:161
9780992822,4cyclictest749-21runrttasks08:43:161
9780992821,5cyclictest550-21cron09:18:191
9780992821,5cyclictest550-21cron09:18:191
9780992821,5cyclictest22034-21latency_hist09:13:121
9780992821,5cyclictest22034-21latency_hist09:13:121
9780992821,5cyclictest17825-21latency11:53:221
9780992821,5cyclictest17825-21latency11:53:221
9780992821,4cyclictest0-21swapper/110:23:071
9780992821,4cyclictest0-21swapper/110:23:071
9780992821,4cyclictest0-21swapper/110:23:071
9780992819,7cyclictest470-21fschecks_count11:08:201
9780992817,2cyclictest181rcu_preempt11:30:471
9780992817,2cyclictest181rcu_preempt11:30:471
9780992817,2cyclictest181rcu_preempt11:30:471
9778992824,3cyclictest5205-21kernelversion09:53:220
9778992823,3cyclictest0-21swapper/012:08:070
9778992823,3cyclictest0-21swapper/012:08:070
9778992823,3cyclictest0-21swapper/012:08:070
9778992821,5cyclictest27224-21sshd09:23:560
9778992821,5cyclictest27224-21sshd09:23:560
9780992722,3cyclictest90-1pr/ttyS012:38:311
9780992722,3cyclictest90-1pr/ttyS012:38:311
9780992722,3cyclictest90-1pr/ttyS012:38:311
9780992721,5cyclictest90-1pr/ttyS010:41:341
9780992721,5cyclictest90-1pr/ttyS010:41:341
9780992721,5cyclictest90-1pr/ttyS010:41:341
9780992715,2cyclictest181rcu_preempt08:18:261
9780992715,2cyclictest181rcu_preempt08:18:261
9780992715,2cyclictest181rcu_preempt08:18:261
9780992714,2cyclictest181rcu_preempt07:48:141
9780992714,2cyclictest181rcu_preempt07:48:141
9780992713,2cyclictest181rcu_preempt09:58:191
9778992723,2cyclictest0-21swapper/008:28:190
9778992723,2cyclictest0-21swapper/008:28:190
9778992723,2cyclictest0-21swapper/008:28:190
9778992722,3cyclictest7225-21needreboot09:58:240
9778992722,3cyclictest7225-21needreboot09:58:240
9778992722,3cyclictest0-21swapper/009:38:270
9778992722,3cyclictest0-21swapper/009:38:270
9778992721,4cyclictest32621-21cat08:13:220
9778992721,4cyclictest1648-21ntpd07:56:190
9778992721,4cyclictest1648-21ntpd07:56:190
9778992721,4cyclictest1648-21ntpd07:56:190
9778992721,4cyclictest0-21swapper/012:38:220
9778992721,4cyclictest0-21swapper/012:38:220
9778992721,4cyclictest0-21swapper/012:38:220
9778992720,5cyclictest19425-21gltestperf11:58:210
9778992720,5cyclictest19425-21gltestperf11:58:210
9778992718,7cyclictest8731-21gunzip11:28:260
9778992718,7cyclictest8731-21gunzip11:28:260
9778992718,7cyclictest8731-21gunzip11:28:260
978099268,8cyclictest29-21ksoftirqd/108:56:361
978099268,8cyclictest29-21ksoftirqd/108:56:361
9780992623,2cyclictest90-1pr/ttyS009:15:021
9780992623,2cyclictest90-1pr/ttyS009:15:021
9780992621,3cyclictest90-1pr/ttyS011:15:351
9780992621,3cyclictest90-1pr/ttyS011:15:351
9780992621,3cyclictest90-1pr/ttyS010:08:261
9780992621,3cyclictest90-1pr/ttyS010:08:261
9780992620,5cyclictest12717-21kernelversion10:13:221
9780992620,5cyclictest12717-21kernelversion10:13:221
9780992619,2cyclictest181rcu_preempt08:43:281
9780992619,2cyclictest181rcu_preempt08:43:281
9780992617,3cyclictest181rcu_preempt11:18:271
9780992614,7cyclictest749-21runrttasks10:24:171
9780992614,7cyclictest749-21runrttasks10:24:171
9780992614,7cyclictest749-21runrttasks10:24:171
9780992614,4cyclictest181rcu_preempt07:27:071
9780992614,4cyclictest181rcu_preempt07:27:071
9780992614,4cyclictest181rcu_preempt07:27:071
9780992614,2cyclictest181rcu_preempt10:48:261
9780992614,2cyclictest181rcu_preempt10:48:261
9780992614,2cyclictest181rcu_preempt10:48:261
9780992613,2cyclictest181rcu_preempt12:23:291
9780992613,2cyclictest181rcu_preempt12:23:291
9780992613,2cyclictest181rcu_preempt12:23:291
9780992612,2cyclictest181rcu_preempt10:58:271
9780992612,2cyclictest181rcu_preempt10:58:271
9780992612,2cyclictest181rcu_preempt10:58:271
9778992621,3cyclictest0-21swapper/012:18:190
9778992620,5cyclictest4594-21kernelversion11:18:230
9778992620,5cyclictest4594-21kernelversion11:18:230
9778992620,5cyclictest4594-21kernelversion11:18:230
9778992620,5cyclictest14830-21fschecks_count08:53:180
9778992620,5cyclictest14830-21fschecks_count08:53:180
9778992620,4cyclictest18183-21gltestperf10:28:210
9778992620,4cyclictest18183-21gltestperf10:28:210
9778992620,4cyclictest18183-21gltestperf10:28:210
9778992620,3cyclictest0-21swapper/011:38:210
9778992620,3cyclictest0-21swapper/008:43:270
9778992620,3cyclictest0-21swapper/008:43:270
9778992619,5cyclictest856-21kernelversion11:08:220
9778992619,5cyclictest856-21kernelversion11:08:220
9778992619,5cyclictest3341-21latency09:48:210
9778992619,5cyclictest3341-21latency09:48:210
9778992619,5cyclictest3341-21latency09:48:210
978099259,3cyclictest181rcu_preempt08:33:171
978099259,3cyclictest181rcu_preempt08:33:171
978099259,3cyclictest181rcu_preempt08:33:171
978099256,10cyclictest29-21ksoftirqd/111:43:471
978099256,10cyclictest29-21ksoftirqd/111:43:471
978099256,10cyclictest29-21ksoftirqd/111:43:471
978099252,5cyclictest271rcuc/111:39:481
978099252,5cyclictest271rcuc/111:39:481
978099252,5cyclictest271rcuc/111:39:481
9780992520,4cyclictest19090-21needreboot09:03:231
9780992520,4cyclictest19090-21needreboot09:03:231
9780992520,4cyclictest19090-21needreboot09:03:231
9780992516,2cyclictest181rcu_preempt12:13:161
9780992516,2cyclictest181rcu_preempt12:13:161
9780992516,2cyclictest181rcu_preempt12:13:161
9780992516,2cyclictest181rcu_preempt10:38:131
9780992516,2cyclictest181rcu_preempt10:38:131
9780992516,2cyclictest181rcu_preempt09:33:281
9780992516,2cyclictest181rcu_preempt09:33:281
9780992513,2cyclictest181rcu_preempt09:58:181
9780992512,2cyclictest181rcu_preempt09:48:261
9780992512,2cyclictest181rcu_preempt09:48:261
9780992512,2cyclictest181rcu_preempt09:48:261
9780992511,6cyclictest0-21swapper/112:18:121
9780992511,6cyclictest0-21swapper/112:18:121
9780992511,2cyclictest181rcu_preempt11:28:191
9780992511,2cyclictest181rcu_preempt07:58:201
9780992511,2cyclictest181rcu_preempt07:58:201
9778992520,3cyclictest0-21swapper/010:13:280
9778992520,3cyclictest0-21swapper/010:13:280
9778992519,4cyclictest24389-21latency_hist07:53:070
9778992519,4cyclictest24389-21latency_hist07:53:070
9778992518,5cyclictest25252-21unixbench_singl09:18:310
9778992518,5cyclictest25252-21unixbench_singl09:18:310
9778992518,5cyclictest11414-21latency_hist11:38:210
9778992517,6cyclictest15815-21ls07:28:200
9778992517,6cyclictest15815-21ls07:28:200
9778992516,7cyclictest7683-21latency_hist11:28:070
235242250,3sleep20-21swapper/207:48:252
235242250,3sleep20-21swapper/207:48:252
978099248,6cyclictest29-21ksoftirqd/107:56:131
978099248,6cyclictest29-21ksoftirqd/107:56:131
978099248,6cyclictest29-21ksoftirqd/107:56:131
978099246,3cyclictest281ktimers/111:03:231
978099244,4cyclictest271rcuc/108:34:201
978099244,4cyclictest271rcuc/108:34:201
978099243,4cyclictest281ktimers/112:37:171
978099243,4cyclictest281ktimers/112:37:171
978099243,4cyclictest281ktimers/112:37:171
9780992420,3cyclictest29792-21kworker/u9:0-nfsiod09:24:211
9780992420,3cyclictest29792-21kworker/u9:0-nfsiod09:24:211
9780992420,3cyclictest29792-21kworker/u9:0-nfsiod09:24:211
9780992412,3cyclictest181rcu_preempt07:49:101
9780992412,3cyclictest181rcu_preempt07:49:101
9780992412,2cyclictest181rcu_preempt09:32:411
9780992412,2cyclictest181rcu_preempt09:32:411
9778992420,2cyclictest0-21swapper/010:20:460
9778992420,2cyclictest0-21swapper/010:20:460
9778992420,2cyclictest0-21swapper/010:20:460
9778992418,4cyclictest0-21swapper/009:28:280
9778992418,4cyclictest0-21swapper/009:28:280
9778992418,4cyclictest0-21swapper/008:58:290
9778992418,4cyclictest0-21swapper/008:58:290
9778992418,3cyclictest0-21swapper/010:03:300
9778992418,3cyclictest0-21swapper/010:03:300
9778992418,3cyclictest0-21swapper/010:03:300
9780992318,3cyclictest26933-21gltestperf12:18:211
9780992318,3cyclictest26933-21gltestperf12:18:211
9778992319,2cyclictest0-21swapper/010:58:270
9778992319,2cyclictest0-21swapper/010:58:270
9778992319,2cyclictest0-21swapper/010:58:270
9778992318,3cyclictest0-21swapper/012:23:290
9778992318,3cyclictest0-21swapper/012:23:290
9778992318,3cyclictest0-21swapper/012:23:290
9778992318,3cyclictest0-21swapper/007:38:280
9778992318,3cyclictest0-21swapper/007:38:280
9778992317,4cyclictest749-21runrttasks08:08:220
9778992317,4cyclictest749-21runrttasks08:08:220
9778992316,5cyclictest2206-21ntp_kernel_err08:18:250
9778992316,5cyclictest2206-21ntp_kernel_err08:18:250
9778992316,5cyclictest2206-21ntp_kernel_err08:18:250
977899222,3cyclictest0-21swapper/010:24:330
977899222,3cyclictest0-21swapper/010:24:330
977899222,3cyclictest0-21swapper/010:24:330
9778992217,3cyclictest0-21swapper/009:13:210
9778992217,3cyclictest0-21swapper/009:13:210
9778992216,4cyclictest0-21swapper/009:08:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional