You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 21:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Wed Jun 24, 2026 12:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1348221310,3sleep30-21swapper/310:58:163
937521240,4sleep2351rcuc/212:13:202
937521240,4sleep2351rcuc/212:13:202
937521240,4sleep2351rcuc/212:13:202
1178221220,2sleep20-21swapper/210:53:202
1178221220,2sleep20-21swapper/210:53:202
41712990,2chrt4177-21cpu09:08:140
41712990,2chrt4177-21cpu09:08:140
41712990,2chrt4177-21cpu09:08:140
104652910,2sleep110462-21cut07:58:121
104652910,2sleep110462-21cut07:58:121
197312890,2chrt0-21swapper/312:43:043
197312890,2chrt0-21swapper/312:43:043
44082870,2sleep20-21swapper/209:08:162
44082870,2sleep20-21swapper/209:08:162
44082870,2sleep20-21swapper/209:08:162
97162830,3sleep30-21swapper/309:23:083
97162830,3sleep30-21swapper/309:23:083
97162830,3sleep30-21swapper/309:23:083
243272820,4sleep30-21swapper/310:00:113
243272820,4sleep30-21swapper/310:00:113
243272820,4sleep30-21swapper/310:00:113
243272820,4sleep30-21swapper/310:00:113
94572780,3sleep20-21swapper/207:53:222
94572780,3sleep20-21swapper/207:53:222
56592770,2sleep15660-21grep07:43:241
56592770,2sleep15660-21grep07:43:241
45552690,3chrt0-21swapper/309:08:173
45552690,3chrt0-21swapper/309:08:173
45552690,3chrt0-21swapper/309:08:173
212712610,3chrt0-21swapper/309:53:153
212712610,3chrt0-21swapper/309:53:153
287062600,3chrt0-21swapper/211:38:232
287062600,3chrt0-21swapper/211:38:232
101992600,4sleep00-21swapper/010:48:240
101992600,4sleep00-21swapper/010:48:240
101992600,4sleep00-21swapper/010:48:240
198732540,3chrt0-21swapper/211:13:262
198732540,3chrt0-21swapper/211:13:262
198732540,3chrt0-21swapper/211:13:262
214102520,3sleep20-21swapper/211:18:252
214102520,3sleep20-21swapper/211:18:252
214102520,3sleep20-21swapper/211:18:252
214102520,3sleep20-21swapper/211:18:252
110912520,2chrt0-21swapper/307:58:183
251572510,3chrt0-21swapper/210:03:152
265672500,3chrt0-21swapper/211:33:162
265672500,3chrt0-21swapper/211:33:162
18122480,3chrt0-21swapper/007:33:220
18122480,3chrt0-21swapper/007:33:220
311252450,3chrt0-21swapper/008:53:140
28272410,3sleep30-21swapper/307:38:123
28272410,3sleep30-21swapper/307:38:123
99812380,1sleep190-1pr/ttyS010:48:211
99812380,1sleep190-1pr/ttyS010:48:211
99812380,1sleep190-1pr/ttyS010:48:211
296172380,3sleep30-21swapper/311:43:023
296172380,3sleep30-21swapper/311:43:023
26117993832,3cyclictest201rcuc/010:47:130
26117993832,3cyclictest201rcuc/010:47:130
26117993832,3cyclictest201rcuc/010:47:130
239522380,2chrt0-21swapper/209:58:252
239522380,2chrt0-21swapper/209:58:252
239522380,2chrt0-21swapper/209:58:252
185442380,3sleep20-21swapper/212:38:162
185442380,3sleep20-21swapper/212:38:162
26117993732,3cyclictest10813-21tail12:18:140
26117993732,3cyclictest10813-21tail12:18:140
26117993732,3cyclictest10813-21tail12:18:140
26117993715,8cyclictest16-21ksoftirqd/008:53:250
26117993715,8cyclictest16-21ksoftirqd/008:53:250
159312370,4sleep20-21swapper/211:03:252
159312370,4sleep20-21swapper/211:03:252
159312370,4sleep20-21swapper/211:03:252
146662370,3sleep30-21swapper/311:03:023
146662370,3sleep30-21swapper/311:03:023
307602360,2sleep20-21swapper/207:23:232
307602360,2sleep20-21swapper/207:23:232
26125993629,5cyclictest30594-21mailstats07:23:221
26125993629,5cyclictest30594-21mailstats07:23:221
26125993629,5cyclictest22431-21processes08:28:241
26125993629,5cyclictest22431-21processes08:28:241
26125993629,5cyclictest22431-21processes08:28:241
235682360,2sleep023579-21strings09:58:200
235682360,2sleep023579-21strings09:58:200
235682360,2sleep023579-21strings09:58:200
235682360,2sleep023579-21strings09:58:200
308212350,2chrt30824-21sed08:53:060
26117993530,4cyclictest31909-21cut07:28:150
26117993530,4cyclictest31909-21cut07:28:150
26117993529,4cyclictest26103-21cyclictest12:04:450
26117993529,4cyclictest26103-21cyclictest12:04:450
26117993528,5cyclictest19387-21fschecks_time09:48:150
26117993528,5cyclictest19387-21fschecks_time09:48:150
26117993528,5cyclictest15110-21cut11:03:160
26117993527,4cyclictest181rcu_preempt09:55:390
26117993527,4cyclictest181rcu_preempt09:55:390
84372340,2sleep18455-21sed12:13:041
84372340,2sleep18455-21sed12:13:041
84372340,2sleep18455-21sed12:13:041
26125993426,6cyclictest31131-21fschecks_count08:53:141
26117993429,4cyclictest4492-21latency_hist07:43:030
26117993429,4cyclictest4492-21latency_hist07:43:030
26117993427,5cyclictest6980-21fschecks_time12:08:170
26117993427,5cyclictest6980-21fschecks_time12:08:170
26117993427,5cyclictest6980-21fschecks_time12:08:170
26117993424,3cyclictest181rcu_preempt12:34:310
26117993424,3cyclictest181rcu_preempt12:34:310
26117993412,5cyclictest201rcuc/011:55:300
26117993412,5cyclictest201rcuc/011:55:300
26117993412,5cyclictest201rcuc/011:55:300
26117993411,6cyclictest201rcuc/008:19:240
26117993411,6cyclictest201rcuc/008:19:240
26117993411,6cyclictest201rcuc/008:19:240
29472330,3chrt0-21swapper/209:03:172
29472330,3chrt0-21swapper/209:03:172
26117993319,4cyclictest26103-21cyclictest09:23:030
26117993319,4cyclictest26103-21cyclictest09:23:030
26117993319,4cyclictest26103-21cyclictest09:23:030
26117993313,4cyclictest201rcuc/010:39:130
26117993313,4cyclictest201rcuc/010:39:130
170642330,3sleep30-21swapper/312:33:233
170642330,3sleep30-21swapper/312:33:233
122782330,3sleep00-21swapper/012:23:070
122782330,3sleep00-21swapper/012:23:070
122782330,3sleep00-21swapper/012:23:070
26125993223,7cyclictest6345-21gltestperf09:13:151
26117993224,6cyclictest27373-21fschecks_count08:43:140
26117993224,6cyclictest27373-21fschecks_count08:43:140
26117993224,6cyclictest27373-21fschecks_count08:43:140
26117993222,3cyclictest181rcu_preempt09:38:270
26117993222,3cyclictest181rcu_preempt09:38:270
26117993213,11cyclictest90-1pr/ttyS011:44:340
26117993213,11cyclictest90-1pr/ttyS011:44:340
26117993213,11cyclictest90-1pr/ttyS011:44:340
144102320,2sleep014543-21fschecks_time12:28:140
26125993124,5cyclictest30038-21cut11:43:151
26125993124,5cyclictest30038-21cut11:43:151
26125993124,5cyclictest30038-21cut11:43:151
26117993126,3cyclictest0-21swapper/011:23:030
26117993126,3cyclictest0-21swapper/011:23:030
26117993126,3cyclictest0-21swapper/011:23:030
26117993126,3cyclictest0-21swapper/011:23:030
26117993125,4cyclictest572-21cups-browsed12:23:230
26117993125,4cyclictest572-21cups-browsed12:23:230
26117993125,4cyclictest26103-21cyclictest10:27:330
26117993125,4cyclictest26103-21cyclictest10:27:330
26117993124,5cyclictest26103-21cyclictest11:40:460
26117993124,5cyclictest26103-21cyclictest11:40:460
26125993024,4cyclictest12346-21latency_hist12:23:131
26125993024,4cyclictest12346-21latency_hist12:23:131
26125993024,4cyclictest12346-21latency_hist12:23:131
26125993023,5cyclictest26103-21cyclictest10:08:021
26125993023,5cyclictest26103-21cyclictest10:08:021
2611799308,9cyclictest16-21ksoftirqd/007:57:530
2611799308,9cyclictest16-21ksoftirqd/007:57:530
2611799306,6cyclictest171ktimers/009:28:220
2611799306,6cyclictest171ktimers/009:28:220
26117993025,3cyclictest21853-21fschecks_time08:28:160
26117993025,3cyclictest21853-21fschecks_time08:28:160
26117993025,3cyclictest21853-21fschecks_time08:28:160
26117993023,5cyclictest26103-21cyclictest10:55:520
26117993023,5cyclictest26103-21cyclictest10:55:520
26117993023,5cyclictest24493-21threads08:33:230
26117993023,5cyclictest24493-21threads08:33:230
26117993023,5cyclictest24493-21threads08:33:230
26117993019,4cyclictest90-1pr/ttyS010:18:030
26117993019,4cyclictest90-1pr/ttyS010:18:030
26117993019,4cyclictest90-1pr/ttyS010:18:030
76302290,2sleep20-21swapper/210:43:152
2612599291,6cyclictest700-21192.168.115.40-manager10:13:571
2612599291,6cyclictest700-21192.168.115.40-manager10:13:571
2612599291,6cyclictest700-21192.168.115.40-manager10:13:571
2611799299,5cyclictest16-21ksoftirqd/007:50:540
2611799299,5cyclictest16-21ksoftirqd/007:50:540
2611799298,6cyclictest171ktimers/011:35:590
2611799298,6cyclictest171ktimers/011:35:590
2611799297,5cyclictest171ktimers/008:03:240
2611799297,5cyclictest171ktimers/008:03:240
26117992923,5cyclictest884-21kernelversion08:58:160
26117992923,5cyclictest884-21kernelversion08:58:160
26117992923,4cyclictest0-21swapper/008:43:020
26117992923,4cyclictest0-21swapper/008:43:020
26117992923,3cyclictest0-21swapper/008:13:150
26117992923,3cyclictest0-21swapper/008:13:150
26117992923,3cyclictest0-21swapper/008:13:150
26117992921,6cyclictest19287-21cut11:13:200
26117992921,6cyclictest19287-21cut11:13:200
26117992921,6cyclictest19287-21cut11:13:200
26117992920,7cyclictest29823-21fschecks_count07:23:140
26117992920,7cyclictest29823-21fschecks_count07:23:140
26117992920,7cyclictest10979-21unixbench-2d09:23:260
26117992920,7cyclictest10979-21unixbench-2d09:23:260
26117992919,3cyclictest181rcu_preempt12:38:260
26117992919,3cyclictest181rcu_preempt12:38:260
26117992915,2cyclictest181rcu_preempt09:43:210
26125992822,4cyclictest9601-21latency_hist09:23:021
26125992822,4cyclictest9601-21latency_hist09:23:021
26125992822,4cyclictest9601-21latency_hist09:23:021
26125992821,5cyclictest21790-21ntp_offset09:53:211
26125992821,5cyclictest21790-21ntp_offset09:53:211
2611799285,5cyclictest171ktimers/008:13:540
2611799285,5cyclictest171ktimers/008:13:540
2611799285,5cyclictest171ktimers/008:13:540
26117992823,3cyclictest0-21swapper/010:23:030
26117992823,3cyclictest0-21swapper/010:23:030
26117992823,3cyclictest0-21swapper/007:58:210
26117992821,5cyclictest19687-21kernelversion09:48:170
26117992821,5cyclictest19687-21kernelversion09:48:170
26117992821,5cyclictest19687-21kernelversion09:48:170
26117992821,2cyclictest181rcu_preempt12:03:140
26117992821,2cyclictest181rcu_preempt12:03:140
26117992819,7cyclictest5337-21latency_hist10:38:060
26117992819,7cyclictest5337-21latency_hist10:38:060
26117992819,7cyclictest5337-21latency_hist10:38:060
26117992819,7cyclictest16887-21cut11:08:150
26117992819,7cyclictest16887-21cut11:08:150
26117992819,7cyclictest16887-21cut11:08:150
26117992818,3cyclictest181rcu_preempt10:28:170
26117992818,3cyclictest181rcu_preempt10:28:170
26117992818,3cyclictest181rcu_preempt10:28:170
71622270,1sleep20-21swapper/212:08:182
71622270,1sleep20-21swapper/212:08:182
71622270,1sleep20-21swapper/212:08:182
290192270,3sleep20-21swapper/210:13:162
290192270,3sleep20-21swapper/210:13:162
290192270,3sleep20-21swapper/210:13:162
26131992722,4cyclictest351rcuc/209:22:562
26131992722,4cyclictest351rcuc/209:22:562
26131992722,4cyclictest351rcuc/209:22:562
26125992721,4cyclictest1346-21avahi-daemon07:43:031
26125992721,4cyclictest1346-21avahi-daemon07:43:031
26125992720,6cyclictest15948-21kernelversion09:38:191
26125992720,6cyclictest15948-21kernelversion09:38:191
26125992720,5cyclictest993-21unixbench-2d10:23:241
26125992720,5cyclictest993-21unixbench-2d10:23:241
26125992719,6cyclictest9110-21latency_hist10:48:071
26125992719,6cyclictest9110-21latency_hist10:48:071
26125992719,6cyclictest9110-21latency_hist10:48:071
26125992719,6cyclictest1369-21fschecks_time11:53:131
26125992719,6cyclictest1369-21fschecks_time11:53:131
26125992718,7cyclictest4349-21fschecks_time09:08:161
26125992718,7cyclictest4349-21fschecks_time09:08:161
26117992722,3cyclictest0-21swapper/011:08:250
26117992722,3cyclictest0-21swapper/011:08:250
26117992722,3cyclictest0-21swapper/011:08:250
26117992721,4cyclictest1346-21avahi-daemon09:33:230
26117992721,4cyclictest1346-21avahi-daemon09:33:230
26117992721,3cyclictest0-21swapper/011:58:170
26117992717,7cyclictest6490-21latency_hist07:48:060
26117992717,7cyclictest6490-21latency_hist07:48:060
26117992712,3cyclictest181rcu_preempt09:13:240
26117992712,3cyclictest181rcu_preempt09:13:240
26117992711,6cyclictest16-21ksoftirqd/011:29:440
26117992711,6cyclictest16-21ksoftirqd/011:29:440
215872270,3sleep30-21swapper/311:18:263
215872270,3sleep30-21swapper/311:18:263
215872270,3sleep30-21swapper/311:18:263
215872270,3sleep30-21swapper/311:18:263
2612599262,3cyclictest65372irqstats09:13:161
2612599262,3cyclictest65372irqstats09:13:161
26125992622,2cyclictest0-21swapper/111:23:031
26125992622,2cyclictest0-21swapper/111:23:031
26125992622,2cyclictest0-21swapper/111:23:031
26125992622,2cyclictest0-21swapper/111:23:031
26125992622,2cyclictest0-21swapper/110:03:021
26125992622,2cyclictest0-21swapper/110:03:021
26125992622,2cyclictest0-21swapper/110:03:021
26125992622,2cyclictest0-21swapper/110:03:021
26125992622,2cyclictest0-21swapper/109:53:141
26125992622,2cyclictest0-21swapper/109:53:141
26125992622,2cyclictest0-21swapper/109:53:141
26125992620,4cyclictest13872-21gltestperf09:33:161
26125992620,4cyclictest13872-21gltestperf09:33:161
26125992620,3cyclictest0-21swapper/111:18:141
26125992620,3cyclictest0-21swapper/111:18:141
26125992620,3cyclictest0-21swapper/111:18:141
26125992618,6cyclictest12461-21fschecks_time08:03:151
26125992618,6cyclictest12461-21fschecks_time08:03:151
26125992617,7cyclictest13272-21gltestperf10:58:141
26125992617,7cyclictest13272-21gltestperf10:58:141
26125992617,3cyclictest617-21lldpd10:22:271
26125992617,3cyclictest617-21lldpd10:22:271
26125992616,7cyclictest32731-21latency_hist08:58:081
26125992616,7cyclictest32731-21latency_hist08:58:081
26125992612,11cyclictest14678-21systemd-journal08:23:091
26125992612,11cyclictest14678-21systemd-journal08:23:091
26125992612,11cyclictest14678-21systemd-journal08:23:091
2611799267,4cyclictest171ktimers/010:03:200
2611799267,4cyclictest171ktimers/010:03:200
26117992622,2cyclictest0-21swapper/009:03:110
26117992622,2cyclictest0-21swapper/009:03:110
26117992619,2cyclictest181rcu_preempt11:03:140
26117992618,6cyclictest171ktimers/008:29:540
26117992618,6cyclictest171ktimers/008:29:540
26117992618,6cyclictest171ktimers/008:29:540
26117992618,2cyclictest181rcu_preempt11:48:170
26117992618,2cyclictest181rcu_preempt11:48:170
26132992516,5cyclictest109682sleep312:18:163
26132992516,5cyclictest109682sleep312:18:163
26132992516,5cyclictest109682sleep312:18:163
26125992521,2cyclictest0-21swapper/110:43:021
26125992521,2cyclictest0-21swapper/110:43:021
26125992519,4cyclictest27421-21ntp_states10:08:231
26125992519,4cyclictest27421-21ntp_states10:08:231
26125992519,4cyclictest27421-21ntp_states10:08:231
26125992519,3cyclictest0-21swapper/111:03:181
26125992519,3cyclictest0-21swapper/111:03:181
26125992519,3cyclictest0-21swapper/111:03:181
26125992518,5cyclictest30400-21sshd08:48:441
26125992518,5cyclictest27975-21ntp_offset08:43:201
26125992518,5cyclictest27975-21ntp_offset08:43:201
26125992518,5cyclictest27975-21ntp_offset08:43:201
26125992518,5cyclictest27014-21latency_hist08:43:021
26125992518,5cyclictest27014-21latency_hist08:43:021
26125992518,4cyclictest0-21swapper/112:38:241
26125992518,4cyclictest0-21swapper/112:38:241
26125992516,7cyclictest5602-21fschecks_count10:38:141
26125992516,7cyclictest5602-21fschecks_count10:38:141
26117992518,2cyclictest181rcu_preempt11:23:240
26117992518,2cyclictest181rcu_preempt11:23:240
26125992420,3cyclictest60-21kcompactd011:56:001
26125992420,3cyclictest60-21kcompactd011:56:001
26125992420,3cyclictest60-21kcompactd011:56:001
26125992420,3cyclictest17484-21ntp_offset11:08:221
26125992420,3cyclictest17484-21ntp_offset11:08:221
26125992420,3cyclictest17484-21ntp_offset11:08:221
26125992420,2cyclictest0-21swapper/108:33:251
26125992420,2cyclictest0-21swapper/108:33:251
26125992420,2cyclictest0-21swapper/108:33:251
26125992419,3cyclictest0-21swapper/107:53:121
26125992419,3cyclictest0-21swapper/107:53:121
26125992417,5cyclictest2063-21gltestperf10:28:161
26125992417,5cyclictest2063-21gltestperf10:28:161
26125992417,5cyclictest2063-21gltestperf10:28:161
26125992417,5cyclictest10193-21sshd12:16:441
26125992417,5cyclictest10193-21sshd12:16:441
26125992417,5cyclictest10193-21sshd12:16:441
26125992410,11cyclictest3922-21latency_hist09:08:131
26117992412,2cyclictest181rcu_preempt10:08:190
26117992412,2cyclictest181rcu_preempt10:08:190
26117992412,2cyclictest181rcu_preempt10:08:190
4132230,3sleep20-21swapper/210:23:172
4132230,3sleep20-21swapper/210:23:172
26132992317,4cyclictest219172sleep309:53:243
26132992317,4cyclictest219172sleep309:53:243
26131992319,3cyclictest351rcuc/210:30:502
26131992319,3cyclictest351rcuc/210:30:502
26131992319,3cyclictest351rcuc/210:30:502
26131992319,3cyclictest351rcuc/209:54:002
26131992319,3cyclictest351rcuc/209:54:002
26131992318,3cyclictest351rcuc/211:43:422
26131992318,3cyclictest351rcuc/211:43:422
26131992318,3cyclictest351rcuc/211:43:422
26131992317,4cyclictest351rcuc/208:43:072
26131992317,4cyclictest351rcuc/208:43:072
26125992319,2cyclictest0-21swapper/111:43:131
26125992319,2cyclictest0-21swapper/111:43:131
26125992319,2cyclictest0-21swapper/111:28:201
26125992319,2cyclictest0-21swapper/111:28:201
26125992319,2cyclictest0-21swapper/110:33:251
26125992318,4cyclictest6643-21latency_hist12:08:081
26125992318,4cyclictest6643-21latency_hist12:08:081
26125992318,3cyclictest17985-21fschecks_count08:18:151
26125992318,3cyclictest17985-21fschecks_count08:18:151
26125992318,3cyclictest17985-21fschecks_count08:18:151
26125992318,3cyclictest0-21swapper/112:33:191
26125992318,3cyclictest0-21swapper/112:33:191
26125992318,3cyclictest0-21swapper/109:23:261
26125992318,3cyclictest0-21swapper/109:23:261
26125992318,3cyclictest0-21swapper/108:08:151
26125992318,3cyclictest0-21swapper/108:08:151
26125992318,3cyclictest0-21swapper/108:08:151
26125992315,6cyclictest24060-21latency_hist11:28:051
26125992315,6cyclictest24060-21latency_hist11:28:051
26131992217,3cyclictest351rcuc/210:49:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional