You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 18:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Tue Jun 30, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
77121420,2sleep30-21swapper/307:33:313
77121420,2sleep30-21swapper/307:33:313
77121420,2sleep30-21swapper/307:33:313
1326621380,2sleep20-21swapper/208:08:232
1326621380,2sleep20-21swapper/208:08:232
169921360,3sleep30-21swapper/309:03:283
169921360,3sleep30-21swapper/309:03:283
169921360,3sleep30-21swapper/309:03:283
1145021310,3sleep20-21swapper/212:23:222
1145021310,3sleep20-21swapper/212:23:222
1145021310,3sleep20-21swapper/212:23:222
1492021280,2sleep30-21swapper/308:13:193
1492021280,2sleep30-21swapper/308:13:193
1492021280,2sleep30-21swapper/308:13:193
1979121270,3sleep30-21swapper/309:53:213
1979121270,3sleep30-21swapper/309:53:213
652321130,3sleep20-21swapper/207:48:422
652321130,3sleep20-21swapper/207:48:422
1357421080,2chrt13571-21df_inode11:03:200
1357421080,2chrt13571-21df_inode11:03:200
231212940,2chrt23106-21gltestperf11:28:221
278432900,2chrt27842-21awk10:13:280
278432900,2chrt27842-21awk10:13:280
309512880,3sleep20-21swapper/211:48:252
309512880,3sleep20-21swapper/211:48:252
187782810,3sleep30-21swapper/312:43:213
187782810,3sleep30-21swapper/312:43:213
289982720,2sleep20-21swapper/210:18:202
289982720,2sleep20-21swapper/210:18:202
302052690,2sleep30-21swapper/307:28:203
302052690,2sleep30-21swapper/307:28:203
302052690,2sleep30-21swapper/307:28:203
46812670,3sleep30-21swapper/310:38:233
46812670,3sleep30-21swapper/310:38:233
46812670,3sleep30-21swapper/310:38:233
5682660,2sleep30-21swapper/310:28:223
5682660,2sleep30-21swapper/310:28:223
5682660,2sleep30-21swapper/310:28:223
152072640,3sleep20-21swapper/208:13:222
152072640,3sleep20-21swapper/208:13:222
152072640,3sleep20-21swapper/208:13:222
66962610,2chrt6693-21ntpq10:43:270
66962610,2chrt6693-21ntpq10:43:270
66962610,2chrt6693-21ntpq10:43:270
303342570,6sleep1281ktimers/111:48:201
303342570,6sleep1281ktimers/111:48:201
303342570,6sleep1281ktimers/111:48:201
235002550,3chrt23502-21needreboot11:28:261
235002550,3chrt23502-21needreboot11:28:261
235002550,3chrt23502-21needreboot11:28:261
235002550,3chrt23502-21needreboot11:28:261
56692530,1sleep15671-21xargs09:13:311
56692530,1sleep15671-21xargs09:13:311
56692530,1sleep15671-21xargs09:13:311
213182530,2sleep20-21swapper/208:28:292
213182530,2sleep20-21swapper/208:28:292
213182530,2sleep20-21swapper/208:28:292
311132520,1sleep031273-21unixbench_multi07:28:300
311132520,1sleep031273-21unixbench_multi07:28:300
311132520,1sleep031273-21unixbench_multi07:28:300
155242520,2sleep015624-21/usr/sbin/munin12:33:300
155242520,2sleep015624-21/usr/sbin/munin12:33:300
162592510,3chrt0-21swapper/211:08:292
162592510,3chrt0-21swapper/211:08:292
278822490,1sleep10-21swapper/110:13:291
278822490,1sleep10-21swapper/110:13:291
314992480,6sleep031502-21unixbench_multi11:48:310
314992480,6sleep031502-21unixbench_multi11:48:310
314992480,6sleep031502-21unixbench_multi11:48:310
314992480,6sleep031502-21unixbench_multi11:48:310
79402450,2sleep20-21swapper/212:13:252
79402450,2sleep20-21swapper/212:13:252
79402450,2sleep20-21swapper/212:13:252
139042450,3chrt0-21swapper/211:03:222
139042450,3chrt0-21swapper/211:03:222
323472430,3sleep20-21swapper/207:33:222
323472430,3sleep20-21swapper/207:33:222
323472430,3sleep20-21swapper/207:33:222
36232400,3chrt0-21swapper/107:43:221
36232400,3chrt0-21swapper/107:43:221
36232400,3chrt0-21swapper/107:43:221
24897994035,3cyclictest8161-21cron09:23:071
24897994035,3cyclictest8161-21cron09:23:071
24897994035,3cyclictest8161-21cron09:23:071
24894994030,8cyclictest8171-21idleruntime-cro09:23:070
24894994030,8cyclictest8171-21idleruntime-cro09:23:070
24894994030,8cyclictest8171-21idleruntime-cro09:23:070
279552390,3sleep30-21swapper/308:48:203
279552390,3sleep30-21swapper/308:48:203
279552390,3sleep30-21swapper/308:48:203
24894993813,5cyclictest201rcuc/009:29:000
24894993813,5cyclictest201rcuc/009:29:000
24894993713,4cyclictest201rcuc/007:44:570
24894993713,4cyclictest201rcuc/007:44:570
24894993616,3cyclictest201rcuc/010:54:030
24894993616,3cyclictest201rcuc/010:54:030
24897993526,7cyclictest5927-21latency_hist10:43:181
24897993526,7cyclictest5927-21latency_hist10:43:181
24897993526,7cyclictest5927-21latency_hist10:43:181
24897993518,11cyclictest30121-21cpuspeed07:28:191
24897993518,11cyclictest30121-21cpuspeed07:28:191
24897993518,11cyclictest30121-21cpuspeed07:28:191
24894993526,7cyclictest15807-21if_wlan011:08:220
24894993526,7cyclictest15807-21if_wlan011:08:220
24894993525,3cyclictest181rcu_preempt09:04:360
24894993525,3cyclictest181rcu_preempt09:04:360
24894993525,3cyclictest181rcu_preempt09:04:360
24894993522,7cyclictest90-1pr/ttyS008:46:590
24894993522,7cyclictest90-1pr/ttyS008:46:590
323752340,1sleep10-21swapper/108:58:321
323752340,1sleep10-21swapper/108:58:321
24897993417,10cyclictest12164-21cpu09:33:181
24897993417,10cyclictest12164-21cpu09:33:181
2489499349,4cyclictest201rcuc/008:49:140
2489499349,4cyclictest201rcuc/008:49:140
2489499349,4cyclictest201rcuc/008:49:140
24894993412,5cyclictest201rcuc/008:16:580
24894993412,5cyclictest201rcuc/008:16:580
24894993412,5cyclictest201rcuc/008:16:580
141832340,2sleep10-21swapper/112:28:321
141832340,2sleep10-21swapper/112:28:321
24894993325,6cyclictest1346-21avahi-daemon12:38:320
24894993325,6cyclictest1346-21avahi-daemon12:38:320
24894993325,6cyclictest1346-21avahi-daemon12:38:320
24894993319,4cyclictest181rcu_preempt10:27:190
24894993319,4cyclictest181rcu_preempt10:27:190
24894993319,4cyclictest181rcu_preempt10:27:190
54712320,3sleep20-21swapper/212:08:192
54712320,3sleep20-21swapper/212:08:192
24897993228,3cyclictest28913-21kernelversion11:43:241
24897993228,3cyclictest28913-21kernelversion11:43:241
24897993228,3cyclictest28913-21kernelversion11:43:241
24897993226,4cyclictest749-21runrttasks07:58:181
24897993226,4cyclictest749-21runrttasks07:58:181
24894993226,4cyclictest201rcuc/010:04:010
24894993226,4cyclictest201rcuc/010:04:010
24894993223,3cyclictest181rcu_preempt09:59:400
24894993223,3cyclictest181rcu_preempt09:59:400
24894993223,2cyclictest181rcu_preempt11:40:230
24894993223,2cyclictest181rcu_preempt11:40:230
24894993223,2cyclictest181rcu_preempt11:40:230
24894993213,16cyclictest171ktimers/009:56:300
24894993213,16cyclictest171ktimers/009:56:300
24894993210,20cyclictest201rcuc/008:05:130
24894993210,20cyclictest201rcuc/008:05:130
24894993210,20cyclictest201rcuc/008:05:130
24897993122,7cyclictest22200-21needreboot09:58:271
24897993122,7cyclictest22200-21needreboot09:58:271
24894993127,3cyclictest90-1pr/ttyS011:30:040
24894993127,3cyclictest90-1pr/ttyS011:30:040
24894993127,3cyclictest90-1pr/ttyS011:30:040
24894993127,3cyclictest90-1pr/ttyS011:30:040
24894993126,3cyclictest0-21swapper/008:23:080
24894993126,3cyclictest0-21swapper/008:23:080
24894993126,3cyclictest0-21swapper/007:23:070
24894993126,3cyclictest0-21swapper/007:23:070
24894993126,3cyclictest0-21swapper/007:23:070
24894993125,5cyclictest5572-21fschecks_time12:08:200
24894993118,2cyclictest181rcu_preempt12:18:250
24894993118,2cyclictest181rcu_preempt12:18:250
24894993111,4cyclictest201rcuc/010:13:010
24894993111,4cyclictest201rcuc/010:13:010
24894993111,4cyclictest201rcuc/010:13:010
78232300,2sleep17851-21ntpq07:53:281
78232300,2sleep17851-21ntpq07:53:281
45872300,1sleep14707-21/usr/sbin/munin09:13:201
45872300,1sleep14707-21/usr/sbin/munin09:13:201
45872300,1sleep14707-21/usr/sbin/munin09:13:201
32352300,10sleep03236-21cron12:03:070
32352300,10sleep03236-21cron12:03:070
32352300,10sleep03236-21cron12:03:070
323162300,3sleep30-21swapper/311:53:203
323162300,3sleep30-21swapper/311:53:203
323162300,3sleep30-21swapper/311:53:203
323162300,3sleep30-21swapper/311:53:203
309682300,4sleep30-21swapper/310:23:203
309682300,4sleep30-21swapper/310:23:203
309682300,4sleep30-21swapper/310:23:203
2489499307,6cyclictest16-21ksoftirqd/010:21:310
2489499307,6cyclictest16-21ksoftirqd/010:21:310
2489499307,6cyclictest16-21ksoftirqd/010:21:310
2489499303,5cyclictest171ktimers/011:45:280
2489499303,5cyclictest171ktimers/011:45:280
2489499303,5cyclictest171ktimers/011:45:280
24894993025,4cyclictest24880-21cyclictest10:48:250
24894993025,4cyclictest24880-21cyclictest10:48:250
24894993025,4cyclictest24880-21cyclictest10:48:250
24894993023,5cyclictest5922-21/usr/sbin/munin10:43:190
24894993023,5cyclictest5922-21/usr/sbin/munin10:43:190
24894993023,5cyclictest2084-21kernelversion11:58:240
24894993023,5cyclictest2084-21kernelversion11:58:240
24894993016,2cyclictest181rcu_preempt07:33:270
24894993016,2cyclictest181rcu_preempt07:33:270
24894993016,2cyclictest181rcu_preempt07:33:270
24894993015,7cyclictest90-1pr/ttyS007:23:550
24894993015,7cyclictest90-1pr/ttyS007:23:550
24894993015,7cyclictest90-1pr/ttyS007:23:550
24897992924,2cyclictest0-21swapper/108:38:291
24897992924,2cyclictest0-21swapper/108:38:291
24897992922,5cyclictest11358-21latency_hist10:58:081
24897992922,5cyclictest11358-21latency_hist10:58:081
24894992925,3cyclictest90-1pr/ttyS011:17:030
24894992925,3cyclictest90-1pr/ttyS011:17:030
24894992925,3cyclictest26845-21gltestperf11:38:220
24894992925,3cyclictest26845-21gltestperf11:38:220
24894992925,3cyclictest26845-21gltestperf11:38:220
24894992925,3cyclictest26845-21gltestperf11:38:220
24894992923,5cyclictest8653-21sshd07:57:080
24894992923,5cyclictest8653-21sshd07:57:080
24894992921,6cyclictest24880-21cyclictest10:28:220
24894992921,6cyclictest24880-21cyclictest10:28:220
24894992921,6cyclictest24880-21cyclictest10:28:220
24894992921,2cyclictest181rcu_preempt10:42:530
24894992918,4cyclictest181rcu_preempt12:30:360
24894992918,4cyclictest181rcu_preempt12:30:360
24894992916,2cyclictest181rcu_preempt11:18:230
24894992916,2cyclictest181rcu_preempt11:18:230
2489499291,23cyclictest1381-21latency_hist11:58:070
222882290,4sleep20-21swapper/211:24:092
222882290,4sleep20-21swapper/211:24:092
24898992818,6cyclictest0-21swapper/209:26:002
24898992818,6cyclictest0-21swapper/209:26:002
24897992824,2cyclictest0-21swapper/112:23:221
24897992824,2cyclictest0-21swapper/112:23:221
24897992824,2cyclictest0-21swapper/112:23:221
24897992822,4cyclictest0-21swapper/108:13:281
24897992822,4cyclictest0-21swapper/108:13:281
24897992822,4cyclictest0-21swapper/108:13:281
24897992821,5cyclictest2690-21latency_hist09:08:151
24897992821,5cyclictest2690-21latency_hist09:08:151
24897992821,5cyclictest2690-21latency_hist09:08:151
24897992821,5cyclictest19889-21fschecks_time09:53:211
24897992821,5cyclictest19889-21fschecks_time09:53:211
2489799280,4cyclictest181rcu_preempt09:23:301
2489799280,4cyclictest181rcu_preempt09:23:301
2489499289,3cyclictest171ktimers/007:41:310
2489499289,3cyclictest171ktimers/007:41:310
2489499289,3cyclictest171ktimers/007:41:310
2489499286,4cyclictest201rcuc/008:10:500
2489499286,4cyclictest201rcuc/008:10:500
2489499283,5cyclictest201rcuc/008:00:000
2489499283,5cyclictest201rcuc/008:00:000
24894992824,2cyclictest0-21swapper/009:23:300
24894992824,2cyclictest0-21swapper/009:23:300
24894992823,4cyclictest6244-21threads07:48:300
24894992823,4cyclictest6244-21threads07:48:300
24894992822,5cyclictest7725-21kernelversion12:13:220
24894992822,5cyclictest7725-21kernelversion12:13:220
24894992822,5cyclictest7725-21kernelversion12:13:220
24894992822,5cyclictest12651-21kernelversion09:33:220
24894992822,5cyclictest12651-21kernelversion09:33:220
24894992821,5cyclictest4723-21unixbench_singl12:03:320
24894992820,6cyclictest749-21runrttasks08:33:190
24894992820,6cyclictest749-21runrttasks08:33:190
24894992820,6cyclictest749-21runrttasks08:33:190
172192280,3sleep30-21swapper/311:13:203
172192280,3sleep30-21swapper/311:13:203
16872280,5sleep11535-21/usr/sbin/munin11:58:211
16872280,5sleep11535-21/usr/sbin/munin11:58:211
16872280,5sleep11535-21/usr/sbin/munin11:58:211
40772270,3sleep30-21swapper/307:43:283
40772270,3sleep30-21swapper/307:43:283
24897992721,4cyclictest90-1pr/ttyS007:28:271
24897992721,4cyclictest90-1pr/ttyS007:28:271
24897992721,4cyclictest90-1pr/ttyS007:28:271
24897992720,5cyclictest17443-21cut11:13:221
24897992720,5cyclictest17443-21cut11:13:221
24897992719,6cyclictest29375-21sort10:18:231
24897992719,6cyclictest29375-21sort10:18:231
24897992719,6cyclictest29375-21sort10:18:231
2489499276,4cyclictest201rcuc/010:38:020
2489499276,4cyclictest201rcuc/010:38:020
2489499275,5cyclictest171ktimers/008:56:400
2489499275,5cyclictest171ktimers/008:56:400
24894992721,5cyclictest31572-21fschecks_count08:58:220
24894992721,5cyclictest31572-21fschecks_count08:58:220
24894992721,4cyclictest201rcuc/008:27:280
24894992721,4cyclictest201rcuc/008:27:280
24897992622,3cyclictest18292-21kernelversion09:48:231
24897992622,3cyclictest18292-21kernelversion09:48:231
24897992621,3cyclictest0-21swapper/111:23:081
24897992621,3cyclictest0-21swapper/111:23:081
24897992620,3cyclictest0-21swapper/110:03:281
24897992620,3cyclictest0-21swapper/110:03:281
24897992620,3cyclictest0-21swapper/109:43:081
24897992620,3cyclictest0-21swapper/109:43:081
24897992619,5cyclictest15818-21timerandwakeup12:33:321
24897992619,5cyclictest15818-21timerandwakeup12:33:321
24897992619,4cyclictest0-21swapper/107:18:311
24897992619,4cyclictest0-21swapper/107:18:311
24897992619,4cyclictest0-21swapper/107:18:311
24897992617,7cyclictest361-21rt-features07:33:281
24897992617,7cyclictest361-21rt-features07:33:281
24897992617,7cyclictest361-21rt-features07:33:281
2489499265,5cyclictest171ktimers/009:51:020
2489499265,5cyclictest171ktimers/009:51:020
2489499265,4cyclictest171ktimers/010:59:170
2489499265,4cyclictest171ktimers/010:59:170
2489499262,5cyclictest171ktimers/012:27:320
2489499262,5cyclictest171ktimers/012:27:320
2489499262,5cyclictest171ktimers/012:27:320
24894992613,2cyclictest181rcu_preempt09:43:230
24894992613,2cyclictest181rcu_preempt09:43:230
24894992612,2cyclictest181rcu_preempt09:38:230
24894992612,2cyclictest181rcu_preempt09:38:230
24894992610,14cyclictest171ktimers/009:11:560
24894992610,14cyclictest171ktimers/009:11:560
24894992610,14cyclictest171ktimers/009:11:560
72302250,4sleep10-21swapper/110:43:321
72302250,4sleep10-21swapper/110:43:321
72302250,4sleep10-21swapper/110:43:321
24897992520,4cyclictest28687-21switchtime08:48:291
24897992520,4cyclictest28687-21switchtime08:48:291
24897992520,4cyclictest28687-21switchtime08:48:291
24897992520,3cyclictest0-21swapper/108:43:281
24897992520,3cyclictest0-21swapper/108:43:281
24897992518,5cyclictest11367-21kernelversion08:03:221
24897992518,5cyclictest11367-21kernelversion08:03:221
24897992518,5cyclictest11367-21kernelversion08:03:221
24897992517,6cyclictest32749-21cpu10:28:201
24897992517,6cyclictest32749-21cpu10:28:201
24897992517,6cyclictest21222-21sort08:28:291
24897992517,6cyclictest21222-21sort08:28:291
24897992517,6cyclictest21222-21sort08:28:291
24897992517,6cyclictest11949-21ls10:58:221
24897992517,6cyclictest11949-21ls10:58:221
24897992515,7cyclictest9034-21latency_hist12:18:161
24897992515,7cyclictest9034-21latency_hist12:18:161
24897992515,7cyclictest9034-21latency_hist12:18:161
24894992520,4cyclictest674-21gpm08:38:200
24894992520,4cyclictest674-21gpm08:38:200
24894992517,6cyclictest5516-21gunzip09:13:290
24894992517,6cyclictest5516-21gunzip09:13:290
24894992517,6cyclictest5516-21gunzip09:13:290
24894992513,2cyclictest181rcu_preempt11:23:220
24894992513,2cyclictest181rcu_preempt11:23:220
24899992419,3cyclictest102652chrt10:53:233
24899992419,3cyclictest102652chrt10:53:233
24898992413,6cyclictest0-21swapper/210:04:012
24898992413,6cyclictest0-21swapper/210:04:012
24898992413,5cyclictest0-21swapper/209:37:002
24898992413,5cyclictest0-21swapper/209:37:002
24897992420,3cyclictest10775-21latency_hist12:23:081
24897992420,3cyclictest10775-21latency_hist12:23:081
24897992420,2cyclictest0-21swapper/108:53:291
24897992420,2cyclictest0-21swapper/108:53:291
24897992418,4cyclictest17666-21latency_hist09:48:131
24897992418,4cyclictest17666-21latency_hist09:48:131
24897992416,6cyclictest2723-21sort10:33:231
24897992416,6cyclictest2723-21sort10:33:231
24897992416,6cyclictest21193-21tune2fs11:23:201
24897992414,8cyclictest26739-21cut11:38:211
24897992414,8cyclictest26739-21cut11:38:211
24897992414,8cyclictest26739-21cut11:38:211
24897992414,8cyclictest26739-21cut11:38:211
24894992414,2cyclictest181rcu_preempt08:28:260
24894992414,2cyclictest181rcu_preempt08:28:260
24894992414,2cyclictest181rcu_preempt08:28:260
24894992413,2cyclictest181rcu_preempt12:08:260
24894992413,2cyclictest181rcu_preempt12:08:260
83152231,4sleep30-21swapper/310:48:253
83152231,4sleep30-21swapper/310:48:253
83152231,4sleep30-21swapper/310:48:253
53942231,4sleep15470-21df_inode12:08:191
53942231,4sleep15470-21df_inode12:08:191
24898992316,4cyclictest0-21swapper/208:25:582
24898992316,4cyclictest0-21swapper/208:25:582
24898992315,5cyclictest0-21swapper/208:51:592
24898992315,5cyclictest0-21swapper/208:51:592
24898992315,5cyclictest0-21swapper/208:51:592
24898992314,7cyclictest0-21swapper/211:19:032
24898992314,7cyclictest0-21swapper/211:19:032
24898992314,5cyclictest0-21swapper/207:40:272
24898992314,5cyclictest0-21swapper/207:40:272
24898992314,5cyclictest0-21swapper/207:40:272
24898992313,6cyclictest0-21swapper/209:53:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional