You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-10 - 19:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Fri Jul 10, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1834221310,3sleep30-21swapper/309:43:323
1834221310,3sleep30-21swapper/309:43:323
237521200,2sleep30-21swapper/309:01:523
237521200,2sleep30-21swapper/309:01:523
3166121190,4chrt0-21swapper/310:18:383
39321040,3sleep20-21swapper/210:23:272
39321040,3sleep20-21swapper/210:23:272
39321040,3sleep20-21swapper/210:23:272
29112940,3sleep20-21swapper/211:53:402
29112940,3sleep20-21swapper/211:53:402
176922770,3chrt0-21swapper/208:13:432
176922770,3chrt0-21swapper/208:13:432
18832750,2sleep01884-21/usr/sbin/munin07:33:330
18832750,2sleep01884-21/usr/sbin/munin07:33:330
18832750,2sleep01884-21/usr/sbin/munin07:33:330
23062720,3sleep30-21swapper/311:53:333
23062720,3sleep30-21swapper/311:53:333
145512720,3sleep00-21swapper/008:08:260
145512720,3sleep00-21swapper/008:08:260
162512710,2chrt0-21swapper/311:03:363
162512710,2chrt0-21swapper/311:03:363
162512710,2chrt0-21swapper/311:03:363
109052620,3sleep20-21swapper/210:48:402
109052620,3sleep20-21swapper/210:48:402
109052620,3sleep20-21swapper/210:48:402
295132590,3sleep00-21swapper/010:13:330
295132590,3sleep00-21swapper/010:13:330
295132590,3sleep00-21swapper/010:13:330
237102590,3sleep20-21swapper/208:33:162
237102590,3sleep20-21swapper/208:33:162
284372580,3chrt0-21swapper/311:38:253
284372580,3chrt0-21swapper/311:38:253
52922550,2sleep05350-21/usr/sbin/munin09:08:370
52922550,2sleep05350-21/usr/sbin/munin09:08:370
312432540,4sleep031245-21timerwakeupswit07:23:400
312432540,4sleep031245-21timerwakeupswit07:23:400
312432540,4sleep031245-21timerwakeupswit07:23:400
278502540,2sleep20-21swapper/208:43:292
95992510,4sleep30-21swapper/309:18:403
95992510,4sleep30-21swapper/309:18:403
299762510,3chrt0-21swapper/208:48:322
299762510,3chrt0-21swapper/208:48:322
299762510,3chrt0-21swapper/208:48:322
171462510,2chrt16-21ksoftirqd/012:33:300
171462510,2chrt16-21ksoftirqd/012:33:300
263892470,2sleep026390-21/usr/sbin/munin08:38:330
263892470,2sleep026390-21/usr/sbin/munin08:38:330
263892470,2sleep026390-21/usr/sbin/munin08:38:330
4772460,1sleep30-21swapper/307:28:413
4772460,1sleep30-21swapper/307:28:413
161002450,3sleep016101-21sshd08:11:400
161002450,3sleep016101-21sshd08:11:400
58782440,2sleep15925-21ntpq07:43:361
58782440,2sleep15925-21ntpq07:43:361
58782440,2sleep15925-21ntpq07:43:361
98942430,2sleep00-21swapper/007:53:390
98942430,2sleep00-21swapper/007:53:390
69702430,3sleep20-21swapper/209:13:322
69702430,3sleep20-21swapper/209:13:322
12772430,2sleep00-21swapper/007:33:200
12772430,2sleep00-21swapper/007:33:200
101772430,2sleep20-21swapper/212:13:382
101772430,2sleep20-21swapper/212:13:382
53402420,2chrt0-21swapper/007:43:300
53402420,2chrt0-21swapper/007:43:300
53402420,2chrt0-21swapper/007:43:300
162282420,1sleep016374-21if_wlan009:38:320
162282420,1sleep016374-21if_wlan009:38:320
112252410,2sleep30-21swapper/309:23:383
112252410,2sleep30-21swapper/309:23:383
173162400,2sleep117319-21fschecks_count11:08:291
173162400,2sleep117319-21fschecks_count11:08:291
173162400,2sleep117319-21fschecks_count11:08:291
26785993933,4cyclictest545-21in:imuxsock12:33:170
26785993933,4cyclictest545-21in:imuxsock12:33:170
283452380,3chrt0-21swapper/208:43:332
283452380,3chrt0-21swapper/208:43:332
283452380,3chrt0-21swapper/208:43:332
26786993628,6cyclictest22220-21netstat09:53:361
26786993628,6cyclictest22220-21netstat09:53:361
23492360,3sleep00-21swapper/011:53:340
23492360,3sleep00-21swapper/011:53:340
185102360,3sleep20-21swapper/209:43:352
185102360,3sleep20-21swapper/209:43:352
26785993531,3cyclictest15692-21latency_hist09:38:170
26785993531,3cyclictest15692-21latency_hist09:38:170
48932340,2sleep20-21swapper/210:33:362
48932340,2sleep20-21swapper/210:33:362
26786993325,6cyclictest15298-21netstat08:08:371
26786993325,6cyclictest15298-21netstat08:08:371
236232330,2sleep123772-21idleruntime09:58:311
236232330,2sleep123772-21idleruntime09:58:311
236232330,2sleep123772-21idleruntime09:58:311
26786993225,5cyclictest26769-21cyclictest10:43:301
26786993225,5cyclictest26769-21cyclictest10:43:301
26786993225,5cyclictest26769-21cyclictest10:43:301
26786993225,5cyclictest19999-21sendmail08:23:171
26785993225,5cyclictest545-21in:imuxsock11:13:200
26785993225,5cyclictest545-21in:imuxsock11:13:200
26785993225,5cyclictest545-21in:imuxsock11:13:200
26785993225,5cyclictest12687-21sendmail12:23:170
26785993225,5cyclictest12687-21sendmail12:23:170
26785993127,3cyclictest7009-21kernelversion09:13:330
26785993127,3cyclictest7009-21kernelversion09:13:330
26785993123,6cyclictest517-21fschecks_count10:23:290
26785993123,6cyclictest517-21fschecks_count10:23:290
26785993123,6cyclictest517-21fschecks_count10:23:290
26786993021,7cyclictest5093-21kernelversion09:08:331
26786993021,7cyclictest5093-21kernelversion09:08:331
26785993023,5cyclictest20920-21latency_hist11:18:270
26785993023,5cyclictest20920-21latency_hist11:18:270
26785993023,5cyclictest20920-21latency_hist11:18:270
26785993023,5cyclictest20920-21latency_hist11:18:270
26785993022,6cyclictest2993-21fschecks_time09:03:310
26785993022,6cyclictest2993-21fschecks_time09:03:310
277882290,3sleep30-21swapper/310:08:333
277882290,3sleep30-21swapper/310:08:333
26786992924,4cyclictest19274-21ntp_offset12:38:351
26786992924,4cyclictest19274-21ntp_offset12:38:351
26786992923,5cyclictest12480-21latency_hist08:03:171
26786992923,5cyclictest12480-21latency_hist08:03:171
26786992923,5cyclictest12480-21latency_hist08:03:171
26786992922,5cyclictest7476-21sort12:08:291
26786992919,7cyclictest12765-21unixbench-2d10:53:411
26786992919,7cyclictest12765-21unixbench-2d10:53:411
26786992919,7cyclictest12765-21unixbench-2d10:53:411
26785992924,3cyclictest17195-21ntp_offset08:13:380
26785992924,3cyclictest17195-21ntp_offset08:13:380
26785992922,5cyclictest10297-21/usr/sbin/munin09:23:350
26785992922,5cyclictest10297-21/usr/sbin/munin09:23:350
26785992921,6cyclictest3714-21fschecks_time11:58:300
26785992921,6cyclictest3714-21fschecks_time11:58:300
26785992921,5cyclictest0-21swapper/011:23:370
26785992921,5cyclictest0-21swapper/011:23:370
2678599291,4cyclictest171ktimers/012:17:410
2678599291,4cyclictest171ktimers/012:17:410
316402280,3chrt31643-21fschecks_time08:53:291
316402280,3chrt31643-21fschecks_time08:53:291
316402280,3chrt31643-21fschecks_time08:53:291
26786992823,4cyclictest32697-21kernelversion11:48:311
26786992823,4cyclictest32697-21kernelversion11:48:311
26786992823,4cyclictest17610-21unixbench-2d08:13:421
26786992823,4cyclictest17610-21unixbench-2d08:13:421
26786992823,4cyclictest13174-21fschecks_time12:23:301
26786992823,4cyclictest13174-21fschecks_time12:23:301
26786992823,3cyclictest2385-21ntp_offset11:53:351
26786992823,3cyclictest2385-21ntp_offset11:53:351
26786992823,3cyclictest0-21swapper/111:38:291
26786992823,3cyclictest0-21swapper/111:38:291
26786992822,5cyclictest3792-21kernelversion07:38:321
26786992822,5cyclictest3792-21kernelversion07:38:321
26786992822,5cyclictest3792-21kernelversion07:38:321
26786992822,5cyclictest22573-21kernelversion08:28:341
26786992822,5cyclictest22573-21kernelversion08:28:341
26786992821,5cyclictest11303-21sshd10:52:111
26786992821,5cyclictest11303-21sshd10:52:111
26786992821,5cyclictest11303-21sshd10:52:111
26786992820,6cyclictest26161-21cut10:03:361
26786992820,6cyclictest26161-21cut10:03:361
26786992820,6cyclictest26161-21cut10:03:361
26786992820,6cyclictest0-21swapper/111:22:151
26786992820,6cyclictest0-21swapper/111:22:151
26786992819,7cyclictest2012-21latency_hist10:28:161
26786992819,7cyclictest2012-21latency_hist10:28:161
26786992819,7cyclictest2012-21latency_hist10:28:161
26785992824,2cyclictest0-21swapper/010:23:170
26785992822,4cyclictest26925-21gltestperf11:33:290
26785992822,4cyclictest26925-21gltestperf11:33:290
26785992822,3cyclictest0-21swapper/011:23:160
26785992822,3cyclictest0-21swapper/011:23:160
26785992821,5cyclictest7630-21sendmail10:43:160
26785992821,5cyclictest7630-21sendmail10:43:160
26785992821,5cyclictest7630-21sendmail10:43:160
26785992821,5cyclictest28716-21sshd10:12:410
26785992821,5cyclictest28716-21sshd10:12:410
26785992821,5cyclictest26769-21cyclictest12:13:290
26785992821,5cyclictest26769-21cyclictest12:13:290
26785992821,5cyclictest24436-21kernelversion08:33:340
26785992821,5cyclictest24436-21kernelversion08:33:340
26785992821,5cyclictest24436-21kernelversion08:33:340
26785992819,7cyclictest31048-21netstat11:43:340
26785992819,7cyclictest31048-21netstat11:43:340
26785992819,7cyclictest31048-21netstat11:43:340
26786992723,3cyclictest7808-21ntp_offset07:48:371
26786992723,3cyclictest7808-21ntp_offset07:48:371
26786992723,3cyclictest7808-21ntp_offset07:48:371
26786992722,4cyclictest26769-21cyclictest11:03:271
26786992722,4cyclictest26769-21cyclictest11:03:271
26786992722,4cyclictest26769-21cyclictest11:03:271
26786992722,3cyclictest9997-21gltestperf10:48:301
26786992722,3cyclictest9997-21gltestperf10:48:301
26786992722,3cyclictest9997-21gltestperf10:48:301
26786992722,3cyclictest4899-21proc_pri10:33:361
26786992722,3cyclictest4899-21proc_pri10:33:361
26786992719,6cyclictest27856-21fschecks_count08:43:291
26786992718,6cyclictest15053-21cut12:28:321
26786992718,6cyclictest15053-21cut12:28:321
26785992722,3cyclictest0-21swapper/008:48:410
26785992722,3cyclictest0-21swapper/008:48:410
26785992722,3cyclictest0-21swapper/008:48:410
26785992712,4cyclictest181rcu_preempt11:03:560
26785992712,4cyclictest181rcu_preempt11:03:560
26785992712,4cyclictest181rcu_preempt11:03:560
166162270,3sleep30-21swapper/312:33:253
166162270,3sleep30-21swapper/312:33:253
26786992621,4cyclictest31783-21latency_hist07:28:171
26786992621,4cyclictest31783-21latency_hist07:28:171
26786992621,4cyclictest31783-21latency_hist07:28:171
26786992621,3cyclictest8926-21latency_hist12:13:171
26786992621,3cyclictest8926-21latency_hist12:13:171
26786992621,3cyclictest8926-21latency_hist12:13:171
26786992621,2cyclictest0-21swapper/112:33:291
26786992621,2cyclictest0-21swapper/112:33:291
26786992618,6cyclictest19179-21fschecks_count11:13:291
26786992618,6cyclictest19179-21fschecks_count11:13:291
26786992618,6cyclictest19179-21fschecks_count11:13:291
26786992617,7cyclictest10714-21latency_hist07:58:221
26786992617,7cyclictest10714-21latency_hist07:58:221
26785992621,3cyclictest0-21swapper/010:58:410
26785992621,3cyclictest0-21swapper/010:58:410
26785992621,3cyclictest0-21swapper/010:58:410
26785992620,5cyclictest7563-21kernelversion07:48:340
26785992620,5cyclictest7563-21kernelversion07:48:340
26785992620,5cyclictest7563-21kernelversion07:48:340
26785992620,5cyclictest4810-21sshd07:41:410
26785992620,5cyclictest4810-21sshd07:41:410
26785992620,5cyclictest4810-21sshd07:41:410
26785992620,5cyclictest12863-21/usr/sbin/munin12:23:360
26785992620,5cyclictest12863-21/usr/sbin/munin12:23:360
26785992620,5cyclictest12863-21/usr/sbin/munin12:23:360
26785992620,5cyclictest12863-21/usr/sbin/munin12:23:360
26785992620,4cyclictest27419-21gltestperf10:08:300
26785992620,4cyclictest27419-21gltestperf10:08:300
26785992620,4cyclictest10061-21sendmail09:23:170
26785992620,4cyclictest10061-21sendmail09:23:170
26785992620,3cyclictest0-21swapper/008:58:170
26785992620,3cyclictest0-21swapper/008:58:170
26785992620,3cyclictest0-21swapper/008:58:170
26785992619,5cyclictest21770-21fschecks_time09:53:310
26785992619,5cyclictest21770-21fschecks_time09:53:310
26785992613,3cyclictest181rcu_preempt11:32:450
26785992613,3cyclictest181rcu_preempt11:32:450
26785992613,3cyclictest181rcu_preempt11:32:450
289232250,1sleep00-21swapper/011:38:310
289232250,1sleep00-21swapper/011:38:310
26786992520,4cyclictest14678-21systemd-journal07:36:341
26786992520,4cyclictest14678-21systemd-journal07:36:341
26786992520,4cyclictest14678-21systemd-journal07:36:341
26786992520,3cyclictest13358-21needreboot08:03:341
26786992520,3cyclictest13358-21needreboot08:03:341
26786992520,3cyclictest0-21swapper/112:23:401
26786992520,3cyclictest0-21swapper/112:23:401
26786992520,3cyclictest0-21swapper/112:23:401
26786992520,3cyclictest0-21swapper/112:23:401
26786992520,3cyclictest0-21swapper/108:33:411
26786992520,3cyclictest0-21swapper/108:33:411
26786992520,3cyclictest0-21swapper/108:33:411
26786992519,5cyclictest26815-21threads08:38:391
26786992519,5cyclictest26815-21threads08:38:391
26786992519,4cyclictest1075-21sshd07:31:401
26786992519,4cyclictest1075-21sshd07:31:401
26786992519,3cyclictest0-21swapper/109:38:311
26786992519,3cyclictest0-21swapper/109:38:311
26786992519,3cyclictest0-21swapper/109:28:421
26786992519,3cyclictest0-21swapper/109:28:421
26786992516,7cyclictest5571-21fschecks_count12:03:281
26786992516,7cyclictest5571-21fschecks_count12:03:281
26785992520,3cyclictest0-21swapper/010:48:270
26785992520,3cyclictest0-21swapper/010:48:270
26785992520,3cyclictest0-21swapper/010:48:270
26785992520,3cyclictest0-21swapper/008:18:330
26785992520,2cyclictest0-21swapper/010:03:370
26785992519,3cyclictest0-21swapper/012:03:310
26785992519,3cyclictest0-21swapper/012:03:310
26785992519,3cyclictest0-21swapper/012:03:310
26785992516,7cyclictest11837-21threads07:58:410
26785992516,7cyclictest11837-21threads07:58:410
26785992516,7cyclictest11837-21threads07:58:410
26785992514,10cyclictest12117-21latency10:53:330
26785992514,10cyclictest12117-21latency10:53:330
26792992417,4cyclictest7267-21chrt07:48:313
26792992417,4cyclictest7267-21chrt07:48:313
26792992417,4cyclictest7267-21chrt07:48:313
26787992418,4cyclictest351rcuc/209:28:362
26787992418,4cyclictest351rcuc/209:28:362
26786992420,2cyclictest0-21swapper/110:18:391
26786992419,3cyclictest0-21swapper/109:43:401
26786992419,3cyclictest0-21swapper/109:43:401
26786992419,3cyclictest0-21swapper/109:33:401
26786992419,3cyclictest0-21swapper/109:33:401
26786992418,4cyclictest30536-21fschecks_count11:43:291
26786992418,4cyclictest30536-21fschecks_count11:43:291
26786992418,4cyclictest30536-21fschecks_count11:43:291
26786992418,4cyclictest0-21swapper/111:28:291
26786992417,5cyclictest9663-21kernelversion12:13:321
26786992417,5cyclictest9663-21kernelversion12:13:321
26786992416,6cyclictest26375-21cron11:33:171
26786992416,6cyclictest26375-21cron11:33:171
26786992416,6cyclictest26375-21cron11:33:171
26786992415,7cyclictest27832-21sed11:33:391
26786992415,7cyclictest27832-21sed11:33:391
26785992420,2cyclictest0-21swapper/008:58:400
26785992420,2cyclictest0-21swapper/008:58:400
26785992419,3cyclictest0-21swapper/012:38:390
26785992419,3cyclictest0-21swapper/012:38:390
26785992418,4cyclictest26769-21cyclictest09:28:320
26785992418,4cyclictest26769-21cyclictest09:28:320
26785992417,5cyclictest20025-21idleruntime09:48:300
97242230,3sleep20-21swapper/210:48:282
97242230,3sleep20-21swapper/210:48:282
97242230,3sleep20-21swapper/210:48:282
26787992319,3cyclictest351rcuc/212:38:402
26787992319,3cyclictest351rcuc/212:38:402
26787992317,4cyclictest351rcuc/210:30:432
26787992317,4cyclictest351rcuc/210:30:432
26787992317,4cyclictest351rcuc/210:30:432
26787992317,4cyclictest351rcuc/209:35:152
26787992317,4cyclictest351rcuc/209:35:152
26786992317,4cyclictest29537-21/usr/sbin/munin08:48:401
26786992317,4cyclictest29537-21/usr/sbin/munin08:48:401
26786992317,4cyclictest29537-21/usr/sbin/munin08:48:401
26786992313,7cyclictest30782-21latency_hist10:18:241
26786992313,7cyclictest30782-21latency_hist10:18:241
26786992313,7cyclictest30782-21latency_hist10:18:241
26785992319,3cyclictest26769-21cyclictest08:48:170
26785992319,3cyclictest26769-21cyclictest08:48:170
26785992319,3cyclictest26769-21cyclictest08:48:170
26785992319,2cyclictest0-21swapper/009:43:300
26785992318,3cyclictest0-21swapper/010:53:400
26785992318,3cyclictest0-21swapper/010:53:400
26785992318,3cyclictest0-21swapper/010:53:400
26785992317,5cyclictest8632-21sshd12:09:410
26785992317,4cyclictest24284-21sendmail_mailtr09:58:380
26785992317,4cyclictest24284-21sendmail_mailtr09:58:380
26785992317,4cyclictest24284-21sendmail_mailtr09:58:380
26785992317,3cyclictest0-21swapper/010:28:350
26785992317,3cyclictest0-21swapper/010:28:350
26785992317,3cyclictest0-21swapper/010:28:350
26785992316,5cyclictest1346-21avahi-daemon09:48:370
26785992316,5cyclictest1346-21avahi-daemon09:48:370
26787992217,3cyclictest351rcuc/211:41:222
26787992217,3cyclictest351rcuc/211:41:222
26787992217,3cyclictest351rcuc/210:42:452
26787992217,3cyclictest351rcuc/210:42:452
26787992217,3cyclictest351rcuc/210:42:452
26786992218,3cyclictest2584-21grep10:28:301
26786992218,3cyclictest2584-21grep10:28:301
26786992218,3cyclictest2584-21grep10:28:301
26786992217,3cyclictest0-21swapper/108:58:341
26786992217,3cyclictest0-21swapper/108:58:341
26786992217,2cyclictest0-21swapper/111:13:381
26786992217,2cyclictest0-21swapper/111:13:381
26786992217,2cyclictest0-21swapper/111:13:381
26786992217,2cyclictest0-21swapper/111:13:381
26786992216,4cyclictest0-21swapper/109:13:401
26786992216,4cyclictest0-21swapper/109:13:401
26786992216,3cyclictest0-21swapper/111:28:291
26786992215,5cyclictest9998-21sshd09:22:401
26786992215,5cyclictest9998-21sshd09:22:401
26785992218,3cyclictest482-21ntp_offset11:48:340
26785992218,3cyclictest482-21ntp_offset11:48:340
26785992213,7cyclictest4747-21needreboot10:33:340
26785992213,7cyclictest4747-21needreboot10:33:340
189052220,3sleep30-21swapper/311:13:173
189052220,3sleep30-21swapper/311:13:173
189052220,3sleep30-21swapper/311:13:173
26786992115,4cyclictest0-21swapper/112:03:341
26786992115,4cyclictest0-21swapper/112:03:341
26786992115,3cyclictest0-21swapper/108:43:301
26786992115,3cyclictest0-21swapper/108:43:301
26786992115,3cyclictest0-21swapper/108:43:301
26786992112,7cyclictest20701-21kernelversion08:23:331
26786992112,7cyclictest20701-21kernelversion08:23:331
26786992110,9cyclictest11096-21wc09:23:371
26786992110,9cyclictest11096-21wc09:23:371
26785992114,2cyclictest181rcu_preempt08:32:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional