You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 20:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Sep 07, 2026 12:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40437422860,2chrt75-21kworker/3:1+events09:34:163
40221372770,6chrt0-21swapper/309:14:143
3899571994635,8cyclictest4160461-21cat11:30:012
3899571994438,4cyclictest3955580-21kworker/u8:2+events_unbound09:04:132
3899571994339,3cyclictest3921755-21kworker/u8:1+events_unbound08:04:112
3899571994233,6cyclictest3904483-21latency_hist07:15:012
3899565994236,3cyclictest1-21systemd07:35:000
38950132423,13sleep03895039-21apt-get07:09:060
3899571994136,3cyclictest4079677-21kworker/u8:2+events_unbound10:29:192
3899567994132,6cyclictest278-21systemd-journal10:44:081
3899565994132,7cyclictest4185303-21latency_hist11:55:000
3899565994034,4cyclictest4175161-21kworker/u8:2+events_unbound12:34:110
3899565994032,6cyclictest3931441-21latency_hist07:40:010
3899571993933,4cyclictest3986097-21kworker/u8:3+events_unbound09:24:132
3899567993929,8cyclictest4110494-21gpgv10:40:001
3899565993926,10cyclictest4110451-21apt-get10:40:010
3899571993833,4cyclictest3055708-21kworker/u8:2+flush-8:007:49:142
3899565993824,10cyclictest278-21systemd-journal09:53:090
3899571993732,4cyclictest4175161-21kworker/u8:2+flush-8:012:29:232
3899567993727,8cyclictest278-21systemd-journal12:00:001
3899567993627,6cyclictest6223-21latency_hist12:10:011
3899567993627,6cyclictest3981492-21/usr/sbin/munin08:34:181
3899565993628,6cyclictest4015450-21grep09:04:250
3899565993625,8cyclictest21079-21latency_hist12:25:010
3899571993526,6cyclictest4060470-21kworker/u8:0+events_unbound10:04:212
389956599356,17cyclictest576-21runrttasks07:24:210
3899571993429,3cyclictest4103304-21kworker/u8:3+events_unbound10:49:242
389956599349,17cyclictest3955800-21grep08:04:240
389956599345,18cyclictest0-21swapper/010:19:090
3899565993411,15cyclictest4019986-21ld09:09:190
3899571993329,3cyclictest4103304-21kworker/u8:3+events_unbound11:15:012
3899567993328,3cyclictest4002226-21kthreadcore08:54:141
3899567993328,3cyclictest3945585-21needreboot07:54:171
389956599337,15cyclictest3995168-21ntpq08:44:190
3899565993325,7cyclictest4091411-21sshd10:24:090
389956599332,19cyclictest0-21swapper/012:39:060
389956599332,15cyclictest838-21mta-sts-daemon10:09:180
3899565993317,10cyclictest4050429-21grep09:39:250
3899565993311,10cyclictest0-21swapper/010:29:480
3899567993227,4cyclictest3955580-21kworker/u8:2+flush-8:008:44:551
3899567993226,4cyclictest4103304-21kworker/u8:3+flush-8:011:24:101
3899567993226,4cyclictest4060470-21kworker/u8:0+events_unbound10:29:101
3899567993226,4cyclictest3055708-21kworker/u8:2+flush-8:007:24:251
3899567993225,5cyclictest4175161-21kworker/u8:2+events_unbound12:04:251
3899565993224,6cyclictest4155195-21apt-get11:25:010
3899565993223,6cyclictest278-21systemd-journal09:25:000
41817502310,3sleep1161rcu_preempt11:54:151
3899567993126,4cyclictest4060446-21idleruntime-cro09:50:001
3899567993126,3cyclictest3990817-21cron08:40:001
3899567993126,3cyclictest32232-21irqrtprio12:39:131
3899567993125,4cyclictest4140311-21idleruntime-cro11:10:011
3899567993124,5cyclictest3997089-21irqrtprio08:49:151
389956599318,10cyclictest4029849-21ntpq09:19:180
389956599317,11cyclictest920-21python312:04:250
389956599317,11cyclictest4104867-21ntpq10:34:190
389956599316,11cyclictest4084825-21ntpq10:14:190
389956599315,16cyclictest4179635-21/usr/sbin/munin11:49:230
389956599315,15cyclictest4116953-21ps10:49:150
389956599313,18cyclictest4189879-21python311:59:240
3899565993125,4cyclictest4074879-21chrt10:04:220
3899565993122,7cyclictest3980954-21latency_hist08:30:010
3899565993121,8cyclictest11694-21/usr/sbin/munin12:19:170
3899565993120,9cyclictest2098-21diskstats12:09:100
3899565993110,8cyclictest3975631-21python308:24:250
3899567993025,4cyclictest3955580-21kworker/u8:2+events_unbound08:19:221
3899567993025,3cyclictest4103304-21kworker/u8:3+flush-8:010:49:091
389956599306,5cyclictest4045235-21/usr/sbin/munin09:34:240
389956599306,12cyclictest4129834-21ntpq10:59:240
389956599306,12cyclictest4129834-21ntpq10:59:240
389956599306,12cyclictest10492-21/usr/sbin/munin12:14:190
389956599305,13cyclictest3940719-21ntpq07:49:200
389956599304,15cyclictest4144723-21ntpq11:14:220
389956599304,15cyclictest3910765-21ntpq07:19:210
389956599303,17cyclictest3990241-21ntpq08:39:200
389956599303,16cyclictest3961925-21df_inode08:14:090
3899565993024,4cyclictest3951205-21ls08:00:000
389956599302,17cyclictest3941876-21sshd07:54:070
389956599301,27cyclictest4040469-21munin-run09:30:000
3899571992924,4cyclictest3986097-21kworker/u8:3+flush-8:008:39:252
3899571992923,4cyclictest11656-21kworker/u8:1+events_unbound12:39:192
3899571992920,7cyclictest4040507-21cp09:30:002
3899567992925,2cyclictest0-21swapper/110:20:001
3899567992924,4cyclictest4140330-21kworker/u8:2+events_unbound11:29:171
3899567992924,3cyclictest4021257-21sshd09:14:081
3899567992922,5cyclictest278-21systemd-journal10:10:091
3899567992919,8cyclictest4075862-21/usr/sbin/munin10:09:201
389956599297,11cyclictest4171252-21/usr/sbin/munin11:44:110
389956599297,10cyclictest4169652-21ntpq11:39:200
389956599296,13cyclictest4146335-21/usr/sbin/munin11:19:140
389956599296,11cyclictest4131501-21/usr/sbin/munin11:04:110
389956599295,15cyclictest4005119-21ntpq08:54:200
389956599295,14cyclictest4115090-21ntpq10:44:200
389956599295,14cyclictest4059861-21ntpq09:49:200
389956599295,12cyclictest4159718-21ntpq11:29:180
389956599295,12cyclictest4010008-21ntpq08:59:210
389956599295,12cyclictest3985339-21ntpq08:34:220
389956599294,15cyclictest4164769-21ntpq11:34:210
389956599294,15cyclictest4136004-21aten2_r5power_p11:09:090
389956599294,15cyclictest4051860-21ps09:44:150
389956599294,15cyclictest3970443-21ntpq08:19:220
389956599294,14cyclictest3996617-21diskstats08:49:110
389956599293,13cyclictest3920962-21ntp_states07:29:230
3899565992924,3cyclictest4023319-21kthreadcore09:14:150
3899571992824,2cyclictest4026364-21fschecks_count09:19:102
3899571992823,4cyclictest4175161-21kworker/u8:2+events_unbound12:20:232
3899567992824,2cyclictest4051436-21cut09:44:111
3899567992824,2cyclictest4006551-21cut08:59:131
3899567992823,3cyclictest3852056-21kworker/u8:0+flush-8:007:34:241
3899567992820,6cyclictest278-21systemd-journal10:00:001
3899567992820,6cyclictest278-21systemd-journal10:00:001
3899567992819,6cyclictest278-21systemd-journal08:12:091
3899567992819,2cyclictest421rcuog/209:09:201
389956599285,9cyclictest4122025-21/usr/sbin/munin10:54:140
389956599285,10cyclictest3935799-21ntpq07:44:200
389956599284,15cyclictest3900213-21/usr/sbin/munin07:14:090
389956599283,15cyclictest22018-21hddtemp_smartct12:29:110
389956599283,14cyclictest4066862-21irqstats09:59:160
389956599283,14cyclictest4066862-21irqstats09:59:150
389956599282,15cyclictest3957117-21hddtemp_smartct08:09:090
3899571992722,4cyclictest3941264-21kworker/u8:3+flush-8:008:09:182
3899571992722,4cyclictest11656-21kworker/u8:1+flush-8:012:19:262
3899567992721,5cyclictest4103304-21kworker/u8:3+events_unbound11:19:111
3899567992721,5cyclictest4034867-21kworker/u8:0+flush-8:009:29:261
3899567992721,4cyclictest4180316-21apt-key11:50:001
3899567992721,4cyclictest4135367-21cron11:04:591
3899567992721,4cyclictest4095483-21unixbench_multi10:24:251
3899567992721,4cyclictest4060470-21kworker/u8:0+flush-8:010:34:251
3899567992721,4cyclictest3932025-21apt-get07:44:061
3899567992720,5cyclictest3986097-21kworker/u8:3+flush-8:009:19:181
3899567992719,5cyclictest3899374-21latency_hist07:10:001
41803092260,5sleep3481ktimers/311:50:003
3899571992623,2cyclictest4185930-21aten2_r5power_e11:59:082
3899571992623,2cyclictest3981606-21aten2_r5power_p08:34:092
3899571992618,6cyclictest3917375-21diskstats07:29:112
3899571992610,3cyclictest40179642cut09:09:142
3899567992622,3cyclictest4046250-21aten2_r5power_p09:39:081
3899567992620,5cyclictest4159803-21kworker/u8:1+flush-8:011:30:271
3899567992620,4cyclictest3975865-21sed08:24:261
3899567992620,4cyclictest3852056-21kworker/u8:0+events_unbound07:15:031
3899567992620,4cyclictest11062-21unixbench_singl12:14:261
3899571992522,2cyclictest4121196-21aten2_r5power_e10:54:082
3899571992522,2cyclictest3971604-21aten2_r5power_c08:24:082
3899571992521,2cyclictest4106300-21cpuspeed_turbos10:39:082
3899571992521,2cyclictest4066291-21fschecks_time09:59:132
3899571992521,2cyclictest4066291-21fschecks_time09:59:122
3899571992519,4cyclictest4130302-21unixbench_multi10:59:302
3899571992519,4cyclictest4130302-21unixbench_multi10:59:302
3899567992521,3cyclictest3904514-21systemd-run07:15:011
3899567992520,4cyclictest3955580-21kworker/u8:2-ext4-rsv-conversion09:05:001
3899567992520,4cyclictest3921374-21unixbench_multi07:29:281
3899567992519,4cyclictest4075174-21unixbench_multi10:04:241
3899567992519,4cyclictest4010669-21kworker/u8:1+events_unbound09:24:091
3899567992519,4cyclictest3921755-21kworker/u8:1+events_unbound07:39:241
3899571992421,1cyclictest4151108-21cut11:24:112
3899571992417,5cyclictest4010669-21kworker/u8:1+events_unbound10:05:072
3899567992419,4cyclictest4010669-21kworker/u8:1+flush-8:009:54:241
3899567992419,4cyclictest3852056-21kworker/u8:0+events_unbound07:59:131
3899567992419,3cyclictest0-21swapper/108:09:211
3899567992417,5cyclictest3971036-21kworker/u8:0+flush-8:008:29:211
3899571992319,2cyclictest4165168-21unixbench_multi11:34:252
3899571992318,4cyclictest4000737-21turbostat.cron08:50:002
3899571992317,4cyclictest4103304-21kworker/u8:3+events_unbound12:05:082
3899571992314,7cyclictest3916423-21cp07:25:012
389957199230,13cyclictest3910713-21ntpq07:19:192
3899567992319,2cyclictest4172968-21kthreadcore11:44:141
3899567992319,2cyclictest0-21swapper/110:55:001
3899567992318,4cyclictest291ktimers/109:34:071
3899567992317,5cyclictest4175161-21kworker/u8:2+flush-8:012:34:211
3899567992317,4cyclictest4150249-21kworker/u8:0+flush-8:011:39:251
3899567992317,4cyclictest3941189-21unixbench_multi07:49:261
3899567992317,4cyclictest26007-21awk12:30:001
389957199222,10cyclictest3970921-21users08:19:262
3899571992218,2cyclictest3961945-21fschecks_count08:14:102
3899567992216,4cyclictest15972-21unixbench_multi12:19:251
3899571992118,2cyclictest4165909-21aten2_r5power_c11:39:072
3899571992117,2cyclictest4115566-21unixbench_singl10:44:262
3899571992117,2cyclictest0-21swapper/211:50:002
389957199211,10cyclictest4021537-21hddtemp_smartct09:14:112
3899567992116,3cyclictest0-21swapper/112:24:111
3899567992115,4cyclictest4060470-21kworker/u8:0+flush-8:011:00:001
3899567992115,4cyclictest4060470-21kworker/u8:0+flush-8:011:00:001
3899567992115,4cyclictest1-21systemd11:10:081
3899567992113,6cyclictest3956181-21latency_hist08:05:001
389957199203,3cyclictest39-21ksoftirqd/210:15:022
389957199202,2cyclictest161rcu_preempt08:00:002
3899571992017,2cyclictest4060305-21unixbench_multi09:49:272
3899571992017,2cyclictest26868-21fschecks_count12:34:112
3899571992016,3cyclictest4041114-21kworker/u8:3+flush-8:009:33:352
389957199201,5cyclictest3976798-21df08:29:092
3899571992015,4cyclictest4010669-21kworker/u8:1+flush-8:009:35:052
389957199201,4cyclictest3995269-21ntp_states08:44:222
3899571992011,7cyclictest3930444-21tr07:39:172
3899571991915,2cyclictest0-21swapper/207:54:102
3899571991914,3cyclictest10854-21sed12:14:262
3899571991910,6cyclictest3923688-21tr07:34:152
389957199190,8cyclictest4064787-21sed09:54:192
389957199190,10cyclictest39348601kthreadcore07:44:152
38950042193,9sleep30-21swapper/307:09:013
3899571991815,1cyclictest0-21swapper/209:44:092
3899571991813,3cyclictest0-21swapper/210:24:142
38947612184,10sleep20-21swapper/207:05:512
3899571991713,3cyclictest4005011-21needreboot08:54:172
3899571991713,2cyclictest0-21swapper/208:59:282
3899571991711,4cyclictest0-21swapper/212:04:152
389957199170,8cyclictest4136530-21sed11:09:132
41323432160,4chrt371rcuc/211:04:142
389957199166,8cyclictest371rcuc/210:34:162
389957199163,4cyclictest0-21swapper/211:19:592
389957199162,4cyclictest0-21swapper/210:15:062
389957199162,13cyclictest0-21swapper/211:42:532
40659752152,8sleep30-21swapper/309:59:083
40659752152,8sleep30-21swapper/309:59:083
40511472152,8sleep30-21swapper/309:44:083
3899571991511,3cyclictest4181227-21fschecks_count11:54:122
70942144,6sleep30-21swapper/312:14:133
41410622143,7sleep30-21swapper/311:14:123
41833052132,7sleep30-21swapper/311:54:193
41501942132,7sleep30-21swapper/311:20:003
41265652132,7sleep30-21swapper/310:59:183
41265652132,7sleep30-21swapper/310:59:183
41211422134,5sleep30-21swapper/310:54:093
41005832132,6sleep30-21swapper/310:30:013
39661632132,6sleep30-21swapper/308:15:013
39611002132,7sleep30-21swapper/308:10:003
319572132,7sleep30-21swapper/312:39:123
20992132,7sleep30-21swapper/312:09:113
41751692121,7sleep30-21swapper/311:45:003
41563572122,6sleep30-21swapper/311:29:123
41082342122,6sleep30-21swapper/310:39:163
40960072122,6sleep30-21swapper/310:27:083
40814812122,6sleep30-21swapper/310:14:133
40763802122,6sleep30-21swapper/310:09:153
40647472122,6sleep30-21swapper/309:54:193
40455882122,6sleep30-21swapper/309:35:013
40161352123,6sleep30-21swapper/309:08:573
40046902122,6sleep30-21swapper/308:54:173
39817612122,6sleep30-21swapper/308:34:123
39648892122,6sleep30-21swapper/308:14:173
39507132122,6sleep30-21swapper/307:59:243
39418332122,6sleep30-21swapper/307:53:593
39370272122,6sleep30-21swapper/307:49:103
39359972122,6sleep30-21swapper/307:44:243
39264472122,6sleep30-21swapper/307:35:013
39220642122,6sleep30-21swapper/307:34:103
39108452122,6sleep30-21swapper/307:19:253
39009022122,6sleep30-21swapper/307:14:153
216422122,6sleep30-21swapper/312:29:103
113862122,6sleep30-21swapper/312:15:093
41906352112,6sleep30-21swapper/312:01:573
41856282112,5sleep30-21swapper/311:56:153
41655552113,5sleep30-21swapper/311:35:133
41649452112,6sleep30-21swapper/311:34:253
41505222112,6sleep30-21swapper/311:20:573
41359062112,6sleep30-21swapper/311:09:013
41307452112,6sleep30-21swapper/311:00:473
41160372112,6sleep30-21swapper/310:46:583
41109802112,6sleep30-21swapper/310:40:413
40909992112,6sleep30-21swapper/310:21:473
40859922112,5sleep30-21swapper/310:16:093
40706202112,6sleep30-21swapper/310:00:083
40600842112,6sleep30-21swapper/309:49:253
40358982112,6sleep30-21swapper/309:28:153
40307552112,5sleep30-21swapper/309:20:173
40258512112,6sleep30-21swapper/309:16:153
40109172112,6sleep30-21swapper/309:00:353
39961712112,6sleep30-21swapper/308:46:563
39910772112,6sleep30-21swapper/308:40:093
39861652112,6sleep30-21swapper/308:35:593
39763512112,6sleep30-21swapper/308:26:453
39713322112,6sleep30-21swapper/308:21:193
39515822112,6sleep30-21swapper/308:01:503
39169872112,6sleep30-21swapper/307:27:433
39116742112,5sleep30-21swapper/307:21:093
260302112,5sleep30-21swapper/312:30:013
204512112,5sleep30-21swapper/312:24:193
40057182101,5sleep30-21swapper/308:55:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional