You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 19:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Thu Jun 04, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3908360994742,4cyclictest4131762-21latency_hist10:45:012
3908360993935,3cyclictest3949731-21kworker/u8:1+flush-259:008:55:142
3908363993732,3cyclictest4027793-21kworker/u8:4+flush-259:010:50:163
3908360993733,2cyclictest15754-21kworker/u8:2+flush-259:012:35:182
3908360993732,3cyclictest3954901-21/usr/sbin/munin07:55:232
3908356993731,4cyclictest4038316-21/usr/sbin/munin09:15:211
3908360993226,4cyclictest3939220-21latency_hist07:40:002
3908352993227,3cyclictest3929185-21apt-get07:30:110
3908363993123,7cyclictest4054024-21kworker/u8:0+flush-259:009:40:003
3908360993126,4cyclictest4064284-21latency_hist09:40:002
3908360993026,3cyclictest4027793-21kworker/u8:4+flush-259:011:45:242
3908360993025,3cyclictest4137558-21/usr/sbin/munin10:50:142
3908352993025,3cyclictest4100809-21apt-get10:15:100
3908360992925,3cyclictest3899200-21kworker/u8:3+flush-259:007:14:592
3908352992925,3cyclictest3913673-21kworker/u8:4+flush-259:008:15:000
3908352992823,3cyclictest20882-21gpgv12:05:000
3908352992822,4cyclictest57352-21latency_hist12:40:000
3908363992721,5cyclictest4147667-21latency_hist11:00:013
3908352992720,4cyclictest4038072-21latency_hist09:15:010
3908363992620,4cyclictest335557-21systemd-journal07:34:283
3908360992622,3cyclictest3850052-21kworker/u8:1+flush-259:007:20:002
3908360992621,4cyclictest3970745-21cat08:10:012
3908352992622,3cyclictest15754-21kworker/u8:2+flush-259:012:20:000
3908352992621,4cyclictest4162331-21kworker/u8:2+flush-259:011:15:230
3908360992522,2cyclictest4001952-21kworker/u8:0+flush-259:009:00:152
3908360992521,3cyclictest3933849-21kworker/u8:2+flush-259:008:00:262
3908356992521,3cyclictest10862-21apt-get11:55:111
3908352992521,3cyclictest3939487-21apt-get07:40:130
3908352992513,10cyclictest0-21swapper/010:45:010
3908363992421,2cyclictest4137550-21kworker/u8:1+flush-259:011:00:153
3908356992421,2cyclictest4059407-21apt-get09:35:111
3908352992419,3cyclictest4026912-21ntpq09:00:200
3908352992418,4cyclictest4022582-21latency_hist09:00:000
3908363992320,2cyclictest4002168-21kworker/u8:3+events_unbound09:40:123
3908363992317,4cyclictest4002361-21diskstats08:40:133
3908360992317,4cyclictest4151949-21ntpq11:00:192
3908356992319,3cyclictest4126537-21latency_hist10:40:011
3908356992319,3cyclictest4002168-21kworker/u8:3+flush-259:009:10:151
3908356992319,3cyclictest335557-21systemd-journal09:25:011
3908363992219,2cyclictest4027793-21kworker/u8:4+flush-259:010:40:003
3908363992219,2cyclictest4027793-21kworker/u8:4+flush-259:009:15:013
3908363992219,2cyclictest4002168-21kworker/u8:3+flush-259:008:45:203
3908363992218,3cyclictest335557-21systemd-journal07:13:273
3908363992216,4cyclictest3975961-21/usr/sbin/munin08:15:133
3908360992219,2cyclictest4162331-21kworker/u8:2+flush-259:011:35:152
390835699221,20cyclictest1-21systemd12:35:011
390835299226,15cyclictest4178696-21idleruntime-cro11:30:000
3908352992215,5cyclictest4074665-21latency_hist09:50:000
3908363992115,4cyclictest335557-21systemd-journal12:25:003
3908360992118,2cyclictest4002168-21kworker/u8:3+events_unbound09:10:162
3908360992118,2cyclictest3850051-21kworker/u8:0+flush-259:007:40:172
3908356992117,3cyclictest3899200-21kworker/u8:3+flush-259:007:10:241
3908352992117,3cyclictest4106012-21apt-get10:20:100
3908352992117,3cyclictest4106012-21apt-get10:20:100
3908352992115,4cyclictest3928919-21latency_hist07:30:010
390835299211,17cyclictest52233-21latency_hist12:35:000
390835299210,2cyclictest3938322-21ntpq07:35:180
3908363992015,4cyclictest3928352-21sed07:25:243
3908363992015,3cyclictest509-21rs:main3
3908363992014,5cyclictest3948583-21ntpq07:45:213
3908363992014,4cyclictest3970351-21cat08:10:003
3908360992016,3cyclictest4027793-21kworker/u8:4+flush-259:010:15:202
3908360992015,4cyclictest4073736-21ntpq09:45:202
3908356992017,2cyclictest4027793-21kworker/u8:4+flush-259:011:25:151
390835299201,7cyclictest4094491-21ntpq10:05:210
3908352992014,4cyclictest4121591-21apt-get10:35:110
3908352992013,5cyclictest4136433-21ntpq10:45:210
3908360991913,4cyclictest15710-21latency_hist12:00:002
3908356991915,3cyclictest4002168-21kworker/u8:3+flush-259:009:05:111
3908356991915,3cyclictest3949731-21kworker/u8:1+flush-259:008:30:171
3908356991915,3cyclictest3913673-21kworker/u8:4+flush-259:007:30:261
3908356991915,2cyclictest0-21swapper/112:05:001
390835299198,10cyclictest14703-21needreboot11:55:190
3908352991914,3cyclictest4137583-21apt-get10:50:120
390835299191,2cyclictest4115265-21ntpq10:25:190
390835299191,2cyclictest3922842-21ntpq07:20:180
390835299191,1cyclictest4120489-21ntpq10:30:210
390835299191,1cyclictest0-21swapper/011:40:130
390835299191,16cyclictest4078993-21ntpq09:50:210
390835299191,14cyclictest4043508-21apt-get09:20:110
390835299191,14cyclictest3949764-21apt-get07:50:120
390835299191,14cyclictest3949764-21apt-get07:50:110
390835299190,5cyclictest4099649-21chrt10:10:210
3908363991814,3cyclictest4002168-21kworker/u8:3+flush-259:009:20:133
3908363991813,3cyclictest20838-21cron12:05:003
3908360991815,2cyclictest0-21swapper/209:20:012
3908360991814,3cyclictest31832-21kworker/u8:0+flush-259:012:15:162
3908360991813,4cyclictest4053088-21ntpq09:25:202
3908360991813,4cyclictest3933849-21kworker/u8:2+flush-259:007:55:002
3908360991813,4cyclictest3933849-21kworker/u8:2+flush-259:007:55:002
3908360991812,4cyclictest3929347-21diskstats07:30:152
3908356991814,3cyclictest4027793-21kworker/u8:4+flush-259:010:10:251
3908356991813,4cyclictest4137550-21kworker/u8:1+flush-259:011:05:001
390835299181,7cyclictest4007384-21apt-get08:45:110
390835299181,2cyclictest4162273-21ntpq11:10:200
390835299181,2cyclictest3948574-21ntpq07:45:200
390835299181,2cyclictest3912572-21ntpq07:10:210
390835299181,1cyclictest4084143-21ntpq09:55:210
390835299181,15cyclictest4168741-21df11:20:120
390835299181,15cyclictest3997506-21ps08:35:170
390835299181,15cyclictest3985107-21ntpq08:20:210
390835299181,14cyclictest4153104-21apt-get11:05:110
390835299180,5cyclictest4148330-21ps11:00:150
390835299180,4cyclictest4059122-21cron09:35:000
390835299180,4cyclictest4006409-21sensors_temp08:40:210
390835299180,4cyclictest3996556-21apt-key08:35:010
390835299180,1cyclictest4053154-21ntpq09:25:220
3908360991714,2cyclictest3949731-21kworker/u8:1+flush-259:008:50:252
3908360991713,3cyclictest5437-21kworker/u8:0+flush-259:011:50:242
3908360991712,3cyclictest4105987-21/usr/sbin/munin10:20:132
3908360991712,3cyclictest4105987-21/usr/sbin/munin10:20:122
3908360991712,3cyclictest4048445-21latency_hist09:25:012
3908360991712,3cyclictest3985568-21grep08:20:252
3908360991711,5cyclictest4189667-21grep11:40:172
3908356991715,1cyclictest0-21swapper/110:09:591
3908356991714,2cyclictest3970102-21apt08:10:001
3908356991713,3cyclictest3997083-21apt-get08:35:121
3908356991713,3cyclictest3850051-21kworker/u8:0+flush-259:007:45:011
3908356991713,3cyclictest15754-21kworker/u8:2+flush-259:012:25:141
3908356991710,5cyclictest4173530-21latency_hist11:25:011
390835299171,4cyclictest4179204-21/usr/sbin/munin11:30:150
390835299171,2cyclictest4038475-21tr09:15:120
3908352991712,4cyclictest4028038-21apt-get09:05:100
3908352991712,3cyclictest42168-21apt-get12:25:100
390835299171,14cyclictest9728-21ntpq11:50:210
390835299171,14cyclictest4484-21ntpq11:45:200
390835299171,14cyclictest4188071-21ntpq11:35:190
390835299171,14cyclictest4089285-21ntpq10:00:190
390835299171,14cyclictest3986558-21/usr/sbin/munin08:25:140
390835299171,14cyclictest26421-21turbostat.cron12:10:000
390835299171,13cyclictest37459-21ps12:20:160
390835299170,6cyclictest4016589-21ntpq08:50:220
390835299170,4cyclictest4147139-21unixbench-2d10:55:240
390835299170,4cyclictest3976106-21tr08:15:120
390835299170,4cyclictest3955185-21/usr/sbin/munin07:55:130
390835299170,4cyclictest3913888-21fschecks_count07:15:150
390835299170,2cyclictest3965669-21ps08:05:160
390835299170,15cyclictest30676-21ntpq12:10:210
390835299170,14cyclictest3960258-21/usr/sbin/munin08:00:150
3908360991613,2cyclictest4002168-21kworker/u8:3+events_unbound08:45:012
3908360991613,2cyclictest3970138-21gpgv08:10:012
3908360991612,3cyclictest4002168-21kworker/u8:3+flush-259:009:40:152
3908360991611,4cyclictest335557-21systemd-journal11:35:002
3908356991612,3cyclictest20854-21apt-get12:05:021
390835299161,1cyclictest0-21swapper/007:10:000
390835299160,13cyclictest4059460-21/usr/sbin/munin09:35:120
3908363991513,1cyclictest0-21swapper/308:40:013
3908363991512,2cyclictest4168080-21kworker/u8:1+events_unbound11:20:173
3908363991512,2cyclictest4021622-21needreboot08:55:183
3908363991511,3cyclictest4168316-21cron11:20:003
3908363991510,3cyclictest335557-21systemd-journal09:05:003
390836099159,4cyclictest4116153-21latency_hist10:30:012
3908360991513,1cyclictest0-21swapper/209:10:012
3908356991511,3cyclictest3933849-21kworker/u8:2+flush-259:008:25:241
3908356991511,3cyclictest26438-21kworker/u8:1+flush-259:012:10:261
3908356991511,2cyclictest4027768-21idleruntime-cro09:05:011
390835699150,14cyclictest509-21rs:main1
3908363991411,2cyclictest4130942-21ntp_offset10:40:223
3908363991411,2cyclictest15754-21kworker/u8:2+flush-259:012:05:173
3908363991410,3cyclictest3933849-21kworker/u8:2+flush-259:008:25:153
3908363991410,3cyclictest335557-21systemd-journal10:35:003
3908360991412,1cyclictest0-21swapper/209:55:172
3908360991410,3cyclictest4173792-21apt-get11:25:102
3908360991410,3cyclictest4089222-21needreboot10:00:192
3908360991410,3cyclictest3922889-21ntpq07:20:202
390835699149,4cyclictest4049065-21cat09:25:021
390835699149,4cyclictest3985154-21ntpq08:20:221
3908356991412,1cyclictest0-21swapper/109:50:181
3908356991411,2cyclictest0-21swapper/107:29:591
3908356991410,3cyclictest335557-21systemd-journal11:40:011
3908363991311,1cyclictest4054540-21runrttasks09:30:143
3908363991311,1cyclictest4051420-21kthreadcore09:25:173
3908363991311,1cyclictest3996426-21apt-key08:35:003
3908363991311,1cyclictest0-21swapper/310:00:163
3908363991310,2cyclictest0-21swapper/312:30:003
3908363991310,1cyclictest0-21swapper/308:55:013
390836099139,3cyclictest4027793-21kworker/u8:4+flush-259:010:09:592
390836099135,6cyclictest19971-21ntpq12:00:212
3908360991310,2cyclictest21798-21fschecks_time12:05:152
390835699139,3cyclictest3913673-21kworker/u8:4+flush-259:007:20:221
3908356991311,1cyclictest0-21swapper/108:00:011
3908356991311,1cyclictest0-21swapper/107:50:011
3908356991310,2cyclictest4189322-21cpuspeed_turbos11:40:141
3908356991310,2cyclictest4085477-21fschecks_count10:00:141
3908356991310,2cyclictest4027793-21kworker/u8:4+flush-259:010:25:241
3908356991310,2cyclictest4017971-21fschecks_time08:55:121
3908356991310,2cyclictest15754-21kworker/u8:2+flush-259:012:20:251
390836399129,2cyclictest4186377-21kthreadcore11:35:163
390836399129,2cyclictest4176085-21tr11:25:173
390836399129,2cyclictest4080327-21fschecks_count09:55:143
390836399129,2cyclictest4027793-21kworker/u8:4+events_unbound11:10:203
390836399129,2cyclictest3933849-21kworker/u8:2+flush-259:007:35:313
390836399129,2cyclictest10928-21cpuspeed_turbos11:55:133
390836399129,2cyclictest0-21swapper/311:35:003
390836399129,2cyclictest0-21swapper/309:45:143
390836399128,3cyclictest4027793-21kworker/u8:4+flush-259:010:10:163
390836399128,3cyclictest3959806-21cron08:00:003
390836399126,5cyclictest51330-21ntpq12:30:183
390836099128,3cyclictest4095385-21kworker/u8:0+flush-259:010:30:212
3908360991210,1cyclictest0-21swapper/212:20:162
3908360991210,1cyclictest0-21swapper/207:25:142
390835699129,2cyclictest4167908-21unixbench_singl11:15:231
390835699129,2cyclictest3973113-21kthreadcore08:10:181
3908356991210,1cyclictest4081149-21kthreadcore09:55:181
3908356991210,1cyclictest0-21swapper/111:35:011
3908356991210,1cyclictest0-21swapper/109:35:001
390835699120,3cyclictest3908358-21cat07:10:001
390836399119,1cyclictest33439-21kthreadcore12:15:173
390836399118,2cyclictest4153170-21cpuspeed_turbos11:05:133
390836399118,2cyclictest0-21swapper/309:50:163
390836399116,3cyclictest5852-21cut11:50:133
390836099118,2cyclictest4121763-21fschecks_count10:35:132
390836099115,4cyclictest490-21dbus-daemon09:55:002
390835699118,2cyclictest56891-21unixbench_multi12:35:271
390835699118,2cyclictest3976074-21cpuspeed_turbos08:15:111
390835699118,2cyclictest3949830-21cpuspeed_turbos07:50:121
390835699118,2cyclictest3949830-21cpuspeed_turbos07:50:111
390835699118,2cyclictest3934744-21sed07:35:141
390835699118,2cyclictest0-21swapper/110:15:171
390835699117,3cyclictest4027793-21kworker/u8:4+flush-259:010:20:201
390835699117,3cyclictest4027793-21kworker/u8:4+flush-259:010:20:201
3908356991110,1cyclictest3150ktimers/111:50:191
390836399108,1cyclictest4028451-21irqcore09:05:163
390836399108,1cyclictest0-21swapper/311:45:123
390836399108,1cyclictest0-21swapper/310:20:163
390836399108,1cyclictest0-21swapper/310:20:163
390836399108,1cyclictest0-21swapper/308:00:203
390836399108,1cyclictest0-21swapper/307:20:123
390836399107,2cyclictest0-21swapper/312:35:203
390836399107,1cyclictest39497672sleep307:50:133
390836399107,1cyclictest39497672sleep307:50:123
390836099108,1cyclictest0-21swapper/212:25:202
390836099108,1cyclictest0-21swapper/209:30:142
390836099107,2cyclictest3986693-21sed08:25:162
390836099104,4cyclictest4167800-21sshd11:15:232
390835699108,1cyclictest4154547-21kthreadcore11:05:171
390835699107,2cyclictest521-21cpuspeed_turbos11:45:121
39083639997,1cyclictest4042228-21needreboot09:15:173
39083609997,1cyclictest3976409-21grep08:15:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional