You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 19:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sun Jan 11, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3766136993228,3cyclictest3828042-21kworker/u8:2+flush-259:008:20:262
3766132993126,3cyclictest3932231-21kworker/u8:3+flush-259:009:54:591
3766143993024,4cyclictest4057068-21latency_hist11:50:023
3766132993024,4cyclictest252-21systemd-journal07:42:271
3766131993026,3cyclictest4026405-21apt-get11:20:110
3766131993024,4cyclictest3886011-21latency_hist09:05:010
3766131993024,4cyclictest3771250-21latency_hist07:15:010
3766136992925,3cyclictest3750590-21kworker/u8:0+flush-259:007:10:212
3766132992924,3cyclictest3807705-21apt-get07:50:121
3766132992923,4cyclictest252-21systemd-journal11:32:451
3766136992824,3cyclictest3921681-21kworker/u8:1+flush-259:009:40:002
3766136992821,5cyclictest3942689-21apt-get10:00:002
3766132992825,2cyclictest3854653-21kworker/u8:3+flush-259:009:00:161
3766143992717,6cyclictest3843865-21apt-get08:25:003
3766132992623,2cyclictest3817949-21kworker/u8:0+flush-259:008:00:161
3766132992622,3cyclictest3785667-21kworker/u8:1+events_unbound09:05:141
3766143992520,3cyclictest252-21systemd-journal08:05:003
3766136992522,2cyclictest3921681-21kworker/u8:1+events_unbound10:00:002
3766136992521,3cyclictest4041629-21kworker/u8:0+flush-259:012:15:012
3766132992520,4cyclictest3974352-21apt-get10:30:101
3766132992520,3cyclictest3849397-21kworker/u8:2+flush-259:008:35:181
3766131992520,3cyclictest4072498-21sh12:04:590
3766143992419,4cyclictest4010229-21apt-get11:05:003
3766132992421,2cyclictest3932231-21kworker/u8:3+flush-259:010:05:151
3766132992420,3cyclictest4041629-21kworker/u8:0+flush-259:011:35:211
3766132992419,3cyclictest3932231-21kworker/u8:3+events_unbound10:20:221
3766143992318,4cyclictest3937810-21apt-get09:55:143
3766136992317,4cyclictest3844498-21cp08:25:012
3766136992317,4cyclictest3823119-21/usr/sbin/munin08:05:152
3766132992318,4cyclictest3749739-21kworker/u8:2+events_unbound07:15:261
3766143992216,5cyclictest3891244-21kworker/u8:2+flush-259:009:20:173
3766143992216,4cyclictest3999778-40mandb10:53:453
3766132992218,3cyclictest4067634-21apt-get12:00:121
3766132992218,3cyclictest4031329-21kworker/u8:3+events_unbound11:25:241
3766132992218,3cyclictest3994625-21kworker/u8:1+flush-259:011:10:231
3766132992218,3cyclictest3786716-21sh07:30:001
3766132992217,3cyclictest3932231-21kworker/u8:3+flush-259:010:15:171
376614399219,1cyclictest3860141-21tr08:40:133
376614399215,4cyclictest513-21gdbus09:45:003
3766143992117,3cyclictest4031330-21kworker/u8:4+flush-259:011:30:003
3766143992116,3cyclictest3953700-21apt-get10:10:113
3766143992115,4cyclictest3932620-21/usr/sbin/munin09:50:143
3766136992117,3cyclictest3854653-21kworker/u8:3+flush-259:009:00:172
3766136992117,3cyclictest3849689-21/usr/sbin/munin08:30:142
3766132992119,1cyclictest252-21systemd-journal12:05:211
3766132992116,3cyclictest4010918-21kworker/u8:2+events_unbound11:20:201
3766132992115,4cyclictest252-21systemd-journal09:25:271
3766131992117,3cyclictest3786984-21apt-get07:30:110
3766131992114,5cyclictest3874728-21ntpq08:50:210
3766131992114,5cyclictest3837498-21ntpq08:15:230
3766143992015,3cyclictest252-21systemd-journal07:54:273
3766132992017,2cyclictest3958623-21idleruntime-cro10:15:001
3766132992016,3cyclictest4041629-21kworker/u8:0+events_unbound12:20:141
3766132992015,4cyclictest3750590-21kworker/u8:0+flush-259:007:35:301
3766132992013,5cyclictest4094287-21cat12:30:001
3766131992016,3cyclictest4031329-21kworker/u8:3+flush-259:011:50:000
3766131992015,3cyclictest3870073-21latency_hist08:50:010
376614399198,1cyclictest0-21swapper/308:10:253
3766143991916,2cyclictest3849460-21latency_hist08:30:003
3766143991914,3cyclictest4072771-21apt-get12:05:113
3766136991915,3cyclictest3953666-21kworker/u8:0+flush-259:011:15:252
3766132991915,3cyclictest3989219-21kworker/u8:3+flush-259:010:45:151
3766132991914,3cyclictest3921681-21kworker/u8:1+events_unbound09:40:211
3766131991915,3cyclictest3994625-21kworker/u8:1+flush-259:011:10:250
3766143991811,5cyclictest252-21systemd-journal09:10:013
3766136991811,5cyclictest3932380-21latency_hist09:50:002
3766132991815,2cyclictest3785667-21kworker/u8:1+events_unbound08:05:241
3766132991814,3cyclictest4021241-21apt-get11:15:121
3766132991813,4cyclictest3854653-21kworker/u8:3+flush-259:009:35:281
3766132991812,4cyclictest3906642-21latency_hist09:25:011
3766131991813,4cyclictest3922055-21latency_hist09:40:000
3766131991813,3cyclictest252-21systemd-journal11:58:450
3766143991715,1cyclictest0-21swapper/312:20:003
3766143991711,4cyclictest4082805-21latency_hist12:15:013
3766136991713,3cyclictest3906632-21awk09:25:012
3766136991710,6cyclictest0-21swapper/210:10:002
3766132991713,3cyclictest3875240-21kworker/u8:2+events_unbound08:55:151
3766132991713,3cyclictest3854653-21kworker/u8:3+flush-259:008:45:161
3766132991713,3cyclictest3785667-21kworker/u8:1+events_unbound09:10:251
3766132991712,3cyclictest3989555-21cron10:45:001
3766132991710,4cyclictest252-21systemd-journal07:12:241
3766131991714,2cyclictest60350irq/132-enp0s29f1:rx-010:20:180
3766131991711,4cyclictest4025256-21ntpq11:15:220
3766131991711,4cyclictest252-21systemd-journal12:11:440
3766143991612,3cyclictest4026131-21idleruntime-cro11:20:013
376613699161,7cyclictest3901488-21cron09:20:012
3766136991614,1cyclictest0-21swapper/207:50:002
3766136991612,3cyclictest3838524-21gpgv08:20:002
3766136991612,3cyclictest252-21systemd-journal08:45:002
3766132991613,2cyclictest3817717-21cron08:00:001
3766132991612,3cyclictest4041629-21kworker/u8:0+flush-259:012:25:211
3766132991612,3cyclictest3785667-21kworker/u8:1+events_unbound08:15:281
3766132991611,3cyclictest252-21systemd-journal12:14:591
3766131991614,1cyclictest60350irq/132-enp0s29f1:rx-011:35:190
3766131991614,1cyclictest60350irq/132-enp0s29f1:rx-009:20:230
3766131991614,1cyclictest0-21swapper/011:45:000
3766131991613,2cyclictest60350irq/132-enp0s29f1:rx-010:40:240
3766131991613,2cyclictest60350irq/132-enp0s29f1:rx-009:50:140
3766131991613,2cyclictest4073182-21irqcore12:05:170
3766131991610,4cyclictest3879944-21ntpq08:55:210
3766131991610,4cyclictest3806617-21ntpq07:45:220
376614399159,5cyclictest3984837-21diskstats10:40:133
3766143991512,2cyclictest61850irq/147-enp0s29f1:tx-710:32:253
3766143991512,1cyclictest0-21swapper/312:30:153
376613699159,5cyclictest509-21rs:main2
376613699158,2cyclictest3927229-21idleruntime-cro09:45:002
3766136991512,2cyclictest509-21rs:main2
3766136991512,2cyclictest3995415-21irqcore10:50:182
3766136991511,3cyclictest3785667-21kworker/u8:1+events_unbound08:45:152
376613699151,12cyclictest252-21systemd-journal11:05:112
3766132991512,2cyclictest832-21runrttasks09:45:181
3766132991511,3cyclictest3953666-21kworker/u8:0+flush-259:010:55:161
3766132991510,3cyclictest4005333-21apt-get11:00:121
3766132991510,3cyclictest252-21systemd-journal12:38:461
376613199159,4cyclictest4098373-21ntpq12:30:190
3766131991514,1cyclictest60350irq/132-enp0s29f1:rx-010:26:560
3766131991514,1cyclictest60350irq/132-enp0s29f1:rx-010:26:550
3766131991513,2cyclictest61150irq/133-enp0s29f1:tx-008:35:180
3766131991513,1cyclictest60350irq/132-enp0s29f1:rx-010:50:150
3766131991513,1cyclictest60350irq/132-enp0s29f1:rx-010:39:590
3766131991513,1cyclictest60350irq/132-enp0s29f1:rx-010:30:250
3766131991513,1cyclictest60350irq/132-enp0s29f1:rx-010:10:140
3766131991513,1cyclictest60350irq/132-enp0s29f1:rx-010:00:190
3766131991513,1cyclictest60350irq/132-enp0s29f1:rx-009:56:430
3766131991513,1cyclictest60350irq/132-enp0s29f1:rx-008:30:240
3766131991513,1cyclictest60350irq/132-enp0s29f1:rx-008:20:220
3766131991513,1cyclictest60350irq/132-enp0s29f1:rx-008:05:150
3766131991512,2cyclictest60350irq/132-enp0s29f1:rx-012:39:190
3766131991512,2cyclictest60350irq/132-enp0s29f1:rx-011:07:150
3766131991512,2cyclictest60350irq/132-enp0s29f1:rx-011:00:110
3766131991512,2cyclictest60350irq/132-enp0s29f1:rx-009:11:150
3766131991512,2cyclictest60350irq/132-enp0s29f1:rx-009:05:250
3766131991512,2cyclictest60350irq/132-enp0s29f1:rx-007:55:130
3766131991511,3cyclictest60350irq/132-enp0s29f1:rx-009:25:200
3766131991511,3cyclictest3771521-21apt-get07:15:140
3766131991510,3cyclictest4000143-21/usr/sbin/munin10:55:140
376614399149,3cyclictest4099541-21/usr/sbin/munin12:35:143
376614399148,4cyclictest252-21systemd-journal10:30:003
376614399148,4cyclictest252-21systemd-journal10:30:003
3766143991412,1cyclictest0-21swapper/308:20:013
376613699149,3cyclictest4083447-21cron12:19:592
3766136991411,2cyclictest4071653-21ntp_kernel_pll_12:00:222
3766136991411,1cyclictest0-21swapper/212:30:002
3766136991410,3cyclictest507-21in:imuxsock07:30:002
3766132991410,3cyclictest4031330-21kworker/u8:4+events_unbound11:50:171
3766132991410,3cyclictest3953666-21kworker/u8:0+events_unbound10:54:461
3766132991410,3cyclictest3891244-21kworker/u8:2+events_unbound09:30:201
3766132991410,3cyclictest3859982-21kworker/u8:0+events_unbound08:50:211
3766132991410,3cyclictest3785667-21kworker/u8:1+flush-259:007:45:191
376613199148,4cyclictest252-21systemd-journal09:35:000
3766131991413,1cyclictest60350irq/132-enp0s29f1:rx-007:29:000
3766131991412,1cyclictest60350irq/132-enp0s29f1:rx-012:24:210
3766131991412,1cyclictest60350irq/132-enp0s29f1:rx-012:19:450
3766131991412,1cyclictest60350irq/132-enp0s29f1:rx-011:50:150
3766131991412,1cyclictest60350irq/132-enp0s29f1:rx-011:30:120
3766131991412,1cyclictest60350irq/132-enp0s29f1:rx-009:45:120
3766131991412,1cyclictest60350irq/132-enp0s29f1:rx-009:41:270
3766131991412,1cyclictest60350irq/132-enp0s29f1:rx-008:40:140
3766131991412,1cyclictest60350irq/132-enp0s29f1:rx-007:42:280
3766131991412,1cyclictest60350irq/132-enp0s29f1:rx-007:36:230
3766131991411,2cyclictest60350irq/132-enp0s29f1:rx-008:25:160
3766131991410,3cyclictest3854653-21kworker/u8:3+flush-259:009:15:170
376614399139,2cyclictest0-21swapper/311:25:003
376614399138,4cyclictest3932231-21kworker/u8:3+flush-259:010:15:193
376614399137,4cyclictest3901438-21sshd09:19:303
3766143991310,2cyclictest3781845-21apt-get07:25:113
376613699137,4cyclictest252-21systemd-journal10:38:452
3766136991311,1cyclictest0-21swapper/211:05:002
3766136991310,2cyclictest0-21swapper/209:30:002
3766136991310,1cyclictest0-21swapper/208:50:012
376613299139,3cyclictest4010792-21gpgv11:05:011
376613299139,3cyclictest3973834-21kworker/u8:2+events_unbound10:35:231
376613299137,4cyclictest252-21systemd-journal08:40:001
3766132991311,1cyclictest0-21swapper/110:00:161
3766132991310,2cyclictest4052275-21tr11:45:111
3766132991310,2cyclictest3817949-21kworker/u8:0+events_unbound08:24:211
3766132991310,2cyclictest3749739-21kworker/u8:2+flush-259:007:20:141
376613199139,3cyclictest3990063-21fschecks_time10:45:150
3766131991311,1cyclictest60350irq/132-enp0s29f1:rx-007:20:250
3766131991310,2cyclictest60350irq/132-enp0s29f1:rx-011:28:520
376614399129,2cyclictest4041196-21unixbench_singl11:30:253
376614399129,2cyclictest3931909-21unixbench_multi09:45:263
376614399129,2cyclictest3881157-21cpuspeed_turbos09:00:133
376614399127,4cyclictest3750590-21kworker/u8:0+flush-259:007:17:573
376614399127,3cyclictest4071627-21grep12:00:223
376614399126,4cyclictest252-21systemd-journal07:50:003
376613699129,2cyclictest3969331-21cpuspeed_turbos10:25:152
376613699129,2cyclictest3969331-21cpuspeed_turbos10:25:152
376613699129,2cyclictest3963306-21unixbench_multi10:15:262
376613699129,2cyclictest3914333-21kthreadcore09:30:182
376613699129,2cyclictest3810008-21kthreadcore07:50:182
376613699129,2cyclictest0-21swapper/211:50:252
376613699127,3cyclictest4077607-21cron12:09:592
376613299129,2cyclictest4041629-21kworker/u8:0+events_unbound11:57:461
376613299128,3cyclictest4031330-21kworker/u8:4+events_unbound11:40:271
376613299128,3cyclictest3932231-21kworker/u8:3+events_unbound10:25:041
376613299128,3cyclictest3932231-21kworker/u8:3+events_unbound10:25:041
376613299128,3cyclictest3921681-21kworker/u8:1+flush-259:009:55:211
376613299120,5cyclictest38988691kthreadcore09:15:191
376613199129,2cyclictest60350irq/132-enp0s29f1:rx-010:15:230
376613199129,2cyclictest3953007-21unixbench_singl10:05:260
376613199129,2cyclictest3822455-21unixbench_singl08:00:270
376614399118,2cyclictest3948602-21cpuspeed_turbos10:05:123
376614399118,2cyclictest3858862-21ntp_kernel_pll_08:35:223
376614399118,2cyclictest0-21swapper/308:50:163
376613699119,1cyclictest0-21swapper/208:10:172
376613699118,2cyclictest4047075-21cpuspeed_turbos11:40:122
376613699118,2cyclictest3974575-21fschecks_time10:30:132
376613699118,2cyclictest3797424-21cpuspeed_turbos07:40:132
376613699117,2cyclictest37921532sleep207:35:182
376613699117,2cyclictest0-21swapper/211:30:152
376613699110,9cyclictest3958629-21awk10:15:002
376613299117,3cyclictest4031330-21kworker/u8:4+flush-259:012:19:161
376613299117,3cyclictest3849397-21kworker/u8:2+flush-259:008:33:581
376613299117,3cyclictest3785667-21kworker/u8:1+events_unbound07:30:121
376613199118,2cyclictest0-21swapper/007:10:000
376614399108,1cyclictest0-21swapper/308:55:133
376614399108,1cyclictest0-21swapper/307:35:253
376614399107,2cyclictest1-21systemd11:11:453
376614399107,1cyclictest0-21swapper/310:35:163
376614399106,3cyclictest491ktimers/308:30:123
376614399106,2cyclictest0-21swapper/312:30:013
376614399101,2cyclictest3968971-21latency_hist10:25:003
376613699107,2cyclictest4046748-21latency_hist11:40:012
376613699107,2cyclictest4031977-21irqcore11:25:172
376613699107,2cyclictest0-21swapper/211:10:142
376613699106,3cyclictest3812933-21cpuspeed_turbos07:55:142
376613699106,2cyclictest4000319-21df10:55:132
376613699104,4cyclictest490-21dbus-daemon10:45:002
37661439996,2cyclictest3906969-21cpuspeed_turbos09:25:113
37661439996,2cyclictest0-21swapper/309:35:143
37661369997,1cyclictest0-21swapper/210:45:152
37661369997,1cyclictest0-21swapper/209:10:202
37661369996,2cyclictest3791057-21ntp_offset07:30:232
37661369995,2cyclictest3855871-21kernelversion08:35:182
37661369994,3cyclictest4103649-21ntp_states12:35:242
37661369990,2cyclictest3781583-21latency_hist07:25:002
37661369981,5cyclictest4083874-21df_inode12:20:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional