You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 16:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Apr 06, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3729910994642,3cyclictest3934411-21kworker/u8:4+events_unbound11:05:213
3729908994440,3cyclictest3991541-21kworker/u8:0+flush-259:011:50:242
3729910994233,6cyclictest3755077-21ntpq07:30:193
3729910994035,3cyclictest3934411-21kworker/u8:4+events_unbound12:05:173
3729910993633,2cyclictest3796954-21kworker/u8:1+flush-259:008:40:213
3729910993632,3cyclictest3724740-21kworker/u8:0+events_unbound07:45:213
3729905993630,4cyclictest3735271-21/usr/sbin/munin07:15:141
3729910993532,2cyclictest3934411-21kworker/u8:4+flush-259:012:10:203
3729910993531,3cyclictest3839377-21kworker/u8:0+events_unbound09:05:173
3729910993531,3cyclictest3724740-21kworker/u8:0+flush-259:007:55:173
3729908993529,4cyclictest3839377-21kworker/u8:0+flush-259:009:20:272
3729905993531,3cyclictest3724740-21kworker/u8:0+flush-259:007:25:231
3729905993529,4cyclictest3933762-21apt-get10:25:001
3729901993430,3cyclictest3849517-21kworker/u8:2+flush-259:009:10:150
3729910993330,2cyclictest3991541-21kworker/u8:0+flush-259:011:20:233
3729910993329,3cyclictest3796954-21kworker/u8:1+flush-259:008:20:203
3729910993327,4cyclictest3944608-21latency_hist10:35:013
3729901993328,4cyclictest4017909-21apt-get11:45:120
3729910993229,2cyclictest3796954-21kworker/u8:1+flush-259:008:15:003
3729910993228,3cyclictest3839377-21kworker/u8:0+flush-259:009:15:233
3729905993225,5cyclictest3949732-21apt-get10:40:011
3729905993219,4cyclictest252-21systemd-journal09:29:541
3729901993224,6cyclictest3933761-21latency_hist10:25:010
3729910993125,4cyclictest4012343-21/usr/sbin/munin11:40:133
3729910993124,5cyclictest3986343-21latency_hist11:15:013
3729905993125,4cyclictest3781934-21/usr/sbin/munin08:00:141
3729901993126,3cyclictest509-21rs:main0
3729901993126,3cyclictest4002105-21apt-get11:30:120
3729910993027,3cyclictest4027978-21kworker/u8:1+events_unbound12:00:133
3729910993026,3cyclictest3724740-21kworker/u8:0+flush-259:008:15:233
3729910993025,3cyclictest4069492-21/usr/sbin/munin12:35:153
3729910993025,3cyclictest4069492-21/usr/sbin/munin12:35:153
3729910993024,4cyclictest3955342-21latency_hist10:45:013
3729905993024,4cyclictest509-21rs:main1
3729901993026,3cyclictest3949749-21kworker/u8:2+flush-259:010:45:200
3729901993026,3cyclictest3860050-21apt-get09:15:120
3729910992925,3cyclictest4064283-21/usr/sbin/munin12:30:223
3729910992925,3cyclictest3934411-21kworker/u8:4+flush-259:010:50:183
3729908992925,3cyclictest3896454-21kworker/u8:0+flush-259:010:20:132
3729908992925,3cyclictest3886641-21kworker/u8:4+flush-259:009:40:132
3729905992921,6cyclictest3812846-21cp08:30:001
3729901992923,4cyclictest3745286-21latency_hist07:25:000
3729910992825,2cyclictest3796954-21kworker/u8:1+events_unbound08:55:253
3729910992824,3cyclictest3934411-21kworker/u8:4+events_unbound11:55:223
3729905992822,4cyclictest3771638-21apt-get07:50:111
3729905992822,4cyclictest3771638-21apt-get07:50:111
3729910992724,2cyclictest3896454-21kworker/u8:0+events_unbound10:05:223
3729910992724,2cyclictest3875910-21kworker/u8:3+events_unbound09:55:243
3729910992723,3cyclictest3896454-21kworker/u8:0+events_unbound10:00:213
3729910992722,3cyclictest3886647-21/usr/sbin/munin09:40:123
3729908992723,3cyclictest3896454-21kworker/u8:0+flush-259:010:05:252
3729908992721,4cyclictest3991496-21latency_hist11:20:002
3729908992721,4cyclictest252-21systemd-journal12:35:102
3729908992721,4cyclictest252-21systemd-journal12:35:092
3729901992723,3cyclictest3676351-21kworker/u8:3+flush-259:007:10:240
3729901992722,3cyclictest3812687-21gpgv08:30:000
3729901992721,4cyclictest3995812-21ntpq11:20:210
3729910992623,2cyclictest3724740-21kworker/u8:0+flush-259:007:25:243
3729910992622,3cyclictest3991541-21kworker/u8:0+events_unbound11:50:123
3729905992622,3cyclictest3729878-21kworker/u8:1+flush-259:007:35:161
3729905992621,3cyclictest3823514-21cat08:40:011
3729901992622,3cyclictest3934411-21kworker/u8:4+flush-259:012:30:150
3729910992522,2cyclictest3991541-21kworker/u8:0+events_unbound11:30:263
3729910992522,2cyclictest3724740-21kworker/u8:0+events_unbound07:10:143
3729910992521,2cyclictest3896454-21kworker/u8:0+flush-259:010:20:203
3729910992520,3cyclictest3807706-21kworker/u8:4+events_unbound08:25:173
3729910992520,3cyclictest3729878-21kworker/u8:1+flush-259:007:50:213
3729910992520,3cyclictest3729878-21kworker/u8:1+flush-259:007:50:203
3729910992519,4cyclictest4053670-21latency_hist12:20:013
3729910992519,4cyclictest3918563-21apt-get10:10:123
3729910992518,5cyclictest3869132-21ntpq09:20:213
3729908992523,1cyclictest3870193-21fwupd09:25:012
3729908992522,2cyclictest4048551-21kworker/u8:0+flush-259:012:30:002
3729908992521,3cyclictest4027978-21kworker/u8:1+flush-259:012:00:262
3729908992520,4cyclictest3934411-21kworker/u8:4+flush-259:011:10:262
3729905992519,4cyclictest4006967-21awk11:35:011
3729901992522,2cyclictest3934411-21kworker/u8:4+flush-259:012:40:000
3729901992522,2cyclictest3934411-21kworker/u8:4+flush-259:012:40:000
3729901992521,3cyclictest3729878-21kworker/u8:1+flush-259:007:35:250
3729910992421,2cyclictest3807706-21kworker/u8:4+flush-259:008:50:003
3729908992421,2cyclictest3934411-21kworker/u8:4+flush-259:011:00:152
3729905992418,4cyclictest252-21systemd-journal10:07:081
3729905992418,4cyclictest252-21systemd-journal09:59:071
3729901992420,2cyclictest3729878-21kworker/u8:1+flush-259:007:50:190
3729901992420,2cyclictest3729878-21kworker/u8:1+flush-259:007:50:190
3729901992418,4cyclictest4052754-21ntpq12:15:220
3729901992418,4cyclictest3885567-21ntpq09:35:210
3729910992320,2cyclictest4053694-21kworker/u8:3+events_unbound12:25:183
3729910992320,2cyclictest3807706-21kworker/u8:4+flush-259:008:50:203
3729910992317,4cyclictest509-21rs:main3
3729908992319,3cyclictest3729878-21kworker/u8:1+flush-259:007:20:212
3729905992319,3cyclictest4027978-21kworker/u8:1+flush-259:012:35:171
3729905992319,3cyclictest4027978-21kworker/u8:1+flush-259:012:35:171
3729905992317,4cyclictest3740413-21apt-get07:20:101
3729905992316,5cyclictest3881465-21cat09:35:011
3729905992316,5cyclictest3843398-21ntpq08:55:211
3729901992320,2cyclictest3796954-21kworker/u8:1+flush-259:009:00:000
3729910992219,2cyclictest3875910-21kworker/u8:3+events_unbound10:25:223
3729910992218,3cyclictest4053694-21kworker/u8:3+events_unbound12:25:013
3729910992218,3cyclictest3960405-21kworker/u8:3+events_unbound10:55:223
3729910992215,4cyclictest252-21systemd-journal09:35:003
3729905992216,4cyclictest4021965-21ntpq11:45:221
3729905992215,5cyclictest3864927-21latency_hist09:20:011
3729901992217,4cyclictest252-21systemd-journal08:55:010
3729910992118,2cyclictest3849517-21kworker/u8:2+events_unbound09:10:223
3729910992118,2cyclictest3729878-21kworker/u8:1+events_unbound07:20:233
3729910992117,3cyclictest3991541-21kworker/u8:0+events_unbound11:45:243
3729910992115,4cyclictest3756246-21apt-get07:35:123
3729908992119,1cyclictest3880860-21/usr/sbin/munin09:34:592
3729908992118,2cyclictest3934411-21kworker/u8:4+flush-259:012:05:162
3729908992118,2cyclictest3729878-21kworker/u8:1+flush-259:007:55:002
3729908992118,2cyclictest3729878-21kworker/u8:1+flush-259:007:55:002
3729908992117,3cyclictest3896454-21kworker/u8:0+events_unbound10:45:242
3729908992117,3cyclictest3886640-21kworker/u8:2+flush-259:009:45:242
3729908992117,3cyclictest3796954-21kworker/u8:1+events_unbound08:30:182
3729908992117,3cyclictest3724740-21kworker/u8:0+flush-259:007:40:252
3729908992115,4cyclictest252-21systemd-journal09:00:252
3729905992117,3cyclictest3796954-21kworker/u8:1+flush-259:008:40:241
3729905992117,3cyclictest3796954-21kworker/u8:1+flush-259:008:20:131
3729905992116,3cyclictest3724740-21kworker/u8:0+flush-259:007:45:171
3729901992118,2cyclictest3724740-21kworker/u8:0+flush-259:008:15:240
3729910992017,2cyclictest3750873-21kworker/u8:3+flush-259:008:05:153
3729910992017,2cyclictest3750873-21kworker/u8:3+events_unbound08:03:453
3729910992016,3cyclictest3796954-21kworker/u8:1+events_unbound08:35:173
3729908992017,2cyclictest3934411-21kworker/u8:4+events_unbound11:10:012
3729908992016,3cyclictest4027978-21kworker/u8:1+events_unbound12:10:242
3729901992017,2cyclictest3849517-21kworker/u8:2+flush-259:009:20:260
3729901992016,3cyclictest3839377-21kworker/u8:0+flush-259:009:00:160
3729901992015,3cyclictest3724740-21kworker/u8:0+flush-259:007:15:170
3729901992014,4cyclictest3828893-21latency_hist08:45:000
3729908991914,4cyclictest252-21systemd-journal08:05:002
3729901991915,3cyclictest3839377-21kworker/u8:0+flush-259:009:10:010
3729901991913,4cyclictest252-21systemd-journal10:55:010
3729910991815,2cyclictest3870274-21kworker/u8:1+events_unbound09:35:143
3729910991815,2cyclictest3729878-21kworker/u8:1+events_unbound07:16:013
3729910991814,3cyclictest3886641-21kworker/u8:4+events_unbound09:50:253
3729908991814,3cyclictest3724740-21kworker/u8:0+flush-259:007:25:252
3729905991815,2cyclictest509-21rs:main1
3729905991815,1cyclictest0-21swapper/107:35:011
3729905991813,4cyclictest3750873-21kworker/u8:3+flush-259:008:05:251
3729905991813,3cyclictest3724740-21kworker/u8:0+flush-259:007:40:161
3729901991815,2cyclictest3944610-21latency_hist10:34:590
3729901991815,2cyclictest3918289-21cron10:09:590
3729901991812,4cyclictest3970871-21latency_hist11:00:000
3729910991714,2cyclictest3849517-21kworker/u8:2+events_unbound09:25:153
3729910991714,2cyclictest3807706-21kworker/u8:4+events_unbound08:34:423
3729910991713,3cyclictest3934411-21kworker/u8:4+events_unbound10:38:093
3729910991713,3cyclictest3886641-21kworker/u8:4+events_unbound09:45:143
372990899172,8cyclictest3807481-21awk08:25:002
3729908991714,2cyclictest3796954-21kworker/u8:1+flush-259:008:45:162
3729901991714,2cyclictest509-21rs:main0
372990899169,5cyclictest4022797-21latency_hist11:50:002
372990599169,4cyclictest4027044-21ntpq11:50:201
3729905991613,2cyclictest0-21swapper/111:25:011
3729905991612,3cyclictest3807706-21kworker/u8:4+flush-259:008:50:251
3729905991610,4cyclictest252-21systemd-journal11:15:001
3729901991614,1cyclictest60350irq/132-enp0s29f1:rx-011:00:150
3729901991614,1cyclictest60350irq/132-enp0s29f1:rx-010:10:260
3729901991613,2cyclictest60350irq/132-enp0s29f1:rx-012:25:160
3729901991612,3cyclictest3839377-21kworker/u8:0+flush-259:009:30:260
3729901991612,3cyclictest3761385-21apt-get07:40:110
3729901991610,4cyclictest252-21systemd-journal12:10:000
3729910991512,2cyclictest3934411-21kworker/u8:4+events_unbound11:25:223
3729910991511,3cyclictest3729878-21kworker/u8:1+events_unbound07:42:153
372990899152,7cyclictest4001821-21cron11:30:012
3729908991512,2cyclictest3896454-21kworker/u8:0+flush-259:010:40:142
3729908991511,3cyclictest3991541-21kworker/u8:0+flush-259:011:30:202
3729908991511,3cyclictest3875910-21kworker/u8:3+flush-259:010:25:172
3729908991511,3cyclictest3796954-21kworker/u8:1+flush-259:008:35:262
3729908991511,2cyclictest3757267-21kthreadcore07:35:172
372990599159,4cyclictest3879930-21ntpq09:30:201
3729905991511,3cyclictest3976014-21kworker/u8:1+flush-259:011:15:161
3729905991511,3cyclictest3934411-21kworker/u8:4+flush-259:012:10:161
372990199159,4cyclictest3897357-21cat09:50:000
3729901991514,1cyclictest60350irq/132-enp0s29f1:rx-009:56:580
3729901991513,1cyclictest60350irq/132-enp0s29f1:rx-011:35:150
3729901991513,1cyclictest60350irq/132-enp0s29f1:rx-010:39:000
3729901991513,1cyclictest60350irq/132-enp0s29f1:rx-009:40:150
3729901991513,1cyclictest60350irq/132-enp0s29f1:rx-008:45:030
3729901991513,1cyclictest60350irq/132-enp0s29f1:rx-007:25:240
3729901991513,1cyclictest0-21swapper/012:15:000
3729901991512,2cyclictest61150irq/133-enp0s29f1:tx-011:25:090
3729901991512,2cyclictest60350irq/132-enp0s29f1:rx-009:26:340
3729901991512,2cyclictest60350irq/132-enp0s29f1:rx-007:55:120
3729901991512,2cyclictest3996924-21kworker/u8:2+flush-259:011:40:230
3729901991512,2cyclictest3991502-21turbostat11:20:010
372990199150,13cyclictest3823386-21munin-run08:40:010
3729910991411,2cyclictest3796954-21kworker/u8:1+events_unbound09:02:543
3729910991410,3cyclictest3896454-21kworker/u8:0+events_unbound10:17:163
3729910991410,3cyclictest3896454-21kworker/u8:0+events_unbound10:17:163
372990899148,5cyclictest3730112-21apt-get07:10:112
3729908991411,2cyclictest3934411-21kworker/u8:4+flush-259:012:30:182
3729908991411,2cyclictest3928616-21munin-plugin-st10:20:002
3729908991411,2cyclictest3928616-21munin-plugin-st10:20:002
3729908991411,2cyclictest0-21swapper/212:25:002
3729908991410,2cyclictest0-21swapper/208:55:182
3729905991411,2cyclictest509-21rs:main1
3729905991411,2cyclictest3839377-21kworker/u8:0+flush-259:009:00:241
3729905991411,1cyclictest0-21swapper/107:55:191
3729901991413,1cyclictest60350irq/132-enp0s29f1:rx-010:01:200
3729901991412,2cyclictest60350irq/132-enp0s29f1:rx-012:02:580
3729901991412,2cyclictest60350irq/132-enp0s29f1:rx-007:34:280
3729901991412,1cyclictest60350irq/132-enp0s29f1:rx-012:21:590
3729901991412,1cyclictest60350irq/132-enp0s29f1:rx-011:58:140
3729901991412,1cyclictest60350irq/132-enp0s29f1:rx-011:06:530
3729901991412,1cyclictest60350irq/132-enp0s29f1:rx-010:16:090
3729901991412,1cyclictest60350irq/132-enp0s29f1:rx-010:16:080
3729901991412,1cyclictest60350irq/132-enp0s29f1:rx-008:04:090
3729901991411,2cyclictest60350irq/132-enp0s29f1:rx-008:25:010
3729901991411,2cyclictest60350irq/132-enp0s29f1:rx-008:10:100
372990899139,3cyclictest3960405-21kworker/u8:3+flush-259:010:55:212
372990899139,3cyclictest3870274-21kworker/u8:1+flush-259:009:35:162
372990899136,5cyclictest3923444-21latency_hist10:15:002
372990899131,3cyclictest4017218-21latency_hist11:45:002
372990899131,3cyclictest3781682-21awk08:00:012
3729908991310,1cyclictest0-21swapper/207:15:172
3729901991312,1cyclictest60350irq/132-enp0s29f1:rx-008:06:100
3729901991311,1cyclictest60350irq/132-enp0s29f1:rx-007:49:590
3729901991310,2cyclictest3875910-21kworker/u8:3+flush-259:010:25:130
372990899128,3cyclictest3875910-21kworker/u8:3+flush-259:009:55:242
372990899128,3cyclictest3796954-21kworker/u8:1+events_unbound08:30:012
372990899128,2cyclictest0-21swapper/211:25:012
372990899128,2cyclictest0-21swapper/208:10:242
372990899127,4cyclictest3724740-21kworker/u8:0+events_unbound08:15:172
372990899124,6cyclictest4033104-21latency_hist11:59:592
372990599129,2cyclictest4054006-21cpuspeed_turbos12:20:121
3729901991210,1cyclictest60350irq/132-enp0s29f1:rx-011:50:130
372990899117,3cyclictest4051079-21kthreadcore12:15:192
372990899116,3cyclictest513-21gdbus08:45:012
372990899114,5cyclictest252-21systemd-journal09:15:002
372990899113,5cyclictest3839150-21latency_hist08:55:012
372990599118,2cyclictest3854980-21cpuspeed_turbos09:10:111
372990899107,2cyclictest3908697-21irqcore10:00:182
372990899105,3cyclictest3787246-21grep08:05:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional