You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 21:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Dec 24, 2025 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
555661994239,2cyclictest779001-21kworker/u8:2+events_unbound10:46:231
555656994137,3cyclictest581579-21apt-get07:34:590
555661993936,2cyclictest565901-21kworker/u8:3+events_unbound08:20:221
555661993733,3cyclictest603227-21kworker/u8:2+events_unbound08:00:141
555661993633,2cyclictest798924-21kworker/u8:4+events_unbound11:05:141
555668993330,2cyclictest711069-21gpgv09:40:003
555661993330,2cyclictest747447-21kworker/u8:0+events_unbound10:25:221
555661993330,2cyclictest747447-21kworker/u8:0+events_unbound10:25:211
555661993330,2cyclictest633610-21kworker/u8:2+events_unbound08:31:011
555661993330,2cyclictest565901-21kworker/u8:3+events_unbound07:50:221
555656993331,1cyclictest783234-21fwupd10:46:210
555661993229,2cyclictest603227-21kworker/u8:2+events_unbound08:05:011
555661993229,2cyclictest565901-21kworker/u8:3+events_unbound07:45:141
555661993226,5cyclictest840947-21latency_hist11:45:011
555661993128,2cyclictest840883-21kworker/u8:0+events_unbound11:50:201
555661993128,2cyclictest779001-21kworker/u8:2+events_unbound10:55:231
555661993025,2cyclictest664792-21kworker/u8:3+events_unbound09:20:221
55565699300,28cyclictest1-21systemd10:40:000
555661992927,2cyclictest613320-21kworker/u8:0+events_unbound08:10:151
555661992825,2cyclictest819476-21kworker/u8:3+events_unbound12:00:141
555661992825,2cyclictest747447-21kworker/u8:0+events_unbound10:50:171
555656992824,3cyclictest623880-21apt-get08:15:130
555668992720,5cyclictest624041-21diskstats08:15:153
555661992724,2cyclictest768051-21kworker/u8:1+events_unbound11:14:201
555661992724,2cyclictest716519-21kworker/u8:3+events_unbound10:15:141
555661992724,2cyclictest628380-21kworker/u8:1+events_unbound08:26:211
555661992724,2cyclictest501895-21kworker/u8:1+events_unbound07:40:191
555664992620,4cyclictest829778-21ntpq11:30:242
555661992624,2cyclictest633610-21kworker/u8:2+events_unbound08:45:081
555661992624,2cyclictest565901-21kworker/u8:3+events_unbound07:20:271
555661992623,2cyclictest809524-21kworker/u8:2+events_unbound11:35:161
555661992623,2cyclictest639288-21kworker/u8:0+events_unbound08:52:191
555661992623,2cyclictest618687-21kworker/u8:4+events_unbound08:15:201
555661992623,2cyclictest565901-21kworker/u8:3+events_unbound08:35:191
555661992622,3cyclictest639288-21kworker/u8:0+events_unbound09:37:201
555661992620,4cyclictest893025-21cp12:35:001
555656992622,3cyclictest633610-21kworker/u8:2+flush-259:008:50:160
555668992521,3cyclictest747447-21kworker/u8:0+flush-259:011:15:243
555668992519,4cyclictest252-21systemd-journal09:56:203
555668992518,5cyclictest891823-21ntpq12:30:233
555661992522,2cyclictest556079-21kworker/u8:0+events_unbound07:11:391
555661992521,3cyclictest840883-21kworker/u8:0+events_unbound12:25:171
555661992521,3cyclictest522886-21kworker/u8:2+events_unbound07:37:201
555668992420,3cyclictest664792-21kworker/u8:3+flush-259:008:55:193
555664992415,8cyclictest500-21systemd-logind12:15:012
555661992421,2cyclictest825065-21kworker/u8:4+events_unbound11:30:231
555661992421,2cyclictest664792-21kworker/u8:3+events_unbound09:10:201
555661992420,3cyclictest710672-21kworker/u8:2+events_unbound10:39:211
555661992420,3cyclictest252-21systemd-journal07:25:201
555668992319,3cyclictest814987-21apt-get11:20:133
555668992318,4cyclictest555404-21latency_hist07:10:003
555668992317,4cyclictest762891-21latency_hist10:30:013
555661992321,2cyclictest716519-21kworker/u8:3+events_unbound09:53:211
555661992320,2cyclictest716519-21kworker/u8:3+events_unbound11:00:261
555661992320,2cyclictest716519-21kworker/u8:3+events_unbound10:01:201
555661992320,2cyclictest664792-21kworker/u8:3+events_unbound09:25:171
555664992215,5cyclictest252-21systemd-journal11:40:002
555661992220,2cyclictest565901-21kworker/u8:3+events_unbound07:18:211
555661992219,2cyclictest866872-21kworker/u8:1+events_unbound12:24:201
555661992219,2cyclictest716519-21kworker/u8:3+events_unbound10:41:211
555661992219,2cyclictest716519-21kworker/u8:3+events_unbound09:59:591
555661992219,2cyclictest639288-21kworker/u8:0+events_unbound09:43:011
555661992219,2cyclictest639288-21kworker/u8:0+events_unbound09:32:201
555661992217,2cyclictest664792-21kworker/u8:3+events_unbound08:55:231
555656992214,6cyclictest767200-21ntpq10:30:230
555668992116,4cyclictest587375-21apt-get07:40:123
555664992118,2cyclictest716519-21kworker/u8:3+flush-259:010:10:182
555661992119,2cyclictest882549-21kworker/u8:2+events_unbound12:35:211
555661992118,2cyclictest825065-21kworker/u8:4+events_unbound11:45:281
555661992118,2cyclictest501895-21kworker/u8:1+events_unbound07:30:161
555668992017,2cyclictest779001-21kworker/u8:2+flush-259:010:55:253
555668992016,2cyclictest252-21systemd-journal07:23:193
555668992015,4cyclictest757970-21/usr/sbin/munin10:25:133
55566499209,10cyclictest500-21systemd-logind12:05:012
555664992014,4cyclictest580754-21ntpq07:30:232
555661992018,2cyclictest819476-21kworker/u8:3+events_unbound11:59:201
555661992017,2cyclictest768051-21kworker/u8:1+events_unbound11:23:211
555661992017,2cyclictest501895-21kworker/u8:1+events_unbound07:55:161
555656992017,2cyclictest798924-21kworker/u8:4+flush-259:011:05:160
555656992017,2cyclictest0-21swapper/007:15:000
555656992015,4cyclictest252-21systemd-journal09:15:010
555668991916,2cyclictest639288-21kworker/u8:0+flush-259:008:40:173
555668991916,2cyclictest581579-21apt-get07:35:013
555668991913,4cyclictest649353-21latency_hist08:40:013
55566499195,3cyclictest252-21systemd-journal10:27:192
55566499195,3cyclictest252-21systemd-journal10:27:192
555664991914,4cyclictest664792-21kworker/u8:3+flush-259:009:00:182
555664991913,4cyclictest700763-21latency_hist09:30:002
555661991917,2cyclictest819476-21kworker/u8:3+events_unbound12:12:091
555661991917,2cyclictest710672-21kworker/u8:2+events_unbound10:21:481
555661991917,2cyclictest710672-21kworker/u8:2+events_unbound10:21:481
555661991917,2cyclictest639288-21kworker/u8:0+events_unbound09:00:271
555661991917,2cyclictest633610-21kworker/u8:2+events_unbound08:42:201
555661991916,2cyclictest747447-21kworker/u8:0+events_unbound11:15:261
555661991916,2cyclictest710672-21kworker/u8:2+events_unbound10:30:281
555661991916,2cyclictest664792-21kworker/u8:3+events_unbound09:19:321
555656991916,2cyclictest757721-21idleruntime-cro10:25:000
555656991916,2cyclictest757721-21idleruntime-cro10:25:000
555656991916,2cyclictest613320-21kworker/u8:0+flush-259:008:14:590
555656991915,3cyclictest892698-21https12:35:000
555656991913,4cyclictest618455-21latency_hist08:10:010
555668991815,2cyclictest700748-21cron09:29:593
555668991815,2cyclictest613984-21irqcore08:05:183
555664991815,2cyclictest814708-21cron11:20:002
555664991814,3cyclictest639288-21kworker/u8:0+flush-259:009:20:012
555664991814,2cyclictest716600-21sh09:45:002
555664991811,5cyclictest596555-21ntpq07:45:222
55566499180,5cyclictest252-21systemd-journal08:00:002
555661991815,2cyclictest664792-21kworker/u8:3+events_unbound09:08:051
555656991813,4cyclictest252-21systemd-journal12:09:590
555656991813,3cyclictest509-21rs:main0
555656991811,5cyclictest252-21systemd-journal09:34:590
555668991713,3cyclictest840883-21kworker/u8:0+flush-259:011:50:263
555668991713,3cyclictest685565-21/usr/sbin/munin09:15:153
555668991712,4cyclictest711729-21apt-get09:40:123
55566499175,3cyclictest623157-21awk08:10:262
55566499174,2cyclictest763225-21cpuspeed_turbos10:30:142
555664991713,3cyclictest633909-21idleruntime-cro08:25:002
55566499170,4cyclictest571298-21turbostat.cron07:24:592
555661991714,2cyclictest747447-21kworker/u8:0+events_unbound11:27:211
555661991714,2cyclictest716519-21kworker/u8:3+events_unbound09:49:181
555656991715,1cyclictest830659-21munin-plugin-st11:35:000
555656991714,2cyclictest60350irq/132-enp0s29f1:rx-008:55:180
555656991713,3cyclictest841188-21/usr/sbin/munin11:45:150
555656991713,3cyclictest779001-21kworker/u8:2+flush-259:010:55:160
555656991712,4cyclictest768051-21kworker/u8:1+flush-259:011:20:250
555656991711,4cyclictest690487-21latency_hist09:20:010
555668991613,2cyclictest825232-21latency_hist11:30:013
555668991613,2cyclictest634158-21/usr/sbin/munin08:25:173
555668991612,3cyclictest252-21systemd-journal08:33:193
555668991611,4cyclictest773218-21latency_hist10:40:003
555668991610,4cyclictest685329-21latency_hist09:15:013
55566499166,1cyclictest0-21swapper/207:25:212
55566499164,3cyclictest802461-21cut11:05:182
555664991613,2cyclictest747447-21kworker/u8:0+flush-259:010:40:012
555664991610,4cyclictest252-21systemd-journal10:45:072
55566499160,5cyclictest585761-21grep07:35:192
55566499160,1cyclictest587790-21irqcore07:40:162
555661991614,2cyclictest819476-21kworker/u8:3+events_unbound12:09:231
55565699169,5cyclictest831068-21diskstats11:35:150
555656991614,1cyclictest60350irq/132-enp0s29f1:rx-010:00:260
555656991613,2cyclictest507-21in:imuxsock10:10:000
555656991612,3cyclictest877423-21/usr/sbin/munin12:20:150
555656991612,2cyclictest869391-21kthreadcore12:10:200
555656991611,3cyclictest522886-21kworker/u8:2+flush-259:007:35:260
555656991610,3cyclictest252-21systemd-journal09:50:000
555668991512,2cyclictest710672-21kworker/u8:2+flush-259:010:04:493
555668991511,3cyclictest639288-21kworker/u8:0+flush-259:009:05:213
55566499156,2cyclictest500-21systemd-logind08:10:002
55566499155,1cyclictest0-21swapper/211:10:182
55566499155,1cyclictest0-21swapper/210:10:002
55566499153,3cyclictest755625-21cut10:20:192
55566499153,3cyclictest755625-21cut10:20:182
55566499153,3cyclictest680583-21df_inode09:10:142
55566499151,5cyclictest798335-21ntpq11:00:252
555664991512,2cyclictest895659-21kthreadcore12:35:192
55566199157,1cyclictest191rcu_preempt10:10:191
555661991512,2cyclictest737194-21kworker/u8:1+events_unbound10:05:561
555661991511,3cyclictest872246-21apt-get12:15:101
55565699159,4cyclictest690915-21diskstats09:20:150
555656991513,1cyclictest60350irq/132-enp0s29f1:rx-012:00:140
555656991513,1cyclictest60350irq/132-enp0s29f1:rx-011:25:240
555656991513,1cyclictest60350irq/132-enp0s29f1:rx-009:40:150
555656991513,1cyclictest60350irq/132-enp0s29f1:rx-007:45:150
555656991512,2cyclictest60350irq/132-enp0s29f1:rx-012:15:020
555656991512,2cyclictest60350irq/132-enp0s29f1:rx-010:27:190
555656991512,2cyclictest60350irq/132-enp0s29f1:rx-010:27:190
555656991511,3cyclictest571562-21apt-get07:25:120
555668991411,2cyclictest710672-21kworker/u8:2+flush-259:010:25:003
555668991411,2cyclictest710672-21kworker/u8:2+flush-259:010:25:003
555668991411,2cyclictest0-21swapper/308:15:003
555668991410,3cyclictest866872-21kworker/u8:1+flush-259:012:20:173
555668991410,3cyclictest840883-21kworker/u8:0+flush-259:012:26:533
55566499144,1cyclictest0-21swapper/210:45:002
555664991410,3cyclictest565901-21kworker/u8:3+flush-259:008:25:172
55566499140,4cyclictest889563-21sshd12:30:182
55566499140,4cyclictest832-21runrttasks11:20:132
55565699148,5cyclictest633070-21ntpq08:20:210
55565699147,6cyclictest0-21swapper/009:35:210
555656991413,1cyclictest60350irq/132-enp0s29f1:rx-011:54:500
555656991413,1cyclictest60350irq/132-enp0s29f1:rx-008:36:240
555656991412,1cyclictest60350irq/132-enp0s29f1:rx-011:10:070
555656991412,1cyclictest60350irq/132-enp0s29f1:rx-010:10:180
555656991412,1cyclictest60350irq/132-enp0s29f1:rx-008:45:200
555656991412,1cyclictest60350irq/132-enp0s29f1:rx-007:16:230
555656991411,2cyclictest634605-21irqcore08:25:170
555656991411,2cyclictest60350irq/132-enp0s29f1:rx-011:55:160
555656991411,2cyclictest60350irq/132-enp0s29f1:rx-009:05:180
555656991411,2cyclictest60350irq/132-enp0s29f1:rx-007:55:150
555656991411,2cyclictest501895-21kworker/u8:1+flush-259:007:51:500
55566899137,4cyclictest252-21systemd-journal07:50:003
555668991311,1cyclictest803323-21needreboot11:05:203
555668991310,2cyclictest853883-21kthreadcore11:55:193
555668991310,2cyclictest831336-21grep11:35:183
555668991310,2cyclictest602896-21latency_hist07:55:013
55566899130,12cyclictest864487-21kthreadcore12:05:193
55566499138,4cyclictest633610-21kworker/u8:2+flush-259:008:54:292
55566499138,3cyclictest252-21systemd-journal11:00:002
55566499133,5cyclictest561009-21basename07:15:002
555656991311,1cyclictest60350irq/132-enp0s29f1:rx-011:00:210
555656991311,1cyclictest60350irq/132-enp0s29f1:rx-009:55:170
555656991310,2cyclictest60350irq/132-enp0s29f1:rx-011:15:120
555656991310,2cyclictest60350irq/132-enp0s29f1:rx-010:15:160
555656991310,2cyclictest60350irq/132-enp0s29f1:rx-007:20:250
55566899129,2cyclictest752581-21sh10:20:003
55566899129,2cyclictest575540-21ntp_kernel_pll_07:25:213
55566899128,3cyclictest737194-21kworker/u8:1+flush-259:010:05:233
555668991210,1cyclictest0-21swapper/310:35:003
55566499129,2cyclictest839985-21needreboot11:40:192
55566499128,3cyclictest628802-21cat08:20:012
55566499128,3cyclictest565901-21kworker/u8:3+flush-259:008:35:162
55566499128,2cyclictest0-21swapper/212:00:002
55566499127,3cyclictest252-21systemd-journal10:05:002
55566499125,5cyclictest513-21gdbus07:55:002
55565699129,2cyclictest0-21swapper/007:10:000
555656991210,1cyclictest60350irq/132-enp0s29f1:rx-009:28:170
55566899119,1cyclictest0-21swapper/307:55:213
55566899117,3cyclictest804571-21apt-get11:10:123
55566899116,4cyclictest252-21systemd-journal08:05:003
55566499118,2cyclictest820534-21sed11:25:162
55566499117,3cyclictest501895-21kworker/u8:1+flush-259:008:04:592
55566499116,4cyclictest649373-21kworker/u8:1+flush-259:008:48:492
55566499116,4cyclictest252-21systemd-journal09:48:192
55565699117,3cyclictest603227-21kworker/u8:2+flush-259:008:00:260
55566899107,2cyclictest0-21swapper/311:40:163
55566899106,3cyclictest825572-21base6411:30:013
55566899105,3cyclictest252-21systemd-journal07:15:003
55566899100,9cyclictest61-21kcompactd010:10:523
55566499108,1cyclictest675388-21cpuspeed_turbos09:05:122
55566499108,1cyclictest0-21swapper/211:45:202
55565699107,2cyclictest60350irq/132-enp0s29f1:rx-007:40:170
5556689996,2cyclictest491ktimers/308:45:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional