You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 22:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Jul 20, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
236005994741,4cyclictest1607760-21fwupd09:27:143
236005994641,3cyclictest490506-21apt-get11:15:143
235998994542,2cyclictest365715-21kworker/u8:0+flush-259:009:40:141
235994994540,2cyclictest448709-21kworker/u8:3+flush-259:011:30:200
235998994441,2cyclictest277558-21kworker/u8:2+events_unbound09:20:001
236002994337,4cyclictest448462-21latency_hist10:35:012
235994994235,4cyclictest479950-21latency_hist11:05:000
236005994035,3cyclictest490666-21kworker/u8:2+events_unbound11:50:183
236005993934,3cyclictest542039-21kworker/u8:1+events_unbound12:25:003
236005993932,5cyclictest335557-21systemd-journal12:00:003
235998993936,2cyclictest531710-21kworker/u8:4+flush-259:012:05:201
235998993936,2cyclictest531710-21kworker/u8:4+flush-259:012:05:201
236005993834,2cyclictest505775-21kworker/u8:1+events_unbound11:35:233
236005993831,5cyclictest286946-21ntpq07:55:213
236002993834,3cyclictest345162-21kworker/u8:3+flush-259:009:05:232
236002993733,3cyclictest526036-21kworker/u8:3+flush-259:011:50:182
236002993731,4cyclictest277506-21latency_hist07:50:012
235998993633,2cyclictest235966-21kworker/u8:3+flush-259:007:45:211
235998993632,3cyclictest417469-21kworker/u8:0+flush-259:010:25:001
235998993632,3cyclictest235966-21kworker/u8:3+flush-259:007:19:411
236005993531,3cyclictest277558-21kworker/u8:2+flush-259:008:20:223
235998993531,3cyclictest277558-21kworker/u8:2+flush-259:009:10:151
236005993329,3cyclictest257081-21kworker/u8:4+flush-259:007:30:153
235998993330,2cyclictest474982-21kworker/u8:1+flush-259:011:00:211
235994993328,3cyclictest505775-21kworker/u8:1+flush-259:011:45:170
236005993228,3cyclictest485307-21kworker/u8:0+events_unbound11:10:153
236002993228,3cyclictest448709-21kworker/u8:3+flush-259:010:45:012
235998993229,2cyclictest490666-21kworker/u8:2+events_unbound11:20:181
235998993229,2cyclictest386457-21kworker/u8:1+flush-259:010:00:251
235998993227,3cyclictest277750-21/usr/sbin/munin07:50:141
236005993127,3cyclictest220585-21kworker/u8:0+flush-259:007:15:013
236005993127,3cyclictest220585-21kworker/u8:0+flush-259:007:15:003
235998993128,2cyclictest417469-21kworker/u8:0+flush-259:010:30:211
235994993127,3cyclictest401724-21kworker/u8:3+flush-259:010:10:160
236005993027,2cyclictest474982-21kworker/u8:1+flush-259:011:00:163
236005993027,2cyclictest465028-21kworker/u8:2+flush-259:010:55:013
236005993026,3cyclictest401724-21kworker/u8:3+flush-259:010:04:593
235998993027,2cyclictest220585-21kworker/u8:0+flush-259:007:10:181
235998993027,2cyclictest220585-21kworker/u8:0+flush-259:007:10:181
235998993026,2cyclictest386457-21kworker/u8:1+flush-259:010:40:191
235994993025,4cyclictest509-21rs:main0
235994993025,4cyclictest469866-21apt-get10:55:120
235998992926,2cyclictest235966-21kworker/u8:3+flush-259:007:40:001
235998992925,3cyclictest313760-21kworker/u8:0+events_unbound08:55:231
235994992924,4cyclictest355693-21/usr/sbin/munin09:05:250
235994992923,4cyclictest509-21rs:main0
235994992922,5cyclictest335557-21systemd-journal09:55:120
235998992825,2cyclictest505775-21kworker/u8:1+flush-259:011:40:241
235998992825,2cyclictest220585-21kworker/u8:0+events_unbound07:25:211
235994992822,4cyclictest267632-21diskstats07:40:140
236005992724,2cyclictest509-21rs:main3
236005992724,2cyclictest277558-21kworker/u8:2+flush-259:009:30:153
236005992724,2cyclictest220585-21kworker/u8:0+events_unbound07:25:133
236005992721,4cyclictest324563-21cat08:35:013
236002992721,4cyclictest412295-21latency_hist10:00:012
236002992721,4cyclictest313735-21latency_hist08:25:012
235998992724,2cyclictest531710-21kworker/u8:4+flush-259:011:55:231
235998992724,2cyclictest277558-21kworker/u8:2+flush-259:008:50:161
235998992723,3cyclictest509-21rs:main1
235998992722,4cyclictest541811-21latency_hist12:05:001
236005992623,2cyclictest345162-21kworker/u8:3+flush-259:009:00:253
236005992623,2cyclictest235966-21kworker/u8:3+events_unbound07:19:143
236005992622,3cyclictest386457-21kworker/u8:1+flush-259:010:15:003
236005992621,4cyclictest402376-21diskstats09:50:143
235998992624,2cyclictest277558-21kworker/u8:2+events_unbound08:15:191
235998992624,1cyclictest345162-21kworker/u8:3+flush-259:009:00:211
235998992623,2cyclictest542039-21kworker/u8:1+flush-259:012:10:161
235998992623,2cyclictest465028-21kworker/u8:2+events_unbound11:05:151
235998992621,4cyclictest328762-21ntpq08:35:211
235994992621,4cyclictest552780-21/usr/sbin/munin12:15:160
236005992522,2cyclictest365715-21kworker/u8:0+events_unbound09:15:243
236005992521,3cyclictest365715-21kworker/u8:0+events_unbound09:38:153
236005992521,3cyclictest282713-21latency_hist07:55:013
236002992521,3cyclictest277558-21kworker/u8:2+flush-259:008:30:182
236002992519,4cyclictest318914-21latency_hist08:30:022
235998992523,2cyclictest381011-21kworker/u8:3+events_unbound09:35:141
235998992523,1cyclictest235966-21kworker/u8:3+events_unbound07:55:251
235998992522,2cyclictest277558-21kworker/u8:2+flush-259:009:25:241
235998992522,2cyclictest277558-21kworker/u8:2+events_unbound08:45:171
235998992521,3cyclictest417469-21kworker/u8:0+flush-259:010:15:061
235998992521,3cyclictest277558-21kworker/u8:2+flush-259:008:20:241
236005992421,2cyclictest542039-21kworker/u8:1+flush-259:012:10:253
236005992421,2cyclictest401724-21kworker/u8:3+events_unbound09:57:143
236005992421,2cyclictest324071-21gpgv08:35:013
236005992420,3cyclictest386457-21kworker/u8:1+events_unbound10:20:133
236005992419,4cyclictest313760-21kworker/u8:0+flush-259:008:49:563
236002992420,3cyclictest386457-21kworker/u8:1+flush-259:010:45:262
236002992420,3cyclictest381247-21latency_hist09:30:012
235998992421,2cyclictest551807-21kworker/u8:2+events_unbound12:35:171
235998992421,2cyclictest448709-21kworker/u8:3+flush-259:010:55:231
235998992421,2cyclictest401724-21kworker/u8:3+flush-259:009:50:241
235998992421,2cyclictest386457-21kworker/u8:1+events_unbound10:35:131
235998992421,2cyclictest277558-21kworker/u8:2+events_unbound08:45:001
235998992421,2cyclictest277558-21kworker/u8:2+events_unbound08:30:201
235998992420,3cyclictest505775-21kworker/u8:1+events_unbound11:45:301
235998992420,3cyclictest297895-21kworker/u8:0+flush-259:008:10:211
235998992420,3cyclictest277558-21kworker/u8:2+flush-259:008:25:151
236005992320,2cyclictest542039-21kworker/u8:1+flush-259:012:15:193
236005992319,3cyclictest551807-21kworker/u8:2+flush-259:012:30:263
236002992320,2cyclictest235966-21kworker/u8:3+events_unbound07:40:002
236002992317,4cyclictest335557-21systemd-journal08:55:142
235998992320,2cyclictest505775-21kworker/u8:1+events_unbound11:35:151
235998992320,2cyclictest288305-21kworker/u8:1+events_unbound08:00:251
235998992318,4cyclictest272379-21latency_hist07:45:011
235994992318,4cyclictest509-21rs:main0
235994992318,4cyclictest509-21rs:main0
235994992317,4cyclictest521195-21latency_hist11:45:000
236005992219,2cyclictest386457-21kworker/u8:1+events_unbound10:25:213
236005992218,2cyclictest448709-21kworker/u8:3+flush-259:011:25:243
236002992217,4cyclictest510886-21latency_hist11:35:002
236002992216,4cyclictest443325-21latency_hist10:30:002
235998992219,2cyclictest551807-21kworker/u8:2+flush-259:012:20:151
235998992219,2cyclictest277558-21kworker/u8:2+flush-259:009:05:251
235998992217,3cyclictest509-21rs:main1
235994992216,4cyclictest302531-21ntpq08:10:230
236005992118,2cyclictest531710-21kworker/u8:4+events_unbound12:00:273
236005992118,2cyclictest235966-21kworker/u8:3+events_unbound07:39:433
236005992117,3cyclictest365715-21kworker/u8:0+events_unbound09:20:223
236005992115,4cyclictest318039-21ntpq08:25:223
236002992117,3cyclictest516066-21kworker/u8:0+flush-259:012:05:242
236002992117,3cyclictest516066-21kworker/u8:0+flush-259:012:05:242
235998992118,3cyclictest551807-21kworker/u8:2+events_unbound12:30:291
235994992118,2cyclictest448709-21kworker/u8:3+flush-259:011:25:210
236005992017,2cyclictest516066-21kworker/u8:0+flush-259:012:05:173
236005992017,2cyclictest516066-21kworker/u8:0+flush-259:012:05:173
236005992017,2cyclictest235966-21kworker/u8:3+events_unbound07:20:123
236005992015,3cyclictest417877-21diskstats10:05:133
236002992017,2cyclictest297895-21kworker/u8:0+flush-259:008:10:252
236002992016,3cyclictest235966-21kworker/u8:3+flush-259:007:20:242
236002992015,4cyclictest551807-21kworker/u8:2+flush-259:012:40:012
236002992015,4cyclictest287843-21latency_hist08:00:002
235998992018,2cyclictest448709-21kworker/u8:3+events_unbound10:50:181
235998992018,1cyclictest0-21swapper/111:15:011
235998992017,2cyclictest386457-21kworker/u8:1+flush-259:010:45:161
235998992017,2cyclictest365715-21kworker/u8:0+flush-259:009:45:201
235998992017,2cyclictest288305-21kworker/u8:1+events_unbound08:05:141
235994992017,1cyclictest0-21swapper/009:40:000
235994992015,3cyclictest335557-21systemd-journal07:56:140
235994992014,4cyclictest335557-21systemd-journal08:05:130
236005991916,2cyclictest568307-21kworker/u8:0+events_unbound12:35:193
236005991916,2cyclictest490666-21kworker/u8:2+flush-259:011:45:253
236005991916,2cyclictest417469-21kworker/u8:0+flush-259:010:30:233
236005991916,2cyclictest277558-21kworker/u8:2+flush-259:009:05:193
236005991915,3cyclictest277558-21kworker/u8:2+events_unbound08:50:203
236005991915,3cyclictest235966-21kworker/u8:3+flush-259:007:45:003
236002991916,2cyclictest313760-21kworker/u8:0+flush-259:008:35:162
236002991915,3cyclictest531710-21kworker/u8:4+flush-259:012:00:242
236002991914,3cyclictest552281-21base6412:15:002
236002991913,4cyclictest453662-21latency_hist10:40:012
235994991913,4cyclictest500534-21latency_hist11:25:000
235994991913,4cyclictest432957-21latency_hist10:20:010
236005991815,2cyclictest490666-21kworker/u8:2+events_unbound11:40:133
236005991815,2cyclictest235966-21kworker/u8:3+events_unbound07:49:463
236005991814,3cyclictest297895-21kworker/u8:0+events_unbound08:10:133
236005991814,2cyclictest297895-21kworker/u8:0+flush-259:008:10:003
236002991815,2cyclictest490666-21kworker/u8:2+events_unbound11:15:232
236002991815,2cyclictest281853-21ntp_kernel_pll_07:50:222
236002991814,3cyclictest365979-21/usr/sbin/munin09:15:212
235994991814,3cyclictest365715-21kworker/u8:0+flush-259:009:15:270
236005991714,2cyclictest308303-21kworker/u8:1+events_unbound08:18:133
236005991714,2cyclictest277558-21kworker/u8:2+flush-259:009:10:243
236005991713,3cyclictest350298-21latency_hist09:00:013
236002991714,2cyclictest387108-21irqcore09:35:172
236002991714,2cyclictest235966-21kworker/u8:3+flush-259:007:10:252
236002991714,2cyclictest235966-21kworker/u8:3+flush-259:007:10:242
236002991711,4cyclictest335557-21systemd-journal09:40:142
235998991714,2cyclictest401724-21kworker/u8:3+flush-259:009:55:171
235998991714,2cyclictest381011-21kworker/u8:3+events_unbound09:33:141
235998991714,2cyclictest235966-21kworker/u8:3+events_unbound07:20:131
235998991713,3cyclictest490666-21kworker/u8:2+events_unbound11:50:121
235998991713,3cyclictest277558-21kworker/u8:2+events_unbound09:20:171
235994991711,4cyclictest324665-21base6408:35:020
235994991711,4cyclictest250775-21ntpq07:20:210
236002991613,2cyclictest0-21swapper/212:00:002
236002991612,3cyclictest397059-21cpuspeed_turbos09:45:132
235998991613,2cyclictest257081-21kworker/u8:4+events_unbound07:30:191
235994991614,1cyclictest60350irq/132-enp0s29f1:rx-010:40:250
235994991613,2cyclictest60350irq/132-enp0s29f1:rx-012:25:240
235994991613,2cyclictest60350irq/132-enp0s29f1:rx-011:19:590
235994991613,2cyclictest60350irq/132-enp0s29f1:rx-009:00:190
235994991613,2cyclictest60350irq/132-enp0s29f1:rx-008:15:190
235994991613,2cyclictest60350irq/132-enp0s29f1:rx-008:01:280
235994991613,2cyclictest386396-21cron09:35:000
236005991512,2cyclictest386457-21kworker/u8:1+events_unbound09:45:223
236005991511,3cyclictest386457-21kworker/u8:1+flush-259:010:45:173
236002991511,2cyclictest0-21swapper/210:55:012
236002991510,4cyclictest235966-21kworker/u8:3+flush-259:008:04:512
235998991511,3cyclictest490666-21kworker/u8:2+events_unbound11:25:221
235994991513,2cyclictest60350irq/132-enp0s29f1:rx-011:36:310
235994991513,1cyclictest60350irq/132-enp0s29f1:rx-012:35:160
235994991513,1cyclictest60350irq/132-enp0s29f1:rx-010:25:210
235994991513,1cyclictest60350irq/132-enp0s29f1:rx-010:20:150
235994991513,1cyclictest60350irq/132-enp0s29f1:rx-009:27:500
235994991513,1cyclictest60350irq/132-enp0s29f1:rx-007:50:150
235994991512,2cyclictest60350irq/132-enp0s29f1:rx-012:00:160
235994991512,2cyclictest60350irq/132-enp0s29f1:rx-011:53:200
235994991512,2cyclictest60350irq/132-enp0s29f1:rx-010:05:180
235994991512,2cyclictest60350irq/132-enp0s29f1:rx-007:25:110
235994991512,2cyclictest536663-21turbostat12:00:000
235994991510,3cyclictest335557-21systemd-journal10:00:130
236005991410,3cyclictest330097-21diskstats08:40:153
236002991411,2cyclictest504736-21needreboot11:25:192
236002991411,2cyclictest334395-21unixbench_multi08:40:262
235998991411,2cyclictest551807-21kworker/u8:2+events_unbound12:19:441
235998991411,2cyclictest401724-21kworker/u8:3+events_unbound10:10:131
235998991410,3cyclictest386457-21kworker/u8:1+events_unbound10:05:121
23599499149,3cyclictest335557-21systemd-journal09:20:140
235994991412,2cyclictest60350irq/132-enp0s29f1:rx-012:34:250
235994991412,1cyclictest60350irq/132-enp0s29f1:rx-012:20:240
235994991412,1cyclictest60350irq/132-enp0s29f1:rx-008:43:210
235994991412,1cyclictest60350irq/132-enp0s29f1:rx-008:25:260
235994991410,3cyclictest60350irq/132-enp0s29f1:rx-011:05:130
236005991311,2cyclictest448709-21kworker/u8:3+events_unbound10:44:143
236005991310,2cyclictest542039-21kworker/u8:1+flush-259:012:25:153
236005991310,2cyclictest474314-21unixbench_singl10:55:263
23600299139,2cyclictest0-21swapper/212:30:212
23600299138,4cyclictest381515-21apt-get09:30:102
23600299138,3cyclictest485323-21/usr/sbin/munin11:10:252
23600299137,4cyclictest335557-21systemd-journal11:36:132
23600299137,4cyclictest335557-21systemd-journal11:00:012
236002991310,2cyclictest417918-21fschecks_count10:05:142
236002991310,2cyclictest298192-21cron08:10:002
235994991312,1cyclictest60350irq/132-enp0s29f1:rx-008:54:370
235994991311,1cyclictest60350irq/132-enp0s29f1:rx-012:13:150
235994991311,1cyclictest60350irq/132-enp0s29f1:rx-010:50:120
235994991311,1cyclictest60350irq/132-enp0s29f1:rx-008:30:190
235994991311,1cyclictest60350irq/132-enp0s29f1:rx-008:20:120
235994991311,1cyclictest60350irq/132-enp0s29f1:rx-007:10:190
235994991311,1cyclictest60350irq/132-enp0s29f1:rx-007:10:190
235994991311,1cyclictest0-21swapper/007:10:010
235994991310,2cyclictest60350irq/132-enp0s29f1:rx-008:45:210
235994991310,2cyclictest485349-21apt-get11:10:130
235994991310,2cyclictest261161-21ntp_kernel_pll_07:30:210
23600599129,2cyclictest235966-21kworker/u8:3+events_unbound08:05:013
236005991210,1cyclictest0-21swapper/311:20:223
23600299129,2cyclictest401724-21kworker/u8:3+events_unbound10:15:002
23600299126,4cyclictest220585-21kworker/u8:0+events_unbound07:25:152
23600299125,5cyclictest335557-21systemd-journal08:20:012
23599899129,2cyclictest448709-21kworker/u8:3+flush-259:011:30:141
23599499129,2cyclictest60350irq/132-enp0s29f1:rx-010:35:130
235994991211,1cyclictest60350irq/132-enp0s29f1:rx-009:43:460
235994991210,1cyclictest60350irq/132-enp0s29f1:rx-007:35:180
235994991210,1cyclictest60350irq/132-enp0s29f1:rx-007:15:190
23600299119,1cyclictest0-21swapper/209:20:152
23600299118,2cyclictest521893-21irqcore11:45:162
23600299117,2cyclictest270461-21kthreadcore07:40:182
23600299117,2cyclictest235682-21latency_hist07:10:002
23600299116,3cyclictest335557-21systemd-journal10:05:002
23600299116,3cyclictest335108-21sshd08:45:122
23599499119,2cyclictest60350irq/132-enp0s29f1:rx-010:47:360
23599499118,2cyclictest60350irq/132-enp0s29f1:rx-010:30:260
23599499118,2cyclictest360987-21cpuspeed_turbos09:10:120
23600599106,3cyclictest505980-21sshd11:30:133
23600299107,1cyclictest0-21swapper/212:20:132
23600299106,3cyclictest495726-21cpuspeed_turbos11:20:142
23600299105,4cyclictest244553-21cut07:15:202
23600299100,6cyclictest490-21dbus-daemon10:20:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional