You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 18:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Jul 29, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3900646995750,4cyclictest4076773-21cp10:00:002
3900648995551,2cyclictest4113338-21latency_hist10:35:003
3900638995450,3cyclictest4045924-21apt-get09:30:130
3900641994537,5cyclictest4134079-21latency_hist10:55:011
3900638994441,2cyclictest4076709-21kworker/u8:2+flush-259:010:10:010
3900648994037,2cyclictest4087641-21kworker/u8:4+events_unbound11:35:003
3900646994037,2cyclictest4029602-21kworker/u8:0+events_unbound09:50:002
3900648993933,4cyclictest3957818-21latency_hist08:05:003
3900638993935,3cyclictest4164724-21kworker/u8:2+flush-259:011:30:120
3900641993732,3cyclictest335557-21systemd-journal12:39:101
3900638993732,4cyclictest3900813-21kworker/u8:1+events_unbound07:45:000
3900638993732,4cyclictest3900813-21kworker/u8:1+events_unbound07:45:000
3900648993633,2cyclictest4076709-21kworker/u8:2+flush-259:010:55:213
3900641993631,3cyclictest4087649-21/usr/sbin/munin10:10:151
3900648993531,3cyclictest4029602-21kworker/u8:0+events_unbound09:44:133
3900638993531,3cyclictest4061165-21kworker/u8:1+events_unbound09:50:020
3900648993428,4cyclictest4165044-21latency_hist11:25:023
3900641993427,5cyclictest335557-21systemd-journal12:24:081
3900638993430,3cyclictest1840417-21kworker/u8:0+events_unbound07:35:120
3900648993330,2cyclictest3993997-21kworker/u8:0+events_unbound08:41:123
3900638993329,3cyclictest4076709-21kworker/u8:2+events_unbound10:55:130
3900648993229,2cyclictest4009405-21kworker/u8:3+events_unbound09:05:003
3900648993229,2cyclictest3885365-21kworker/u8:2+flush-259:007:20:003
3900648993225,5cyclictest3921205-21latency_hist07:30:003
3900638993228,3cyclictest3952705-21kworker/u8:3+events_unbound08:15:130
3900648993127,3cyclictest3931378-21kworker/u8:2+events_unbound07:49:133
3900648993125,4cyclictest44363-21latency_hist12:35:003
3900646993127,3cyclictest4087641-21kworker/u8:4+events_unbound10:15:122
3900646993125,4cyclictest49550-21latency_hist12:40:012
3900641993126,3cyclictest3906004-21apt-get07:15:131
3900641993123,5cyclictest4035299-21latency_hist09:20:001
3900648993027,2cyclictest4076709-21kworker/u8:2+events_unbound10:42:113
3900648993027,2cyclictest4019786-21kworker/u8:2+events_unbound09:05:163
3900648993027,2cyclictest3952705-21kworker/u8:3+events_unbound08:10:003
3900648993024,4cyclictest3947241-21base6407:55:003
3900638993023,5cyclictest33619-21latency_hist12:25:010
3900648992926,3cyclictest12074-21kworker/u8:2+flush-259:012:05:243
3900648992926,2cyclictest4019786-21kworker/u8:2+flush-259:009:30:153
3900641992924,4cyclictest3911115-21apt-get07:20:121
3900638992926,2cyclictest3983883-21kworker/u8:2+events_unbound08:35:020
3900638992925,3cyclictest3983883-21kworker/u8:2+events_unbound08:51:120
3900648992824,3cyclictest3911076-21kworker/u8:4+events_unbound07:23:103
3900646992824,3cyclictest4113578-21/usr/sbin/munin10:35:152
3900648992724,2cyclictest4019786-21kworker/u8:2+flush-259:009:10:213
3900648992720,5cyclictest39007-21gpgv12:30:013
3900638992723,3cyclictest4134315-21kworker/u8:0+events_unbound11:23:580
3900638992723,3cyclictest4076709-21kworker/u8:2+events_unbound10:25:120
3900638992722,3cyclictest3994221-21/usr/sbin/munin08:40:240
3900648992623,2cyclictest4108165-21kworker/u8:1+flush-259:010:45:203
3900648992621,4cyclictest28176-21kworker/u8:2+events_unbound12:35:173
3900648992619,4cyclictest3973322-21latency_hist08:20:013
3900646992622,3cyclictest3900813-21kworker/u8:1+events_unbound09:05:032
3900638992623,2cyclictest4066547-21kworker/u8:3+flush-259:010:00:160
3900638992623,2cyclictest4066547-21kworker/u8:3+flush-259:010:00:160
3900638992622,3cyclictest4108165-21kworker/u8:1+events_unbound10:46:130
3900638992621,4cyclictest335557-21systemd-journal08:10:010
3900648992521,3cyclictest3952705-21kworker/u8:3+events_unbound08:23:273
3900648992521,3cyclictest3165-21kworker/u8:1+events_unbound12:19:133
3900648992521,3cyclictest3165-21kworker/u8:1+events_unbound12:19:133
3900648992520,3cyclictest4019786-21kworker/u8:2+events_unbound09:35:203
3900648992519,5cyclictest4029602-21kworker/u8:0+flush-259:009:20:183
3900648992518,5cyclictest335557-21systemd-journal08:38:293
3900648992518,5cyclictest23271-21latency_hist12:15:003
3900646992521,3cyclictest3885365-21kworker/u8:2+events_unbound07:15:002
3900646992518,5cyclictest4186174-21latency_hist11:45:002
3900638992522,2cyclictest4181208-21kworker/u8:0+flush-259:011:45:170
3900638992521,3cyclictest4087641-21kworker/u8:4+events_unbound10:18:110
3900638992521,3cyclictest3900813-21kworker/u8:1+events_unbound07:34:120
3900648992420,3cyclictest4082486-21kworker/u8:1+flush-259:010:10:213
3900648992418,4cyclictest4191312-21latency_hist11:50:013
3900641992420,3cyclictest4176069-21apt-get11:35:121
3900641992420,3cyclictest4087641-21kworker/u8:4+flush-259:010:17:101
3900638992421,2cyclictest4009405-21kworker/u8:3+events_unbound09:00:190
3900638992421,2cyclictest3900813-21kworker/u8:1+events_unbound07:48:120
3900638992420,3cyclictest4019786-21kworker/u8:2+flush-259:009:20:160
3900638992420,3cyclictest3931378-21kworker/u8:2+events_unbound07:53:120
3900648992319,3cyclictest4098018-21kworker/u8:0+events_unbound10:23:113
3900646992319,3cyclictest3947783-21apt-get07:55:132
3900646992319,2cyclictest4108165-21kworker/u8:1+flush-259:010:45:152
3900641992319,3cyclictest4014854-21apt-get09:00:121
3900638992320,2cyclictest3958045-21kworker/u8:2+events_unbound08:10:120
3900638992320,2cyclictest3900813-21kworker/u8:1+events_unbound08:55:120
3900638992319,3cyclictest4175818-21kworker/u8:1+events_unbound11:35:120
3900638992319,3cyclictest1840417-21kworker/u8:0+flush-259:007:30:000
3900648992219,2cyclictest4029602-21kworker/u8:0+events_unbound09:25:203
3900648992218,3cyclictest509-21rs:main3
3900648992218,3cyclictest3983883-21kworker/u8:2+flush-259:008:48:313
3900648992218,3cyclictest3900813-21kworker/u8:1+flush-259:008:55:243
3900641992219,2cyclictest3900813-21kworker/u8:1+events_unbound09:10:021
3900641992218,3cyclictest3983922-21apt-get08:30:121
3900638992219,2cyclictest4108165-21kworker/u8:1+flush-259:010:40:230
3900648992119,1cyclictest3900813-21kworker/u8:1+flush-259:008:30:253
3900648992117,3cyclictest4134315-21kworker/u8:0+events_unbound11:29:133
3900648992115,4cyclictest2842-21/usr/sbin/munin11:55:153
3900646992118,2cyclictest4087641-21kworker/u8:4+flush-259:010:45:002
3900646992117,3cyclictest4077361-21apt-get10:00:132
3900646992117,3cyclictest4077361-21apt-get10:00:122
3900646992117,2cyclictest4102987-21sh10:25:002
3900646992116,4cyclictest4087414-21latency_hist10:10:002
390064699210,19cyclictest3963000-21cron08:10:002
3900641992118,2cyclictest4066547-21kworker/u8:3+flush-259:010:20:171
3900641992115,4cyclictest3956929-21ntpq08:00:211
3900638992117,3cyclictest4019786-21kworker/u8:2+flush-259:009:35:160
3900638992117,3cyclictest3900813-21kworker/u8:1+flush-259:007:20:160
3900648992016,3cyclictest4108165-21kworker/u8:1+events_unbound10:50:213
3900648992016,3cyclictest3900813-21kworker/u8:1+flush-259:009:15:213
3900648992013,5cyclictest3968139-21latency_hist08:15:013
3900646992017,2cyclictest4149789-21kworker/u8:1+events_unbound11:15:152
3900646992017,2cyclictest3958045-21kworker/u8:2+events_unbound08:10:232
3900646992014,4cyclictest509-21rs:main2
3900646992014,4cyclictest3941912-21latency_hist07:50:002
3900638992016,3cyclictest4087641-21kworker/u8:4+flush-259:011:10:150
3900638992016,3cyclictest4029602-21kworker/u8:0+events_unbound09:29:120
3900638992016,3cyclictest28176-21kworker/u8:2+events_unbound12:19:090
3900638992016,3cyclictest28176-21kworker/u8:2+events_unbound12:19:080
3900648991915,3cyclictest4164724-21kworker/u8:2+flush-259:011:44:113
3900648991914,3cyclictest8025-21apt-get12:00:133
3900648991914,3cyclictest28671-21/usr/sbin/munin12:20:153
3900648991913,4cyclictest4097792-21latency_hist10:20:003
3900646991916,2cyclictest4019786-21kworker/u8:2+flush-259:009:25:012
3900646991915,3cyclictest4181208-21kworker/u8:0+flush-259:012:10:182
3900646991915,3cyclictest3958045-21kworker/u8:2+flush-259:008:20:002
3900646991913,4cyclictest7753-21latency_hist12:00:002
3900641991914,4cyclictest28176-21kworker/u8:2+flush-259:012:30:181
3900638991916,2cyclictest3900813-21kworker/u8:1+flush-259:009:15:140
3900638991916,2cyclictest3885365-21kworker/u8:2+events_unbound07:19:120
3900646991814,3cyclictest3900813-21kworker/u8:1+flush-259:008:35:242
3900646991814,3cyclictest3900813-21kworker/u8:1+flush-259:007:40:172
3900646991814,3cyclictest3900813-21kworker/u8:1+flush-259:007:40:172
3900641991814,3cyclictest4108165-21kworker/u8:1+flush-259:010:35:251
3900641991813,4cyclictest335557-21systemd-journal12:06:101
3900641991812,4cyclictest335557-21systemd-journal08:45:011
390064199180,16cyclictest1-21systemd10:10:001
3900638991815,2cyclictest28176-21kworker/u8:2+events_unbound12:25:270
3900638991814,3cyclictest4076709-21kworker/u8:2+events_unbound11:00:160
3900638991814,3cyclictest3952705-21kworker/u8:3+events_unbound08:27:120
3900638991813,4cyclictest4066547-21kworker/u8:3+flush-259:010:20:190
3900648991715,2cyclictest4066547-21kworker/u8:3+events_unbound09:58:443
3900648991714,2cyclictest4076709-21kworker/u8:2+events_unbound11:00:233
3900648991713,3cyclictest4061165-21kworker/u8:1+events_unbound09:45:113
3900648991713,3cyclictest3952694-21munin-run08:00:003
3900646991713,3cyclictest4082486-21kworker/u8:1+flush-259:010:10:282
3900646991712,3cyclictest4019786-21kworker/u8:2+flush-259:009:20:002
3900641991713,3cyclictest4087641-21kworker/u8:4+events_unbound11:15:171
3900641991713,3cyclictest3931378-21kworker/u8:2+flush-259:007:50:171
3900641991712,3cyclictest4181220-21/usr/sbin/munin11:40:151
3900638991714,2cyclictest4108165-21kworker/u8:1+flush-259:010:35:170
3900638991714,2cyclictest4087641-21kworker/u8:4+events_unbound10:30:160
3900638991713,3cyclictest4087641-21kworker/u8:4+events_unbound11:52:120
3900638991713,3cyclictest4087641-21kworker/u8:4+events_unbound10:13:450
3900638991713,2cyclictest4129620-21irqcore10:50:160
3900648991613,2cyclictest4066547-21kworker/u8:3+events_unbound10:00:013
3900648991613,2cyclictest4066547-21kworker/u8:3+events_unbound10:00:003
3900648991612,3cyclictest4191538-21kworker/u8:3+events_unbound11:53:133
3900648991612,3cyclictest4061165-21kworker/u8:1+flush-259:009:50:163
3900646991613,2cyclictest4110727-21kthreadcore10:30:182
3900646991613,1cyclictest0-21swapper/211:25:022
3900646991612,3cyclictest4134315-21kworker/u8:0+flush-259:011:05:002
3900646991612,3cyclictest4087641-21kworker/u8:4+events_unbound11:50:212
3900646991612,3cyclictest28176-21kworker/u8:2+flush-259:012:20:272
3900646991612,2cyclictest0-21swapper/209:55:012
3900646991611,3cyclictest4175785-21cron11:35:002
3900641991613,2cyclictest4153828-21ntp_kernel_pll_11:10:221
3900641991613,2cyclictest3952705-21kworker/u8:3+flush-259:008:25:251
3900641991612,3cyclictest3989067-21apt-get08:35:121
3900641991611,3cyclictest4170939-21apt-get11:30:131
3900638991614,2cyclictest60350irq/132-enp0s29f1:rx-011:19:330
3900638991613,2cyclictest60350irq/132-enp0s29f1:rx-007:55:170
3900638991613,2cyclictest4164724-21kworker/u8:2+events_unbound11:25:160
3900638991613,2cyclictest4029602-21kworker/u8:0+events_unbound09:55:150
3900638991613,2cyclictest18315-21kworker/u8:3+events_unbound12:10:250
3900638991612,3cyclictest3993997-21kworker/u8:0+events_unbound08:45:210
390064899157,7cyclictest335557-21systemd-journal11:20:003
3900648991512,2cyclictest0-21swapper/308:55:003
3900648991511,3cyclictest4087641-21kworker/u8:4+events_unbound11:13:583
3900648991511,3cyclictest4082486-21kworker/u8:1+events_unbound10:09:133
3900648991511,3cyclictest4076709-21kworker/u8:2+flush-259:010:25:263
390064699158,4cyclictest335557-21systemd-journal12:30:002
3900646991513,1cyclictest3900813-21kworker/u8:1+events_unbound08:55:202
3900646991512,2cyclictest44369-21cron12:34:592
3900646991511,3cyclictest4181208-21kworker/u8:0+events_unbound11:45:132
3900646991511,3cyclictest12074-21kworker/u8:2+events_unbound12:05:012
3900646991511,2cyclictest3915063-21needreboot07:20:212
3900646991511,2cyclictest0-21swapper/208:25:002
3900641991512,2cyclictest4144392-21munin-plugin-st11:05:011
3900641991511,3cyclictest4181208-21kworker/u8:0+flush-259:012:00:211
3900641991511,3cyclictest3952705-21kworker/u8:3+flush-259:008:05:271
3900641991510,3cyclictest4061382-21/usr/sbin/munin09:45:241
390063899158,5cyclictest335557-21systemd-journal09:10:110
3900638991513,1cyclictest60350irq/132-enp0s29f1:rx-012:05:130
3900638991513,1cyclictest60350irq/132-enp0s29f1:rx-009:05:240
3900638991513,1cyclictest60350irq/132-enp0s29f1:rx-008:00:240
3900638991513,1cyclictest60350irq/132-enp0s29f1:rx-007:10:160
3900638991512,2cyclictest60350irq/132-enp0s29f1:rx-009:45:330
3900638991512,2cyclictest3952705-21kworker/u8:3+events_unbound08:20:140
3900638991511,3cyclictest4056252-21apt-get09:40:110
390063899150,14cyclictest335480-21sshd11:58:110
3900648991411,2cyclictest1840417-21kworker/u8:0+events_unbound07:35:163
3900648991410,3cyclictest3952705-21kworker/u8:3+events_unbound08:25:183
3900648991410,3cyclictest3931378-21kworker/u8:2+events_unbound07:43:123
3900648991410,3cyclictest3931378-21kworker/u8:2+events_unbound07:43:123
3900648991410,3cyclictest3900813-21kworker/u8:1+flush-259:007:10:133
390064699149,3cyclictest335557-21systemd-journal07:29:112
3900646991410,3cyclictest0-21swapper/207:20:002
390064199148,4cyclictest4045653-21latency_hist09:30:001
3900641991411,2cyclictest4071533-21systemd-run09:55:001
3900641991411,2cyclictest3927658-21kthreadcore07:35:171
3900641991410,3cyclictest3900813-21kworker/u8:1+flush-259:007:32:161
3900638991412,1cyclictest60350irq/132-enp0s29f1:rx-008:30:200
3900638991411,2cyclictest60350irq/132-enp0s29f1:rx-012:35:160
3900638991411,2cyclictest60350irq/132-enp0s29f1:rx-012:30:380
3900638991411,2cyclictest60350irq/132-enp0s29f1:rx-011:40:120
390064899139,2cyclictest0-21swapper/311:05:163
3900648991310,2cyclictest4117615-21ntp_kernel_err10:35:203
390064699139,2cyclictest0-21swapper/207:55:002
390064699138,3cyclictest4019786-21kworker/u8:2+flush-259:009:40:162
3900646991310,2cyclictest3998171-21cut08:40:212
3900646991310,2cyclictest3900813-21kworker/u8:1+events_unbound08:33:272
390064199139,3cyclictest4087641-21kworker/u8:4+flush-259:010:33:541
390064199139,2cyclictest0-21swapper/110:00:001
390064199137,5cyclictest0-21swapper/109:44:591
3900641991310,1cyclictest0-21swapper/108:45:001
3900638991310,2cyclictest60350irq/132-enp0s29f1:rx-011:05:160
3900646991210,1cyclictest0-21swapper/209:30:002
390064199129,2cyclictest22814-21unixbench_multi12:10:261
3900641991210,1cyclictest0-21swapper/107:50:001
390064199120,4cyclictest41660992awk11:25:161
3900638991210,1cyclictest60350irq/132-enp0s29f1:rx-012:00:210
390064899119,1cyclictest0-21swapper/311:40:003
390064699118,2cyclictest4004591-21cpuspeed_turbos08:50:142
390064699118,2cyclictest3952705-21kworker/u8:3+flush-259:008:25:172
390064199119,1cyclictest0-21swapper/108:55:011
390064199118,2cyclictest7268-21unixbench_multi11:55:261
390064199118,2cyclictest3973323-21idleruntime-cro08:20:001
390064199117,3cyclictest3973591-21apt-get08:20:111
390064699107,2cyclictest4170255-21unixbench_singl11:25:262
390064699106,3cyclictest4098018-21kworker/u8:0+flush-259:010:25:162
390064699106,3cyclictest4003841-21unixbench_singl08:45:242
390064699104,4cyclictest4030104-21cron09:14:592
390064199108,1cyclictest0-21swapper/108:55:131
390064199106,3cyclictest3900813-21kworker/u8:1+flush-259:007:10:181
390064199105,4cyclictest3963276-21apt-get08:10:121
390064199105,3cyclictest23541-21apt-get12:15:141
390064199105,3cyclictest23541-21apt-get12:15:131
39006419997,1cyclictest0-21swapper/109:10:181
39006419983,3cyclictest4191577-21apt-get11:50:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional