You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 15:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri May 01, 2026 12:44:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4101788995854,3cyclictest75-21kswapd011:30:153
4101778994441,2cyclictest147205-21kworker/u8:2+events_unbound11:20:141
4101778994440,3cyclictest75-21kswapd011:30:141
4101778994439,4cyclictest224959-21apt-get12:15:011
4101775994339,3cyclictest157507-21kworker/u8:3+events_unbound11:30:130
4101783994235,4cyclictest4185371-21latency_hist08:30:012
4101778994237,4cyclictest147155-21latency_hist11:00:001
4101778994138,2cyclictest4112014-21kworker/u8:2+flush-259:007:35:231
4101778994037,2cyclictest4112014-21kworker/u8:2+flush-259:008:55:231
4101775993934,4cyclictest142008-21latency_hist10:55:010
4101778993734,2cyclictest4037671-21kworker/u8:1+events_unbound07:10:231
4101783993629,4cyclictest121451-21latency_hist10:35:002
4101775993633,2cyclictest147205-21kworker/u8:2+flush-259:011:35:150
4101775993633,2cyclictest147205-21kworker/u8:2+flush-259:011:35:150
4101778993532,2cyclictest147205-21kworker/u8:2+flush-259:011:45:161
4101778993429,4cyclictest4185632-21apt-get08:30:101
4101778993330,2cyclictest4112014-21kworker/u8:2+events_unbound08:45:221
4101778993326,2cyclictest27928-21kworker/u8:1+events_unbound09:35:001
4101778993229,2cyclictest27928-21kworker/u8:1+events_unbound09:40:231
4101778993228,2cyclictest147205-21kworker/u8:2+events_unbound11:40:141
4101778993228,2cyclictest147205-21kworker/u8:2+events_unbound11:40:131
4101775993126,4cyclictest252-21systemd-journal12:00:000
4101775993126,4cyclictest252-21systemd-journal08:15:000
4101783993025,4cyclictest27928-21kworker/u8:1+flush-259:011:04:592
4101778993026,3cyclictest4037671-21kworker/u8:1+flush-259:007:55:211
4101778993026,3cyclictest27928-21kworker/u8:1+events_unbound11:15:231
4101778993026,3cyclictest27928-21kworker/u8:1+events_unbound11:15:231
4101778993026,3cyclictest246502-21kworker/u8:3+events_unbound12:35:141
4101783992925,3cyclictest4112014-21kworker/u8:2+flush-259:007:25:212
4101783992921,5cyclictest4143790-21latency_hist07:50:012
4101778992925,3cyclictest43413-21kworker/u8:0+flush-259:010:40:231
4101778992925,3cyclictest43413-21kworker/u8:0+events_unbound10:35:131
4101775992926,2cyclictest43413-21kworker/u8:0+flush-259:010:15:200
4101775992925,3cyclictest43413-21kworker/u8:0+flush-259:009:30:230
4101775992925,3cyclictest43413-21kworker/u8:0+events_unbound10:10:210
4101778992825,2cyclictest43413-21kworker/u8:0+events_unbound09:50:191
4101778992825,2cyclictest4048090-21kworker/u8:3+flush-259:007:15:251
4101778992821,5cyclictest85033-21latency_hist10:00:011
4101783992722,4cyclictest100654-21gpgv10:15:012
4101778992724,2cyclictest4112014-21kworker/u8:2+events_unbound08:14:531
410177599270,25cyclictest252-21systemd-journal09:41:520
4101788992622,3cyclictest27928-21kworker/u8:1+events_unbound10:05:223
4101788992619,5cyclictest22332-21apt-get09:00:003
4101783992621,3cyclictest4149216-21/usr/sbin/munin07:55:122
4101778992623,2cyclictest6924-21kworker/u8:3+events_unbound09:00:231
4101778992622,3cyclictest147205-21kworker/u8:2+events_unbound12:20:161
4101775992621,4cyclictest252-21systemd-journal12:06:540
4101775992621,4cyclictest225084-21gpgv12:15:010
4101775992620,5cyclictest236325-21cat12:25:010
4101788992520,4cyclictest75002-21apt-get09:50:093
4101783992519,4cyclictest101081-21base6410:15:012
4101778992522,2cyclictest43413-21kworker/u8:0+events_unbound09:35:201
4101778992522,2cyclictest147205-21kworker/u8:2+events_unbound11:25:211
4101788992420,3cyclictest4128173-21apt-get07:35:103
4101788992419,3cyclictest4112014-21kworker/u8:2+flush-259:008:40:003
4101783992420,3cyclictest4037671-21kworker/u8:1+flush-259:007:15:002
4101783992416,6cyclictest42449-21ntpq09:15:212
4101778992421,2cyclictest147205-21kworker/u8:2+flush-259:011:35:101
4101778992421,2cyclictest147205-21kworker/u8:2+flush-259:011:35:091
4101778992420,3cyclictest43413-21kworker/u8:0+events_unbound09:45:211
4101778992420,3cyclictest27928-21kworker/u8:1+flush-259:010:49:591
4101778992420,3cyclictest147205-21kworker/u8:2+flush-259:012:00:001
4101778992417,5cyclictest4139082-21diskstats07:45:131
4101775992421,3cyclictest27928-21kworker/u8:1+events_unbound09:50:140
4101775992417,6cyclictest146279-21ntpq10:55:190
4101788992319,3cyclictest178506-21kworker/u8:0+events_unbound12:30:143
4101788992318,4cyclictest43413-21kworker/u8:0+events_unbound10:20:193
410178399231,16cyclictest147167-21awk11:00:002
4101778992320,2cyclictest147436-21apt-get11:00:121
4101778992319,3cyclictest27928-21kworker/u8:1+events_unbound10:05:121
4101778992319,3cyclictest178506-21kworker/u8:0+flush-259:012:05:231
4101775992320,2cyclictest4112014-21kworker/u8:2+flush-259:008:05:150
4101775992319,3cyclictest6924-21kworker/u8:3+events_unbound08:51:510
4101775992319,3cyclictest6924-21kworker/u8:3+events_unbound08:51:510
4101775992319,3cyclictest4048090-21kworker/u8:3+flush-259:007:20:000
4101775992319,3cyclictest4037671-21kworker/u8:1+flush-259:007:55:220
4101775992318,4cyclictest4037671-21kworker/u8:1+flush-259:007:45:190
4101788992218,3cyclictest4037671-21kworker/u8:1+flush-259:008:00:173
4101788992216,4cyclictest137278-21diskstats10:50:103
4101788992215,5cyclictest252-21systemd-journal09:20:013
4101783992216,4cyclictest4138254-21https07:45:002
4101783992216,4cyclictest252-21systemd-journal12:20:002
4101778992219,2cyclictest4112014-21kworker/u8:2+flush-259:007:30:011
4101778992219,2cyclictest147205-21kworker/u8:2+events_unbound11:10:191
4101778992216,4cyclictest4170195-21apt-get08:15:121
4101775992219,2cyclictest4112014-21kworker/u8:2+flush-259:008:40:190
4101775992219,2cyclictest4037671-21kworker/u8:1+events_unbound08:15:220
4101775992218,3cyclictest147205-21kworker/u8:2+events_unbound11:40:160
4101775992218,3cyclictest147205-21kworker/u8:2+events_unbound11:40:150
4101775992216,4cyclictest53859-21base6409:30:010
4101788992118,2cyclictest4112014-21kworker/u8:2+events_unbound08:40:213
4101788992118,2cyclictest27928-21kworker/u8:1+flush-259:011:15:243
4101788992118,2cyclictest27928-21kworker/u8:1+flush-259:011:15:233
4101788992117,3cyclictest43413-21kworker/u8:0+events_unbound09:35:223
4101788992117,3cyclictest100675-21store10:15:013
4101788992115,4cyclictest252-21systemd-journal10:34:543
4101778992117,3cyclictest2004-21apt-get08:40:111
4101778992117,3cyclictest147205-21kworker/u8:2+events_unbound11:05:161
4101778992116,4cyclictest27928-21kworker/u8:1+flush-259:010:50:141
4101775992117,3cyclictest27928-21kworker/u8:1+flush-259:009:55:170
4101775992117,3cyclictest147205-21kworker/u8:2+events_unbound11:05:220
4101775992114,5cyclictest11169-21ntpq08:45:220
4101788992016,3cyclictest43413-21kworker/u8:0+flush-259:009:50:013
4101788992016,3cyclictest252-21systemd-journal12:10:003
4101778992017,2cyclictest43413-21kworker/u8:0+events_unbound10:05:001
4101778992017,2cyclictest199383-21kworker/u8:1+events_unbound11:50:201
4101778992016,3cyclictest6924-21kworker/u8:3+flush-259:009:20:111
4101775992017,2cyclictest199141-21sh11:50:000
4101775992016,3cyclictest43413-21kworker/u8:0+events_unbound10:25:200
4101775992016,3cyclictest43413-21kworker/u8:0+events_unbound10:20:220
4101775992016,3cyclictest4112014-21kworker/u8:2+flush-259:007:35:110
4101775992016,3cyclictest178506-21kworker/u8:0+events_unbound12:00:190
4101775992013,5cyclictest4148091-21ntpq07:50:200
4101775992013,5cyclictest130789-21ntpq10:40:180
410178399193,9cyclictest209507-21munin-plugin-st11:59:592
4101783991914,4cyclictest23030-21apt-get09:00:132
4101783991914,3cyclictest235851-21base6412:25:002
4101783991912,5cyclictest177560-21ntpq11:25:202
4101778991916,2cyclictest147205-21kworker/u8:2+events_unbound12:15:031
4101778991915,3cyclictest4037671-21kworker/u8:1+flush-259:008:35:251
4101778991913,4cyclictest4117147-21latency_hist07:25:011
4101775991916,2cyclictest147205-21kworker/u8:2+events_unbound11:20:230
4101775991915,3cyclictest6924-21kworker/u8:3+events_unbound09:17:520
4101775991912,5cyclictest4127050-21ntpq07:30:210
4101775991912,5cyclictest251667-21latency_hist12:40:010
4101788991814,3cyclictest4037671-21kworker/u8:1+events_unbound08:15:183
4101788991813,3cyclictest235696-21apt-get12:25:003
4101783991815,2cyclictest48550-21sh09:25:002
4101783991815,2cyclictest33060-21idleruntime-cro09:10:002
4101783991814,3cyclictest214669-21systemd-journal12:05:002
4101783991812,4cyclictest246721-21/usr/sbin/munin12:35:202
4101783991811,5cyclictest37287-21ntpq09:10:192
4101778991816,2cyclictest4112014-21kworker/u8:2+flush-259:009:05:191
4101778991814,3cyclictest4112014-21kworker/u8:2+flush-259:007:40:111
4101778991814,3cyclictest4112014-21kworker/u8:2+events_unbound08:20:121
4101778991814,3cyclictest4037671-21kworker/u8:1+events_unbound08:00:171
4101778991814,3cyclictest111399-21/usr/sbin/munin10:25:151
4101775991815,2cyclictest43413-21kworker/u8:0+events_unbound10:45:200
4101775991814,3cyclictest27928-21kworker/u8:1+events_unbound11:10:090
4101775991812,3cyclictest4112014-21kworker/u8:2+flush-259:007:25:010
4101788991713,3cyclictest4037671-21kworker/u8:1+flush-259:008:25:543
4101788991713,3cyclictest27928-21kworker/u8:1+events_unbound09:55:143
4101783991712,3cyclictest4112014-21kworker/u8:2+flush-259:008:50:172
4101783991712,3cyclictest4112014-21kworker/u8:2+flush-259:008:50:162
4101783991712,3cyclictest126581-21cron10:39:592
4101778991714,2cyclictest6924-21kworker/u8:3+events_unbound09:19:511
4101778991714,2cyclictest4037671-21kworker/u8:1+events_unbound07:34:151
4101778991711,5cyclictest53915-21cat09:30:011
4101775991714,2cyclictest199383-21kworker/u8:1+flush-259:011:50:170
4101775991713,3cyclictest4037671-21kworker/u8:1+flush-259:008:25:170
4101775991713,3cyclictest4037671-21kworker/u8:1+flush-259:007:10:190
4101788991612,3cyclictest64681-21apt-get09:40:103
4101788991612,2cyclictest6924-21kworker/u8:3+flush-259:009:15:003
4101788991611,4cyclictest59264-21latency_hist09:35:013
4101788991611,3cyclictest43413-21kworker/u8:0+flush-259:010:25:193
4101788991610,4cyclictest240452-21ntpq12:25:223
410178399161,9cyclictest4111994-21munin-run07:20:002
4101783991613,2cyclictest75-21kswapd011:30:162
4101783991612,3cyclictest43413-21kworker/u8:0+flush-259:010:00:242
4101783991612,2cyclictest0-21swapper/210:30:012
4101778991613,2cyclictest27928-21kworker/u8:1+flush-259:010:30:221
410177599169,5cyclictest120551-21ntpq10:30:180
4101775991614,1cyclictest60350irq/132-enp0s29f1:rx-007:25:140
4101775991612,3cyclictest4112014-21kworker/u8:2+flush-259:008:35:160
4101775991612,3cyclictest4037671-21kworker/u8:1+events_unbound08:00:210
4101788991511,3cyclictest252-21systemd-journal11:39:593
4101788991511,3cyclictest252-21systemd-journal11:39:593
4101788991511,3cyclictest252-21systemd-journal11:04:543
4101788991510,4cyclictest12303-21/usr/sbin/munin08:50:153
4101788991510,4cyclictest12303-21/usr/sbin/munin08:50:143
4101783991511,3cyclictest4154404-21apt-get08:00:112
4101783991511,3cyclictest252-21systemd-journal07:39:242
4101783991510,4cyclictest27928-21kworker/u8:1+flush-259:009:30:172
410177899159,5cyclictest111161-21latency_hist10:25:021
4101778991511,3cyclictest43413-21kworker/u8:0+flush-259:010:10:241
410177599159,4cyclictest252-21systemd-journal08:24:340
4101775991514,1cyclictest60350irq/132-enp0s29f1:rx-012:32:390
4101775991513,1cyclictest60350irq/132-enp0s29f1:rx-010:05:160
4101775991513,1cyclictest60350irq/132-enp0s29f1:rx-009:45:190
4101775991513,1cyclictest60350irq/132-enp0s29f1:rx-008:55:240
4101775991512,2cyclictest60350irq/132-enp0s29f1:rx-008:30:080
4101775991512,2cyclictest509-21rs:main0
4101775991511,3cyclictest43632-21apt-get09:20:090
4101775991511,3cyclictest252-21systemd-journal10:04:510
4101775991511,3cyclictest147205-21kworker/u8:2+flush-259:012:15:100
410178899148,4cyclictest252-21systemd-journal07:20:003
4101788991411,3cyclictest4112014-21kworker/u8:2+flush-259:007:25:223
4101788991411,2cyclictest6924-21kworker/u8:3+flush-259:009:10:003
4101788991410,3cyclictest6924-21kworker/u8:3+events_unbound09:00:013
4101788991410,3cyclictest4112014-21kworker/u8:2+events_unbound07:40:203
4101788991410,3cyclictest178506-21kworker/u8:0+flush-259:012:00:243
4101783991412,1cyclictest0-21swapper/209:55:002
4101783991411,2cyclictest4165278-21fschecks_time08:10:152
4101783991411,2cyclictest4123422-21irqcore07:30:172
4101783991411,2cyclictest147205-21kworker/u8:2+flush-259:011:35:152
4101783991411,2cyclictest147205-21kworker/u8:2+flush-259:011:35:142
4101783991411,2cyclictest0-21swapper/212:15:002
4101783991410,3cyclictest27928-21kworker/u8:1+flush-259:009:35:562
410177899149,2cyclictest4037671-21kworker/u8:1+events_unbound08:05:211
4101778991411,2cyclictest4037671-21kworker/u8:1+flush-259:007:50:231
4101778991411,2cyclictest178506-21kworker/u8:0-events_unbound12:00:161
4101778991410,3cyclictest6924-21kworker/u8:3+events_unbound09:10:151
4101778991410,3cyclictest4037671-21kworker/u8:1+events_unbound08:26:191
4101775991412,2cyclictest60350irq/132-enp0s29f1:rx-011:16:590
4101775991412,2cyclictest60350irq/132-enp0s29f1:rx-011:16:580
4101775991412,1cyclictest60350irq/132-enp0s29f1:rx-011:02:030
4101775991412,1cyclictest60350irq/132-enp0s29f1:rx-010:35:120
4101775991411,2cyclictest60350irq/132-enp0s29f1:rx-012:20:190
4101775991411,2cyclictest60350irq/132-enp0s29f1:rx-009:10:160
4101775991411,2cyclictest60350irq/132-enp0s29f1:rx-009:00:200
4101788991311,1cyclictest0-21swapper/309:30:003
4101788991310,2cyclictest43413-21kworker/u8:0+flush-259:010:45:143
4101788991310,2cyclictest246823-21cpuspeed_turbos12:35:113
4101788991310,2cyclictest142685-21irqcore10:55:153
4101788991310,1cyclictest0-21swapper/307:45:163
410178399139,2cyclictest0-21swapper/210:45:132
410178399138,4cyclictest27928-21kworker/u8:1+flush-259:011:15:212
410178399138,4cyclictest27928-21kworker/u8:1+flush-259:011:15:202
410178399138,4cyclictest167742-21apt-get11:20:012
410178399138,3cyclictest509-21rs:main2
410178399136,4cyclictest252-21systemd-journal11:50:162
4101783991310,2cyclictest131702-21idleruntime-cro10:45:002
410178399130,6cyclictest142019-21munin-run10:55:002
4101778991310,2cyclictest17206-21munin-plugin-st08:55:011
4101778991310,2cyclictest17206-21munin-plugin-st08:55:001
4101775991310,2cyclictest61824-21kthreadcore09:35:180
4101775991310,2cyclictest60350irq/132-enp0s29f1:rx-009:06:160
410178899129,2cyclictest4037671-21kworker/u8:1+events_unbound07:50:223
410178899129,2cyclictest198727-21unixbench_singl11:45:263
410178899129,2cyclictest174045-21irqcore11:25:143
410178899129,2cyclictest121855-21cpuspeed_turbos10:35:113
410178899128,3cyclictest147205-21kworker/u8:2+flush-259:011:11:333
410178899127,4cyclictest252-21systemd-journal07:14:513
410178399129,2cyclictest74734-21cron09:50:012
410178399129,2cyclictest4179200-21needreboot08:20:192
410178399129,2cyclictest0-21swapper/209:55:162
410178399128,3cyclictest218951-21ntp_kernel_pll_12:05:212
410178399128,2cyclictest3203-21kthreadcore08:40:162
410178399127,4cyclictest4112014-21kworker/u8:2+flush-259:008:45:162
410178399126,4cyclictest53717-21https09:30:002
410177899128,3cyclictest178506-21kworker/u8:0+events_unbound12:25:121
410177899127,4cyclictest101118-21/usr/sbin/munin10:15:131
410178899119,1cyclictest4154131-21sh07:59:593
410178899119,1cyclictest199383-21kworker/u8:1+events_unbound11:50:113
410178899117,2cyclictest0-21swapper/308:35:003
410178899115,4cyclictest189108-21apt-get11:40:123
410178899115,4cyclictest189108-21apt-get11:40:113
410178899110,3cyclictest131696-21journal-offline10:45:003
410178399117,3cyclictest4037671-21kworker/u8:1+flush-259:008:15:022
410178399106,3cyclictest157829-21cpuspeed_turbos11:10:112
410178399106,2cyclictest1708-21sshd08:39:512
41017889996,2cyclictest168731-21fw_conntrack11:20:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional