You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 17:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Mar 25, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3165745994139,1cyclictest1105703-21kworker/1:0+pm10:12:271
3165741994038,1cyclictest3222848-21kworker/0:1+pm10:12:260
3165741993632,3cyclictest3311295-21apt-get09:30:120
3165745993228,3cyclictest3223046-21apt-get08:05:131
3165748993128,2cyclictest3227940-21kworker/u8:2+flush-259:009:50:252
3165748993127,3cyclictest3291183-21kworker/u8:4+events_unbound09:20:142
3165748993127,3cyclictest3181169-21kworker/u8:1+flush-259:007:35:252
3165745993127,3cyclictest3326756-21apt-get09:45:111
3165748992924,3cyclictest3503512-21kworker/u8:1+events_unbound12:35:192
3165745992924,4cyclictest3285576-21/usr/sbin/munin09:05:151
3165748992824,3cyclictest3291183-21kworker/u8:4+flush-259:009:10:192
3165751992723,3cyclictest3337043-21kworker/u8:4+flush-259:010:00:213
3165748992722,4cyclictest3181822-21apt-get07:25:092
3165741992722,4cyclictest3197260-21apt-get07:40:110
3165751992622,3cyclictest3181701-21gpgv07:25:003
3165748992622,3cyclictest3367808-21kworker/u8:0+flush-259:010:50:212
3165748992622,3cyclictest3337043-21kworker/u8:4+events_unbound11:10:102
3165748992621,4cyclictest3254179-21gpgv08:35:012
3165748992518,5cyclictest252-21systemd-journal12:09:592
3165745992520,4cyclictest3270164-21apt-get08:50:131
3165751992416,6cyclictest3487553-21latency_hist12:20:003
3165745992420,3cyclictest3482670-21apt-get12:15:111
3165745992420,3cyclictest3394354-21/usr/sbin/munin10:50:151
3165745992417,5cyclictest252-21systemd-journal11:15:001
3165751992317,4cyclictest3446040-21/usr/sbin/munin11:40:183
3165751992316,5cyclictest3388025-21ntpq10:40:203
3165745992320,2cyclictest0-21swapper/112:40:011
3165745992319,3cyclictest3337077-21apt-get09:55:091
3165745992319,3cyclictest3337077-21apt-get09:55:091
3165741992317,4cyclictest3347088-21latency_hist10:05:000
3165748992219,2cyclictest3440834-21kworker/u8:4+events_unbound12:00:232
3165748992218,3cyclictest3357200-21kworker/u8:2+events_unbound10:15:142
3165748992218,3cyclictest3217850-21kworker/u8:1+flush-259:008:30:002
3165748992218,2cyclictest3367808-21kworker/u8:0+flush-259:010:30:152
3165748992216,4cyclictest3311035-21latency_hist09:30:002
3165745992219,2cyclictest3217850-21kworker/u8:1+flush-259:008:30:251
3165741992217,3cyclictest3337043-21kworker/u8:4+flush-259:010:25:000
3165751992117,3cyclictest3321348-21kworker/u8:1+flush-259:010:10:253
3165748992117,3cyclictest3186951-21kworker/u8:0+events_unbound07:45:122
3165748992117,3cyclictest3112954-21kworker/u8:1+events_unbound07:14:242
3165748992115,5cyclictest3456819-21apt-get11:50:122
3165751992016,2cyclictest0-21swapper/310:10:003
3165751992014,4cyclictest3451187-21kworker/u8:2+flush-259:011:45:163
3165748992017,2cyclictest3477229-21kworker/u8:2+events_unbound12:10:232
3165748992017,2cyclictest3337043-21kworker/u8:4+flush-259:011:00:232
3165748992017,2cyclictest3227940-21kworker/u8:2+events_unbound08:45:142
3165748992015,3cyclictest3409825-21apt-get11:05:112
3165741992014,4cyclictest3165959-21apt-get07:10:110
3165751991916,2cyclictest490-21dbus-daemon08:35:013
3165748991916,2cyclictest3430952-21irqcore11:25:142
3165748991915,3cyclictest3440834-21kworker/u8:4+events_unbound11:40:212
3165748991915,3cyclictest3367808-21kworker/u8:0+events_unbound10:25:142
3165748991915,3cyclictest3321348-21kworker/u8:1+flush-259:009:45:242
3165748991915,3cyclictest3227940-21kworker/u8:2+events_unbound08:35:152
3165748991915,3cyclictest3217850-21kworker/u8:1+events_unbound08:08:242
3165748991915,3cyclictest3171065-21kworker/u8:2+flush-259:007:40:212
3165748991914,3cyclictest3367808-21kworker/u8:0+flush-259:011:20:002
3165748991912,5cyclictest3455273-21ntpq11:45:222
3165745991915,3cyclictest507-21in:imuxsock08:45:001
3165741991916,2cyclictest3227940-21kworker/u8:2+flush-259:009:25:160
3165741991914,3cyclictest0-21swapper/011:05:010
316574199190,17cyclictest1-21systemd09:52:240
3165748991814,3cyclictest3227940-21kworker/u8:2+flush-259:008:55:202
3165748991814,3cyclictest3207136-21kworker/u8:3+flush-259:008:00:162
3165748991813,4cyclictest3389180-21apt-get10:45:102
3165748991812,4cyclictest3341062-21ntpq09:55:182
3165748991812,4cyclictest3341062-21ntpq09:55:182
316574599186,11cyclictest3285325-21sh09:05:011
3165745991814,3cyclictest3477229-21kworker/u8:2+flush-259:012:10:211
3165741991814,2cyclictest2971-21cron07:20:000
3165741991812,5cyclictest3243787-21latency_hist08:25:010
3165751991715,1cyclictest3316456-21apt-get09:35:113
3165751991713,3cyclictest509-21rs:main3
3165751991713,3cyclictest3440867-21apt-get11:35:113
3165748991714,2cyclictest3435474-21kworker/u8:2+flush-259:011:30:182
3165748991714,2cyclictest3337043-21kworker/u8:4+events_unbound10:20:192
3165748991714,2cyclictest3171065-21kworker/u8:2+events_unbound07:20:222
3165748991713,3cyclictest3310995-21kworker/u8:0+flush-259:009:35:202
3165748991713,3cyclictest3275102-21kworker/u8:3+events_unbound09:30:192
3165748991713,3cyclictest1-21systemd10:12:262
3165745991714,2cyclictest3450945-21idleruntime-cro11:44:591
3165745991714,2cyclictest3227940-21kworker/u8:2+flush-259:009:40:151
3165745991714,2cyclictest3217850-21kworker/u8:1+flush-259:008:14:591
3165745991712,4cyclictest3346231-21ntpq10:00:211
3165741991713,2cyclictest3503501-21turbostat12:35:000
316575199169,5cyclictest252-21systemd-journal08:06:243
3165751991613,2cyclictest0-21swapper/311:34:593
3165751991610,4cyclictest252-21systemd-journal11:06:233
3165748991613,2cyclictest3227940-21kworker/u8:2+flush-259:008:20:212
3165748991612,3cyclictest3497458-21ntp_kernel_pll_12:25:222
3165748991612,3cyclictest3487549-21apt-get12:20:022
3165748991612,3cyclictest3487549-21apt-get12:20:022
3165748991612,3cyclictest3217850-21kworker/u8:1+flush-259:008:50:282
3165748991612,3cyclictest3217850-21kworker/u8:1+events_unbound08:40:252
3165748991612,3cyclictest3171065-21kworker/u8:2+flush-259:007:50:252
3165745991614,1cyclictest3436134-21irqcore11:30:161
3165745991613,2cyclictest3502620-21ntp_kernel_pll_12:30:201
3165745991613,1cyclictest0-21swapper/111:50:011
3165741991614,2cyclictest60350irq/132-enp0s29f1:rx-010:19:240
3165741991614,1cyclictest60350irq/132-enp0s29f1:rx-011:15:170
3165741991613,2cyclictest60350irq/132-enp0s29f1:rx-012:25:130
3165741991613,2cyclictest60350irq/132-enp0s29f1:rx-011:05:200
3165741991613,2cyclictest60350irq/132-enp0s29f1:rx-009:05:130
3165741991613,2cyclictest60350irq/132-enp0s29f1:rx-007:45:210
3165741991613,2cyclictest60350irq/132-enp0s29f1:rx-007:35:140
3165741991613,2cyclictest3295666-21sh09:15:000
3165741991612,2cyclictest60350irq/132-enp0s29f1:rx-007:55:200
3165741991611,4cyclictest3221922-21ntpq08:00:210
316575199158,5cyclictest3238316-21gpgv08:20:003
3165751991512,2cyclictest3285326-21idleruntime-cro09:05:013
3165751991511,3cyclictest3475219-21kthreadcore12:05:183
3165748991512,2cyclictest3321348-21kworker/u8:1+events_unbound09:40:182
3165748991512,2cyclictest3171509-21irqcore07:15:172
3165748991511,3cyclictest3440834-21kworker/u8:4+events_unbound11:57:252
3165748991511,3cyclictest3367808-21kworker/u8:0+flush-259:011:20:172
3165748991511,3cyclictest3217850-21kworker/u8:1+events_unbound08:10:172
3165748991511,3cyclictest3186951-21kworker/u8:0+flush-259:007:55:212
3165745991512,2cyclictest3472057-21munin-run12:05:001
3165745991512,1cyclictest0-21swapper/110:25:001
3165745991511,3cyclictest3306178-21apt-get09:25:111
3165745991511,3cyclictest3202421-21apt-get07:45:121
3165745991510,3cyclictest252-21systemd-journal12:21:231
3165745991510,3cyclictest252-21systemd-journal12:21:221
3165741991514,1cyclictest60350irq/132-enp0s29f1:rx-012:16:010
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-012:08:340
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-010:50:190
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-010:45:220
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-009:55:100
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-009:55:090
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-009:36:150
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-009:02:430
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-008:57:160
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-008:41:100
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-008:39:230
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-008:15:170
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-007:52:030
3165741991513,1cyclictest60350irq/132-enp0s29f1:rx-007:20:230
3165741991512,2cyclictest60350irq/132-enp0s29f1:rx-011:22:230
3165741991512,2cyclictest60350irq/132-enp0s29f1:rx-010:55:130
3165741991512,2cyclictest3326500-21turbostat09:45:000
3165741991511,3cyclictest3186951-21kworker/u8:0+flush-259:007:30:160
3165741991511,3cyclictest3186951-21kworker/u8:0+flush-259:007:30:160
3165741991511,2cyclictest3435456-21turbostat11:29:590
3165741991510,3cyclictest252-21systemd-journal07:27:250
3165751991411,2cyclictest3271185-21kthreadcore08:50:193
3165748991411,2cyclictest3499002-21sed12:30:152
3165748991411,2cyclictest3337043-21kworker/u8:4+events_unbound10:05:202
3165748991410,3cyclictest3378184-21kworker/u8:1+events_unbound12:15:122
3165748991410,3cyclictest3337043-21kworker/u8:4+events_unbound10:03:252
3165748991410,3cyclictest3275102-21kworker/u8:3+events_unbound09:08:552
3165748991410,3cyclictest3227940-21kworker/u8:2+events_unbound09:00:132
316574599149,4cyclictest3497469-21ntpq12:25:221
316574599149,4cyclictest3399531-21apt-get10:55:101
316574599149,3cyclictest3461696-21latency_hist11:55:001
316574599148,4cyclictest252-21systemd-journal08:28:231
3165745991410,3cyclictest3378184-21kworker/u8:1+flush-259:011:15:161
3165745991410,3cyclictest252-21systemd-journal08:05:001
3165741991413,1cyclictest60350irq/132-enp0s29f1:rx-011:56:510
3165741991412,1cyclictest60350irq/132-enp0s29f1:rx-012:35:180
3165741991412,1cyclictest60350irq/132-enp0s29f1:rx-011:10:100
3165741991412,1cyclictest60350irq/132-enp0s29f1:rx-010:35:230
3165741991412,1cyclictest60350irq/132-enp0s29f1:rx-008:25:170
3165741991412,1cyclictest60350irq/132-enp0s29f1:rx-008:11:180
3165741991412,1cyclictest0-21swapper/012:15:000
3165741991411,2cyclictest60350irq/132-enp0s29f1:rx-010:40:110
3165741991410,3cyclictest3367808-21kworker/u8:0+flush-259:010:30:160
3165741991410,3cyclictest3227940-21kworker/u8:2+events_unbound08:45:180
316575199139,3cyclictest3171065-21kworker/u8:2+events_unbound07:50:183
316575199138,3cyclictest252-21systemd-journal08:38:243
316575199137,4cyclictest3280224-21latency_hist09:00:013
3165751991311,1cyclictest0-21swapper/311:29:593
3165751991310,2cyclictest3259951-21cpuspeed_turbos08:40:123
3165751991310,2cyclictest0-21swapper/307:55:163
316574899139,3cyclictest3217850-21kworker/u8:1+events_unbound08:15:242
316574899139,2cyclictest0-21swapper/211:35:172
3165748991310,2cyclictest3300789-21cron09:20:002
316574599139,3cyclictest3296145-21fschecks_time09:15:131
316574599139,3cyclictest3178547-21kthreadcore07:20:171
316574599138,4cyclictest3321338-21latency_hist09:40:001
3165745991310,2cyclictest3361678-21ntp_kernel_err10:15:201
3165745991310,2cyclictest3197006-21sh07:40:001
3165741991312,1cyclictest60350irq/132-enp0s29f1:rx-011:50:480
3165741991311,1cyclictest60350irq/132-enp0s29f1:rx-012:21:330
3165741991311,1cyclictest60350irq/132-enp0s29f1:rx-012:21:320
3165741991311,1cyclictest60350irq/132-enp0s29f1:rx-012:00:140
3165741991311,1cyclictest60350irq/132-enp0s29f1:rx-010:25:250
3165741991311,1cyclictest60350irq/132-enp0s29f1:rx-010:05:220
3165741991311,1cyclictest60350irq/132-enp0s29f1:rx-008:50:200
3165741991310,2cyclictest60350irq/132-enp0s29f1:rx-011:45:220
3165741991310,2cyclictest60350irq/132-enp0s29f1:rx-011:30:190
3165741991310,2cyclictest3321348-21kworker/u8:1+flush-259:009:45:230
3165741991310,2cyclictest3291183-21kworker/u8:4+flush-259:009:20:250
3165741991310,2cyclictest3227469-21unixbench_singl08:05:260
316575199129,2cyclictest3504174-21irqcore12:35:143
316575199129,1cyclictest0-21swapper/307:25:003
316575199128,2cyclictest0-21swapper/310:55:163
316575199127,4cyclictest3155532-21kworker/u8:0+flush-259:007:10:153
316575199121,9cyclictest3399268-21awk10:55:003
316575199120,4cyclictest3305913-21awk09:25:003
316574899128,3cyclictest3337043-21kworker/u8:4+events_unbound10:44:582
316574599129,2cyclictest3347778-21sed10:05:151
316574599129,2cyclictest3311362-21cpuspeed_turbos09:30:131
316574599129,2cyclictest3265283-21fschecks_time08:45:151
316574599128,3cyclictest3337043-21kworker/u8:4+flush-259:010:35:161
316574599127,4cyclictest3430536-21apt-get11:25:101
316574599126,4cyclictest490-21dbus-daemon11:25:001
3165741991210,1cyclictest60350irq/132-enp0s29f1:rx-008:30:160
316575199118,2cyclictest3187050-21cpuspeed_turbos07:30:133
316575199118,2cyclictest3187050-21cpuspeed_turbos07:30:133
316575199118,2cyclictest0-21swapper/309:30:133
316575199116,4cyclictest3378184-21kworker/u8:1+flush-259:011:50:173
316575199110,3cyclictest3341954-21latency_hist10:00:003
316575199110,3cyclictest3341954-21latency_hist10:00:003
316574599119,1cyclictest0-21swapper/111:05:171
316574599118,2cyclictest3393636-21unixbench_multi10:45:231
316574599118,2cyclictest3165735-21cyclictest08:20:001
316574599118,1cyclictest0-21swapper/107:45:001
316574599117,3cyclictest500-21systemd-logind09:15:001
316574199119,1cyclictest60350irq/132-enp0s29f1:rx-011:39:100
3165741991110,1cyclictest60350irq/132-enp0s29f1:rx-009:17:450
316575199108,1cyclictest0-21swapper/311:10:203
316574899106,3cyclictest2453694-21kworker/u8:5+events_unbound07:30:022
316574899106,3cyclictest2453694-21kworker/u8:5+events_unbound07:30:022
31657519995,3cyclictest3290367-21sshd09:08:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional