You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 15:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Thu Mar 12, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3462586993532,2cyclictest3555265-21kworker/u8:2+flush-259:009:05:002
3462591993426,5cyclictest509-21rs:main3
3462583993327,4cyclictest252-21systemd-journal07:28:201
3462591993226,4cyclictest3762631-21awk12:00:003
3462581993229,2cyclictest3684580-21apt-get10:42:590
3462581993229,2cyclictest3468010-21apt-get07:15:100
3462586993027,2cyclictest3768133-21apt-get12:05:122
3462581992924,4cyclictest3721638-21apt-get11:20:110
3462586992724,2cyclictest3555265-21kworker/u8:2+flush-259:009:10:162
3462586992723,3cyclictest3674302-21kworker/u8:2+flush-259:012:00:142
3462583992723,3cyclictest3430327-21kworker/u8:2+events_unbound07:10:181
3462591992622,3cyclictest3514108-21kworker/u8:1+flush-259:008:15:213
3462583992621,3cyclictest3493491-21latency_hist07:40:021
3462581992622,3cyclictest3648525-21apt-get10:10:100
3462586992521,3cyclictest3664173-21kworker/u8:3+flush-259:010:25:212
3462583992518,5cyclictest3560380-21latency_hist08:45:001
3462581992521,3cyclictest252-21systemd-journal12:35:200
3462591992419,3cyclictest252-21systemd-journal10:12:213
3462586992418,4cyclictest3544916-21latency_hist08:30:002
3462581992420,3cyclictest3473151-21apt-get07:20:110
3462591992318,3cyclictest3653660-21/usr/sbin/munin10:15:193
3462591992317,4cyclictest3430327-21kworker/u8:2+flush-259:007:10:153
3462586992320,2cyclictest3519227-21idleruntime-cro08:05:002
3462586992319,3cyclictest3685022-21kworker/u8:0+flush-259:010:45:162
3462583992317,4cyclictest3617380-21latency_hist09:40:001
3462581992319,3cyclictest3633202-21diskstats09:55:130
3462581992317,4cyclictest3492621-21ntpq07:35:210
3462586992219,2cyclictest3721122-21kworker/u8:3+flush-259:011:20:212
3462586992218,2cyclictest3736863-21sh11:35:002
3462583992218,3cyclictest3757721-21apt-get11:55:131
3462583992217,3cyclictest252-21systemd-journal12:29:201
3462583992216,3cyclictest252-21systemd-journal08:30:211
3462591992114,5cyclictest252-21systemd-journal12:40:003
3462591992113,6cyclictest252-21systemd-journal11:00:003
3462586992118,2cyclictest3488361-21kworker/u8:2+flush-259:007:40:002
3462581992117,3cyclictest3472630-21kworker/u8:3+flush-259:007:30:000
3462581992115,4cyclictest3581596-21apt-get09:05:100
3462581992115,4cyclictest252-21systemd-journal10:25:010
3462591992015,4cyclictest252-21systemd-journal07:30:013
3462586992016,3cyclictest3643122-21kworker/u8:1+flush-259:010:55:232
3462586992013,5cyclictest3658970-21cp10:20:002
3462586992013,5cyclictest3627669-21latency_hist09:50:002
346258399207,2cyclictest0-21swapper/112:05:001
3462583992014,4cyclictest3773670-21/usr/sbin/munin12:10:141
3462581992014,4cyclictest509-21rs:main0
3462581992014,4cyclictest509-21rs:main0
3462591991917,1cyclictest3674302-21kworker/u8:2+flush-259:011:50:203
3462591991914,3cyclictest3597062-21apt-get09:20:103
3462591991913,4cyclictest3555265-21kworker/u8:2+flush-259:008:59:593
3462586991915,2cyclictest0-21swapper/207:55:012
3462586991914,4cyclictest3524410-21kworker/u8:3+flush-259:009:09:592
3462586991913,4cyclictest3488344-21latency_hist07:35:012
3462586991913,4cyclictest3462508-21latency_hist07:10:002
346258399198,2cyclictest3561199-21cpuspeed_turbos08:45:151
3462583991913,4cyclictest3721370-21latency_hist11:20:011
3462581991915,3cyclictest3488361-21kworker/u8:2+flush-259:007:40:160
3462581991912,5cyclictest3756536-21ntpq11:50:200
3462591991814,2cyclictest0-21swapper/308:15:003
3462591991813,3cyclictest500-21systemd-logind07:25:003
3462586991812,5cyclictest3788874-21apt-get12:25:012
3462583991815,2cyclictest3799549-21idleruntime-cro12:35:001
3462583991814,3cyclictest509-21rs:main1
3462583991814,3cyclictest3747416-21apt-get11:45:091
3462583991814,3cyclictest3581357-21kworker/u8:0+flush-259:009:25:001
3462583991812,4cyclictest252-21systemd-journal07:52:201
3462581991814,3cyclictest3581357-21kworker/u8:0+flush-259:009:40:260
3462591991714,2cyclictest3632783-21sh09:55:003
3462591991714,2cyclictest3539808-21munin-plugin-st08:25:003
3462591991713,2cyclictest3783778-21true12:20:013
3462591991711,4cyclictest509-21rs:main3
3462591991711,4cyclictest3752296-21latency_hist11:50:013
3462591991711,4cyclictest252-21systemd-journal09:30:003
3462591991710,5cyclictest252-21systemd-journal08:45:203
3462586991712,3cyclictest252-21systemd-journal08:45:282
3462586991710,5cyclictest3653422-21latency_hist10:15:012
3462583991712,4cyclictest3757479-21kworker/u8:0+flush-259:012:20:171
3462583991712,4cyclictest3540043-21/usr/sbin/munin08:25:141
3462583991712,3cyclictest252-21systemd-journal07:46:201
3462581991715,1cyclictest0-21swapper/008:20:010
3462581991713,3cyclictest3643122-21kworker/u8:1+flush-259:010:35:160
3462581991713,3cyclictest252-21systemd-journal12:35:010
3462581991712,3cyclictest3695420-21apt-get10:55:100
3462581991710,5cyclictest3674439-21latency_hist10:35:010
3462591991613,2cyclictest3726583-21kworker/u8:1+flush-259:012:25:263
3462591991613,2cyclictest3683835-21ntp_kernel_pll_10:40:193
3462591991613,2cyclictest3581357-21kworker/u8:0+flush-259:009:45:263
3462591991612,3cyclictest3612079-21kworker/u8:1+flush-259:009:40:153
3462591991612,3cyclictest3503761-21kworker/u8:0+flush-259:007:55:243
3462591991612,2cyclictest3488342-21idleruntime-cro07:35:003
3462591991611,3cyclictest3560408-21gpgv08:44:593
3462591991611,3cyclictest252-21systemd-journal10:52:203
3462591991610,4cyclictest509-21rs:main3
3462586991613,2cyclictest509-21rs:main2
3462586991613,2cyclictest3499320-21irqcore07:45:162
3462586991612,3cyclictest1-21systemd09:30:212
3462581991614,1cyclictest60350irq/132-enp0s29f1:rx-011:05:130
3462581991613,2cyclictest60350irq/132-enp0s29f1:rx-010:00:210
346259199159,4cyclictest3648269-21latency_hist10:10:003
346259199159,4cyclictest3524371-21latency_hist08:10:013
3462591991512,2cyclictest3701573-21kthreadcore11:00:143
3462586991513,1cyclictest0-21swapper/209:45:012
3462586991511,3cyclictest3514108-21kworker/u8:1+flush-259:008:35:232
3462586991511,3cyclictest1-21systemd09:15:202
3462586991510,4cyclictest3524410-21kworker/u8:3+flush-259:008:50:242
346258399159,4cyclictest3711258-21/usr/sbin/munin11:10:121
346258399159,4cyclictest252-21systemd-journal09:50:001
3462583991511,3cyclictest3685056-21apt-get10:45:121
3462583991511,3cyclictest3659252-21apt-get10:20:111
3462581991514,1cyclictest60350irq/132-enp0s29f1:rx-009:37:120
3462581991513,1cyclictest61150irq/133-enp0s29f1:tx-007:30:150
3462581991513,1cyclictest60350irq/132-enp0s29f1:rx-012:28:250
3462581991513,1cyclictest60350irq/132-enp0s29f1:rx-012:05:120
3462581991513,1cyclictest60350irq/132-enp0s29f1:rx-011:55:190
3462581991513,1cyclictest60350irq/132-enp0s29f1:rx-011:45:210
3462581991513,1cyclictest60350irq/132-enp0s29f1:rx-011:19:430
3462581991513,1cyclictest60350irq/132-enp0s29f1:rx-009:20:110
3462581991512,2cyclictest60350irq/132-enp0s29f1:rx-009:00:110
3462581991512,2cyclictest60350irq/132-enp0s29f1:rx-008:41:290
3462581991512,2cyclictest60350irq/132-enp0s29f1:rx-008:05:160
3462581991511,3cyclictest60350irq/132-enp0s29f1:rx-010:45:120
3462591991411,2cyclictest0-21swapper/312:10:013
3462586991411,2cyclictest3483213-21idleruntime-cro07:30:012
3462586991411,2cyclictest0-21swapper/209:50:192
3462586991411,2cyclictest0-21swapper/208:05:172
346258399148,4cyclictest509-21rs:main1
3462583991412,1cyclictest0-21swapper/111:05:211
3462583991411,2cyclictest3690707-21irqcore10:50:171
3462581991413,1cyclictest60350irq/132-enp0s29f1:rx-012:15:230
3462581991413,1cyclictest60350irq/132-enp0s29f1:rx-009:10:270
3462581991412,2cyclictest60350irq/132-enp0s29f1:rx-008:00:140
3462581991412,1cyclictest60350irq/132-enp0s29f1:rx-011:04:020
3462581991412,1cyclictest60350irq/132-enp0s29f1:rx-010:25:230
3462581991412,1cyclictest60350irq/132-enp0s29f1:rx-009:30:210
3462581991412,1cyclictest60350irq/132-enp0s29f1:rx-008:35:180
3462581991412,1cyclictest60350irq/132-enp0s29f1:rx-008:10:560
3462581991412,1cyclictest60350irq/132-enp0s29f1:rx-007:51:350
3462581991412,1cyclictest60350irq/132-enp0s29f1:rx-007:45:140
3462581991411,2cyclictest61150irq/133-enp0s29f1:tx-008:54:190
3462581991410,2cyclictest3742258-21apt-get11:40:110
346259199139,2cyclictest0-21swapper/311:30:213
346259199139,2cyclictest0-21swapper/310:05:013
346259199138,3cyclictest3632570-21kworker/u8:3+events_unbound09:55:233
3462591991310,2cyclictest3799550-21sh12:34:593
3462591991310,2cyclictest3592320-21sed09:15:153
346258699138,3cyclictest252-21systemd-journal11:29:592
3462586991310,2cyclictest3789144-21latency_hist12:25:012
3462586991310,2cyclictest3602246-21cpuspeed_turbos09:25:132
3462586991310,2cyclictest3465124-21kthreadcore07:10:192
3462583991310,2cyclictest3674873-21fschecks_count10:35:131
3462583991310,2cyclictest3607770-21irqcore09:30:141
3462583991310,2cyclictest3521778-21kthreadcore08:05:181
346258399130,12cyclictest0-21swapper/108:05:001
3462581991311,1cyclictest60350irq/132-enp0s29f1:rx-012:12:430
3462581991311,1cyclictest60350irq/132-enp0s29f1:rx-011:30:230
3462581991311,1cyclictest60350irq/132-enp0s29f1:rx-010:54:230
346259199129,1cyclictest0-21swapper/312:25:013
346259199128,3cyclictest3488784-21fschecks_count07:35:133
346259199128,2cyclictest0-21swapper/311:19:593
346259199128,2cyclictest0-21swapper/309:35:153
346259199126,4cyclictest507-21in:imuxsock07:45:123
346259199121,3cyclictest3519232-21latency_hist08:05:013
3462591991210,1cyclictest1404501-21kworker/3:2+events_power_efficient11:28:123
346258699129,2cyclictest3779079-21fschecks_time12:15:122
346258699128,3cyclictest3638521-21grep10:00:132
346258699128,3cyclictest3493827-21cpuspeed_turbos07:40:132
3462586991210,1cyclictest0-21swapper/210:55:002
3462586991210,1cyclictest0-21swapper/208:10:122
346258399129,2cyclictest3705487-21gpgv11:05:001
346258399129,2cyclictest3483539-21cpuspeed_turbos07:30:111
346258399129,1cyclictest0-21swapper/109:00:161
346258399128,3cyclictest3493762-21apt-get07:40:101
346258399127,3cyclictest3684508-40mandb10:42:201
346258399121,4cyclictest36438522irqcore10:05:161
3462583991210,1cyclictest0-21swapper/112:15:151
3462583991210,1cyclictest0-21swapper/108:15:001
346258199129,2cyclictest60350irq/132-enp0s29f1:rx-012:21:220
346258199129,2cyclictest3544921-21turbostat08:29:590
346258199129,2cyclictest3534994-21cpuspeed_turbos08:20:110
346258199127,3cyclictest3632570-21kworker/u8:3+flush-259:010:15:240
3462581991211,1cyclictest60350irq/132-enp0s29f1:rx-009:19:550
3462581991210,1cyclictest60350irq/132-enp0s29f1:rx-011:29:120
3462581991210,1cyclictest60350irq/132-enp0s29f1:rx-011:10:210
3462581991210,1cyclictest60350irq/132-enp0s29f1:rx-009:45:380
3462581991210,1cyclictest60350irq/132-enp0s29f1:rx-007:10:180
346259199119,1cyclictest0-21swapper/310:45:243
346259199119,1cyclictest0-21swapper/310:30:123
346259199118,2cyclictest3741551-21unixbench_singl11:35:243
346259199118,2cyclictest3741551-21unixbench_singl11:35:233
346259199118,1cyclictest0-21swapper/308:50:213
346259199116,2cyclictest0-21swapper/308:40:003
346258699118,2cyclictest3678589-21needreboot10:35:192
346258699117,3cyclictest3462771-21kworker/u8:0+flush-259:007:16:512
346258699116,3cyclictest490-21dbus-daemon11:05:002
346258399118,2cyclictest0-21swapper/110:59:591
346258399118,1cyclictest0-21swapper/108:00:001
346258399117,3cyclictest0-21swapper/109:30:011
346258199110,10cyclictest3763443-21irqcore12:00:140
346259199108,1cyclictest0-21swapper/309:30:233
346259199106,2cyclictest3663675-21grep10:20:243
346258699108,1cyclictest3473574-21grep07:20:152
346258699108,1cyclictest0-21swapper/211:55:182
346258699107,2cyclictest3726583-21kworker/u8:1+events_unbound12:13:132
346258399108,1cyclictest0-21swapper/107:20:161
34625839997,1cyclictest3638298-21cpuspeed_turbos10:00:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional