You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 22:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sat May 09, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
384784994034,4cyclictest252-21systemd-journal08:06:242
384778993932,5cyclictest513264-21ntpq09:10:220
384778993932,5cyclictest513264-21ntpq09:10:220
384789993634,1cyclictest539613-21fwupd09:36:203
384778993531,3cyclictest519274-21kworker/u8:3+flush-259:009:25:010
384789993431,2cyclictest721751-21apt-get12:35:123
384784993328,4cyclictest431301-21apt-get07:55:122
384778993327,4cyclictest399340-21ntpq07:20:220
384789993127,3cyclictest534759-21kworker/u8:4+flush-259:009:50:243
384784993125,4cyclictest441709-21cat08:05:012
384778993125,5cyclictest502466-21ntpq09:00:220
384778993124,5cyclictest252-21systemd-journal10:10:010
384781993023,5cyclictest684202-21ntpq11:55:221
384781993023,5cyclictest409526-21ntpq07:30:211
384778993024,4cyclictest509-21rs:main0
384789992923,4cyclictest669626-21latency_hist11:45:013
384789992923,4cyclictest669626-21latency_hist11:45:003
384784992925,3cyclictest384755-21kworker/u8:3+flush-259:007:30:282
384778992924,4cyclictest685485-21diskstats12:00:140
384778992923,5cyclictest388983-21ntpq07:10:210
384789992823,4cyclictest1468027-21kworker/u8:2+flush-259:007:20:203
384781992822,4cyclictest252-21systemd-journal08:50:001
384778992824,3cyclictest622946-21kworker/u8:1+flush-259:011:25:250
384778992823,4cyclictest590755-21ntpq10:25:220
384778992823,4cyclictest384755-21kworker/u8:3+events_unbound07:30:240
384778992821,5cyclictest549351-21ntpq09:45:190
384789992723,3cyclictest446864-21kworker/u8:3+flush-259:008:20:003
384781992721,4cyclictest705890-21apt-get12:20:081
384781992721,4cyclictest509-21rs:main1
384781992720,5cyclictest528772-21ntpq09:25:231
384778992724,2cyclictest601732-21kworker/u8:3+flush-259:011:00:200
384778992723,3cyclictest659308-21kworker/u8:3+flush-259:011:59:590
384778992722,4cyclictest1468027-21kworker/u8:2+events_unbound08:05:230
384789992623,2cyclictest503246-21kworker/u8:0+flush-259:009:20:013
384789992622,3cyclictest446864-21kworker/u8:3+flush-259:009:05:263
384789992620,4cyclictest695773-21diskstats12:10:133
384789992521,3cyclictest410449-21kworker/u8:0+flush-259:008:40:003
384784992520,3cyclictest503246-21kworker/u8:0+flush-259:010:20:162
384781992520,4cyclictest503246-21kworker/u8:0+flush-259:010:35:171
384781992519,3cyclictest508587-21kworker/u8:4+flush-259:009:20:161
384778992517,6cyclictest440374-21ntpq08:00:210
384784992420,3cyclictest503246-21kworker/u8:0+flush-259:009:45:012
384784992418,4cyclictest534732-21latency_hist09:35:002
384784992417,6cyclictest487112-21ntpq08:45:202
384778992417,5cyclictest663595-21ntpq11:35:200
384789992317,4cyclictest710993-21gpgv12:25:013
384781992318,4cyclictest700150-21kworker/u8:1+flush-259:012:15:211
384781992317,4cyclictest545107-21latency_hist09:45:011
384778992318,4cyclictest669639-21kworker/u8:0+events_unbound12:35:220
384778992317,4cyclictest571308-21apt-get10:10:130
384778992317,4cyclictest477062-21kworker/u8:2+flush-259:008:54:590
384778992316,5cyclictest384755-21kworker/u8:3+events_unbound07:40:210
384778992315,5cyclictest720661-21ntpq12:30:220
384789992218,3cyclictest534759-21kworker/u8:4+flush-259:010:30:013
384781992216,4cyclictest252-21systemd-journal08:58:231
384778992220,1cyclictest477062-21kworker/u8:2+flush-259:008:55:200
384778992217,4cyclictest622946-21kworker/u8:1+events_unbound11:50:010
384789992115,4cyclictest586483-21latency_hist10:25:013
384784992116,4cyclictest503246-21kworker/u8:0+flush-259:010:15:242
384784992115,4cyclictest659290-21latency_hist11:35:012
384781992115,4cyclictest452241-21apt-get08:15:121
384781992115,4cyclictest384698-21latency_hist07:10:001
384781992114,5cyclictest695353-21latency_hist12:10:011
384778992115,4cyclictest638408-21store11:15:010
384789992017,2cyclictest420706-21sh07:45:013
384789992017,2cyclictest410449-21kworker/u8:0+flush-259:007:45:173
384789992014,4cyclictest441323-21gpgv08:05:003
38478499207,1cyclictest0-21swapper/207:35:222
384784992014,4cyclictest679003-21ntpq11:50:222
384781992017,2cyclictest509-21rs:main1
384781992014,4cyclictest690203-21latency_hist12:05:011
384778992014,4cyclictest446864-21kworker/u8:3+flush-259:008:44:590
384778992012,6cyclictest617987-21diskstats10:55:130
384778992012,5cyclictest607239-21latency_hist10:45:010
384789991915,3cyclictest1468027-21kworker/u8:2+flush-259:007:35:203
384789991914,4cyclictest560901-21apt-get10:00:103
38478499198,9cyclictest0-21swapper/208:35:212
38478499193,4cyclictest602014-21awk10:40:012
38478499190,3cyclictest565390-21grep10:00:222
384781991914,3cyclictest252-21systemd-journal11:15:401
384781991913,4cyclictest503246-21kworker/u8:0+flush-259:009:35:171
384781991912,5cyclictest252-21systemd-journal08:39:591
384778991915,3cyclictest700150-21kworker/u8:1+flush-259:012:25:210
384778991915,3cyclictest500-21systemd-logind09:10:000
384778991911,5cyclictest633049-21latency_hist11:10:000
384789991814,3cyclictest534759-21kworker/u8:4+flush-259:010:00:013
384789991814,3cyclictest533862-21ntp_kernel_pll_09:30:213
384789991814,3cyclictest503246-21kworker/u8:0+events_unbound10:15:173
384789991813,4cyclictest659308-21kworker/u8:3+flush-259:011:55:253
384784991814,3cyclictest669639-21kworker/u8:0+flush-259:012:20:002
384784991814,3cyclictest638218-21http11:14:592
384784991812,4cyclictest612416-21latency_hist10:50:012
384781991815,2cyclictest509-21rs:main1
384781991815,2cyclictest0-21swapper/109:19:591
384781991814,3cyclictest617587-21kworker/u8:0+flush-259:011:10:161
384781991812,4cyclictest550500-21/usr/sbin/munin09:50:141
384781991812,4cyclictest441294-21apt-get08:05:001
384778991814,2cyclictest0-21swapper/008:00:000
384778991813,4cyclictest410449-21kworker/u8:0+flush-259:008:35:250
384778991813,3cyclictest617587-21kworker/u8:0+flush-259:011:24:590
384778991813,1cyclictest60350irq/132-enp0s29f1:rx-007:35:260
384778991812,4cyclictest503246-21kworker/u8:0+flush-259:009:25:170
384789991713,2cyclictest1468027-21kworker/u8:2+events_unbound07:25:183
38478499178,8cyclictest0-21swapper/210:40:232
38478499174,3cyclictest664475-21basename11:40:002
384784991715,1cyclictest726641-21cut12:40:002
384784991714,2cyclictest674749-21idleruntime-cro11:50:002
384784991711,4cyclictest252-21systemd-journal09:55:002
38478499170,2cyclictest451974-21latency_hist08:15:012
384781991714,2cyclictest0-21swapper/110:35:011
384781991713,3cyclictest488255-21apt-get08:50:111
384778991715,1cyclictest0-21swapper/009:36:220
384778991714,2cyclictest613083-21irqcore10:50:140
384778991714,2cyclictest60350irq/132-enp0s29f1:rx-011:53:440
384778991713,2cyclictest462257-21turbostat08:24:590
384778991711,4cyclictest622946-21kworker/u8:1+events_unbound11:45:000
384778991711,4cyclictest622946-21kworker/u8:1+events_unbound11:45:000
384789991612,3cyclictest534759-21kworker/u8:4+flush-259:010:10:163
384789991612,3cyclictest390126-21apt-get07:15:113
38478499160,7cyclictest0-21swapper/210:50:132
384781991613,2cyclictest424984-21ntp_kernel_pll_07:45:211
384781991613,2cyclictest0-21swapper/112:29:591
384781991612,3cyclictest601732-21kworker/u8:3+flush-259:010:45:111
384781991611,4cyclictest509235-21apt-get09:10:121
384781991611,4cyclictest509235-21apt-get09:10:111
384781991610,4cyclictest653244-21ntpq11:25:221
384781991610,4cyclictest252-21systemd-journal09:50:001
384778991614,1cyclictest60350irq/132-enp0s29f1:rx-008:15:330
384778991613,2cyclictest410449-21kworker/u8:0+events_unbound07:50:240
38478999159,4cyclictest462252-21latency_hist08:25:013
384789991512,2cyclictest472531-21cron08:34:593
384789991511,3cyclictest669639-21kworker/u8:0+flush-259:012:00:253
38478499159,4cyclictest252-21systemd-journal08:55:002
384784991512,2cyclictest686346-21kthreadcore12:00:162
384784991512,2cyclictest669618-21sh11:45:002
384784991512,2cyclictest669618-21sh11:45:002
384784991511,3cyclictest446864-21kworker/u8:3+flush-259:009:00:002
384784991510,4cyclictest540161-21kworker/u8:2+flush-259:009:45:232
38478499150,13cyclictest1-21systemd09:26:242
384781991511,3cyclictest252-21systemd-journal10:11:241
384781991510,1cyclictest415560-21sh07:40:011
384778991514,1cyclictest60350irq/132-enp0s29f1:rx-009:18:000
384778991513,2cyclictest61150irq/133-enp0s29f1:tx-007:45:140
384778991513,2cyclictest60350irq/132-enp0s29f1:rx-012:07:000
384778991513,2cyclictest60350irq/132-enp0s29f1:rx-011:34:110
384778991513,2cyclictest60350irq/132-enp0s29f1:rx-010:36:090
384778991513,1cyclictest60350irq/132-enp0s29f1:rx-011:15:200
384778991513,1cyclictest60350irq/132-enp0s29f1:rx-008:30:170
384778991513,1cyclictest60350irq/132-enp0s29f1:rx-008:10:240
384778991513,1cyclictest60350irq/132-enp0s29f1:rx-007:25:150
384778991512,2cyclictest60350irq/132-enp0s29f1:rx-012:15:240
384778991512,2cyclictest60350irq/132-enp0s29f1:rx-010:47:300
384778991512,2cyclictest60350irq/132-enp0s29f1:rx-009:50:140
384778991512,2cyclictest60350irq/132-enp0s29f1:rx-009:40:140
384778991512,2cyclictest60350irq/132-enp0s29f1:rx-009:30:110
384778991512,2cyclictest576457-21apt-get10:15:120
384778991511,3cyclictest576219-21kworker/u8:2+flush-259:010:25:010
384789991410,2cyclictest0-21swapper/309:45:163
38478999140,4cyclictest627894-21awk11:04:593
384784991410,3cyclictest601732-21kworker/u8:3+flush-259:011:20:002
38478199147,5cyclictest508544-21latency_hist09:10:001
384781991410,3cyclictest534759-21kworker/u8:4+flush-259:010:56:241
384781991410,3cyclictest500-21systemd-logind07:30:001
38477899149,4cyclictest700150-21kworker/u8:1+flush-259:012:20:210
384778991412,1cyclictest60350irq/132-enp0s29f1:rx-008:25:170
38478999137,4cyclictest252-21systemd-journal09:14:593
38478999137,4cyclictest252-21systemd-journal09:14:593
384789991311,1cyclictest0-21swapper/311:54:593
384789991310,2cyclictest703025-21kthreadcore12:15:163
384789991310,2cyclictest620119-21kthreadcore10:55:183
384789991310,2cyclictest540290-21cpuspeed_turbos09:40:143
384789991310,2cyclictest0-21swapper/311:14:593
384789991310,1cyclictest0-21swapper/312:30:163
38478499137,4cyclictest252-21systemd-journal07:46:232
384784991310,2cyclictest556136-21irqcore09:55:182
384784991310,2cyclictest0-21swapper/209:40:002
38478199137,4cyclictest252-21systemd-journal08:29:231
38478199134,8cyclictest622946-21kworker/u8:1+flush-259:011:45:001
38478199134,8cyclictest622946-21kworker/u8:1+flush-259:011:45:001
384781991311,1cyclictest0-21swapper/107:45:001
384781991310,2cyclictest633030-21cron11:10:001
384781991310,2cyclictest1468027-21kworker/u8:2+flush-259:007:20:231
38477899138,3cyclictest60350irq/132-enp0s29f1:rx-010:30:120
384778991311,1cyclictest60350irq/132-enp0s29f1:rx-009:59:040
384778991310,2cyclictest60350irq/132-enp0s29f1:rx-010:00:140
38478999129,2cyclictest711893-21tr12:25:163
38478999129,2cyclictest653625-21unixbench_multi11:25:243
38478999129,2cyclictest435714-21unixbench_singl07:55:263
38478999129,2cyclictest0-21swapper/310:45:143
38478999128,3cyclictest614960-21kthreadcore10:50:173
38478999127,3cyclictest617587-21kworker/u8:0+flush-259:011:30:173
38478499129,2cyclictest389388-21unixbench_multi07:10:252
38478499129,1cyclictest0-21swapper/207:20:002
38478499124,7cyclictest0-21swapper/212:15:002
384784991210,1cyclictest0-21swapper/208:20:012
38478199129,2cyclictest447194-21cpuspeed_turbos08:10:131
38478199128,3cyclictest446864-21kworker/u8:3+flush-259:009:05:011
38478199127,3cyclictest627888-21latency_hist11:05:001
38478199126,4cyclictest252-21systemd-journal07:56:221
384781991210,1cyclictest591623-21cron10:30:001
384781991210,1cyclictest0-21swapper/109:35:001
38478999118,2cyclictest669951-21cpuspeed_turbos11:45:123
38478999117,3cyclictest659308-21kworker/u8:3+flush-259:012:10:003
38478999117,3cyclictest1468027-21kworker/u8:2+flush-259:008:10:003
38478499114,6cyclictest405302-21munin-run07:30:012
38478499110,4cyclictest654097-21cron11:30:002
38478199119,1cyclictest0-21swapper/107:10:191
38478199118,2cyclictest0-21swapper/112:10:201
38478199116,4cyclictest410449-21kworker/u8:0+flush-259:007:50:321
38477899119,1cyclictest60350irq/132-enp0s29f1:rx-012:10:120
38477899119,1cyclictest60350irq/132-enp0s29f1:rx-008:45:140
38478999108,1cyclictest0-21swapper/311:15:143
38478999108,1cyclictest0-21swapper/307:30:143
38478999107,2cyclictest492631-21unixbench_multi08:50:243
38478999106,3cyclictest628412-21perl11:05:143
38478999105,3cyclictest430726-21sshd07:51:223
38478499107,2cyclictest628220-21cpuspeed_turbos11:05:132
38478199108,1cyclictest0-21swapper/110:20:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional