You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-31 - 13:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Aug 31, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
268447997470,3cyclictest75-21kswapd000:20:023
268447995956,2cyclictest278781-21kworker/u8:2+events_unbound20:20:253
268442995245,5cyclictest335557-21systemd-journal20:20:011
268444995045,4cyclictest75-21kswapd020:20:032
268442995045,4cyclictest497888-21apt-get22:50:111
268444994943,4cyclictest523759-21apt-get23:15:122
268442994944,3cyclictest497317-21gpgv22:50:001
268444994843,4cyclictest388358-21gpgv21:05:012
268442994339,3cyclictest294293-21kworker/u8:4+flush-259:020:10:231
268442994337,4cyclictest383108-21latency_hist21:00:011
268437994239,2cyclictest278781-21kworker/u8:2+flush-259:019:30:240
268437994237,4cyclictest394132-21apt-get21:10:120
268437994237,4cyclictest320896-21apt-get20:00:120
268437994236,4cyclictest315764-21apt-get19:55:130
268442994135,4cyclictest388930-21apt-get21:05:121
268442994035,3cyclictest456133-21apt-get22:10:121
268442993832,4cyclictest440599-21apt-get21:55:111
268442993632,2cyclictest414799-21apt-get21:30:131
268447993532,2cyclictest476815-21kworker/u8:1+events_unbound23:09:173
268447993531,3cyclictest404439-21kworker/u8:3+flush-259:021:25:263
268437993530,3cyclictest466256-21kworker/u8:0+flush-259:022:25:250
268447993431,2cyclictest268056-21kworker/u8:3+events_unbound19:45:233
268447993330,2cyclictest278781-21kworker/u8:2+events_unbound19:55:173
268447993329,3cyclictest388458-21kworker/u8:2+events_unbound21:55:223
268442993328,3cyclictest388418-21base6421:05:011
268447993229,2cyclictest486737-21kworker/u8:0+events_unbound23:00:143
268444993228,3cyclictest388458-21kworker/u8:2+flush-259:022:30:322
268442993226,4cyclictest425103-21/usr/sbin/munin21:40:141
268447993128,2cyclictest512829-21kworker/u8:2+flush-259:023:10:213
268447993125,4cyclictest342026-21kworker/u8:3+flush-259:020:50:013
268447993027,2cyclictest565153-21kworker/u8:3+events_unbound00:15:153
268447993027,2cyclictest476815-21kworker/u8:1+events_unbound23:25:233
268444993025,3cyclictest476815-21kworker/u8:1+flush-259:023:05:222
268442993024,5cyclictest367843-21apt-get20:45:121
268437993027,2cyclictest476815-21kworker/u8:1+events_unbound23:00:170
268437993026,3cyclictest289113-21kworker/u8:1+flush-259:020:45:290
268447992926,2cyclictest528698-21kworker/u8:4+events_unbound23:22:053
268447992926,2cyclictest289113-21kworker/u8:1+flush-259:021:09:183
268442992924,4cyclictest289355-21apt-get19:30:121
268437992925,3cyclictest476815-21kworker/u8:1+flush-259:000:30:190
268442992823,4cyclictest278781-21kworker/u8:2+flush-259:019:40:181
268447992724,2cyclictest476815-21kworker/u8:1+events_unbound22:55:173
268447992724,2cyclictest455892-21kworker/u8:1+flush-259:022:15:293
268447992724,2cyclictest388458-21kworker/u8:2+events_unbound22:10:273
268447992724,2cyclictest278781-21kworker/u8:2+flush-259:019:25:153
268447992723,3cyclictest419712-21kworker/u8:0+events_unbound21:45:223
268447992722,2cyclictest404439-21kworker/u8:3+events_unbound21:25:003
268447992720,3cyclictest466256-21kworker/u8:0+events_unbound22:25:163
268437992723,3cyclictest492076-21kworker/u8:2+flush-259:022:50:240
268447992620,3cyclictest512829-21kworker/u8:2+events_unbound23:15:243
268444992619,5cyclictest335557-21systemd-journal23:45:172
268442992622,3cyclictest486737-21kworker/u8:0+flush-259:023:25:161
268442992622,3cyclictest476815-21kworker/u8:1+flush-259:023:45:221
268437992622,3cyclictest476815-21kworker/u8:1+flush-259:000:15:190
268447992522,2cyclictest342026-21kworker/u8:3+events_unbound20:55:143
268447992521,3cyclictest471625-21kworker/u8:3+events_unbound22:40:143
268447992521,3cyclictest278781-21kworker/u8:2+events_unbound19:40:193
268447992519,4cyclictest549598-21apt-get23:40:123
268444992521,3cyclictest445753-21apt-get22:00:102
268444992517,6cyclictest335557-21systemd-journal22:30:002
268447992421,2cyclictest388458-21kworker/u8:2+flush-259:022:35:313
268447992421,2cyclictest352363-21kworker/u8:2+events_unbound20:30:143
268447992421,2cyclictest289113-21kworker/u8:1+events_unbound20:50:153
268447992420,3cyclictest294293-21kworker/u8:4+flush-259:020:10:163
268444992418,4cyclictest476815-21kworker/u8:1+flush-259:023:50:242
268444992417,5cyclictest451118-21diskstats22:05:142
268442992420,3cyclictest335557-21systemd-journal23:37:071
268442992418,4cyclictest528677-21latency_hist23:20:011
268442992418,4cyclictest335557-21systemd-journal19:49:551
268447992320,2cyclictest268056-21kworker/u8:3+events_unbound19:18:183
268447992319,3cyclictest528698-21kworker/u8:4+events_unbound23:55:283
268447992319,3cyclictest492076-21kworker/u8:2+events_unbound22:53:183
268444992317,4cyclictest372752-21latency_hist20:50:012
268444992317,4cyclictest335557-21systemd-journal19:15:002
268437992320,2cyclictest342026-21kworker/u8:3+flush-259:020:50:210
268437992319,3cyclictest476815-21kworker/u8:1+flush-259:023:25:010
268437992318,4cyclictest476815-21kworker/u8:1+events_unbound00:00:190
268437992317,4cyclictest314644-21ntpq19:50:200
268437992317,4cyclictest314644-21ntpq19:50:200
268447992219,2cyclictest565153-21kworker/u8:3+events_unbound00:25:243
268447992219,2cyclictest445492-21kworker/u8:0+events_unbound22:01:173
268447992219,2cyclictest388458-21kworker/u8:2+events_unbound22:34:193
268447992219,2cyclictest388458-21kworker/u8:2+events_unbound22:07:183
268447992219,2cyclictest278781-21kworker/u8:2+events_unbound19:30:153
268447992218,3cyclictest388458-21kworker/u8:2+events_unbound21:41:183
268447992218,3cyclictest347236-21apt-get20:25:113
268444992218,3cyclictest476815-21kworker/u8:1+flush-259:000:25:262
268442992218,3cyclictest388458-21kworker/u8:2+flush-259:022:20:181
268437992217,4cyclictest289113-21kworker/u8:1+events_unbound19:35:220
268437992217,3cyclictest268666-21apt-get19:10:120
268447992118,2cyclictest388458-21kworker/u8:2+events_unbound22:21:193
268447992118,2cyclictest336254-21kworker/u8:0+events_unbound20:16:173
268447992118,2cyclictest294293-21kworker/u8:4+flush-259:019:35:263
268444992117,3cyclictest544224-21kworker/u8:2+flush-259:023:39:592
268444992116,4cyclictest309855-21apt-get19:50:002
268444992116,4cyclictest257941-21kworker/u8:0+flush-259:019:20:182
268437992117,3cyclictest278781-21kworker/u8:2+events_unbound20:05:210
268437992115,4cyclictest299757-21apt-get19:40:120
268447992017,2cyclictest476815-21kworker/u8:1+events_unbound23:50:073
268447992017,2cyclictest476815-21kworker/u8:1+events_unbound23:45:143
268447992017,2cyclictest404439-21kworker/u8:3+events_unbound21:33:183
268447992017,2cyclictest257941-21kworker/u8:0+events_unbound19:24:173
268447992015,3cyclictest611947-21latency_hist00:40:013
268447992014,4cyclictest335557-21systemd-journal00:35:003
268444992014,4cyclictest419712-21kworker/u8:0+flush-259:021:40:162
268437992016,2cyclictest60350irq/132-enp0s29f1:rx-020:24:590
268447991916,2cyclictest289113-21kworker/u8:1+events_unbound21:10:133
268447991915,3cyclictest528698-21kworker/u8:4+events_unbound23:30:393
268444991915,3cyclictest528698-21kworker/u8:4+flush-259:023:55:222
268437991916,2cyclictest565603-21irqcore23:55:160
268437991915,3cyclictest476815-21kworker/u8:1+events_unbound23:35:000
268437991915,3cyclictest476815-21kworker/u8:1+events_unbound23:05:210
268437991913,4cyclictest352363-21kworker/u8:2+events_unbound20:35:240
268437991913,4cyclictest341538-21cat20:20:010
268447991816,1cyclictest352363-21kworker/u8:2+events_unbound20:40:123
268447991815,2cyclictest544224-21kworker/u8:2+events_unbound23:35:283
268447991815,2cyclictest257941-21kworker/u8:0+events_unbound19:10:193
268444991815,2cyclictest274281-21irqcore19:15:172
268444991814,3cyclictest507-21in:imuxsock00:25:012
268442991813,4cyclictest471625-21kworker/u8:3+flush-259:022:40:151
268437991815,2cyclictest528828-21runrttasks23:20:010
268437991815,2cyclictest268056-21kworker/u8:3+flush-259:019:45:200
268437991814,3cyclictest565153-21kworker/u8:3+events_unbound00:25:210
268437991814,3cyclictest434306-21ntp_kernel_pll_21:45:210
268437991813,4cyclictest476815-21kworker/u8:1+flush-259:000:35:210
268447991714,2cyclictest565153-21kworker/u8:3+events_unbound00:10:293
268447991714,2cyclictest419712-21kworker/u8:0+events_unbound21:35:273
268447991712,4cyclictest309855-21apt-get19:50:023
268447991712,4cyclictest309855-21apt-get19:50:013
268444991714,2cyclictest0-21swapper/220:40:002
268442991715,1cyclictest0-21swapper/120:30:001
268442991714,2cyclictest602268-21irqcore00:30:181
268442991713,3cyclictest461294-21apt-get22:15:111
268442991711,3cyclictest294293-21kworker/u8:4+flush-259:020:15:211
268437991714,2cyclictest0-21swapper/020:45:010
268437991713,3cyclictest512829-21kworker/u8:2+events_unbound23:10:180
268437991713,3cyclictest342026-21kworker/u8:3+flush-259:021:00:210
268437991713,2cyclictest476815-21kworker/u8:1+flush-259:023:50:200
268437991711,4cyclictest352553-21diskstats20:30:150
26844799162,2cyclictest191rcu_preempt00:00:233
268447991614,2cyclictest476815-21kworker/u8:1+flush-259:000:05:213
26844799160,15cyclictest1-21systemd20:04:153
268444991613,2cyclictest539269-21apt-get23:30:122
268444991610,4cyclictest299498-21latency_hist19:40:002
268442991612,2cyclictest289089-21sh19:30:001
268437991614,1cyclictest60350irq/132-enp0s29f1:rx-023:35:280
268437991614,1cyclictest60350irq/132-enp0s29f1:rx-021:50:270
268437991614,1cyclictest388458-21kworker/u8:2+events_unbound22:15:220
268437991613,2cyclictest60350irq/132-enp0s29f1:rx-023:42:300
268437991613,2cyclictest60350irq/132-enp0s29f1:rx-022:03:100
268437991613,2cyclictest60350irq/132-enp0s29f1:rx-019:20:270
268437991611,3cyclictest430054-21kworker/u8:1+flush-259:022:00:000
268447991512,2cyclictest476815-21kworker/u8:1+events_unbound22:49:033
26844499159,4cyclictest388807-21gpgv21:05:002
268444991512,2cyclictest502791-21idleruntime-cro22:55:002
268444991512,2cyclictest314634-21ntp_kernel_pll_19:50:202
268444991512,2cyclictest314634-21ntp_kernel_pll_19:50:192
268444991512,2cyclictest0-21swapper/220:29:592
268444991511,3cyclictest0-21swapper/222:40:002
268444991511,2cyclictest419686-21sh21:35:002
268444991511,2cyclictest322921-21kthreadcore20:00:182
268444991511,2cyclictest0-21swapper/220:20:002
26844499150,6cyclictest435177-21munin-run21:50:002
26844299159,4cyclictest476815-21kworker/u8:1+flush-259:000:15:191
268442991512,2cyclictest377927-21kworker/u8:0+flush-259:021:20:271
268442991512,2cyclictest278781-21kworker/u8:2+flush-259:019:50:111
268442991512,2cyclictest278781-21kworker/u8:2+flush-259:019:50:111
268442991511,3cyclictest342026-21kworker/u8:3+flush-259:020:50:151
268437991513,1cyclictest60350irq/132-enp0s29f1:rx-023:45:250
268437991513,1cyclictest60350irq/132-enp0s29f1:rx-022:20:250
268437991513,1cyclictest60350irq/132-enp0s29f1:rx-021:19:370
268437991513,1cyclictest60350irq/132-enp0s29f1:rx-019:25:230
268437991512,2cyclictest61150irq/133-enp0s29f1:tx-000:10:160
268437991512,2cyclictest60350irq/132-enp0s29f1:rx-022:55:190
268437991512,2cyclictest60350irq/132-enp0s29f1:rx-021:21:290
268437991512,2cyclictest60350irq/132-enp0s29f1:rx-020:28:130
268437991512,2cyclictest60350irq/132-enp0s29f1:rx-000:05:260
268437991512,2cyclictest0-21swapper/022:45:010
268437991511,2cyclictest60350irq/132-enp0s29f1:rx-021:30:160
268437991510,3cyclictest486737-21kworker/u8:0+events_unbound23:25:190
268437991510,3cyclictest476815-21kworker/u8:1+events_unbound22:30:170
268447991412,2cyclictest388458-21kworker/u8:2+events_unbound21:50:163
268447991411,2cyclictest352363-21kworker/u8:2+flush-259:020:35:393
26844499143,5cyclictest575316-21basename00:04:592
268444991411,2cyclictest388458-21kworker/u8:2-ext4-rsv-conversion22:25:002
26844499140,12cyclictest554515-21awk23:45:002
268442991411,2cyclictest507-21in:imuxsock19:20:001
268437991413,1cyclictest60350irq/132-enp0s29f1:rx-021:08:150
268437991412,2cyclictest60350irq/132-enp0s29f1:rx-021:38:520
268437991412,1cyclictest60350irq/132-enp0s29f1:rx-022:12:140
268437991412,1cyclictest60350irq/132-enp0s29f1:rx-020:56:460
268437991411,2cyclictest60350irq/132-enp0s29f1:rx-021:40:130
268437991410,3cyclictest60350irq/132-enp0s29f1:rx-022:35:180
268437991410,2cyclictest1-21systemd22:50:000
26844799139,3cyclictest278781-21kworker/u8:2+events_unbound20:05:123
268447991310,2cyclictest387831-21unixbench_singl21:00:243
26844499139,3cyclictest497197-21apt-get22:50:002
26844499139,3cyclictest404439-21kworker/u8:3+flush-259:021:35:182
26844499138,3cyclictest528914-21/usr/sbin/munin23:20:232
26844499136,5cyclictest490-21dbus-daemon22:45:002
26844499135,5cyclictest335557-21systemd-journal20:00:002
268444991310,2cyclictest0-21swapper/220:50:252
26844299139,3cyclictest445492-21kworker/u8:0+flush-259:022:00:151
26844299138,4cyclictest476815-21kworker/u8:1+flush-259:023:05:211
26844299137,4cyclictest523499-21latency_hist23:15:021
268442991311,1cyclictest0-21swapper/122:40:001
268442991310,2cyclictest585168-21unixbench_multi00:10:261
268442991310,2cyclictest414534-21sh21:30:001
26844299130,7cyclictest435184-21basename21:50:001
268437991311,1cyclictest60350irq/132-enp0s29f1:rx-020:13:330
26844799129,2cyclictest388458-21kworker/u8:2+flush-259:021:17:013
26844499129,2cyclictest414546-21cut21:30:002
26844499129,1cyclictest0-21swapper/220:30:242
26844499128,3cyclictest2971-21cron00:10:002
26844499125,5cyclictest513136-21awk23:05:002
26844299129,2cyclictest359366-21kthreadcore20:35:161
26844299129,1cyclictest0-21swapper/123:34:591
26844299128,3cyclictest497-21gpm00:20:151
26844299128,2cyclictest0-21swapper/123:55:011
26844299120,11cyclictest0-21swapper/100:04:591
26843799129,2cyclictest60350irq/132-enp0s29f1:rx-019:19:030
26844499119,1cyclictest0-21swapper/221:25:002
26844499118,2cyclictest507494-21unixbench_multi22:55:272
26844499117,2cyclictest465323-21ntpq22:15:212
26844499111,9cyclictest404208-21awk21:20:012
26844499111,1cyclictest444987-21grep21:55:242
26844499110,9cyclictest294265-21awk19:35:002
26844299119,1cyclictest0-21swapper/122:05:191
26844299119,1cyclictest0-21swapper/120:10:011
26844299118,2cyclictest529005-21cpuspeed_turbos23:20:141
26844299118,1cyclictest0-21swapper/123:00:221
26844299117,3cyclictest575570-21apt-get00:05:131
26844299115,4cyclictest435744-21hddtemp_smartct21:50:161
26843799118,2cyclictest60350irq/132-enp0s29f1:rx-021:25:140
26844499108,1cyclictest0-21swapper/220:10:002
26844499104,4cyclictest288019-21memory19:25:192
26844299108,1cyclictest481041-21sensors22:30:301
26844299108,1cyclictest0-21swapper/121:35:161
26844299107,2cyclictest403378-21ntp_offset21:15:231
26844299107,2cyclictest279288-21fschecks_time19:20:161
2684429995,3cyclictest311ktimers/120:40:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional