You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 05:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Tue May 05, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
638341994134,5cyclictest700275-21latency_hist20:10:011
638341994036,3cyclictest939366-21kworker/u8:1+events_unbound00:26:231
638341994036,3cyclictest939366-21kworker/u8:1+events_unbound00:26:221
638341993832,3cyclictest830050-21kworker/u8:1+flush-259:022:30:161
638341993732,3cyclictest763984-21kworker/u8:1+flush-259:021:35:241
638344993327,4cyclictest939373-21cp00:00:002
638339993329,3cyclictest252-21systemd-journal20:56:210
638341993229,2cyclictest939366-21kworker/u8:1+flush-259:000:35:241
638341993225,5cyclictest870594-21ntpq22:50:241
638339993228,3cyclictest851074-21apt-get22:35:100
638344993024,4cyclictest252-21systemd-journal00:30:212
638339993024,4cyclictest741289-21ntpq20:45:220
638341992925,3cyclictest793405-21kworker/u8:3+flush-259:022:05:221
638341992923,4cyclictest793978-21apt-get21:40:121
638344992824,3cyclictest939366-21kworker/u8:1+flush-259:000:35:152
638341992825,2cyclictest928868-21kworker/u8:0+flush-259:023:55:201
638341992825,2cyclictest685045-21kworker/u8:1+events_unbound20:00:251
638341992824,3cyclictest928868-21kworker/u8:0+events_unbound00:00:141
638341992824,3cyclictest830050-21kworker/u8:1+events_unbound23:05:251
638341992824,3cyclictest793405-21kworker/u8:3+flush-259:022:00:001
638341992822,4cyclictest787658-21ntpq21:30:211
638349992722,4cyclictest882276-21gpgv23:05:013
638344992720,5cyclictest767057-21ntpq21:10:212
638341992723,3cyclictest939366-21kworker/u8:1+events_unbound00:34:211
638341992723,3cyclictest892513-21kworker/u8:4+events_unbound23:34:231
638341992723,3cyclictest763984-21kworker/u8:1+flush-259:021:20:211
638341992723,2cyclictest669540-21kworker/u8:2+events_unbound20:15:231
638341992721,4cyclictest949960-21/usr/sbin/munin00:10:131
638339992722,4cyclictest861375-21apt-get22:45:110
638341992622,3cyclictest944853-21apt-get00:05:161
638341992622,3cyclictest830050-21kworker/u8:1+flush-259:022:22:211
638341992622,3cyclictest746920-21kworker/u8:2+events_unbound21:10:151
638341992622,3cyclictest685045-21kworker/u8:1+events_unbound20:13:221
638341992620,4cyclictest861120-21latency_hist22:45:011
638339992623,2cyclictest861342-21kworker/u8:3+events_unbound23:00:010
638344992519,4cyclictest252-21systemd-journal22:37:062
638341992523,1cyclictest830050-21kworker/u8:1+events_unbound22:55:121
638341992522,2cyclictest850836-21kworker/u8:0+flush-259:022:35:211
638339992521,3cyclictest773354-21apt-get21:20:110
638339992519,4cyclictest975764-21apt-get00:35:120
638344992419,3cyclictest871436-21kworker/u8:2+flush-259:023:05:182
638341992421,2cyclictest763984-21kworker/u8:1+events_unbound21:51:481
638341992421,2cyclictest711308-21kworker/u8:3+events_unbound21:06:391
638341992418,4cyclictest252-21systemd-journal23:11:211
638339992419,4cyclictest747301-21latency_hist20:55:010
638349992320,2cyclictest674748-21apt-get19:45:113
638349992320,2cyclictest674748-21apt-get19:45:103
638349992319,3cyclictest710770-21gpgv20:20:013
638349992318,4cyclictest928868-21kworker/u8:0+flush-259:000:00:003
638349992316,5cyclictest773091-21latency_hist21:20:003
638344992317,4cyclictest840268-21base6422:25:002
638341992320,2cyclictest799135-21/usr/sbin/munin21:45:191
638339992319,2cyclictest892513-21kworker/u8:4+flush-259:023:30:240
638349992219,2cyclictest2971-21cron00:25:013
638349992217,4cyclictest699381-21ntpq20:05:213
638349992217,3cyclictest893158-21apt-get23:15:113
638344992219,2cyclictest618055-21kworker/u8:1+flush-259:019:10:162
638344992216,4cyclictest866277-21latency_hist22:50:012
638341992219,2cyclictest871436-21kworker/u8:2+events_unbound23:46:211
638341992219,2cyclictest669540-21kworker/u8:2+events_unbound19:40:221
638341992219,2cyclictest653827-21kworker/u8:0+flush-259:019:55:121
638341992219,2cyclictest618055-21kworker/u8:1+events_unbound19:33:231
638341992218,3cyclictest830047-21apt-get22:15:101
638341992218,3cyclictest690175-21kworker/u8:4+events_unbound20:28:231
638339992218,3cyclictest746920-21kworker/u8:2+flush-259:021:00:200
638341992118,2cyclictest763984-21kworker/u8:1+events_unbound21:28:211
638341992118,2cyclictest757648-21kworker/u8:0+flush-259:021:15:241
638341992117,3cyclictest892513-21kworker/u8:4+events_unbound23:38:241
638341992117,2cyclictest898319-21kworker/u8:0+events_unbound23:20:211
638339992117,3cyclictest763984-21kworker/u8:1+flush-259:022:00:260
638339992117,3cyclictest690175-21kworker/u8:4+flush-259:020:30:210
638349992016,3cyclictest648382-21kworker/u8:2+flush-259:019:25:243
638344992017,2cyclictest669540-21kworker/u8:2+events_unbound19:45:002
638344992015,4cyclictest876812-21/usr/sbin/munin23:00:202
638341992017,2cyclictest892513-21kworker/u8:4+events_unbound00:15:231
638341992016,3cyclictest653827-21kworker/u8:0+events_unbound19:35:221
638341992014,4cyclictest881914-21gpgv23:05:011
638349991915,3cyclictest892890-21gpgv23:15:023
638349991915,3cyclictest830050-21kworker/u8:1+flush-259:022:50:263
638349991913,4cyclictest829784-21latency_hist22:15:003
638349991913,4cyclictest673568-21ntpq19:40:203
638344991916,2cyclictest845672-21sh22:30:002
638344991912,5cyclictest725707-21ntpq20:30:202
638341991915,3cyclictest618055-21kworker/u8:1+events_unbound19:14:221
638339991915,3cyclictest928868-21kworker/u8:0+flush-259:000:15:170
638349991815,2cyclictest919378-21irqcore23:40:153
638349991813,3cyclictest252-21systemd-journal20:29:203
638344991815,2cyclictest850813-21sh22:35:002
638344991814,3cyclictest819175-21kworker/u8:2+flush-259:022:40:142
638344991813,3cyclictest763984-21kworker/u8:1+flush-259:021:20:162
638344991812,4cyclictest943670-21ntpq00:00:212
638341991815,2cyclictest711308-21kworker/u8:3+flush-259:020:40:211
638341991815,2cyclictest618055-21kworker/u8:1+events_unbound19:15:161
638341991814,3cyclictest830050-21kworker/u8:1+flush-259:023:15:191
638341991814,3cyclictest618055-21kworker/u8:1+events_unbound19:26:231
638339991812,5cyclictest809645-21diskstats21:55:140
638339991811,4cyclictest252-21systemd-journal23:50:210
638349991713,2cyclictest793405-21kworker/u8:3+flush-259:021:40:173
638344991713,3cyclictest809484-21apt-get21:55:112
638344991711,4cyclictest509-21rs:main2
638341991714,2cyclictest919989-21kthreadcore23:40:161
638341991714,2cyclictest721508-21kworker/u8:0+flush-259:020:50:201
638341991713,3cyclictest690175-21kworker/u8:4+events_unbound20:21:311
638341991713,3cyclictest669540-21kworker/u8:2+events_unbound19:46:251
638341991713,3cyclictest669540-21kworker/u8:2+events_unbound19:46:241
638341991712,4cyclictest903485-21apt-get23:25:131
638339991714,2cyclictest60350irq/132-enp0s29f1:rx-020:15:210
638339991714,2cyclictest60350irq/132-enp0s29f1:rx-020:14:050
638339991714,2cyclictest60350irq/132-enp0s29f1:rx-019:40:140
638339991713,3cyclictest830050-21kworker/u8:1+events_unbound22:30:210
63834999169,5cyclictest751545-21ntpq20:55:203
638349991614,1cyclictest0-21swapper/322:25:003
63834499163,8cyclictest716250-21munin-run20:25:002
638344991611,4cyclictest710658-21apt-get20:20:002
638341991611,4cyclictest830050-21kworker/u8:1+flush-259:022:45:191
638339991614,1cyclictest60350irq/132-enp0s29f1:rx-021:19:090
638339991613,2cyclictest60350irq/132-enp0s29f1:rx-023:46:420
638339991613,2cyclictest60350irq/132-enp0s29f1:rx-023:05:160
638339991613,2cyclictest60350irq/132-enp0s29f1:rx-022:50:260
638339991613,2cyclictest60350irq/132-enp0s29f1:rx-021:53:490
638339991613,2cyclictest60350irq/132-enp0s29f1:rx-021:48:330
638339991612,3cyclictest898319-21kworker/u8:0+flush-259:023:20:160
638339991612,3cyclictest892513-21kworker/u8:4+flush-259:000:30:010
638339991612,3cyclictest892513-21kworker/u8:4+flush-259:000:30:000
638339991612,3cyclictest830050-21kworker/u8:1+flush-259:022:15:150
638339991612,2cyclictest0-21swapper/021:05:190
63834999159,4cyclictest767923-21latency_hist21:15:003
638349991511,3cyclictest793405-21kworker/u8:3+flush-259:022:05:003
638349991510,3cyclictest252-21systemd-journal21:01:213
638341991512,2cyclictest793405-21kworker/u8:3+flush-259:022:00:151
638341991512,2cyclictest711308-21kworker/u8:3+events_unbound20:50:011
638341991512,2cyclictest653827-21kworker/u8:0+flush-259:019:50:251
638339991513,1cyclictest60350irq/132-enp0s29f1:rx-023:25:080
638339991513,1cyclictest60350irq/132-enp0s29f1:rx-021:10:440
638339991513,1cyclictest60350irq/132-enp0s29f1:rx-019:10:090
638339991513,1cyclictest60350irq/132-enp0s29f1:rx-000:30:190
638339991513,1cyclictest60350irq/132-enp0s29f1:rx-000:07:160
638339991512,2cyclictest61150irq/133-enp0s29f1:tx-023:15:250
638339991512,2cyclictest61150irq/133-enp0s29f1:tx-021:30:180
638339991512,2cyclictest60350irq/132-enp0s29f1:rx-023:55:200
638339991512,2cyclictest60350irq/132-enp0s29f1:rx-021:25:180
638339991512,2cyclictest60350irq/132-enp0s29f1:rx-000:00:180
638339991511,3cyclictest721508-21kworker/u8:0+flush-259:020:40:260
638339991511,3cyclictest60350irq/132-enp0s29f1:rx-019:50:120
638339991511,2cyclictest60350irq/132-enp0s29f1:rx-020:25:160
638339991510,4cyclictest653827-21kworker/u8:0+flush-259:020:00:000
638339991510,3cyclictest918968-21apt-get23:40:100
63833999150,4cyclictest8255541irqcore22:10:170
638349991410,3cyclictest876903-21cpuspeed_turbos23:00:143
638349991410,3cyclictest850836-21kworker/u8:0+flush-259:022:50:003
63834499149,4cyclictest252-21systemd-journal23:55:002
63834499148,5cyclictest730858-21ntpq20:35:202
638344991411,2cyclictest806620-21kthreadcore21:50:172
638344991411,2cyclictest2971-21cron20:10:002
638344991410,3cyclictest939366-21kworker/u8:1+flush-259:000:25:182
638344991410,3cyclictest939366-21kworker/u8:1+flush-259:000:25:172
638341991411,2cyclictest726625-21sh20:35:001
638341991410,3cyclictest690175-21kworker/u8:4+flush-259:020:35:231
638341991410,2cyclictest0-21swapper/121:05:011
638339991412,2cyclictest60350irq/132-enp0s29f1:rx-019:47:430
638339991412,2cyclictest60350irq/132-enp0s29f1:rx-019:47:420
638339991412,1cyclictest60350irq/132-enp0s29f1:rx-022:26:380
638339991412,1cyclictest60350irq/132-enp0s29f1:rx-022:05:240
638339991412,1cyclictest60350irq/132-enp0s29f1:rx-020:05:240
638339991412,1cyclictest60350irq/132-enp0s29f1:rx-020:01:590
638339991412,1cyclictest60350irq/132-enp0s29f1:rx-019:25:250
638339991411,2cyclictest60350irq/132-enp0s29f1:rx-019:30:260
638349991310,2cyclictest954412-21unixbench_multi00:10:243
638349991310,2cyclictest851185-21cpuspeed_turbos22:35:113
638349991310,2cyclictest804583-21fschecks_time21:50:143
638349991310,2cyclictest727288-21irqcore20:35:163
63834499139,3cyclictest819175-21kworker/u8:2+flush-259:022:09:572
63834499138,4cyclictest797971-21ntpq21:40:202
63834499138,4cyclictest252-21systemd-journal00:10:212
63834499137,4cyclictest898089-21latency_hist23:20:012
638344991310,2cyclictest876562-21idleruntime-cro23:00:012
638344991310,2cyclictest799247-21cpuspeed_turbos21:45:122
638344991310,2cyclictest0-21swapper/219:50:002
638344991310,2cyclictest0-21swapper/219:50:002
638344991310,1cyclictest0-21swapper/223:30:002
63834199132,2cyclictest9625842sed00:20:141
638341991310,2cyclictest819175-21kworker/u8:2+flush-259:022:10:211
63833999137,4cyclictest252-21systemd-journal00:25:000
638339991312,1cyclictest60350irq/132-enp0s29f1:rx-019:37:450
638339991311,2cyclictest60350irq/132-enp0s29f1:rx-022:23:540
638339991311,1cyclictest60350irq/132-enp0s29f1:rx-023:10:180
638339991311,1cyclictest60350irq/132-enp0s29f1:rx-000:10:160
638339991310,2cyclictest60350irq/132-enp0s29f1:rx-023:37:220
638339991310,2cyclictest60350irq/132-enp0s29f1:rx-021:40:150
638339991310,2cyclictest60350irq/132-enp0s29f1:rx-021:35:160
638339991310,2cyclictest60350irq/132-enp0s29f1:rx-020:23:530
63834999129,2cyclictest944159-21unixbench_singl00:00:263
63834999129,2cyclictest0-21swapper/322:35:013
63834999127,4cyclictest830050-21kworker/u8:1+flush-259:022:40:333
63834499129,2cyclictest736169-21cut20:40:222
63834499129,2cyclictest0-21swapper/200:10:002
63834499128,3cyclictest664139-21latency_hist19:35:012
63834499125,2cyclictest871414-21idleruntime-cro22:55:002
63834499125,1cyclictest0-21swapper/221:05:012
63834199129,2cyclictest840919-21cpuspeed_turbos22:25:151
63834199128,3cyclictest736993-21kworker/u8:1+flush-259:020:55:161
63834199128,3cyclictest618055-21kworker/u8:1+flush-259:019:20:091
63833999129,2cyclictest60350irq/132-enp0s29f1:rx-023:05:000
63833999129,2cyclictest60350irq/132-enp0s29f1:rx-020:35:200
638339991210,2cyclictest60350irq/132-enp0s29f1:rx-019:19:000
63834999119,1cyclictest0-21swapper/319:20:243
63834999118,2cyclictest694668-21unixbench_multi20:00:263
63834999117,3cyclictest898319-21kworker/u8:0+flush-259:023:25:333
63834499119,1cyclictest0-21swapper/223:49:592
63834499119,1cyclictest0-21swapper/221:35:002
63834499119,1cyclictest0-21swapper/221:00:012
63834499118,2cyclictest910904-21kthreadcore23:30:182
63834499117,3cyclictest746920-21kworker/u8:2+flush-259:021:07:252
63834499117,2cyclictest0-21swapper/223:25:012
63834199118,2cyclictest928868-21kworker/u8:0+flush-259:023:53:191
63834999108,1cyclictest0-21swapper/323:50:233
63834999108,1cyclictest0-21swapper/323:40:003
63834999108,1cyclictest0-21swapper/322:05:133
63834999107,2cyclictest809576-21cut21:55:133
63834999105,3cyclictest783082-21sshd21:26:433
63834999101,8cyclictest705453-21latency_hist20:15:013
63834499108,1cyclictest0-21swapper/220:00:192
63834499108,1cyclictest0-21swapper/220:00:002
63834499107,2cyclictest666698-21kthreadcore19:35:172
63834499105,3cyclictest716665-21diskstats20:25:132
6383499995,3cyclictest799444-21fw_conntrack21:45:133
6383499986,1cyclictest0-21swapper/321:20:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional