You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 12:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Tue Sep 08, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
675204994642,3cyclictest919571-21apt-get23:05:131
675196994641,4cyclictest846775-21apt-get21:55:120
675204994340,2cyclictest619699-21kworker/u8:2+flush-259:020:50:181
675210994239,2cyclictest619699-21kworker/u8:2+flush-259:020:50:223
675206994138,2cyclictest619699-21kworker/u8:2+flush-259:020:55:162
675206994037,2cyclictest752672-21kworker/u8:0+flush-259:020:25:232
675206994036,3cyclictest841597-21apt-get21:50:112
675204994035,4cyclictest810534-21apt-get21:20:141
675210993832,4cyclictest893234-21cp22:40:013
675210993633,2cyclictest997332-21kworker/u8:2+flush-259:000:20:253
675210993632,3cyclictest711383-21kworker/u8:1+events_unbound19:45:183
675206993630,4cyclictest919544-21/usr/sbin/munin23:05:152
675206993527,5cyclictest752680-21latency_hist20:25:002
675204993531,3cyclictest778912-21kworker/u8:1+flush-259:021:35:261
675204993529,4cyclictest893051-21latency_hist22:40:011
675206993430,3cyclictest887881-21kworker/u8:2+events_unbound22:50:212
675196993330,2cyclictest861945-21kworker/u8:0+flush-259:022:10:210
675206993227,4cyclictest716511-21kworker/u8:4+flush-259:020:05:252
675204993228,3cyclictest955921-21kworker/u8:3+flush-259:000:20:171
675204993228,3cyclictest887881-21kworker/u8:2+flush-259:023:05:001
675204993228,3cyclictest509-21rs:main1
675204993226,4cyclictest954980-21ntpq23:35:191
675210993127,3cyclictest716511-21kworker/u8:4+flush-259:020:10:273
675210993126,3cyclictest742393-21kworker/u8:1+flush-259:020:30:173
675210993125,4cyclictest794325-21apt-get21:05:003
675206993127,3cyclictest815606-21kworker/u8:4+flush-259:023:20:242
675206993127,3cyclictest815606-21kworker/u8:4+flush-259:021:25:242
675204993126,4cyclictest867174-21latency_hist22:15:011
675206993026,3cyclictest898391-21kworker/u8:1+flush-259:022:57:532
675206993026,3cyclictest701222-21kworker/u8:0+flush-259:019:40:152
675196993024,4cyclictest741452-21ntpq20:10:210
675210992824,3cyclictest861945-21kworker/u8:0+events_unbound22:30:253
675206992822,4cyclictest335557-21systemd-journal23:15:012
675206992723,3cyclictest935024-21kworker/u8:1+events_unbound23:40:182
675206992722,4cyclictest955921-21kworker/u8:3+events_unbound00:26:182
675206992722,3cyclictest619699-21kworker/u8:2+events_unbound19:15:172
675196992723,3cyclictest831163-21kworker/u8:0+flush-259:021:45:230
675196992723,3cyclictest727134-21apt-get20:00:110
675210992622,3cyclictest619699-21kworker/u8:2+flush-259:020:55:233
675206992623,2cyclictest861945-21kworker/u8:0+flush-259:022:10:232
675206992622,3cyclictest950470-21kworker/u8:2+flush-259:023:55:242
675204992621,3cyclictest997596-21latency_hist00:20:011
675196992622,3cyclictest815606-21kworker/u8:4+flush-259:022:35:170
675196992621,4cyclictest971790-21diskstats23:55:140
675196992619,6cyclictest752672-21kworker/u8:0+flush-259:020:40:260
675210992521,3cyclictest887881-21kworker/u8:2+events_unbound23:10:263
675206992522,2cyclictest815606-21kworker/u8:4+events_unbound22:35:222
675206992522,2cyclictest721741-21kworker/u8:0+events_unbound20:00:142
675206992522,2cyclictest619699-21kworker/u8:2+flush-259:020:32:352
675206992521,3cyclictest991429-21kworker/u8:1+flush-259:000:10:282
675206992521,3cyclictest950470-21kworker/u8:2+events_unbound23:53:002
675206992521,3cyclictest929636-21kworker/u8:0+events_unbound23:30:202
675206992520,3cyclictest986120-21kworker/u8:0+flush-259:000:40:002
675204992522,2cyclictest815606-21kworker/u8:4+flush-259:022:25:181
675204992521,3cyclictest1007808-21kworker/u8:4+flush-259:000:30:271
675196992522,2cyclictest795020-21apt-get21:05:150
675196992522,2cyclictest763084-21apt-key20:35:000
675196992519,4cyclictest939100-21ntpq23:20:220
675210992421,2cyclictest950470-21kworker/u8:2+events_unbound23:55:213
675206992420,3cyclictest945124-21apt-get23:30:002
675206992420,3cyclictest778912-21kworker/u8:1+events_unbound21:30:252
675206992420,3cyclictest768789-21kworker/u8:3+flush-259:022:05:162
675206992420,3cyclictest619699-21kworker/u8:2+flush-259:020:50:222
675206992420,3cyclictest619699-21kworker/u8:2+flush-259:019:50:152
675206992419,4cyclictest669574-21kworker/u8:1+flush-259:019:10:222
675206992418,4cyclictest851652-21cron21:59:592
675204992420,3cyclictest986120-21kworker/u8:0+events_unbound00:35:181
675210992319,3cyclictest778912-21kworker/u8:1+flush-259:021:45:163
675206992319,3cyclictest950470-21kworker/u8:2+events_unbound23:35:182
675206992319,3cyclictest669574-21kworker/u8:1+events_unbound19:32:172
675206992316,5cyclictest509-21rs:main2
675206992315,5cyclictest830938-21latency_hist21:40:012
675204992320,2cyclictest861945-21kworker/u8:0+events_unbound22:20:171
675204992320,2cyclictest619699-21kworker/u8:2+flush-259:020:20:211
675204992318,4cyclictest685744-21/usr/sbin/munin19:20:131
675196992320,2cyclictest831163-21kworker/u8:0+events_unbound21:40:160
675196992318,4cyclictest335557-21systemd-journal00:05:000
675210992219,2cyclictest669574-21kworker/u8:1+flush-259:019:25:003
675210992218,3cyclictest961344-21apt-get23:45:113
675210992218,3cyclictest861945-21kworker/u8:0+flush-259:022:20:163
675206992219,2cyclictest778912-21kworker/u8:1+flush-259:022:15:252
675206992218,3cyclictest955921-21kworker/u8:3+events_unbound00:20:192
675206992218,3cyclictest831163-21kworker/u8:0+events_unbound21:40:232
675206992218,3cyclictest619699-21kworker/u8:2+flush-259:021:20:272
675206992218,2cyclictest716497-21sh19:50:012
675206992215,5cyclictest747533-21latency_hist20:20:012
675204992219,2cyclictest887881-21kworker/u8:2+flush-259:022:45:231
675196992218,3cyclictest685531-21kworker/u8:3+events_unbound19:20:200
675196992218,3cyclictest509-21rs:main0
675196992217,4cyclictest1003058-21apt-get00:25:120
675210992117,3cyclictest887881-21kworker/u8:2+events_unbound22:40:243
675206992118,2cyclictest768789-21kworker/u8:3+events_unbound21:05:252
675206992115,4cyclictest805330-21apt-get21:15:112
675204992118,2cyclictest716511-21kworker/u8:4+flush-259:019:50:271
675196992118,2cyclictest898888-21apt-get22:45:120
675196992117,3cyclictest861945-21kworker/u8:0+events_unbound22:20:240
675206992017,1cyclictest0-21swapper/223:50:002
675206992016,3cyclictest991429-21kworker/u8:1+flush-259:000:15:252
675206992016,3cyclictest716511-21kworker/u8:4+events_unbound20:12:302
675206992016,3cyclictest619699-21kworker/u8:2+events_unbound19:55:142
675206992016,3cyclictest1007808-21kworker/u8:4+events_unbound00:30:162
675204992017,2cyclictest752672-21kworker/u8:0+events_unbound20:35:231
675204992017,2cyclictest619699-21kworker/u8:2+flush-259:019:15:201
675204992016,3cyclictest950470-21kworker/u8:2+events_unbound00:00:181
675204992016,3cyclictest815606-21kworker/u8:4+flush-259:022:00:161
675204992015,3cyclictest335557-21systemd-journal22:17:471
675204992014,4cyclictest934800-21latency_hist23:20:011
675196992016,3cyclictest887881-21kworker/u8:2+flush-259:023:05:220
675196992016,3cyclictest887881-21kworker/u8:2+events_unbound23:15:220
675210991916,2cyclictest778912-21kworker/u8:1+flush-259:021:30:273
675210991916,2cyclictest619699-21kworker/u8:2+flush-259:019:55:173
675210991916,2cyclictest1007808-21kworker/u8:4+flush-259:000:30:193
675210991913,4cyclictest509-21rs:main3
675206991915,3cyclictest950470-21kworker/u8:2+flush-259:000:08:012
675206991915,3cyclictest861945-21kworker/u8:0+flush-259:022:25:262
675206991915,3cyclictest742393-21kworker/u8:1+flush-259:020:35:252
675204991917,1cyclictest815606-21kworker/u8:4+events_unbound23:25:151
675204991916,2cyclictest935024-21kworker/u8:1+flush-259:023:40:151
675204991915,3cyclictest784257-21/usr/sbin/munin20:55:141
675204991915,3cyclictest706406-21/usr/sbin/munin19:40:171
675204991914,4cyclictest857270-21diskstats22:05:141
675204991914,4cyclictest509-21rs:main1
675204991912,5cyclictest737162-21latency_hist20:10:001
675196991916,2cyclictest861945-21kworker/u8:0+events_unbound22:30:180
675196991916,2cyclictest815606-21kworker/u8:4+events_unbound23:25:180
675196991916,2cyclictest768789-21kworker/u8:3+events_unbound21:00:250
675196991916,2cyclictest619699-21kworker/u8:2+flush-259:019:25:200
675196991915,3cyclictest752672-21kworker/u8:0+flush-259:020:25:170
675210991815,2cyclictest991429-21kworker/u8:1+flush-259:000:10:263
675210991815,2cyclictest955921-21kworker/u8:3+flush-259:000:25:173
675210991815,2cyclictest335557-21systemd-journal20:25:003
675206991814,3cyclictest861945-21kworker/u8:0+events_unbound22:33:182
675206991814,3cyclictest619699-21kworker/u8:2+flush-259:019:25:222
675206991814,3cyclictest619699-21kworker/u8:2+events_unbound19:20:172
675204991815,2cyclictest815606-21kworker/u8:4+events_unbound23:20:191
675204991815,2cyclictest768789-21kworker/u8:3+flush-259:021:55:201
675204991815,2cyclictest768789-21kworker/u8:3+events_unbound20:40:151
675204991815,2cyclictest752672-21kworker/u8:0+events_unbound20:45:161
675204991814,3cyclictest619699-21kworker/u8:2+events_unbound21:29:191
675196991816,1cyclictest619699-21kworker/u8:2+flush-259:019:35:240
675196991815,2cyclictest935024-21kworker/u8:1+flush-259:023:35:230
675196991814,3cyclictest752672-21kworker/u8:0+flush-259:020:45:220
675210991714,2cyclictest619699-21kworker/u8:2+events_unbound21:15:183
675210991713,3cyclictest861945-21kworker/u8:0+flush-259:022:10:223
675210991713,3cyclictest846513-21latency_hist21:55:013
675204991714,2cyclictest841320-21cron21:50:001
675204991714,2cyclictest619699-21kworker/u8:2+flush-259:019:35:161
675204991713,3cyclictest950470-21kworker/u8:2+flush-259:023:55:201
675204991713,3cyclictest716511-21kworker/u8:4+flush-259:020:00:011
675196991714,2cyclictest815606-21kworker/u8:4+events_unbound22:00:210
675196991714,2cyclictest778912-21kworker/u8:1+events_unbound22:15:220
675196991713,3cyclictest991429-21kworker/u8:1+flush-259:000:15:000
675210991613,2cyclictest619699-21kworker/u8:2+events_unbound21:29:183
675206991613,2cyclictest915685-21kthreadcore23:00:172
675206991613,2cyclictest778912-21kworker/u8:1+flush-259:021:47:392
675206991612,3cyclictest768789-21kworker/u8:3+events_unbound21:13:182
675206991612,2cyclictest0-21swapper/222:05:002
675196991614,1cyclictest60350irq/132-enp0s29f1:rx-022:58:040
675196991614,1cyclictest60350irq/132-enp0s29f1:rx-021:50:130
675196991614,1cyclictest60350irq/132-enp0s29f1:rx-019:40:180
675196991613,2cyclictest987034-21apt-key00:10:000
675196991613,2cyclictest61150irq/133-enp0s29f1:tx-020:52:180
675196991613,2cyclictest60350irq/132-enp0s29f1:rx-020:05:190
675196991613,2cyclictest60350irq/132-enp0s29f1:rx-019:15:120
675196991612,3cyclictest898391-21kworker/u8:1+flush-259:022:50:300
67521099159,4cyclictest684648-21ntpq19:15:213
675210991512,2cyclictest830923-21idleruntime-cro21:40:003
675206991511,3cyclictest887881-21kworker/u8:2+events_unbound23:15:242
67520499159,4cyclictest695816-21latency_hist19:30:001
67520499159,4cyclictest335557-21systemd-journal23:00:011
675204991513,1cyclictest0-21swapper/100:10:001
675204991512,2cyclictest935024-21kworker/u8:1+events_unbound23:30:171
675204991512,2cyclictest887881-21kworker/u8:2+events_unbound22:40:221
675204991511,3cyclictest831163-21kworker/u8:0+flush-259:021:40:241
67519699158,5cyclictest335557-21systemd-journal22:30:010
675196991513,1cyclictest60350irq/132-enp0s29f1:rx-021:20:270
675196991513,1cyclictest60350irq/132-enp0s29f1:rx-020:55:140
675196991513,1cyclictest60350irq/132-enp0s29f1:rx-019:10:280
675196991512,2cyclictest997332-21kworker/u8:2+flush-259:000:20:220
675196991512,2cyclictest768789-21kworker/u8:3+flush-259:021:15:250
675196991512,2cyclictest60350irq/132-enp0s29f1:rx-023:30:120
675196991512,2cyclictest60350irq/132-enp0s29f1:rx-020:15:220
67521099149,4cyclictest335557-21systemd-journal20:20:013
67521099149,3cyclictest940188-21/usr/sbin/munin23:25:243
675210991412,2cyclictest831163-21kworker/u8:0+flush-259:021:40:193
675210991411,2cyclictest752672-21kworker/u8:0+flush-259:020:47:353
675210991411,2cyclictest619699-21kworker/u8:2+events_unbound19:35:223
675210991410,3cyclictest619699-21kworker/u8:2+flush-259:020:30:003
67520699149,4cyclictest768789-21kworker/u8:3+flush-259:021:03:222
675206991411,2cyclictest950470-21kworker/u8:2+flush-259:000:03:062
675206991410,3cyclictest778912-21kworker/u8:1+flush-259:022:23:232
675206991410,3cyclictest752672-21kworker/u8:0+flush-259:020:43:282
675204991411,2cyclictest768789-21kworker/u8:3+events_unbound21:05:211
675204991410,3cyclictest966418-21kworker/u8:0+flush-259:023:55:001
675204991410,3cyclictest335557-21systemd-journal22:34:551
675196991413,1cyclictest60350irq/132-enp0s29f1:rx-021:27:370
675196991412,2cyclictest60350irq/132-enp0s29f1:rx-019:30:150
675196991412,1cyclictest60350irq/132-enp0s29f1:rx-021:35:210
675196991412,1cyclictest60350irq/132-enp0s29f1:rx-019:50:120
675196991412,1cyclictest60350irq/132-enp0s29f1:rx-019:45:170
675196991411,2cyclictest768789-21kworker/u8:3+events_unbound22:05:180
675196991411,2cyclictest60350irq/132-enp0s29f1:rx-020:40:010
67520499139,3cyclictest716511-21kworker/u8:4+events_unbound20:15:181
67520499139,3cyclictest675433-21apt-get19:10:121
67520499138,4cyclictest955921-21kworker/u8:3+flush-259:000:25:201
675204991310,2cyclictest898391-21kworker/u8:1+flush-259:022:50:261
675204991310,2cyclictest742393-21kworker/u8:1+events_unbound20:30:131
675196991312,1cyclictest60350irq/132-enp0s29f1:rx-023:45:260
675196991311,2cyclictest60350irq/132-enp0s29f1:rx-021:13:220
675196991311,1cyclictest60350irq/132-enp0s29f1:rx-020:22:030
675196991311,1cyclictest60350irq/132-enp0s29f1:rx-000:34:400
675196991310,2cyclictest60350irq/132-enp0s29f1:rx-021:30:250
67521099129,3cyclictest768789-21kworker/u8:3+flush-259:021:55:163
67521099129,2cyclictest991429-21kworker/u8:1+events_unbound00:15:193
67521099129,2cyclictest945877-21cpuspeed_turbos23:30:123
67521099129,2cyclictest695799-21cron19:29:593
675210991210,2cyclictest887881-21kworker/u8:2+events_unbound22:50:183
675210991210,1cyclictest0-21swapper/322:30:003
675210991210,1cyclictest0-21swapper/319:14:593
67520699128,3cyclictest898391-21kworker/u8:1+events_unbound22:49:562
67520499129,2cyclictest925137-21irqcore23:10:201
67520499128,3cyclictest619699-21kworker/u8:2+flush-259:020:25:331
67519699129,2cyclictest898217-21unixbench_singl22:40:250
67519699129,2cyclictest60350irq/132-enp0s29f1:rx-023:40:130
675196991210,1cyclictest60350irq/132-enp0s29f1:rx-023:13:150
675196991210,1cyclictest60350irq/132-enp0s29f1:rx-023:00:250
67521099118,2cyclictest0-21swapper/322:15:173
67521099117,3cyclictest857367-21fschecks_time22:05:163
67520699118,2cyclictest768789-21kworker/u8:3+events_unbound20:47:192
67520499118,2cyclictest809787-21unixbench_multi21:15:251
67520499118,2cyclictest789485-21cpuspeed_turbos21:00:151
67520499105,4cyclictest696080-21apt-get19:30:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional