You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 14:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Thu Apr 23, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
115495995346,5cyclictest302814-21cp22:10:000
115505994640,4cyclictest252-21systemd-journal20:45:153
115499994643,2cyclictest308525-21kworker/u8:1+events_unbound22:20:151
115505994236,4cyclictest349717-21cat22:55:013
115501994238,3cyclictest225571-21kworker/u8:4+flush-259:021:00:012
115501994032,3cyclictest127217-21kworker/u8:1+events_unbound19:55:232
115495994036,3cyclictest224921-21apt-get20:55:000
115501993933,4cyclictest252-21systemd-journal22:25:152
115495993935,3cyclictest334312-21kworker/u8:0+flush-259:023:00:150
115501993835,2cyclictest127217-21kworker/u8:1+events_unbound21:15:252
115501993832,4cyclictest308525-21kworker/u8:1+events_unbound22:40:012
115501993832,4cyclictest245996-21latency_hist21:15:002
115499993834,3cyclictest78370-21kworker/u8:0+flush-259:019:10:131
115495993732,4cyclictest172053-21ntpq20:00:230
115501993633,2cyclictest127217-21kworker/u8:1+flush-259:020:50:172
115499993632,3cyclictest438346-21apt-get00:20:111
115499993632,3cyclictest225571-21kworker/u8:4+events_unbound20:55:191
115495993633,2cyclictest448405-21kworker/u8:0+flush-259:000:35:190
115501993530,3cyclictest308525-21kworker/u8:1+events_unbound23:15:172
115501993431,2cyclictest432931-21kworker/u8:3+flush-259:000:25:212
115501993430,3cyclictest302712-21apt-get22:10:022
115501993428,4cyclictest67877-21kworker/u8:3+flush-259:019:20:152
115499993431,2cyclictest127217-21kworker/u8:1+flush-259:020:10:241
115495993429,3cyclictest241093-21apt-get21:10:120
115501993329,2cyclictest127217-21kworker/u8:1+events_unbound21:05:162
115501993229,2cyclictest67877-21kworker/u8:3+events_unbound19:25:222
115501993228,3cyclictest250592-21kworker/u8:0+events_unbound21:20:162
115501993227,3cyclictest199364-21/usr/sbin/munin20:30:232
11549599321,30cyclictest1-21systemd20:10:320
115501993126,4cyclictest334312-21kworker/u8:0+flush-259:023:05:172
115499993126,3cyclictest252-21systemd-journal21:05:171
115501993027,2cyclictest78370-21kworker/u8:0+flush-259:019:10:202
115501993027,2cyclictest432931-21kworker/u8:3+flush-259:000:30:182
115501993027,2cyclictest136518-21kworker/u8:0+events_unbound20:25:202
115501993026,3cyclictest432931-21kworker/u8:3+flush-259:000:15:202
115501993026,3cyclictest127217-21kworker/u8:1+flush-259:020:10:212
115501993024,4cyclictest127217-21kworker/u8:1+events_unbound19:40:232
115499993026,3cyclictest308525-21kworker/u8:1+flush-259:023:55:001
115505992923,4cyclictest509-21rs:main3
115501992925,3cyclictest411799-21kworker/u8:2+flush-259:000:00:252
115499992925,3cyclictest417564-21base6400:00:001
115499992925,3cyclictest411799-21kworker/u8:2+flush-259:000:15:001
115495992926,2cyclictest127217-21kworker/u8:1+flush-259:019:55:210
115505992822,4cyclictest204312-21latency_hist20:35:003
115501992824,3cyclictest411799-21kworker/u8:2+flush-259:000:05:252
115501992824,3cyclictest411799-21kworker/u8:2+flush-259:000:05:242
115501992822,4cyclictest252-21systemd-journal20:44:142
115499992825,2cyclictest308525-21kworker/u8:1+flush-259:022:30:251
115499992825,2cyclictest136518-21kworker/u8:0+flush-259:020:10:011
115499992824,3cyclictest142376-21apt-get19:35:121
115499992822,4cyclictest344385-21latency_hist22:50:011
115495992825,2cyclictest127217-21kworker/u8:1+flush-259:020:20:010
115495992824,3cyclictest308525-21kworker/u8:1+flush-259:000:00:000
115495992824,3cyclictest308525-21kworker/u8:1+flush-259:000:00:000
115495992821,5cyclictest318624-21latency_hist22:25:010
11549599280,27cyclictest509-21rs:main0
115505992721,4cyclictest225571-21kworker/u8:4+flush-259:021:25:163
115501992723,3cyclictest334312-21kworker/u8:0+flush-259:023:45:152
115501992723,3cyclictest308525-21kworker/u8:1+events_unbound23:40:172
115495992720,5cyclictest421718-21ntpq00:00:230
115501992622,3cyclictest334312-21kworker/u8:0+events_unbound23:00:162
115501992621,3cyclictest252-21systemd-journal21:50:572
115501992621,3cyclictest252-21systemd-journal21:50:572
115495992622,3cyclictest136518-21kworker/u8:0+events_unbound20:30:010
115505992520,4cyclictest252-21systemd-journal23:10:003
115505992519,4cyclictest448377-21latency_hist00:30:003
115501992521,3cyclictest344405-21kworker/u8:2+flush-259:022:55:162
115501992521,3cyclictest297779-21kworker/u8:0+events_unbound22:19:172
115501992521,3cyclictest272042-21kworker/u8:2+flush-259:022:00:212
115499992521,3cyclictest78370-21kworker/u8:0+flush-259:019:15:231
115499992521,3cyclictest78370-21kworker/u8:0+flush-259:019:15:221
115501992421,2cyclictest308525-21kworker/u8:1+events_unbound23:20:152
115501992421,2cyclictest127217-21kworker/u8:1+events_unbound20:00:122
115501992420,3cyclictest386269-21apt-get23:30:122
115501992420,3cyclictest344405-21kworker/u8:2+events_unbound22:50:172
115501992418,4cyclictest126071-21cat19:20:012
115501992418,4cyclictest126071-21cat19:20:012
115501992416,5cyclictest328940-21latency_hist22:35:012
115499992420,3cyclictest127217-21kworker/u8:1+flush-259:021:00:171
115495992419,4cyclictest390329-21ntpq23:30:230
115501992320,2cyclictest334312-21kworker/u8:0+events_unbound23:25:122
115501992320,2cyclictest199356-21kworker/u8:3+flush-259:020:35:212
115501992319,3cyclictest199356-21kworker/u8:3+flush-259:021:30:152
115501992317,4cyclictest147244-21latency_hist19:40:012
115495992320,2cyclictest287503-21kworker/u8:3+flush-259:022:05:000
115505992218,3cyclictest78370-21kworker/u8:0+flush-259:019:10:103
115505992218,3cyclictest183499-21apt-get20:15:103
115505992216,4cyclictest422549-21latency_hist00:05:013
115499992218,3cyclictest334312-21kworker/u8:0+flush-259:023:05:161
115499992218,3cyclictest199266-21gpgv20:30:011
115499992218,3cyclictest157814-21apt-get19:50:121
115499992216,4cyclictest224921-21apt-get20:55:011
115505992118,2cyclictest509-21rs:main3
115505992117,3cyclictest193587-21kworker/u8:2+flush-259:020:50:153
115501992118,2cyclictest308525-21kworker/u8:1+flush-259:023:50:242
115501992118,2cyclictest199356-21kworker/u8:3+events_unbound21:35:152
115505992015,4cyclictest416639-21journal-offline23:56:153
115505992015,4cyclictest416639-21journal-offline23:56:153
115505992014,4cyclictest252-21systemd-journal22:04:153
115501992012,6cyclictest343525-21ntpq22:45:212
115499992017,2cyclictest422817-21apt-get00:05:121
115499992017,2cyclictest422817-21apt-get00:05:121
115499992016,3cyclictest225571-21kworker/u8:4+flush-259:021:45:201
115499992014,5cyclictest270896-21ntpq21:35:191
115495992017,2cyclictest509-21rs:main0
115495992016,3cyclictest448645-21apt-get00:30:120
115495992015,4cyclictest157551-21latency_hist19:50:010
115505991915,3cyclictest302737-21gpgv22:10:003
115501991916,2cyclictest427764-21kworker/u8:1+flush-259:000:20:162
115501991916,2cyclictest386047-21kworker/u8:2+events_unbound23:37:172
115499991916,2cyclictest287503-21kworker/u8:3+flush-259:022:05:241
115499991915,3cyclictest292721-21apt-get22:00:121
115495991913,4cyclictest380863-21latency_hist23:25:000
115505991815,2cyclictest178072-21sh20:10:003
115505991815,2cyclictest0-21swapper/300:10:003
115505991815,2cyclictest0-21swapper/300:10:003
115505991811,5cyclictest276978-21latency_hist21:45:003
115501991815,2cyclictest334312-21kworker/u8:0+events_unbound23:55:152
115501991815,2cyclictest334312-21kworker/u8:0+events_unbound23:55:142
115501991812,4cyclictest252-21systemd-journal22:41:152
115499991816,1cyclictest0-21swapper/121:25:001
115499991815,2cyclictest308525-21kworker/u8:1+events_unbound23:20:121
115495991815,2cyclictest257017-21irqcore21:25:160
115495991815,2cyclictest127217-21kworker/u8:1+flush-259:020:20:160
115495991814,3cyclictest417619-21kworker/u8:4+flush-259:000:10:170
115495991814,3cyclictest225571-21kworker/u8:4+flush-259:021:45:260
115495991812,4cyclictest252-21systemd-journal20:07:150
115505991712,3cyclictest252-21systemd-journal21:30:543
115505991711,4cyclictest252-21systemd-journal20:55:473
115501991714,2cyclictest417619-21kworker/u8:4+flush-259:000:10:252
115501991713,3cyclictest225571-21kworker/u8:4+events_unbound22:07:172
115501991713,3cyclictest225571-21kworker/u8:4+events_unbound21:00:032
115501991713,3cyclictest127217-21kworker/u8:1+events_unbound20:05:172
115501991712,3cyclictest225571-21kworker/u8:4+events_unbound21:25:172
115501991710,5cyclictest141236-21ntpq19:30:222
115499991714,2cyclictest204985-21irqcore20:35:171
115499991713,3cyclictest225571-21kworker/u8:4+flush-259:021:35:001
115499991713,3cyclictest199356-21kworker/u8:3+flush-259:020:40:211
115499991713,3cyclictest136518-21kworker/u8:0+flush-259:019:45:161
115499991711,5cyclictest334506-21sshd22:40:151
115499991710,5cyclictest329369-21diskstats22:35:141
115495991714,2cyclictest500-21systemd-logind23:20:010
115495991714,2cyclictest267339-21tr21:35:150
115505991614,1cyclictest0-21swapper/320:40:013
115505991610,4cyclictest252-21systemd-journal22:31:093
115501991613,2cyclictest448405-21kworker/u8:0+events_unbound00:35:562
115501991613,2cyclictest127217-21kworker/u8:1+flush-259:020:20:192
115501991612,3cyclictest297779-21kworker/u8:0+events_unbound22:21:162
115501991612,3cyclictest272042-21kworker/u8:2+events_unbound21:41:072
115499991612,3cyclictest432931-21kworker/u8:3+flush-259:000:35:011
115499991611,4cyclictest252-21systemd-journal19:25:151
115495991614,1cyclictest60350irq/132-enp0s29f1:rx-023:45:230
115495991614,1cyclictest60350irq/132-enp0s29f1:rx-021:40:230
115495991614,1cyclictest60350irq/132-enp0s29f1:rx-019:30:160
115495991614,1cyclictest60350irq/132-enp0s29f1:rx-000:05:200
115495991614,1cyclictest60350irq/132-enp0s29f1:rx-000:05:190
115495991613,2cyclictest60350irq/132-enp0s29f1:rx-022:55:230
115495991613,2cyclictest60350irq/132-enp0s29f1:rx-021:05:140
115495991613,2cyclictest60350irq/132-enp0s29f1:rx-019:35:200
115495991613,2cyclictest131812-21fschecks_count19:25:150
11550599159,4cyclictest509-21rs:main3
115505991513,1cyclictest0-21swapper/319:30:003
115505991510,4cyclictest198700-21apt-get20:30:013
115501991512,2cyclictest127217-21kworker/u8:1+events_unbound20:15:162
115501991511,2cyclictest0-21swapper/221:55:162
115499991512,2cyclictest217158-21kthreadcore20:45:171
115499991511,3cyclictest355158-21latency_hist23:00:011
11549999151,12cyclictest1-21systemd23:47:161
115499991511,2cyclictest0-21swapper/119:20:151
115495991513,2cyclictest60350irq/132-enp0s29f1:rx-022:34:360
115495991513,2cyclictest60350irq/132-enp0s29f1:rx-022:16:400
115495991513,1cyclictest60350irq/132-enp0s29f1:rx-022:36:310
115495991513,1cyclictest60350irq/132-enp0s29f1:rx-022:10:170
115495991513,1cyclictest60350irq/132-enp0s29f1:rx-019:50:190
115495991513,1cyclictest60350irq/132-enp0s29f1:rx-019:40:150
115495991513,1cyclictest60350irq/132-enp0s29f1:rx-019:19:280
115495991513,1cyclictest60350irq/132-enp0s29f1:rx-019:19:270
115495991513,1cyclictest60350irq/132-enp0s29f1:rx-000:25:210
115495991513,1cyclictest60350irq/132-enp0s29f1:rx-000:15:150
115495991512,2cyclictest60350irq/132-enp0s29f1:rx-021:55:170
115495991512,2cyclictest60350irq/132-enp0s29f1:rx-020:55:130
115495991512,2cyclictest60350irq/132-enp0s29f1:rx-020:40:220
115495991512,2cyclictest365439-21turbostat23:10:000
115495991512,2cyclictest349893-21apt-key22:55:010
115505991411,2cyclictest0-21swapper/323:29:593
115505991411,1cyclictest0-21swapper/320:20:123
115505991410,3cyclictest334312-21kworker/u8:0+flush-259:023:00:203
115505991410,3cyclictest252-21systemd-journal22:39:553
11550599140,13cyclictest142127-21true19:35:003
115501991411,2cyclictest136518-21kworker/u8:0+events_unbound19:48:422
115501991410,3cyclictest225571-21kworker/u8:4+events_unbound21:49:592
115501991410,3cyclictest136518-21kworker/u8:0+events_unbound19:54:262
11549999149,4cyclictest308559-21apt-get22:15:111
11549999149,4cyclictest225571-21kworker/u8:4+flush-259:021:40:251
115499991410,3cyclictest287537-21apt-get21:55:111
115499991410,3cyclictest282132-21kworker/u8:0+flush-259:021:50:171
115499991410,3cyclictest282132-21kworker/u8:0+flush-259:021:50:171
115499991410,3cyclictest136518-21kworker/u8:0+flush-259:020:25:171
115495991413,1cyclictest60350irq/132-enp0s29f1:rx-021:15:080
115495991412,2cyclictest60350irq/132-enp0s29f1:rx-021:23:330
115495991412,2cyclictest60350irq/132-enp0s29f1:rx-019:12:270
115495991412,1cyclictest60350irq/132-enp0s29f1:rx-023:50:140
115495991412,1cyclictest60350irq/132-enp0s29f1:rx-023:25:180
115495991412,1cyclictest323788-21turbostat22:30:000
115495991411,2cyclictest61150irq/133-enp0s29f1:tx-023:44:150
115495991411,2cyclictest60350irq/132-enp0s29f1:rx-021:00:130
115505991311,1cyclictest0-21swapper/319:35:153
115505991310,2cyclictest350657-21irqcore22:55:173
115505991310,2cyclictest212011-21kthreadcore20:40:193
115505991310,2cyclictest163156-21fschecks_count19:55:153
11550199139,3cyclictest334312-21kworker/u8:0+events_unbound23:11:072
11550199139,3cyclictest193587-21kworker/u8:2+events_unbound20:49:122
11549999139,3cyclictest256591-21apt-get21:25:111
11549999139,2cyclictest0-21swapper/123:05:001
115499991311,1cyclictest139521-21kthreadcore19:30:171
115499991310,2cyclictest500-21systemd-logind23:20:001
115499991310,2cyclictest370155-21unixbench_singl23:10:241
115499991310,2cyclictest127217-21kworker/u8:1+flush-259:020:15:161
11549599139,3cyclictest308525-21kworker/u8:1+flush-259:023:35:160
115495991312,1cyclictest60350irq/132-enp0s29f1:rx-022:42:130
115495991311,1cyclictest60350irq/132-enp0s29f1:rx-021:30:140
11550599129,2cyclictest432931-21kworker/u8:3+flush-259:000:33:443
11550599129,2cyclictest241159-21cpuspeed_turbos21:10:123
11550599128,3cyclictest334312-21kworker/u8:0+flush-259:023:49:453
11550599128,3cyclictest334312-21kworker/u8:0+flush-259:023:31:103
11550599128,3cyclictest127217-21kworker/u8:1+flush-259:020:10:313
11550599127,4cyclictest386047-21kworker/u8:2+flush-259:023:37:463
115505991210,1cyclictest0-21swapper/300:20:003
11549999129,1cyclictest0-21swapper/122:50:181
11549999129,1cyclictest0-21swapper/100:40:001
11549999128,2cyclictest136518-21kworker/u8:0-flush-259:020:05:011
115499991210,1cyclictest0-21swapper/121:15:211
11549599127,4cyclictest252-21systemd-journal19:20:110
11550599119,1cyclictest0-21swapper/300:35:143
11550599118,2cyclictest313809-21cpuspeed_turbos22:20:123
11550599117,3cyclictest317797-21kworker/u8:3+flush-259:022:27:453
11550599117,3cyclictest127217-21kworker/u8:1+flush-259:020:00:253
11550599115,4cyclictest252-21systemd-journal21:55:003
11550599115,4cyclictest252-21systemd-journal21:55:003
11549999118,1cyclictest0-21swapper/122:10:111
11549999111,2cyclictest3985741kthreadcore23:40:181
11549999111,2cyclictest396330-21awk23:40:001
11549999110,4cyclictest152370-21cron19:45:001
11549599119,1cyclictest60350irq/132-enp0s29f1:rx-020:46:190
11549599118,2cyclictest0-21swapper/000:20:160
11550599107,2cyclictest380856-21idleruntime-cro23:24:593
11550599104,4cyclictest303344-21cp22:10:013
11549999108,1cyclictest0-21swapper/121:10:221
11549999104,4cyclictest437296-21wc00:15:231
11549999101,7cyclictest193574-21awk20:25:001
11549999100,3cyclictest448377-21latency_hist00:30:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional