You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 11:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Wed Mar 25, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3667081995552,2cyclictest75-21kswapd000:01:243
3667071994945,3cyclictest75-21kswapd000:01:240
3667077994036,3cyclictest75-21kswapd000:01:232
3667074994035,4cyclictest3755668-21apt-get20:35:131
3667071994035,4cyclictest3771103-21/usr/sbin/munin20:50:140
3667081993935,2cyclictest3728833-21kworker/u8:0+flush-259:020:30:013
3667074993632,3cyclictest3713645-21apt-get19:55:101
3667074993533,1cyclictest3973179-21fwupd00:01:201
3667074993532,2cyclictest3865230-21kworker/u8:4+flush-259:022:45:241
3667074993532,2cyclictest3865230-21kworker/u8:4+flush-259:022:45:231
3667071993430,3cyclictest3802213-21apt-get21:20:010
3667074993329,3cyclictest3682480-21kworker/u8:3+flush-259:020:00:261
3667071993228,3cyclictest3813000-21kworker/u8:4+flush-259:021:30:250
3667081993127,3cyclictest3713422-21kworker/u8:2+events_unbound20:10:173
3667074993127,3cyclictest3786350-21kworker/u8:0+flush-259:021:20:151
3667071993126,4cyclictest3781430-21apt-get21:00:130
3667081993025,4cyclictest4004531-21latency_hist00:35:003
3667071993023,5cyclictest3910419-21ntpq23:00:220
3667081992825,2cyclictest3667037-21kworker/u8:2+flush-259:019:15:163
3667081992824,3cyclictest3682480-21kworker/u8:3+flush-259:021:05:273
3667074992824,3cyclictest3932074-21kworker/u8:3+flush-259:023:45:241
3667074992822,4cyclictest3739804-21/usr/sbin/munin20:20:151
3667071992824,3cyclictest3962836-21gpgv23:55:010
3667071992824,3cyclictest3952488-21kworker/u8:0+flush-259:023:55:160
3667071992822,4cyclictest3754581-21ntpq20:30:240
3667081992724,2cyclictest3708482-21apt-get19:50:113
3667081992724,2cyclictest3682480-21kworker/u8:3+events_unbound21:00:143
3667077992723,3cyclictest3854722-21kworker/u8:3+flush-259:022:15:162
3667071992724,3cyclictest3682480-21kworker/u8:3+flush-259:021:05:150
3667081992622,3cyclictest3952488-21kworker/u8:0+events_unbound23:55:183
3667077992622,3cyclictest3978920-21kworker/u8:1+flush-259:000:10:262
3667077992521,3cyclictest3682480-21kworker/u8:3+flush-259:021:00:002
3667077992519,4cyclictest3734824-21diskstats20:15:112
3667074992521,3cyclictest3844606-21kworker/u8:0+events_unbound23:15:151
3667074992520,3cyclictest3786350-21kworker/u8:0+flush-259:021:40:171
3667071992522,2cyclictest3801899-21kworker/u8:2+events_unbound21:55:190
3667071992522,2cyclictest3682480-21kworker/u8:3+events_unbound19:30:130
3667071992521,3cyclictest3833663-21apt-get21:50:000
3667071992519,5cyclictest3718567-21latency_hist20:00:000
3667074992421,2cyclictest3786350-21kworker/u8:0+flush-259:021:10:241
3667074992419,4cyclictest3885814-21apt-get22:40:121
3667081992320,2cyclictest3823295-21kworker/u8:1+flush-259:022:05:203
3667081992320,2cyclictest3667268-21kworker/u8:4+flush-259:019:10:193
3667081992319,3cyclictest3682480-21kworker/u8:3+flush-259:021:30:003
3667081992319,3cyclictest3682480-21kworker/u8:3+flush-259:019:25:263
3667077992320,2cyclictest3813000-21kworker/u8:4+events_unbound21:30:172
3667077992319,3cyclictest3801899-21kworker/u8:2+flush-259:021:35:272
3667074992319,3cyclictest3931886-21kworker/u8:2+flush-259:023:25:181
3667074992319,3cyclictest3921771-21kworker/u8:4+flush-259:023:30:251
3667074992318,3cyclictest3865262-21apt-get22:20:111
3667074992316,5cyclictest3801288-21ntpq21:15:201
3667071992320,3cyclictest3682480-21kworker/u8:3+flush-259:019:25:170
3667071992319,3cyclictest3786350-21kworker/u8:0+events_unbound21:10:150
3667081992219,2cyclictest3682480-21kworker/u8:3+events_unbound19:45:123
3667074992218,3cyclictest3854722-21kworker/u8:3+events_unbound22:15:171
3667074992216,4cyclictest3790638-21ntpq21:05:231
3667074992215,5cyclictest3967407-21ntpq23:55:231
3667071992219,2cyclictest3801899-21kworker/u8:2+flush-259:021:50:240
3667071992217,4cyclictest3672174-21latency_hist19:15:020
3667081992118,2cyclictest3801899-21kworker/u8:2+flush-259:021:50:223
3667081992118,2cyclictest3682480-21kworker/u8:3+events_unbound20:20:193
3667081992118,2cyclictest3682480-21kworker/u8:3+events_unbound20:05:193
3667081992117,3cyclictest3952488-21kworker/u8:0+flush-259:000:15:263
3667081992117,3cyclictest3932074-21kworker/u8:3+flush-259:023:35:263
3667081992117,3cyclictest3921771-21kworker/u8:4+flush-259:023:45:263
3667081992115,5cyclictest3833840-21base6421:50:013
3667077992118,2cyclictest3682480-21kworker/u8:3+flush-259:020:20:172
3667077992115,4cyclictest3722853-21ntpq20:00:222
3667077992114,5cyclictest3727943-21ntpq20:05:212
3667074992117,3cyclictest3906154-21kworker/u8:3+flush-259:023:10:241
3667074992117,3cyclictest252-21systemd-journal22:36:541
3667074992116,4cyclictest3651765-21kworker/u8:1+flush-259:019:15:211
3667071992118,2cyclictest3749913-21kworker/u8:2+events_unbound20:35:180
3667071992115,4cyclictest3932270-21diskstats23:25:150
3667081992018,1cyclictest3682480-21kworker/u8:3+events_unbound19:35:233
3667081992017,2cyclictest3760408-21kworker/u8:1+flush-259:020:45:223
3667081992016,3cyclictest3947543-21/usr/sbin/munin23:40:153
3667081992016,3cyclictest3921802-21apt-get23:15:103
3667081992015,4cyclictest252-21systemd-journal20:40:253
3667077992016,3cyclictest3682480-21kworker/u8:3+flush-259:019:25:252
3667074992017,2cyclictest3760408-21kworker/u8:1+flush-259:020:45:241
3667074992016,3cyclictest3844606-21kworker/u8:0+events_unbound22:10:181
3667074992015,4cyclictest3734664-21apt-get20:15:091
3667071992017,2cyclictest3713422-21kworker/u8:2+events_unbound20:15:250
3667071992015,4cyclictest252-21systemd-journal20:06:270
366707199200,19cyclictest1-21systemd22:51:240
3667081991917,2cyclictest3823295-21kworker/u8:1+events_unbound22:00:173
3667081991916,2cyclictest3820687-21kthreadcore21:35:183
3667081991916,2cyclictest3760408-21kworker/u8:1+events_unbound20:55:133
3667077991916,2cyclictest3797063-21latency_hist21:15:002
3667077991916,1cyclictest0-21swapper/220:15:012
3667077991914,4cyclictest3865230-21kworker/u8:4+flush-259:022:35:172
3667077991912,5cyclictest252-21systemd-journal19:15:002
3667074991916,2cyclictest3823295-21kworker/u8:1+flush-259:022:09:591
3667074991915,3cyclictest3728833-21kworker/u8:0+events_unbound20:25:231
3667074991915,3cyclictest3682480-21kworker/u8:3+events_unbound19:30:021
3667074991913,4cyclictest3931848-21latency_hist23:25:001
3667071991916,2cyclictest3760408-21kworker/u8:1+flush-259:020:55:230
3667071991915,3cyclictest3801899-21kworker/u8:2+events_unbound21:35:220
3667071991914,4cyclictest3989310-21apt-get00:20:120
3667081991815,2cyclictest3890690-21kworker/u8:1+events_unbound22:50:253
3667081991815,2cyclictest3844606-21kworker/u8:0+events_unbound22:55:233
3667081991815,2cyclictest3786350-21kworker/u8:0+events_unbound21:20:183
3667081991814,2cyclictest0-21swapper/321:15:003
3667081991813,3cyclictest252-21systemd-journal19:31:203
3667077991815,2cyclictest3692749-21kworker/u8:1+flush-259:019:35:172
3667077991814,3cyclictest3802236-21gpgv21:20:012
3667077991814,2cyclictest0-21swapper/219:54:592
3667077991813,4cyclictest500-21systemd-logind21:50:012
3667077991812,4cyclictest3895807-21latency_hist22:50:012
3667077991812,4cyclictest3895807-21latency_hist22:50:002
3667074991815,2cyclictest3801899-21kworker/u8:2+flush-259:021:35:011
3667074991812,4cyclictest3984130-21apt-get00:15:121
3667071991816,1cyclictest3749852-21idleruntime-cro20:29:590
3667071991815,2cyclictest3854722-21kworker/u8:3+events_unbound22:25:250
3667071991815,2cyclictest3765919-21/usr/sbin/munin20:45:140
3667071991815,2cyclictest3677039-21kworker/u8:0+flush-259:019:20:160
3667071991814,3cyclictest4004792-21apt-get00:35:120
3667071991813,4cyclictest3823513-21/usr/sbin/munin21:40:150
3667081991714,2cyclictest3865230-21kworker/u8:4+flush-259:022:35:153
3667081991714,2cyclictest3760408-21kworker/u8:1+flush-259:020:50:223
3667077991715,1cyclictest3947303-21latency_hist23:39:592
3667077991713,3cyclictest3932074-21kworker/u8:3+flush-259:023:40:172
3667077991713,3cyclictest3844606-21kworker/u8:0+flush-259:022:55:002
3667077991712,3cyclictest3765679-21latency_hist20:45:002
3667074991713,3cyclictest3823295-21kworker/u8:1+flush-259:022:00:161
3667074991711,5cyclictest3834180-21cat21:50:011
3667071991714,3cyclictest3932074-21kworker/u8:3+events_unbound23:41:250
3667071991714,2cyclictest60350irq/132-enp0s29f1:rx-022:20:180
3667071991714,2cyclictest3994243-21kworker/u8:1+flush-259:000:30:170
3667071991714,2cyclictest3921771-21kworker/u8:4+events_unbound00:05:180
3667071991712,4cyclictest3906111-21latency_hist23:00:010
3667081991614,2cyclictest3844606-21kworker/u8:0+flush-259:022:45:163
3667081991614,2cyclictest3844606-21kworker/u8:0+flush-259:022:45:153
3667081991613,2cyclictest3932074-21kworker/u8:3+events_unbound23:50:213
3667081991612,3cyclictest3786350-21kworker/u8:0+events_unbound21:15:193
3667077991613,2cyclictest3932518-21irqcore23:25:182
3667077991612,3cyclictest3952488-21kworker/u8:0+flush-259:000:25:262
3667077991612,2cyclictest0-21swapper/222:35:002
3667077991610,4cyclictest3994222-21latency_hist00:25:002
3667071991613,2cyclictest60350irq/132-enp0s29f1:rx-022:45:160
3667071991613,2cyclictest60350irq/132-enp0s29f1:rx-022:45:160
3667071991613,2cyclictest3952488-21kworker/u8:0+flush-259:000:15:210
3667071991613,2cyclictest3921771-21kworker/u8:4+flush-259:023:35:260
3667071991612,3cyclictest3952488-21kworker/u8:0+events_unbound00:10:170
3667071991612,3cyclictest3677039-21kworker/u8:0+events_unbound19:19:260
3667081991513,1cyclictest1629469-21kworker/3:1+events_power_efficient19:55:193
3667081991512,2cyclictest3939591-21grep23:30:183
3667081991512,2cyclictest3749913-21kworker/u8:2+events_unbound20:30:213
3667081991512,2cyclictest3677039-21kworker/u8:0+flush-259:019:20:013
3667081991511,3cyclictest3931886-21kworker/u8:2+events_unbound23:25:223
366707799159,4cyclictest252-21systemd-journal23:33:242
3667077991512,2cyclictest3651765-21kworker/u8:1+flush-259:019:15:272
3667077991511,3cyclictest3750044-21apt-key20:30:012
3667074991512,2cyclictest3994243-21kworker/u8:1+events_unbound00:35:251
3667074991512,2cyclictest3932074-21kworker/u8:3+events_unbound23:50:151
3667074991510,4cyclictest252-21systemd-journal19:25:001
3667071991513,2cyclictest61150irq/133-enp0s29f1:tx-020:00:150
3667071991513,1cyclictest60350irq/132-enp0s29f1:rx-023:30:190
3667071991513,1cyclictest60350irq/132-enp0s29f1:rx-023:05:200
3667071991513,1cyclictest60350irq/132-enp0s29f1:rx-022:40:170
3667071991513,1cyclictest60350irq/132-enp0s29f1:rx-021:27:040
3667071991512,3cyclictest3906154-21kworker/u8:3+events_unbound23:10:140
3667071991512,2cyclictest60350irq/132-enp0s29f1:rx-022:10:240
3667071991512,2cyclictest3806915-21ntp_kernel_pll_21:20:200
3667071991511,3cyclictest3682480-21kworker/u8:3+flush-259:019:45:150
3667071991510,4cyclictest3849778-21/usr/sbin/munin22:05:210
3667081991411,2cyclictest3844606-21kworker/u8:0+events_unbound23:20:133
3667081991411,2cyclictest3813000-21kworker/u8:4+flush-259:021:30:213
366707799149,3cyclictest252-21systemd-journal20:30:002
366707799148,4cyclictest252-21systemd-journal22:30:002
3667077991411,2cyclictest3803300-21irqcore21:20:162
3667077991410,3cyclictest3962196-21unixbench-2d23:50:232
366707499147,5cyclictest3946480-21ntpq23:35:241
3667074991412,1cyclictest0-21swapper/119:55:001
3667074991410,3cyclictest3896284-21fschecks_count22:50:161
3667074991410,3cyclictest3801899-21kworker/u8:2+events_unbound21:35:181
3667074991410,3cyclictest3682480-21kworker/u8:3+flush-259:019:35:251
3667071991413,1cyclictest60350irq/132-enp0s29f1:rx-023:21:450
3667071991412,1cyclictest60350irq/132-enp0s29f1:rx-022:30:160
3667071991412,1cyclictest60350irq/132-enp0s29f1:rx-022:00:240
3667071991411,2cyclictest3932074-21kworker/u8:3+flush-259:023:45:200
3667071991411,2cyclictest3854722-21kworker/u8:3+flush-259:022:15:230
3667071991411,2cyclictest3733979-21turbostat20:14:590
366708199139,3cyclictest0-21swapper/321:59:593
3667081991311,1cyclictest0-21swapper/300:05:153
3667081991310,2cyclictest3854722-21kworker/u8:3+flush-259:022:25:273
366707799139,3cyclictest3844606-21kworker/u8:0+events_unbound23:05:242
366707799139,3cyclictest3692749-21kworker/u8:1+flush-259:019:55:162
3667077991311,1cyclictest0-21swapper/223:05:002
3667077991310,2cyclictest3770003-21ntp_kernel_pll_20:45:202
3667077991310,2cyclictest3702215-21ntp_offset19:40:222
366707799130,11cyclictest1-21systemd21:45:002
366707499139,3cyclictest3906154-21kworker/u8:3+events_unbound23:00:131
3667074991310,2cyclictest3823296-21kworker/u8:3+flush-259:021:49:011
3667074991310,2cyclictest3682480-21kworker/u8:3+events_unbound19:45:201
366707199139,3cyclictest3994243-21kworker/u8:1+events_unbound00:27:210
3667071991311,1cyclictest60350irq/132-enp0s29f1:rx-019:40:220
3667071991310,2cyclictest61150irq/133-enp0s29f1:tx-023:15:140
366708199129,2cyclictest3994243-21kworker/u8:1+flush-259:000:37:253
366708199128,3cyclictest3854722-21kworker/u8:3+flush-259:022:15:193
3667081991210,1cyclictest0-21swapper/320:04:593
366707799129,2cyclictest3926215-21unixbench_multi23:15:232
366707799129,2cyclictest3809073-21tr21:25:162
366707799128,3cyclictest3844606-21kworker/u8:0+flush-259:022:10:272
366707799128,3cyclictest3801899-21kworker/u8:2+flush-259:021:55:272
366707499129,2cyclictest3989385-21cpuspeed_turbos00:20:141
366707499129,2cyclictest3765251-21unixbench_singl20:40:241
366707199129,2cyclictest60350irq/132-enp0s29f1:rx-019:50:120
366708199118,2cyclictest3755735-21cpuspeed_turbos20:35:143
366708199118,2cyclictest3682480-21kworker/u8:3+events_unbound19:40:143
366708199117,3cyclictest3988988-21kworker/u8:2+flush-259:000:20:003
366707799119,1cyclictest3791471-21cron21:10:012
366707799110,9cyclictest3931850-21awk23:25:002
366707499119,2cyclictest3844606-21kworker/u8:0+events_unbound22:55:131
366707499118,2cyclictest3874867-21unixbench_singl22:25:271
366707499117,3cyclictest3973799-21apt-get00:05:121
366707799108,1cyclictest0-21swapper/222:55:172
366707799108,1cyclictest0-21swapper/200:05:132
366707799107,2cyclictest3844781-21cpuspeed_turbos22:00:132
366707799106,3cyclictest3667037-21kworker/u8:2+flush-259:019:30:212
366707799105,1cyclictest0-21swapper/222:45:002
366707799100,8cyclictest3786322-21latency_hist21:05:012
366707499106,3cyclictest3932074-21kworker/u8:3+flush-259:023:40:161
36670779997,1cyclictest0-21swapper/223:45:142
36670779997,1cyclictest0-21swapper/219:20:242
36670779996,2cyclictest0-21swapper/223:10:122
36670779996,1cyclictest0-21swapper/223:55:182
36670779996,1cyclictest0-21swapper/220:40:012
36670779995,3cyclictest3865457-21cut22:20:122
36670749994,4cyclictest3911527-21/usr/sbin/munin23:05:141
36670749994,3cyclictest3783903-21cut21:00:191
36670779986,1cyclictest0-21swapper/200:20:002
36670779984,3cyclictest252-21systemd-journal00:31:252
36670779971,4cyclictest3850108-21hddtemp_smartct22:05:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional