You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 11:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Dec 17, 2025 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3764400993326,5cyclictest3804642-21ntpq19:45:223
3764400993229,2cyclictest3837215-21kworker/u8:3+flush-259:020:40:203
3764400993227,4cyclictest4080669-21latency_hist00:15:003
3764392993228,3cyclictest3857672-21kworker/u8:0+flush-259:020:45:001
3764392993227,3cyclictest4039624-21cat23:35:011
3764392993025,3cyclictest4028282-21latency_hist23:25:021
3764390993027,2cyclictest3919764-21kworker/u8:4+flush-259:021:50:180
3764400992924,4cyclictest252-21systemd-journal23:20:003
3764392992923,4cyclictest3830945-21ntpq20:10:231
3764390992924,4cyclictest3894032-21/usr/sbin/munin21:15:140
3764396992821,5cyclictest3784940-21latency_hist19:30:002
3764392992824,3cyclictest4033416-21latency_hist23:30:011
3764400992724,2cyclictest3764020-21kworker/u8:2+flush-259:019:10:173
3764400992622,3cyclictest3940340-21cat22:00:003
3764400992521,3cyclictest3837215-21kworker/u8:3+flush-259:021:05:153
3764400992417,5cyclictest3986167-21ntpq22:40:223
3764396992421,2cyclictest3857672-21kworker/u8:0+events_unbound21:05:172
3764392992422,2cyclictest4064935-21kworker/u8:1+flush-259:000:10:241
3764392992421,2cyclictest3992416-21apt-get22:50:121
3764390992419,4cyclictest4081091-21diskstats00:15:130
376439099241,22cyclictest252-21systemd-journal20:55:550
3764390992319,3cyclictest4075548-21kworker/u8:0+flush-259:000:20:220
3764400992219,2cyclictest3893796-21sh21:15:003
3764400992115,4cyclictest3997296-21latency_hist22:55:003
3764392992116,4cyclictest3856721-21ntpq20:35:191
3764390992118,2cyclictest4055074-21kworker/u8:3+flush-259:023:50:150
3764390992115,4cyclictest3764313-21latency_hist19:10:010
3764400992017,2cyclictest3852499-21sh20:35:003
3764396992017,2cyclictest507-21in:imuxsock22:30:002
3764396992017,2cyclictest3800352-21kworker/u8:3+events_unbound19:45:002
3764392992015,4cyclictest4105653-21ntpq00:35:211
3764390992017,2cyclictest3868045-21cron20:50:000
3764400991915,2cyclictest4044547-21cron23:40:013
3764400991915,2cyclictest0-21swapper/321:20:003
3764400991914,3cyclictest3805579-21kworker/u8:4+flush-259:020:25:183
3764396991913,4cyclictest3893791-21latency_hist21:15:012
3764392991916,2cyclictest4044828-21apt-get23:40:121
3764392991914,4cyclictest3842408-21/usr/sbin/munin20:25:201
3764392991913,5cyclictest3778895-21ntpq19:20:201
3764390991914,3cyclictest252-21systemd-journal20:26:560
3764390991913,5cyclictest4069482-21ntpq00:00:230
3764390991912,5cyclictest3795254-21latency_hist19:40:000
3764400991814,2cyclictest3904123-21sh21:25:013
3764396991815,2cyclictest3940186-21apt-get22:00:032
376440099179,5cyclictest252-21systemd-journal22:25:003
3764400991714,2cyclictest3837215-21kworker/u8:3+events_unbound20:35:163
3764400991714,1cyclictest0-21swapper/322:15:003
3764396991714,2cyclictest507-21in:imuxsock22:50:002
3764396991713,3cyclictest3821089-21latency_hist20:05:002
3764396991713,3cyclictest3821089-21latency_hist20:05:002
3764396991713,2cyclictest3966357-21latency_hist22:25:002
3764396991711,4cyclictest4053973-21ntpq23:45:212
3764396991711,4cyclictest3976689-21awk22:35:002
3764392991714,2cyclictest0-21swapper/123:15:001
3764390991715,1cyclictest3966362-21munin-plugin-st22:25:000
3764390991714,2cyclictest60350irq/132-enp0s29f1:rx-021:25:200
3764390991714,2cyclictest60350irq/132-enp0s29f1:rx-019:55:130
3764390991714,2cyclictest60350irq/132-enp0s29f1:rx-000:28:350
3764390991714,2cyclictest3950460-21kworker/u8:0+flush-259:022:25:180
3764390991714,2cyclictest3805579-21kworker/u8:4+flush-259:020:30:170
3764390991712,4cyclictest252-21systemd-journal20:25:000
3764390991711,4cyclictest3826674-21latency_hist20:10:000
376440099169,5cyclictest252-21systemd-journal22:36:133
376440099169,5cyclictest252-21systemd-journal22:36:133
3764400991612,3cyclictest4017021-21ntp_kernel_err23:10:213
3764400991612,3cyclictest3908717-21kworker/u8:2+flush-259:021:25:253
3764400991612,3cyclictest252-21systemd-journal21:49:553
3764400991610,4cyclictest3826720-21kworker/u8:2+flush-259:020:20:193
3764396991614,1cyclictest0-21swapper/222:15:002
3764396991613,2cyclictest3898962-21cron21:20:002
376439299169,5cyclictest0-21swapper/119:30:001
3764392991614,1cyclictest3961156-21cron22:20:001
3764392991613,2cyclictest3899647-21irqcore21:20:161
3764392991611,3cyclictest252-21systemd-journal21:15:001
3764390991613,2cyclictest60350irq/132-enp0s29f1:rx-023:35:160
3764390991613,2cyclictest60350irq/132-enp0s29f1:rx-023:30:190
3764390991613,2cyclictest60350irq/132-enp0s29f1:rx-020:15:190
3764390991613,2cyclictest0-21swapper/022:40:000
3764390991613,2cyclictest0-21swapper/022:40:000
3764390991612,3cyclictest3878636-21apt-get21:00:120
3764390991612,3cyclictest252-21systemd-journal23:16:210
376440099159,5cyclictest4038072-21ntpq23:30:203
3764396991512,2cyclictest4075932-21cpuspeed_turbos00:10:132
3764396991512,2cyclictest4072924-21kthreadcore00:05:192
3764396991511,3cyclictest3956236-21kworker/u8:3+flush-259:022:35:202
3764396991511,3cyclictest3956236-21kworker/u8:3+flush-259:022:35:202
3764396991510,4cyclictest4002444-21latency_hist23:00:002
3764392991513,1cyclictest4023099-21cron23:20:001
3764390991514,1cyclictest60350irq/132-enp0s29f1:rx-023:41:360
3764390991514,1cyclictest60350irq/132-enp0s29f1:rx-022:10:240
3764390991513,2cyclictest60350irq/132-enp0s29f1:rx-022:16:310
3764390991513,2cyclictest60350irq/132-enp0s29f1:rx-019:51:230
3764390991513,1cyclictest60350irq/132-enp0s29f1:rx-023:11:020
3764390991513,1cyclictest60350irq/132-enp0s29f1:rx-022:40:180
3764390991513,1cyclictest60350irq/132-enp0s29f1:rx-021:33:530
3764390991513,1cyclictest0-21swapper/019:20:010
3764390991512,2cyclictest60350irq/132-enp0s29f1:rx-023:55:130
3764390991512,2cyclictest60350irq/132-enp0s29f1:rx-021:43:290
3764390991512,2cyclictest60350irq/132-enp0s29f1:rx-000:10:140
3764390991512,1cyclictest0-21swapper/020:40:000
3764390991510,4cyclictest3816163-21/usr/sbin/munin20:00:130
3764390991510,4cyclictest3816163-21/usr/sbin/munin20:00:130
376440099149,3cyclictest3769269-21kworker/u8:3+flush-259:019:15:063
376440099148,4cyclictest3749041-21kworker/u8:1+flush-259:019:30:243
376440099145,4cyclictest4012791-21awk23:10:003
376440099141,2cyclictest4060000-21awk23:55:013
3764400991412,1cyclictest834-21snmpd23:04:523
3764400991411,2cyclictest3824080-21tr20:05:183
3764400991411,2cyclictest3779814-21idleruntime-cro19:25:013
376440099141,11cyclictest3868040-21awk20:50:003
3764400991410,2cyclictest0-21swapper/323:00:013
3764400991410,2cyclictest0-21swapper/321:00:173
3764400991410,2cyclictest0-21swapper/320:15:003
3764396991411,2cyclictest4034213-21cpuspeed_turbos23:30:132
3764396991411,2cyclictest3905404-21kthreadcore21:25:182
3764396991411,2cyclictest3749041-21kworker/u8:1+flush-259:019:15:012
376439299149,4cyclictest4054839-21latency_hist23:50:021
376439299149,4cyclictest3919799-21apt-get21:40:131
376439299148,4cyclictest252-21systemd-journal20:55:001
3764392991412,1cyclictest4075508-21cron00:09:591
3764392991411,2cyclictest4010165-21kthreadcore23:05:191
3764392991410,3cyclictest3965432-21ntp_kernel_err22:20:221
3764390991413,1cyclictest60350irq/132-enp0s29f1:rx-023:45:140
3764390991412,1cyclictest60350irq/132-enp0s29f1:rx-023:05:240
3764390991412,1cyclictest60350irq/132-enp0s29f1:rx-022:56:560
3764390991412,1cyclictest60350irq/132-enp0s29f1:rx-022:54:340
3764390991412,1cyclictest60350irq/132-enp0s29f1:rx-022:45:240
3764390991412,1cyclictest60350irq/132-enp0s29f1:rx-022:33:030
3764390991412,1cyclictest60350irq/132-enp0s29f1:rx-021:55:260
3764390991412,1cyclictest60350irq/132-enp0s29f1:rx-021:35:150
3764390991412,1cyclictest60350irq/132-enp0s29f1:rx-021:05:210
3764390991412,1cyclictest60350irq/132-enp0s29f1:rx-020:50:260
3764390991412,1cyclictest60350irq/132-enp0s29f1:rx-019:40:140
3764390991412,1cyclictest60350irq/132-enp0s29f1:rx-019:28:310
3764390991411,2cyclictest60350irq/132-enp0s29f1:rx-021:45:030
3764390991411,2cyclictest60350irq/132-enp0s29f1:rx-000:05:140
3764390991411,2cyclictest3837215-21kworker/u8:3+flush-259:020:40:220
376440099138,3cyclictest4033416-21latency_hist23:30:013
376440099138,3cyclictest3992148-21latency_hist22:50:003
376440099137,4cyclictest252-21systemd-journal20:20:003
376440099134,6cyclictest252-21systemd-journal00:04:593
3764400991310,2cyclictest3950400-21unixbench_singl22:05:263
376439699139,3cyclictest4023139-21kworker/u8:1+flush-259:023:30:002
376439699139,3cyclictest3826720-21kworker/u8:2+flush-259:020:20:532
3764396991310,2cyclictest3822002-21fschecks_time20:05:152
3764396991310,2cyclictest0-21swapper/200:24:592
376439299138,4cyclictest3935450-21diskstats21:55:151
3764392991311,1cyclictest4091694-21irqcore00:25:171
3764392991310,2cyclictest4034066-21kworker/u8:0+flush-259:023:51:281
376439099139,3cyclictest252-21systemd-journal19:12:560
376439099139,2cyclictest0-21swapper/021:10:170
376439099138,3cyclictest4033862-21gpgv23:30:010
3764390991312,1cyclictest60350irq/132-enp0s29f1:rx-019:20:340
3764390991311,2cyclictest60350irq/132-enp0s29f1:rx-000:36:240
3764390991311,1cyclictest3830859-21needreboot20:10:210
3764390991310,2cyclictest60350irq/132-enp0s29f1:rx-023:20:160
3764390991310,2cyclictest60350irq/132-enp0s29f1:rx-021:20:120
3764390991310,2cyclictest3800765-21cpuspeed_turbos19:45:140
3764390991310,2cyclictest3785276-21cpuspeed_turbos19:30:120
3764390991310,2cyclictest0-21swapper/000:34:590
376440099129,1cyclictest0-21swapper/319:55:123
376440099128,3cyclictest3919764-21kworker/u8:4+flush-259:022:02:263
376440099128,2cyclictest0-21swapper/319:25:193
376440099127,3cyclictest4034066-21kworker/u8:0+flush-259:023:40:143
376440099127,3cyclictest3800352-21kworker/u8:3+flush-259:019:50:263
376440099126,4cyclictest252-21systemd-journal21:54:593
376440099125,4cyclictest4096166-21latency_hist00:30:003
376439699129,2cyclictest4013468-21irqcore23:10:162
376439699129,2cyclictest3909680-21fschecks_count21:30:162
376439699129,2cyclictest0-21swapper/222:00:002
376439699128,2cyclictest0-21swapper/220:10:212
376439699121,9cyclictest3997289-21awk22:55:012
376439699120,10cyclictest3919547-21awk21:40:002
376439299129,2cyclictest4081351-21sed00:15:151
376439299129,2cyclictest3924984-21apt-get21:45:111
376439299129,2cyclictest3914835-21fschecks_count21:35:161
376439299129,2cyclictest3882686-21ntp_offset21:00:231
376439299129,2cyclictest0-21swapper/119:50:001
376439299127,4cyclictest3898960-21latency_hist21:20:011
376439099129,2cyclictest60350irq/132-enp0s29f1:rx-022:00:140
376440099118,2cyclictest4085408-21unixbench_singl00:15:233
376439699119,1cyclictest0-21swapper/222:15:172
376439699119,1cyclictest0-21swapper/220:00:002
376439699118,2cyclictest4064390-21cut23:55:232
376439699118,2cyclictest3810284-21unixbench_multi19:50:262
376439299119,1cyclictest0-21swapper/121:05:231
376439299119,1cyclictest0-21swapper/100:24:591
376439299118,2cyclictest4002768-21cpuspeed_turbos23:00:141
376439299117,3cyclictest4096427-21apt-get00:30:141
376439299117,3cyclictest3836489-21kworker/u8:1+flush-259:020:20:261
376440099108,1cyclictest0-21swapper/319:35:153
376440099107,1cyclictest0-21swapper/323:25:003
376439699108,1cyclictest0-21swapper/200:00:192
376439699106,3cyclictest3857672-21kworker/u8:0+flush-259:020:50:102
376439699100,8cyclictest3929878-21idleruntime-cro21:49:592
376439699100,8cyclictest3852491-21basename20:35:002
376439299106,2cyclictest3980923-21ntpq22:35:221
376439299106,2cyclictest3980923-21ntpq22:35:211
37643969997,1cyclictest0-21swapper/221:50:142
37643969995,3cyclictest0-21swapper/223:05:142
37643969994,4cyclictest4044659-21sed23:40:012
37643969994,3cyclictest1-21systemd20:30:002
37643969990,8cyclictest3946823-21irqcore22:05:182
37643929996,2cyclictest3863322-21fschecks_time20:45:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional