You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 12:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sun Mar 29, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3859725994136,4cyclictest4021027-21gpgv21:45:010
3859725993732,3cyclictest4188390-21base6400:25:010
3859735993430,3cyclictest3974262-21kworker/u8:4+flush-259:021:55:163
3859735993430,3cyclictest3869709-21kworker/u8:1+flush-259:019:45:253
3859735993428,4cyclictest3999872-21apt-get21:25:013
3859725993431,2cyclictest4152334-21apt-get23:50:100
3859731993227,4cyclictest4100376-21cat23:00:022
3859729993228,3cyclictest4100543-21apt-get23:00:121
3859729993228,3cyclictest4032081-21kworker/u8:1+flush-259:022:10:191
3859725993229,2cyclictest4042900-21gpgv22:05:010
3859731993126,3cyclictest252-21systemd-journal21:35:202
3859725993128,2cyclictest3869709-21kworker/u8:1+flush-259:019:40:240
3859725993128,2cyclictest3869709-21kworker/u8:1+flush-259:019:40:240
3859729993025,3cyclictest4142102-21apt-get23:40:111
3859725993026,3cyclictest3859949-21apt-get19:10:110
3859735992925,3cyclictest1665514-21kworker/u8:3+flush-259:020:40:253
3859725992926,2cyclictest4042990-21kworker/u8:2+flush-259:022:35:160
3859735992723,3cyclictest3885721-21kworker/u8:4+flush-259:019:50:273
3859735992722,4cyclictest4177938-21latency_hist00:15:003
3859731992723,3cyclictest3953271-21apt-get20:40:132
3859731992720,5cyclictest3968625-21cat20:55:022
3859729992721,4cyclictest4032323-21apt-get21:55:131
3859735992622,3cyclictest4090203-21kworker/u8:2+events_unbound23:10:133
3859735992521,3cyclictest1665514-21kworker/u8:3+flush-259:020:15:183
3859731992522,2cyclictest3989773-21kworker/u8:0+flush-259:021:40:172
3859731992521,3cyclictest4120580-21kworker/u8:0+flush-259:023:20:292
3859731992520,4cyclictest5070-21gpgv00:34:592
3859729992521,3cyclictest4068767-21apt-get22:30:101
3859729992520,4cyclictest4167876-21apt-get00:05:111
3859725992522,2cyclictest4090203-21kworker/u8:2+events_unbound23:15:120
3859725992521,3cyclictest4042453-21gpgv22:05:000
3859725992520,4cyclictest9791-21ntpq00:35:230
3859725992520,4cyclictest4063346-21latency_hist22:25:010
3859735992420,3cyclictest4078847-21kworker/u8:3+flush-259:023:30:153
3859731992420,2cyclictest4162407-21kworker/u8:4+flush-259:000:09:592
3859725992421,2cyclictest4146999-21kworker/u8:2+events_unbound00:15:240
3859725992421,2cyclictest4146999-21kworker/u8:2+events_unbound00:15:230
3859735992320,2cyclictest3895838-21kworker/u8:0+events_unbound20:00:253
3859735992318,3cyclictest4194255-21diskstats00:30:143
3859725992320,2cyclictest3974262-21kworker/u8:4+flush-259:021:35:240
3859725992320,2cyclictest3885721-21kworker/u8:4+flush-259:020:10:260
3859725992319,3cyclictest3968468-21kworker/u8:0+events_unbound20:55:240
3859725992318,4cyclictest4094719-21latency_hist22:55:010
3859729992217,3cyclictest509-21rs:main1
3859729992217,3cyclictest252-21systemd-journal20:02:271
3859729992216,4cyclictest4173017-21apt-get00:10:121
3859729992216,4cyclictest4098944-21ntpq22:55:201
3859725992218,3cyclictest3869709-21kworker/u8:1+events_unbound19:45:130
385972599220,20cyclictest1-21systemd00:15:000
3859735992115,4cyclictest4188736-21cat00:25:013
3859731992116,4cyclictest3900975-21apt-get19:50:002
3859729992117,3cyclictest4120580-21kworker/u8:0+flush-259:023:55:261
3859729992114,5cyclictest4093804-21ntpq22:50:211
3859725992116,4cyclictest3979456-21apt-get21:05:110
3859735992016,3cyclictest4090203-21kworker/u8:2+flush-259:022:50:243
3859735992016,3cyclictest1665514-21kworker/u8:3+events_unbound21:15:013
3859735992015,3cyclictest252-21systemd-journal22:35:003
3859731992017,2cyclictest3974262-21kworker/u8:4+events_unbound21:20:152
3859729992014,4cyclictest252-21systemd-journal23:46:211
385972999201,13cyclictest4120829-21idleruntime-cro23:20:011
3859725992017,2cyclictest4032081-21kworker/u8:1+events_unbound22:15:120
3859725992017,2cyclictest3968468-21kworker/u8:0+events_unbound21:00:220
3859725992016,3cyclictest3974262-21kworker/u8:4+events_unbound21:20:220
3859725992016,3cyclictest252-21systemd-journal21:47:520
3859725992016,3cyclictest252-21systemd-journal21:47:510
3859735991916,2cyclictest4078847-21kworker/u8:3+events_unbound23:00:193
3859735991915,3cyclictest4032081-21kworker/u8:1+flush-259:022:15:173
3859735991914,3cyclictest4078847-21kworker/u8:3+flush-259:023:10:013
3859735991913,4cyclictest252-21systemd-journal19:29:193
3859729991915,3cyclictest1665514-21kworker/u8:3+flush-259:020:20:101
3859729991914,4cyclictest4043025-21apt-get22:05:121
3859729991914,4cyclictest3885721-21kworker/u8:4+flush-259:019:50:251
3859729991914,3cyclictest509-21rs:main1
3859725991916,2cyclictest4120580-21kworker/u8:0+flush-259:023:40:170
3859725991915,3cyclictest3932098-21kworker/u8:0+flush-259:020:25:260
3859725991915,3cyclictest3895838-21kworker/u8:0+events_unbound19:55:180
3859725991915,3cyclictest1665514-21kworker/u8:3+events_unbound21:10:130
3859735991815,2cyclictest4042990-21kworker/u8:2+flush-259:022:30:013
3859735991814,3cyclictest4146999-21kworker/u8:2+events_unbound00:35:173
3859735991813,4cyclictest4020911-21apt-get21:44:593
385973199183,8cyclictest4053068-21munin-plugin-st22:15:002
3859731991814,3cyclictest3974262-21kworker/u8:4+flush-259:021:55:252
3859731991814,3cyclictest3895838-21kworker/u8:0+flush-259:019:55:002
3859731991814,2cyclictest0-21swapper/223:15:002
3859731991813,4cyclictest4120580-21kworker/u8:0+events_unbound23:55:232
3859729991815,2cyclictest4187292-21ntp_kernel_err00:20:211
3859729991814,2cyclictest0-21swapper/121:55:001
3859729991812,4cyclictest4183055-21latency_hist00:20:011
3859729991812,4cyclictest4183055-21latency_hist00:20:001
3859729991812,4cyclictest3869099-21ntpq19:15:221
3859725991816,2cyclictest4078847-21kworker/u8:3+flush-259:023:28:220
3859725991816,1cyclictest3890636-21cron19:40:000
3859725991815,2cyclictest3989773-21kworker/u8:0+flush-259:021:35:010
3859725991815,2cyclictest3922048-21kworker/u8:1+flush-259:020:30:150
3859725991815,2cyclictest3885721-21kworker/u8:4+events_unbound19:50:190
3859725991815,2cyclictest3865534-21irqcore19:15:180
3859725991815,2cyclictest1665514-21kworker/u8:3+events_unbound20:05:000
3859725991814,3cyclictest4099861-21apt-get23:00:020
3859725991814,3cyclictest4078847-21kworker/u8:3+flush-259:023:08:060
3859725991814,3cyclictest3932098-21kworker/u8:0+flush-259:020:37:000
3859725991813,4cyclictest3932364-21latency_hist20:20:000
3859735991714,2cyclictest0-21swapper/322:25:003
3859735991713,3cyclictest4120580-21kworker/u8:0+events_unbound23:45:203
3859735991713,3cyclictest4057922-21kworker/u8:0+flush-259:022:45:213
3859735991713,3cyclictest3869709-21kworker/u8:1+flush-259:019:35:003
3859735991713,3cyclictest3854267-21kworker/u8:2+flush-259:019:10:163
3859731991714,2cyclictest4042990-21kworker/u8:2+flush-259:022:45:012
3859729991714,2cyclictest4057922-21kworker/u8:0+flush-259:022:45:251
3859729991710,5cyclictest4026518-21apt-get21:50:001
3859729991710,5cyclictest4026518-21apt-get21:49:591
3859725991715,2cyclictest4120580-21kworker/u8:0+events_unbound23:20:170
3859725991714,2cyclictest4162407-21kworker/u8:4+flush-259:000:05:230
3859725991714,2cyclictest3869709-21kworker/u8:1+events_unbound19:20:190
3859725991713,3cyclictest4042990-21kworker/u8:2+events_unbound22:13:190
3859725991713,3cyclictest3989773-21kworker/u8:0+events_unbound21:50:130
3859725991713,3cyclictest1665514-21kworker/u8:3+flush-259:020:20:230
3859725991711,5cyclictest3968446-21latency_hist20:55:010
3859735991613,2cyclictest1665514-21kworker/u8:3+events_unbound20:20:203
3859735991612,3cyclictest3989773-21kworker/u8:0+events_unbound21:25:223
3859735991612,3cyclictest3932098-21kworker/u8:0+events_unbound20:35:153
385973199161,9cyclictest3963317-21munin-run20:50:002
3859731991612,3cyclictest3854267-21kworker/u8:2+flush-259:019:10:202
3859731991611,4cyclictest4057922-21kworker/u8:0+flush-259:022:45:242
385973199161,13cyclictest4136612-21awk23:35:002
3859731991610,4cyclictest252-21systemd-journal22:09:182
3859729991612,2cyclictest0-21swapper/119:50:001
3859725991613,2cyclictest60350irq/132-enp0s29f1:rx-023:10:590
3859725991613,2cyclictest4078847-21kworker/u8:3+events_unbound22:45:130
3859725991613,2cyclictest3974262-21kworker/u8:4+events_unbound21:55:210
3859725991612,3cyclictest4146999-21kworker/u8:2+events_unbound00:25:180
3859725991612,3cyclictest4120580-21kworker/u8:0+events_unbound23:45:240
3859725991612,3cyclictest3974262-21kworker/u8:4+events_unbound21:15:250
3859725991612,3cyclictest3922048-21kworker/u8:1+events_unbound20:45:170
3859725991612,3cyclictest3869709-21kworker/u8:1+flush-259:019:25:150
3859725991610,4cyclictest3917152-21apt-get20:05:120
3859735991512,2cyclictest4182800-21kworker/u8:1+flush-259:000:18:213
3859735991512,2cyclictest4182800-21kworker/u8:1+flush-259:000:18:213
3859735991512,2cyclictest4120580-21kworker/u8:0+flush-259:023:40:183
3859735991512,2cyclictest3989773-21kworker/u8:0+events_unbound22:02:553
3859735991512,2cyclictest3869709-21kworker/u8:1+events_unbound19:40:133
3859735991512,2cyclictest3869709-21kworker/u8:1+events_unbound19:40:133
3859735991512,2cyclictest3854267-21kworker/u8:2+flush-259:019:15:183
3859735991511,3cyclictest4136944-21apt-get23:35:123
3859735991511,3cyclictest4042990-21kworker/u8:2+flush-259:022:05:193
3859735991511,3cyclictest1665514-21kworker/u8:3+flush-259:019:35:163
385973199154,6cyclictest4094724-21munin-run22:55:012
3859731991513,1cyclictest4110545-21cron23:10:012
3859731991512,2cyclictest4064626-21kthreadcore22:25:182
3859731991511,3cyclictest4162407-21kworker/u8:4+events_unbound00:00:232
3859731991511,3cyclictest4042990-21kworker/u8:2+flush-259:022:35:002
3859731991511,3cyclictest4042341-21apt-get22:04:592
3859731991510,3cyclictest1665514-21kworker/u8:3+flush-259:021:10:162
3859729991512,2cyclictest507-21in:imuxsock21:14:591
3859729991511,3cyclictest3922295-21apt-get20:10:141
3859729991511,3cyclictest252-21systemd-journal20:42:281
3859729991510,4cyclictest3989773-21kworker/u8:0+flush-259:021:25:201
3859725991513,1cyclictest60350irq/132-enp0s29f1:rx-022:34:030
3859725991513,1cyclictest60350irq/132-enp0s29f1:rx-020:40:150
3859725991513,1cyclictest60350irq/132-enp0s29f1:rx-000:00:240
3859725991512,2cyclictest60350irq/132-enp0s29f1:rx-023:30:230
3859725991512,2cyclictest60350irq/132-enp0s29f1:rx-022:25:230
3859725991512,2cyclictest60350irq/132-enp0s29f1:rx-021:25:210
385973599149,3cyclictest252-21systemd-journal23:30:003
3859735991411,2cyclictest4162407-21kworker/u8:4+flush-259:000:05:133
3859735991411,2cyclictest4136909-21kworker/u8:1+flush-259:023:59:593
3859735991411,2cyclictest4078847-21kworker/u8:3+events_unbound22:45:013
3859735991411,2cyclictest3974262-21kworker/u8:4+flush-259:021:45:193
3859735991411,2cyclictest3974262-21kworker/u8:4+flush-259:021:45:183
3859735991411,2cyclictest3932098-21kworker/u8:0+flush-259:020:25:153
3859735991411,2cyclictest3922048-21kworker/u8:1+events_unbound20:10:193
3859735991411,2cyclictest0-21swapper/321:05:013
3859735991410,3cyclictest3979431-21/usr/sbin/munin21:05:193
3859731991411,2cyclictest4182800-21kworker/u8:1+flush-259:000:40:002
3859731991410,3cyclictest4078847-21kworker/u8:3+flush-259:023:35:132
3859731991410,2cyclictest3867855-21kthreadcore19:15:192
385972999149,4cyclictest2971-21cron22:20:001
385972999148,1cyclictest0-21swapper/121:35:001
3859725991412,1cyclictest60350irq/132-enp0s29f1:rx-023:55:260
3859725991412,1cyclictest60350irq/132-enp0s29f1:rx-022:55:160
3859725991411,2cyclictest60350irq/132-enp0s29f1:rx-022:43:290
3859725991410,3cyclictest3880535-21kworker/u8:0+flush-259:019:30:160
385973599139,3cyclictest4090203-21kworker/u8:2+events_unbound23:15:153
385973599139,3cyclictest3989773-21kworker/u8:0+flush-259:021:50:153
385973599139,3cyclictest3895838-21kworker/u8:0+flush-259:019:55:243
385973599139,3cyclictest252-21systemd-journal21:19:593
3859735991311,1cyclictest4078819-21munin-plugin-st22:40:003
3859735991310,2cyclictest3974262-21kworker/u8:4+flush-259:021:35:213
3859735991310,2cyclictest3922048-21kworker/u8:1+events_unbound20:30:203
385973199139,2cyclictest3983498-21ntp_kernel_pll_21:05:222
385973199138,3cyclictest3936622-21sshd20:20:192
385973199137,4cyclictest252-21systemd-journal21:29:592
385973199136,5cyclictest4020911-21apt-get21:45:012
385973199136,5cyclictest4020911-21apt-get21:45:012
3859731991310,2cyclictest4058847-21irqcore22:20:142
3859731991310,2cyclictest3895838-21kworker/u8:0+flush-259:019:55:152
385972999139,3cyclictest4136279-21gpgv23:35:001
385972999138,3cyclictest252-21systemd-journal21:03:191
385972999136,4cyclictest3984357-21latency_hist21:10:011
3859729991310,2cyclictest3872537-21kthreadcore19:20:171
3859729991310,2cyclictest0-21swapper/123:25:011
385972599139,3cyclictest4078847-21kworker/u8:3+events_unbound23:35:000
3859725991311,1cyclictest60350irq/132-enp0s29f1:rx-000:30:160
385973599129,2cyclictest4078847-21kworker/u8:3+events_unbound22:55:163
385973599129,2cyclictest3963699-21cpuspeed_turbos20:50:123
385973599129,2cyclictest3922048-21kworker/u8:1+flush-259:020:45:213
385973599129,2cyclictest1665514-21kworker/u8:3+flush-259:020:05:203
385973599128,3cyclictest4136909-21kworker/u8:1+flush-259:023:50:163
385973599128,3cyclictest3989773-21kworker/u8:0+flush-259:021:30:043
3859735991210,1cyclictest0-21swapper/319:20:173
385973199129,2cyclictest4177516-21unixbench_singl00:10:252
385973199129,2cyclictest3992094-21kthreadcore21:15:192
385973199129,2cyclictest3948175-21cpuspeed_turbos20:35:122
385973199129,2cyclictest3922363-21cpuspeed_turbos20:10:152
385973199128,3cyclictest4126264-21apt-get23:25:102
385973199128,3cyclictest3895838-21kworker/u8:0+flush-259:020:00:202
385973199128,3cyclictest3869709-21kworker/u8:1+flush-259:019:20:212
3859731991210,1cyclictest0-21swapper/223:00:012
385972999129,2cyclictest4162713-21cpuspeed_turbos00:00:141
385972999127,4cyclictest3880543-21/usr/sbin/munin19:30:181
385972999126,4cyclictest513-21gdbus23:15:001
385973599118,2cyclictest4120580-21kworker/u8:0+events_unbound23:20:203
385973199119,1cyclictest3927925-21tr20:15:172
385973199118,2cyclictest3885066-21unixbench_singl19:30:242
385973199118,1cyclictest0-21swapper/222:35:242
385973199117,3cyclictest4032081-21kworker/u8:1+flush-259:022:15:172
385973199115,4cyclictest513-21gdbus23:50:002
385973199115,4cyclictest252-21systemd-journal00:15:212
385973199115,4cyclictest252-21systemd-journal00:15:202
385972999119,1cyclictest0-21swapper/120:35:131
385972999117,3cyclictest4130949-21journal-offline23:27:541
385972999117,2cyclictest0-21swapper/121:45:001
385972999116,3cyclictest3910861-21ntpq19:55:251
385972999115,4cyclictest252-21systemd-journal23:35:221
385972999111,8cyclictest4063354-21awk22:25:011
385973199108,1cyclictest4142301-21fschecks_count23:40:122
385973199107,1cyclictest0-21swapper/200:20:172
385972999107,2cyclictest4188976-21cpuspeed_turbos00:25:131
385972999107,1cyclictest0-21swapper/120:50:131
385972999106,3cyclictest3993760-21ntp_kernel_err21:15:221
38597299991,6cyclictest4083982-21awk22:45:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional