You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 05:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Wed Mar 11, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
700219994639,5cyclictest252-21systemd-journal20:40:002
700219993934,3cyclictest996217-21latency_hist23:55:012
700219993934,3cyclictest996217-21latency_hist23:55:002
700213993533,1cyclictest845218-21fwupd21:30:020
700223993428,4cyclictest903354-21diskstats22:25:123
700223993427,5cyclictest252-21systemd-journal21:30:003
700217993429,3cyclictest252-21systemd-journal21:10:171
700213993431,2cyclictest725908-21kworker/u8:0+flush-259:020:45:010
700217993125,4cyclictest736632-21latency_hist19:45:011
700223993026,3cyclictest762784-21kworker/u8:2+flush-259:021:20:003
700223992923,4cyclictest897305-21latency_hist22:20:013
700219992925,2cyclictest923654-21kworker/u8:2+flush-259:022:45:162
700217992922,5cyclictest855504-21latency_hist21:40:001
700219992823,3cyclictest944259-21kworker/u8:3+flush-259:000:00:012
700217992822,4cyclictest1006941-21latency_hist00:05:001
700219992724,2cyclictest762784-21kworker/u8:2+flush-259:021:00:002
700219992723,3cyclictest778256-21kworker/u8:3+flush-259:020:35:012
700217992723,3cyclictest913467-21kworker/u8:0+flush-259:000:05:171
700217992722,3cyclictest252-21systemd-journal21:19:591
700219992620,4cyclictest700135-21latency_hist19:10:012
700217992614,9cyclictest965607-21/usr/sbin/munin23:25:141
700213992623,2cyclictest944259-21kworker/u8:3+events_unbound23:40:160
700213992620,4cyclictest871484-21latency_hist21:55:010
700213992619,5cyclictest950070-21cp23:10:000
700213992522,2cyclictest913467-21kworker/u8:0+flush-259:022:45:170
700223992419,3cyclictest252-21systemd-journal22:10:003
700219992418,4cyclictest809079-21latency_hist20:55:002
70021399241,20cyclictest1-21systemd21:25:000
700223992320,2cyclictest710735-21apt-get19:20:123
700223992318,3cyclictest840023-21latency_hist21:25:003
700217992320,2cyclictest694595-21kworker/u8:0+flush-259:019:14:591
700213992317,4cyclictest850798-21diskstats21:35:140
700213992317,4cyclictest509-21rs:main0
700223992218,3cyclictest887203-21kworker/u8:1+flush-259:023:00:153
700223992218,3cyclictest509-21rs:main3
700219992219,2cyclictest725908-21kworker/u8:0+events_unbound19:45:212
700217992214,6cyclictest777366-21ntpq20:20:221
700213992219,2cyclictest1027569-21kworker/u8:0+flush-259:000:40:010
700213992218,3cyclictest840050-21kworker/u8:3+flush-259:021:45:000
700213992217,4cyclictest731560-21cat19:40:010
700223992118,2cyclictest871713-21kworker/u8:4+flush-259:022:05:003
700219992116,4cyclictest798797-21kworker/u8:1+flush-259:021:25:232
700217992117,3cyclictest944259-21kworker/u8:3+flush-259:023:45:001
700217992117,2cyclictest0-21swapper/122:45:001
700217992116,3cyclictest752707-21/usr/sbin/munin20:00:151
700217992112,7cyclictest0-21swapper/121:55:001
700219992014,4cyclictest252-21systemd-journal20:27:182
700217992015,3cyclictest509-21rs:main1
700217992013,6cyclictest0-21swapper/123:10:001
700213992016,3cyclictest1001474-21gpgv00:00:010
700213992014,4cyclictest980778-21latency_hist23:40:000
700213992014,4cyclictest823675-21ntpq21:05:210
700213992013,5cyclictest1021468-21ntpq00:15:210
700223991916,2cyclictest0-21swapper/300:25:003
700223991915,3cyclictest725908-21kworker/u8:0+events_unbound20:20:133
700223991914,3cyclictest252-21systemd-journal23:09:593
700219991916,2cyclictest949444-21grep23:10:002
700219991915,3cyclictest1001393-21kworker/u8:2+flush-259:000:17:132
700217991913,4cyclictest955031-21latency_hist23:15:001
700217991913,4cyclictest908085-21latency_hist22:30:011
700217991912,5cyclictest762784-21kworker/u8:2+flush-259:020:30:171
700217991911,6cyclictest252-21systemd-journal23:00:001
700213991915,3cyclictest881862-21kworker/u8:0+flush-259:022:20:000
700213991915,3cyclictest700403-21kworker/u8:1+flush-259:020:01:020
700213991913,4cyclictest747354-21kworker/u8:2+flush-259:020:00:000
700223991812,4cyclictest252-21systemd-journal21:05:003
700219991812,4cyclictest950097-21/usr/sbin/munin23:10:202
70021799185,11cyclictest513-21gdbus00:25:011
700217991815,2cyclictest975686-21sh23:34:591
700217991814,3cyclictest1032672-21idleruntime-cro00:30:001
700213991815,2cyclictest960201-21cron23:20:000
700213991814,3cyclictest778654-21diskstats20:25:120
700213991813,4cyclictest887203-21kworker/u8:1+flush-259:022:20:220
700223991713,3cyclictest871713-21kworker/u8:4+flush-259:021:55:263
700223991713,3cyclictest500-21systemd-logind20:00:003
700219991714,2cyclictest1-21systemd00:34:552
700219991712,3cyclictest866054-21base6421:50:002
700219991711,4cyclictest767955-21latency_hist20:15:012
70021799176,9cyclictest731041-21latency_hist19:40:001
70021799175,10cyclictest736973-21cpuspeed_turbos19:45:121
70021799171,4cyclictest845196-21/usr/sbin/munin21:30:001
70021799171,4cyclictest767948-21cron20:15:001
70021799171,4cyclictest1017222-21munin-plugin-st00:15:011
700217991713,3cyclictest1-21systemd21:20:171
700217991712,4cyclictest700403-21kworker/u8:1+flush-259:020:05:171
700217991712,4cyclictest509-21rs:main1
700217991710,5cyclictest252-21systemd-journal21:50:001
70021799170,5cyclictest1038981-21grep00:35:181
700213991714,2cyclictest991078-21unin-run23:50:010
700213991714,2cyclictest60350irq/132-enp0s29f1:rx-023:50:200
700213991714,2cyclictest60350irq/132-enp0s29f1:rx-023:50:200
700213991714,2cyclictest60350irq/132-enp0s29f1:rx-000:20:260
700213991713,3cyclictest944259-21kworker/u8:3+flush-259:023:05:220
70022399161,6cyclictest252-21systemd-journal22:50:003
700223991614,1cyclictest897979-21irqcore22:20:163
700223991613,2cyclictest725908-21kworker/u8:0+events_unbound20:35:183
700223991613,2cyclictest705318-21idleruntime-cro19:15:003
700223991613,1cyclictest0-21swapper/300:10:003
700223991612,3cyclictest923654-21kworker/u8:2+flush-259:022:55:233
700223991612,3cyclictest762784-21kworker/u8:2+flush-259:020:45:233
700219991614,1cyclictest0-21swapper/223:45:002
700219991613,2cyclictest1032692-21cut00:30:012
700219991612,3cyclictest902507-21apt-get22:25:002
700219991612,3cyclictest725908-21kworker/u8:0+events_unbound20:20:012
700219991611,3cyclictest252-21systemd-journal20:47:172
700219991610,4cyclictest824801-21/usr/sbin/munin21:10:142
700219991610,4cyclictest252-21systemd-journal19:53:192
70021799167,7cyclictest0-21swapper/122:15:171
70021799164,4cyclictest908994-21sed22:30:151
70021799161,4cyclictest976085-21tr23:35:131
70021799161,4cyclictest928005-21ps22:45:211
70021799161,4cyclictest778909-21ps20:25:141
70021799161,3cyclictest715141-21grep19:20:251
700217991613,2cyclictest961498-21kthreadcore23:20:161
70021799160,5cyclictest882514-21grep22:05:151
700213991613,2cyclictest908767-21irqcore22:30:150
700213991613,2cyclictest60350irq/132-enp0s29f1:rx-022:25:230
700213991613,2cyclictest60350irq/132-enp0s29f1:rx-021:25:200
700213991613,2cyclictest60350irq/132-enp0s29f1:rx-020:19:350
700213991613,2cyclictest60350irq/132-enp0s29f1:rx-000:00:230
700213991613,2cyclictest0-21swapper/019:40:000
700213991610,4cyclictest746493-21ntpq19:50:220
70022399159,4cyclictest986337-21diskstats23:45:133
700223991512,2cyclictest0-21swapper/323:35:173
700223991511,3cyclictest913467-21kworker/u8:0+flush-259:022:45:003
700223991511,2cyclictest720696-21kworker/u8:3+flush-259:019:50:173
700223991511,2cyclictest0-21swapper/300:00:003
700223991510,3cyclictest0-21swapper/321:45:003
70021799157,7cyclictest877071-21cpuspeed_turbos22:00:121
70021799155,8cyclictest0-21swapper/122:10:171
70021799151,4cyclictest1017769-21/usr/sbin/munin00:15:151
70021799151,2cyclictest752475-21cut20:00:001
70021799150,4cyclictest998199-21grep23:55:191
70021799150,4cyclictest991725-21grep23:50:151
70021799150,4cyclictest991725-21grep23:50:151
70021799150,4cyclictest939758-21irqcore23:00:151
70021799150,4cyclictest802620-21grep20:45:181
70021799150,4cyclictest773112-21idleruntime-cro20:20:001
70021799150,3cyclictest990405-21find23:45:241
70021799150,3cyclictest0-21swapper/120:35:211
70021399159,4cyclictest252-21systemd-journal19:20:170
700213991514,1cyclictest60350irq/132-enp0s29f1:rx-020:47:230
700213991513,1cyclictest60350irq/132-enp0s29f1:rx-022:35:250
700213991513,1cyclictest60350irq/132-enp0s29f1:rx-022:05:130
700213991513,1cyclictest60350irq/132-enp0s29f1:rx-000:30:090
700213991512,2cyclictest944259-21kworker/u8:3+flush-259:023:25:180
700213991512,2cyclictest60350irq/132-enp0s29f1:rx-022:55:150
700213991512,2cyclictest60350irq/132-enp0s29f1:rx-022:40:130
700213991511,3cyclictest252-21systemd-journal20:57:170
70022399149,4cyclictest944259-21kworker/u8:3+events_unbound23:25:173
70022399149,4cyclictest731255-21cp19:40:013
70022399140,6cyclictest8063171kthreadcore20:50:183
70021999148,4cyclictest509-21rs:main2
700219991411,2cyclictest970060-21unixbench_multi23:25:242
70021799141,3cyclictest955715-21irqcore23:15:161
70021799141,3cyclictest722785-21cat19:30:171
70021799140,3cyclictest821832-21kthreadcore21:05:171
70021799140,2cyclictest700215-21latency_hist19:10:011
70021799140,13cyclictest0-21swapper/122:35:131
700213991413,1cyclictest60350irq/132-enp0s29f1:rx-021:15:250
700213991413,1cyclictest60350irq/132-enp0s29f1:rx-019:45:230
700213991412,1cyclictest60350irq/132-enp0s29f1:rx-023:20:100
700213991412,1cyclictest60350irq/132-enp0s29f1:rx-023:00:140
700213991412,1cyclictest60350irq/132-enp0s29f1:rx-022:10:180
700213991412,1cyclictest60350irq/132-enp0s29f1:rx-021:55:160
700213991412,1cyclictest60350irq/132-enp0s29f1:rx-000:26:030
700213991412,1cyclictest60350irq/132-enp0s29f1:rx-000:10:130
700213991412,1cyclictest60350irq/132-enp0s29f1:rx-000:05:150
700213991412,1cyclictest0-21swapper/019:35:000
700213991411,2cyclictest61150irq/133-enp0s29f1:tx-019:10:180
700213991411,2cyclictest60350irq/132-enp0s29f1:rx-021:45:170
700213991411,2cyclictest60350irq/132-enp0s29f1:rx-020:31:030
700213991410,3cyclictest944259-21kworker/u8:3+flush-259:023:30:310
70022399138,3cyclictest1033208-21base6400:30:013
70022399137,4cyclictest757275-21sshd20:00:503
700223991311,1cyclictest0-21swapper/319:50:013
700223991311,1cyclictest0-21swapper/300:30:013
70022399131,10cyclictest985910-21awk23:45:003
700223991310,2cyclictest850809-21fschecks_count21:35:143
700223991310,2cyclictest715936-21cpuspeed_turbos19:25:123
700219991310,2cyclictest845527-21cpuspeed_turbos21:30:122
70021999130,7cyclictest824572-21idleruntime-cro21:10:002
700213991311,2cyclictest60350irq/132-enp0s29f1:rx-020:06:280
700213991311,1cyclictest60350irq/132-enp0s29f1:rx-021:13:590
700213991311,1cyclictest60350irq/132-enp0s29f1:rx-020:38:110
700213991310,2cyclictest60350irq/132-enp0s29f1:rx-019:15:240
700213991310,2cyclictest0-21swapper/021:05:000
70022399129,2cyclictest934031-21latency_hist22:55:013
70022399129,2cyclictest825231-21irqcore21:10:163
70022399129,2cyclictest778558-21cpuspeed_turbos20:25:113
70022399129,2cyclictest1038639-21cpuspeed_turbos00:35:133
70022399128,3cyclictest944259-21kworker/u8:3+flush-259:023:15:003
70022399126,4cyclictest700403-21kworker/u8:1+flush-259:019:40:163
70022399124,5cyclictest252-21systemd-journal20:45:013
700223991210,1cyclictest0-21swapper/300:05:013
70021999127,4cyclictest871747-21apt-get21:55:112
70021999127,3cyclictest252-21systemd-journal20:41:192
70021399129,2cyclictest60350irq/132-enp0s29f1:rx-022:00:110
70021399128,2cyclictest8041542sleep020:50:130
700213991211,1cyclictest60350irq/132-enp0s29f1:rx-020:20:390
70022399110,8cyclictest913246-21latency_hist22:35:013
70021999117,3cyclictest944259-21kworker/u8:3+flush-259:023:30:222
70021399118,2cyclictest60350irq/132-enp0s29f1:rx-019:25:190
70021999108,1cyclictest0-21swapper/223:15:182
70021999105,1cyclictest1027554-21munin-run00:25:002
70021999100,3cyclictest832-21runrttasks21:15:132
70021399107,1cyclictest763055-21apt-get20:10:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional