You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-15 - 10:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Mon Jun 15, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2013909994741,4cyclictest335557-21systemd-journal20:25:001
2013910994440,2cyclictest2288292-21gpgv23:35:002
2013907993833,4cyclictest2071182-21diskstats20:05:150
2013909993733,3cyclictest2314597-21kworker/u8:3+flush-259:000:05:001
2013909993528,5cyclictest335557-21systemd-journal22:45:001
2013909993428,4cyclictest2142527-21ntpq21:10:221
2013910993327,4cyclictest2200658-21latency_hist22:10:012
2013909993227,4cyclictest335557-21systemd-journal23:09:341
2013909993127,3cyclictest2236915-21apt-get22:45:111
2013909993027,2cyclictest2081486-21kworker/u8:3+flush-259:020:17:131
2013909993026,3cyclictest2054882-21kworker/u8:0+flush-259:019:55:261
2013910992924,3cyclictest335557-21systemd-journal22:59:332
2013907992922,5cyclictest2349646-21ntpq00:30:210
2013915992823,3cyclictest2262651-21apt-get23:10:093
2013910992824,3cyclictest2054882-21kworker/u8:0+flush-259:019:55:252
2013909992824,3cyclictest2159597-21kworker/u8:0+flush-259:022:35:161
2013909992824,3cyclictest1971476-21kworker/u8:3+flush-259:019:25:221
2013907992824,3cyclictest2159543-21cat21:30:010
2013915992721,4cyclictest335557-21systemd-journal22:00:013
2013909992723,3cyclictest2272977-21apt-get23:20:101
2013909992723,3cyclictest2138214-21kworker/u8:0+flush-259:021:25:011
2013907992722,4cyclictest2204980-21ntpq22:10:210
2013907992721,4cyclictest2292867-21ntpq23:35:200
2013910992620,4cyclictest2350536-21latency_hist00:35:012
2013907992622,3cyclictest2055516-21apt-get19:50:110
2013907992613,12cyclictest2247413-21fschecks_count22:55:140
2013910992522,2cyclictest2180310-21kworker/u8:3+flush-259:021:55:012
2013910992519,4cyclictest2050051-21latency_hist19:45:002
2013907992521,3cyclictest2092059-21kworker/u8:2+flush-259:020:34:590
2013915992421,2cyclictest2159597-21kworker/u8:0+flush-259:022:20:253
2013910992420,3cyclictest2309437-21/usr/sbin/munin23:55:152
2013909992421,2cyclictest2309237-21kworker/u8:2+flush-259:000:15:251
2013907992418,4cyclictest509-21rs:main0
2013915992319,3cyclictest2257271-21kworker/u8:0+flush-259:000:09:593
2013910992319,3cyclictest2231536-21kworker/u8:2+flush-259:023:10:222
2013910992319,3cyclictest2081486-21kworker/u8:3+events_unbound20:15:192
2013910992317,4cyclictest2210969-21latency_hist22:20:012
2013909992319,3cyclictest2314597-21kworker/u8:3+flush-259:000:30:011
2013909992319,3cyclictest2159597-21kworker/u8:0+flush-259:021:50:261
2013909992318,4cyclictest2215221-21ntpq22:20:211
2013909992318,3cyclictest2024454-21/usr/sbin/munin19:20:251
201390799239,2cyclictest2028957-21unixbench_singl19:20:250
2013907992310,1cyclictest0-21swapper/021:30:000
2013915992216,4cyclictest2060430-21latency_hist19:55:013
2013915992215,5cyclictest2169666-21latency_hist21:40:003
2013910992217,3cyclictest2086929-21apt-get20:20:112
2013909992217,4cyclictest2257271-21kworker/u8:0+events_unbound23:40:181
2013909992217,3cyclictest509-21rs:main1
2013907992217,4cyclictest2271794-21ntpq23:15:200
2013907992216,4cyclictest335557-21systemd-journal22:54:590
2013915992118,2cyclictest2054882-21kworker/u8:0+flush-259:020:00:173
2013915992117,3cyclictest2299129-21kworker/u8:4+flush-259:023:50:173
2013915992117,3cyclictest2111465-21kworker/u8:3+flush-259:020:50:253
2013909992117,3cyclictest335557-21systemd-journal19:38:341
2013909992117,3cyclictest1971476-21kworker/u8:3+flush-259:019:15:251
2013907992114,5cyclictest2054325-21ntpq19:45:210
2013907992113,6cyclictest2256317-21ntpq23:00:200
201391099207,6cyclictest2133061-21awk21:04:592
2013910992017,2cyclictest0-21swapper/219:35:002
2013910992016,3cyclictest2122934-21kworker/u8:4+flush-259:021:05:252
2013909992016,2cyclictest2180310-21kworker/u8:3+events_unbound22:05:011
2013909992013,5cyclictest2096130-21ntpq20:25:221
2013907992018,1cyclictest2143374-21kworker/u8:5+flush-259:022:15:170
2013907992015,3cyclictest2294002-21apt-get23:40:120
2013907992013,5cyclictest335557-21systemd-journal22:35:010
2013915991916,2cyclictest2314597-21kworker/u8:3+flush-259:000:40:013
2013915991914,3cyclictest2117565-21kworker/u8:1+flush-259:021:15:263
2013909991916,2cyclictest2309237-21kworker/u8:2+events_unbound00:10:251
2013909991914,4cyclictest2122934-21kworker/u8:4+flush-259:020:55:171
2013907991913,4cyclictest335557-21systemd-journal19:57:020
2013907991912,6cyclictest60350irq/132-enp0s29f1:rx-021:00:130
2013907991910,3cyclictest60350irq/132-enp0s29f1:rx-021:00:010
201391599180,16cyclictest335557-21systemd-journal23:40:003
201391099184,6cyclictest2277861-21awk23:25:002
2013910991815,2cyclictest0-21swapper/200:40:002
2013910991814,3cyclictest2159597-21kworker/u8:0+flush-259:022:00:252
2013910991814,2cyclictest2075886-21sh20:10:012
2013909991815,2cyclictest2092059-21kworker/u8:2+events_unbound20:30:221
2013909991814,3cyclictest1971476-21kworker/u8:3+flush-259:019:10:151
2013909991813,3cyclictest490-21dbus-daemon23:35:001
2013915991714,2cyclictest2019071-21kworker/u8:1+flush-259:019:40:163
2013915991713,3cyclictest2309237-21kworker/u8:2+flush-259:000:10:263
2013915991713,3cyclictest2247216-21apt-get22:55:123
2013915991711,4cyclictest2091825-21latency_hist20:25:023
2013910991715,1cyclictest0-21swapper/200:30:002
2013910991714,2cyclictest2159597-21kworker/u8:0+flush-259:022:45:212
2013909991715,1cyclictest2346044-21irqcore00:30:151
2013909991714,1cyclictest1-21systemd23:01:341
2013909991713,2cyclictest2046157-21kthreadcore19:40:161
2013907991713,3cyclictest60350irq/132-enp0s29f1:rx-019:30:130
2013907991712,4cyclictest60350irq/132-enp0s29f1:rx-000:11:420
2013907991712,3cyclictest2039715-21kworker/u8:2+flush-259:020:10:160
2013915991611,3cyclictest2159060-21gpgv21:30:013
2013910991613,2cyclictest2118219-21irqcore20:50:162
2013910991613,2cyclictest2060428-21sh19:55:012
2013907991614,1cyclictest60350irq/132-enp0s29f1:rx-019:35:170
2013907991613,2cyclictest60350irq/132-enp0s29f1:rx-023:20:160
2013907991613,2cyclictest60350irq/132-enp0s29f1:rx-023:05:230
2013907991613,2cyclictest60350irq/132-enp0s29f1:rx-022:07:030
2013907991613,2cyclictest60350irq/132-enp0s29f1:rx-022:02:300
2013907991613,2cyclictest60350irq/132-enp0s29f1:rx-021:45:200
2013907991613,2cyclictest60350irq/132-enp0s29f1:rx-021:36:460
2013907991613,2cyclictest60350irq/132-enp0s29f1:rx-020:35:180
2013907991613,2cyclictest60350irq/132-enp0s29f1:rx-020:00:190
2013907991611,4cyclictest335557-21systemd-journal21:57:230
2013907991611,1cyclictest60350irq/132-enp0s29f1:rx-021:12:010
2013915991512,2cyclictest2231536-21kworker/u8:2+flush-259:022:55:003
2013915991511,3cyclictest2092059-21kworker/u8:2+flush-259:020:45:243
2013915991511,3cyclictest2054882-21kworker/u8:0+flush-259:019:55:203
2013915991510,4cyclictest335557-21systemd-journal19:31:343
2013910991512,2cyclictest2231536-21kworker/u8:2+events_unbound23:00:192
2013910991512,2cyclictest2223770-21tr22:30:202
2013910991511,3cyclictest2299129-21kworker/u8:4+flush-259:023:50:202
2013910991511,3cyclictest2039715-21kworker/u8:2+flush-259:019:35:182
2013909991513,1cyclictest509-21rs:main1
2013909991513,1cyclictest0-21swapper/100:10:001
2013909991512,2cyclictest2117565-21kworker/u8:1+events_unbound21:15:231
2013909991511,3cyclictest2107528-21apt-get20:40:121
2013909991511,3cyclictest2039930-21kworker/u8:4+flush-259:019:45:181
2013907991513,1cyclictest60350irq/132-enp0s29f1:rx-023:50:240
2013907991513,1cyclictest60350irq/132-enp0s29f1:rx-023:30:040
2013907991513,1cyclictest60350irq/132-enp0s29f1:rx-021:50:280
2013907991513,1cyclictest60350irq/132-enp0s29f1:rx-021:44:320
2013907991513,1cyclictest60350irq/132-enp0s29f1:rx-020:15:150
2013907991513,1cyclictest60350irq/132-enp0s29f1:rx-019:40:220
2013907991512,2cyclictest61150irq/133-enp0s29f1:tx-020:45:210
2013907991512,2cyclictest60350irq/132-enp0s29f1:rx-023:25:230
2013907991512,2cyclictest60350irq/132-enp0s29f1:rx-023:11:360
2013907991512,2cyclictest60350irq/132-enp0s29f1:rx-021:15:170
2013907991512,2cyclictest60350irq/132-enp0s29f1:rx-019:10:100
2013915991411,1cyclictest0-21swapper/320:10:013
201391099149,3cyclictest335557-21systemd-journal19:21:552
201391099147,5cyclictest0-21swapper/219:30:002
2013910991411,2cyclictest2092059-21kworker/u8:2+flush-259:020:45:002
2013910991411,2cyclictest0-21swapper/221:40:002
2013910991410,3cyclictest2314597-21kworker/u8:3+flush-259:000:00:272
2013910991410,2cyclictest507-21in:imuxsock21:50:002
2013909991412,2cyclictest2019071-21kworker/u8:1+events_unbound19:30:211
2013909991412,1cyclictest0-21swapper/121:30:161
2013909991411,2cyclictest2180310-21kworker/u8:3+flush-259:021:55:241
201390999141,11cyclictest509-21rs:main1
2013909991410,3cyclictest2133313-21apt-get21:05:121
2013909991410,3cyclictest2092059-21kworker/u8:2+events_unbound20:45:181
2013907991412,1cyclictest60350irq/132-enp0s29f1:rx-020:50:250
2013907991412,1cyclictest60350irq/132-enp0s29f1:rx-020:20:230
2013907991412,1cyclictest60350irq/132-enp0s29f1:rx-000:37:040
2013907991412,1cyclictest60350irq/132-enp0s29f1:rx-000:02:310
2013907991412,1cyclictest0-21swapper/022:25:000
2013907991411,2cyclictest60350irq/132-enp0s29f1:rx-023:55:120
2013907991411,2cyclictest60350irq/132-enp0s29f1:rx-022:37:590
2013907991411,2cyclictest60350irq/132-enp0s29f1:rx-022:25:050
2013907991411,2cyclictest60350irq/132-enp0s29f1:rx-021:20:150
2013907991411,2cyclictest60350irq/132-enp0s29f1:rx-021:08:080
2013907991411,2cyclictest60350irq/132-enp0s29f1:rx-019:19:290
2013907991411,2cyclictest60350irq/132-enp0s29f1:rx-000:25:130
2013915991311,1cyclictest0-21swapper/319:35:183
2013915991310,2cyclictest2314364-21sh00:00:003
2013915991310,2cyclictest0-21swapper/323:20:003
201391099139,3cyclictest2257271-21kworker/u8:0+flush-259:000:25:012
201391099139,3cyclictest2231536-21kworker/u8:2+flush-259:023:45:002
201391099138,3cyclictest2231536-21kworker/u8:2+flush-259:023:40:002
201391099135,6cyclictest2070762-21idleruntime-cro20:05:012
2013910991311,1cyclictest0-21swapper/223:50:002
2013910991311,1cyclictest0-21swapper/221:25:242
2013910991310,2cyclictest2325021-21cpuspeed_turbos00:10:142
2013910991310,2cyclictest2230588-21ntp_kernel_pll_22:35:202
2013910991310,2cyclictest2019453-21cpuspeed_turbos19:15:122
2013910991310,1cyclictest0-21swapper/221:45:002
201390999139,3cyclictest2278115-21apt-get23:25:111
2013909991310,2cyclictest2309237-21kworker/u8:2+flush-259:000:00:001
2013909991310,2cyclictest2308299-21ntp_kernel_pll_23:50:211
2013909991310,2cyclictest2168797-21ntp_kernel_pll_21:35:231
2013907991311,2cyclictest61150irq/133-enp0s29f1:tx-000:05:140
2013907991311,2cyclictest60350irq/132-enp0s29f1:rx-020:40:040
2013907991311,1cyclictest60350irq/132-enp0s29f1:rx-022:45:240
2013907991311,1cyclictest60350irq/132-enp0s29f1:rx-020:25:160
2013907991311,1cyclictest60350irq/132-enp0s29f1:rx-019:25:140
2013907991311,1cyclictest60350irq/132-enp0s29f1:rx-000:20:260
201391599129,2cyclictest2133722-21irqcore21:05:163
2013915991210,1cyclictest2288306-21apt-config23:35:003
2013915991210,1cyclictest0-21swapper/322:15:013
201391099129,2cyclictest2231926-21fschecks_count22:40:132
201391099129,2cyclictest2039930-21kworker/u8:4+flush-259:019:45:232
201391099129,2cyclictest2019071-21kworker/u8:1+flush-259:020:35:262
201391099128,3cyclictest2231536-21kworker/u8:2+flush-259:022:55:002
201391099123,2cyclictest191rcu_preempt00:10:002
2013910991210,1cyclictest2076992-21irqcore20:10:152
201390999129,2cyclictest2060442-21idleruntime-cro19:55:001
201390999128,3cyclictest2054882-21kworker/u8:0+events_unbound20:05:231
201390999127,3cyclictest2272448-21cron23:17:011
201390999126,4cyclictest335557-21systemd-journal23:50:001
201390999126,4cyclictest335557-21systemd-journal00:40:001
201391599119,1cyclictest0-21swapper/320:15:183
201391599118,2cyclictest2206197-21cpuspeed_turbos22:15:123
201391599118,2cyclictest2123679-21irqcore20:55:173
201391599118,2cyclictest2092215-21cpuspeed_turbos20:25:133
201391599118,2cyclictest0-21swapper/323:20:203
201391599117,3cyclictest491ktimers/323:00:113
201391599117,3cyclictest2159597-21kworker/u8:0+flush-259:022:30:263
201391099119,1cyclictest0-21swapper/219:10:012
201391099118,2cyclictest2162105-21kthreadcore21:30:172
201391099118,2cyclictest2123390-21sed20:55:172
201391099118,2cyclictest2117081-21unixbench_multi20:45:242
201391099118,2cyclictest2092059-21kworker/u8:2+flush-259:020:25:212
201391099117,3cyclictest2309237-21kworker/u8:2+flush-259:000:15:182
201390999119,1cyclictest0-21swapper/120:50:221
201390999118,1cyclictest0-21swapper/121:25:191
201390999116,3cyclictest335557-21systemd-journal20:38:341
201390799119,2cyclictest60350irq/132-enp0s29f1:rx-023:47:040
201390799118,2cyclictest60350irq/132-enp0s29f1:rx-022:40:120
201391599108,1cyclictest0-21swapper/321:40:143
201391599108,1cyclictest0-21swapper/320:30:173
201391599107,2cyclictest2019387-21cpuspeed_turbos19:15:123
201391599105,4cyclictest2175442-21perl21:45:153
201391099106,2cyclictest2215183-21ntpq22:20:212
201390999107,2cyclictest2334733-21kworker/u8:1+flush-259:000:20:181
201390999106,3cyclictest2263666-21kthreadcore23:10:161
20139159997,1cyclictest0-21swapper/322:47:343
20139159996,1cyclictest0-21swapper/300:30:173
20139159990,8cyclictest2133224-21cat21:05:013
20139109996,2cyclictest2278221-21cpuspeed_turbos23:25:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional