You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 16:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sat May 16, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
197998222090,4sleep30-21swapper/308:45:003
20572512760,3chrt75-21kworker/3:1+events10:00:573
20572512760,3chrt75-21kworker/3:1+events10:00:563
1883432996858,7cyclictest1929842-21latency_hist07:55:011
1883432996559,5cyclictest2154010-21kworker/u8:3+events_unbound11:56:061
1883432996456,6cyclictest1850527-21kworker/u8:3+flush-8:007:36:041
1883427996455,6cyclictest2094103-21latency_hist10:40:010
1883432996254,6cyclictest2114214-21kworker/u8:2+flush-8:012:11:021
21676172610,2sleep3481ktimers/311:51:013
1883432996156,4cyclictest1945186-21kworker/u8:3+flush-8:008:36:071
1883432996154,5cyclictest1945186-21kworker/u8:3+events_unbound09:46:031
1883427996054,4cyclictest1850527-21kworker/u8:3+flush-8:007:11:080
1883427996049,8cyclictest280-21systemd-journal08:40:010
21643762590,1chrt2163959-21/usr/sbin/munin11:50:541
1883427995950,7cyclictest280-21systemd-journal09:40:000
1883427995848,7cyclictest2174119-21diskstats12:00:520
1883432995650,4cyclictest2108969-21kworker/u8:0+events_unbound11:36:021
1883432995650,4cyclictest2094347-21kworker/u8:2+events_unbound10:51:021
1883432995649,6cyclictest2147989-21kworker/u8:1+flush-8:012:21:041
1883432995551,3cyclictest2094347-21kworker/u8:2+events_unbound10:41:071
1883432995550,4cyclictest2154010-21kworker/u8:3+flush-8:012:01:061
1883432995550,4cyclictest1945186-21kworker/u8:3+flush-8:009:16:061
1883432995550,4cyclictest1910743-21kworker/u8:1+flush-8:010:01:061
1883432995550,4cyclictest1910743-21kworker/u8:1+flush-8:010:01:051
1883432995550,4cyclictest1900387-21kworker/u8:2+flush-8:007:26:081
1883432995550,4cyclictest1850527-21kworker/u8:3+flush-8:007:41:071
1883435995348,3cyclictest1954861-21gpgv08:20:012
1883432995347,4cyclictest1945186-21kworker/u8:3+flush-8:009:50:551
1883432995345,6cyclictest2182612-21ntpq12:06:021
1883432995345,6cyclictest2182612-21ntpq12:06:021
1883427995347,4cyclictest1900387-21kworker/u8:2+flush-8:007:26:030
1883432995248,3cyclictest1930304-21kworker/u8:0+events_unbound09:10:531
1883432995247,3cyclictest1945186-21kworker/u8:3+events_unbound08:41:071
1883432995246,4cyclictest1945186-21kworker/u8:3+events_unbound08:26:041
1883432995245,6cyclictest2049629-21kworker/u8:2+flush-8:009:56:051
1883432995243,6cyclictest2208408-21latency_hist12:35:011
1883432995147,3cyclictest2147989-21kworker/u8:1+events_unbound11:46:081
1883432995145,5cyclictest2059063-21kworker/u8:0+flush-8:010:11:101
1883432995145,5cyclictest1910743-21kworker/u8:1+flush-8:009:06:091
1883427995144,4cyclictest1930304-21kworker/u8:0+flush-8:008:30:550
1883432995045,4cyclictest1910743-21kworker/u8:1+events_unbound08:01:041
1883427995044,4cyclictest1930304-21kworker/u8:0+flush-8:008:51:050
1883427995040,7cyclictest2004698-21latency_hist09:10:000
21044332490,3chrt2104438-21aten2_r5power_v10:50:522
1883432994944,3cyclictest1850527-21kworker/u8:3+events_unbound07:21:021
1883432994943,4cyclictest1910743-21kworker/u8:1+flush-8:008:56:021
1883432994943,4cyclictest1910743-21kworker/u8:1+flush-8:008:16:051
1883432994942,5cyclictest2147989-21kworker/u8:1+flush-8:012:36:021
1883432994942,5cyclictest1910743-21kworker/u8:1+flush-8:009:31:031
1883427994939,7cyclictest2074237-21latency_hist10:20:020
21127982480,4sleep00-21swapper/010:56:000
1883432994840,6cyclictest1930304-21kworker/u8:0+flush-8:008:11:091
1883427994838,7cyclictest1999783-21latency_hist09:05:010
1883435994740,5cyclictest280-21systemd-journal08:35:012
1883435994736,8cyclictest280-21systemd-journal11:59:342
1883432994743,3cyclictest2147989-21kworker/u8:1+events_unbound12:16:081
1883427994743,3cyclictest1910743-21kworker/u8:1+flush-8:007:51:080
1883432994642,3cyclictest2049629-21kworker/u8:2+flush-8:010:06:051
1883432994641,4cyclictest1930304-21kworker/u8:0+flush-8:009:40:551
1883432994637,7cyclictest1984184-21ntpq08:46:051
1883432994540,4cyclictest1850527-21kworker/u8:3+events_unbound07:30:521
1883432994540,4cyclictest1850527-21kworker/u8:3+events_unbound07:30:511
1883432994540,3cyclictest2147989-21kworker/u8:1+events_unbound12:25:521
1883432994540,3cyclictest1910743-21kworker/u8:1+events_unbound09:25:521
1883432994540,3cyclictest1850527-21kworker/u8:3+flush-8:007:10:551
1883432994539,5cyclictest2108969-21kworker/u8:0+flush-8:011:21:021
1883432994538,5cyclictest2108969-21kworker/u8:0+flush-8:011:11:031
1883432994538,5cyclictest1930304-21kworker/u8:0+events_unbound08:50:521
1883427994538,5cyclictest1930304-21kworker/u8:0+flush-8:009:15:550
218371624433,6sleep30-21swapper/312:10:353
1883432994438,5cyclictest1910743-21kworker/u8:1+flush-8:009:01:031
1883432994438,4cyclictest1930304-21kworker/u8:0+events_unbound08:06:041
1883432994438,4cyclictest1850527-21kworker/u8:3+events_unbound07:15:041
1883432994437,5cyclictest1930390-21apt-get07:55:501
1883432994436,5cyclictest2133747-21latency_hist11:20:011
1883427994435,6cyclictest1919972-21latency_hist07:45:010
1883432994337,5cyclictest2108969-21kworker/u8:0+flush-8:011:01:041
1883432994337,4cyclictest1930304-21kworker/u8:0+events_unbound09:35:531
1883432994336,5cyclictest1930304-21kworker/u8:0+flush-8:008:31:031
1883427994332,8cyclictest2124452-21diskstats11:10:530
1883432994236,4cyclictest1930304-21kworker/u8:0+flush-8:009:20:581
1883427994237,4cyclictest1930304-21kworker/u8:0+flush-8:009:11:080
1883427994236,4cyclictest1850527-21kworker/u8:3+flush-8:007:21:080
1883432994134,5cyclictest1910743-21kworker/u8:1+flush-8:010:26:041
1883427994137,3cyclictest1850527-21kworker/u8:3+flush-8:007:46:050
1883432994035,4cyclictest2049629-21kworker/u8:2+flush-8:010:15:561
1883432994035,3cyclictest1900387-21kworker/u8:2+events_unbound07:45:501
1883432994034,5cyclictest2084444-21kworker/u8:4+events_unbound10:56:061
1883427994035,3cyclictest2154010-21kworker/u8:3+flush-8:011:50:530
1883427994033,5cyclictest280-21systemd-journal12:31:420
1883427994032,6cyclictest2078317-21ntpq10:21:010
1883427994031,6cyclictest2029381-21latency_hist09:35:010
1883432993934,3cyclictest2114214-21kworker/u8:2+flush-8:011:05:571
1883432993932,4cyclictest1910743-21kworker/u8:1+flush-8:010:21:061
1883427993929,8cyclictest2018625-21ntpq09:21:020
1883427993928,8cyclictest1954828-21latency_hist08:20:000
21219702380,4sleep00-21swapper/011:05:590
1883432993829,7cyclictest2088316-21ntpq10:31:021
1883427993831,5cyclictest1930304-21kworker/u8:0+events_unbound09:41:050
1883427993828,8cyclictest280-21systemd-journal07:19:590
1883427993827,8cyclictest1940554-21diskstats08:05:540
1883435993727,8cyclictest1954827-21apt-get08:20:022
1883432993731,4cyclictest2134024-21kworker/u8:3+flush-8:011:25:551
1883432993727,8cyclictest2147980-21ntpq11:31:031
1883427993732,3cyclictest2084444-21kworker/u8:4+events_unbound10:46:090
1883427993731,4cyclictest2108969-21kworker/u8:0+events_unbound11:25:020
1883432993630,4cyclictest1930304-21kworker/u8:0+flush-8:008:21:051
1883427993632,3cyclictest2084444-21kworker/u8:4+flush-8:010:31:070
1883427993631,4cyclictest2154010-21kworker/u8:3+events_unbound12:06:060
1883427993631,4cyclictest2154010-21kworker/u8:3+events_unbound12:06:050
1883427993630,5cyclictest1945186-21kworker/u8:3+flush-8:008:41:050
1883427993630,4cyclictest2108969-21kworker/u8:0+events_unbound11:01:040
1883427993630,4cyclictest1930304-21kworker/u8:0+events_unbound08:21:050
1883427993629,5cyclictest2149110-21/usr/sbin/munin11:36:010
188342799360,34cyclictest1-21systemd07:35:000
188342799360,34cyclictest1-21systemd07:34:590
18824052363,8sleep20-21swapper/207:06:042
1883432993531,3cyclictest1910743-21kworker/u8:1+flush-8:010:35:551
1883427993530,4cyclictest1910743-21kworker/u8:1+events_unbound08:45:020
1883435993427,5cyclictest2138720-21apt-get11:25:002
1883432993430,3cyclictest2084444-21kworker/u8:4+events_unbound10:50:001
1883427993430,3cyclictest1945186-21kworker/u8:3+flush-8:008:26:050
1883427993430,3cyclictest1930304-21kworker/u8:0+flush-8:008:01:090
1883427993424,8cyclictest2108095-21ntpq10:51:040
1883435993329,2cyclictest2113920-21cron11:00:002
1883432993328,3cyclictest2154010-21kworker/u8:3+flush-8:011:41:081
1883427993329,3cyclictest2147989-21kworker/u8:1+flush-8:011:46:090
1883427993328,4cyclictest2147989-21kworker/u8:1+events_unbound12:21:070
1883427993326,5cyclictest2154069-21/usr/sbin/munin11:41:020
188342799331,30cyclictest1-21systemd10:07:240
1883435993226,4cyclictest2123530-21unixbench_singl11:06:082
1883427993228,3cyclictest2147989-21kworker/u8:1+flush-8:012:36:070
1883427993228,3cyclictest2084173-21cron10:30:000
1883427993227,4cyclictest1930304-21kworker/u8:0+events_unbound08:10:570
1883427993227,3cyclictest2134024-21kworker/u8:3+events_unbound11:31:020
1883427993227,3cyclictest2114214-21kworker/u8:2+events_unbound12:10:530
1883435993125,4cyclictest280-21systemd-journal07:35:002
1883435993125,4cyclictest280-21systemd-journal07:35:002
1883427993126,3cyclictest2059063-21kworker/u8:0+flush-8:010:11:000
1883427993125,4cyclictest1910743-21kworker/u8:1+flush-8:008:56:090
1883435993025,3cyclictest2118912-21sh11:05:002
1883427993022,5cyclictest2114214-21kworker/u8:2+events_unbound11:55:510
1883427993020,8cyclictest280-21systemd-journal10:45:010
1883435992925,2cyclictest2178138-21unixbench_multi12:01:082
1883435992925,2cyclictest1895633-21aten2_r5power_p07:20:512
1883435992921,6cyclictest280-21systemd-journal10:35:002
1883427992924,4cyclictest2108969-21kworker/u8:0+events_unbound11:21:050
1883427992924,4cyclictest1945186-21kworker/u8:3+flush-8:009:51:090
1883427992922,5cyclictest1850527-21kworker/u8:3+events_unbound07:36:060
20085002280,3sleep375-21kworker/3:1+events09:11:013
1883435992823,4cyclictest2114214-21kworker/u8:2-ext4-rsv-conversion11:35:002
1883435992819,7cyclictest280-21systemd-journal07:12:252
1883427992825,2cyclictest2049931-21cpuspeed_turbos09:55:530
1883427992821,5cyclictest2198307-21apt-get12:25:020
1883435992723,2cyclictest2149167-21aten2_r5power_c11:35:512
1883435992722,3cyclictest1949872-21cron08:15:002
1883435992720,4cyclictest2004303-21unixbench_multi09:06:102
1883427992722,4cyclictest1910743-21kworker/u8:1+events_unbound09:26:030
1883427992720,5cyclictest1934159-21ntpq07:56:030
1883435992622,2cyclictest2074593-21aten2_r5power_c10:20:502
1883427992622,3cyclictest1945186-21kworker/u8:3+flush-8:009:46:030
1883435992521,2cyclictest2178934-21aten2_r5power_p12:05:502
1883435992521,2cyclictest2178934-21aten2_r5power_p12:05:492
1883435992520,3cyclictest2010169-21tr09:15:532
1883435992519,4cyclictest1910743-21kworker/u8:1+events_unbound09:00:002
1883427992521,3cyclictest2108969-21kworker/u8:0+flush-8:011:15:490
1883427992520,3cyclictest1910743-21kworker/u8:1+flush-8:010:00:520
1883427992520,3cyclictest1910743-21kworker/u8:1+flush-8:010:00:520
1883435992420,3cyclictest2203477-21idleruntime-cro12:30:012
1883435992420,2cyclictest1935587-21cpuspeed_turbos08:00:532
18786912244,13sleep10-21swapper/107:05:521
18786072242,15sleep00-21swapper/007:05:110
188343599230,21cyclictest2043830-21unixbench_multi09:46:082
208965622213,5sleep30-21swapper/310:35:523
1883435992218,3cyclictest2193360-21idleruntime-cro12:20:012
1883435992218,2cyclictest1914624-21grep07:36:102
1883435992211,8cyclictest1980169-21awk08:45:002
1883427992213,7cyclictest2188969-21diskstats12:15:520
188343599210,19cyclictest1-21systemd11:55:002
19526652200,5chrt0-21swapper/308:16:003
1883435992016,2cyclictest0-21swapper/212:25:012
1883435992015,4cyclictest2134024-21kworker/u8:3+flush-8:011:26:102
1883435992013,5cyclictest280-21systemd-journal07:45:452
1883435992012,6cyclictest1964907-21cron08:30:002
1883435992011,7cyclictest2056275-21tr10:00:562
1883435992011,7cyclictest2056275-21tr10:00:562
1883435992011,6cyclictest280-21systemd-journal11:20:002
188343599192,12cyclictest2044537-21apt-get09:50:522
1883435991914,3cyclictest0-21swapper/207:55:012
1883435991913,3cyclictest2034332-21sh09:40:002
1883435991913,3cyclictest0-21swapper/212:35:592
18784222193,7sleep30-21swapper/307:05:023
188343599188,8cyclictest1933013-21tr07:56:002
1883435991815,2cyclictest2154313-21cpuspeed_turbos11:40:532
1883435991815,2cyclictest2020063-21cpuspeed_turbos09:25:522
1883435991814,2cyclictest2207670-21grep12:31:072
1883435991814,2cyclictest0-21swapper/210:06:052
1883435991814,2cyclictest0-21swapper/209:55:572
1883435991814,2cyclictest0-21swapper/208:35:572
188343599181,15cyclictest2015785-21sed09:20:582
1883435991810,6cyclictest2104001-21cron10:50:002
188343599179,6cyclictest2065932-21tr10:11:002
188343599179,5cyclictest2097612-21cut10:41:012
1883435991713,3cyclictest0-21swapper/211:15:002
1883435991713,2cyclictest2029023-21unixbench_singl09:31:072
1883435991713,2cyclictest0-21swapper/209:41:102
1883435991713,2cyclictest0-21swapper/208:06:092
1883435991713,2cyclictest0-21swapper/207:15:042
1883435991712,3cyclictest0-21swapper/209:10:552
1883435991711,2cyclictest0-21swapper/208:51:072
19065262160,2sleep375-21kworker/3:1+mm_percpu_wq07:30:573
19065262160,2sleep375-21kworker/3:1+mm_percpu_wq07:30:573
188343599162,13cyclictest0-21swapper/212:10:142
188343599162,13cyclictest0-21swapper/210:15:032
188343599162,13cyclictest0-21swapper/207:29:512
1883435991613,2cyclictest0-21swapper/208:45:492
1883435991612,2cyclictest0-21swapper/211:45:562
1883435991612,2cyclictest0-21swapper/210:35:522
1883435991612,2cyclictest0-21swapper/207:40:502
1883435991611,3cyclictest2081525-21kthreadcore10:25:582
188343599161,11cyclictest1998974-21ntpq09:01:052
20383732142,8sleep30-21swapper/309:41:043
19353722142,8sleep30-21swapper/308:00:523
21988532132,7sleep30-21swapper/312:25:523
21289652132,6sleep30-21swapper/311:15:023
21040462132,6sleep30-21swapper/310:50:013
20888952135,5sleep30-21swapper/310:31:243
20395522132,7sleep30-21swapper/309:45:493
19549562132,6sleep30-21swapper/308:20:023
19489502132,7sleep30-21swapper/308:11:033
22087252122,6sleep30-21swapper/312:35:523
22034962122,6sleep30-21swapper/312:30:023
21975692123,5sleep30-21swapper/312:21:073
21727552122,6sleep30-21swapper/311:56:073
21590782122,6sleep30-21swapper/311:45:523
21540012122,5sleep30-21swapper/311:40:013
21387372122,5sleep30-21swapper/311:25:003
21137172122,6sleep30-21swapper/310:57:243
20986792122,6sleep30-21swapper/310:41:113
20792472122,6sleep30-21swapper/310:25:023
20789312122,6sleep30-21swapper/310:21:253
20608272122,6sleep30-21swapper/310:06:003
20447862122,6sleep30-21swapper/309:50:543
20215322122,6sleep30-21swapper/309:25:593
20142552122,6sleep30-21swapper/309:16:233
19960492122,6sleep30-21swapper/309:00:593
19841972122,6sleep30-21swapper/308:46:063
19748002121,7sleep30-21swapper/308:40:003
19604792122,6sleep30-21swapper/308:25:513
19149582122,6sleep30-21swapper/307:39:243
18839742122,6sleep30-21swapper/307:10:563
21889752112,5sleep30-21swapper/312:15:533
21787932113,5sleep30-21swapper/312:05:263
21787932113,5sleep30-21swapper/312:05:263
21741092112,5sleep30-21swapper/312:00:533
21490772112,6sleep30-21swapper/311:35:253
21445762112,5sleep30-21swapper/311:30:553
21341062112,6sleep30-21swapper/311:20:523
21281792112,6sleep30-21swapper/311:11:093
21192262112,5sleep30-21swapper/311:05:513
21142372112,5sleep30-21swapper/311:00:493
20993362112,6sleep30-21swapper/310:45:293
20696082112,5sleep30-21swapper/310:15:513
20643362112,5sleep30-21swapper/310:10:013
20296012112,5sleep30-21swapper/309:35:023
20246912113,5sleep30-21swapper/309:30:253
20145792112,5sleep30-21swapper/309:20:013
20046062112,6sleep30-21swapper/309:09:023
19904712112,5sleep30-21swapper/308:55:533
19892592112,5sleep30-21swapper/308:51:083
19692562112,5sleep30-21swapper/308:31:103
19402412112,5sleep30-21swapper/308:05:253
19303642112,5sleep30-21swapper/307:55:503
19251572112,5sleep30-21swapper/307:50:243
19247142112,6sleep30-21swapper/307:47:403
19150622112,5sleep30-21swapper/307:40:013
19004102112,5sleep30-21swapper/307:25:243
18958592112,5sleep30-21swapper/307:20:553
18883252111,5sleep30-21swapper/307:15:013
20496202102,5sleep30-21swapper/309:55:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional