You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 05:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue May 05, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
223110921960,2sleep3481ktimers/321:36:063
2084426996359,3cyclictest2101109-21kworker/u8:0+events_unbound23:11:181
2084426996155,5cyclictest2185008-21kworker/u8:1+events_unbound23:21:141
2084426996153,6cyclictest2267173-21kworker/u8:3+flush-8:022:46:111
2084426995953,4cyclictest2267173-21kworker/u8:3+events_unbound23:51:131
2084426995952,5cyclictest2267173-21kworker/u8:3+events_unbound22:56:171
2084426995850,6cyclictest2042041-21kworker/u8:2+flush-8:019:21:171
2084424995847,8cyclictest2239782-21latency_hist21:44:590
23348002570,3sleep3481ktimers/323:21:033
2084426995749,6cyclictest2267173-21kworker/u8:3+events_unbound23:26:131
2084426995649,5cyclictest2052138-21kworker/u8:1+flush-8:019:51:101
2084426995649,5cyclictest2052138-21kworker/u8:1+flush-8:019:51:101
2084426995646,8cyclictest2052138-21kworker/u8:1+flush-8:019:41:171
2084426995550,3cyclictest2343381-21kworker/u8:2+events_unbound23:36:101
2084426995546,6cyclictest2101109-21kworker/u8:0+flush-8:020:31:111
2084424995448,4cyclictest2052138-21kworker/u8:1+events_unbound19:15:010
2084426995347,4cyclictest2185008-21kworker/u8:1+events_unbound22:16:141
2084426995246,5cyclictest2185008-21kworker/u8:1+flush-8:022:06:131
2084426995246,4cyclictest2185008-21kworker/u8:1+events_unbound21:56:151
2084426995246,4cyclictest2185008-21kworker/u8:1+events_unbound21:56:141
2084426995246,4cyclictest2101109-21kworker/u8:0+events_unbound20:01:021
2084426995245,5cyclictest2101109-21kworker/u8:0+events_unbound22:36:121
2084426995244,6cyclictest2101109-21kworker/u8:0+flush-8:020:36:121
2084426995145,4cyclictest2185008-21kworker/u8:1+events_unbound20:55:011
2084426995144,5cyclictest2239779-21apt-get21:45:021
2084426995144,5cyclictest2101109-21kworker/u8:0+events_unbound22:51:001
2084426995043,5cyclictest2185008-21kworker/u8:1+events_unbound21:11:121
2084426995040,7cyclictest2267173-21kworker/u8:3+flush-8:022:26:171
2084424995044,4cyclictest2101109-21kworker/u8:0+flush-8:019:46:150
2084426994943,4cyclictest2369199-21kworker/u8:2+events_unbound00:21:151
2084426994943,4cyclictest2185008-21kworker/u8:1+events_unbound23:16:161
2084426994942,5cyclictest2052138-21kworker/u8:1+events_unbound19:15:031
2084424994940,6cyclictest2329115-21latency_hist23:15:010
2084434994841,5cyclictest2294902-21apt-get22:40:562
2084426994842,4cyclictest2101109-21kworker/u8:0+flush-8:021:31:031
2084426994842,3cyclictest2042041-21kworker/u8:2+flush-8:019:31:111
2084424994842,4cyclictest2195254-21latency_hist21:00:010
2084426994741,4cyclictest2267173-21kworker/u8:3+events_unbound23:06:151
2084426994741,4cyclictest2145573-21kworker/u8:2+events_unbound21:01:051
2084426994738,6cyclictest280-21systemd-journal20:10:001
2084426994738,6cyclictest2234832-21latency_hist21:40:011
2084424994739,5cyclictest2408813-21latency_hist00:35:010
2084426994641,4cyclictest2052138-21kworker/u8:1+events_unbound19:11:141
2084426994640,5cyclictest2267173-21kworker/u8:3+events_unbound22:20:031
2084426994640,4cyclictest2110794-21kworker/u8:3+flush-8:020:41:171
2084426994540,4cyclictest2389257-21kworker/u8:3+events_unbound00:31:121
2084426994539,4cyclictest2319251-21latency_hist23:05:001
2084426994538,5cyclictest2145573-21kworker/u8:2+flush-8:020:21:171
2084426994533,8cyclictest2205410-21kworker/u8:3+flush-8:021:16:101
2084426994439,4cyclictest2267173-21kworker/u8:3+flush-8:023:41:021
2084426994439,4cyclictest2101109-21kworker/u8:0+events_unbound21:06:121
2084426994437,5cyclictest2185008-21kworker/u8:1+flush-8:020:56:181
2084424994437,5cyclictest2120866-21latency_hist19:45:010
2084434994335,6cyclictest2180489-21cat20:45:002
2084426994338,3cyclictest2215289-21kworker/u8:2+events_unbound21:51:141
2084424994337,4cyclictest2101109-21kworker/u8:0+flush-8:020:36:010
2084424994336,5cyclictest2185008-21kworker/u8:1+flush-8:021:26:030
21100352420,2sleep30-21swapper/319:31:103
2084426994236,4cyclictest2185008-21kworker/u8:1+events_unbound21:26:011
2084426994235,5cyclictest2101109-21kworker/u8:0+events_unbound22:31:131
2084426994234,5cyclictest2269643-21latency_hist22:15:001
2084426994230,8cyclictest280-21systemd-journal00:13:071
2084426994136,3cyclictest2101109-21kworker/u8:0+flush-8:019:36:131
2084426994135,4cyclictest2399284-21apt-get00:25:551
2084426994135,4cyclictest2374454-21kworker/u8:0+flush-8:000:06:031
2084426994135,4cyclictest2374454-21kworker/u8:0+flush-8:000:06:031
2084426994135,4cyclictest2267173-21kworker/u8:3+flush-8:023:46:101
2084426994035,3cyclictest2101109-21kworker/u8:0+events_unbound20:11:061
2084424994034,4cyclictest2180725-21/usr/sbin/munin20:46:120
2084424994034,4cyclictest2101109-21kworker/u8:0+flush-8:020:01:030
2084424994031,7cyclictest2244053-21ntpq21:46:100
2084426993935,3cyclictest2101109-21kworker/u8:0+flush-8:021:21:021
2084426993932,6cyclictest2389257-21kworker/u8:3+flush-8:000:16:101
2084426993932,5cyclictest2240046-21store21:45:011
2084424993935,3cyclictest2267173-21kworker/u8:3+flush-8:022:41:050
2084426993833,4cyclictest2101109-21kworker/u8:0+events_unbound20:00:001
2084426993832,5cyclictest2185008-21kworker/u8:1+flush-8:022:41:091
2084426993832,4cyclictest2267173-21kworker/u8:3+flush-8:023:31:191
2084424993833,3cyclictest2185008-21kworker/u8:1+events_unbound20:51:000
2084424993831,5cyclictest2374454-21kworker/u8:0+flush-8:000:06:070
2084424993831,5cyclictest2374454-21kworker/u8:0+flush-8:000:06:070
2084424993829,6cyclictest2259769-21latency_hist22:05:010
2084434993731,4cyclictest2413765-21apt-get00:40:002
2084434993728,6cyclictest2101070-21cron19:25:002
2084426993731,5cyclictest2267173-21kworker/u8:3+flush-8:023:56:161
2084424993729,6cyclictest280-21systemd-journal23:25:030
2084434993628,5cyclictest2130730-21cat19:55:002
2084434993628,5cyclictest2130730-21cat19:54:592
2084434993628,5cyclictest2120065-21ntpq19:41:122
2084424993628,6cyclictest280-21systemd-journal23:55:000
208442499362,29cyclictest2239814-21kworker/0:2+events22:10:290
2084424993526,6cyclictest280-21systemd-journal21:06:070
2084424993526,6cyclictest2096128-21latency_hist19:20:010
2084434993428,4cyclictest2239779-21apt-get21:45:002
2084434993426,5cyclictest2394002-21awk00:20:012
2084426993429,3cyclictest2412942-21ntpq00:36:121
2084426993426,5cyclictest280-21systemd-journal22:01:081
2084424993425,7cyclictest2309386-21latency_hist22:55:010
208442499342,31cyclictest2239814-21kworker/0:2+events23:44:290
208442499342,30cyclictest2239814-21kworker/0:2+events23:48:420
208442499340,30cyclictest2106039-21kworker/0:2+events20:20:090
2084426993328,4cyclictest2101109-21kworker/u8:0+flush-8:020:26:111
2084426993326,5cyclictest2042041-21kworker/u8:2+flush-8:019:26:171
2084426993325,6cyclictest2084264-21latency_hist19:10:001
2084424993329,3cyclictest2264700-21systemd-run22:10:010
2084424993326,5cyclictest2110794-21kworker/u8:3+flush-8:020:41:020
208442499332,30cyclictest2364268-21kworker/0:0+events00:38:290
208442499332,30cyclictest2190357-21kworker/0:1+events21:18:350
2084434993226,5cyclictest2101109-21kworker/u8:0+flush-8:020:26:012
2084434993221,9cyclictest2354367-21cat23:39:592
2084426993227,3cyclictest2185008-21kworker/u8:1+events_unbound00:01:021
2084424993228,3cyclictest2185008-21kworker/u8:1+events_unbound23:21:000
2084424993225,5cyclictest2267173-21kworker/u8:3+events_unbound23:56:100
208442499322,29cyclictest2106039-21kworker/0:2+events20:28:590
208442499322,26cyclictest2190357-21kworker/0:1+events21:35:270
208442499321,28cyclictest2239814-21kworker/0:2+events23:15:130
208442499320,31cyclictest2239814-21kworker/0:2+events21:53:470
22476102310,5sleep3451irq_work/321:51:073
2084424993127,2cyclictest2294552-21cron22:40:000
2084424993126,4cyclictest2267173-21kworker/u8:3+flush-8:022:56:080
2084424993125,5cyclictest2389257-21kworker/u8:3+flush-8:000:26:080
208442499312,24cyclictest2084285-21kworker/0:0+events19:25:350
208442499311,26cyclictest2106039-21kworker/0:2+events19:30:530
208442499310,30cyclictest2239814-21kworker/0:2+events21:57:290
208442499310,30cyclictest2239814-21kworker/0:2+events21:57:290
208442499310,30cyclictest2190357-21kworker/0:1+events21:11:570
208442499310,26cyclictest2239814-21kworker/0:2+events22:25:100
208442499310,26cyclictest2190357-21kworker/0:1+events21:00:410
2084426993026,3cyclictest2101109-21kworker/u8:0+flush-8:019:46:101
2084426993025,3cyclictest2151575-21irqrtprio20:16:051
208442499302,27cyclictest2239814-21kworker/0:2+events23:33:570
208442499302,24cyclictest2364268-21kworker/0:0+events00:00:040
208442499302,22cyclictest2364268-21kworker/0:0+events00:20:130
2084424993020,8cyclictest0-21swapper/022:20:010
208442499301,28cyclictest2106039-21kworker/0:2+events20:14:290
208442499300,29cyclictest2106039-21kworker/0:2+events20:17:290
208442499300,26cyclictest2364268-21kworker/0:0+events00:10:170
20840202302,6sleep00-21swapper/019:07:080
2084434992924,4cyclictest2389029-21awk00:15:002
2084434992924,4cyclictest2101109-21kworker/u8:0+flush-8:020:11:132
2084426992923,3cyclictest2181278-21sed20:46:041
208442499293,25cyclictest2239814-21kworker/0:2+events22:34:030
2084424992923,4cyclictest2130720-21cron19:55:000
2084424992923,4cyclictest2130720-21cron19:54:590
208442499292,26cyclictest2239814-21kworker/0:2+events23:00:510
208442499292,26cyclictest2239814-21kworker/0:2+events22:48:510
208442499292,26cyclictest2084285-21kworker/0:0+events19:23:410
208442499292,22cyclictest2364268-21kworker/0:0+events00:15:310
208442499292,22cyclictest2239814-21kworker/0:2+events23:05:030
208442499292,22cyclictest2190357-21kworker/0:1+events21:20:050
208442499282,25cyclictest2106039-21kworker/0:2+events19:55:150
208442499282,22cyclictest2106039-21kworker/0:2+events20:30:150
208442499282,21cyclictest2239814-21kworker/0:2+events23:35:050
208442499282,21cyclictest2106039-21kworker/0:2+events20:05:190
208442499280,27cyclictest2190357-21kworker/0:1+events21:30:290
21557712270,4sleep3481ktimers/320:20:583
2084434992723,2cyclictest2289979-21aten2_r5power_c22:35:592
2084434992721,4cyclictest2095730-21unixbench_multi19:16:182
208442499271,25cyclictest2106039-21kworker/0:2+events19:38:540
2084434992622,3cyclictest2369842-21fschecks_time23:56:022
2084434992622,2cyclictest2333697-21unixbench_singl23:16:182
2084434992620,4cyclictest2267173-21kworker/u8:3+events_unbound22:11:162
2084434992619,5cyclictest2369199-21kworker/u8:2+events_unbound00:01:102
2084434992618,6cyclictest2289626-21turbostat.cron22:34:592
2084434992522,2cyclictest2259370-21unixbench_multi22:01:172
2084434992521,2cyclictest2404448-21cpuspeed_turbos00:31:022
2084424992515,8cyclictest2275119-21munin-node22:20:560
2084434992421,2cyclictest2310055-21fschecks_time22:56:042
2084434992420,3cyclictest2052138-21kworker/u8:1+flush-8:019:56:082
2084434992419,4cyclictest2343381-21kworker/u8:2+flush-8:023:26:182
2084434992419,3cyclictest2084877-21tr19:11:032
2084434992419,3cyclictest0-21swapper/220:56:192
2084434992416,6cyclictest280-21systemd-journal20:35:002
2084434992320,2cyclictest2399635-21fschecks_time00:26:002
2084434992320,2cyclictest2359973-21fschecks_time23:46:022
2084434992319,2cyclictest2274187-21grep22:16:172
2084434992319,2cyclictest0-21swapper/200:10:002
2084434992319,2cyclictest0-21swapper/200:09:592
208443499224,2cyclictest23003302if_err_enp4s0.222:46:012
2084434992218,3cyclictest2101755-21fschecks_time19:26:022
2084434992218,2cyclictest2205823-21fschecks_time21:11:052
2084434992218,2cyclictest0-21swapper/223:25:002
2084434992214,6cyclictest2349377-21turbostat.cron23:35:002
21638802210,3chrt481ktimers/320:26:083
208443499213,13cyclictest2150855-21apt-get20:15:592
208443499212,13cyclictest2156674-21irqstats20:21:062
2084434992118,2cyclictest2354967-21fschecks_count23:41:012
2084434992117,3cyclictest2224942-21cron21:30:002
2084434992117,3cyclictest2215289-21kworker/u8:2+events_unbound22:10:012
2084434992117,3cyclictest2145573-21kworker/u8:2+events_unbound20:46:122
208443499210,19cyclictest2234498-21grep21:36:182
208443499203,9cyclictest0-21swapper/221:05:012
208443499202,13cyclictest2364569-21apt-get23:50:582
208443499202,13cyclictest2215383-21apt-get21:20:592
2084434992016,2cyclictest2398634-21grep00:21:192
2084434992016,2cyclictest2111493-21cpuspeed_turbos19:36:012
2084434992016,2cyclictest0-21swapper/221:46:082
2084434992010,7cyclictest2229878-21cron21:34:592
20793972206,8sleep20-21swapper/219:05:012
2084434991915,2cyclictest0-21swapper/220:10:012
2084434991914,3cyclictest0-21swapper/223:01:102
20796072192,8sleep30-21swapper/319:05:023
23795092182,10sleep30-21swapper/300:05:593
23795092182,10sleep30-21swapper/300:05:583
22850192184,10sleep30-21swapper/322:31:003
2084434991815,2cyclictest0-21swapper/223:11:202
2084434991814,3cyclictest2106562-21cpuspeed_turbos19:31:012
2084434991814,2cyclictest0-21swapper/223:06:132
2084434991814,2cyclictest0-21swapper/222:51:022
2084434991814,2cyclictest0-21swapper/222:21:012
2084434991814,2cyclictest0-21swapper/221:15:592
2084434991813,3cyclictest2123596-21kthreadcore19:46:062
208443499175,4cyclictest0-21swapper/222:26:182
2084434991712,4cyclictest0-21swapper/221:51:152
2084434991712,3cyclictest0-21swapper/220:51:092
208443499162,13cyclictest0-21swapper/220:00:052
2084434991613,2cyclictest0-21swapper/221:55:312
2084434991613,2cyclictest0-21swapper/221:55:312
2084434991613,2cyclictest0-21swapper/221:06:002
208443499161,11cyclictest2171181-21ps20:36:052
23241672152,7sleep30-21swapper/323:10:003
23294382142,8sleep30-21swapper/323:15:593
21726782145,5sleep30-21swapper/320:36:083
23980682132,7sleep30-21swapper/300:21:113
23636312132,7sleep30-21swapper/323:46:173
23146792134,6sleep30-21swapper/323:01:023
22257602132,7sleep30-21swapper/321:31:053
22222022133,6sleep30-21swapper/321:26:083
21822162132,7sleep30-21swapper/320:46:073
24116832122,6sleep30-21swapper/300:36:083
24049312122,6sleep30-21swapper/300:31:073
23844482122,6sleep30-21swapper/300:11:043
23742002122,5sleep30-21swapper/300:00:013
23686382122,6sleep30-21swapper/323:51:183
23501912122,6sleep30-21swapper/323:36:053
23455352122,6sleep30-21swapper/323:31:083
23392442122,5sleep30-21swapper/323:25:023
23059242121,7sleep30-21swapper/322:51:073
22995022122,6sleep30-21swapper/322:45:013
22896542122,6sleep30-21swapper/322:35:023
22803442122,6sleep30-21swapper/322:26:033
22703372122,6sleep30-21swapper/322:16:033
22646912122,6sleep30-21swapper/322:10:023
22604352122,6sleep30-21swapper/322:06:053
22405712122,6sleep30-21swapper/321:46:023
22391302122,6sleep30-21swapper/321:41:173
22135692122,6sleep30-21swapper/321:16:083
22006302122,6sleep30-21swapper/321:06:013
21971892122,6sleep30-21swapper/321:01:073
21903722122,6sleep30-21swapper/320:55:023
21894712122,6sleep30-21swapper/320:51:133
21755452122,6sleep30-21swapper/320:40:573
21653632122,6sleep30-21swapper/320:30:023
21552932122,6sleep30-21swapper/320:18:103
21496382122,6sleep30-21swapper/320:11:113
21364152122,6sleep30-21swapper/320:01:053
21251812122,6sleep30-21swapper/319:46:163
21198462122,6sleep30-21swapper/319:41:103
21117112122,6sleep30-21swapper/319:36:053
21010682122,5sleep30-21swapper/319:25:013
20912082122,6sleep30-21swapper/319:15:063
20855412122,6sleep30-21swapper/319:11:083
23992882112,5sleep30-21swapper/300:25:573
23893332112,5sleep30-21swapper/300:15:583
23699162112,5sleep30-21swapper/323:56:043
23546042112,5sleep30-21swapper/323:40:033
23247642112,5sleep30-21swapper/323:11:053
23096352113,5sleep30-21swapper/322:55:243
23001502112,5sleep30-21swapper/322:46:013
22796302112,6sleep30-21swapper/322:23:143
22562562112,5sleep30-21swapper/322:01:063
22498722112,5sleep30-21swapper/321:55:013
22498722112,5sleep30-21swapper/321:55:013
22152202112,5sleep30-21swapper/321:20:023
22092752112,5sleep30-21swapper/321:11:153
21406362111,5sleep30-21swapper/320:05:023
21312992111,6sleep30-21swapper/319:56:023
21258142112,5sleep30-21swapper/319:50:013
21258142112,5sleep30-21swapper/319:50:013
20978092112,5sleep30-21swapper/319:21:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional