You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-13 - 10:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Sat Dec 13, 2025 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11565599274213,2725cyclictest136582-21kworker/0:1+events20:15:150
11565599271313,2696cyclictest157095-21kworker/0:0+events21:20:150
11566099267913,2663cyclictest116932-21kworker/2:0+events19:15:012
11566599267312,2657cyclictest209554-21kworker/3:3+events00:05:163
11566099262711,2612cyclictest209306-21kworker/2:1+events00:20:102
11566599255412,2538cyclictest146008-21kworker/3:2+events21:01:563
1156609925425,2532cyclictest128507-21kworker/2:0+events19:55:102
11566599249812,2483cyclictest141473-21kworker/3:0+events20:33:553
11566599249312,2477cyclictest209554-21kworker/3:3+events00:10:143
11566599249212,2476cyclictest146008-21kworker/3:2+events20:59:153
11566599249012,2476cyclictest157247-21kworker/3:1+events21:20:383
11566099244910,2434cyclictest173083-21kworker/2:1+events22:15:142
11566599243412,2418cyclictest189098-21kworker/3:2+events23:09:353
11566099242312,2408cyclictest149890-21kworker/2:0+events20:58:282
11565799241810,2404cyclictest119170-21kworker/1:0+events19:45:171
11565799241810,2404cyclictest119170-21kworker/1:0+events19:45:171
11566099240512,2390cyclictest190867-21kworker/2:2+events23:05:262
11565799240312,2388cyclictest189187-21kworker/1:0+events23:14:321
11565599240111,2386cyclictest206200-21kworker/0:1+events23:50:000
11566099239612,2382cyclictest186009-21kworker/2:2+events22:50:102
11565799239610,2382cyclictest195867-21kworker/1:1+events23:25:161
11565799239510,2382cyclictest190899-21kworker/1:1+events23:06:321
11566599239312,2378cyclictest178890-21kworker/3:2+events22:34:343
1156659923846,2375cyclictest159131-21kworker/3:2+events21:40:193
11565799238410,2371cyclictest119170-21kworker/1:0+events19:42:141
11565799235512,2339cyclictest179765-21kworker/1:2+events22:38:431
11565599235412,2339cyclictest157095-21kworker/0:0+events21:18:180
11566599235012,2335cyclictest174895-21kworker/3:2+events22:16:203
11565599235011,2335cyclictest209427-21kworker/0:0+events00:12:570
11565599234712,2332cyclictest195991-21kworker/0:0+events23:30:340
11566099234012,2324cyclictest200691-21kworker/2:0+events23:40:492
11566599233710,2324cyclictest138029-21kworker/3:2+events20:28:293
11566099233711,2322cyclictest218772-21kworker/2:2+events00:29:202
11565799233710,2324cyclictest163869-21kworker/1:1+events21:40:421
11566099233311,2319cyclictest160492-21kworker/2:2+events21:43:022
11566599232512,2311cyclictest184674-21kworker/3:1+events22:55:103
11566099232112,2305cyclictest187616-21kworker/2:0+events23:24:062
11566599231912,2304cyclictest125390-21kworker/3:2+events20:06:323
11566599231111,2297cyclictest147759-21kworker/3:1+events20:53:513
11566599231111,2297cyclictest146008-21kworker/3:2+events20:49:163
11566599231111,2296cyclictest192343-21kworker/3:0+events23:12:383
11566599231111,2296cyclictest153981-21kworker/3:1+events21:10:413
11566599231011,2296cyclictest217285-21kworker/3:1+events00:24:003
11566599230911,2295cyclictest205944-21kworker/3:2+events23:46:313
11566599230911,2295cyclictest135160-21kworker/3:1+events20:39:403
11565599230912,2295cyclictest214055-21kworker/0:1+events00:20:330
1156659923089,2296cyclictest165287-21kworker/3:1+events21:55:173
11566599230811,2293cyclictest218976-21kworker/3:2+events00:31:363
11565799230810,2295cyclictest215686-21kworker/1:2+events00:37:101
11565799230810,2295cyclictest215686-21kworker/1:2+events00:37:101
11566599230711,2293cyclictest194235-21kworker/3:1+events23:16:263
11566599230610,2293cyclictest125390-21kworker/3:2+events19:37:043
11566599230410,2292cyclictest163541-21kworker/3:0+events21:45:193
11566599230410,2291cyclictest173262-21kworker/3:0+events22:24:353
11566599230410,2291cyclictest173262-21kworker/3:0+events22:24:353
11566599230010,2286cyclictest200754-21kworker/3:2+events23:36:163
11566599229311,2278cyclictest135160-21kworker/3:1+events20:11:053
11566599227210,2259cyclictest165287-21kworker/3:1+events21:51:263
11566599226110,2248cyclictest184674-21kworker/3:1+events22:46:193
11566599225911,2245cyclictest173262-21kworker/3:0+events22:14:283
11565799225111,2238cyclictest130135-21kworker/1:2+events20:10:201
11566099224610,2233cyclictest209306-21kworker/2:1+events00:04:082
1156659922457,2235cyclictest122447-21kworker/3:1+events19:30:553
11565799224411,2229cyclictest170031-21kworker/1:2+events22:00:161
11565799224311,2228cyclictest142931-21kworker/1:2+events20:37:461
11565799224310,2229cyclictest215686-21kworker/1:2+events00:25:331
11565799224010,2227cyclictest182997-21kworker/1:1+events22:55:341
11565799223910,2226cyclictest206035-21kworker/1:0+events23:52:171
11565799223811,2224cyclictest207641-21kworker/1:1+events23:55:431
11565799223810,2224cyclictest178109-21kworker/1:0+events22:24:591
11565799223810,2224cyclictest178109-21kworker/1:0+events22:24:591
11565799223711,2223cyclictest195867-21kworker/1:1+events23:43:281
11565799223710,2224cyclictest179765-21kworker/1:2+events22:43:381
1156579922368,2225cyclictest152247-21kworker/1:2+events21:01:341
1156579922358,2224cyclictest155459-21kworker/1:1+events21:30:461
11565799223511,2222cyclictest119170-21kworker/1:0+events19:30:091
11565799223511,2221cyclictest155459-21kworker/1:1+events21:19:041
1156579922348,2223cyclictest153864-21kworker/1:0+events21:07:361
11565799223210,2218cyclictest211022-21kworker/1:1+events00:15:351
11566599223110,2218cyclictest165287-21kworker/3:1+events22:05:373
11565799223111,2217cyclictest178109-21kworker/1:0+events22:31:561
1156579922239,2211cyclictest131734-21kworker/1:0+events20:01:351
1156579922167,2206cyclictest195867-21kworker/1:1+events23:30:121
11565799221611,2202cyclictest182997-21kworker/1:1+events22:45:561
11565799221511,2200cyclictest158955-21kworker/1:2+events21:27:241
11565799221411,2200cyclictest142931-21kworker/1:2+events20:33:311
11565799221211,2198cyclictest195867-21kworker/1:1+events23:37:491
11566599221010,2197cyclictest113027-21kworker/3:0+events19:18:463
11565799220911,2195cyclictest168401-21kworker/1:0+events21:57:571
11565599220611,2191cyclictest125617-21kworker/0:2+events20:32:450
11565599220511,2191cyclictest144564-21kworker/0:0+events20:45:470
1156579922049,2191cyclictest134922-21kworker/1:1+events20:08:031
11565799220411,2190cyclictest141169-21kworker/1:0+events20:27:421
1156559922049,2192cyclictest192403-21kworker/0:1+events23:16:030
11565599220410,2191cyclictest149215-21kworker/0:1+events21:00:010
11565599220410,2191cyclictest139926-21kworker/0:1+events20:42:200
1156559922038,2192cyclictest206200-21kworker/0:1+events23:54:340
11565599220311,2188cyclictest165197-21kworker/0:0+events22:08:190
11565599220310,2190cyclictest192403-21kworker/0:1+events23:21:500
11565599220211,2187cyclictest186187-21kworker/0:2+events22:58:150
11565599220211,2187cyclictest159042-21kworker/0:2+events21:26:180
11565599220111,2187cyclictest174806-21kworker/0:2+events22:16:420
1156559921996,2190cyclictest133294-21kworker/0:1+events20:01:580
11565599219711,2183cyclictest149215-21kworker/0:1+events21:34:590
11565599219411,2180cyclictest199122-21kworker/0:2+events23:37:020
11565599219311,2179cyclictest123931-21kworker/0:0+events19:41:520
11566099219211,2177cyclictest155548-21kworker/2:2+events21:13:392
11565599219211,2177cyclictest165197-21kworker/0:0+events21:56:260
11566099219111,2177cyclictest163692-21kworker/2:0+events21:39:312
11565599219111,2177cyclictest119434-21kworker/0:2+events19:23:230
11565599218911,2176cyclictest138307-21kworker/0:0+events20:21:100
11566099218312,2167cyclictest187616-21kworker/2:0+events22:57:512
11566099218310,2169cyclictest209306-21kworker/2:1+events00:08:172
11566099218310,2169cyclictest160492-21kworker/2:2+events21:34:352
11566599218110,2168cyclictest161234-21kworker/3:1+events21:33:273
11566099218011,2167cyclictest173083-21kworker/2:1+events22:45:112
11566099218011,2166cyclictest160492-21kworker/2:2+events21:51:482
11566099217811,2164cyclictest197844-21kworker/2:2+events23:29:482
11566099217810,2165cyclictest179949-21kworker/2:0+events22:31:112
11566099217711,2163cyclictest215561-21kworker/2:0+events00:30:492
11566099217711,2163cyclictest122510-21kworker/2:1+events19:37:252
11566099217611,2162cyclictest187616-21kworker/2:0+events23:11:282
11566099217611,2162cyclictest160492-21kworker/2:2+events21:27:462
11566099217610,2163cyclictest187616-21kworker/2:0+events23:01:372
11566099217510,2162cyclictest116932-21kworker/2:0+events19:32:262
1156579921749,2162cyclictest211022-21kworker/1:1+events00:11:481
11566099217311,2158cyclictest173083-21kworker/2:1+events22:44:022
1156659921725,2164cyclictest113027-21kworker/3:0+events19:21:273
11566099217011,2156cyclictest173083-21kworker/2:1+events22:28:042
11565599217011,2155cyclictest209427-21kworker/0:0+events00:30:270
11566099216911,2155cyclictest131968-21kworker/2:1+events20:10:432
11566099216811,2154cyclictest139686-21kworker/2:2+events20:22:412
11565599216610,2153cyclictest214055-21kworker/0:1+events00:16:210
11565599216610,2152cyclictest192403-21kworker/0:1+events23:08:260
11565799216511,2151cyclictest182997-21kworker/1:1+events22:51:431
11565599216011,2146cyclictest162298-21kworker/0:2+events21:41:290
11566099215611,2142cyclictest173083-21kworker/2:1+events22:37:122
11566099215611,2142cyclictest173083-21kworker/2:1+events22:22:002
11566099215611,2142cyclictest173083-21kworker/2:1+events22:22:002
11566099215611,2142cyclictest149890-21kworker/2:0+events21:15:132
11566099215611,2142cyclictest149890-21kworker/2:0+events21:05:212
11566099215211,2138cyclictest152268-21kworker/2:2+events21:02:402
11566599214911,2135cyclictest199091-21kworker/3:0+events23:41:573
11566099214911,2134cyclictest144533-21kworker/2:0+events20:39:192
11566599214711,2132cyclictest209184-21kworker/3:2+events23:59:103
1156609921468,2135cyclictest204176-21kworker/2:2+events23:58:242
11566099214311,2129cyclictest200691-21kworker/2:0+events23:37:262
11565799214310,2130cyclictest119170-21kworker/1:0+events19:22:361
11566099214211,2128cyclictest120917-21kworker/2:2+events19:25:182
11566599214010,2127cyclictest196281-21kworker/3:2+events23:24:293
1156609921379,2125cyclictest160492-21kworker/2:2+events22:02:572
1156559921375,2128cyclictest130536-21kworker/0:0+events19:58:100
11565599213610,2123cyclictest209427-21kworker/0:0+events00:00:420
11566599213010,2117cyclictest130104-21kworker/3:1+events20:00:483
11565599212510,2112cyclictest134954-21kworker/0:0+events20:08:270
1156579921246,2115cyclictest122389-21kworker/1:2+events19:29:231
11566599212213,2105cyclictest207583-21kworker/3:1+events00:02:363
11566099212111,2107cyclictest195960-21kworker/2:1+events23:46:082
11566599211910,2105cyclictest130104-21kworker/3:1+events19:57:483
11566599211610,2103cyclictest130104-21kworker/3:1+events19:52:073
11566599211310,2100cyclictest214021-21kworker/3:1+events00:15:593
11566599211310,2100cyclictest178890-21kworker/3:2+events22:39:283
11566599211010,2097cyclictest186367-21kworker/3:0+events22:53:183
11566599211010,2097cyclictest135160-21kworker/3:1+events20:16:233
11566599211010,2097cyclictest113027-21kworker/3:0+events19:40:443
11566599211010,2096cyclictest199091-21kworker/3:0+events23:51:313
11565599211011,2097cyclictest123931-21kworker/0:0+events19:35:090
1156659921098,2098cyclictest165287-21kworker/3:1+events22:03:203
1156659921095,2100cyclictest150727-21kworker/3:0+events21:07:593
1156559921096,2100cyclictest174806-21kworker/0:2+events22:20:500
1156559921096,2100cyclictest174806-21kworker/0:2+events22:20:500
11565599210711,2094cyclictest200783-21kworker/0:1+events23:40:040
1156659921066,2097cyclictest200754-21kworker/3:2+events23:34:443
11566599210610,2093cyclictest150727-21kworker/3:0+events21:19:283
11566599210510,2092cyclictest190718-21kworker/3:1+events23:03:563
11566599210510,2092cyclictest150727-21kworker/3:0+events21:28:083
11566599210410,2090cyclictest178890-21kworker/3:2+events22:29:383
1156579921029,2090cyclictest162237-21kworker/1:2+events21:36:071
11566099210010,2086cyclictest139686-21kworker/2:2+events20:43:302
1156659920998,2087cyclictest146008-21kworker/3:2+events20:43:063
11566599209510,2082cyclictest163541-21kworker/3:0+events21:37:183
1156659920917,2081cyclictest178890-21kworker/3:2+events22:44:473
11565599208910,2076cyclictest181430-21kworker/0:0+events22:41:200
11566099208611,2072cyclictest160492-21kworker/2:2+events22:06:232
11566599208410,2071cyclictest199091-21kworker/3:0+events23:28:183
11565799208011,2066cyclictest130135-21kworker/1:2+events19:56:401
11565799207310,2060cyclictest163869-21kworker/1:1+events21:46:261
11565799206710,2053cyclictest195867-21kworker/1:1+events23:19:081
1156609920629,2050cyclictest166918-21kworker/2:0+events21:49:552
11566599205510,2042cyclictest120674-21kworker/3:2+events19:25:423
1156559920535,2045cyclictest169916-21kworker/0:2+events22:03:430
1156579920517,2041cyclictest116903-21kworker/1:1+events19:17:381
1156609920509,2038cyclictest149890-21kworker/2:0+events21:24:242
11565799205010,2037cyclictest170031-21kworker/1:2+events22:10:151
1156579920497,2039cyclictest171845-21kworker/1:1+events22:09:061
11565799204610,2034cyclictest153864-21kworker/1:0+events21:11:461
1156579920459,2033cyclictest209335-21kworker/1:2+events00:04:311
1156659920444,2037cyclictest115108-21kworker/3:1+events19:14:383
11565799204410,2031cyclictest119170-21kworker/1:0+events19:50:111
1156579920439,2031cyclictest215686-21kworker/1:2+events00:31:131
1156579920425,2034cyclictest141169-21kworker/1:0+events20:48:301
11565799204210,2029cyclictest178109-21kworker/1:0+events22:27:401
1156579920409,2027cyclictest155459-21kworker/1:1+events21:22:321
11565799204010,2027cyclictest202674-21kworker/1:2+events23:46:541
11566099203910,2026cyclictest144533-21kworker/2:0+events20:46:102
11565599203910,2027cyclictest125617-21kworker/0:2+events20:35:030
11565799203810,2025cyclictest141169-21kworker/1:0+events20:58:521
11565799203510,2022cyclictest130135-21kworker/1:2+events20:24:141
11565799202910,2016cyclictest171845-21kworker/1:1+events22:19:431
1156579920278,2016cyclictest211022-21kworker/1:1+events00:07:321
11566099202410,2012cyclictest124158-21kworker/2:2+events19:50:342
1156559920224,2015cyclictest174806-21kworker/0:2+events22:29:150
11566099202111,2007cyclictest160492-21kworker/2:2+events22:13:412
1156659920139,2001cyclictest113027-21kworker/3:0+events19:46:033
1156659920139,2001cyclictest113027-21kworker/3:0+events19:46:033
1156559920136,2003cyclictest179703-21kworker/0:1+events22:30:490
11565599201310,1999cyclictest116815-21kworker/0:1+events19:16:100
1156559920127,2002cyclictest212327-21kworker/0:2+events00:07:550
11565599201110,1998cyclictest174806-21kworker/0:2+events22:37:590
11565599201010,1997cyclictest165197-21kworker/0:0+events21:48:460
1156559920099,1997cyclictest209427-21kworker/0:0+events00:28:570
1156579920087,1998cyclictest213959-21kworker/1:0+events00:22:501
1156559920073,2001cyclictest122301-21kworker/0:1+events19:32:490
11565599200710,1993cyclictest125617-21kworker/0:2+events19:49:500
11565599200710,1993cyclictest125617-21kworker/0:2+events19:49:500
1156609920063,2000cyclictest139686-21kworker/2:2+events20:32:222
11565799200610,1993cyclictest166766-21kworker/1:2+events21:51:021
11566099200510,1992cyclictest133588-21kworker/2:0+events20:07:402
1156559920057,1995cyclictest162298-21kworker/0:2+events21:35:220
1156559920053,1999cyclictest149215-21kworker/0:1+events21:12:070
11565599200410,1991cyclictest220145-21kworker/0:1+events00:39:510
11565599200410,1991cyclictest220145-21kworker/0:1+events00:39:510
11565599200410,1991cyclictest127266-21kworker/0:1+events19:51:430
1156559920039,1991cyclictest165197-21kworker/0:0+events21:50:410
1156559920032,1998cyclictest207823-21kworker/0:2+events23:58:010
11565599200310,1990cyclictest119434-21kworker/0:2+events19:27:080
1156609920028,1991cyclictest160492-21kworker/2:2+events21:57:342
11565599200210,1989cyclictest181430-21kworker/0:0+events22:49:000
11566099200110,1988cyclictest139686-21kworker/2:2+events20:26:552
1156559920016,1991cyclictest136582-21kworker/0:1+events20:13:460
1156609919995,1990cyclictest215561-21kworker/2:0+events00:39:072
1156609919995,1990cyclictest215561-21kworker/2:0+events00:39:062
11566099199910,1986cyclictest146187-21kworker/2:1+events20:51:562
11566099199710,1984cyclictest122510-21kworker/2:1+events19:40:232
11565599199710,1984cyclictest173112-21kworker/0:1+events22:13:180
11566099199610,1983cyclictest131968-21kworker/2:1+events20:04:592
11565599199610,1983cyclictest144564-21kworker/0:0+events20:52:430
1156609919957,1985cyclictest204176-21kworker/2:2+events23:54:132
11565599199510,1982cyclictest186187-21kworker/0:2+events22:54:250
1156609919885,1980cyclictest200691-21kworker/2:0+events23:32:512
11565599198810,1975cyclictest149215-21kworker/0:1+events21:03:500
11566099198710,1974cyclictest211115-21kworker/2:3+events00:11:242
1156609919848,1973cyclictest116932-21kworker/2:0+events19:24:342
11565799198310,1969cyclictest141169-21kworker/1:0+events20:41:111
11565799197710,1964cyclictest190899-21kworker/1:1+events23:04:191
1156579919754,1968cyclictest136553-21kworker/1:0+events20:17:101
1156609919745,1965cyclictest128507-21kworker/2:0+events19:46:482
1156609919745,1965cyclictest128507-21kworker/2:0+events19:46:482
1156609919738,1962cyclictest190867-21kworker/2:2+events23:16:492
11566099197310,1960cyclictest138000-21kworker/2:0+events20:17:322
1156659919709,1958cyclictest217285-21kworker/3:1+events00:25:563
1156579919669,1954cyclictest115138-21kworker/1:2+events19:12:231
1156609919619,1950cyclictest110952-21kworker/2:2+events19:10:522
1156579919538,1942cyclictest193119-21kworker/1:2+events23:22:121
1156579919517,1941cyclictest141169-21kworker/1:0+events20:50:251
11565599194710,1934cyclictest152620-21kworker/0:0+events21:07:130
1156559919449,1932cyclictest186187-21kworker/0:2+events23:04:420
1156659919412,1936cyclictest218976-21kworker/3:2+events00:35:433
1156659919412,1936cyclictest218976-21kworker/3:2+events00:35:423
1156559919365,1929cyclictest125617-21kworker/0:2+events20:25:010
1156559919319,1919cyclictest189518-21kworker/0:0+events23:11:050
1156609919228,1910cyclictest215561-21kworker/2:0+events00:17:512
1156559919219,1909cyclictest195991-21kworker/0:0+events23:26:020
1156659918699,1857cyclictest135160-21kworker/3:1+events20:23:283
1156559918669,1854cyclictest114135-21kworker/0:0+events19:11:150
1152972155105,43sleep10-21swapper/119:07:541
115125214197,41sleep00-21swapper/019:05:410
11565799140137,2cyclictest119170-21kworker/1:0+pm19:39:511
1153932139110,24sleep30-21swapper/319:09:083
1154452136105,26sleep20-21swapper/219:09:472
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional