You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 21:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Mon Dec 22, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23579299284414,2826cyclictest301640-21kworker/3:2+events22:58:073
23579299284414,2826cyclictest301640-21kworker/3:2+events22:58:073
23579099282914,2810cyclictest261777-21kworker/2:0+events20:35:002
23579099277913,2761cyclictest327265-21kworker/2:1+events00:05:132
23578599275710,2743cyclictest296549-21kworker/1:0+events22:25:191
23579299266412,2648cyclictest288705-21kworker/3:2+events22:05:193
23578599265411,2638cyclictest320948-21kworker/1:2+events23:35:151
23579299264213,2627cyclictest326021-21kworker/3:2+events00:10:153
23578599261312,2598cyclictest263113-21kworker/1:0+events20:40:191
23578299260612,2591cyclictest290275-21kworker/0:2+events22:00:010
23579099256811,2553cyclictest309513-21kworker/2:0+events23:20:172
23579099254112,2524cyclictest285262-21kworker/2:2+events21:45:122
2357859924659,2451cyclictest328690-21kworker/1:2+events00:00:131
23578599244212,2426cyclictest282094-21kworker/1:2+events21:33:201
23578599244111,2426cyclictest320948-21kworker/1:2+events23:45:161
2357859924269,2413cyclictest272912-21kworker/1:1+events21:10:141
23578599241112,2395cyclictest314233-21kworker/1:0+events23:40:141
23578299240112,2385cyclictest294823-21kworker/0:2+events22:30:170
23578299239811,2383cyclictest304803-21kworker/0:1+events23:25:160
23579099239312,2379cyclictest311194-21kworker/2:2+events23:05:202
23579299239112,2375cyclictest238941-21kworker/3:2+events19:26:103
23578299239011,2375cyclictest272742-21kworker/0:0+events21:05:200
23578299236212,2346cyclictest309422-21kworker/0:2+events22:59:380
23578299236212,2346cyclictest309422-21kworker/0:2+events22:59:370
23579299232711,2313cyclictest261839-21kworker/3:1+events20:35:233
23579299232311,2309cyclictest244468-21kworker/3:2+events19:50:393
23578599231812,2303cyclictest251991-21kworker/1:1+events20:05:261
23579299231612,2300cyclictest324147-21kworker/3:1+events23:55:163
23578599231112,2295cyclictest312526-21kworker/1:1+events23:09:301
23579299230911,2295cyclictest252019-21kworker/3:2+events20:10:233
23578599229910,2286cyclictest333815-21kworker/1:2+events00:19:021
2357909922989,2286cyclictest282422-21kworker/2:0+events22:07:582
23579099228811,2275cyclictest335334-21kworker/2:1+events00:25:092
2357929922788,2267cyclictest266405-21kworker/3:0+events20:47:093
23578299227311,2259cyclictest271027-21kworker/0:1+events20:57:450
23578299227311,2259cyclictest271027-21kworker/0:1+events20:57:450
23579099226111,2247cyclictest309513-21kworker/2:0+events23:11:032
2357829922589,2246cyclictest316098-21kworker/0:0+events23:20:400
2357929922546,2245cyclictest301640-21kworker/3:2+events22:36:263
23579099225212,2237cyclictest245506-21kworker/2:0+events19:41:272
23579099223811,2224cyclictest261777-21kworker/2:0+events20:37:162
23579099223611,2222cyclictest309513-21kworker/2:0+events23:19:072
23579099223210,2218cyclictest306134-21kworker/2:1+events22:55:512
23579099223210,2218cyclictest306134-21kworker/2:1+events22:55:512
23579099222711,2213cyclictest319425-21kworker/2:0+events23:43:432
23579099222711,2212cyclictest279160-21kworker/2:0+events21:26:542
23579099222610,2213cyclictest319425-21kworker/2:0+events23:32:592
23579099222610,2213cyclictest261777-21kworker/2:0+events20:29:592
23579099222511,2211cyclictest306134-21kworker/2:1+events22:52:012
23579099222310,2209cyclictest333608-21kworker/2:0+events00:22:312
23579099222211,2207cyclictest245506-21kworker/2:0+events20:04:192
2357909922219,2209cyclictest266436-21kworker/2:2+events20:57:012
2357909922219,2209cyclictest266436-21kworker/2:2+events20:57:002
23579099222011,2205cyclictest290095-21kworker/2:1+events22:04:562
2357829922209,2207cyclictest283726-21kworker/0:0+events21:36:470
23578299221810,2205cyclictest248788-21kworker/0:1+events20:02:010
23579099221710,2204cyclictest253647-21kworker/2:2+events20:06:352
2357829922159,2203cyclictest324178-21kworker/0:2+events23:51:230
23578299221411,2201cyclictest277621-21kworker/0:2+events21:20:040
23578299221411,2200cyclictest256698-21kworker/0:1+events20:30:230
2357929922139,2201cyclictest294736-21kworker/3:0+events22:25:433
23578299220910,2196cyclictest252109-21kworker/0:2+events20:14:310
2357829922069,2194cyclictest303156-21kworker/0:2+events22:40:400
23578299220611,2192cyclictest239122-21kworker/0:0+events19:22:410
23578299220510,2192cyclictest248788-21kworker/0:1+events19:51:460
23579099220411,2190cyclictest301579-21kworker/2:2+events22:39:082
2357829922049,2192cyclictest332061-21kworker/0:0+events00:17:520
23579099220311,2189cyclictest325511-21kworker/2:2+events23:54:062
23578299220311,2189cyclictest322546-21kworker/0:1+events23:59:050
23578299220211,2188cyclictest332061-21kworker/0:0+events00:25:320
23578299220210,2189cyclictest304803-21kworker/0:1+events23:14:510
2357909922009,2188cyclictest255274-21kworker/2:1+events20:16:032
23578299220011,2186cyclictest324178-21kworker/0:2+events23:46:270
23579099219911,2185cyclictest303187-21kworker/2:0+events22:46:162
23578299219911,2185cyclictest282133-21kworker/0:2+events21:42:080
23579299219711,2182cyclictest326021-21kworker/3:2+events23:54:283
23579099219510,2183cyclictest255274-21kworker/2:1+events20:11:312
23578299219411,2180cyclictest252109-21kworker/0:2+events20:29:160
2357829921929,2180cyclictest264989-21kworker/0:1+events20:43:220
23579099218610,2172cyclictest239186-21kworker/2:1+events19:28:042
23578299218410,2171cyclictest247131-21kworker/0:0+events19:57:480
2357929921825,2174cyclictest235258-21kworker/3:0+events19:16:073
23578299217911,2165cyclictest320914-21kworker/0:0+events23:35:590
23579099217510,2162cyclictest242291-21kworker/2:2+events19:30:442
2357909921654,2158cyclictest319425-21kworker/2:0+events23:48:452
2357829921657,2155cyclictest279274-21kworker/0:1+events21:33:450
23579099216210,2149cyclictest263446-21kworker/2:1+events20:42:362
2357929921569,2144cyclictest283664-21kworker/3:2+events21:37:093
23579099215410,2141cyclictest268152-21kworker/2:0+events20:53:592
2357929921498,2138cyclictest261839-21kworker/3:1+events20:31:083
23579299214811,2134cyclictest328722-21kworker/3:0+events00:01:453
2357859921478,2136cyclictest250334-21kworker/1:0+events19:58:351
2357929921457,2135cyclictest240835-21kworker/3:0+events19:31:303
23579299214511,2131cyclictest332031-21kworker/3:1+events00:38:303
23579299214511,2131cyclictest290306-21kworker/3:0+events22:00:233
23579299214511,2131cyclictest271265-21kworker/3:0+events21:21:343
23578599214511,2131cyclictest293377-21kworker/1:2+events22:15:521
2357929921449,2132cyclictest244468-21kworker/3:2+events19:42:363
23578599214211,2127cyclictest304863-21kworker/1:2+events23:03:261
23578299214210,2129cyclictest322546-21kworker/0:1+events00:09:530
2357929921419,2129cyclictest279070-21kworker/3:1+events21:40:143
23579299214111,2127cyclictest317549-21kworker/3:0+events23:28:413
23578599214110,2128cyclictest274781-21kworker/1:0+events21:15:311
2357929921409,2128cyclictest301640-21kworker/3:2+events23:21:033
23579299214011,2126cyclictest252019-21kworker/3:2+events19:59:423
23579299213910,2126cyclictest332031-21kworker/3:1+events00:27:513
23578599213911,2125cyclictest263113-21kworker/1:0+events20:59:181
23578599213911,2125cyclictest263113-21kworker/1:0+events20:59:181
23579299213611,2123cyclictest301640-21kworker/3:2+events22:50:083
23578599213410,2121cyclictest312526-21kworker/1:1+events23:16:001
23578599213210,2119cyclictest263113-21kworker/1:0+events21:03:261
23579299213011,2116cyclictest259858-21kworker/3:0+events20:26:133
23579299212711,2113cyclictest301640-21kworker/3:2+events23:03:013
23579099212510,2112cyclictest327265-21kworker/2:1+events23:59:292
2357859921226,2112cyclictest279247-21kworker/1:1+events21:25:211
2357909921199,2107cyclictest330847-21kworker/2:2+events00:12:552
23579299211210,2098cyclictest296395-21kworker/3:1+events22:32:563
2357859921129,2100cyclictest258149-21kworker/1:2+events20:17:351
23579099211110,2098cyclictest309513-21kworker/2:0+events23:00:232
23578599211110,2097cyclictest247250-21kworker/1:2+events19:52:311
23578299210610,2093cyclictest304803-21kworker/0:1+events22:45:290
23579099210511,2091cyclictest333608-21kworker/2:0+events00:19:252
23578599210312,2087cyclictest241045-21kworker/1:0+events19:25:231
23578599209211,2078cyclictest271294-21kworker/1:2+events21:07:361
23578299208810,2075cyclictest322546-21kworker/0:1+events23:44:530
23579099208511,2071cyclictest294790-21kworker/2:2+events22:12:012
2357909920727,2062cyclictest316004-21kworker/2:2+events23:29:522
23578299207111,2057cyclictest298079-21kworker/0:0+events22:38:460
23578299206710,2054cyclictest274398-21kworker/0:1+events21:12:080
2357929920666,2057cyclictest301640-21kworker/3:2+events23:16:233
23579099206410,2050cyclictest338769-21kworker/2:0+events00:34:172
23578599206111,2047cyclictest293377-21kworker/1:2+events22:09:471
23578299205910,2046cyclictest309422-21kworker/0:2+events23:07:130
2357859920589,2046cyclictest289545-21kworker/1:1+events21:57:451
2357929920579,2044cyclictest288705-21kworker/3:2+events21:56:113
2357859920565,2048cyclictest324446-21kworker/1:1+events23:52:571
23578599205510,2042cyclictest241045-21kworker/1:0+events19:39:361
2357929920549,2042cyclictest319211-21kworker/3:1+events23:30:153
2357859920529,2040cyclictest274781-21kworker/1:0+events21:24:361
2357929920469,2034cyclictest301640-21kworker/3:2+events23:14:303
23578599204510,2032cyclictest303096-21kworker/1:0+events22:46:391
23579299204410,2031cyclictest252019-21kworker/3:2+events20:54:423
2357909920418,2030cyclictest275818-21kworker/2:1+events21:31:042
2357909920416,2032cyclictest245506-21kworker/2:0+events19:48:182
2357859920409,2028cyclictest259917-21kworker/1:1+events20:25:521
2357909920399,2027cyclictest335334-21kworker/2:1+events00:36:572
23579299203310,2020cyclictest332031-21kworker/3:1+events00:08:413
23579099203310,2020cyclictest266436-21kworker/2:2+events21:17:242
2357909920329,2020cyclictest294790-21kworker/2:2+events22:18:542
23579099203110,2018cyclictest328873-21kworker/2:0+events00:04:022
23579099203110,2018cyclictest259769-21kworker/2:2+events20:22:262
23579099203010,2017cyclictest316004-21kworker/2:2+events23:37:332
23579099203010,2017cyclictest237169-21kworker/2:0+events19:19:592
2357929920299,2017cyclictest320884-21kworker/3:2+events23:36:243
2357909920295,2021cyclictest248700-21kworker/2:2+events19:51:232
2357909920289,2016cyclictest275818-21kworker/2:1+events21:23:292
2357909920284,2021cyclictest296578-21kworker/2:1+events22:26:312
23578599202811,2014cyclictest263113-21kworker/1:0+events20:51:421
2357829920288,2017cyclictest274398-21kworker/0:1+events21:15:530
23579099202710,2014cyclictest299563-21kworker/2:0+events22:31:272
2357909920263,2020cyclictest303187-21kworker/2:0+events22:41:002
23579099202510,2013cyclictest239186-21kworker/2:1+events19:21:552
2357829920255,2012cyclictest244167-21kworker/0:2+events19:41:510
23579099202410,2011cyclictest294790-21kworker/2:2+events22:23:262
23579099202410,2011cyclictest239186-21kworker/2:1+events19:38:042
2357929920229,2010cyclictest252019-21kworker/3:2+events20:01:383
2357829920221,2018cyclictest252109-21kworker/0:2+events20:16:480
23579099202110,2008cyclictest273004-21kworker/2:0+events21:08:002
23578299202110,2008cyclictest322546-21kworker/0:1+events00:00:350
2357829920209,2008cyclictest304803-21kworker/0:1+events22:50:520
23578299201910,2007cyclictest271027-21kworker/0:1+events21:00:250
2357829920189,2006cyclictest294823-21kworker/0:2+events22:12:480
2357829920185,2010cyclictest332061-21kworker/0:0+events00:33:090
2357829920184,2012cyclictest294823-21kworker/0:2+events22:26:060
2357829920177,2007cyclictest252109-21kworker/0:2+events20:45:370
2357829920173,2011cyclictest294823-21kworker/0:2+events22:17:020
23579099201610,2003cyclictest266436-21kworker/2:2+events21:11:222
23579099201610,2002cyclictest282422-21kworker/2:0+events21:51:382
2357829920154,2008cyclictest288673-21kworker/0:0+events22:03:210
23578299201210,1999cyclictest279274-21kworker/0:1+events21:27:380
2357829920119,1999cyclictest322546-21kworker/0:1+events00:14:500
2357829920117,2001cyclictest252109-21kworker/0:2+events20:08:500
2357829920116,2002cyclictest252109-21kworker/0:2+events20:22:040
23578299201110,1998cyclictest309422-21kworker/0:2+events23:15:130
2357829920108,1999cyclictest252109-21kworker/0:2+events20:39:320
2357829920105,2002cyclictest304803-21kworker/0:1+events23:32:340
23578299201010,1997cyclictest252109-21kworker/0:2+events20:52:490
23578299201010,1997cyclictest222618-21kworker/0:2+events19:19:120
2357829920099,1997cyclictest294823-21kworker/0:2+events22:24:110
2357929920086,1999cyclictest277442-21kworker/3:2+events21:27:153
23578299200710,1994cyclictest335239-21kworker/0:2+events00:20:320
23578299200710,1994cyclictest293198-21kworker/0:1+events22:08:410
2357829920068,1995cyclictest247131-21kworker/0:0+events19:47:550
2357829920058,1994cyclictest287043-21kworker/0:1+events21:53:560
23578299200310,1990cyclictest239122-21kworker/0:0+events19:31:080
2357909920009,1988cyclictest245506-21kworker/2:0+events19:55:332
23579299199811,1984cyclictest294736-21kworker/3:0+events22:12:253
23578599199810,1987cyclictest258149-21kworker/1:2+events20:20:141
2357829919988,1987cyclictest239122-21kworker/0:0+events19:28:280
2357829919985,1989cyclictest283726-21kworker/0:0+events21:46:210
2357909919969,1985cyclictest282422-21kworker/2:0+events21:40:382
2357929919929,1980cyclictest235258-21kworker/3:0+events19:14:163
23579299199010,1977cyclictest338542-21kworker/3:2+events00:31:373
2357929919898,1978cyclictest285413-21kworker/3:0+events21:45:343
23579099198910,1976cyclictest275818-21kworker/2:1+events21:39:292
2357929919859,1973cyclictest268064-21kworker/3:1+events20:57:233
2357929919859,1973cyclictest268064-21kworker/3:1+events20:57:223
2357859919798,1968cyclictest304863-21kworker/1:2+events22:51:151
23578599197510,1962cyclictest237020-21kworker/1:1+events19:15:461
23578299196810,1955cyclictest244167-21kworker/0:2+events19:35:450
23579099196410,1951cyclictest266436-21kworker/2:2+events20:49:242
2357859919609,1948cyclictest263113-21kworker/1:0+events20:31:331
2357859919569,1944cyclictest247250-21kworker/1:2+events19:45:141
2357929919544,1947cyclictest271265-21kworker/3:0+events21:08:443
23579299195410,1941cyclictest266405-21kworker/3:0+events20:42:593
2357909919547,1944cyclictest290095-21kworker/2:1+events21:58:312
23579299195110,1938cyclictest244468-21kworker/3:2+events19:46:013
2357859919519,1939cyclictest293377-21kworker/1:2+events22:13:561
2357859919517,1941cyclictest333815-21kworker/1:2+events00:27:281
2357859919514,1944cyclictest237020-21kworker/1:1+events19:25:001
2357929919509,1938cyclictest277442-21kworker/3:2+events21:19:403
23579299195010,1937cyclictest252019-21kworker/3:2+events20:20:353
2357859919509,1938cyclictest324446-21kworker/1:1+events23:58:411
23578599195010,1937cyclictest298527-21kworker/1:1+events22:30:401
2357929919499,1937cyclictest294736-21kworker/3:0+events22:16:383
2357929919499,1937cyclictest287073-21kworker/3:1+events21:50:553
2357929919496,1940cyclictest242679-21kworker/3:1+events19:35:213
2357859919497,1939cyclictest285503-21kworker/1:2+events21:47:071
2357859919496,1940cyclictest289545-21kworker/1:1+events22:02:381
2357859919494,1942cyclictest324446-21kworker/1:1+events00:06:231
2357859919494,1942cyclictest296549-21kworker/1:0+events22:20:261
2357859919488,1937cyclictest319123-21kworker/1:1+events23:29:061
2357859919488,1937cyclictest250334-21kworker/1:0+events20:03:091
2357859919483,1942cyclictest330341-21kworker/1:0+events00:23:391
23578599194810,1935cyclictest283695-21kworker/1:0+events21:39:071
2357929919478,1936cyclictest280697-21kworker/3:0+events21:32:103
23579299194710,1934cyclictest301640-21kworker/3:2+events22:43:593
2357929919469,1936cyclictest253674-21kworker/3:1+events20:05:503
2357929919469,1934cyclictest311073-21kworker/3:1+events23:06:503
2357929919469,1934cyclictest294736-21kworker/3:0+events22:23:483
23579299194610,1934cyclictest271265-21kworker/3:0+events21:00:033
23579299194610,1933cyclictest336901-21kworker/3:0+events00:22:533
2357859919468,1934cyclictest330341-21kworker/1:0+events00:36:121
23578599194610,1933cyclictest266345-21kworker/1:2+events20:47:311
2357929919449,1932cyclictest275786-21kworker/3:1+events21:13:403
23579299194410,1931cyclictest333668-21kworker/3:0+events00:15:573
2357859919438,1932cyclictest298527-21kworker/1:1+events22:37:591
23578599194310,1930cyclictest314233-21kworker/1:0+events23:14:051
2357829919439,1931cyclictest338662-21kworker/0:2+events00:36:340
2357859919429,1930cyclictest241045-21kworker/1:0+events19:31:521
2357859919426,1933cyclictest333815-21kworker/1:2+events00:32:241
2357859919406,1931cyclictest245535-21kworker/1:1+events19:43:221
2357859919387,1928cyclictest263113-21kworker/1:0+events20:36:071
23578599193810,1925cyclictest314233-21kworker/1:0+events23:34:311
2357929919379,1925cyclictest238941-21kworker/3:2+events19:24:363
2357859919314,1924cyclictest285503-21kworker/1:2+events21:50:311
2357909919288,1917cyclictest233828-21kworker/2:1+events19:13:062
2357859919199,1907cyclictest256551-21kworker/1:0+events20:12:371
2357829919187,1908cyclictest309422-21kworker/0:2+events23:01:090
2357829919109,1898cyclictest222618-21kworker/0:2+events19:13:290
2357929919034,1896cyclictest317549-21kworker/3:0+events23:44:303
2357929918999,1887cyclictest258213-21kworker/3:1+events20:19:273
2357859918939,1881cyclictest307712-21kworker/1:1+events22:55:281
2357859918939,1881cyclictest307712-21kworker/1:1+events22:55:281
2357859918848,1873cyclictest330341-21kworker/1:0+events00:13:181
23578599188410,1869cyclictest233739-21kworker/1:0+events19:12:431
23578599186810,1855cyclictest279247-21kworker/1:1+events21:43:401
23578599186610,1853cyclictest298527-21kworker/1:1+events22:41:471
2354292151104,26sleep00-21swapper/019:08:260
235217214491,43sleep30-21swapper/319:05:453
235220214398,17sleep10-21swapper/119:05:461
2354162138105,27sleep20-21swapper/219:08:162
23579299191,6cyclictest325797-21idleruntime-cro23:50:003
23578599181,6cyclictest317120-21ntpq23:20:171
235792991711,4cyclictest306471-21awk22:50:003
23579099140,13cyclictest271864-21/usr/sbin/munin21:00:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional