You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 03:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Mon Nov 24, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
80244699312113,3103cyclictest882734-21kworker/0:0+events23:35:160
80244699269312,2677cyclictest893817-21kworker/0:0+events00:05:240
80245699255811,2542cyclictest884266-21kworker/3:0+events23:45:113
80245399254112,2525cyclictest828153-21kworker/2:0+events20:35:192
80245099250612,2490cyclictest856886-21kworker/1:2+events22:00:191
80245399244212,2427cyclictest822225-21kworker/2:2+events20:30:162
80244699243612,2420cyclictest811846-21kworker/0:0+events19:40:150
80244699241911,2406cyclictest856947-21kworker/0:1+events22:35:200
8024509923973,2391cyclictest906406-21kworker/1:2+events00:35:201
80245099238412,2368cyclictest825234-21kworker/1:1+events20:25:181
8024509923779,2364cyclictest863385-21kworker/1:0+events22:22:021
80245099235911,2345cyclictest900245-21kworker/1:0+events00:31:291
80245099233112,2316cyclictest868140-21kworker/1:0+events22:45:001
80245099232111,2306cyclictest865266-21kworker/1:2+events22:26:331
80244699230810,2294cyclictest874528-21kworker/0:1+events22:56:490
80245099228912,2274cyclictest877952-21kworker/1:2+events23:16:171
80245099228811,2273cyclictest904777-21kworker/1:1+events00:29:581
80245399227611,2262cyclictest832782-21kworker/2:2+events20:51:302
80245399224310,2230cyclictest856853-21kworker/2:2+events22:07:342
80244699224211,2228cyclictest868323-21kworker/0:2+events22:52:160
80245699222611,2212cyclictest873043-21kworker/3:1+events23:13:363
8024539922259,2212cyclictest892155-21kworker/2:2+events00:03:502
80245399222113,2204cyclictest892155-21kworker/2:2+events00:06:302
80245699221810,2205cyclictest881100-21kworker/3:2+events23:17:013
80245399221611,2202cyclictest856853-21kworker/2:2+events22:11:212
80245699221411,2200cyclictest873043-21kworker/3:1+events23:03:383
80245699221311,2198cyclictest810392-21kworker/3:1+events19:48:103
80245399221311,2199cyclictest872863-21kworker/2:0+events22:51:282
80245399221210,2199cyclictest872863-21kworker/2:0+events23:08:372
80245699221010,2197cyclictest825050-21kworker/3:1+events20:24:543
8024539922108,2199cyclictest868082-21kworker/2:1+events22:32:172
80245399221011,2196cyclictest901576-21kworker/2:0+events00:16:242
8024569922098,2197cyclictest884266-21kworker/3:0+events23:38:193
80245399220910,2196cyclictest892155-21kworker/2:2+events00:32:402
8024539922069,2194cyclictest822225-21kworker/2:2+events20:29:092
80245699220511,2191cyclictest893848-21kworker/3:0+events23:53:363
80245099220211,2188cyclictest815598-21kworker/1:1+events19:59:351
80245699220111,2187cyclictest831304-21kworker/3:1+events20:38:173
80245099220111,2187cyclictest831423-21kworker/1:0+events20:53:441
8024569921988,2186cyclictest858333-21kworker/3:1+events22:11:453
80245699219811,2184cyclictest890495-21kworker/3:1+events23:41:473
80245699219611,2182cyclictest873043-21kworker/3:1+events22:54:543
80245399219611,2182cyclictest884328-21kworker/2:1+events23:23:272
80245399219611,2182cyclictest863171-21kworker/2:1+events22:17:512
80245099219611,2182cyclictest888988-21kworker/1:0+events23:46:221
80245099219611,2182cyclictest831423-21kworker/1:0+events20:56:261
8024509921938,2182cyclictest821627-21kworker/1:0+events20:06:301
80245699219210,2178cyclictest869777-21kworker/3:2+events22:40:213
80245099218811,2174cyclictest898638-21kworker/1:2+events00:11:041
80245399218511,2171cyclictest847122-21kworker/2:1+events21:28:312
80245099218511,2170cyclictest831423-21kworker/1:0+events21:04:531
80245099218510,2172cyclictest895358-21kworker/1:0+events00:04:131
8024569921849,2172cyclictest892096-21kworker/3:2+events00:01:113
8024569921809,2168cyclictest847034-21kworker/3:1+events21:27:463
80245399218011,2166cyclictest847122-21kworker/2:1+events21:41:582
80245399218010,2167cyclictest892155-21kworker/2:2+events23:57:472
8024539921799,2167cyclictest888927-21kworker/2:1+events23:37:092
80245399217711,2162cyclictest884328-21kworker/2:1+events23:27:392
80245699217611,2163cyclictest813642-21kworker/3:0+events19:50:063
80245699217610,2163cyclictest865089-21kworker/3:1+events22:31:073
8024539921768,2164cyclictest874466-21kworker/2:2+events22:56:032
80245699217411,2159cyclictest826705-21kworker/3:0+events20:26:053
80245099217111,2157cyclictest825234-21kworker/1:1+events20:22:591
80245099216710,2154cyclictest874407-21kworker/1:1+events22:56:271
80245699216510,2152cyclictest903436-21kworker/3:2+events00:29:143
8024509921655,2157cyclictest888988-21kworker/1:0+events23:38:421
80245399216310,2150cyclictest836057-21kworker/2:1+events21:00:392
8024509921618,2150cyclictest855254-21kworker/1:0+events21:56:271
80245099215711,2142cyclictest860148-21kworker/1:1+events22:19:461
80245099215710,2144cyclictest815598-21kworker/1:1+events20:03:511
80245699215211,2138cyclictest881100-21kworker/3:2+events23:20:483
80245699214810,2136cyclictest901784-21kworker/3:0+events00:20:103
8024569921428,2131cyclictest831304-21kworker/3:1+events20:42:573
80244699213911,2125cyclictest882734-21kworker/0:0+events23:30:190
80244699213310,2119cyclictest834605-21kworker/0:2+events20:50:200
80244699212911,2115cyclictest817021-21kworker/0:2+events20:04:580
8024539921267,2116cyclictest888927-21kworker/2:1+events23:41:242
80244699212611,2112cyclictest828243-21kworker/0:2+events20:32:360
80244699212611,2111cyclictest848852-21kworker/0:2+events21:36:090
80244699212411,2111cyclictest840653-21kworker/0:1+events21:10:340
80244699212410,2111cyclictest892187-21kworker/0:2+events23:50:310
80244699211911,2104cyclictest823200-21kworker/0:0+events20:16:290
80244699211811,2104cyclictest840653-21kworker/0:1+events21:07:320
80244699211810,2105cyclictest901750-21kworker/0:0+events00:39:110
80244699211710,2104cyclictest881071-21kworker/0:1+events23:13:580
80244699211611,2102cyclictest881071-21kworker/0:1+events23:15:330
80244699211611,2102cyclictest836237-21kworker/0:1+events20:56:030
80244699211510,2102cyclictest807302-21kworker/0:2+events19:30:440
80245699211011,2096cyclictest873043-21kworker/3:1+events23:09:023
80245699210811,2094cyclictest831304-21kworker/3:1+events21:09:023
8024539921089,2096cyclictest868082-21kworker/2:1+events22:36:062
8024569921059,2093cyclictest903436-21kworker/3:2+events00:36:553
8024569921048,2093cyclictest858333-21kworker/3:1+events22:08:203
8024469921034,2096cyclictest901750-21kworker/0:0+events00:29:380
80245099210211,2088cyclictest890645-21kworker/1:2+events23:50:541
8024539920969,2084cyclictest828153-21kworker/2:0+events20:40:142
80245399209410,2080cyclictest834447-21kworker/2:0+events20:47:592
80245099209411,2080cyclictest841052-21kworker/1:2+events21:49:591
80245699208510,2072cyclictest905048-21kworker/3:0+events00:33:023
8024539920859,2073cyclictest818653-21kworker/2:2+events19:59:122
80244699208111,2067cyclictest884417-21kworker/0:1+events23:24:360
80245399208011,2066cyclictest908162-21kworker/2:1+events00:39:592
80244699208011,2066cyclictest848852-21kworker/0:2+events21:52:160
8024569920776,2067cyclictest893848-21kworker/3:0+events00:06:533
80245699207610,2063cyclictest807125-21kworker/3:2+events19:26:563
8024509920768,2066cyclictest839410-21kworker/1:1+events21:15:111
8024469920769,2063cyclictest897279-21kworker/0:2+events00:17:510
8024539920758,2064cyclictest879736-21kworker/2:1+events23:10:322
80245399207510,2062cyclictest843829-21kworker/2:0+events21:17:502
8024539920728,2061cyclictest812087-21kworker/2:1+events20:01:062
80245399207210,2059cyclictest865057-21kworker/2:0+events22:23:112
8024539920716,2062cyclictest856853-21kworker/2:2+events21:58:022
8024569920707,2060cyclictest861571-21kworker/3:2+events22:17:293
8024569920702,2065cyclictest847034-21kworker/3:1+events21:31:363
8024539920704,2062cyclictest847122-21kworker/2:1+events21:46:132
8024569920699,2056cyclictest853858-21kworker/3:0+events21:56:513
8024569920689,2056cyclictest817111-21kworker/3:2+events19:57:173
8024539920689,2056cyclictest843829-21kworker/2:0+events21:23:142
80245399206610,2052cyclictest822225-21kworker/2:2+events20:11:072
8024569920657,2056cyclictest828053-21kworker/3:3+events20:34:553
8024569920655,2057cyclictest811997-21kworker/3:2+events19:38:223
80245699206510,2052cyclictest898522-21kworker/3:1+events00:12:593
8024539920659,2053cyclictest808849-21kworker/2:0+events19:42:072
80245399206410,2051cyclictest847122-21kworker/2:1+events21:51:092
80245399206310,2050cyclictest890552-21kworker/2:0+events23:54:212
80245399206310,2050cyclictest882644-21kworker/2:0+events23:19:162
80244699206311,2049cyclictest866688-21kworker/0:0+events22:28:510
8024509920628,2051cyclictest805715-21kworker/1:1+events19:18:561
80245399206110,2049cyclictest847122-21kworker/2:1+events21:30:062
8024509920619,2048cyclictest900245-21kworker/1:0+events00:23:091
8024539920609,2048cyclictest824775-21kworker/2:0+events20:19:342
8024539920605,2052cyclictest813760-21kworker/2:2+events19:45:302
80245399206010,2047cyclictest847122-21kworker/2:1+events21:38:302
8024539920579,2045cyclictest807184-21kworker/2:2+events19:22:442
80245399205710,2044cyclictest822225-21kworker/2:2+events20:23:222
80245399205410,2041cyclictest808849-21kworker/2:0+events19:38:432
8024469920549,2042cyclictest805622-21kworker/0:0+events19:23:060
80245699205310,2040cyclictest886079-21kworker/3:2+events23:34:553
80244699205311,2039cyclictest860178-21kworker/0:0+events22:09:510
8024539920529,2039cyclictest808849-21kworker/2:0+events19:33:012
80245399205210,2039cyclictest837690-21kworker/2:2+events20:59:062
8024509920529,2040cyclictest851611-21kworker/1:0+events21:42:221
8024469920519,2039cyclictest820381-21kworker/0:1+events20:10:440
80245699205012,2036cyclictest871408-21kworker/3:0+events22:48:263
80245099205010,2037cyclictest874407-21kworker/1:1+events23:00:371
80245699204810,2035cyclictest861571-21kworker/3:2+events22:26:573
8024539920487,2038cyclictest800421-21kworker/2:1+events19:27:422
8024509920488,2036cyclictest888988-21kworker/1:0+events23:42:341
80245099204810,2035cyclictest868140-21kworker/1:0+events22:33:031
8024569920478,2036cyclictest839381-21kworker/3:0+events21:12:303
8024569920475,2039cyclictest865089-21kworker/3:1+events22:37:163
8024569920474,2040cyclictest871408-21kworker/3:0+events22:55:413
8024539920474,2040cyclictest892155-21kworker/2:2+events00:28:262
8024509920478,2036cyclictest884444-21kworker/1:2+events23:27:151
80245699204610,2033cyclictest865089-21kworker/3:1+events22:24:193
80245699204610,2033cyclictest850505-21kworker/3:2+events21:53:013
80245699204610,2032cyclictest821717-21kworker/3:2+events20:19:113
8024539920468,2035cyclictest878098-21kworker/2:2+events23:33:462
8024509920468,2034cyclictest815598-21kworker/1:1+events19:50:521
80245099204610,2033cyclictest900245-21kworker/1:0+events00:19:461
8024569920458,2034cyclictest821717-21kworker/3:2+events20:07:393
80245699204410,2031cyclictest831304-21kworker/3:1+events20:57:353
80245399204410,2031cyclictest820352-21kworker/2:0+events20:06:062
80245699204310,2030cyclictest850505-21kworker/3:2+events21:49:133
8024569920429,2030cyclictest831304-21kworker/3:1+events20:51:523
80245399204110,2028cyclictest840982-21kworker/2:1+events21:13:152
8024509920419,2028cyclictest825234-21kworker/1:1+events20:32:591
8024539920408,2029cyclictest802133-21kworker/2:2+events19:14:022
8024509920396,2030cyclictest810303-21kworker/1:2+events19:34:091
80244699203811,2024cyclictest843892-21kworker/0:1+events21:21:190
8024539920368,2025cyclictest890552-21kworker/2:0+events23:49:222
8024509920339,2021cyclictest829760-21kworker/1:2+events20:42:341
8024509920328,2021cyclictest871643-21kworker/1:3+events22:53:011
80244699203210,2019cyclictest871315-21kworker/0:0+events22:42:180
8024509920299,2017cyclictest860148-21kworker/1:1+events22:12:541
8024509920297,2019cyclictest868140-21kworker/1:0+events22:48:021
8024509920297,2019cyclictest805715-21kworker/1:1+events19:36:521
80245099202910,2016cyclictest895358-21kworker/1:0+events23:58:111
80245099202810,2015cyclictest881191-21kworker/1:1+events23:22:201
80245099202810,2015cyclictest845402-21kworker/1:0+events21:24:221
80245099202710,2014cyclictest876299-21kworker/1:0+events23:10:551
80245099202510,2012cyclictest845402-21kworker/1:0+events21:27:001
8024569920239,2011cyclictest832932-21kworker/3:2+events20:46:483
80245099202210,2009cyclictest881191-21kworker/1:1+events23:31:061
8024569920218,2010cyclictest823320-21kworker/3:0+events20:13:263
8024509920214,2014cyclictest865266-21kworker/1:2+events22:39:141
8024569920188,2007cyclictest839381-21kworker/3:0+events21:17:053
8024509920167,2005cyclictest877952-21kworker/1:2+events23:07:051
80244699201410,2001cyclictest893817-21kworker/0:0+events23:56:160
80245699201310,2000cyclictest839381-21kworker/3:0+events21:36:573
80245399201010,1997cyclictest892155-21kworker/2:2+events00:11:502
8024569920099,1997cyclictest820101-21kworker/3:1+events20:03:273
8024569920095,2000cyclictest900182-21kworker/3:2+events00:16:473
8024539920099,1997cyclictest869683-21kworker/2:2+events22:40:462
8024539920073,2001cyclictest903230-21kworker/2:1+events00:22:022
8024509920076,1998cyclictest821627-21kworker/1:0+events20:17:391
8024539920035,1995cyclictest803919-21kworker/2:0+events19:15:112
80244699200311,1989cyclictest826468-21kworker/0:1+events20:26:510
80244699200110,1987cyclictest832992-21kworker/0:0+events20:49:090
8024509919999,1987cyclictest813586-21kworker/1:2+events19:44:221
8024569919988,1987cyclictest858333-21kworker/3:1+events22:04:333
8024539919988,1987cyclictest856853-21kworker/2:2+events22:03:452
8024539919977,1987cyclictest872863-21kworker/2:0+events23:01:012
8024539919959,1984cyclictest839320-21kworker/2:0+events21:06:462
8024569919936,1984cyclictest805504-21kworker/3:1+events19:17:283
8024569919909,1978cyclictest805504-21kworker/3:1+events19:20:493
80245699198710,1974cyclictest884266-21kworker/3:0+events23:29:563
8024509919875,1979cyclictest856886-21kworker/1:2+events22:06:471
8024469919878,1976cyclictest837900-21kworker/0:2+events21:03:200
80245099198510,1972cyclictest892335-21kworker/1:1+events00:08:241
80244699198410,1971cyclictest856947-21kworker/0:1+events22:33:490
8024569919837,1973cyclictest839381-21kworker/3:0+events21:20:543
80245399198310,1970cyclictest868082-21kworker/2:1+events22:46:102
8024539919829,1970cyclictest865057-21kworker/2:0+events22:25:502
8024509919807,1970cyclictest803699-21kworker/1:0+events19:20:271
8024509919773,1971cyclictest841052-21kworker/1:2+events21:34:401
8024569919769,1964cyclictest850505-21kworker/3:2+events21:43:313
8024539919758,1964cyclictest812087-21kworker/2:1+events19:50:292
8024509919743,1968cyclictest829760-21kworker/1:2+events20:36:051
8024509919742,1969cyclictest848703-21kworker/1:1+events21:35:251
80244699197410,1961cyclictest868323-21kworker/0:2+events22:46:330
8024469919736,1964cyclictest837900-21kworker/0:2+events21:19:230
8024469919729,1961cyclictest868323-21kworker/0:2+events23:05:100
8024469919728,1961cyclictest823200-21kworker/0:0+events20:21:510
80244699197210,1959cyclictest895486-21kworker/0:1+events00:02:200
80244699197210,1959cyclictest892187-21kworker/0:2+events23:48:370
8024469919719,1959cyclictest897279-21kworker/0:2+events00:20:330
80244699197110,1958cyclictest845522-21kworker/0:0+events21:28:070
80244699197110,1958cyclictest809085-21kworker/0:1+events19:56:540
80244699197110,1957cyclictest897279-21kworker/0:2+events00:12:120
8024569919669,1954cyclictest808787-21kworker/3:0+events19:32:163
80245099196410,1951cyclictest839410-21kworker/1:1+events21:10:571
8024469919649,1953cyclictest848852-21kworker/0:2+events21:58:240
8024469919648,1953cyclictest848852-21kworker/0:2+events21:48:060
80244699196410,1951cyclictest860178-21kworker/0:0+events22:12:090
8024469919639,1951cyclictest809085-21kworker/0:1+events19:52:460
80244699196310,1950cyclictest809085-21kworker/0:1+events19:48:580
80244699196310,1950cyclictest805622-21kworker/0:0+events19:27:190
8024469919629,1950cyclictest832992-21kworker/0:0+events20:44:290
8024469919628,1951cyclictest848852-21kworker/0:2+events21:41:350
8024569919616,1952cyclictest811997-21kworker/3:2+events19:41:433
8024509919609,1948cyclictest803699-21kworker/1:0+events19:13:391
8024469919606,1951cyclictest809085-21kworker/0:1+events19:35:420
8024569919589,1946cyclictest831304-21kworker/3:1+events21:04:303
8024509919589,1946cyclictest855254-21kworker/1:0+events21:54:321
8024469919587,1948cyclictest861878-21kworker/0:2+events22:23:340
8024469919584,1951cyclictest882734-21kworker/0:0+events23:42:110
8024469919584,1951cyclictest848852-21kworker/0:2+events22:01:030
8024509919438,1932cyclictest811939-21kworker/1:0+events19:49:421
8024469919377,1927cyclictest845522-21kworker/0:0+events21:32:470
8024469919304,1923cyclictest876863-21kworker/0:0+events23:02:520
8024569919269,1914cyclictest798962-21kworker/3:2+events19:14:263
8024569919119,1899cyclictest893848-21kworker/3:0+events23:56:383
8024469919069,1894cyclictest802222-21kworker/0:1+events19:17:060
80244699189810,1885cyclictest828243-21kworker/0:2+events20:36:500
8024469918957,1885cyclictest856947-21kworker/0:1+events22:15:540
8024509918934,1886cyclictest831423-21kworker/1:0+events20:46:241
8024469918939,1881cyclictest884417-21kworker/0:1+events23:28:230
8024509918918,1880cyclictest821627-21kworker/1:0+events20:13:021
8024469918178,1806cyclictest905078-21kworker/0:2+events00:30:210
8024469915838,1574cyclictest800628-21kworker/0:2+events19:10:100
8021962173143,25sleep30-21swapper/319:09:413
8021782139108,27sleep00-21swapper/019:09:260
8015242139107,22sleep10-21swapper/119:05:191
8019892138109,24sleep20-21swapper/219:07:042
80244699201,6cyclictest822000-21perf-exec20:10:000
802450991816,1cyclictest0-21swapper/121:05:141
80245099135,5cyclictest807746-21apt-get19:25:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional