You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 17:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Tue Dec 16, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
155271799291013,2893cyclictest1626769-21kworker/1:0+events00:05:001
155272299275313,2736cyclictest1597595-21kworker/3:2+events21:30:163
155272299274513,2727cyclictest1584817-21kworker/3:2+events20:50:113
15527199927418,2729cyclictest1586629-21kworker/2:2+events21:15:192
155272299271112,2695cyclictest1649842-21kworker/3:2+events00:10:193
155271799270213,2686cyclictest1575742-21kworker/1:2+events20:30:001
155271999265013,2633cyclictest1586629-21kworker/2:2+events21:20:192
155271299252212,2507cyclictest1641814-21kworker/0:1+events23:50:140
155272299245911,2444cyclictest1594270-21kworker/3:1+events21:25:163
155271799244412,2430cyclictest1562415-21kworker/1:1+events19:45:001
155271999244212,2426cyclictest1569268-21kworker/2:2+events20:20:122
155271299241712,2402cyclictest1596082-21kworker/0:1+events21:32:100
155271299241010,2397cyclictest1586716-21kworker/0:2+events21:02:500
155271799240912,2393cyclictest1626769-21kworker/1:0+events23:40:011
155271999240712,2392cyclictest1631581-21kworker/2:0+events23:17:062
155271299240712,2391cyclictest1580048-21kworker/0:2+events20:38:220
155271299240612,2390cyclictest1648458-21kworker/0:0+events00:16:450
155271299240610,2393cyclictest1641814-21kworker/0:1+events23:47:140
155271799239612,2381cyclictest1572169-21kworker/1:1+events20:15:191
155271299239412,2380cyclictest1594452-21kworker/0:2+events21:25:400
155271799238810,2374cyclictest1581770-21kworker/1:1+events20:45:151
155272299238611,2371cyclictest1641543-21kworker/3:0+events23:54:473
155271299238512,2370cyclictest1573955-21kworker/0:0+events20:28:540
155272299238211,2367cyclictest1564817-21kworker/3:2+events20:05:473
155272299237912,2363cyclictest1572738-21kworker/3:0+events20:21:193
155272299236412,2349cyclictest1632754-21kworker/3:1+events23:31:153
15527229923619,2349cyclictest1570803-21kworker/3:1+events20:10:203
155271299236012,2345cyclictest1581830-21kworker/0:1+events20:40:190
155271999235110,2337cyclictest1629844-21kworker/2:2+events23:12:282
15527199923439,2330cyclictest1615677-21kworker/2:2+events22:55:212
155271999232912,2313cyclictest1596021-21kworker/2:1+events21:34:512
155272299232411,2310cyclictest1628428-21kworker/3:0+events23:10:133
155271299231410,2301cyclictest1646485-21kworker/0:1+events00:05:440
155271299231211,2299cyclictest1604380-21kworker/0:2+events22:00:000
155271299230910,2295cyclictest1612383-21kworker/0:1+events22:16:140
155271299230512,2289cyclictest1552545-21kworker/0:2+events19:29:440
155272299229812,2283cyclictest1617076-21kworker/3:1+events22:45:303
155271999228912,2275cyclictest1638176-21kworker/2:1+events23:57:272
155272299228011,2265cyclictest1641543-21kworker/3:0+events00:01:353
155271299227210,2259cyclictest1592704-21kworker/0:0+events21:19:080
15527179922719,2259cyclictest1604349-21kworker/1:1+events22:00:241
155272299226911,2255cyclictest1618767-21kworker/3:2+events22:35:533
155271799226912,2254cyclictest1588228-21kworker/1:1+events21:10:251
155271799226912,2254cyclictest1588228-21kworker/1:1+events21:10:251
155271299226911,2255cyclictest1656487-21kworker/0:0+events00:32:440
155272299226611,2252cyclictest1604111-21kworker/3:2+events21:48:323
155271299226410,2251cyclictest1623391-21kworker/0:0+events22:50:310
155271299226310,2250cyclictest1625027-21kworker/0:2+events23:07:310
155271799226211,2248cyclictest1586537-21kworker/1:0+events21:00:541
15527129922629,2249cyclictest1573955-21kworker/0:0+events20:33:250
155271299226211,2247cyclictest1625027-21kworker/0:2+events23:02:140
155271299226111,2247cyclictest1585052-21kworker/0:1+events21:14:560
155271299226111,2247cyclictest1585052-21kworker/0:1+events21:14:560
155271299226110,2248cyclictest1604380-21kworker/0:2+events21:58:270
155272299226012,2245cyclictest1572738-21kworker/3:0+events20:25:533
155271299225911,2245cyclictest1586716-21kworker/0:2+events20:58:350
155271299225910,2246cyclictest1572199-21kworker/0:1+events20:07:150
155271299225510,2242cyclictest1565818-21kworker/0:0+events19:57:420
155271299225311,2239cyclictest1604380-21kworker/0:2+events22:06:190
155271299225310,2240cyclictest1594452-21kworker/0:2+events21:23:210
155271299225310,2240cyclictest1559259-21kworker/0:0+events19:31:120
155271299225211,2238cyclictest1600889-21kworker/0:2+events21:43:060
15527129922509,2238cyclictest1625027-21kworker/0:2+events23:22:030
155271999224210,2229cyclictest1586629-21kworker/2:2+events21:02:282
15527129922429,2230cyclictest1638264-21kworker/0:2+events23:43:510
15527129922379,2225cyclictest1636246-21kworker/0:1+events23:38:290
155272299223612,2221cyclictest1564817-21kworker/3:2+events20:03:513
15527199922328,2222cyclictest1596021-21kworker/2:1+events21:45:032
155272299223011,2216cyclictest1575314-21kworker/3:2+events20:17:573
155271799223011,2215cyclictest1614201-21kworker/1:1+events22:24:511
155272299222610,2212cyclictest1632754-21kworker/3:1+events23:29:173
155271299222311,2209cyclictest1552545-21kworker/0:2+events19:22:480
155272299222210,2209cyclictest1626593-21kworker/3:1+events22:58:503
155271799222210,2209cyclictest1621880-21kworker/1:2+events22:49:231
155272299222111,2206cyclictest1562506-21kworker/3:0+events19:39:433
155271299222111,2208cyclictest1646485-21kworker/0:1+events00:00:040
155271299222011,2206cyclictest1610537-21kworker/0:0+events22:12:480
15527229922198,2208cyclictest1612220-21kworker/3:1+events22:11:393
155272299221911,2205cyclictest1623047-21kworker/3:2+events22:51:163
15527179922198,2208cyclictest1583813-21kworker/1:2+events20:56:161
155271799221911,2205cyclictest1626769-21kworker/1:0+events23:28:321
15527229922189,2206cyclictest1600657-21kworker/3:1+events21:56:543
155271799221811,2204cyclictest1644710-21kworker/1:1+events23:55:101
155271799221710,2204cyclictest1554042-21kworker/1:1+events19:16:581
155271799221611,2201cyclictest1581770-21kworker/1:1+events20:41:271
155271799221610,2204cyclictest1631183-21kworker/1:2+events23:15:091
15527229922159,2203cyclictest1649842-21kworker/3:2+events00:23:563
155271799221511,2202cyclictest1604349-21kworker/1:1+events21:55:021
155271799221511,2200cyclictest1644710-21kworker/1:1+events23:53:171
155272299221411,2199cyclictest1639864-21kworker/3:2+events23:44:563
155271799221310,2199cyclictest1656306-21kworker/1:2+events00:27:251
155272299221210,2199cyclictest1605776-21kworker/3:0+events22:00:463
155272299221210,2199cyclictest1580347-21kworker/3:0+events20:49:253
155271799221111,2196cyclictest1657974-21kworker/1:0+events00:34:171
155271799221111,2196cyclictest1649901-21kworker/1:2+events00:12:321
15527129922118,2200cyclictest1565818-21kworker/0:0+events19:50:210
155272299221011,2195cyclictest1620399-21kworker/3:0+events22:44:193
155272299221010,2197cyclictest1641543-21kworker/3:0+events23:58:353
155272299220810,2196cyclictest1558032-21kworker/3:1+events19:30:063
15527199922089,2195cyclictest1656426-21kworker/2:2+events00:29:182
15527179922079,2195cyclictest1573865-21kworker/1:0+events20:22:511
155271799220710,2195cyclictest1618590-21kworker/1:2+events22:35:091
155272299220611,2192cyclictest1626593-21kworker/3:1+events23:00:413
155272299220610,2193cyclictest1605776-21kworker/3:0+events22:05:133
155271799220611,2191cyclictest1610386-21kworker/1:0+events22:28:201
155271799220610,2192cyclictest1612431-21kworker/1:2+events22:14:431
155271299220611,2192cyclictest1612383-21kworker/0:1+events22:21:050
155271799220511,2191cyclictest1588228-21kworker/1:1+events21:26:041
155271799220511,2191cyclictest1565760-21kworker/1:2+events19:56:331
155271799220311,2188cyclictest1556060-21kworker/1:2+events19:23:101
155271799220211,2188cyclictest1618590-21kworker/1:2+events22:32:531
155271799220010,2187cyclictest1642790-21kworker/1:2+events23:48:231
155271799219910,2185cyclictest1560606-21kworker/1:2+events19:36:141
155272299219711,2183cyclictest1632754-21kworker/3:1+events23:21:173
155272299219510,2182cyclictest1591221-21kworker/3:2+events21:19:553
155272299219211,2178cyclictest1556093-21kworker/3:0+events19:23:563
155272299219210,2179cyclictest1615470-21kworker/3:2+events22:26:243
155271799219010,2177cyclictest1580162-21kworker/1:0+events20:39:341
155271999218810,2175cyclictest1608999-21kworker/2:2+events22:14:182
15527179921858,2174cyclictest1588228-21kworker/1:1+events21:21:491
15527229921799,2167cyclictest1612220-21kworker/3:1+events22:18:063
15527229921799,2167cyclictest1580347-21kworker/3:0+events20:56:393
155271299217910,2166cyclictest1612383-21kworker/0:1+events22:25:140
155271999217011,2155cyclictest1604051-21kworker/2:0+events21:59:382
155271999217010,2156cyclictest1596021-21kworker/2:1+events21:26:262
15527129921696,2160cyclictest1583457-21kworker/0:0+events20:46:460
155271999216810,2155cyclictest1584908-21kworker/2:1+events20:59:442
155271999216711,2152cyclictest1596021-21kworker/2:1+events21:40:292
155271999216710,2154cyclictest1578622-21kworker/2:0+events20:28:302
155272299216611,2152cyclictest1639864-21kworker/3:2+events23:49:513
155271999216610,2152cyclictest1634353-21kworker/2:2+events23:32:252
15527199921656,2155cyclictest1583217-21kworker/2:2+events20:43:232
155271299216410,2151cyclictest1596082-21kworker/0:1+events21:48:090
155271999216311,2149cyclictest1559439-21kworker/2:2+events19:40:492
15527199921629,2150cyclictest1653095-21kworker/2:0+events00:22:012
155271999216211,2148cyclictest1608999-21kworker/2:2+events22:05:362
155271999216111,2146cyclictest1569268-21kworker/2:2+events20:16:482
155271799216011,2146cyclictest1597626-21kworker/1:0+events21:35:141
15527199921588,2147cyclictest1646635-21kworker/2:3+events00:15:592
155271999215811,2144cyclictest1554075-21kworker/2:1+events19:25:312
15527179921589,2146cyclictest1621880-21kworker/1:2+events22:59:561
155271299215810,2145cyclictest1573955-21kworker/0:0+events20:14:330
155272299215710,2143cyclictest1567388-21kworker/3:1+events19:52:193
155271999215711,2143cyclictest1646635-21kworker/2:3+events00:08:242
155271999215710,2144cyclictest1634353-21kworker/2:2+events23:22:252
155271999215610,2143cyclictest1573804-21kworker/2:1+events20:37:152
15527199921548,2142cyclictest1605746-21kworker/2:1+events22:03:222
15527179921478,2136cyclictest1583813-21kworker/1:2+events20:52:511
155271299214711,2133cyclictest1653155-21kworker/0:1+events00:25:290
155271999214611,2131cyclictest1573804-21kworker/2:1+events20:14:112
155271999214311,2129cyclictest1659632-21kworker/2:1+events00:40:002
155271999214011,2126cyclictest1615677-21kworker/2:2+events22:50:552
15527229921319,2119cyclictest1578743-21kworker/3:2+events20:31:303
155271999212411,2110cyclictest1567660-21kworker/2:1+events20:03:272
155272299212010,2108cyclictest1552241-21kworker/3:1+events19:17:463
15527179921028,2094cyclictest1565760-21kworker/1:2+events19:49:581
155271999210111,2086cyclictest1615677-21kworker/2:2+events22:44:432
155272299210010,2087cyclictest1578743-21kworker/3:2+events20:39:103
155271799210010,2087cyclictest1621880-21kworker/1:2+events23:04:521
15527129920905,2082cyclictest1633177-21kworker/0:0+events23:28:530
155271999208411,2070cyclictest1545571-21kworker/2:2+events19:18:312
155271299208310,2070cyclictest1612383-21kworker/0:1+events22:43:130
155271799208110,2068cyclictest1610386-21kworker/1:0+events22:06:421
155271299208110,2070cyclictest1550192-21kworker/0:0+events19:15:020
155271799207611,2062cyclictest1631183-21kworker/1:2+events23:11:191
15527229920758,2063cyclictest1641543-21kworker/3:0+events00:28:113
15527229920755,2066cyclictest1580347-21kworker/3:0+events21:07:003
15527129920758,2064cyclictest1648458-21kworker/0:0+events00:21:180
155271299207410,2061cyclictest1628302-21kworker/0:0+events23:14:000
15527129920733,2067cyclictest1639924-21kworker/0:0+events23:56:400
155271299207310,2060cyclictest1564164-21kworker/0:2+events19:45:460
155271299207110,2058cyclictest1572199-21kworker/0:1+events20:15:400
155271999206911,2055cyclictest1565672-21kworker/2:0+events19:49:352
15527179920697,2059cyclictest1600859-21kworker/1:2+events21:43:531
15527199920689,2056cyclictest1573804-21kworker/2:1+events20:31:072
155271799206710,2054cyclictest1572169-21kworker/1:1+events20:06:521
15527129920679,2055cyclictest1559259-21kworker/0:0+events19:35:040
155271299206710,2053cyclictest1564164-21kworker/0:2+events20:02:190
15527129920665,2058cyclictest1612383-21kworker/0:1+events22:49:440
15527129920658,2052cyclictest1564164-21kworker/0:2+events19:43:530
155271299206510,2052cyclictest1625027-21kworker/0:2+events22:58:270
155271799206311,2051cyclictest1575742-21kworker/1:2+events20:33:031
15527129920637,2053cyclictest1653155-21kworker/0:1+events00:39:370
15527129920629,2050cyclictest1575582-21kworker/0:2+events20:22:280
15527129920626,2054cyclictest1585052-21kworker/0:1+events20:50:360
15527129920609,2048cyclictest1615775-21kworker/0:0+events22:31:470
15527129920569,2045cyclictest1631507-21kworker/0:1+events23:17:290
15527129920536,2043cyclictest1648458-21kworker/0:0+events00:11:250
155271999205110,2038cyclictest1643086-21kworker/2:0+events23:50:372
15527129920477,2037cyclictest1604380-21kworker/0:2+events21:51:590
15527229920465,2038cyclictest1595930-21kworker/3:0+events21:24:533
155271299204610,2033cyclictest1636246-21kworker/0:1+events23:33:310
155271299204510,2032cyclictest1615775-21kworker/0:0+events22:36:170
15527199920433,2037cyclictest1586629-21kworker/2:2+events21:12:192
15527199920433,2037cyclictest1586629-21kworker/2:2+events21:12:182
15527129920374,2030cyclictest1552545-21kworker/0:2+events19:12:470
155271299203710,2024cyclictest1596082-21kworker/0:1+events21:39:210
15527179920368,2025cyclictest1621880-21kworker/1:2+events22:54:351
155271999203510,2022cyclictest1615677-21kworker/2:2+events22:31:002
15527229920297,2019cyclictest1641543-21kworker/3:0+events00:17:083
15527179920267,2016cyclictest1588228-21kworker/1:1+events21:18:231
15527179920256,2016cyclictest1562415-21kworker/1:1+events19:52:421
155271799202510,2012cyclictest1651556-21kworker/1:0+events00:17:301
155271799202510,2012cyclictest1612431-21kworker/1:2+events22:17:451
15527179920229,2010cyclictest1599233-21kworker/1:1+events21:34:281
15527179920218,2010cyclictest1639954-21kworker/1:1+events23:44:351
155272299202010,2007cyclictest1638233-21kworker/3:0+events23:36:353
155271799202010,2007cyclictest1597626-21kworker/1:0+events21:48:561
155272299201910,2006cyclictest1600657-21kworker/3:1+events21:37:073
15527179920199,2007cyclictest1636428-21kworker/1:1+events23:30:511
155271799201910,2006cyclictest1651556-21kworker/1:0+events00:20:551
15527229920189,2006cyclictest1553985-21kworker/3:2+events19:28:563
15527179920189,2006cyclictest1600859-21kworker/1:2+events21:51:121
15527179920177,2007cyclictest1626769-21kworker/1:0+events00:07:391
155271799201710,2004cyclictest1621880-21kworker/1:2+events22:43:361
155272299201510,2002cyclictest1617076-21kworker/3:1+events22:30:393
155272299201410,2001cyclictest1615470-21kworker/3:2+events22:24:053
155272299201410,2001cyclictest1564817-21kworker/3:2+events19:46:083
15527179920147,2004cyclictest1565760-21kworker/1:2+events20:02:421
15527229920138,2002cyclictest1641543-21kworker/3:0+events00:34:393
155272299201110,1998cyclictest1558032-21kworker/3:1+events19:41:363
155271999201111,1997cyclictest1610683-21kworker/2:0+events22:18:522
15527179920105,2002cyclictest1656306-21kworker/1:2+events00:38:041
155272299200910,1996cyclictest1605776-21kworker/3:0+events21:54:373
155272299200910,1995cyclictest1569175-21kworker/3:0+events19:59:593
15527229920089,1996cyclictest1591221-21kworker/3:2+events21:10:023
15527229920089,1996cyclictest1591221-21kworker/3:2+events21:10:023
15527179920088,1997cyclictest1626769-21kworker/1:0+events23:05:391
15527179920088,1997cyclictest1589975-21kworker/1:2+events21:05:291
15527229920073,2001cyclictest1581952-21kworker/3:1+events20:43:013
155271799200710,1996cyclictest1558100-21kworker/1:0+events19:30:301
155271799200710,1993cyclictest1565760-21kworker/1:2+events20:10:441
15527179920068,1995cyclictest1554042-21kworker/1:1+events19:27:001
15527229920058,1994cyclictest1659571-21kworker/3:1+events00:39:153
155271999200510,1992cyclictest1599352-21kworker/2:0+events21:37:512
15527179920046,1995cyclictest1626769-21kworker/1:0+events23:21:401
155271299200210,1989cyclictest1585052-21kworker/0:1+events21:05:530
15527229920016,1991cyclictest1623047-21kworker/3:2+events23:06:233
155272299200110,1988cyclictest1628428-21kworker/3:0+events23:15:333
15527199919998,1988cyclictest1636274-21kworker/2:0+events23:28:092
15527199919879,1975cyclictest1646635-21kworker/2:3+events00:10:422
15527229919844,1977cyclictest1588017-21kworker/3:1+events21:04:443
155271999198310,1970cyclictest1559439-21kworker/2:2+events19:51:322
15527229919788,1967cyclictest1641543-21kworker/3:0+events00:08:023
15527199919747,1964cyclictest1638176-21kworker/2:1+events23:49:292
15527199919735,1965cyclictest1567660-21kworker/2:1+events19:55:242
155271999197310,1960cyclictest1639805-21kworker/2:0+events23:41:322
15527229919729,1960cyclictest1595930-21kworker/3:0+events21:41:143
15527199919726,1963cyclictest1629844-21kworker/2:2+events23:09:502
15527199919723,1966cyclictest1624879-21kworker/2:0+events23:01:052
155271999197210,1959cyclictest1583217-21kworker/2:2+events20:45:392
15527199919718,1960cyclictest1638176-21kworker/2:1+events23:38:072
155271999197010,1958cyclictest1618558-21kworker/2:1+events22:45:072
155271999197010,1957cyclictest1571401-21kworker/2:0+events20:07:382
155271999197010,1957cyclictest1559439-21kworker/2:2+events19:34:182
15527199919644,1957cyclictest1604051-21kworker/2:0+events21:54:142
15527199919638,1952cyclictest1561078-21kworker/2:0+events19:36:592
15527199919624,1955cyclictest1656426-21kworker/2:2+events00:33:072
15527199919605,1952cyclictest1584908-21kworker/2:1+events20:54:012
15527199919587,1948cyclictest1646634-21kworker/2:2+events00:00:282
155271999195810,1945cyclictest1554075-21kworker/2:1+events19:22:232
15527199919559,1943cyclictest1586629-21kworker/2:2+events21:06:382
155272299195010,1937cyclictest1553985-21kworker/3:2+events19:14:413
15527179919448,1933cyclictest1546848-21kworker/1:0+events19:13:531
15527199919087,1898cyclictest1615677-21kworker/2:2+events22:26:002
15527199918719,1859cyclictest1545571-21kworker/2:2+events19:14:182
15527199918047,1794cyclictest1610683-21kworker/2:0+events22:24:282
15523502169140,24sleep00-21swapper/019:08:160
15523382146110,31sleep30-21swapper/319:08:073
15524552143111,26sleep10-21swapper/119:09:381
15522352141109,28sleep20-21swapper/219:06:512
155271999156,5cyclictest1620512-21tr22:39:592
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional