You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 13:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Sun Mar 29, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
156855999288813,2870cyclictest1659457-21kworker/1:1+events00:00:181
156855799267513,2658cyclictest1655884-21kworker/0:2+events23:40:140
156856399265011,2635cyclictest1602789-21kworker/2:1+events20:55:212
156856399265010,2636cyclictest1621056-21kworker/2:2+events22:00:142
156855999264914,2631cyclictest1662614-21kworker/1:3+events00:10:131
156855799263613,2620cyclictest1664022-21kworker/0:2+events00:15:010
15685699925880,2583cyclictest1625676-21kworker/3:0+events22:11:183
156856999257812,2562cyclictest1652646-21kworker/3:2+events23:30:183
156855999255612,2540cyclictest1648015-21kworker/1:1+events23:18:271
156856999254312,2527cyclictest1665659-21kworker/3:0+events00:25:173
156856999253611,2521cyclictest1628906-21kworker/3:1+events22:18:043
15685699925328,2520cyclictest1622448-21kworker/3:1+events21:56:023
156856999252011,2505cyclictest1589671-21kworker/3:1+events20:27:203
156855999249312,2477cyclictest1580177-21kworker/1:2+events19:43:331
156856999248712,2472cyclictest1599702-21kworker/3:2+events21:02:343
156855999248612,2471cyclictest1597887-21kworker/1:1+events20:41:571
156856999248412,2469cyclictest1673569-21kworker/3:2+events00:35:323
156855799248212,2466cyclictest1598103-21kworker/0:1+events20:52:380
156855999248011,2465cyclictest1657774-21kworker/1:0+events23:45:351
156855999247912,2464cyclictest1583479-21kworker/1:2+events20:33:061
156855999247810,2465cyclictest1593478-21kworker/1:1+events20:29:421
15685599924749,2461cyclictest1611195-21kworker/1:2+events21:31:471
156855999247412,2458cyclictest1606070-21kworker/1:1+events21:02:551
156856999247010,2456cyclictest1654341-21kworker/3:1+events23:37:593
156855999246611,2451cyclictest1572219-21kworker/1:0+events19:21:301
156855999246012,2445cyclictest1611195-21kworker/1:2+events21:35:111
156856999245911,2444cyclictest1596468-21kworker/3:1+events20:39:383
156856999245712,2442cyclictest1571449-21kworker/3:1+events19:20:203
156855999245411,2440cyclictest1619187-21kworker/1:0+events21:44:431
156856999245212,2437cyclictest1588005-21kworker/3:0+events20:11:463
156856999245212,2436cyclictest1631893-21kworker/3:2+events22:27:073
156856999245211,2438cyclictest1585143-21kworker/3:1+events20:03:413
15685699924498,2437cyclictest1588005-21kworker/3:0+events20:06:233
156855999244911,2435cyclictest1606070-21kworker/1:1+events21:05:381
156855799244812,2434cyclictest1569978-21kworker/0:0+events19:16:370
156856999244712,2432cyclictest1635277-21kworker/3:1+events22:52:573
156856999244311,2429cyclictest1583507-21kworker/3:2+events19:56:563
156856999243912,2424cyclictest1599702-21kworker/3:2+events21:06:013
156856999243812,2422cyclictest1611282-21kworker/3:0+events21:52:383
156856999243210,2418cyclictest1639716-21kworker/3:2+events22:48:203
156856999242611,2411cyclictest1659134-21kworker/3:1+events00:05:153
156856999241311,2399cyclictest1609392-21kworker/3:2+events21:19:553
156856999241211,2398cyclictest1635277-21kworker/3:1+events22:38:083
15685599924098,2397cyclictest1670455-21kworker/1:2+events00:33:151
15685699924039,2391cyclictest1596468-21kworker/3:1+events20:42:423
156855799239710,2384cyclictest1596348-21kworker/0:2+events20:35:470
156856999239611,2381cyclictest1578686-21kworker/3:2+events19:43:093
156855999238812,2374cyclictest1625795-21kworker/1:1+events22:30:081
15685699923849,2372cyclictest1668885-21kworker/3:2+events00:24:073
156856999238412,2369cyclictest1635277-21kworker/3:1+events22:40:463
156856999238410,2369cyclictest1635277-21kworker/3:1+events23:03:523
156855999237812,2362cyclictest1583479-21kworker/1:2+events19:56:091
156855799237312,2358cyclictest1642915-21kworker/0:0+events23:01:590
156856999237210,2358cyclictest1644483-21kworker/3:2+events23:05:223
156856999236511,2350cyclictest1611282-21kworker/3:0+events21:28:423
156855799236210,2348cyclictest1622566-21kworker/0:1+events21:59:050
156856999236010,2347cyclictest1575400-21kworker/3:1+events19:37:483
156855999235710,2344cyclictest1597887-21kworker/1:1+events20:38:291
156856399234912,2334cyclictest1584840-21kworker/2:1+events19:56:322
156856999233811,2323cyclictest1631893-21kworker/3:2+events22:30:533
156856399233711,2323cyclictest1631837-21kworker/2:0+events22:27:512
156856399233710,2324cyclictest1568352-21kworker/2:0+events19:16:582
156855799233612,2320cyclictest1636698-21kworker/0:2+events22:38:540
15685579923329,2319cyclictest1664022-21kworker/0:2+events00:26:470
156856399233012,2314cyclictest1638454-21kworker/2:1+events22:51:472
156855799232911,2315cyclictest1647782-21kworker/0:0+events23:39:290
156856399232812,2314cyclictest1614153-21kworker/2:1+events21:30:152
156856399232812,2312cyclictest1568352-21kworker/2:0+events19:25:172
156856399232712,2311cyclictest1599430-21kworker/2:1+events20:45:242
156856399232612,2310cyclictest1667193-21kworker/2:2+events00:15:242
156856399232512,2310cyclictest1638454-21kworker/2:1+events23:04:162
156855799232512,2310cyclictest1599755-21kworker/0:0+events20:46:340
156855799232511,2311cyclictest1609363-21kworker/0:1+events21:21:250
156855799232112,2306cyclictest1614241-21kworker/0:0+events21:28:200
156855799231612,2300cyclictest1660620-21kworker/0:0+events00:08:210
156855799231312,2298cyclictest1617389-21kworker/0:1+events21:44:200
156855999231112,2296cyclictest1665444-21kworker/1:0+events00:20:201
156855799231112,2296cyclictest1627156-21kworker/0:1+events22:49:520
156855799231111,2298cyclictest1664022-21kworker/0:2+events00:30:120
156855999230910,2296cyclictest1625795-21kworker/1:1+events22:10:341
156856399230611,2292cyclictest1597799-21kworker/2:2+events20:50:232
156855799230612,2291cyclictest1662368-21kworker/0:1+events23:59:340
156855799230510,2292cyclictest1670181-21kworker/0:0+events00:21:510
156855799230412,2289cyclictest1673833-21kworker/0:0+events00:35:560
156855799230411,2289cyclictest1620942-21kworker/0:2+events21:53:010
156855999230010,2287cyclictest1641437-21kworker/1:1+events22:58:151
156856999229910,2285cyclictest1615759-21kworker/3:2+events21:34:243
156855799229712,2282cyclictest1585083-21kworker/0:1+events20:04:280
156856399229511,2280cyclictest1636848-21kworker/2:2+events22:47:122
156855799229311,2279cyclictest1649539-21kworker/0:1+events23:22:170
156855799229311,2279cyclictest1649539-21kworker/0:1+events23:22:170
156856999228312,2268cyclictest1580299-21kworker/3:0+events19:53:523
156856399228112,2266cyclictest1640147-21kworker/2:0+events22:55:112
156855999228011,2266cyclictest1585111-21kworker/1:1+events20:02:361
156856999227411,2259cyclictest1602551-21kworker/3:1+events20:52:163
156855999227410,2260cyclictest1599671-21kworker/1:0+events20:47:201
156855999227311,2260cyclictest1606070-21kworker/1:1+events21:10:091
156855999227211,2257cyclictest1612815-21kworker/1:1+events21:24:511
156855999227111,2256cyclictest1620792-21kworker/1:1+events21:49:391
156855999227110,2258cyclictest1583479-21kworker/1:2+events20:56:291
15685599922709,2258cyclictest1644690-21kworker/1:0+events23:27:161
156855999227011,2256cyclictest1625795-21kworker/1:1+events22:05:341
156855999227011,2256cyclictest1601280-21kworker/1:1+events20:54:561
15685599922698,2258cyclictest1667045-21kworker/1:1+events00:18:491
156855999226911,2256cyclictest1581808-21kworker/1:1+events19:50:031
156855999226911,2255cyclictest1609307-21kworker/1:0+events21:16:341
156855999226911,2254cyclictest1619187-21kworker/1:0+events21:51:101
156855999226811,2254cyclictest1624168-21kworker/1:0+events22:02:321
156856999226711,2252cyclictest1649392-21kworker/3:1+events23:24:133
156856999226711,2252cyclictest1649392-21kworker/3:1+events23:24:123
156855999226711,2252cyclictest1667045-21kworker/1:1+events00:27:101
156855999226710,2254cyclictest1631951-21kworker/1:2+events22:24:061
156855799226710,2254cyclictest1572528-21kworker/0:2+events19:43:550
156855999226510,2252cyclictest1659457-21kworker/1:1+events23:55:491
156855999226510,2252cyclictest1654162-21kworker/1:2+events23:44:501
156855799226511,2253cyclictest1644569-21kworker/0:1+events23:07:170
156856999226310,2249cyclictest1619247-21kworker/3:2+events21:43:363
156856399226312,2248cyclictest1625585-21kworker/2:0+events22:14:382
15685579922639,2251cyclictest1609363-21kworker/0:1+events21:15:000
156856999226110,2248cyclictest1611282-21kworker/3:0+events21:47:463
156856999226110,2248cyclictest1580299-21kworker/3:0+events19:49:413
156855999226011,2246cyclictest1672392-21kworker/1:0+events00:36:191
156856999225911,2244cyclictest1577103-21kworker/3:0+events19:33:423
156856999225811,2244cyclictest1606100-21kworker/3:0+events21:10:313
156856999225610,2243cyclictest1564982-21kworker/3:0+events19:15:263
156855999225610,2242cyclictest1654162-21kworker/1:2+events23:33:241
156856399225410,2241cyclictest1597799-21kworker/2:2+events20:41:332
156855999225311,2239cyclictest1568201-21kworker/1:2+events19:13:551
156855999225211,2238cyclictest1639745-21kworker/1:0+events22:46:491
15685599922438,2232cyclictest1574100-21kworker/1:1+events19:27:311
15685599922436,2234cyclictest1577373-21kworker/1:0+events19:36:141
156855999224311,2229cyclictest1591754-21kworker/1:0+events20:23:571
156856399224010,2227cyclictest1578919-21kworker/2:1+events19:46:362
156856999223910,2226cyclictest1631893-21kworker/3:2+events22:23:203
156856399223711,2223cyclictest1652431-21kworker/2:2+events23:42:312
156855999223710,2224cyclictest1622507-21kworker/1:2+events21:59:291
156856999223611,2223cyclictest1598073-21kworker/3:0+events20:45:013
156855999223610,2223cyclictest1611195-21kworker/1:2+events21:29:531
156856999223510,2222cyclictest1573803-21kworker/3:2+events19:26:243
156856999223410,2221cyclictest1659134-21kworker/3:1+events00:01:283
156856999223011,2215cyclictest1617359-21kworker/3:1+events21:37:283
156856999223010,2217cyclictest1644483-21kworker/3:2+events23:13:073
156856999222811,2214cyclictest1602551-21kworker/3:1+events20:58:023
156856999222610,2214cyclictest1644483-21kworker/3:2+events23:15:013
156856999222513,2209cyclictest1588005-21kworker/3:0+events20:23:333
156856999222511,2211cyclictest1670760-21kworker/3:1+events00:34:463
156856999222511,2211cyclictest1659134-21kworker/3:1+events23:56:133
156855799222511,2211cyclictest1660620-21kworker/0:0+events00:03:210
156855799222511,2211cyclictest1598103-21kworker/0:1+events21:04:280
156856999222411,2210cyclictest1667278-21kworker/3:1+events00:15:483
156856999222311,2209cyclictest1624052-21kworker/3:2+events22:07:303
156856399222011,2205cyclictest1635245-21kworker/2:1+events22:36:152
156856399221711,2203cyclictest1638454-21kworker/2:1+events23:29:312
15685599922139,2200cyclictest1654162-21kworker/1:2+events23:39:051
156855799219110,2178cyclictest1619277-21kworker/0:0+events22:00:360
156856999218310,2170cyclictest1652646-21kworker/3:2+events23:53:073
156856399217711,2164cyclictest1659346-21kworker/2:1+events23:50:282
156855799217411,2160cyclictest1642915-21kworker/0:0+events22:58:590
15685699921729,2159cyclictest1641467-21kworker/3:0+events22:55:563
156855999215810,2144cyclictest1586760-21kworker/1:0+events20:08:181
156856999215511,2141cyclictest1594810-21kworker/3:2+events20:30:243
156855999215211,2138cyclictest1633583-21kworker/1:0+events22:36:401
156856999214211,2128cyclictest1622448-21kworker/3:1+events22:01:223
156856999214210,2129cyclictest1609392-21kworker/3:2+events21:22:113
15685639921429,2130cyclictest1611225-21kworker/2:0+events21:38:362
15685599921418,2130cyclictest1636875-21kworker/1:1+events22:43:501
15685599921407,2130cyclictest1625795-21kworker/1:1+events22:28:131
156856399213010,2117cyclictest1581963-21kworker/2:2+events20:06:012
156856399212811,2113cyclictest1636848-21kworker/2:2+events22:41:112
156856399212810,2115cyclictest1589762-21kworker/2:2+events20:17:062
156855999212810,2115cyclictest1630268-21kworker/1:0+events22:18:271
156856399212711,2113cyclictest1659346-21kworker/2:1+events23:58:262
156856399212711,2113cyclictest1621056-21kworker/2:2+events21:50:472
156856399212710,2114cyclictest1568352-21kworker/2:0+events19:33:172
156855799212710,2114cyclictest1627156-21kworker/0:1+events22:25:350
156856399212611,2112cyclictest1597799-21kworker/2:2+events20:38:052
156856399212610,2114cyclictest1670487-21kworker/2:0+events00:35:082
156856399212610,2113cyclictest1629465-21kworker/2:1+events22:19:142
156856399212610,2113cyclictest1604426-21kworker/2:2+events21:09:442
156856399212411,2110cyclictest1657687-21kworker/2:0+events23:46:422
156855999212311,2108cyclictest1583479-21kworker/1:2+events20:19:491
156855999212210,2109cyclictest1644690-21kworker/1:0+events23:21:081
156855999212210,2109cyclictest1644690-21kworker/1:0+events23:21:081
156856399212111,2107cyclictest1665537-21kworker/2:1+events00:09:482
156856399212111,2106cyclictest1638454-21kworker/2:1+events23:21:312
156856399212111,2106cyclictest1638454-21kworker/2:1+events23:21:302
156856399212110,2108cyclictest1631837-21kworker/2:0+events22:24:512
156855799212010,2106cyclictest1627156-21kworker/0:1+events22:13:130
156856399211910,2106cyclictest1644510-21kworker/2:2+events23:05:452
156856399211811,2104cyclictest1607613-21kworker/2:1+events21:15:242
156856399211811,2103cyclictest1647875-21kworker/2:2+events23:16:342
156856399211810,2105cyclictest1586465-21kworker/2:0+events20:12:542
156855799211811,2104cyclictest1651402-21kworker/0:2+events23:26:050
156856399211711,2103cyclictest1668855-21kworker/2:1+events00:24:532
156856399211610,2103cyclictest1604426-21kworker/2:2+events21:12:292
156855999211510,2102cyclictest1577373-21kworker/1:0+events19:48:301
156855799211511,2101cyclictest1640042-21kworker/0:2+events22:51:220
156856399211411,2100cyclictest1654130-21kworker/2:0+events23:33:472
156855999211310,2100cyclictest1589612-21kworker/1:1+events20:12:301
156855999210910,2096cyclictest1568201-21kworker/1:2+events19:34:241
156855999210910,2096cyclictest1568201-21kworker/1:2+events19:19:341
15685599921087,2097cyclictest1639745-21kworker/1:0+events22:52:331
156855799210711,2093cyclictest1585083-21kworker/0:1+events20:06:460
156855799210711,2092cyclictest1594704-21kworker/0:0+events20:32:420
156855799210511,2091cyclictest1591443-21kworker/0:1+events20:26:580
15685599921047,2093cyclictest1646326-21kworker/1:2+events23:12:221
156855799210411,2090cyclictest1660620-21kworker/0:0+events23:51:360
156855799210411,2090cyclictest1655884-21kworker/0:2+events23:45:580
156855799210411,2090cyclictest1647782-21kworker/0:0+events23:15:480
156855799210411,2090cyclictest1596348-21kworker/0:2+events20:43:520
156855799210411,2090cyclictest1572528-21kworker/0:2+events19:51:360
156855799210410,2091cyclictest1627156-21kworker/0:1+events22:20:190
156856399210311,2089cyclictest1654130-21kworker/2:0+events23:36:492
156856399210310,2090cyclictest1670487-21kworker/2:0+events00:33:372
156855799210310,2090cyclictest1575432-21kworker/0:0+events19:29:460
15685599921025,2093cyclictest1644690-21kworker/1:0+events23:06:321
156855999210110,2087cyclictest1641437-21kworker/1:1+events23:03:301
15685579921019,2089cyclictest1604978-21kworker/0:0+events21:07:110
15685699920995,2091cyclictest1652646-21kworker/3:2+events23:44:043
156856399209711,2084cyclictest1591632-21kworker/2:1+events20:30:032
15685699920965,2088cyclictest1647662-21kworker/3:0+events23:29:553
15685579920949,2082cyclictest1646167-21kworker/0:2+events23:14:380
156855799209011,2076cyclictest1578641-21kworker/0:1+events19:39:200
15685579920870,2084cyclictest1586727-21kworker/0:2+events20:13:400
156855799208511,2070cyclictest1586727-21kworker/0:2+events20:15:560
15685699920839,2071cyclictest1588005-21kworker/3:0+events20:16:423
15685699920819,2069cyclictest1665659-21kworker/3:0+events00:12:473
156855799208110,2068cyclictest1635054-21kworker/0:0+events22:32:470
15685699920808,2069cyclictest1657533-21kworker/3:0+events23:46:203
15685599920779,2064cyclictest1665444-21kworker/1:0+events00:07:121
15685639920647,2054cyclictest1619400-21kworker/2:1+events21:46:152
156855799205811,2044cyclictest1580358-21kworker/0:0+events19:58:510
156856399205511,2041cyclictest1670487-21kworker/2:0+events00:25:392
156855799205411,2040cyclictest1586727-21kworker/0:2+events20:20:580
15685579920319,2019cyclictest1627156-21kworker/0:1+events22:43:270
156856399203011,2016cyclictest1611225-21kworker/2:0+events21:21:022
156855799203011,2016cyclictest1619277-21kworker/0:0+events21:48:310
15685639920259,2013cyclictest1568352-21kworker/2:0+events19:13:322
156856399202410,2011cyclictest1611225-21kworker/2:0+events21:40:302
156856399201310,1999cyclictest1665537-21kworker/2:1+events00:12:032
15685579919969,1983cyclictest1602521-21kworker/0:2+events20:55:440
15685579919892,1984cyclictest1647782-21kworker/0:0+events23:34:100
15685639919808,1969cyclictest1623955-21kworker/2:1+events21:58:192
15685639919759,1963cyclictest1586465-21kworker/2:0+events20:20:122
15685639919728,1960cyclictest1657687-21kworker/2:0+events00:01:512
15685639919719,1959cyclictest1581963-21kworker/2:2+events19:52:222
156856399197110,1959cyclictest1646264-21kworker/2:0+events23:10:492
15685639919708,1959cyclictest1573890-21kworker/2:2+events19:23:222
15685579919708,1959cyclictest1564861-21kworker/0:1+events19:20:430
15685639919692,1964cyclictest1633548-21kworker/2:2+events22:32:232
156856399196710,1954cyclictest1586465-21kworker/2:0+events20:01:502
15685639919605,1951cyclictest1578919-21kworker/2:1+events19:44:182
156856399195910,1946cyclictest1604426-21kworker/2:2+events21:01:042
156855799195510,1941cyclictest1564861-21kworker/0:1+events19:14:420
15685639919519,1939cyclictest1611225-21kworker/2:0+events21:26:022
15685579919513,1945cyclictest1611254-21kworker/0:2+events21:37:050
156855799195110,1937cyclictest1628822-21kworker/0:0+events22:17:420
15685579919507,1940cyclictest1572528-21kworker/0:2+events19:31:440
15685579919499,1937cyclictest1625466-21kworker/0:2+events22:07:070
15685579919430,1940cyclictest1667307-21kworker/0:1+events00:18:030
15685579919408,1930cyclictest1580358-21kworker/0:0+events19:45:030
15685699919329,1920cyclictest1568307-21kworker/3:2+events19:11:153
15685639919103,1904cyclictest1577132-21kworker/2:2+events19:35:322
15685639919057,1895cyclictest1593343-21kworker/2:2+events20:25:522
15685579918603,1853cyclictest1604978-21kworker/0:0+events21:13:560
15682152157115,37sleep00-21swapper/019:08:130
15681022142110,27sleep10-21swapper/119:06:501
15680622141110,25sleep30-21swapper/319:06:213
15680062139109,25sleep20-21swapper/219:05:352
156856399241,7cyclictest1627426-21idleruntime-cro22:10:002
156855999171,1cyclictest1659658-21apt-get23:50:111
1568557991612,1cyclictest191rcu_preempt21:33:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional