You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 03:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Tue Apr 07, 2026 00:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
160426999294212,2925cyclictest1702852-21kworker/0:0+events00:20:130
160427499283413,2817cyclictest1636407-21kworker/1:2+events21:35:091
160427499278013,2764cyclictest1617377-21kworker/1:0+events19:50:011
160428299277713,2761cyclictest1633157-21kworker/3:1+events20:40:003
160427499277613,2759cyclictest1622183-21kworker/1:0+events20:25:121
160428299276913,2753cyclictest1625185-21kworker/3:2+events20:15:203
160427499276313,2748cyclictest1636407-21kworker/1:2+events21:00:121
160427499275113,2734cyclictest1696543-21kworker/1:2+events00:13:331
160427499273812,2722cyclictest1622183-21kworker/1:0+events20:14:121
160427499273413,2717cyclictest1675367-21kworker/1:0+events22:50:131
160426999273414,2716cyclictest1620438-21kworker/0:2+events20:20:170
160427899270511,2690cyclictest1685203-21kworker/2:0+events00:00:182
160427899265513,2638cyclictest1670388-21kworker/2:1+events22:45:132
160427499262910,2614cyclictest1606343-21kworker/1:0+events19:25:121
160428299258913,2573cyclictest1641118-21kworker/3:0+events21:20:223
160426999256110,2547cyclictest1633063-21kworker/0:1+events21:15:000
160428299253312,2518cyclictest1645854-21kworker/3:2+events21:25:423
16042749925308,2520cyclictest1655315-21kworker/1:1+events22:05:021
160427499252812,2512cyclictest1655315-21kworker/1:1+events21:55:531
160427499252612,2510cyclictest1668964-21kworker/1:1+events22:40:151
160427899252412,2508cyclictest1670388-21kworker/2:1+events22:43:192
160428299252210,2508cyclictest1659360-21kworker/3:1+events22:14:383
160428299250312,2488cyclictest1696366-21kworker/3:1+events00:27:323
160427499250312,2486cyclictest1680414-21kworker/1:1+events23:14:231
160427499250312,2486cyclictest1680414-21kworker/1:1+events23:14:221
160427899249412,2479cyclictest1694981-21kworker/2:2+events23:56:032
160426999249412,2478cyclictest1709299-21kworker/0:1+events00:32:450
160427899249312,2478cyclictest1662469-21kworker/2:2+events22:14:142
160427899249312,2478cyclictest1647514-21kworker/2:2+events21:24:332
160427899249312,2477cyclictest1598872-21kworker/2:0+events19:50:252
160428299249210,2478cyclictest1637708-21kworker/3:1+events20:54:043
160427899249212,2477cyclictest1645885-21kworker/2:0+events21:30:152
160427499248912,2474cyclictest1629833-21kworker/1:1+events20:43:531
160428299248712,2472cyclictest1688580-21kworker/3:2+events23:38:303
160427499248612,2471cyclictest1668964-21kworker/1:1+events22:32:121
160427899248012,2464cyclictest1650805-21kworker/2:2+events21:40:332
160426999247912,2463cyclictest1699530-21kworker/0:1+events00:18:010
160428299247812,2462cyclictest1665533-21kworker/3:2+events22:25:433
16042699924726,2463cyclictest1620438-21kworker/0:2+events20:31:380
160426999247212,2456cyclictest1654099-21kworker/0:0+events21:53:120
160426999247212,2456cyclictest1620438-21kworker/0:2+events20:03:490
160427499247111,2457cyclictest1610554-21kworker/1:2+events19:32:061
160426999246812,2453cyclictest1639376-21kworker/0:0+events21:06:170
160426999246812,2453cyclictest1639376-21kworker/0:0+events21:06:170
160428299246712,2451cyclictest1620346-21kworker/3:2+events19:58:273
160426999246312,2447cyclictest1647542-21kworker/0:1+events21:25:190
160426999246112,2445cyclictest1615970-21kworker/0:1+events19:58:050
160426999245812,2442cyclictest1668842-21kworker/0:2+events22:32:340
160427499245311,2438cyclictest1686734-21kworker/1:1+events23:21:431
160427499244712,2431cyclictest1704324-21kworker/1:1+events00:18:221
160427499244612,2430cyclictest1696543-21kworker/1:2+events23:57:131
160427499244312,2428cyclictest1650926-21kworker/1:0+events21:52:501
160427499244012,2424cyclictest1663837-21kworker/1:1+events22:16:541
160427499244011,2425cyclictest1647607-21kworker/1:0+events21:27:101
160428299243910,2426cyclictest1685053-21kworker/3:0+events23:28:373
160427499243812,2422cyclictest1665436-21kworker/1:0+events22:27:141
160427499243712,2421cyclictest1622183-21kworker/1:0+events20:21:271
160428299243612,2420cyclictest1626847-21kworker/3:1+events20:27:513
16042749924368,2425cyclictest1676998-21kworker/1:1+events22:57:271
160427499243612,2420cyclictest1680414-21kworker/1:1+events23:07:281
160427499243611,2421cyclictest1628232-21kworker/1:2+events20:31:151
160427499243512,2419cyclictest1693313-21kworker/1:1+events23:49:151
160427499243512,2419cyclictest1658753-21kworker/1:2+events22:11:341
160427499243412,2418cyclictest1622183-21kworker/1:0+events20:19:301
160427499243411,2419cyclictest1650926-21kworker/1:0+events21:43:161
160428299243312,2417cyclictest1677241-21kworker/3:0+events23:05:333
160427499243311,2419cyclictest1636407-21kworker/1:2+events20:50:381
160427499243211,2418cyclictest1606343-21kworker/1:0+events19:17:141
160427899243012,2415cyclictest1699499-21kworker/2:1+events00:39:382
160427499242610,2412cyclictest1622183-21kworker/1:0+events20:07:181
160428299242512,2409cyclictest1657131-21kworker/3:0+events21:58:333
160428299242210,2408cyclictest1620346-21kworker/3:2+events20:04:123
160426999242212,2407cyclictest1647542-21kworker/0:1+events21:23:250
160428299242112,2406cyclictest1686974-21kworker/3:1+events23:33:333
160428299242112,2406cyclictest1672144-21kworker/3:2+events22:52:523
160428299241710,2404cyclictest1668784-21kworker/3:1+events22:41:463
160428299241310,2400cyclictest1631436-21kworker/3:0+events20:42:423
160428299241212,2397cyclictest1649238-21kworker/3:0+events21:40:583
160428299241212,2397cyclictest1631436-21kworker/3:0+events20:48:453
160427899241012,2394cyclictest1662469-21kworker/2:2+events22:19:592
160427499241012,2395cyclictest1612457-21kworker/1:1+events19:41:361
160428299240910,2395cyclictest1677241-21kworker/3:0+events22:57:063
160428299240810,2396cyclictest1707779-21kworker/3:0+events00:30:073
160428299240712,2391cyclictest1673773-21kworker/3:0+events22:45:593
160428299240710,2394cyclictest1612592-21kworker/3:1+events19:44:443
160428299240612,2391cyclictest1621973-21kworker/3:0+events20:23:423
160428299240612,2390cyclictest1618711-21kworker/3:1+events19:53:523
160428299240511,2390cyclictest1601912-21kworker/3:0+events19:28:383
160427499240511,2391cyclictest1707857-21kworker/1:2+events00:29:441
160428299240112,2385cyclictest1696366-21kworker/3:1+events00:14:413
160426999239712,2381cyclictest1687064-21kworker/0:1+events23:29:020
160427899239611,2381cyclictest1657008-21kworker/2:1+events22:03:102
160427899239412,2379cyclictest1685203-21kworker/2:0+events23:49:382
160427499239211,2378cyclictest1636407-21kworker/1:2+events20:57:531
160426999239012,2374cyclictest1662353-21kworker/0:0+events22:12:440
160426999238612,2370cyclictest1678725-21kworker/0:2+events23:02:500
160426999238511,2370cyclictest1637768-21kworker/0:2+events20:56:430
160426999238412,2369cyclictest1664776-21kworker/0:1+events22:20:440
160426999238311,2368cyclictest1649176-21kworker/0:0+events21:31:210
160427899238211,2367cyclictest1704413-21kworker/2:2+events00:21:452
160426999238211,2367cyclictest1673862-21kworker/0:1+events22:58:140
160427499238112,2365cyclictest1642271-21kworker/1:1+events21:08:571
160427499238112,2365cyclictest1642271-21kworker/1:1+events21:08:571
160428299237710,2363cyclictest1698005-21kworker/3:0+events00:04:063
160426999237712,2362cyclictest1697877-21kworker/0:0+events00:05:360
160426999237712,2361cyclictest1658842-21kworker/0:2+events22:15:250
160427499237310,2359cyclictest1691637-21kworker/1:2+events23:41:101
160426999237312,2359cyclictest1680355-21kworker/0:0+events23:20:320
160427899237212,2356cyclictest1662469-21kworker/2:2+events22:25:212
160427899237112,2355cyclictest1701159-21kworker/2:0+events00:15:252
160427899237111,2357cyclictest1636263-21kworker/2:2+events20:50:162
160426999236911,2354cyclictest1605849-21kworker/0:3+events19:46:590
160426999236312,2348cyclictest1633063-21kworker/0:1+events20:39:380
160426999235912,2344cyclictest1673862-21kworker/0:1+events22:48:410
160426999235211,2337cyclictest1633063-21kworker/0:1+events21:02:090
160428299235110,2338cyclictest1655344-21kworker/3:2+events22:05:273
160426999234911,2334cyclictest1644025-21kworker/0:2+events21:48:360
160427499234211,2328cyclictest1678757-21kworker/1:0+events23:02:041
160427499233710,2324cyclictest1694949-21kworker/1:0+events23:54:321
160426999233412,2319cyclictest1694828-21kworker/0:2+events23:56:250
16042829923319,2319cyclictest1662531-21kworker/3:0+events22:18:033
160427899233112,2316cyclictest1693220-21kworker/2:1+events23:43:522
160427899233012,2315cyclictest1622153-21kworker/2:2+events20:27:092
160427899233011,2315cyclictest1615863-21kworker/2:1+events19:48:542
160427899232812,2312cyclictest1655406-21kworker/2:0+events21:52:032
160427899232711,2312cyclictest1622153-21kworker/2:2+events20:13:482
16042749923279,2315cyclictest1631498-21kworker/1:0+events20:35:041
160427499232210,2308cyclictest1672556-21kworker/1:2+events22:45:371
160427899230912,2293cyclictest1645885-21kworker/2:0+events21:27:332
160427899230812,2292cyclictest1667807-21kworker/2:0+events22:31:032
160428299230712,2292cyclictest1680111-21kworker/3:2+events23:15:553
160428299230512,2290cyclictest1696366-21kworker/3:1+events00:24:253
160427899230512,2290cyclictest1598872-21kworker/2:0+events19:30:572
160428299230312,2288cyclictest1662531-21kworker/3:0+events22:21:083
160426999229712,2281cyclictest1623731-21kworker/0:1+events20:12:400
160426999228710,2274cyclictest1660469-21kworker/0:1+events22:06:340
160427899228511,2271cyclictest1675668-21kworker/2:2+events23:24:462
160428299228410,2270cyclictest1688580-21kworker/3:2+events23:53:243
160427499228211,2267cyclictest1608920-21kworker/1:1+events19:21:461
160427499228210,2269cyclictest1618984-21kworker/1:1+events19:59:381
160427899227611,2262cyclictest1675668-21kworker/2:2+events22:55:112
160427899227312,2258cyclictest1610647-21kworker/2:1+events19:29:462
160427899227310,2261cyclictest1598872-21kworker/2:0+events20:00:012
160427899227210,2258cyclictest1598872-21kworker/2:0+events19:22:092
160428299226410,2250cyclictest1641118-21kworker/3:0+events21:07:023
160428299226410,2250cyclictest1641118-21kworker/3:0+events21:07:023
160427899226311,2249cyclictest1673740-21kworker/2:0+events22:53:402
160427499226311,2249cyclictest1688397-21kworker/1:0+events23:33:581
160427499225710,2243cyclictest1700036-21kworker/1:0+events00:23:391
160427499225511,2241cyclictest1655315-21kworker/1:1+events22:02:461
160426999225311,2238cyclictest1620438-21kworker/0:2+events20:17:580
160427499225012,2235cyclictest1649267-21kworker/1:1+events21:34:001
160427499225011,2236cyclictest1665436-21kworker/1:0+events22:22:421
160428299224711,2232cyclictest1655344-21kworker/3:2+events21:47:513
160427499223810,2224cyclictest1650926-21kworker/1:0+events21:49:001
160428299223710,2223cyclictest1696366-21kworker/3:1+events23:57:593
160427499223710,2223cyclictest1615745-21kworker/1:2+events19:54:401
160428299223411,2219cyclictest1643749-21kworker/3:1+events21:14:373
160427499223410,2221cyclictest1645950-21kworker/1:1+events21:21:061
160427499223410,2221cyclictest1644055-21kworker/1:0+events21:13:081
160427499223310,2220cyclictest1688397-21kworker/1:0+events23:36:361
160427499223111,2217cyclictest1670751-21kworker/1:0+events22:37:561
160427499223110,2219cyclictest1709479-21kworker/1:1+events00:35:021
160427499223110,2218cyclictest1682017-21kworker/1:0+events23:18:381
16042749922299,2216cyclictest1683666-21kworker/1:2+events23:27:051
160426999222712,2212cyclictest1605849-21kworker/0:3+events19:37:250
160427899222610,2213cyclictest1694981-21kworker/2:2+events00:06:212
16042699922269,2214cyclictest1615970-21kworker/0:1+events19:52:190
160428299222511,2211cyclictest1688580-21kworker/3:2+events23:48:293
160427499222411,2210cyclictest1698152-21kworker/1:1+events00:00:401
160428299222311,2209cyclictest1688580-21kworker/3:2+events23:40:263
160427499222310,2209cyclictest1700036-21kworker/1:0+events00:31:361
160428299222111,2207cyclictest1670449-21kworker/3:0+events22:34:523
16042829922209,2208cyclictest1670449-21kworker/3:0+events22:36:453
16042829922208,2209cyclictest1610738-21kworker/3:2+events19:33:393
160428299222010,2207cyclictest1621973-21kworker/3:0+events20:07:413
160428299222010,2206cyclictest1655344-21kworker/3:2+events21:53:353
160427499221811,2203cyclictest1612457-21kworker/1:1+events19:35:551
160426999221711,2203cyclictest1658842-21kworker/0:2+events21:59:190
160428299221610,2203cyclictest1637708-21kworker/3:1+events21:01:463
160428299221511,2201cyclictest1607508-21kworker/3:2+events19:20:153
160428299221111,2196cyclictest1614239-21kworker/3:0+events19:47:463
160428299220911,2195cyclictest1709419-21kworker/3:2+events00:35:253
160427499220910,2196cyclictest1629833-21kworker/1:1+events20:49:511
16042829922079,2195cyclictest1637708-21kworker/3:1+events20:57:073
160426999220610,2192cyclictest1673862-21kworker/0:1+events22:51:430
16042749922059,2192cyclictest1615745-21kworker/1:2+events20:02:411
160427499220510,2192cyclictest1700036-21kworker/1:0+events00:09:241
160427499220510,2191cyclictest1645950-21kworker/1:1+events21:19:121
160426999220210,2188cyclictest1699530-21kworker/0:1+events00:13:570
160428299220110,2187cyclictest1680111-21kworker/3:2+events23:02:273
160427899219810,2184cyclictest1620315-21kworker/2:1+events19:57:412
16042699921988,2187cyclictest1633063-21kworker/0:1+events20:52:080
160426999219812,2183cyclictest1680355-21kworker/0:0+events23:07:500
160428299219712,2181cyclictest1610738-21kworker/3:2+events19:38:353
160427899219311,2179cyclictest1662469-21kworker/2:2+events22:23:492
160428299219211,2178cyclictest1701041-21kworker/3:2+events00:06:453
160426999218911,2174cyclictest1620438-21kworker/0:2+events20:09:370
160428299218710,2174cyclictest1645854-21kworker/3:2+events21:19:363
160426999218110,2169cyclictest1654099-21kworker/0:0+events22:00:040
160426999217911,2164cyclictest1636085-21kworker/0:0+events20:48:210
160428299217811,2164cyclictest1655344-21kworker/3:2+events22:01:143
16042699921789,2166cyclictest1664776-21kworker/0:1+events22:36:220
160426999217811,2164cyclictest1608950-21kworker/0:0+events19:27:070
160426999217810,2165cyclictest1680355-21kworker/0:0+events23:19:010
160426999216810,2154cyclictest1629771-21kworker/0:1+events20:28:130
160427899216710,2154cyclictest1685203-21kworker/2:0+events23:35:522
16042699921668,2155cyclictest1680355-21kworker/0:0+events23:11:410
16042699921668,2155cyclictest1680355-21kworker/0:0+events23:11:410
160426999216611,2152cyclictest1668842-21kworker/0:2+events22:28:440
160426999216610,2153cyclictest1680355-21kworker/0:0+events23:36:580
16042699921657,2155cyclictest1605849-21kworker/0:3+events19:34:240
160426999216411,2149cyclictest1608950-21kworker/0:0+events19:24:500
16042829921618,2150cyclictest1683446-21kworker/3:1+events23:14:463
16042829921618,2150cyclictest1683446-21kworker/3:1+events23:14:463
160427899216111,2147cyclictest1709184-21kworker/2:2+events00:31:142
160426999216011,2145cyclictest1707672-21kworker/0:2+events00:27:070
160426999216010,2147cyclictest1668842-21kworker/0:2+events22:44:520
160426999215911,2145cyclictest1689857-21kworker/0:2+events23:31:190
160426999215411,2140cyclictest1709299-21kworker/0:1+events00:38:520
16042829921449,2132cyclictest1650895-21kworker/3:2+events21:37:053
160426999213611,2122cyclictest1644025-21kworker/0:2+events21:39:010
160428299213411,2120cyclictest1649238-21kworker/3:0+events21:32:293
160428299213011,2115cyclictest1621973-21kworker/3:0+events20:13:033
160427899212511,2111cyclictest1655406-21kworker/2:0+events21:49:212
160427899212010,2107cyclictest1636263-21kworker/2:2+events20:59:272
160428299210911,2095cyclictest1702668-21kworker/3:0+events00:15:463
160427899210911,2095cyclictest1699499-21kworker/2:1+events00:26:452
160427899210711,2093cyclictest1685203-21kworker/2:0+events23:25:332
160427899210611,2091cyclictest1630068-21kworker/2:0+events20:42:182
160426999210610,2093cyclictest1605849-21kworker/0:3+events19:15:190
16042789921054,2098cyclictest1630068-21kworker/2:0+events20:35:272
16042789921038,2092cyclictest1628325-21kworker/2:1+events20:24:512
160427899210310,2090cyclictest1636263-21kworker/2:2+events21:03:382
16042789921029,2090cyclictest1675668-21kworker/2:2+events23:12:282
16042789921029,2090cyclictest1675668-21kworker/2:2+events23:12:272
16042789921028,2091cyclictest1660548-21kworker/2:0+events22:05:482
16042789921028,2091cyclictest1598872-21kworker/2:0+events19:35:322
160427899210211,2088cyclictest1639527-21kworker/2:1+events21:16:312
160427899210210,2089cyclictest1699499-21kworker/2:1+events00:12:232
160427899210111,2088cyclictest1675668-21kworker/2:2+events23:15:092
160427899210110,2088cyclictest1694981-21kworker/2:2+events23:50:232
160427899210110,2088cyclictest1641181-21kworker/2:0+events21:09:202
160427899210110,2088cyclictest1641181-21kworker/2:0+events21:09:202
160427899209610,2083cyclictest1645885-21kworker/2:0+events21:35:572
160427499209610,2082cyclictest1600383-21kworker/1:2+events19:13:021
160427899209311,2079cyclictest1607324-21kworker/2:1+events19:16:512
160427899209110,2079cyclictest1677540-21kworker/2:1+events23:00:092
16042829920766,2067cyclictest1607508-21kworker/3:2+events19:18:443
16042829920715,2062cyclictest1629741-21kworker/3:2+events20:32:023
16042829920618,2050cyclictest1685053-21kworker/3:0+events23:24:023
16042789920419,2029cyclictest1614207-21kworker/2:2+events19:41:152
160426999203211,2018cyclictest1603649-21kworker/0:2+events19:14:110
160426999201810,2007cyclictest1614179-21kworker/0:0+events19:40:060
160426999200710,1994cyclictest1699530-21kworker/0:1+events00:02:570
160427899200510,1991cyclictest1689889-21kworker/2:2+events23:32:472
16042699920058,1994cyclictest1691543-21kworker/0:1+events23:47:430
160426999200510,1992cyclictest1650889-21kworker/0:1+events21:44:220
16042829919914,1984cyclictest1601912-21kworker/3:0+events19:14:333
16042699919766,1966cyclictest1691543-21kworker/0:1+events23:51:310
16042789919609,1948cyclictest1598872-21kworker/2:0+events19:10:432
160427899195210,1939cyclictest1634632-21kworker/2:1+events20:47:592
16042789919519,1939cyclictest1675668-21kworker/2:2+events23:07:052
16042789919439,1931cyclictest1657008-21kworker/2:1+events21:57:462
160427899193910,1926cyclictest1670388-21kworker/2:1+events22:37:322
16042699919399,1927cyclictest1644025-21kworker/0:2+events21:16:550
160427899193510,1922cyclictest1639527-21kworker/2:1+events21:10:522
16034572145110,30sleep30-21swapper/319:06:063
1603525214295,43sleep00-21swapper/019:06:550
16034722142110,27sleep10-21swapper/119:06:161
16036442140111,24sleep20-21swapper/219:08:252
160427899172,10cyclictest43-21ksoftirqd/220:35:002
160427899160,4cyclictest1625602-21/usr/sbin/munin20:15:182
160427899160,3cyclictest1623793-21munin-run20:10:002
1604269991610,4cyclictest739-21runrttasks20:42:570
160426999150,4cyclictest1693074-21taskset23:40:550
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional