You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 04:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Wed Jul 22, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16572589933599,3345cyclictest1757493-21kworker/2:2+events00:20:152
165725199330615,3286cyclictest1753918-21kworker/0:0+events00:10:170
165726199311715,3098cyclictest1696367-21kworker/3:2+events21:10:133
165725699297714,2958cyclictest1733066-21kworker/1:0+events23:10:201
165725699289714,2878cyclictest1689994-21kworker/1:1+events20:53:451
165725699283414,2816cyclictest1718935-21kworker/1:1+events22:45:011
165725699279013,2773cyclictest1697703-21kworker/1:2+events21:12:081
165725199275513,2738cyclictest1706064-21kworker/0:0+events21:45:140
165725699273613,2720cyclictest1723788-21kworker/1:0+events22:37:021
165725699273213,2714cyclictest1718935-21kworker/1:1+events22:22:101
165725199270513,2688cyclictest1755858-21kworker/0:1+events00:15:190
165725699265912,2643cyclictest1665187-21kworker/1:1+events19:31:591
165725899265212,2637cyclictest1665394-21kworker/2:1+events19:46:022
165725199264213,2625cyclictest1736782-21kworker/0:1+events23:20:380
165725199261513,2599cyclictest1675154-21kworker/0:1+events20:20:480
165725199261112,2595cyclictest1734853-21kworker/0:2+events23:15:150
165726199260612,2590cyclictest1691385-21kworker/3:2+events20:53:203
165725199258513,2570cyclictest1686075-21kworker/0:0+events20:40:060
165725699255112,2535cyclictest1733066-21kworker/1:0+events23:02:391
165725899255012,2534cyclictest1749292-21kworker/2:1+events00:05:172
165725699254912,2533cyclictest1702847-21kworker/1:2+events21:30:191
16572619925489,2534cyclictest1643964-21kworker/3:2+events19:25:153
165725699254710,2533cyclictest1684482-21kworker/1:0+events20:34:471
165725699253411,2519cyclictest1706055-21kworker/1:2+events21:40:161
165725699253311,2518cyclictest1684482-21kworker/1:0+events20:43:281
165725699252712,2512cyclictest1671705-21kworker/1:2+events19:54:231
165725699252611,2511cyclictest1704451-21kworker/1:1+events21:57:001
165725699252212,2506cyclictest1752482-21kworker/1:0+events00:04:101
165725699251712,2501cyclictest1679705-21kworker/1:1+events20:19:171
165725699251411,2499cyclictest1742526-21kworker/1:1+events23:32:041
165725699251011,2495cyclictest1704451-21kworker/1:1+events22:08:471
165725699250711,2493cyclictest1707742-21kworker/1:0+events21:49:411
165725699250612,2490cyclictest1688075-21kworker/1:2+events20:49:341
165725699250512,2490cyclictest1738032-21kworker/1:1+events23:23:191
165725899249812,2483cyclictest1671583-21kworker/2:2+events20:05:172
165726199249412,2479cyclictest1643964-21kworker/3:2+events19:48:463
165725699249012,2474cyclictest1715459-21kworker/1:0+events22:16:251
16572619924869,2473cyclictest1685981-21kworker/3:0+events20:46:083
165725699248412,2470cyclictest1689994-21kworker/1:1+events21:05:361
165725899247512,2459cyclictest1681363-21kworker/2:1+events20:25:002
165725699247112,2455cyclictest1733066-21kworker/1:0+events23:51:361
165725699246612,2451cyclictest1691913-21kworker/1:0+events21:20:491
165725699246612,2451cyclictest1691913-21kworker/1:0+events21:17:031
165725199246612,2451cyclictest1681269-21kworker/0:0+events20:28:290
165726199246211,2448cyclictest1673387-21kworker/3:0+events20:11:453
165725899246212,2446cyclictest1689693-21kworker/2:2+events20:50:202
16572569924628,2451cyclictest1757642-21kworker/1:2+events00:26:481
165725699246012,2445cyclictest1662267-21kworker/1:0+events19:35:221
165725699245712,2441cyclictest1756029-21kworker/1:0+events00:14:561
16572589924556,2445cyclictest1686223-21kworker/2:1+events20:49:102
165725699245312,2438cyclictest1733066-21kworker/1:0+events23:46:371
165725699245212,2436cyclictest1679705-21kworker/1:1+events20:29:381
165725699244712,2432cyclictest1662267-21kworker/1:0+events19:26:441
165725199244512,2429cyclictest1740950-21kworker/0:0+events23:51:580
165725699244412,2429cyclictest1700985-21kworker/1:1+events21:27:171
165725899244212,2428cyclictest1718780-21kworker/2:1+events22:25:112
165726199244112,2426cyclictest1731441-21kworker/3:2+events22:57:183
165725699244112,2425cyclictest1739772-21kworker/1:2+events23:25:581
16572569924409,2427cyclictest1757642-21kworker/1:2+events00:30:141
165725199243811,2423cyclictest1656890-21kworker/0:0+events19:10:130
165726199243612,2420cyclictest1720562-21kworker/3:1+events22:26:423
165726199243412,2418cyclictest1683116-21kworker/3:2+events20:32:133
165726199243412,2418cyclictest1678085-21kworker/3:2+events20:18:553
165725899243412,2418cyclictest1679662-21kworker/2:2+events20:19:392
165725699243412,2418cyclictest1679705-21kworker/1:1+events20:24:391
165725899243312,2417cyclictest1723922-21kworker/2:0+events22:41:112
165726199243210,2418cyclictest1694758-21kworker/3:0+events21:19:393
165725699243211,2417cyclictest1744131-21kworker/1:2+events23:36:381
165725699243211,2417cyclictest1744131-21kworker/1:2+events23:36:381
165725699243112,2417cyclictest1711692-21kworker/1:0+events22:00:041
165726199243012,2414cyclictest1757611-21kworker/3:1+events00:31:013
165725699243012,2415cyclictest1670107-21kworker/1:0+events19:58:531
165725699242911,2414cyclictest1750807-21kworker/1:1+events00:06:491
165725699242812,2413cyclictest1658490-21kworker/1:2+events19:17:451
165725699242712,2412cyclictest1727041-21kworker/1:2+events22:46:091
165725699242711,2412cyclictest1733066-21kworker/1:0+events23:56:101
165725899242612,2410cyclictest1691569-21kworker/2:3+events21:02:572
165725899242611,2412cyclictest1741056-21kworker/2:0+events23:28:382
165725699242612,2410cyclictest1718935-21kworker/1:1+events22:32:041
16572519924269,2413cyclictest1671555-21kworker/0:2+events20:06:250
16572619924259,2412cyclictest1696367-21kworker/3:2+events21:41:473
165725699242512,2409cyclictest1745761-21kworker/1:1+events23:42:041
165725699242412,2409cyclictest1689994-21kworker/1:1+events20:55:161
165725899242312,2408cyclictest1749292-21kworker/2:1+events00:11:022
165725899242312,2407cyclictest1729927-21kworker/2:2+events23:09:112
165725699242211,2408cyclictest1756029-21kworker/1:0+events00:16:061
165725699242211,2407cyclictest1736366-21kworker/1:2+events23:15:381
165725699242112,2406cyclictest1727041-21kworker/1:2+events22:54:381
165725699242011,2406cyclictest1666845-21kworker/1:2+events19:41:081
165725699242011,2405cyclictest1673301-21kworker/1:1+events20:06:031
165725699241912,2403cyclictest1704451-21kworker/1:1+events21:38:421
165725199241912,2403cyclictest1675154-21kworker/0:1+events20:04:320
165726199241711,2402cyclictest1643964-21kworker/3:2+events19:33:303
165725899241512,2399cyclictest1737816-21kworker/2:2+events23:21:482
165725199241512,2399cyclictest1691443-21kworker/0:1+events21:16:160
165726199241412,2399cyclictest1685981-21kworker/3:0+events20:37:493
165725899241412,2399cyclictest1707474-21kworker/2:0+events21:46:002
165726199241310,2400cyclictest1751012-21kworker/3:2+events00:23:213
165725199241312,2398cyclictest1742583-21kworker/0:1+events23:56:340
165725199241212,2396cyclictest1700869-21kworker/0:2+events21:22:220
165725199241112,2395cyclictest1684459-21kworker/0:2+events20:33:380
16572519924109,2397cyclictest1675154-21kworker/0:1+events20:17:460
165725199241012,2395cyclictest1668363-21kworker/0:1+events19:53:140
165725199241012,2394cyclictest1753918-21kworker/0:0+events00:29:500
165725199240912,2395cyclictest1723845-21kworker/0:0+events22:36:170
165725699240812,2392cyclictest1684482-21kworker/1:0+events20:37:021
165725199240812,2393cyclictest1733201-21kworker/0:0+events23:03:480
165726199240712,2391cyclictest1710701-21kworker/3:1+events21:58:083
165725699240710,2394cyclictest1689994-21kworker/1:1+events21:03:191
165725899240611,2391cyclictest1759219-21kworker/2:0+events00:27:332
165725699240211,2387cyclictest1715459-21kworker/1:0+events22:14:281
165725899239711,2382cyclictest1654771-21kworker/2:1+events19:22:582
165725199239412,2378cyclictest1742583-21kworker/0:1+events23:37:250
165725199239412,2378cyclictest1742583-21kworker/0:1+events23:37:250
165725199239112,2375cyclictest1733201-21kworker/0:0+events23:08:470
16572619923867,2376cyclictest1696367-21kworker/3:2+events21:20:263
165725899238612,2371cyclictest1691569-21kworker/2:3+events21:33:432
165726199238410,2371cyclictest1694758-21kworker/3:0+events21:06:443
165725899238112,2365cyclictest1718780-21kworker/2:1+events22:17:332
165726199237912,2363cyclictest1733126-21kworker/3:0+events23:02:163
165725899237912,2365cyclictest1654771-21kworker/2:1+events19:26:002
165726199237712,2361cyclictest1673387-21kworker/3:0+events20:21:103
165725199237712,2361cyclictest1689846-21kworker/0:0+events20:52:350
165725899237612,2361cyclictest1734943-21kworker/2:1+events23:18:172
165726199237512,2360cyclictest1685981-21kworker/3:0+events20:43:523
165725899237411,2359cyclictest1718780-21kworker/2:1+events22:21:232
165726199237312,2358cyclictest1742679-21kworker/3:1+events23:42:263
165726199237312,2357cyclictest1720562-21kworker/3:1+events22:36:413
16572619923728,2361cyclictest1736396-21kworker/3:0+events23:17:303
165726199237212,2356cyclictest1709077-21kworker/3:0+events21:47:313
165726199237012,2354cyclictest1763791-21kworker/3:2+events00:37:533
165725199237011,2356cyclictest1675154-21kworker/0:1+events20:10:120
165725899236511,2351cyclictest1712472-21kworker/2:2+events22:10:172
165726199236111,2348cyclictest1714009-21kworker/3:0+events22:05:443
165725199236112,2346cyclictest1691443-21kworker/0:1+events21:06:230
165725899236011,2346cyclictest1742737-21kworker/2:2+events23:38:132
165725899236011,2346cyclictest1742737-21kworker/2:2+events23:38:132
16572589923588,2346cyclictest1733336-21kworker/2:0+events23:14:312
165725899235712,2342cyclictest1742737-21kworker/2:2+events23:57:202
165725699235710,2344cyclictest1675511-21kworker/1:2+events20:12:531
165725899235411,2340cyclictest1707474-21kworker/2:0+events21:42:332
165726199235312,2338cyclictest1747331-21kworker/3:2+events23:47:483
165726199235312,2338cyclictest1734766-21kworker/3:1+events23:13:223
165725199235312,2338cyclictest1710905-21kworker/0:0+events21:56:360
165726199235212,2337cyclictest1683116-21kworker/3:2+events20:29:583
165726199235212,2336cyclictest1670194-21kworker/3:1+events19:59:583
165725199235212,2337cyclictest1742583-21kworker/0:1+events00:03:230
165725199235212,2336cyclictest1691443-21kworker/0:1+events21:30:410
165726199235110,2338cyclictest1691385-21kworker/3:2+events21:00:163
165725199235112,2336cyclictest1687968-21kworker/0:2+events20:47:400
165725199235112,2336cyclictest1663601-21kworker/0:1+events19:32:450
165725899235010,2337cyclictest1749292-21kworker/2:1+events00:17:382
165725199235012,2335cyclictest1740950-21kworker/0:0+events23:27:310
165725199235012,2335cyclictest1691443-21kworker/0:1+events21:39:060
165725199235011,2336cyclictest1729863-21kworker/0:2+events22:52:190
165726199234912,2334cyclictest1756002-21kworker/3:0+events00:18:213
165726199234912,2333cyclictest1643964-21kworker/3:2+events19:35:453
165725899234912,2334cyclictest1734943-21kworker/2:1+events23:33:142
165726199234812,2332cyclictest1665364-21kworker/3:0+events19:43:023
165725899234812,2333cyclictest1662149-21kworker/2:0+events19:36:322
165726199234412,2329cyclictest1723608-21kworker/3:0+events22:50:003
165725899234210,2328cyclictest1712472-21kworker/2:2+events22:08:242
165725199234212,2326cyclictest1706064-21kworker/0:0+events21:41:010
165726199234112,2326cyclictest1718843-21kworker/3:0+events22:19:273
165725899234111,2326cyclictest1701074-21kworker/2:1+events21:24:592
165725899234111,2326cyclictest1678059-21kworker/2:1+events20:11:222
165725899234011,2326cyclictest1663773-21kworker/2:2+events19:30:512
165725899234011,2325cyclictest1658851-21kworker/2:3+events19:18:532
165725899233912,2323cyclictest1707474-21kworker/2:0+events21:54:402
165725699233911,2324cyclictest1670107-21kworker/1:0+events20:01:521
165725899233812,2324cyclictest1667028-21kworker/2:2+events19:41:302
165725899233811,2324cyclictest1763727-21kworker/2:1+events00:39:462
165725899233811,2324cyclictest1762098-21kworker/2:2+events00:32:102
165725199233812,2323cyclictest1750843-21kworker/0:2+events00:07:100
165726199233711,2322cyclictest1759280-21kworker/3:0+events00:29:293
165726199233711,2322cyclictest1693042-21kworker/3:1+events20:58:193
165725899233712,2322cyclictest1742737-21kworker/2:2+events23:45:282
165725899233711,2322cyclictest1671583-21kworker/2:2+events19:59:152
165725899233611,2322cyclictest1682967-21kworker/2:2+events20:36:192
165726199233512,2320cyclictest1660596-21kworker/3:0+events19:20:433
165725199233411,2320cyclictest1719040-21kworker/0:1+events22:29:240
165725899233112,2315cyclictest1731532-21kworker/2:1+events22:57:412
165725199233011,2316cyclictest1713845-21kworker/0:2+events22:07:370
165725199233011,2315cyclictest1713845-21kworker/0:2+events22:03:060
165725899232711,2313cyclictest1665394-21kworker/2:1+events19:50:372
165725199232712,2311cyclictest1727306-21kworker/0:1+events22:47:410
165725199232712,2311cyclictest1691443-21kworker/0:1+events21:26:550
165725899232612,2310cyclictest1694788-21kworker/2:0+events21:15:542
165725199232612,2310cyclictest1663957-21kworker/0:2+events19:39:580
165725199232512,2311cyclictest1660989-21kworker/0:0+events19:26:210
165725199232512,2310cyclictest1742583-21kworker/0:1+events23:33:380
165725199232512,2310cyclictest1660989-21kworker/0:0+events19:20:210
165725199232412,2309cyclictest1697639-21kworker/0:2+events21:14:450
165725899231911,2305cyclictest1712472-21kworker/2:2+events22:05:002
165725199231912,2304cyclictest1733201-21kworker/0:0+events23:12:130
165726199230711,2292cyclictest1723608-21kworker/3:0+events22:40:493
165725199230610,2292cyclictest1717410-21kworker/0:0+events22:18:190
165725899228612,2271cyclictest1675512-21kworker/2:0+events20:30:202
165725899228212,2266cyclictest1682967-21kworker/2:2+events20:28:532
165726199228112,2265cyclictest1710701-21kworker/3:1+events22:03:503
165726199227812,2262cyclictest1704420-21kworker/3:0+events21:34:073
165726199227412,2258cyclictest1742679-21kworker/3:1+events23:39:233
165726199227412,2258cyclictest1742679-21kworker/3:1+events23:39:223
165725899227411,2259cyclictest1742737-21kworker/2:2+events23:40:552
165725699227310,2260cyclictest1757642-21kworker/1:2+events00:20:381
165726199227212,2257cyclictest1673387-21kworker/3:0+events20:08:423
165726199226312,2247cyclictest1749354-21kworker/3:0+events00:03:463
165726199226210,2249cyclictest1736396-21kworker/3:0+events23:26:223
165726199225810,2245cyclictest1670194-21kworker/3:1+events19:51:003
165725899225710,2243cyclictest1723922-21kworker/2:0+events22:51:342
165725699225612,2241cyclictest1718935-21kworker/1:1+events22:26:191
165725199225512,2239cyclictest1666728-21kworker/0:0+events19:49:070
165725699225110,2238cyclictest1762187-21kworker/1:1+events00:35:571
165725199224710,2234cyclictest1715491-21kworker/0:1+events22:11:020
165725899224612,2231cyclictest1723922-21kworker/2:0+events22:45:232
165725899224512,2229cyclictest1691569-21kworker/2:3+events21:39:532
165725899224210,2228cyclictest1742737-21kworker/2:2+events23:52:452
165726199223810,2225cyclictest1709077-21kworker/3:0+events21:52:233
165725699222710,2214cyclictest1733066-21kworker/1:0+events23:07:181
165725699222610,2213cyclictest1658490-21kworker/1:2+events19:24:291
16572569922249,2211cyclictest1668474-21kworker/1:1+events19:48:231
165725699222211,2207cyclictest1718935-21kworker/1:1+events22:58:511
165725899221711,2202cyclictest1722270-21kworker/2:2+events22:33:372
165726199221611,2201cyclictest1670194-21kworker/3:1+events20:04:533
165725199221512,2200cyclictest1713845-21kworker/0:2+events22:31:190
16572519922099,2196cyclictest1707680-21kworker/0:2+events21:51:360
16572589922066,2197cyclictest1691569-21kworker/2:3+events20:56:262
165725199220512,2190cyclictest1757461-21kworker/0:2+events00:22:110
165725199217810,2165cyclictest1675154-21kworker/0:1+events20:39:190
165726199215711,2142cyclictest1742679-21kworker/3:1+events23:50:253
165726199215610,2142cyclictest1715756-21kworker/3:3+events22:23:183
165726199215410,2141cyclictest1741007-21kworker/3:2+events23:32:273
165725899215411,2141cyclictest1694788-21kworker/2:0+events21:13:142
165726199215311,2139cyclictest1715610-21kworker/3:2+events22:14:063
165725899215210,2139cyclictest1686223-21kworker/2:1+events20:42:422
165725899215111,2137cyclictest1729927-21kworker/2:2+events23:04:342
165726199214810,2135cyclictest1720562-21kworker/3:1+events22:31:433
165725899214210,2129cyclictest1718780-21kworker/2:1+events22:37:482
16572519921428,2131cyclictest1693088-21kworker/0:0+events20:59:280
16572619921418,2130cyclictest1696367-21kworker/3:2+events21:39:283
16572619921409,2127cyclictest1751012-21kworker/3:2+events00:13:473
165726199214010,2127cyclictest1660596-21kworker/3:0+events19:19:173
165726199213911,2125cyclictest1749354-21kworker/3:0+events23:59:333
165725899213910,2126cyclictest1673329-21kworker/2:1+events20:03:212
165725199213110,2118cyclictest1650384-21kworker/0:2+events19:16:590
165725199212911,2115cyclictest1740950-21kworker/0:0+events23:43:120
165725199212810,2115cyclictest1723845-21kworker/0:0+events22:42:450
165725199212711,2113cyclictest1719040-21kworker/0:1+events22:21:000
165725199212711,2113cyclictest1693310-21kworker/0:3+events21:02:370
165725199212710,2114cyclictest1753918-21kworker/0:0+events00:34:490
165725199212710,2113cyclictest1729863-21kworker/0:2+events22:59:360
165725199212511,2111cyclictest1742583-21kworker/0:1+events23:48:540
165725199212511,2111cyclictest1671555-21kworker/0:2+events19:57:440
16572619921238,2112cyclictest1733126-21kworker/3:0+events23:05:213
165725199211911,2105cyclictest1666728-21kworker/0:0+events19:43:490
165726199211811,2104cyclictest1643964-21kworker/3:2+events19:14:203
16572589921149,2102cyclictest1691569-21kworker/2:3+events21:27:412
165725699211311,2099cyclictest1709385-21kworker/1:2+events21:52:451
165725199211110,2097cyclictest1753918-21kworker/0:0+events00:38:590
165725899210710,2093cyclictest1707474-21kworker/2:0+events21:59:402
16572589920899,2076cyclictest1750896-21kworker/2:0+events00:01:492
165725699202311,2009cyclictest1658490-21kworker/1:2+events19:13:341
16572589919419,1929cyclictest1658520-21kworker/2:2+events19:13:122
16569442188158,25sleep20-21swapper/219:08:192
16569052150105,25sleep10-21swapper/119:07:501
16569802144110,30sleep30-21swapper/319:08:493
16568782142113,24sleep00-21swapper/019:07:290
165726199190,17cyclictest1702899-21taskset21:28:323
1657261991817,1cyclictest26450irq/143-i91500:06:263
1657261991512,1cyclictest1739514-21taskset23:22:233
1657261991511,3cyclictest1728883-21/usr/sbin/munin22:50:153
165725899150,13cyclictest1695097-21runrttasks21:05:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional