You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 13:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Tue Sep 22, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15857729928502,2843cyclictest1585529-21kworker/2:3+events19:15:192
158577099280913,2792cyclictest1592282-21kworker/1:0+events19:35:181
158576699274913,2733cyclictest1592248-21kworker/0:0+events19:30:210
158576699270813,2693cyclictest1656583-21kworker/0:1+events22:50:100
158577099268413,2666cyclictest1651428-21kworker/1:1+events22:40:171
158577099268010,2666cyclictest1619327-21kworker/1:1+events21:15:121
158577299266312,2648cyclictest1666048-21kworker/2:0+events23:20:212
158577299258212,2566cyclictest1590541-21kworker/2:1+events19:29:352
158577099257712,2561cyclictest1667425-21kworker/1:0+events23:22:591
158577099257011,2555cyclictest1622528-21kworker/1:2+events21:10:191
158577099257011,2555cyclictest1622528-21kworker/1:2+events21:10:191
158577299256812,2552cyclictest1667709-21kworker/2:1+events23:29:082
158577099256711,2552cyclictest1658180-21kworker/1:0+events23:01:141
158577299256212,2546cyclictest1619426-21kworker/2:2+events20:57:022
158577099256212,2546cyclictest1672288-21kworker/1:2+events00:04:191
158577299256112,2545cyclictest1645271-21kworker/2:1+events22:23:522
158577299254912,2533cyclictest1609625-21kworker/2:0+events20:23:132
158577299253712,2521cyclictest1595420-21kworker/2:0+events19:49:392
158576699253211,2518cyclictest1667532-21kworker/0:2+events23:25:170
15857709925288,2516cyclictest1675679-21kworker/1:0+events23:51:191
158577099252012,2505cyclictest1613068-21kworker/1:1+events20:39:441
158577099250312,2488cyclictest1614648-21kworker/1:0+events20:50:321
158577099249612,2481cyclictest1643542-21kworker/1:0+events22:09:191
158577099249512,2479cyclictest1638718-21kworker/1:1+events22:04:181
158577099249312,2478cyclictest1687244-21kworker/1:0+events00:34:421
158577099249312,2477cyclictest1641935-21kworker/1:2+events22:13:101
158577099249312,2477cyclictest1596864-21kworker/1:2+events19:41:191
158577099249311,2479cyclictest1598612-21kworker/1:1+events20:02:581
158577299249211,2478cyclictest1676942-21kworker/2:1+events23:56:162
158577299249112,2477cyclictest1645271-21kworker/2:1+events22:15:052
158577299249012,2474cyclictest1605173-21kworker/2:3+events20:11:232
158577099248911,2475cyclictest1651428-21kworker/1:1+events22:36:471
158577099248811,2474cyclictest1608177-21kworker/1:0+events20:22:261
15857709924878,2476cyclictest1678456-21kworker/1:1+events23:57:021
15857729924859,2472cyclictest1662802-21kworker/2:0+events23:12:412
158577299248412,2468cyclictest1607966-21kworker/2:1+events20:17:042
158577299248312,2468cyclictest1613147-21kworker/2:2+events20:42:452
158577299248311,2469cyclictest1638627-21kworker/2:1+events22:05:282
15857709924839,2471cyclictest1598612-21kworker/1:1+events19:57:401
158577099248212,2467cyclictest1670685-21kworker/1:0+events23:37:551
158577299248012,2464cyclictest1673704-21kworker/2:2+events23:45:152
158577099248011,2465cyclictest1680170-21kworker/1:0+events00:10:511
158577099247910,2466cyclictest1646917-21kworker/1:2+events22:21:571
158577299247712,2462cyclictest1621023-21kworker/2:1+events21:00:262
158577299247711,2463cyclictest1590541-21kworker/2:1+events19:42:042
15857729924769,2464cyclictest1600215-21kworker/2:1+events19:58:032
158577099247612,2461cyclictest1672288-21kworker/1:2+events23:41:241
158577099247611,2462cyclictest1662622-21kworker/1:1+events23:13:521
158577099247512,2460cyclictest1685362-21kworker/1:1+events00:27:061
158577099247512,2460cyclictest1625723-21kworker/1:0+events21:26:401
158577299247412,2459cyclictest1673704-21kworker/2:2+events00:03:322
158577099247412,2459cyclictest1662622-21kworker/1:1+events23:16:091
158577099247412,2459cyclictest1638718-21kworker/1:1+events21:53:401
15857709924739,2461cyclictest1588929-21kworker/1:1+events19:19:261
158577099247212,2456cyclictest1609807-21kworker/1:2+events20:34:421
158577099247110,2458cyclictest1619327-21kworker/1:1+events20:56:381
158576699247011,2455cyclictest1625667-21kworker/0:0+events21:11:030
158576699247011,2455cyclictest1625667-21kworker/0:0+events21:11:020
158577299246912,2454cyclictest1687332-21kworker/2:2+events00:25:362
158577299246612,2451cyclictest1653121-21kworker/2:0+events22:41:502
158577099246511,2451cyclictest1654688-21kworker/1:2+events22:54:461
158576699246512,2449cyclictest1680139-21kworker/0:0+events00:02:240
158577099246110,2448cyclictest1658180-21kworker/1:0+events23:10:001
158576699246112,2446cyclictest1659856-21kworker/0:3+events23:10:460
158577299245712,2441cyclictest1654748-21kworker/2:1+events22:45:182
158577299245210,2439cyclictest1622647-21kworker/2:0+events21:12:562
158577299245210,2439cyclictest1622647-21kworker/2:0+events21:12:552
158577099244012,2425cyclictest1633848-21kworker/1:2+events21:41:141
158577299243912,2424cyclictest1611369-21kworker/2:1+events20:29:432
15857669924309,2418cyclictest1605075-21kworker/0:0+events20:10:130
158576699242512,2411cyclictest1658197-21kworker/0:2+events22:55:300
158577099242012,2405cyclictest1643542-21kworker/1:0+events22:15:301
158576699242012,2405cyclictest1598567-21kworker/0:2+events19:48:530
158577699241012,2394cyclictest1670718-21kworker/3:2+events23:44:513
158576699240812,2393cyclictest1588987-21kworker/0:1+events19:20:560
158576699240811,2395cyclictest1690412-21kworker/0:0+events00:35:060
158577299240412,2388cyclictest1688977-21kworker/2:0+events00:34:192
158577099240411,2390cyclictest1654688-21kworker/1:2+events22:47:361
158576699240112,2386cyclictest1685329-21kworker/0:0+events00:23:210
15857729924003,2394cyclictest1605045-21kworker/2:2+events20:09:522
158576699240012,2385cyclictest1664269-21kworker/0:1+events23:22:370
15857769923999,2386cyclictest1611209-21kworker/3:2+events20:40:523
158576699239712,2381cyclictest1619657-21kworker/0:1+events21:09:320
158577299239511,2380cyclictest1617575-21kworker/2:0+events20:51:382
158576699239212,2377cyclictest1643355-21kworker/0:2+events22:11:160
158577299238912,2373cyclictest1611369-21kworker/2:1+events20:32:222
158577099238912,2374cyclictest1649773-21kworker/1:0+events22:31:531
158576699238812,2373cyclictest1659856-21kworker/0:3+events23:06:360
158576699238712,2371cyclictest1619733-21kworker/0:3+events21:01:580
158576699238412,2369cyclictest1608299-21kworker/0:0+events20:21:180
15857729923839,2371cyclictest1648111-21kworker/2:0+events22:30:452
158576699238312,2368cyclictest1629178-21kworker/0:0+events21:36:160
158576699238312,2367cyclictest1635730-21kworker/0:1+events21:54:270
158577099238211,2367cyclictest1598612-21kworker/1:1+events20:18:341
158576699238212,2367cyclictest1608299-21kworker/0:0+events20:28:570
158576699238210,2368cyclictest1600219-21kworker/0:1+events19:59:110
158576699238112,2365cyclictest1635730-21kworker/0:1+events22:03:070
158576699237912,2364cyclictest1629178-21kworker/0:0+events21:23:590
158577099237811,2363cyclictest1680170-21kworker/1:0+events00:06:361
158577299237711,2363cyclictest1673704-21kworker/2:2+events00:06:142
15857669923778,2367cyclictest1681979-21kworker/0:2+events00:15:020
158576699237412,2359cyclictest1643355-21kworker/0:2+events22:07:220
158576699237012,2355cyclictest1619657-21kworker/0:1+events21:16:200
158577099236910,2356cyclictest1688902-21kworker/1:2+events00:37:221
158577699236511,2351cyclictest1611209-21kworker/3:2+events20:54:193
158577299236212,2347cyclictest1656613-21kworker/2:2+events23:30:152
158576699236112,2346cyclictest1632427-21kworker/0:2+events21:47:420
158577299235411,2339cyclictest1590541-21kworker/2:1+events19:23:582
158577099235312,2338cyclictest1583746-21kworker/1:0+events19:11:531
158577099234911,2334cyclictest1616319-21kworker/1:2+events20:47:481
158576699234611,2332cyclictest1617802-21kworker/0:2+events20:50:550
158577299234211,2327cyclictest1671447-21kworker/2:1+events23:37:112
158577699234011,2327cyclictest1583636-21kworker/3:2+events19:40:113
158577099233811,2324cyclictest1625723-21kworker/1:0+events21:21:191
158577299233412,2319cyclictest1673704-21kworker/2:2+events23:51:412
158577099233212,2316cyclictest1625723-21kworker/1:0+events21:38:111
158576699233012,2314cyclictest1672349-21kworker/0:2+events23:39:280
158577299232712,2312cyclictest1630725-21kworker/2:0+events21:33:582
158577299232612,2310cyclictest1598551-21kworker/2:2+events19:54:372
158577299232512,2309cyclictest1656613-21kworker/2:2+events22:53:592
15857669923198,2308cyclictest1608299-21kworker/0:0+events20:32:000
158576699231911,2305cyclictest1669113-21kworker/0:0+events23:53:140
158577699231812,2303cyclictest1598517-21kworker/3:1+events19:52:423
158577299231812,2302cyclictest1682162-21kworker/2:1+events00:38:512
158577699231612,2301cyclictest1670718-21kworker/3:2+events00:07:243
158577299231511,2300cyclictest1682162-21kworker/2:1+events00:19:342
158577699231211,2297cyclictest1622558-21kworker/3:1+events21:29:223
158577299231112,2296cyclictest1630725-21kworker/2:0+events21:41:382
158577299230611,2292cyclictest1656613-21kworker/2:2+events23:09:362
158577099230311,2289cyclictest1622528-21kworker/1:2+events21:05:431
158576699229810,2284cyclictest1593856-21kworker/0:1+events19:36:050
158577699229510,2282cyclictest1611209-21kworker/3:2+events20:33:313
158577699229410,2281cyclictest1595748-21kworker/3:0+events19:46:363
158576699229312,2278cyclictest1619657-21kworker/0:1+events20:58:540
158577299229212,2277cyclictest1590541-21kworker/2:1+events19:37:312
158577299228311,2269cyclictest1671447-21kworker/2:1+events23:40:142
158577299228310,2270cyclictest1624335-21kworker/2:2+events21:23:362
158577099227710,2264cyclictest1598612-21kworker/1:1+events20:27:461
158577299227611,2262cyclictest1622647-21kworker/2:0+events21:08:482
158577299227611,2261cyclictest1630725-21kworker/2:0+events21:51:022
158577099227610,2265cyclictest1625723-21kworker/1:0+events21:30:101
158577299227512,2258cyclictest1613147-21kworker/2:2+events20:37:032
158577099227511,2261cyclictest1664223-21kworker/1:2+events23:29:531
158577299227410,2260cyclictest1630725-21kworker/2:0+events21:28:362
15857709922745,2266cyclictest1604894-21kworker/1:2+events20:08:201
158576699227410,2261cyclictest1603459-21kworker/0:2+events20:09:280
158577299227311,2259cyclictest1656613-21kworker/2:2+events23:15:462
158577099227311,2259cyclictest1592282-21kworker/1:0+events19:49:151
158577099227311,2258cyclictest1622528-21kworker/1:2+events21:02:421
158577099227211,2258cyclictest1685362-21kworker/1:1+events00:20:421
158577299227111,2257cyclictest1630725-21kworker/2:0+events21:55:572
158576699227111,2256cyclictest1687214-21kworker/0:1+events00:33:120
158577099227011,2256cyclictest1613068-21kworker/1:1+events20:41:371
158577099227011,2255cyclictest1669042-21kworker/1:1+events23:31:021
158577099227010,2257cyclictest1683716-21kworker/1:2+events00:15:491
15857709922699,2256cyclictest1590623-21kworker/1:2+events19:32:161
158577099226911,2255cyclictest1633848-21kworker/1:2+events21:48:501
15857709922678,2256cyclictest1654688-21kworker/1:2+events22:58:551
158577099226711,2252cyclictest1673917-21kworker/1:1+events23:47:551
158577099226511,2250cyclictest1590623-21kworker/1:2+events19:27:411
158577099226510,2252cyclictest1592282-21kworker/1:0+events19:52:191
158576699226411,2250cyclictest1635730-21kworker/0:1+events21:57:260
15857729922609,2248cyclictest1630725-21kworker/2:0+events21:45:262
158577299225810,2244cyclictest1601799-21kworker/2:0+events20:03:202
158577099225811,2244cyclictest1649773-21kworker/1:0+events22:28:511
15857729922569,2244cyclictest1645271-21kworker/2:1+events22:25:472
158577099225611,2242cyclictest1598612-21kworker/1:1+events20:13:171
15857729922558,2243cyclictest1673704-21kworker/2:2+events00:13:062
158577299225511,2241cyclictest1682162-21kworker/2:1+events00:21:502
158577299225410,2241cyclictest1622647-21kworker/2:0+events21:17:292
158577099225411,2239cyclictest1638718-21kworker/1:1+events21:58:111
158577299225211,2237cyclictest1592160-21kworker/2:0+events19:31:072
15857729922509,2237cyclictest1645271-21kworker/2:1+events22:36:252
158577699224710,2234cyclictest1622558-21kworker/3:1+events21:15:583
158577299224710,2234cyclictest1643666-21kworker/2:0+events22:10:282
158577299224710,2234cyclictest1615971-21kworker/2:1+events20:48:332
158577699224512,2230cyclictest1661481-21kworker/3:0+events23:06:593
158576699223612,2221cyclictest1614475-21kworker/0:2+events20:38:110
15857769922337,2223cyclictest1580268-21kworker/3:1+events19:17:113
15857669922339,2219cyclictest1664269-21kworker/0:1+events23:17:420
158576699220911,2195cyclictest1687214-21kworker/0:1+events00:29:220
158576699220910,2196cyclictest1629178-21kworker/0:0+events21:31:410
15857669922069,2193cyclictest1612794-21kworker/0:1+events20:46:170
158576699219711,2183cyclictest1595479-21kworker/0:0+events19:44:400
15857669921938,2182cyclictest1632427-21kworker/0:2+events21:40:520
158576699219010,2177cyclictest1667532-21kworker/0:2+events23:32:120
158576699218811,2173cyclictest1648250-21kworker/0:1+events22:26:080
15857669921868,2174cyclictest1669113-21kworker/0:0+events23:44:030
15857669921838,2172cyclictest1627554-21kworker/0:2+events21:25:550
15857669921836,2174cyclictest1603459-21kworker/0:2+events20:04:280
158576699218211,2169cyclictest1612794-21kworker/0:1+events20:40:050
158576699218111,2167cyclictest1643355-21kworker/0:2+events22:21:110
158576699217911,2164cyclictest1669113-21kworker/0:0+events23:48:380
15857669921779,2164cyclictest1651457-21kworker/0:0+events22:42:140
158576699217710,2164cyclictest1603459-21kworker/0:2+events20:17:270
15857709921768,2165cyclictest1583746-21kworker/1:0+events19:20:331
158576699217610,2163cyclictest1651457-21kworker/0:0+events22:37:110
158576699217511,2161cyclictest1598567-21kworker/0:2+events19:53:520
158576699217411,2160cyclictest1588987-21kworker/0:1+events19:25:280
158576699217311,2159cyclictest1651457-21kworker/0:0+events22:49:280
15857669921729,2159cyclictest1644969-21kworker/0:0+events22:16:150
15857769921709,2158cyclictest1646967-21kworker/3:0+events22:25:243
158577699216611,2151cyclictest1659540-21kworker/3:1+events23:25:393
158576699216611,2152cyclictest1649837-21kworker/0:2+events22:33:480
15857669921387,2127cyclictest1681979-21kworker/0:2+events00:11:570
158577699213111,2117cyclictest1600184-21kworker/3:2+events20:00:203
158577699212011,2106cyclictest1648932-21kworker/3:2+events22:57:023
158577699211911,2105cyclictest1637213-21kworker/3:0+events21:50:413
158577699211711,2103cyclictest1619625-21kworker/3:0+events20:58:343
158577699211711,2103cyclictest1583636-21kworker/3:2+events19:34:113
158577699211511,2101cyclictest1659540-21kworker/3:1+events23:30:393
158577699211411,2100cyclictest1645000-21kworker/3:1+events22:24:133
158577699211411,2100cyclictest1633967-21kworker/3:2+events22:11:393
158577699210910,2096cyclictest1615940-21kworker/3:1+events20:45:293
15857729921087,2098cyclictest1658212-21kworker/2:0+events22:55:552
158577699210611,2092cyclictest1622558-21kworker/3:1+events21:37:243
158577699210310,2090cyclictest1622558-21kworker/3:1+events21:06:533
15857769920979,2086cyclictest1611209-21kworker/3:2+events21:01:153
15857729920969,2084cyclictest1580474-21kworker/2:2+events19:13:262
158577699209310,2080cyclictest1624183-21kworker/3:0+events21:10:413
158577699209310,2080cyclictest1624183-21kworker/3:0+events21:10:413
158577699209210,2079cyclictest1622558-21kworker/3:1+events21:42:233
158577299209010,2076cyclictest1656613-21kworker/2:2+events23:04:172
158576699206810,2055cyclictest1656583-21kworker/0:1+events23:02:450
158577299205211,2038cyclictest1630725-21kworker/2:0+events22:00:482
158577699204511,2031cyclictest1670718-21kworker/3:2+events00:22:563
15857669920379,2025cyclictest1586952-21kworker/0:0+events19:11:100
15857669920347,2023cyclictest1586952-21kworker/0:0+events19:16:270
15857669920336,2024cyclictest1673975-21kworker/0:1+events23:56:390
158577299202911,2015cyclictest1630725-21kworker/2:0+events21:39:432
158576699202410,2011cyclictest1680139-21kworker/0:0+events00:07:470
158577699201410,2001cyclictest1668951-21kworker/3:0+events23:55:313
158577699196910,1956cyclictest1583636-21kworker/3:2+events19:13:503
15857769919636,1954cyclictest1633967-21kworker/3:2+events21:48:053
158577699196010,1947cyclictest1602228-21kworker/3:0+events20:37:263
158577699195810,1945cyclictest1593974-21kworker/3:1+events19:37:543
158577699194210,1929cyclictest1659540-21kworker/3:1+events23:18:503
15857769919409,1929cyclictest1682101-21kworker/3:1+events00:10:053
15857769918506,1841cyclictest1602228-21kworker/3:0+events20:28:333
15851092193164,24sleep00-21swapper/019:06:370
15851402153111,25sleep30-21swapper/319:07:003
15852162148114,29sleep10-21swapper/119:07:581
15853442141109,27sleep20-21swapper/219:09:352
158577699330,20cyclictest1677243-21awk23:55:013
158577699281,23cyclictest1642148-21awk22:05:013
158577699250,23cyclictest1628552-21memory21:20:173
158577699242,19cyclictest1692133-21awk00:40:003
158577699241,20cyclictest1643731-21sleep22:10:013
158577699241,20cyclictest1632624-21idleruntime-cro21:35:003
158577699241,18cyclictest1646881-21perf22:20:003
158577699240,22cyclictest1656124-21sed22:45:213
158577699235,16cyclictest1608332-21systemctl20:20:013
158577699231,18cyclictest1601973-21munin-run20:00:003
158577699230,12cyclictest1685757-21cat00:20:003
158577699228,12cyclictest1688028-21memory00:25:173
158577699221,18cyclictest1664570-21idleruntime-cro23:14:593
158577699221,18cyclictest1653233-21awk22:40:003
158577699221,17cyclictest1672493-21perf23:39:593
158577699220,16cyclictest0-21swapper/323:20:303
158577699215,14cyclictest0-21swapper/320:10:003
1585776992111,8cyclictest1654219-21/usr/sbin/munin22:40:193
158577699210,17cyclictest0-21swapper/319:20:113
158577699201,17cyclictest1651650-21idleruntime-cro22:35:013
158577699201,16cyclictest1661405-21munin-run23:05:003
158577699200,19cyclictest1680498-21/usr/sbin/munin00:05:013
158577699200,19cyclictest1609617-21chrt20:21:263
158577699200,18cyclictest1675664-21awk23:50:003
158577699191,16cyclictest1640551-21perf22:00:003
158577699191,15cyclictest1689934-21python300:30:223
158577699180,16cyclictest1658337-21wc22:55:013
158577699174,7cyclictest0-21swapper/320:10:133
158577699170,15cyclictest1591700-21ntpq19:25:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional