You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-13 - 05:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Sun Sep 13, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
151966699345411,3438cyclictest1613222-21kworker/0:1+events00:16:110
15196769930505,3039cyclictest1523384-21kworker/2:0+events19:25:152
151967699295714,2938cyclictest1620915-21kworker/2:2+events00:25:162
151966899292612,2909cyclictest1574116-21kworker/1:1+events22:10:191
151966699289213,2876cyclictest1600391-21kworker/0:2+events23:25:000
151967699285913,2841cyclictest1523384-21kworker/2:0+events19:30:132
151966699285811,2843cyclictest1563178-21kworker/0:2+events21:25:150
151967699278413,2765cyclictest1606646-21kworker/2:2+events00:00:152
151966699277813,2761cyclictest1543487-21kworker/0:0+events20:35:150
151966899277313,2757cyclictest1516264-21kworker/1:0+events19:20:181
151967699277210,2759cyclictest1543584-21kworker/2:0+events20:40:112
151966899273713,2720cyclictest1592545-21kworker/1:1+events23:05:151
151966899272210,2709cyclictest1574116-21kworker/1:1+events22:00:021
151966699272110,2707cyclictest1566413-21kworker/0:2+events22:45:150
151966699271213,2696cyclictest1575803-21kworker/0:0+events22:05:010
151966699268113,2664cyclictest1588884-21kworker/0:0+events23:00:240
151966699264112,2625cyclictest1566413-21kworker/0:2+events22:35:230
151966899260310,2589cyclictest1547060-21kworker/1:0+events20:47:451
151967699254812,2533cyclictest1600180-21kworker/2:0+events23:23:292
151966899253313,2516cyclictest1603730-21kworker/1:0+events23:35:221
151967699252912,2513cyclictest1569256-21kworker/2:1+events21:50:262
151967699252812,2512cyclictest1600180-21kworker/2:0+events23:26:322
151967699252612,2511cyclictest1546855-21kworker/2:3+events20:34:322
151967699252612,2510cyclictest1556502-21kworker/2:2+events21:22:142
151967699251812,2502cyclictest1620915-21kworker/2:2+events00:33:332
151967699251810,2504cyclictest1546855-21kworker/2:3+events20:52:132
15196769925168,2504cyclictest1615983-21kworker/2:1+events00:08:112
151967699251412,2499cyclictest1598569-21kworker/2:1+events23:14:232
151966899250110,2487cyclictest1541953-21kworker/1:1+events20:37:311
151966699249812,2484cyclictest1613222-21kworker/0:1+events00:30:090
151966899249612,2480cyclictest1574116-21kworker/1:1+events22:20:121
151967699249511,2481cyclictest1585539-21kworker/2:1+events22:52:252
151966899249312,2477cyclictest1625720-21kworker/1:2+events00:39:311
151966899249312,2477cyclictest1541953-21kworker/1:1+events20:21:331
15196689924909,2478cyclictest1525992-21kworker/1:0+events20:17:441
151966899249012,2476cyclictest1525992-21kworker/1:0+events20:25:051
151968199248712,2471cyclictest1561375-21kworker/3:0+events21:37:503
151967699248711,2472cyclictest1543584-21kworker/2:0+events20:38:162
151966899248710,2473cyclictest1611430-21kworker/1:2+events23:56:031
151966699248711,2472cyclictest1524448-21kworker/0:0+events19:37:240
15196769924867,2476cyclictest1556502-21kworker/2:2+events21:18:272
151966899248612,2470cyclictest1555033-21kworker/1:0+events21:19:141
151966699248612,2471cyclictest1617750-21kworker/0:0+events00:13:320
151967699248512,2470cyclictest1564881-21kworker/2:3+events21:34:212
151967699248511,2470cyclictest1533942-21kworker/2:2+events19:55:532
151966899248512,2470cyclictest1592545-21kworker/1:1+events22:55:511
15196689924847,2473cyclictest1530928-21kworker/1:2+events19:44:111
151966899248412,2468cyclictest1596999-21kworker/1:2+events23:20:521
151967699248312,2467cyclictest1546855-21kworker/2:3+events20:57:052
151966899248310,2469cyclictest1555033-21kworker/1:0+events21:24:291
151966899247511,2460cyclictest1592545-21kworker/1:1+events23:00:461
15196769924735,2465cyclictest1532350-21kworker/2:1+events20:07:242
151967699247112,2456cyclictest1551696-21kworker/2:0+events20:48:292
151967699247111,2456cyclictest1569256-21kworker/2:1+events22:09:122
15196769924669,2453cyclictest1572480-21kworker/2:2+events21:57:002
151966899246310,2449cyclictest1611430-21kworker/1:2+events23:54:121
151967699245911,2445cyclictest1541972-21kworker/2:2+events20:26:342
151967699245811,2443cyclictest1579129-21kworker/2:2+events22:28:092
151967699245811,2443cyclictest1579129-21kworker/2:2+events22:23:162
151966899245711,2443cyclictest1574116-21kworker/1:1+events22:05:461
151966699245412,2440cyclictest1561558-21kworker/0:0+events21:35:080
151967699245312,2437cyclictest1558348-21kworker/2:1+events21:09:202
151967699245112,2436cyclictest1598569-21kworker/2:1+events23:17:282
151967699244912,2434cyclictest1620915-21kworker/2:2+events00:23:222
151967699244712,2431cyclictest1532350-21kworker/2:1+events20:16:352
151966899244510,2431cyclictest1583798-21kworker/1:1+events22:43:181
151966899244510,2431cyclictest1583798-21kworker/1:1+events22:43:171
151966699244312,2428cyclictest1534121-21kworker/0:1+events19:59:180
151967699244212,2426cyclictest1585539-21kworker/2:1+events22:49:002
151967699244212,2426cyclictest1567653-21kworker/2:0+events21:38:362
151967699244211,2428cyclictest1556502-21kworker/2:2+events21:12:472
151967699243912,2424cyclictest1585539-21kworker/2:1+events22:41:462
151967699243912,2424cyclictest1585539-21kworker/2:1+events22:41:462
151967699243912,2424cyclictest1532350-21kworker/2:1+events20:11:362
151967699243811,2424cyclictest1604997-21kworker/2:0+events23:39:342
151967699243612,2421cyclictest1595395-21kworker/2:0+events23:03:462
151967699243612,2420cyclictest1569256-21kworker/2:1+events21:42:262
151967699243511,2421cyclictest1583949-21kworker/2:0+events22:36:522
151967699243511,2421cyclictest1541972-21kworker/2:2+events20:22:212
151967699243511,2421cyclictest1533942-21kworker/2:2+events19:53:352
151967699243412,2419cyclictest1532350-21kworker/2:1+events20:00:262
151967699243410,2421cyclictest1579129-21kworker/2:2+events22:18:442
15196769924339,2421cyclictest1609894-21kworker/2:0+events23:49:252
151967699243212,2417cyclictest1575681-21kworker/2:0+events22:11:052
151967699243112,2416cyclictest1595395-21kworker/2:0+events23:07:102
151967699243011,2416cyclictest1569256-21kworker/2:1+events22:01:582
15196689924276,2417cyclictest1583798-21kworker/1:1+events22:47:511
151966699242711,2412cyclictest1538946-21kworker/0:0+events20:10:270
151967699242412,2408cyclictest1529125-21kworker/2:0+events19:38:302
151966699242412,2410cyclictest1524448-21kworker/0:0+events19:40:250
151966699242211,2407cyclictest1602065-21kworker/0:1+events23:48:180
151966899242112,2406cyclictest1567928-21kworker/1:1+events21:42:021
151967699242012,2404cyclictest1601805-21kworker/2:2+events23:31:322
151967699241712,2403cyclictest1564881-21kworker/2:3+events21:45:062
151966699241612,2400cyclictest1566413-21kworker/0:2+events22:25:330
151966899241411,2399cyclictest1525992-21kworker/1:0+events19:45:201
151966899241211,2398cyclictest1605489-21kworker/1:2+events23:43:011
151966699240812,2393cyclictest1543804-21kworker/0:3+events20:29:400
151966699240811,2393cyclictest1606555-21kworker/0:0+events23:40:180
151966899240712,2393cyclictest1609747-21kworker/1:0+events00:05:101
151966699240511,2390cyclictest1588884-21kworker/0:0+events22:50:540
15196689924046,2395cyclictest1532553-21kworker/1:1+events19:57:261
151966899240410,2390cyclictest1602003-21kworker/1:1+events23:31:571
151966899240312,2387cyclictest1555033-21kworker/1:0+events21:13:101
151966699240212,2386cyclictest1532525-21kworker/0:0+events19:53:580
151966899240112,2386cyclictest1585494-21kworker/1:0+events22:33:301
151966699240111,2387cyclictest1566413-21kworker/0:2+events21:40:540
151966899239912,2383cyclictest1525992-21kworker/1:0+events19:37:471
151966899239712,2383cyclictest1590598-21kworker/1:2+events22:50:101
151966899239712,2383cyclictest1525992-21kworker/1:0+events20:10:041
151966899239712,2382cyclictest1613084-21kworker/1:1+events00:02:541
151966899239712,2382cyclictest1598630-21kworker/1:1+events23:16:411
151966899239712,2382cyclictest1563060-21kworker/1:1+events21:28:391
151966899239711,2382cyclictest1547060-21kworker/1:0+events20:42:291
151966899239612,2381cyclictest1574116-21kworker/1:1+events22:15:411
151966899239612,2380cyclictest1555129-21kworker/1:3+events21:05:071
151966899239512,2379cyclictest1538630-21kworker/1:1+events20:07:481
151966899239412,2379cyclictest1617598-21kworker/1:1+events00:13:531
151966899239312,2377cyclictest1550375-21kworker/1:1+events20:51:301
15196689923929,2379cyclictest1617598-21kworker/1:1+events00:18:501
151966899239112,2377cyclictest1583798-21kworker/1:1+events22:35:011
151966899239112,2375cyclictest1619593-21kworker/1:3+events00:21:531
151966899238812,2373cyclictest1525992-21kworker/1:0+events19:54:211
151968199238612,2370cyclictest1521303-21kworker/3:3+events19:23:413
151966699238512,2369cyclictest1561558-21kworker/0:0+events21:24:080
151967699238311,2368cyclictest1609894-21kworker/2:0+events23:51:122
151966899238311,2368cyclictest1516264-21kworker/1:0+events19:16:071
151966699238211,2368cyclictest1621018-21kworker/0:0+events00:29:230
151966699238112,2366cyclictest1566413-21kworker/0:2+events22:19:050
15196669923703,2364cyclictest1548708-21kworker/0:1+events21:18:490
151966699237012,2355cyclictest1548708-21kworker/0:1+events20:57:260
151966699236311,2349cyclictest1550317-21kworker/0:0+events20:45:310
151966899235911,2345cyclictest1596999-21kworker/1:2+events23:11:451
151968199235412,2339cyclictest1585725-21kworker/3:0+events00:00:373
151966699235112,2336cyclictest1566413-21kworker/0:2+events21:59:150
151966699235111,2337cyclictest1588884-21kworker/0:0+events23:12:520
151966699235012,2336cyclictest1566413-21kworker/0:2+events21:50:040
151966699235011,2337cyclictest1548708-21kworker/0:1+events20:41:190
15196669923489,2336cyclictest1577758-21kworker/0:1+events22:12:130
15196669923469,2334cyclictest1602065-21kworker/0:1+events23:26:560
151966699234311,2328cyclictest1543487-21kworker/0:0+events20:33:220
151966699234112,2326cyclictest1613222-21kworker/0:1+events00:20:230
151966699233812,2323cyclictest1624644-21kworker/0:0+events00:37:370
151966699233712,2321cyclictest1574149-21kworker/0:1+events22:02:190
151966899233511,2321cyclictest1545449-21kworker/1:2+events20:32:391
151966699233510,2322cyclictest1613222-21kworker/0:1+events00:08:310
151966699233312,2318cyclictest1613222-21kworker/0:1+events00:03:410
151967699233212,2316cyclictest1606646-21kworker/2:2+events23:57:562
151966699233010,2317cyclictest1524448-21kworker/0:0+events19:25:370
151966699232911,2315cyclictest1530872-21kworker/0:2+events19:46:040
151966699232812,2312cyclictest1548708-21kworker/0:1+events21:06:400
151968199232711,2312cyclictest1613212-21kworker/3:1+events00:24:083
151966699232612,2311cyclictest1588884-21kworker/0:0+events22:42:530
151966699232612,2311cyclictest1588884-21kworker/0:0+events22:42:530
151966699232612,2310cyclictest1585345-21kworker/0:1+events22:31:360
151966699232612,2310cyclictest1541233-21kworker/0:2+events20:16:130
151966699232611,2312cyclictest1520781-21kworker/0:1+events19:30:370
151966899232512,2309cyclictest1619593-21kworker/1:3+events00:26:221
151966699232512,2310cyclictest1600391-21kworker/0:2+events23:19:450
151968199232311,2309cyclictest1616076-21kworker/3:2+events00:11:143
151966699231212,2297cyclictest1520781-21kworker/0:1+events19:21:470
151966899230910,2295cyclictest1608088-21kworker/1:1+events23:47:091
151966699230712,2292cyclictest1602065-21kworker/0:1+events23:36:540
151966899228511,2271cyclictest1525992-21kworker/1:0+events19:29:051
151966899228312,2268cyclictest1564719-21kworker/1:2+events22:00:471
15196689922807,2270cyclictest1583798-21kworker/1:1+events22:27:011
151966699227110,2258cyclictest1612789-21kworker/0:0+events23:59:060
151966899226611,2252cyclictest1564719-21kworker/1:2+events21:30:571
151966699226612,2251cyclictest1566413-21kworker/0:2+events21:47:260
151966699226212,2247cyclictest1535726-21kworker/0:2+events20:04:200
151967699225710,2244cyclictest1521167-21kworker/2:3+events19:21:242
151967699225211,2237cyclictest1613205-21kworker/2:0+events00:15:472
151966699224110,2227cyclictest1610032-21kworker/0:3+events23:53:490
15196769922344,2226cyclictest1608272-21kworker/2:1+events23:44:322
15196769922339,2221cyclictest1520887-21kworker/2:2+events19:17:392
151967699223310,2220cyclictest1562912-21kworker/2:0+events21:29:012
15196769922327,2223cyclictest1554883-21kworker/2:0+events21:00:092
151967699223210,2219cyclictest1613205-21kworker/2:0+events00:12:222
151967699223210,2218cyclictest1532350-21kworker/2:1+events19:47:112
15196769922318,2220cyclictest1592485-21kworker/2:2+events22:57:462
15196689922298,2217cyclictest1564719-21kworker/1:2+events21:47:481
151966899222111,2206cyclictest1553198-21kworker/1:2+events20:59:451
151966699222011,2207cyclictest1548708-21kworker/0:1+events21:10:060
151966699221811,2203cyclictest1520781-21kworker/0:1+events19:19:540
151967699221611,2203cyclictest1583949-21kworker/2:0+events22:33:082
151967699221011,2196cyclictest1620915-21kworker/2:2+events00:36:292
15196689922098,2198cyclictest1622404-21kworker/1:0+events00:34:181
151966899219911,2185cyclictest1525992-21kworker/1:0+events19:34:231
151966899219810,2183cyclictest1596999-21kworker/1:2+events23:25:231
151966899219510,2183cyclictest1525992-21kworker/1:0+events20:00:041
151966899218911,2175cyclictest1569558-21kworker/1:0+events21:53:321
151966899218910,2176cyclictest1516264-21kworker/1:0+events19:14:351
151966899217611,2161cyclictest1555129-21kworker/1:3+events21:02:041
15196689921727,2161cyclictest1564719-21kworker/1:2+events21:39:211
151966699215111,2137cyclictest1548708-21kworker/0:1+events20:51:510
151966699214111,2126cyclictest1592454-21kworker/0:2+events23:06:490
151966699214011,2126cyclictest1588884-21kworker/0:0+events22:56:590
15196769921313,2125cyclictest1530747-21kworker/2:2+events19:41:342
15196669921314,2124cyclictest1602065-21kworker/0:1+events23:30:030
151966699213110,2118cyclictest1535726-21kworker/0:2+events20:08:100
151966699213011,2116cyclictest1564774-21kworker/0:1+events21:32:260
151966699212810,2115cyclictest1534121-21kworker/0:1+events20:23:320
151966699212711,2113cyclictest1554733-21kworker/0:2+events21:00:310
151966699212611,2112cyclictest1566413-21kworker/0:2+events22:21:420
151966699212511,2111cyclictest1520781-21kworker/0:1+events19:14:140
151968199211311,2099cyclictest1585725-21kworker/3:0+events23:47:563
151968199208511,2070cyclictest1533859-21kworker/3:1+events20:41:423
151967699208510,2072cyclictest1519227-21kworker/2:0+events19:13:502
151968199198510,1972cyclictest1613212-21kworker/3:1+events00:38:003
15196819919709,1958cyclictest1609809-21kworker/3:2+events23:52:433
15196819919648,1953cyclictest1516278-21kworker/3:1+events19:12:193
151968199195410,1942cyclictest1613212-21kworker/3:1+events00:06:423
15196819919499,1937cyclictest1524599-21kworker/3:0+events19:50:383
151968199194510,1932cyclictest1555161-21kworker/3:2+events21:16:353
15191862145108,31sleep00-21swapper/019:06:260
15194562143113,25sleep20-21swapper/219:09:542
15181342142112,24sleep30-21swapper/319:05:063
1519098214097,40sleep10-21swapper/119:05:191
1519681993325,5cyclictest0-21swapper/319:40:003
151968199291,24cyclictest1564865-21basename21:30:003
151968199261,23cyclictest0-21swapper/323:20:003
151968199243,11cyclictest1601309-21ntpq23:20:163
1519681992422,2cyclictest26450irq/143-i91522:05:013
1519681992412,10cyclictest0-21swapper/323:15:003
151968199231,19cyclictest1613154-21idleruntime-cro23:59:593
151968199230,17cyclictest0-21swapper/322:15:133
151968199221,17cyclictest1558520-21munin-run21:10:003
151968199221,17cyclictest1556692-21idleruntime-cro21:05:013
151968199220,20cyclictest1540566-21cron20:14:593
151968199218,11cyclictest1589924-21ld22:45:193
151968199217,11cyclictest1602563-21/usr/sbin/munin23:25:133
151968199211,18cyclictest1595342-21cat23:00:213
151968199211,17cyclictest1547185-21idleruntime-cro20:35:003
151968199211,17cyclictest1535822-21systemctl20:00:013
151968199210,20cyclictest1566349-21taskset21:34:083
151968199210,20cyclictest0-21swapper/300:30:003
151968199209,5cyclictest1542953-10ld20:20:193
1519681992017,2cyclictest593-21dbus-daemon19:50:003
1519681992016,3cyclictest689-21gmain22:05:013
151968199201,16cyclictest1619563-21basename00:19:593
151968199201,15cyclictest1597343-21munin-run23:10:013
151968199201,15cyclictest1574366-21grep22:00:013
151968199200,9cyclictest1605719-21diskstats23:35:133
151968199200,15cyclictest0-21swapper/322:39:083
151968199195,4cyclictest0-21swapper/322:20:163
1519681991912,6cyclictest0-21swapper/320:35:163
151968199191,16cyclictest1527907-21perf19:35:013
151968199191,15cyclictest1545588-21sh20:29:593
151968199191,15cyclictest1542174-21idleruntime-cro20:20:003
151968199191,15cyclictest1526322-21idleruntime-cro19:30:003
151968199190,17cyclictest1608440-21basename23:45:013
151968199186,9cyclictest1588018-21df22:40:143
151968199186,9cyclictest1588018-21df22:40:143
151968199186,10cyclictest1536586-21ld20:00:153
151968199181,15cyclictest1579373-21perf22:14:593
151968199181,14cyclictest1624304-21perf00:35:003
151968199181,14cyclictest1563279-21munin-run21:25:013
151968199181,14cyclictest1539009-21basename20:09:593
151968199181,13cyclictest1585700-21munin-run22:34:593
151968199180,16cyclictest1591236-21chrt22:50:143
151968199180,15cyclictest1555091-21systemctl21:00:013
151968199174,11cyclictest1604422-21ntpq23:30:153
151968199171,14cyclictest865-10wireplumber23:00:003
151968199171,13cyclictest1560101-21perf21:15:003
1519681991710,5cyclictest1551941-21awk20:49:593
151968199169,5cyclictest1584099-21cat22:29:553
151968199166,6cyclictest1570402-21collect221:45:183
151968199164,10cyclictest1522382-21ntpq19:15:183
151968199161,13cyclictest1568267-21/usr/sbin/munin21:40:143
1519681991610,5cyclictest1530779-21sshd19:41:243
151968199154,9cyclictest1552225-21grep20:50:133
151968199150,13cyclictest1571941-21ntp_kernel_err21:50:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional