You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 01:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Sat May 30, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
162198099503122,5004cyclictest1709898-21kworker/1:0+events23:46:011
162197599324315,3222cyclictest1687336-21kworker/0:2+events22:35:010
162197599315015,3130cyclictest1636522-21kworker/0:0+events20:10:000
162198099310212,3086cyclictest1621609-21kworker/1:2+events19:30:171
162197599310215,3083cyclictest1662021-21kworker/0:0+events21:30:100
162198599303713,3019cyclictest1663654-21kworker/3:2+events21:25:173
162197599297113,2953cyclictest1710075-21kworker/0:0+events23:45:130
162198099291314,2894cyclictest1695264-21kworker/1:0+events23:20:001
162198599289010,2876cyclictest1629878-21kworker/3:2+events19:35:183
162198599286514,2847cyclictest1713489-21kworker/3:0+events23:55:123
162198099285812,2843cyclictest1691100-21kworker/1:1+events22:55:151
162197599282213,2805cyclictest1669988-21kworker/0:2+events21:37:220
162197599278413,2766cyclictest1678125-21kworker/0:1+events22:10:000
162197599277513,2760cyclictest1647331-21kworker/0:1+events20:30:080
162197599277313,2758cyclictest1662021-21kworker/0:0+events21:15:010
162198599276912,2753cyclictest1685880-21kworker/3:2+events22:36:343
162197599276712,2751cyclictest1689090-21kworker/0:1+events22:47:530
162197599276712,2751cyclictest1660386-21kworker/0:1+events21:08:540
162197599276513,2748cyclictest1697217-21kworker/0:1+events23:20:240
162197599275913,2741cyclictest1721189-21kworker/0:3+events00:21:400
162197599275613,2739cyclictest1722881-21kworker/0:1+events00:27:010
162197599274913,2732cyclictest1640934-21kworker/0:1+events20:20:170
162198099274613,2731cyclictest1633055-21kworker/1:2+events20:05:291
162197599274011,2726cyclictest1690714-21kworker/0:2+events22:44:050
162197599273013,2715cyclictest1673271-21kworker/0:2+events21:50:130
162197599273012,2714cyclictest1667110-21kworker/0:1+events21:49:270
162197599272613,2709cyclictest1640934-21kworker/0:1+events20:17:130
162198099272513,2708cyclictest1685942-21kworker/1:2+events22:29:391
162198099272513,2708cyclictest1685942-21kworker/1:2+events22:29:391
162198099272412,2708cyclictest1644346-21kworker/1:1+events20:39:211
162197599272413,2707cyclictest1676513-21kworker/0:2+events22:11:320
162197599272213,2705cyclictest1636522-21kworker/0:0+events19:58:380
162198599272013,2703cyclictest1668356-21kworker/3:0+events21:33:353
162198099272012,2704cyclictest1655357-21kworker/1:2+events21:11:571
162197599272013,2703cyclictest1639333-21kworker/0:2+events20:01:180
162197599271813,2703cyclictest1693987-21kworker/0:0+events23:10:070
162197599271613,2699cyclictest1633291-21kworker/0:1+events19:46:230
162198099271512,2699cyclictest1668447-21kworker/1:1+events21:42:411
162197599271413,2697cyclictest1674925-21kworker/0:0+events22:03:330
162197599271313,2696cyclictest1718019-21kworker/0:0+events00:08:140
162197599271313,2696cyclictest1663622-21kworker/0:2+events21:27:100
162197599271113,2694cyclictest1647331-21kworker/0:1+events20:27:300
162197599271013,2693cyclictest1706741-21kworker/0:2+events23:35:210
162198099270912,2693cyclictest1626993-21kworker/1:1+events19:49:511
162197599270913,2694cyclictest1667110-21kworker/0:1+events21:40:040
162197599270813,2691cyclictest1663622-21kworker/0:2+events21:20:410
16219809927047,2693cyclictest1626993-21kworker/1:1+events19:25:171
162198599270312,2687cyclictest1625720-21kworker/3:1+events19:43:453
162198599270210,2688cyclictest1653911-21kworker/3:0+events21:05:023
162198099269913,2682cyclictest1626993-21kworker/1:1+events19:40:191
162198099269812,2684cyclictest1655357-21kworker/1:2+events21:00:081
16219759926987,2687cyclictest1633291-21kworker/0:1+events19:50:140
162198599269413,2677cyclictest1644227-21kworker/3:0+events20:25:143
162197599268513,2668cyclictest1682989-21kworker/0:0+events22:38:010
162198599268210,2668cyclictest1618254-21kworker/3:2+events19:20:193
162198599268013,2664cyclictest1647537-21kworker/3:2+events20:47:223
162198099267813,2661cyclictest1644346-21kworker/1:1+events20:21:251
162198099267711,2662cyclictest1652103-21kworker/1:0+events20:56:171
162198099267613,2659cyclictest1636433-21kworker/1:0+events19:55:331
162198099267513,2658cyclictest1687639-21kworker/1:0+events22:42:141
162198599267413,2657cyclictest1663654-21kworker/3:2+events21:39:413
162198099267313,2656cyclictest1682635-21kworker/1:2+events22:18:241
162198099267313,2656cyclictest1668447-21kworker/1:1+events21:52:081
162198099266813,2651cyclictest1644346-21kworker/1:1+events20:28:171
162198599266713,2649cyclictest1642592-21kworker/3:2+events20:12:393
162198099266513,2649cyclictest1695264-21kworker/1:0+events23:12:451
162198099266413,2647cyclictest1687639-21kworker/1:0+events22:45:121
162198099266213,2645cyclictest1631454-21kworker/1:0+events19:39:331
162198099266211,2647cyclictest1648902-21kworker/1:2+events20:32:241
162198099266013,2643cyclictest1713402-21kworker/1:1+events23:58:141
162198099265812,2643cyclictest1668447-21kworker/1:1+events21:35:491
162198599265213,2635cyclictest1636387-21kworker/3:1+events19:56:193
162198599265111,2636cyclictest1661990-21kworker/3:1+events21:16:563
16219809926482,2642cyclictest1724095-21kworker/1:0+events00:25:511
162198599264512,2629cyclictest1655500-21kworker/3:2+events20:57:513
162198299264112,2625cyclictest1630275-21kworker/2:0+events19:39:092
162198599264013,2624cyclictest1701822-21kworker/3:1+events23:19:383
162198299264013,2623cyclictest1668329-21kworker/2:0+events21:32:272
162198599263913,2622cyclictest1638097-21kworker/3:2+events20:00:563
162197599263811,2624cyclictest1640934-21kworker/0:1+events20:10:460
162198599263713,2620cyclictest1652282-21kworker/3:1+events20:53:413
162198599263612,2620cyclictest1647537-21kworker/3:2+events20:30:303
162198599263513,2618cyclictest1685880-21kworker/3:2+events22:33:273
162198599263412,2619cyclictest1693685-21kworker/3:2+events23:05:333
162198599263113,2614cyclictest1625720-21kworker/3:1+events19:31:043
162198599263012,2616cyclictest1708265-21kworker/3:2+events00:00:113
162198099262911,2614cyclictest1642534-21kworker/1:0+events20:15:191
162198599262613,2610cyclictest1693685-21kworker/3:2+events22:51:443
162198599262610,2612cyclictest1663654-21kworker/3:2+events21:47:113
162198599261613,2600cyclictest1673208-21kworker/3:1+events21:52:293
162198599260912,2593cyclictest1668356-21kworker/3:0+events21:44:333
162198599260312,2587cyclictest1726203-21kworker/3:1+events00:31:383
162198599258112,2565cyclictest1685880-21kworker/3:2+events22:28:523
162198599258112,2565cyclictest1685880-21kworker/3:2+events22:28:523
162198299257312,2557cyclictest1647239-21kworker/2:1+events20:35:292
162198099257213,2556cyclictest1668447-21kworker/1:1+events21:48:191
162198099257013,2553cyclictest1621609-21kworker/1:2+events19:24:321
162198099256913,2552cyclictest1698673-21kworker/1:2+events23:09:431
162198099256812,2552cyclictest1653766-21kworker/1:1+events20:52:141
162198599256412,2548cyclictest1645878-21kworker/3:1+events20:24:263
162197599255613,2539cyclictest1703240-21kworker/0:0+events23:32:370
162198599253812,2522cyclictest1698582-21kworker/3:0+events23:11:373
162198599253712,2521cyclictest1696979-21kworker/3:1+events23:03:163
162198599253612,2520cyclictest1679727-21kworker/3:2+events22:15:193
162198099253612,2521cyclictest1687639-21kworker/1:0+events22:50:121
16219809925338,2521cyclictest1648902-21kworker/1:2+events20:43:091
162198299253012,2515cyclictest1719843-21kworker/2:1+events00:27:232
162197599253013,2513cyclictest1620473-21kworker/0:0+events19:33:460
162197599252611,2512cyclictest1626843-21kworker/0:2+events19:26:040
162197599252412,2510cyclictest1660386-21kworker/0:1+events21:10:030
162198099252212,2506cyclictest1652103-21kworker/1:0+events20:48:071
162198299251912,2503cyclictest1641227-21kworker/2:0+events20:16:522
162198299251811,2503cyclictest1626933-21kworker/2:2+events20:09:362
162197599251412,2498cyclictest1708451-21kworker/0:1+events23:44:270
162197599251112,2497cyclictest1649113-21kworker/0:2+events20:36:150
162197599251112,2495cyclictest1693987-21kworker/0:0+events23:06:400
162197599250411,2489cyclictest1690714-21kworker/0:2+events23:03:380
162197599250112,2485cyclictest1625138-21kworker/0:1+events19:20:430
16219809924999,2487cyclictest1623289-21kworker/1:0+events19:18:471
162197599249512,2480cyclictest1656806-21kworker/0:1+events20:59:230
16219759924939,2480cyclictest1620473-21kworker/0:0+events19:38:220
162198299249112,2475cyclictest1654004-21kworker/2:1+events21:11:332
162198099249112,2475cyclictest1724095-21kworker/1:0+events00:37:501
16219759924898,2477cyclictest1690714-21kworker/0:2+events22:59:470
162197599248812,2472cyclictest1649113-21kworker/0:2+events20:40:060
162197599248811,2475cyclictest1724754-21kworker/0:0+events00:30:060
162197599248810,2474cyclictest1697217-21kworker/0:1+events23:15:300
162197599248612,2470cyclictest1682989-21kworker/0:0+events22:27:460
162197599248612,2470cyclictest1682989-21kworker/0:0+events22:27:450
162197599248610,2472cyclictest1674925-21kworker/0:0+events21:57:250
162197599248512,2471cyclictest1676513-21kworker/0:2+events22:16:060
162197599248512,2470cyclictest1620473-21kworker/0:0+events19:16:050
162197599248412,2468cyclictest1631635-21kworker/0:2+events19:44:090
162197599248410,2470cyclictest1718019-21kworker/0:0+events00:11:370
162197599248410,2470cyclictest1718019-21kworker/0:0+events00:11:360
162197599248310,2469cyclictest1678125-21kworker/0:1+events22:23:110
162197599248212,2467cyclictest1650748-21kworker/0:0+events20:46:340
162197599248212,2466cyclictest1724754-21kworker/0:0+events00:39:450
162197599248112,2465cyclictest1650748-21kworker/0:0+events20:52:570
162197599248111,2466cyclictest1711687-21kworker/0:2+events00:00:330
162197599248012,2464cyclictest1708451-21kworker/0:1+events23:52:540
162198099247411,2460cyclictest1678156-21kworker/1:0+events22:21:441
162198099247211,2458cyclictest1642534-21kworker/1:0+events20:13:031
162198099247010,2456cyclictest1724095-21kworker/1:0+events00:31:151
162197599247012,2454cyclictest1705108-21kworker/0:1+events23:27:400
162198099246712,2451cyclictest1719934-21kworker/1:2+events00:22:031
162198599246513,2448cyclictest1708265-21kworker/3:2+events23:54:243
16219809924598,2448cyclictest1693655-21kworker/1:2+events23:00:571
16219859924539,2441cyclictest1673208-21kworker/3:1+events22:01:173
162198099245212,2436cyclictest1701913-21kworker/1:2+events23:36:301
16219809924516,2441cyclictest1679842-21kworker/1:1+events22:14:321
162198099245011,2435cyclictest1701913-21kworker/1:2+events23:34:561
162198599244712,2431cyclictest1653911-21kworker/3:0+events21:24:073
16219809924477,2436cyclictest1660477-21kworker/1:0+events21:19:101
162198099244612,2431cyclictest1719934-21kworker/1:2+events00:16:381
162198099244512,2429cyclictest1666847-21kworker/1:0+events21:29:481
162198099244211,2427cyclictest1684258-21kworker/1:1+events22:31:111
16219829924417,2431cyclictest1697128-21kworker/2:2+events23:16:372
162198099244012,2424cyclictest1687639-21kworker/1:0+events22:38:241
162198099243811,2423cyclictest1701913-21kworker/1:2+events23:26:301
16219759924387,2428cyclictest1721189-21kworker/0:3+events00:15:530
16219809924367,2425cyclictest1633055-21kworker/1:2+events19:54:461
162198099243512,2419cyclictest1668447-21kworker/1:1+events21:33:131
16219809924347,2423cyclictest1658605-21kworker/1:1+events21:06:091
162198099243412,2418cyclictest1674894-21kworker/1:2+events22:08:281
162198099243412,2418cyclictest1668447-21kworker/1:1+events21:56:381
162198099243411,2420cyclictest1708231-21kworker/1:1+events23:43:411
162198099243312,2417cyclictest1664208-21kworker/1:2+events21:21:041
162198099243112,2416cyclictest1695264-21kworker/1:0+events23:24:351
162198099243112,2415cyclictest1711537-21kworker/1:2+events23:53:171
162198099243111,2416cyclictest1636433-21kworker/1:0+events20:03:101
16219859924219,2408cyclictest1693685-21kworker/3:2+events22:59:023
162198299242111,2406cyclictest1654004-21kworker/2:1+events20:55:552
16219859924209,2407cyclictest1625720-21kworker/3:1+events19:46:003
162198599241812,2402cyclictest1636387-21kworker/3:1+events20:16:053
162197599241312,2398cyclictest1689090-21kworker/0:1+events22:53:180
162198599241212,2396cyclictest1647537-21kworker/3:2+events20:41:363
162198599241211,2398cyclictest1661990-21kworker/3:1+events21:14:383
162198599241211,2397cyclictest1658431-21kworker/3:1+events21:04:393
162198599241112,2395cyclictest1721367-21kworker/3:0+events00:29:413
162198299241112,2396cyclictest1686901-21kworker/2:2+events22:33:502
162198599241012,2395cyclictest1631484-21kworker/3:0+events19:53:183
162198599241012,2394cyclictest1679727-21kworker/3:2+events22:12:163
162198299240911,2394cyclictest1686901-21kworker/2:2+events22:47:062
162198299240812,2393cyclictest1654004-21kworker/2:1+events21:50:372
162197599240812,2392cyclictest1656806-21kworker/0:1+events21:01:170
162198599240712,2391cyclictest1708265-21kworker/3:2+events23:44:503
162198599240612,2390cyclictest1684285-21kworker/3:1+events22:22:503
162198099240611,2391cyclictest1716697-21kworker/1:0+events00:05:551
16219829924059,2393cyclictest1705628-21kworker/2:0+events23:36:072
162198599240412,2389cyclictest1620182-21kworker/3:0+events19:19:343
162198599240110,2388cyclictest1640996-21kworker/3:0+events20:07:233
162198599240012,2384cyclictest1719719-21kworker/3:2+events00:14:193
162198599240012,2384cyclictest1719719-21kworker/3:2+events00:14:193
162198599240011,2385cyclictest1625720-21kworker/3:1+events19:27:353
162198299240012,2385cyclictest1626933-21kworker/2:2+events20:25:352
162198599239912,2384cyclictest1728336-21kworker/3:0+events00:38:133
16219859923986,2388cyclictest1706653-21kworker/3:1+events23:33:483
162197599239811,2383cyclictest1714824-21kworker/0:0+events23:58:590
162198099239311,2378cyclictest1713402-21kworker/1:1+events00:14:431
162198099239311,2378cyclictest1713402-21kworker/1:1+events00:14:431
162198599239212,2376cyclictest1721367-21kworker/3:0+events00:20:303
162198299238212,2366cyclictest1636315-21kworker/2:1+events19:55:552
162198099238212,2368cyclictest1674894-21kworker/1:2+events22:00:061
162198599237411,2360cyclictest1650659-21kworker/3:0+events20:39:453
162198099237411,2359cyclictest1711537-21kworker/1:2+events00:02:261
162198299236711,2354cyclictest1701645-21kworker/2:0+events23:20:462
162198299236612,2351cyclictest1719843-21kworker/2:1+events00:19:212
162198599236412,2350cyclictest1673208-21kworker/3:1+events21:55:083
162198299235711,2343cyclictest1686901-21kworker/2:2+events22:40:422
162198599235212,2336cyclictest1708265-21kworker/3:2+events23:39:503
162198099235212,2336cyclictest1621609-21kworker/1:2+events19:14:321
162198599235114,2335cyclictest1685880-21kworker/3:2+events22:42:593
162198599235012,2335cyclictest1618254-21kworker/3:2+events19:14:083
162198599234712,2332cyclictest1711567-21kworker/3:1+events23:49:063
162198599234612,2332cyclictest1701822-21kworker/3:1+events23:21:093
162198299234612,2331cyclictest1711927-21kworker/2:2+events23:59:242
162198299234410,2331cyclictest1708202-21kworker/2:2+events23:40:142
162198599234212,2326cyclictest1700214-21kworker/3:2+events23:26:073
162198299234112,2326cyclictest1723367-21kworker/2:0+events00:33:112
162198299234111,2326cyclictest1661813-21kworker/2:0+events21:16:122
162198599233912,2323cyclictest1715224-21kworker/3:1+events00:06:183
162198599233812,2323cyclictest1689151-21kworker/3:1+events22:45:593
162198599233810,2326cyclictest1715224-21kworker/3:1+events00:15:073
162198299233212,2317cyclictest1656744-21kworker/2:2+events21:00:532
162198299233212,2316cyclictest1695329-21kworker/2:0+events23:00:352
162198299233212,2316cyclictest1673416-21kworker/2:0+events22:15:432
162198299232810,2315cyclictest1616615-21kworker/2:1+events19:23:452
162198299232611,2312cyclictest1710045-21kworker/2:1+events23:47:352
162198299232510,2312cyclictest1626933-21kworker/2:2+events19:52:322
162198299232312,2307cyclictest1703419-21kworker/2:1+events23:30:202
16219859923219,2309cyclictest1673208-21kworker/3:1+events22:09:363
162198299232112,2306cyclictest1721490-21kworker/2:2+events00:23:112
162198299231610,2302cyclictest1641227-21kworker/2:0+events20:11:322
162198299231412,2298cyclictest1715066-21kworker/2:1+events00:02:052
162198299231111,2297cyclictest1673416-21kworker/2:0+events22:08:512
162198299221712,2201cyclictest1692198-21kworker/2:1+events22:56:482
162197599221111,2196cyclictest1620473-21kworker/0:0+events19:12:360
162198299211911,2104cyclictest1679667-21kworker/2:2+events22:12:592
162198299211811,2103cyclictest1705628-21kworker/2:0+events23:53:402
162198299211711,2103cyclictest1723367-21kworker/2:0+events00:39:232
162198299211711,2102cyclictest1711927-21kworker/2:2+events00:07:052
162198299211611,2102cyclictest1718150-21kworker/2:0+events00:13:332
162198299211611,2102cyclictest1718150-21kworker/2:0+events00:13:322
162198299210211,2088cyclictest1654004-21kworker/2:1+events21:49:502
16217102147112,26sleep30-21swapper/319:08:503
16215612145101,26sleep10-21swapper/119:06:561
16217432142107,30sleep00-21swapper/019:09:150
16216992139105,29sleep20-21swapper/219:08:412
162198299271,22cyclictest1649207-21idleruntime-cro20:35:002
162198299261,20cyclictest1659442-21hddtemp_smartct21:05:152
1621982992520,3cyclictest1655513-21idleruntime-cro20:55:002
162198299251,19cyclictest1638955-21chrt20:00:162
162198299250,22cyclictest1685191-21meminfo22:25:142
162198299250,22cyclictest1685191-21meminfo22:25:142
162198299241,19cyclictest1653953-21idleruntime-cro20:50:002
162198299240,16cyclictest0-21swapper/223:10:142
162198299232,8cyclictest740-21snmpd23:08:292
162198299231,19cyclictest1630202-21cron19:35:012
162198299230,21cyclictest0-21swapper/222:50:162
162198299221,18cyclictest1665554-21munin-run21:25:002
162198299221,18cyclictest1634150-21ntpq19:45:162
162198299219,9cyclictest1669458-21ldconfig21:35:182
162198299214,14cyclictest1677829-21sshd22:00:222
162198299211,18cyclictest0-21swapper/223:25:032
162198299211,17cyclictest1676645-21awk22:00:002
162198299211,17cyclictest1671889-21awk21:45:002
1621982992110,8cyclictest1644864-21ls20:20:142
162198299210,18cyclictest1625473-21run-parts19:20:002
162198299209,7cyclictest622-21gdbus22:40:012
162198299191,14cyclictest1684541-21munin-run22:25:002
162198299191,14cyclictest1627324-21taskset19:25:102
162198299190,18cyclictest0-21swapper/219:12:282
162198299181,14cyclictest1633404-21basename19:45:002
162198299170,9cyclictest1652018-21runrttasks20:40:452
162198299170,16cyclictest1666890-21taskset21:27:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional