You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 08:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Mon Jan 05, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
276875999575027,5719cyclictest2768501-21kworker/0:2+events19:11:160
276876999572218,5700cyclictest2759869-21kworker/3:1+events19:11:383
276876299307010,3055cyclictest2841023-21kworker/1:0+events23:10:001
276876999277313,2756cyclictest2840759-21kworker/3:1+events22:55:173
276876999276612,2750cyclictest2849482-21kworker/3:2+events23:30:113
276876299276313,2747cyclictest2805966-21kworker/1:1+events21:45:161
276875999254012,2524cyclictest2795916-21kworker/0:0+events20:35:200
276876299248810,2475cyclictest2812240-21kworker/1:0+events21:25:171
276876299246911,2455cyclictest2769796-21kworker/1:0+events19:12:241
276876999243712,2422cyclictest2846017-21kworker/3:0+events23:20:183
27687669924309,2418cyclictest2820161-21kworker/2:0+events21:50:172
276876699239012,2376cyclictest2836255-21kworker/2:1+events23:15:012
276875999238611,2372cyclictest2787892-21kworker/0:2+events20:09:350
276876699231512,2300cyclictest2812256-21kworker/2:2+events21:30:212
276876299230511,2291cyclictest2826683-21kworker/1:0+events22:14:451
276875999230111,2287cyclictest2799195-21kworker/0:1+events20:45:290
27687629922909,2277cyclictest2789556-21kworker/1:1+events20:17:111
276876299228310,2269cyclictest2810630-21kworker/1:2+events21:20:161
276875999227811,2264cyclictest2776882-21kworker/0:1+events19:52:480
27687599922747,2263cyclictest2816932-21kworker/0:0+events21:55:160
27687599922747,2263cyclictest2816932-21kworker/0:0+events21:55:160
276876999226611,2252cyclictest2853662-21kworker/3:1+events23:39:403
27687599922658,2254cyclictest2778543-21kworker/0:2+events19:56:380
276875999226211,2248cyclictest2826534-21kworker/0:1+events22:10:340
276875999225511,2242cyclictest2855350-21kworker/0:2+events23:40:280
276875999222811,2214cyclictest2865063-21kworker/0:2+events00:10:570
27687699922254,2218cyclictest2775579-21kworker/3:0+events19:32:403
276876299220411,2190cyclictest2873096-21kworker/1:0+events00:35:141
27687629922016,2192cyclictest2855533-21kworker/1:2+events23:51:551
276875999219910,2186cyclictest2778543-21kworker/0:2+events19:42:310
276875999219610,2183cyclictest2784578-21kworker/0:0+events20:13:460
276876999218511,2171cyclictest2789377-21kworker/3:2+events20:20:153
276875999218511,2171cyclictest2797572-21kworker/0:2+events20:41:440
27687669921695,2161cyclictest2800771-21kworker/2:2+events20:55:262
27687599921669,2153cyclictest2858671-21kworker/0:0+events00:04:080
27687669921619,2149cyclictest2846099-21kworker/2:0+events23:21:262
276876699215411,2140cyclictest2837878-21kworker/2:0+events22:46:572
276876699215410,2140cyclictest2865576-21kworker/2:0+events00:13:122
27687669921519,2139cyclictest2861815-21kworker/2:0+events00:00:402
27687699921509,2137cyclictest2859200-21kworker/3:2+events23:57:173
276876699214811,2134cyclictest2824667-21kworker/2:2+events22:02:062
27687629921469,2134cyclictest2865003-21kworker/1:0+events00:18:331
276876299214211,2128cyclictest2826683-21kworker/1:0+events22:37:471
27687629921389,2126cyclictest2805966-21kworker/1:1+events21:13:271
276876699213611,2122cyclictest2800771-21kworker/2:2+events20:53:292
27687629921329,2119cyclictest2805966-21kworker/1:1+events21:19:091
276876299213111,2116cyclictest2861849-21kworker/1:1+events00:10:131
276876299212211,2107cyclictest2826683-21kworker/1:0+events22:31:161
27687699921136,2104cyclictest2823221-21kworker/3:1+events22:22:493
276876299211310,2100cyclictest2841023-21kworker/1:0+events23:13:061
27687629921099,2097cyclictest2779981-21kworker/1:0+events19:45:571
276876299210910,2096cyclictest2771808-21kworker/1:1+events19:23:501
27687629921088,2097cyclictest2804296-21kworker/1:0+events20:59:401
27687629921035,2095cyclictest2850699-21kworker/1:0+events23:41:571
276875999210310,2090cyclictest2795916-21kworker/0:0+events20:51:340
27687629921019,2089cyclictest2832888-21kworker/1:1+events22:29:441
27687599921003,2094cyclictest2849134-21kworker/0:2+events23:26:030
27687629920997,2088cyclictest2771808-21kworker/1:1+events19:27:181
276876299209910,2085cyclictest2794113-21kworker/1:1+events20:31:561
27687599920999,2087cyclictest2784578-21kworker/0:0+events20:03:270
276876299209710,2084cyclictest2844147-21kworker/1:1+events23:27:141
27687599920979,2085cyclictest2824605-21kworker/0:2+events22:09:480
27687629920959,2083cyclictest2844147-21kworker/1:1+events23:23:461
276876299209510,2082cyclictest2784845-21kworker/1:1+events20:00:271
276875999209510,2082cyclictest2836040-21kworker/0:0+events23:02:270
276876699209410,2082cyclictest2778596-21kworker/2:1+events19:45:102
27687699920928,2080cyclictest2789377-21kworker/3:2+events20:14:103
27687629920928,2081cyclictest2805966-21kworker/1:1+events21:39:341
27687599920888,2078cyclictest2845870-21kworker/0:1+events23:10:240
276876299208410,2070cyclictest2781606-21kworker/1:2+events19:52:261
276876699208011,2066cyclictest2826594-21kworker/2:0+events22:20:562
276875999207810,2065cyclictest2871586-21kworker/0:1+events00:38:170
27687629920776,2068cyclictest2797634-21kworker/1:0+events20:43:381
27687599920778,2065cyclictest2800895-21kworker/0:2+events21:05:240
27687629920757,2065cyclictest2852327-21kworker/1:2+events23:30:331
27687599920759,2063cyclictest2855350-21kworker/0:2+events23:52:410
27687699920749,2062cyclictest2849482-21kworker/3:2+events23:26:503
27687629920749,2062cyclictest2848919-21kworker/1:2+events23:18:511
27687629920748,2063cyclictest2865003-21kworker/1:0+events00:09:041
27687599920749,2062cyclictest2795916-21kworker/0:0+events20:33:480
27687599920739,2061cyclictest2784578-21kworker/0:0+events20:22:070
276876999207210,2059cyclictest2805907-21kworker/3:1+events21:16:043
27687599920727,2063cyclictest2868298-21kworker/0:2+events00:20:040
27687599920724,2065cyclictest2800895-21kworker/0:2+events21:42:360
27687699920717,2061cyclictest2807598-21kworker/3:2+events21:14:333
27687599920719,2058cyclictest2829931-21kworker/0:1+events22:23:120
276876999206910,2056cyclictest2868548-21kworker/3:1+events00:24:163
276876999206910,2056cyclictest2857007-21kworker/3:0+events23:50:243
276876999206910,2056cyclictest2804221-21kworker/3:0+events21:01:113
27687599920695,2061cyclictest2852062-21kworker/0:0+events23:37:430
276875999206910,2056cyclictest2860333-21kworker/0:1+events23:56:520
276875999206910,2056cyclictest2818584-21kworker/0:1+events21:48:460
276875999206910,2056cyclictest2805730-21kworker/0:0+events21:04:370
27687699920685,2060cyclictest2866871-21kworker/3:0+events00:31:493
276876999206810,2055cyclictest2805907-21kworker/3:1+events21:08:053
27687599920678,2056cyclictest2800895-21kworker/0:2+events21:35:410
27687599920677,2057cyclictest2809380-21kworker/0:0+events21:29:580
27687599920674,2060cyclictest2829931-21kworker/0:1+events22:26:390
27687599920673,2061cyclictest2773583-21kworker/0:1+events19:27:420
276875999206710,2054cyclictest2855350-21kworker/0:2+events23:47:450
276875999206710,2054cyclictest2824605-21kworker/0:2+events22:01:450
27687699920669,2054cyclictest2837975-21kworker/3:0+events22:51:323
27687699920658,2054cyclictest2792659-21kworker/3:0+events20:26:393
27687699920656,2056cyclictest2794316-21kworker/3:1+events20:40:363
27687629920655,2057cyclictest2828348-21kworker/1:1+events22:19:241
27687599920659,2053cyclictest2776882-21kworker/0:1+events19:46:190
27687599920658,2054cyclictest2791161-21kworker/0:2+events20:27:250
276875999206510,2052cyclictest2869979-21kworker/0:0+events00:32:350
276875999206510,2052cyclictest2829931-21kworker/0:1+events22:43:310
276876999206411,2050cyclictest2836221-21kworker/3:2+events22:46:333
276876999206410,2051cyclictest2829592-21kworker/3:2+events22:18:153
27687599920649,2052cyclictest2784578-21kworker/0:0+events20:16:030
27687599920644,2056cyclictest2809380-21kworker/0:0+events21:23:240
27687699920637,2053cyclictest2797842-21kworker/3:2+events20:45:523
27687699920635,2055cyclictest2781635-21kworker/3:0+events20:01:353
27687699920629,2050cyclictest2874578-21kworker/3:2+events00:37:533
276876999206110,2048cyclictest2823221-21kworker/3:1+events22:09:253
27687629920619,2049cyclictest2779981-21kworker/1:0+events19:58:081
27687629920608,2049cyclictest2797634-21kworker/1:0+events20:46:371
276875999206010,2047cyclictest2866693-21kworker/0:1+events00:17:490
27687699920599,2047cyclictest2844237-21kworker/3:1+events23:11:343
276876999205910,2046cyclictest2844237-21kworker/3:1+events23:09:403
27687699920588,2047cyclictest2789377-21kworker/3:2+events20:17:563
276876299205710,2044cyclictest2871415-21kworker/1:2+events00:28:021
27687599920569,2044cyclictest2820195-21kworker/0:2+events21:50:410
27687699920558,2044cyclictest2797842-21kworker/3:2+events20:58:083
276876999205510,2041cyclictest2846017-21kworker/3:0+events23:17:413
276875999205110,2038cyclictest2809380-21kworker/0:0+events21:18:010
27687699920499,2036cyclictest2772141-21kworker/3:2+events19:21:533
27687699920497,2038cyclictest2778188-21kworker/3:1+events19:45:333
27687669920489,2036cyclictest2776676-21kworker/2:2+events19:33:032
27687629920489,2036cyclictest2769796-21kworker/1:0+events19:15:521
27687629920486,2039cyclictest2776617-21kworker/1:0+events19:33:471
276875999204810,2035cyclictest2836040-21kworker/0:0+events22:58:180
27687699920478,2036cyclictest2813593-21kworker/3:0+events21:38:243
27687629920468,2035cyclictest2802705-21kworker/1:2+events21:09:581
276876299204610,2033cyclictest2841023-21kworker/1:0+events22:55:401
27687629920449,2032cyclictest2837727-21kworker/1:1+events22:48:281
27687629920444,2037cyclictest2823161-21kworker/1:1+events22:02:301
27687599920449,2032cyclictest2771963-21kworker/0:0+events19:20:250
27687599920448,2033cyclictest2839425-21kworker/0:2+events22:50:460
27687629920438,2032cyclictest2844147-21kworker/1:1+events23:04:211
27687599920428,2031cyclictest2768501-21kworker/0:2+events19:33:240
276875999204210,2028cyclictest2800895-21kworker/0:2+events20:56:110
27687699920419,2029cyclictest2859200-21kworker/3:2+events00:16:393
27687629920419,2029cyclictest2821466-21kworker/1:2+events22:08:381
27687699920409,2028cyclictest2871324-21kworker/3:2+events00:26:343
27687629920389,2026cyclictest2804296-21kworker/1:0+events21:00:481
27687629920388,2027cyclictest2815417-21kworker/1:2+events21:43:201
27687699920377,2027cyclictest2813593-21kworker/3:0+events22:00:123
27687699920369,2024cyclictest2832977-21kworker/3:0+events22:37:233
276876299203610,2023cyclictest2861849-21kworker/1:1+events00:01:271
27687599920369,2024cyclictest2809380-21kworker/0:0+events21:32:170
276876999203510,2022cyclictest2859200-21kworker/3:2+events00:07:563
27687629920349,2022cyclictest2818680-21kworker/1:0+events21:54:521
27687629920349,2021cyclictest2786706-21kworker/1:0+events20:24:451
27687629920337,2023cyclictest2836102-21kworker/1:2+events22:41:161
27687599920339,2021cyclictest2844267-21kworker/0:2+events23:07:020
27687699920328,2021cyclictest2813593-21kworker/3:0+events21:31:303
27687599920329,2020cyclictest2828168-21kworker/0:0+events22:16:420
27687629920313,2025cyclictest2830020-21kworker/1:2+events22:24:441
27687699920307,2020cyclictest2794316-21kworker/3:1+events20:34:343
27687629920299,2017cyclictest2839333-21kworker/1:2+events22:54:561
27687629920289,2016cyclictest2868357-21kworker/1:1+events00:33:211
27687629920289,2016cyclictest2855533-21kworker/1:2+events23:59:551
27687699920277,2017cyclictest2823221-21kworker/3:1+events21:59:273
27687699920277,2017cyclictest2823221-21kworker/3:1+events21:59:273
276876699202710,2014cyclictest2800771-21kworker/2:2+events20:48:082
27687699920269,2014cyclictest2818556-21kworker/3:1+events21:48:223
27687629920259,2013cyclictest2781606-21kworker/1:2+events20:08:031
276875999202410,2011cyclictest2768501-21kworker/0:2+events19:19:390
27687669920236,2014cyclictest2836255-21kworker/2:1+events22:40:302
27687599920219,2008cyclictest2869979-21kworker/0:0+events00:29:100
276876999201710,2004cyclictest2759869-21kworker/3:1+events19:26:563
276875999201710,2004cyclictest2836040-21kworker/0:0+events23:17:190
276876699201610,2003cyclictest2797515-21kworker/2:2+events20:41:212
27687599920136,2004cyclictest2776882-21kworker/0:1+events19:39:050
27687629920128,2001cyclictest2794113-21kworker/1:1+events20:28:531
276876999201110,1998cyclictest2836221-21kworker/3:2+events22:40:543
27687669920119,1999cyclictest2812256-21kworker/2:2+events21:43:432
27687599920109,1998cyclictest2865063-21kworker/0:2+events00:07:330
27687669920087,1998cyclictest2871524-21kworker/2:1+events00:31:262
27687699920079,1995cyclictest2781635-21kworker/3:0+events19:54:413
27687699920063,2000cyclictest2855318-21kworker/3:2+events23:41:353
276876699200611,1992cyclictest2783007-21kworker/2:2+events19:53:332
27687699920053,1999cyclictest2794316-21kworker/3:1+events20:36:263
27687599920059,1993cyclictest2849134-21kworker/0:2+events23:30:570
27687699920049,1991cyclictest2821530-21kworker/3:2+events21:52:583
27687599920039,1990cyclictest2829931-21kworker/0:1+events22:38:570
27687599920037,1993cyclictest2829931-21kworker/0:1+events22:45:480
27687699920014,1994cyclictest2863287-21kworker/3:0+events00:04:313
27687599920019,1989cyclictest2829931-21kworker/0:1+events22:30:310
276875999200010,1987cyclictest2849134-21kworker/0:2+events23:20:400
27687699919999,1987cyclictest2859200-21kworker/3:2+events00:10:353
27687699919999,1987cyclictest2783242-21kworker/3:1+events19:59:183
276876999199910,1986cyclictest2853662-21kworker/3:1+events23:46:143
27687699919989,1986cyclictest2786172-21kworker/3:2+events20:06:083
27687699919989,1986cyclictest2770094-21kworker/3:0+events19:17:243
27687699919988,1987cyclictest2813593-21kworker/3:0+events21:40:213
27687699919979,1985cyclictest2813593-21kworker/3:0+events21:27:363
27687699919973,1991cyclictest2778188-21kworker/3:1+events19:37:353
27687699919969,1984cyclictest2829592-21kworker/3:2+events22:32:243
27687699919969,1984cyclictest2779842-21kworker/3:2+events19:44:473
27687699919958,1984cyclictest2823221-21kworker/3:1+events22:12:043
27687699919942,1989cyclictest2811997-21kworker/3:2+events21:24:553
27687699919918,1980cyclictest2842620-21kworker/3:2+events23:02:033
27687629919908,1979cyclictest2786706-21kworker/1:0+events20:14:331
27687669919889,1976cyclictest2789406-21kworker/2:0+events20:22:312
27687629919879,1975cyclictest2778305-21kworker/1:1+events19:43:391
276876999198610,1973cyclictest2802582-21kworker/3:1+events20:54:153
27687629919869,1974cyclictest2812240-21kworker/1:0+events21:33:471
276876999198210,1969cyclictest2829592-21kworker/3:2+events22:28:113
27687629919827,1972cyclictest2855533-21kworker/1:2+events23:48:091
27687629919809,1968cyclictest2794113-21kworker/1:1+events20:37:111
27687599919808,1969cyclictest2800895-21kworker/0:2+events21:11:080
276876699197310,1961cyclictest2783007-21kworker/2:2+events19:55:052
27687669919626,1953cyclictest2770032-21kworker/2:1+events19:28:052
276876699196210,1949cyclictest2848954-21kworker/2:2+events23:42:192
276876699196210,1949cyclictest2792871-21kworker/2:2+events20:29:162
27687669919609,1948cyclictest2812256-21kworker/2:2+events21:36:512
27687669919609,1948cyclictest2812256-21kworker/2:2+events21:26:042
27687669919609,1948cyclictest2795853-21kworker/2:1+events20:33:262
27687669919607,1950cyclictest2828258-21kworker/2:1+events22:17:062
27687669919607,1950cyclictest2776676-21kworker/2:2+events19:44:022
27687669919605,1952cyclictest2839774-21kworker/2:2+events22:53:482
276876699196010,1948cyclictest2828258-21kworker/2:1+events22:25:312
27687669919593,1953cyclictest2823011-21kworker/2:1+events21:56:482
27687669919593,1953cyclictest2823011-21kworker/2:1+events21:56:472
276876699195910,1946cyclictest2810511-21kworker/2:1+events21:24:312
27687669919587,1948cyclictest2804374-21kworker/2:0+events21:03:282
276876699195810,1945cyclictest2800771-21kworker/2:2+events21:12:172
27687669919578,1946cyclictest2772051-21kworker/2:2+events19:22:402
27687669919577,1947cyclictest2856917-21kworker/2:0+events23:52:202
276876699195510,1942cyclictest2842585-21kworker/2:0+events22:58:402
276876699195310,1940cyclictest2871524-21kworker/2:1+events00:29:552
27687669919507,1939cyclictest2853840-21kworker/2:1+events23:34:192
27687669919506,1940cyclictest2783007-21kworker/2:2+events20:14:572
27687669919502,1945cyclictest2863750-21kworker/2:2+events00:20:282
276876699195010,1936cyclictest2844387-21kworker/2:2+events23:08:342
27687669919499,1937cyclictest2787802-21kworker/2:1+events20:09:572
276876699194710,1934cyclictest2846099-21kworker/2:0+events23:13:512
27687669919417,1931cyclictest2800771-21kworker/2:2+events21:15:422
27687629919399,1927cyclictest2853940-21kworker/1:1+events23:38:531
27687669919378,1926cyclictest2852186-21kworker/2:0+events23:28:442
27687629919379,1924cyclictest2799253-21kworker/1:1+events20:53:521
27687669919369,1924cyclictest2868146-21kworker/2:1+events00:17:262
27687669919363,1929cyclictest2770032-21kworker/2:1+events19:18:552
27687669919359,1923cyclictest2856917-21kworker/2:0+events23:49:152
276876699193510,1922cyclictest2848954-21kworker/2:2+events23:57:392
27687669919326,1923cyclictest2800771-21kworker/2:2+events21:06:562
27687669919208,1908cyclictest2773702-21kworker/2:0+events19:37:122
27687669918968,1885cyclictest2826594-21kworker/2:0+events22:33:112
27687669918959,1883cyclictest2848954-21kworker/2:2+events23:35:472
27687669918959,1883cyclictest2824667-21kworker/2:2+events22:11:422
276876699188810,1875cyclictest2860126-21kworker/2:1+events00:05:162
276876699188510,1872cyclictest2834558-21kworker/2:2+events22:39:432
276876699188510,1872cyclictest2812256-21kworker/2:2+events21:49:312
27687629918838,1872cyclictest2823161-21kworker/1:1+events21:59:061
27687629918838,1872cyclictest2823161-21kworker/1:1+events21:59:061
27687669918826,1873cyclictest2871524-21kworker/2:1+events00:36:482
27687629918827,1872cyclictest2778305-21kworker/1:1+events19:38:441
27687669918818,1870cyclictest2836255-21kworker/2:1+events23:04:002
27687669918813,1875cyclictest2789406-21kworker/2:0+events20:18:412
276876299187810,1865cyclictest2865003-21kworker/1:0+events00:21:581
27687669918729,1860cyclictest2766749-21kworker/2:0+events19:13:322
27687669918678,1856cyclictest2824667-21kworker/2:2+events22:07:302
27687669918139,1803cyclictest2795853-21kworker/2:1+events20:36:502
27683502194160,30sleep00-21swapper/019:08:040
27669272147103,23sleep10-21swapper/119:05:011
27681912143112,26sleep20-21swapper/219:06:012
27682232139106,28sleep30-21swapper/319:06:273
276876699220,6cyclictest2785377-21hddtemp_smartct20:00:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional