You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 04:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Fri Nov 28, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
269991199288214,2865cyclictest2757672-21kworker/0:0+events22:12:550
269991999283813,2820cyclictest2728763-21kworker/3:0+events20:45:223
269991999281013,2794cyclictest2780365-21kworker/3:2+events00:00:213
269991799274513,2729cyclictest2770699-21kworker/2:1+events22:50:182
269991199273513,2719cyclictest2781927-21kworker/0:1+events23:30:200
269991999271913,2702cyclictest2756100-21kworker/3:0+events22:10:113
269991799270413,2687cyclictest2774194-21kworker/2:1+events23:00:122
269991999253512,2520cyclictest2765754-21kworker/3:1+events22:38:323
269991499249212,2478cyclictest2723789-21kworker/1:1+events20:25:211
269991799248812,2472cyclictest2720047-21kworker/2:2+events20:21:552
269991499248311,2470cyclictest2715925-21kworker/1:1+events20:00:061
269991499248012,2464cyclictest2746610-21kworker/1:1+events21:41:571
269991499247912,2464cyclictest2699364-21kworker/1:0+events19:37:511
269991499247412,2459cyclictest2733263-21kworker/1:1+events20:59:531
269991999246212,2446cyclictest2699333-21kworker/3:2+events19:30:133
269991999244411,2430cyclictest2701108-21kworker/3:0+events19:55:553
269991999243812,2423cyclictest2772590-21kworker/3:0+events22:56:233
269991999240612,2390cyclictest2765754-21kworker/3:1+events22:34:203
269991799240212,2386cyclictest2800057-21kworker/2:0+events00:27:512
269991199240210,2389cyclictest2751542-21kworker/0:1+events21:55:180
26999199923939,2381cyclictest2744773-21kworker/3:0+events21:42:183
269991799237712,2362cyclictest2762842-21kworker/2:0+events22:29:212
269991199237512,2359cyclictest2788121-21kworker/0:2+events00:15:200
269991199235211,2338cyclictest2757672-21kworker/0:0+events22:16:390
269991799235112,2335cyclictest2804025-21kworker/2:2+events00:30:562
269991199235012,2335cyclictest2788121-21kworker/0:2+events23:52:430
26999119923499,2338cyclictest2730325-21kworker/0:0+events21:05:040
269991199234912,2334cyclictest2730325-21kworker/0:0+events20:48:510
269991499231011,2296cyclictest2711457-21kworker/1:0+events19:50:161
269991499230711,2292cyclictest2699364-21kworker/1:0+events19:27:061
269991999230511,2291cyclictest2800353-21kworker/3:1+events00:25:553
269991999229210,2280cyclictest2701108-21kworker/3:0+events19:40:053
26999199922827,2272cyclictest2733472-21kworker/3:2+events21:02:063
26999149922800,2277cyclictest2770463-21kworker/1:1+events22:49:091
269991499227711,2262cyclictest2788162-21kworker/1:1+events23:49:161
269991499227411,2260cyclictest2740113-21kworker/1:0+events21:18:261
269991499227311,2259cyclictest2786556-21kworker/1:0+events23:42:281
269991499227210,2259cyclictest2719310-21kworker/1:2+events20:36:401
269991499227210,2259cyclictest2719310-21kworker/1:2+events20:20:471
269991499227111,2257cyclictest2706400-21kworker/1:1+events19:49:311
269991499227010,2256cyclictest2795387-21kworker/1:1+events00:08:471
269991499226911,2254cyclictest2756254-21kworker/1:2+events22:06:461
269991499226910,2256cyclictest2770463-21kworker/1:1+events23:02:061
269991499226811,2254cyclictest2746610-21kworker/1:1+events21:38:281
269991499226611,2251cyclictest2715925-21kworker/1:1+events19:57:251
269991199225511,2241cyclictest2730325-21kworker/0:0+events20:55:430
269991499225210,2239cyclictest2806618-21kworker/1:0+events00:36:561
26999149922519,2239cyclictest2798329-21kworker/1:0+events00:17:591
269991199225010,2237cyclictest2719157-21kworker/0:0+events20:13:080
269991999224712,2233cyclictest2780365-21kworker/3:2+events23:56:583
269991499224510,2232cyclictest2746610-21kworker/1:1+events21:45:471
26999149922449,2232cyclictest2757859-21kworker/1:0+events22:12:311
269991499224411,2230cyclictest2709845-21kworker/1:2+events19:42:181
26999149922439,2231cyclictest2777306-21kworker/1:1+events23:18:581
269991999224210,2229cyclictest2714596-21kworker/3:2+events20:02:463
269991999224112,2226cyclictest2756100-21kworker/3:0+events22:03:433
26999199922389,2226cyclictest2733472-21kworker/3:2+events20:57:343
269991999223811,2225cyclictest2780365-21kworker/3:2+events23:20:063
26999199922378,2226cyclictest2780365-21kworker/3:2+events23:29:133
269991999223610,2223cyclictest2775792-21kworker/3:2+events23:09:243
269991999223410,2221cyclictest2738620-21kworker/3:0+events21:11:343
26999199922335,2225cyclictest2725570-21kworker/3:1+events20:29:103
269991999223310,2220cyclictest2778700-21kworker/3:1+events23:15:313
269991999223310,2220cyclictest2723966-21kworker/3:0+events20:32:513
269991499223310,2220cyclictest2741719-21kworker/1:2+events21:33:541
269991999223110,2218cyclictest2769069-21kworker/3:0+events22:43:553
269991499222510,2211cyclictest2784952-21kworker/1:1+events23:35:181
269991999222411,2210cyclictest2772590-21kworker/3:0+events23:11:453
269991999222311,2209cyclictest2796779-21kworker/3:2+events00:17:143
269991999222310,2210cyclictest2796779-21kworker/3:2+events00:11:303
269991499222210,2209cyclictest2719310-21kworker/1:2+events20:52:151
269991999222010,2207cyclictest2782018-21kworker/3:0+events23:41:223
26999199922189,2206cyclictest2737012-21kworker/3:1+events21:05:283
269991999221410,2202cyclictest2744773-21kworker/3:0+events21:35:033
26999199922119,2198cyclictest2805051-21kworker/3:2+events00:35:263
269991799220811,2194cyclictest2772559-21kworker/2:2+events23:15:542
269991799220611,2192cyclictest2711426-21kworker/2:0+events19:52:082
269991999220510,2192cyclictest2701108-21kworker/3:0+events19:49:063
269991199220210,2189cyclictest2798147-21kworker/0:1+events00:24:010
26999199921998,2188cyclictest2782018-21kworker/3:0+events23:39:073
26999199921928,2181cyclictest2712970-21kworker/3:1+events19:50:393
26999199921888,2177cyclictest2699333-21kworker/3:2+events19:16:173
269991499218511,2171cyclictest2729554-21kworker/1:0+events20:40:501
269991799218011,2166cyclictest2795028-21kworker/2:0+events00:03:492
26999119921749,2162cyclictest2706155-21kworker/0:0+events19:27:520
26999179921739,2161cyclictest2716138-21kworker/2:2+events20:03:562
269991799216810,2154cyclictest2761180-21kworker/2:1+events22:24:252
269991799216510,2151cyclictest2725505-21kworker/2:0+events20:28:462
269991799216311,2149cyclictest2747094-21kworker/2:1+events21:40:242
269991799216310,2150cyclictest2706245-21kworker/2:2+events19:33:152
269991199216311,2149cyclictest2736752-21kworker/0:2+events21:22:190
269991799216211,2148cyclictest2751330-21kworker/2:2+events22:04:052
269991199216211,2148cyclictest2761150-21kworker/0:2+events22:35:300
26999179921618,2150cyclictest2720047-21kworker/2:2+events20:11:112
26999179921616,2152cyclictest2706245-21kworker/2:2+events19:38:592
269991199216110,2147cyclictest2711396-21kworker/0:1+events19:46:070
269991799215910,2146cyclictest2804025-21kworker/2:2+events00:38:272
269991199215911,2145cyclictest2727014-21kworker/0:2+events20:37:480
269991199215811,2144cyclictest2781927-21kworker/0:1+events23:29:370
269991199215810,2144cyclictest2803657-21kworker/0:0+events00:33:100
269991499215710,2144cyclictest2706400-21kworker/1:1+events19:30:581
269991199215711,2141cyclictest2773982-21kworker/0:2+events22:59:030
269991199215710,2144cyclictest2751542-21kworker/0:1+events21:52:390
269991199215610,2143cyclictest2720794-21kworker/0:1+events20:25:460
269991799215411,2140cyclictest2720047-21kworker/2:2+events20:19:152
269991199215411,2140cyclictest2720794-21kworker/0:1+events20:19:380
269991199215311,2139cyclictest2788121-21kworker/0:2+events23:45:530
269991199215311,2139cyclictest2697822-21kworker/0:1+events19:15:530
269991199215110,2138cyclictest2717493-21kworker/0:1+events20:05:510
26999199921508,2140cyclictest2714596-21kworker/3:2+events20:05:043
269991999214910,2136cyclictest2770668-21kworker/3:1+events23:04:023
269991499214510,2132cyclictest2754630-21kworker/1:0+events22:03:191
26999179921439,2131cyclictest2735217-21kworker/2:2+events21:10:292
26999199921399,2127cyclictest2744773-21kworker/3:0+events21:33:093
26999179921379,2125cyclictest2743074-21kworker/2:2+events21:26:572
26999199921349,2122cyclictest2770668-21kworker/3:1+events22:50:383
269991499212711,2113cyclictest2777306-21kworker/1:1+events23:12:081
269991999212511,2111cyclictest2744773-21kworker/3:0+events21:46:083
269991499212410,2111cyclictest2729554-21kworker/1:0+events20:46:541
26999199921238,2112cyclictest2793471-21kworker/3:0+events00:06:283
269991199212111,2107cyclictest2736752-21kworker/0:2+events21:32:440
26999199921199,2106cyclictest2699333-21kworker/3:2+events19:22:523
269991499211910,2105cyclictest2795387-21kworker/1:1+events00:22:541
26999119921198,2108cyclictest2715838-21kworker/0:2+events19:56:180
269991499211810,2105cyclictest2781466-21kworker/1:2+events23:24:161
26999149921179,2104cyclictest2741719-21kworker/1:2+events21:28:071
269991499211610,2102cyclictest2711457-21kworker/1:0+events20:06:371
269991499211510,2102cyclictest2784952-21kworker/1:1+events23:33:461
26999149921129,2100cyclictest2789805-21kworker/1:2+events23:51:111
269991499211210,2099cyclictest2791820-21kworker/1:0+events23:55:261
26999119921127,2102cyclictest2788121-21kworker/0:2+events00:01:300
26999149921119,2099cyclictest2759461-21kworker/1:2+events22:20:541
269991499211110,2098cyclictest2703066-21kworker/1:1+events19:19:221
26999149921109,2097cyclictest2801943-21kworker/1:0+events00:29:221
26999149921099,2096cyclictest2778911-21kworker/1:0+events23:25:251
26999149921098,2098cyclictest2701048-21kworker/1:2+events19:14:431
26999149921089,2095cyclictest2759461-21kworker/1:2+events22:15:101
26999149921087,2098cyclictest2746610-21kworker/1:1+events21:55:411
269991499210810,2095cyclictest2765904-21kworker/1:0+events22:33:581
269991799210510,2091cyclictest2728853-21kworker/2:0+events20:41:122
26999149921059,2093cyclictest2699364-21kworker/1:0+events19:23:151
269991799210410,2090cyclictest2751330-21kworker/2:2+events21:59:532
26999149921025,2094cyclictest2736779-21kworker/1:2+events21:02:291
269991499210210,2089cyclictest2791820-21kworker/1:0+events00:04:341
269991499210110,2088cyclictest2719310-21kworker/1:2+events20:16:331
26999149920997,2090cyclictest2764232-21kworker/1:1+events22:35:071
269991499209910,2086cyclictest2774011-21kworker/1:2+events23:05:551
26999149920989,2086cyclictest2738404-21kworker/1:1+events21:08:081
26999199920958,2083cyclictest2727164-21kworker/3:2+events20:38:093
26999149920958,2084cyclictest2715925-21kworker/1:1+events20:12:451
269991999209411,2080cyclictest2789867-21kworker/3:1+events23:51:573
269991999209410,2080cyclictest2789867-21kworker/3:1+events23:48:333
269991199209410,2081cyclictest2778611-21kworker/0:2+events23:22:210
269991999208810,2075cyclictest2701108-21kworker/3:0+events19:35:583
26999199920864,2079cyclictest2743136-21kworker/3:1+events21:27:433
269991999208510,2072cyclictest2743136-21kworker/3:1+events21:22:403
26999199920837,2073cyclictest2725570-21kworker/3:1+events20:41:353
269991999208310,2070cyclictest2761241-21kworker/3:1+events22:23:383
269991999208210,2069cyclictest2744773-21kworker/3:0+events21:54:103
26999179920809,2067cyclictest2728853-21kworker/2:0+events20:51:082
26999199920798,2068cyclictest2752816-21kworker/3:1+events21:56:493
269991999207910,2066cyclictest2782018-21kworker/3:0+events23:33:223
26999199920787,2068cyclictest2738620-21kworker/3:0+events21:18:503
26999199920785,2070cyclictest2757737-21kworker/3:1+events22:09:273
26999199920769,2064cyclictest2701108-21kworker/3:0+events20:12:213
269991999207610,2063cyclictest2803446-21kworker/3:0+events00:34:393
269991999207610,2063cyclictest2796779-21kworker/3:2+events00:21:053
269991999207610,2063cyclictest2756100-21kworker/3:0+events22:17:493
26999149920745,2065cyclictest2765904-21kworker/1:0+events22:42:451
269991499207410,2061cyclictest2795387-21kworker/1:1+events00:13:021
269991199207411,2060cyclictest2708057-21kworker/0:2+events19:32:520
269991199207410,2061cyclictest2767355-21kworker/0:0+events23:07:060
26999199920737,2063cyclictest2722338-21kworker/3:2+events20:24:593
269991999207310,2060cyclictest2699333-21kworker/3:2+events19:25:313
26999119920713,2065cyclictest2801727-21kworker/0:2+events00:28:360
26999199920699,2056cyclictest2759341-21kworker/3:2+events22:27:503
269991999206410,2051cyclictest2733472-21kworker/3:2+events20:54:113
269991799206410,2051cyclictest2706245-21kworker/2:2+events19:47:592
26999149920649,2051cyclictest2772381-21kworker/1:0+events22:56:461
26999119920619,2049cyclictest2778611-21kworker/0:2+events23:11:220
26999119920617,2051cyclictest2701168-21kworker/0:2+events19:14:190
26999179920608,2049cyclictest2795028-21kworker/2:0+events00:09:572
269991999205910,2046cyclictest2767416-21kworker/3:2+events22:48:263
269991799205311,2039cyclictest2761180-21kworker/2:1+events22:32:272
269991199204910,2036cyclictest2736752-21kworker/0:2+events21:16:570
26999119920468,2035cyclictest2781927-21kworker/0:1+events23:40:380
26999119920468,2035cyclictest2709663-21kworker/0:0+events19:39:200
269991799204411,2030cyclictest2714388-21kworker/2:1+events19:59:212
26999149920417,2031cyclictest2751423-21kworker/1:2+events21:54:551
26999179920403,2034cyclictest2785073-21kworker/2:2+events23:33:002
26999149920404,2033cyclictest2738404-21kworker/1:1+events21:21:321
269991799203910,2026cyclictest2790045-21kworker/2:1+events23:55:492
269991799203713,2021cyclictest2780213-21kworker/2:1+events23:37:342
26999149920379,2025cyclictest2736779-21kworker/1:2+events21:10:501
26999179920363,2030cyclictest2727228-21kworker/2:1+events20:38:312
26999199920296,2020cyclictest2722338-21kworker/3:2+events20:18:293
26999179920297,2019cyclictest2744713-21kworker/2:0+events21:50:212
26999149920264,2019cyclictest2770463-21kworker/1:1+events22:51:501
269991799202210,2009cyclictest2735217-21kworker/2:2+events21:03:112
26999149920209,2008cyclictest2759461-21kworker/1:2+events22:29:451
269991799201810,2005cyclictest2788295-21kworker/2:2+events23:44:002
26999119920187,2008cyclictest2738529-21kworker/0:1+events21:13:060
269991799201710,2004cyclictest2751330-21kworker/2:2+events22:18:352
26999179920169,2003cyclictest2786673-21kworker/2:0+events23:53:062
269991199201510,2002cyclictest2749936-21kworker/0:0+events21:45:230
26999179920147,2003cyclictest2751330-21kworker/2:2+events21:48:492
269991799201410,2002cyclictest2741445-21kworker/2:1+events21:21:082
26999179920137,2003cyclictest2744713-21kworker/2:0+events21:31:112
26999119920128,2001cyclictest2719157-21kworker/0:0+events20:31:450
269991199201210,1999cyclictest2751542-21kworker/0:1+events22:01:010
269991799201010,1996cyclictest2731718-21kworker/2:1+events20:55:192
26999179920095,2001cyclictest2788295-21kworker/2:2+events23:47:252
269991199200910,1996cyclictest2743166-21kworker/0:1+events21:25:470
269991199200910,1996cyclictest2715838-21kworker/0:2+events20:03:310
26999179920077,1997cyclictest2751330-21kworker/2:2+events22:12:082
269991799200710,1994cyclictest2756041-21kworker/2:1+events22:05:592
26999179920068,1995cyclictest2703003-21kworker/2:0+events19:19:002
269991799200610,1993cyclictest2798266-21kworker/2:2+events00:14:352
269991799200610,1993cyclictest2769101-21kworker/2:2+events22:48:032
269991199200610,1993cyclictest2767355-21kworker/0:0+events22:52:350
269991199200510,1992cyclictest2773982-21kworker/0:2+events23:00:590
26999179920037,1993cyclictest2781840-21kworker/2:0+events23:23:062
26999179920029,1989cyclictest2709785-21kworker/2:1+events19:41:132
269991199200210,1989cyclictest2788121-21kworker/0:2+events00:11:540
269991199200110,1988cyclictest2761150-21kworker/0:2+events22:24:020
269991799200010,1987cyclictest2800057-21kworker/2:0+events00:20:412
26999149920009,1988cyclictest2725416-21kworker/1:0+events20:31:011
26999179919995,1991cyclictest2761180-21kworker/2:1+events22:37:042
26999119919997,1989cyclictest2708057-21kworker/0:2+events19:44:090
269991199199910,1986cyclictest2762812-21kworker/0:0+events22:25:540
26999119919979,1985cyclictest2711396-21kworker/0:1+events19:53:180
26999119919969,1984cyclictest2730325-21kworker/0:0+events20:53:470
26999119919968,1985cyclictest2730325-21kworker/0:0+events21:01:240
26999119919955,1987cyclictest2748314-21kworker/0:1+events21:41:100
269991199199310,1981cyclictest2727014-21kworker/0:2+events20:43:270
26999119919879,1975cyclictest2719157-21kworker/0:0+events20:22:410
26999119919869,1974cyclictest2736752-21kworker/0:2+events21:39:150
26999179919858,1974cyclictest2762842-21kworker/2:0+events22:57:542
26999179919847,1974cyclictest2738670-21kworker/2:0+events21:15:472
26999119919846,1975cyclictest2785252-21kworker/0:0+events23:36:500
269991199198310,1970cyclictest2701168-21kworker/0:2+events19:24:260
26999199919818,1970cyclictest2701108-21kworker/3:0+events19:13:573
26999119919818,1970cyclictest2765693-21kworker/0:1+events22:31:400
269991199198110,1968cyclictest2801727-21kworker/0:2+events00:39:140
26999179919806,1971cyclictest2720047-21kworker/2:2+events20:34:252
26999179919776,1968cyclictest2747094-21kworker/2:1+events21:36:102
269991799197410,1961cyclictest2736895-21kworker/2:1+events21:07:452
26999179919718,1960cyclictest2775862-21kworker/2:0+events23:09:472
26999119919639,1951cyclictest2767355-21kworker/0:0+events22:49:320
26999179919562,1950cyclictest2703003-21kworker/2:0+events19:25:102
269991799195610,1943cyclictest2714388-21kworker/2:1+events20:08:572
26999119919548,1943cyclictest2788121-21kworker/0:2+events23:55:020
269991199194710,1934cyclictest2755983-21kworker/0:2+events22:07:310
26999179919449,1932cyclictest2798266-21kworker/2:2+events00:19:552
26999179919409,1928cyclictest2704638-21kworker/2:1+events19:22:282
26999179919389,1925cyclictest2728853-21kworker/2:0+events20:46:082
26999179919389,1925cyclictest2699517-21kworker/2:1+events19:13:112
26999119919306,1921cyclictest2767355-21kworker/0:0+events22:41:580
26999179919249,1912cyclictest2780213-21kworker/2:1+events23:26:122
269991199192210,1909cyclictest2778611-21kworker/0:2+events23:17:030
26999149919199,1907cyclictest2799931-21kworker/1:2+events00:30:321
26999179918377,1827cyclictest2762842-21kworker/2:0+events22:43:322
26993932145103,37sleep20-21swapper/219:06:562
2699317214396,16sleep00-21swapper/019:05:580
26994642139109,25sleep10-21swapper/119:07:471
26994322139109,24sleep30-21swapper/319:07:243
2699911991711,4cyclictest2795597-21/usr/sbin/munin00:05:200
269991799140,13cyclictest2777944-21/usr/sbin/munin23:10:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional