You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-05 - 06:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Wed Nov 05, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1818179931619,3147cyclictest191751-21kworker/0:0+events19:40:140
18182999300014,2982cyclictest184954-21kworker/3:2+events19:20:013
18182199283811,2823cyclictest209392-21kworker/1:0+events20:55:171
18181799278613,2769cyclictest233893-21kworker/0:1+events21:55:000
18182199271713,2701cyclictest247267-21kworker/1:2+events22:35:131
18182199268113,2664cyclictest268088-21kworker/1:1+events23:45:131
18182199268113,2664cyclictest268088-21kworker/1:1+events23:45:131
18182999265913,2641cyclictest232378-21kworker/3:1+events22:05:203
18182999254212,2526cyclictest207850-21kworker/3:2+events20:30:163
18182599250312,2488cyclictest187323-21kworker/2:0+events19:35:152
18182599250311,2488cyclictest279273-21kworker/2:2+events00:26:382
18182999249512,2480cyclictest245249-21kworker/3:2+events22:29:033
18182999249211,2478cyclictest274605-21kworker/3:0+events00:09:073
18182999248612,2471cyclictest222617-21kworker/3:0+events21:22:423
18182599247412,2458cyclictest190029-21kworker/2:2+events20:05:442
18182999247312,2458cyclictest207850-21kworker/3:2+events20:39:203
18182999245312,2437cyclictest193079-21kworker/3:2+events19:41:223
18181799244412,2429cyclictest267880-21kworker/0:1+events23:40:120
18182999242711,2413cyclictest248809-21kworker/3:2+events22:58:033
18181799242510,2412cyclictest201821-21kworker/0:1+events20:18:500
1818299924238,2412cyclictest248809-21kworker/3:2+events22:39:443
18182199242212,2406cyclictest220857-21kworker/1:0+events21:31:231
18182599242111,2406cyclictest204406-21kworker/2:0+events20:25:182
18182199241711,2403cyclictest266399-21kworker/1:0+events23:43:171
18182199241612,2400cyclictest274457-21kworker/1:2+events00:05:201
18181799241010,2397cyclictest261665-21kworker/0:1+events23:25:500
18181799240912,2393cyclictest263321-21kworker/0:0+events23:54:450
18182199240812,2393cyclictest247267-21kworker/1:2+events23:33:221
18182999240610,2393cyclictest258272-21kworker/3:2+events23:10:333
18182199240110,2387cyclictest217652-21kworker/1:1+events21:08:161
1818219924008,2389cyclictest229428-21kworker/1:2+events21:41:371
18182999239612,2381cyclictest242015-21kworker/3:1+events22:20:143
18181799239610,2383cyclictest258421-21kworker/0:0+events23:13:380
1818219923959,2383cyclictest222462-21kworker/1:2+events21:20:501
1818179923949,2382cyclictest188394-21kworker/0:2+events19:33:440
18182199239210,2379cyclictest196369-21kworker/1:1+events19:53:571
18181799239211,2377cyclictest214068-21kworker/0:1+events20:51:300
18181799238912,2373cyclictest195789-21kworker/0:1+events19:58:070
18181799238812,2373cyclictest282858-21kworker/0:0+events00:37:380
18181799238810,2374cyclictest217948-21kworker/0:1+events21:04:260
18181799238611,2371cyclictest245282-21kworker/0:0+events22:32:090
18182199238412,2369cyclictest198122-21kworker/1:2+events20:04:581
18181799238112,2366cyclictest207670-21kworker/0:2+events20:34:260
18181799237512,2359cyclictest251704-21kworker/0:1+events22:48:340
18182599236212,2347cyclictest217213-21kworker/2:0+events20:59:072
18182999235511,2341cyclictest266193-21kworker/3:1+events23:32:163
18182599235412,2340cyclictest245160-21kworker/2:2+events22:30:352
18182599234712,2332cyclictest227607-21kworker/2:0+events21:37:252
18181799234411,2329cyclictest215654-21kworker/0:0+events21:13:590
18182599234012,2325cyclictest279273-21kworker/2:2+events00:31:352
18182599233810,2325cyclictest266623-21kworker/2:1+events23:40:342
18182599233712,2322cyclictest255205-21kworker/2:0+events23:22:262
18182199232410,2311cyclictest204502-21kworker/1:2+events20:18:031
1818299923218,2309cyclictest235911-21kworker/3:0+events22:12:153
18182999231410,2301cyclictest200246-21kworker/3:1+events20:24:073
1818299923098,2298cyclictest215788-21kworker/3:2+events21:00:583
18182999230311,2289cyclictest266193-21kworker/3:1+events23:39:043
18182599230212,2287cyclictest266623-21kworker/2:1+events23:37:302
18181799230212,2286cyclictest261665-21kworker/0:1+events23:18:580
18182599229811,2284cyclictest221188-21kworker/2:1+events21:19:182
18182199229710,2284cyclictest240784-21kworker/1:2+events22:23:191
18182199229210,2279cyclictest234160-21kworker/1:1+events21:57:411
18182199229210,2279cyclictest234160-21kworker/1:1+events21:57:401
18182999228111,2266cyclictest253808-21kworker/3:0+events22:54:593
18182599228010,2267cyclictest256853-21kworker/2:2+events23:04:272
18182999227811,2264cyclictest193079-21kworker/3:2+events19:59:393
18182999227511,2261cyclictest215788-21kworker/3:2+events21:14:453
18182999227311,2259cyclictest214034-21kworker/3:0+events20:51:543
18182999227211,2258cyclictest280880-21kworker/3:0+events00:22:253
18182999227210,2259cyclictest267820-21kworker/3:0+events23:47:303
18182999227210,2259cyclictest267820-21kworker/3:0+events23:47:303
18182999227111,2257cyclictest224266-21kworker/3:1+events21:31:023
18182999227111,2256cyclictest274605-21kworker/3:0+events00:02:203
18182999227110,2258cyclictest229002-21kworker/3:2+events21:51:343
18181799227010,2257cyclictest245282-21kworker/0:0+events22:52:190
18182999226911,2255cyclictest229002-21kworker/3:2+events21:48:053
18182999226811,2254cyclictest245249-21kworker/3:2+events22:31:463
18182999226810,2258cyclictest186880-21kworker/3:1+events19:23:503
18182999226810,2255cyclictest232378-21kworker/3:1+events22:04:353
18182999226810,2254cyclictest280880-21kworker/3:0+events00:19:013
1818299922669,2254cyclictest191451-21kworker/3:0+events19:36:243
1818219922669,2254cyclictest268088-21kworker/1:1+events23:58:311
18182999226210,2249cyclictest255398-21kworker/3:1+events23:02:113
18182999225911,2244cyclictest267820-21kworker/3:0+events23:42:313
1818299922557,2246cyclictest207850-21kworker/3:2+events20:45:013
1818299922539,2241cyclictest260148-21kworker/3:0+events23:15:103
18182999225310,2240cyclictest188576-21kworker/3:2+events19:32:583
18182999225011,2235cyclictest282769-21kworker/3:2+events00:38:493
18182999225010,2236cyclictest212404-21kworker/3:1+events20:44:153
18182999223511,2221cyclictest269507-21kworker/3:2+events23:58:533
18182999222910,2215cyclictest202831-21kworker/3:2+events20:11:543
1818179922299,2217cyclictest227670-21kworker/0:2+events21:43:520
18182999222610,2213cyclictest217452-21kworker/3:0+events21:09:033
18182999222411,2210cyclictest197941-21kworker/3:0+events20:05:213
18182199222111,2206cyclictest186941-21kworker/1:2+events19:28:031
1818299922199,2207cyclictest229002-21kworker/3:2+events21:55:473
1818299922199,2207cyclictest229002-21kworker/3:2+events21:55:473
18182599221812,2203cyclictest279273-21kworker/2:2+events00:24:442
1818219922159,2203cyclictest193047-21kworker/1:1+events19:44:211
1818219922058,2194cyclictest247267-21kworker/1:2+events22:53:281
18182199220311,2189cyclictest253750-21kworker/1:0+events22:56:331
18182199220211,2188cyclictest204502-21kworker/1:2+events20:32:081
18181799220210,2189cyclictest277587-21kworker/0:2+events00:10:390
18182199220111,2187cyclictest220857-21kworker/1:0+events21:38:071
1818219921999,2187cyclictest196369-21kworker/1:1+events20:06:071
1818219921998,2188cyclictest196369-21kworker/1:1+events20:10:441
18182199219911,2185cyclictest232468-21kworker/1:0+events21:53:511
18182199219911,2185cyclictest213975-21kworker/1:1+events20:48:251
18182199219910,2185cyclictest276580-21kworker/1:0+events00:11:231
18182599219811,2184cyclictest285081-21kworker/2:0+events00:38:032
18182199219710,2184cyclictest247267-21kworker/1:2+events23:04:501
18182199219610,2183cyclictest247267-21kworker/1:2+events23:17:071
18182199219610,2182cyclictest209392-21kworker/1:0+events20:42:451
18181799219611,2182cyclictest263321-21kworker/0:0+events23:31:080
18182199219511,2181cyclictest276580-21kworker/1:0+events00:19:461
1818219921949,2181cyclictest209392-21kworker/1:0+events20:53:461
18181799219411,2179cyclictest273097-21kworker/0:1+events00:28:540
18182199219311,2179cyclictest247267-21kworker/1:2+events22:42:031
18182199219311,2179cyclictest188545-21kworker/1:0+events19:46:591
18182199219011,2176cyclictest188545-21kworker/1:0+events19:37:091
1818179921908,2180cyclictest197976-21kworker/0:0+events20:07:390
18181799219010,2177cyclictest273097-21kworker/0:1+events00:03:250
1818179921899,2177cyclictest209302-21kworker/0:1+events20:35:120
18181799218911,2175cyclictest273097-21kworker/0:1+events00:18:150
18181799218910,2176cyclictest277587-21kworker/0:2+events00:07:360
1818179921886,2179cyclictest255353-21kworker/0:1+events23:03:400
18181799218810,2175cyclictest273097-21kworker/0:1+events00:21:400
18181799218710,2174cyclictest233893-21kworker/0:1+events21:56:550
18181799218710,2174cyclictest233893-21kworker/0:1+events21:56:540
18181799218611,2172cyclictest263321-21kworker/0:0+events23:59:370
18181799218611,2172cyclictest239021-21kworker/0:0+events22:09:350
18181799218611,2172cyclictest237415-21kworker/0:1+events22:22:340
18181799218611,2172cyclictest195789-21kworker/0:1+events20:02:400
1818179921857,2174cyclictest273097-21kworker/0:1+events00:33:490
18181799218510,2171cyclictest197976-21kworker/0:0+events20:22:590
18181799218311,2170cyclictest215654-21kworker/0:0+events20:56:020
18181799218311,2169cyclictest245282-21kworker/0:0+events22:35:580
18181799218310,2170cyclictest215654-21kworker/0:0+events21:22:210
1818179921819,2167cyclictest232223-21kworker/0:0+events21:48:290
18182999218010,2167cyclictest206244-21kworker/3:0+events20:26:263
1818179921797,2169cyclictest242079-21kworker/0:2+events22:27:560
18181799217811,2165cyclictest253660-21kworker/0:2+events23:07:280
1818219921768,2165cyclictest224208-21kworker/1:1+events21:26:071
18182599217510,2163cyclictest258571-21kworker/2:1+events23:10:102
18182999217410,2161cyclictest284439-21kworker/3:0+events00:33:263
18181799217210,2159cyclictest195789-21kworker/0:1+events19:51:590
18182199216710,2154cyclictest188545-21kworker/1:0+events19:57:221
18182199216611,2152cyclictest282676-21kworker/1:1+events00:33:061
18182199216511,2151cyclictest287527-21kworker/1:2+events00:39:101
18182199216411,2150cyclictest204502-21kworker/1:2+events20:22:381
18182599216311,2148cyclictest240619-21kworker/2:2+events22:15:172
18182199216310,2150cyclictest247267-21kworker/1:2+events23:13:151
1818219921616,2151cyclictest229428-21kworker/1:2+events21:49:161
1818179921619,2149cyclictest237415-21kworker/0:1+events22:17:360
18182599215910,2146cyclictest247088-21kworker/2:1+events22:41:392
18182199215810,2145cyclictest243521-21kworker/1:1+events22:29:271
18182199215610,2143cyclictest185018-21kworker/1:0+events19:19:381
18182599215510,2142cyclictest248777-21kworker/2:2+events22:50:262
18182199215511,2141cyclictest247267-21kworker/1:2+events23:08:381
1818299921547,2144cyclictest224266-21kworker/3:1+events21:38:553
18182599215311,2139cyclictest252973-21kworker/2:1+events22:59:342
18182599215311,2139cyclictest201610-21kworker/2:1+events20:19:352
1818259921529,2139cyclictest217213-21kworker/2:0+events21:00:352
18182599215110,2138cyclictest255205-21kworker/2:0+events23:18:142
18182599214810,2135cyclictest183208-21kworker/2:1+events19:29:572
18182999214510,2132cyclictest222617-21kworker/3:0+events21:18:563
18181799214410,2130cyclictest190118-21kworker/0:1+events19:37:320
18182599214211,2129cyclictest271023-21kworker/2:2+events23:50:342
18182599214210,2129cyclictest235668-21kworker/2:2+events22:00:232
1818259921418,2130cyclictest248777-21kworker/2:2+events22:45:292
18182599214111,2127cyclictest272920-21kworker/2:1+events00:12:292
18182599214111,2127cyclictest232582-21kworker/2:0+events22:11:522
18182999214010,2127cyclictest193079-21kworker/3:2+events19:45:293
18182999214010,2126cyclictest261754-21kworker/3:2+events23:28:313
18182599214011,2126cyclictest230847-21kworker/2:2+events21:47:182
18182599214011,2126cyclictest197794-21kworker/2:1+events19:56:362
18182599214010,2126cyclictest255205-21kworker/2:0+events23:09:232
18182599213911,2124cyclictest210932-21kworker/2:1+events20:40:282
18182599213811,2124cyclictest271023-21kworker/2:2+events23:49:032
18182599213811,2124cyclictest271023-21kworker/2:2+events23:49:032
18182599213811,2124cyclictest221188-21kworker/2:1+events21:25:442
18182599213810,2124cyclictest274770-21kworker/2:2+events00:04:112
18181799213810,2125cyclictest197976-21kworker/0:0+events20:10:210
18182199213710,2124cyclictest217652-21kworker/1:1+events21:03:391
18182599213611,2122cyclictest227607-21kworker/2:0+events21:41:132
18182599213611,2122cyclictest206098-21kworker/2:2+events20:37:042
1818179921338,2121cyclictest197976-21kworker/0:0+events20:27:120
1818219921314,2124cyclictest209392-21kworker/1:0+events20:37:261
18182199213110,2118cyclictest240784-21kworker/1:2+events22:16:261
18182599212811,2115cyclictest272920-21kworker/2:1+events00:06:512
18182599212510,2113cyclictest279273-21kworker/2:2+events00:16:182
18182599212010,2107cyclictest217889-21kworker/2:1+events21:07:532
18182999211810,2105cyclictest196339-21kworker/3:1+events19:53:103
18182999211510,2102cyclictest224266-21kworker/3:1+events21:26:283
18182999211410,2101cyclictest273008-21kworker/3:1+events00:27:483
18182599211411,2100cyclictest204406-21kworker/2:0+events20:22:162
18182999211310,2100cyclictest258272-21kworker/3:2+events23:06:433
18182999211310,2100cyclictest242015-21kworker/3:1+events22:18:223
18181799211210,2099cyclictest253660-21kworker/0:2+events23:21:400
1818299921118,2100cyclictest269507-21kworker/3:2+events23:53:363
18182999211110,2098cyclictest248809-21kworker/3:2+events22:46:143
1818259921109,2098cyclictest235668-21kworker/2:2+events21:57:172
1818259921109,2098cyclictest235668-21kworker/2:2+events21:57:172
1818299921098,2098cyclictest202831-21kworker/3:2+events20:15:433
1818299921074,2100cyclictest273008-21kworker/3:1+events00:12:073
1818179921077,2097cyclictest179952-21kworker/0:2+events19:15:210
1818179921067,2096cyclictest179952-21kworker/0:2+events19:20:220
1818299921048,2093cyclictest193079-21kworker/3:2+events20:01:553
18181799209911,2086cyclictest212348-21kworker/0:0+events20:46:080
1818179920849,2072cyclictest191751-21kworker/0:0+events19:49:410
18182599208311,2069cyclictest255205-21kworker/2:0+events23:31:532
18182599208310,2070cyclictest221188-21kworker/2:1+events21:50:502
18182199207610,2063cyclictest182910-21kworker/1:1+events19:20:441
1818179920706,2061cyclictest269657-21kworker/0:2+events23:45:580
1818179920706,2061cyclictest269657-21kworker/0:2+events23:45:580
1818219920639,2051cyclictest247267-21kworker/1:2+events23:36:461
18182199206210,2049cyclictest268088-21kworker/1:1+events23:50:561
1818259920597,2049cyclictest215607-21kworker/2:1+events20:53:232
1818219920535,2045cyclictest268088-21kworker/1:1+events00:01:341
1818219920479,2035cyclictest280783-21kworker/1:2+events00:21:161
1818219920447,2034cyclictest247267-21kworker/1:2+events23:21:171
18182199204410,2031cyclictest276580-21kworker/1:0+events00:26:141
18182199204410,2031cyclictest204502-21kworker/1:2+events20:28:231
1818219920436,2035cyclictest188545-21kworker/1:0+events19:34:311
1818219920433,2037cyclictest243521-21kworker/1:1+events22:34:491
1818179920433,2037cyclictest222522-21kworker/0:1+events21:18:330
18182599204211,2028cyclictest195023-21kworker/2:0+events19:51:372
1818219920415,2033cyclictest229428-21kworker/1:2+events22:02:171
1818219920405,2032cyclictest239111-21kworker/1:1+events22:14:291
1818299920398,2028cyclictest178527-21kworker/3:0+events19:13:253
18182199203910,2026cyclictest220857-21kworker/1:0+events21:16:141
18182599203710,2023cyclictest217213-21kworker/2:0+events21:10:102
1818179920317,2021cyclictest227670-21kworker/0:2+events22:03:260
18181799203110,2017cyclictest207670-21kworker/0:2+events20:41:130
1818219920306,2021cyclictest247267-21kworker/1:2+events23:29:411
1818179920305,2022cyclictest225807-21kworker/0:1+events21:36:400
1818179920304,2023cyclictest245282-21kworker/0:0+events22:55:460
18181799203010,2017cyclictest186761-21kworker/0:0+events19:26:540
1818179920289,2016cyclictest239021-21kworker/0:0+events22:12:360
18181799202710,2014cyclictest248870-21kworker/0:2+events22:42:260
1818179920259,2013cyclictest225807-21kworker/0:1+events21:29:090
1818259920246,2015cyclictest227607-21kworker/2:0+events21:33:382
18182199202310,2010cyclictest220857-21kworker/1:0+events21:12:051
1818179920239,2011cyclictest225807-21kworker/0:1+events21:34:250
18182999202210,2009cyclictest229002-21kworker/3:2+events21:42:433
1818299920219,2009cyclictest178527-21kworker/3:0+events19:27:183
18181799202010,2007cyclictest263321-21kworker/0:0+events23:39:260
1818259920079,1995cyclictest183208-21kworker/2:1+events19:22:192
1818259920039,1991cyclictest190029-21kworker/2:2+events19:46:382
18182599200310,1990cyclictest190029-21kworker/2:2+events19:43:362
18182599200010,1987cyclictest255205-21kworker/2:0+events23:26:142
1818259919985,1990cyclictest272920-21kworker/2:1+events23:55:522
18182599199810,1985cyclictest235668-21kworker/2:2+events22:06:072
18182199199810,1985cyclictest247267-21kworker/1:2+events22:47:231
18182599199610,1983cyclictest247088-21kworker/2:1+events22:38:592
1818259919957,1985cyclictest212698-21kworker/2:2+events20:47:162
1818259919908,1979cyclictest178252-21kworker/2:2+events19:13:482
18182599198810,1975cyclictest199508-21kworker/2:0+events20:03:272
1818259919876,1978cyclictest245160-21kworker/2:2+events22:27:102
1818259919828,1971cyclictest190029-21kworker/2:2+events20:14:122
1818259919719,1959cyclictest206098-21kworker/2:2+events20:33:172
1818179919607,1950cyclictest181626-21kworker/0:1+events19:13:020
1818219919589,1946cyclictest229428-21kworker/1:2+events22:05:441
1818179919548,1943cyclictest217948-21kworker/0:1+events21:06:430
1818259919425,1934cyclictest187323-21kworker/2:0+events19:32:362
1818259919207,1910cyclictest172138-21kworker/2:0+events19:18:272
1818219918897,1879cyclictest175121-21kworker/1:2+events19:11:061
1812152160116,25sleep10-21swapper/119:05:301
1812652144111,30sleep20-21swapper/219:06:062
1813212143112,26sleep30-21swapper/319:06:513
181365214091,16sleep00-21swapper/019:07:250
181825999592,2cyclictest217213-21kworker/2:0+pm21:24:492
18182999167,6cyclictest217401-21sendmail21:00:013
181829991413,1cyclictest26550irq/143-i91523:24:213
181829991311,1cyclictest250367-21runrttasks22:43:423
18182599120,11cyclictest242667-21/usr/sbin/munin22:20:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional