You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 08:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Tue Mar 10, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9157519930599,3048cyclictest1018283-21kworker/1:1+events00:30:181
91575399289712,2880cyclictest1003812-21kworker/2:0+events23:45:172
91575399288914,2871cyclictest1018312-21kworker/2:0+events00:35:162
91575399282214,2805cyclictest1003812-21kworker/2:0+events23:55:162
91575399279013,2774cyclictest1011741-21kworker/2:1+events00:20:002
91575799274612,2730cyclictest985132-21kworker/3:2+events22:50:173
91575399274613,2729cyclictest948069-21kworker/2:0+events20:50:192
91575799270311,2688cyclictest970616-21kworker/3:1+events22:20:123
91575399267513,2658cyclictest927460-21kworker/2:3+events19:50:212
91575199266012,2644cyclictest920553-21kworker/1:1+events19:30:161
9157479925667,2555cyclictest951275-21kworker/0:1+events21:00:180
9157579925529,2540cyclictest957651-21kworker/3:2+events21:20:113
91575799249811,2484cyclictest920760-21kworker/3:0+events19:25:183
91574799248811,2473cyclictest1018251-21kworker/0:1+events00:36:030
91575799247010,2456cyclictest990929-21kworker/3:0+events23:06:513
91574799245112,2436cyclictest988001-21kworker/0:0+events23:03:290
91575799244812,2432cyclictest930720-21kworker/3:2+events19:58:433
91575399244212,2427cyclictest998887-21kworker/2:1+events23:39:332
91575799243612,2420cyclictest970616-21kworker/3:1+events22:07:353
91575399242512,2409cyclictest966909-21kworker/2:2+events21:50:072
91575399242311,2410cyclictest942150-21kworker/2:0+events20:35:052
91575199242312,2408cyclictest954598-21kworker/1:2+events21:18:171
91575199240811,2394cyclictest970287-21kworker/1:1+events22:05:201
91575399240312,2387cyclictest919590-21kworker/2:0+events19:22:412
91575799239112,2375cyclictest973477-21kworker/3:0+events22:16:003
91575799238612,2371cyclictest1002247-21kworker/3:0+events23:48:443
91575799238612,2370cyclictest963791-21kworker/3:2+events21:47:523
91575799238312,2368cyclictest932347-21kworker/3:0+events20:00:143
91575199238010,2366cyclictest971940-21kworker/1:0+events22:12:361
91575399237711,2362cyclictest970374-21kworker/2:1+events22:07:132
91575799237611,2362cyclictest954355-21kworker/3:0+events21:17:073
91575399236912,2355cyclictest933849-21kworker/2:1+events20:30:052
91575799236512,2349cyclictest1008586-21kworker/3:0+events00:23:483
91575199236512,2350cyclictest998796-21kworker/1:2+events23:38:031
91575399236412,2349cyclictest966909-21kworker/2:2+events21:56:582
91575199236312,2349cyclictest965265-21kworker/1:2+events21:45:111
91575199236312,2348cyclictest943133-21kworker/1:2+events20:41:111
91575199236311,2348cyclictest965265-21kworker/1:2+events21:55:511
91575399236212,2347cyclictest998887-21kworker/2:1+events23:28:312
91575199236212,2347cyclictest960820-21kworker/1:2+events21:33:371
91575799236112,2345cyclictest1019614-21kworker/3:0+events00:32:123
91575199236112,2345cyclictest1003749-21kworker/1:1+events00:00:151
91574799236112,2345cyclictest979821-21kworker/0:2+events22:27:260
91575399236011,2345cyclictest992616-21kworker/2:2+events23:11:422
91575799235911,2345cyclictest960884-21kworker/3:1+events21:39:223
91575199235911,2345cyclictest1015010-21kworker/1:2+events00:28:481
91575199235812,2343cyclictest943133-21kworker/1:2+events20:39:171
91575799235612,2341cyclictest955955-21kworker/3:1+events21:14:233
91575799235412,2338cyclictest1008586-21kworker/3:0+events00:07:503
91575799235112,2337cyclictest1002247-21kworker/3:0+events23:50:393
91575799235112,2336cyclictest943296-21kworker/3:1+events20:36:353
91575799235012,2335cyclictest997438-21kworker/3:0+events23:31:373
91575399235012,2334cyclictest973719-21kworker/2:2+events22:15:142
91575199234912,2334cyclictest978549-21kworker/1:1+events22:29:441
91574799234912,2334cyclictest973658-21kworker/0:1+events22:48:450
91575799234712,2332cyclictest963791-21kworker/3:2+events22:04:583
91575799234712,2332cyclictest1008586-21kworker/3:0+events00:19:143
91575199234512,2329cyclictest932112-21kworker/1:1+events19:57:121
91575199234212,2327cyclictest920553-21kworker/1:1+events19:23:031
91575399234112,2325cyclictest972059-21kworker/2:0+events22:33:572
91574799234110,2327cyclictest955893-21kworker/0:0+events21:13:170
91575399234012,2325cyclictest1008930-21kworker/2:3+events00:02:542
91575399234011,2327cyclictest933849-21kworker/2:1+events21:01:282
91575399234011,2326cyclictest933849-21kworker/2:1+events20:42:182
91574799234010,2327cyclictest992586-21kworker/0:1+events23:09:060
91575399233912,2323cyclictest927238-21kworker/2:0+events19:46:532
91575199233912,2323cyclictest984569-21kworker/1:2+events22:53:171
91575399233812,2322cyclictest955926-21kworker/2:2+events21:17:542
91575199233810,2325cyclictest940294-21kworker/1:1+events20:27:031
91575399233711,2322cyclictest987738-21kworker/2:2+events22:58:112
91575199233611,2321cyclictest987883-21kworker/1:0+events23:26:121
91574799233612,2321cyclictest942706-21kworker/0:0+events20:37:450
91574799233610,2323cyclictest1003780-21kworker/0:2+events23:50:160
91574799233512,2320cyclictest954206-21kworker/0:2+events21:15:570
91575399233211,2317cyclictest994207-21kworker/2:1+events23:17:492
91575199233112,2317cyclictest976928-21kworker/1:2+events22:21:431
91575199233110,2318cyclictest935363-21kworker/1:2+events20:08:591
91575199232912,2315cyclictest989514-21kworker/1:1+events23:00:061
91574799232912,2314cyclictest984688-21kworker/0:0+events22:44:570
91575399232712,2312cyclictest933849-21kworker/2:1+events20:21:392
91575199232712,2311cyclictest1003749-21kworker/1:1+events00:21:561
91575199232612,2311cyclictest994115-21kworker/1:2+events23:14:431
91575199232612,2311cyclictest984569-21kworker/1:2+events22:41:561
91575199232612,2311cyclictest962460-21kworker/1:1+events21:40:311
91575199232612,2311cyclictest1003749-21kworker/1:1+events23:59:521
91575199232612,2310cyclictest918928-21kworker/1:0+events19:26:271
91575199232512,2311cyclictest987883-21kworker/1:0+events22:55:071
91575199232512,2310cyclictest989514-21kworker/1:1+events23:09:501
91574799232512,2310cyclictest962187-21kworker/0:2+events21:32:500
91575399232411,2310cyclictest984539-21kworker/2:2+events22:43:242
91575399231612,2301cyclictest962442-21kworker/2:0+events21:36:172
91574799229911,2284cyclictest930793-21kworker/0:0+events20:17:300
91575399229610,2283cyclictest962442-21kworker/2:0+events21:40:542
91575199227611,2262cyclictest949579-21kworker/1:1+events21:00:411
91575799226811,2254cyclictest1008586-21kworker/3:0+events00:13:333
91575399226710,2253cyclictest964102-21kworker/2:1+events21:49:212
91575799226610,2253cyclictest968981-21kworker/3:0+events21:55:293
91575799226511,2250cyclictest938395-21kworker/3:2+events20:19:003
91575399226511,2250cyclictest954236-21kworker/2:0+events21:12:312
91575399226210,2250cyclictest960853-21kworker/2:2+events21:34:462
91575799226112,2246cyclictest925496-21kworker/3:0+events19:38:353
91575199225912,2244cyclictest949579-21kworker/1:1+events21:05:191
91575799225310,2239cyclictest994145-21kworker/3:2+events23:18:583
91575399225211,2238cyclictest1014917-21kworker/2:0+events00:20:482
91575399224010,2226cyclictest972059-21kworker/2:0+events22:27:492
91575799223312,2218cyclictest1019614-21kworker/3:0+events00:35:393
91575199222911,2215cyclictest986260-21kworker/1:1+events22:49:531
91575799222811,2215cyclictest959277-21kworker/3:0+events21:25:313
91575399222810,2215cyclictest986136-21kworker/2:0+events22:46:522
91575199222411,2210cyclictest968439-21kworker/1:0+events21:53:101
91575199221511,2201cyclictest1002099-21kworker/1:0+events23:43:441
91575799221211,2198cyclictest944901-21kworker/3:2+events20:59:543
91574799220610,2193cyclictest927323-21kworker/0:1+events19:49:340
91575799220111,2186cyclictest985132-21kworker/3:2+events22:46:293
91575399220111,2187cyclictest989330-21kworker/2:0+events23:02:432
91575199220111,2187cyclictest949579-21kworker/1:1+events20:56:291
91575799219010,2176cyclictest954355-21kworker/3:0+events21:08:213
91574799218711,2173cyclictest986346-21kworker/0:2+events22:50:390
91575799218610,2173cyclictest981672-21kworker/3:0+events22:43:473
91575399218611,2172cyclictest927460-21kworker/2:3+events20:03:162
91575799218210,2168cyclictest929116-21kworker/3:1+events20:08:133
91575399218010,2167cyclictest933849-21kworker/2:1+events20:16:212
91575799217611,2162cyclictest992520-21kworker/3:1+events23:12:273
9157479921699,2157cyclictest973658-21kworker/0:1+events22:31:140
9157579921669,2154cyclictest997438-21kworker/3:0+events23:28:543
9157579921669,2154cyclictest940024-21kworker/3:0+events20:32:453
91575799216611,2152cyclictest917069-21kworker/3:1+events19:33:383
91575799216610,2153cyclictest959277-21kworker/3:0+events21:34:233
91575799216510,2151cyclictest1000616-21kworker/3:1+events23:41:303
9157579921637,2154cyclictest963791-21kworker/3:2+events21:40:083
91575799216311,2148cyclictest929116-21kworker/3:1+events19:51:073
91575799216310,2150cyclictest944901-21kworker/3:2+events20:53:233
91575399216311,2149cyclictest972059-21kworker/2:0+events22:24:462
91575799216211,2148cyclictest1008586-21kworker/3:0+events00:02:073
91575799216210,2149cyclictest935575-21kworker/3:0+events20:14:483
91575399216211,2147cyclictest972059-21kworker/2:0+events22:38:092
91575799216111,2147cyclictest938395-21kworker/3:2+events20:20:553
91575799216111,2146cyclictest970616-21kworker/3:1+events22:14:523
91575799216011,2146cyclictest980076-21kworker/3:1+events22:31:373
91575799216010,2147cyclictest994145-21kworker/3:2+events23:36:313
91575799215911,2144cyclictest927151-21kworker/3:2+events19:43:513
91575799215711,2143cyclictest940024-21kworker/3:0+events20:41:553
91575799215711,2143cyclictest917069-21kworker/3:1+events19:20:433
9157519921579,2144cyclictest957435-21kworker/1:1+events21:27:051
9157519921578,2146cyclictest982945-21kworker/1:1+events22:38:541
91575799215611,2142cyclictest981672-21kworker/3:0+events22:35:303
91575799215611,2142cyclictest952752-21kworker/3:1+events21:03:253
91575799215611,2141cyclictest967036-21kworker/3:1+events21:52:243
91575799215610,2142cyclictest989299-21kworker/3:2+events22:58:343
9157579921549,2142cyclictest910502-21kworker/3:2+events19:19:593
9157579921539,2141cyclictest944901-21kworker/3:2+events20:46:093
91575799215311,2140cyclictest927151-21kworker/3:2+events19:45:443
91575799215311,2139cyclictest1006719-21kworker/3:1+events23:56:483
91575199215211,2138cyclictest920553-21kworker/1:1+events19:45:211
91574799214810,2135cyclictest1000678-21kworker/0:1+events23:36:090
91575399214410,2130cyclictest933849-21kworker/2:1+events21:06:062
9157519921428,2130cyclictest926069-21kworker/1:0+events19:44:361
9157539921392,2134cyclictest911382-21kworker/2:1+events19:36:412
91575399213911,2125cyclictest995815-21kworker/2:0+events23:31:132
91575399213911,2125cyclictest1003812-21kworker/2:0+events23:51:492
91575399213911,2124cyclictest987738-21kworker/2:2+events22:52:112
91575199213911,2125cyclictest959186-21kworker/1:0+events21:36:411
91575399213811,2124cyclictest970374-21kworker/2:1+events22:03:042
91575399213811,2124cyclictest927460-21kworker/2:3+events20:05:322
9157519921389,2126cyclictest1003749-21kworker/1:1+events23:47:121
91575199213810,2125cyclictest936999-21kworker/1:0+events20:24:451
91575199213711,2122cyclictest998796-21kworker/1:2+events23:32:001
91575399213611,2122cyclictest989330-21kworker/2:0+events23:07:592
91575399213611,2122cyclictest957533-21kworker/2:1+events21:26:172
91575399213610,2123cyclictest1011741-21kworker/2:1+events00:12:232
9157479921369,2124cyclictest962187-21kworker/0:2+events22:08:220
91575799213511,2120cyclictest940024-21kworker/3:0+events20:29:423
91575399213513,2119cyclictest972059-21kworker/2:0+events22:14:082
91575199213510,2122cyclictest930481-21kworker/1:2+events19:54:121
91575799213210,2119cyclictest1015131-21kworker/3:1+events00:25:213
91575199213211,2118cyclictest936999-21kworker/1:0+events20:19:221
91575399213111,2116cyclictest937032-21kworker/2:0+events20:14:242
91575199213011,2116cyclictest994115-21kworker/1:2+events23:17:011
91575399212911,2115cyclictest940323-21kworker/2:2+events20:25:542
91575799212811,2114cyclictest990929-21kworker/3:0+events23:04:563
91575399212810,2115cyclictest1011741-21kworker/2:1+events00:25:432
91575199212811,2114cyclictest987883-21kworker/1:0+events23:22:471
91575199212810,2114cyclictest913935-21kworker/1:2+events19:16:361
91575399212610,2113cyclictest1011741-21kworker/2:1+events00:34:062
91575199212611,2112cyclictest932112-21kworker/1:1+events20:04:021
91575199212610,2113cyclictest965265-21kworker/1:2+events22:00:471
91575199212511,2111cyclictest980995-21kworker/1:2+events22:34:191
91575199212511,2111cyclictest1003749-21kworker/1:1+events23:54:101
91575199212413,2108cyclictest1003749-21kworker/1:1+events00:07:021
91575199212311,2109cyclictest940294-21kworker/1:1+events20:34:411
91575399212011,2105cyclictest911382-21kworker/2:1+events19:43:062
91575399211911,2104cyclictest933849-21kworker/2:1+events20:48:042
91574799211711,2103cyclictest970588-21kworker/0:0+events22:04:370
91574799211711,2103cyclictest963855-21kworker/0:0+events21:39:450
91574799211511,2101cyclictest962187-21kworker/0:2+events21:59:410
91574799211511,2101cyclictest946494-21kworker/0:2+events20:51:280
91574799211510,2102cyclictest935453-21kworker/0:1+events20:12:050
91574799211510,2102cyclictest1016488-21kworker/0:2+events00:24:340
91574799211411,2100cyclictest935453-21kworker/0:1+events20:09:460
91575399211311,2100cyclictest992616-21kworker/2:2+events23:20:092
91575199210711,2093cyclictest944748-21kworker/1:0+events20:52:141
91574799210711,2093cyclictest1018251-21kworker/0:1+events00:31:020
91574799210611,2092cyclictest939967-21kworker/0:1+events20:30:270
91575199210511,2092cyclictest920553-21kworker/1:1+events19:35:101
91574799210410,2091cyclictest966850-21kworker/0:1+events21:48:360
91574799210311,2088cyclictest915507-21kworker/0:0+events19:21:300
91574799210211,2089cyclictest1005682-21kworker/0:1+events00:10:060
91574799210211,2088cyclictest920519-21kworker/0:1+events19:27:130
9157519921018,2090cyclictest971940-21kworker/1:0+events22:19:491
9157479920952,2090cyclictest973658-21kworker/0:1+events22:10:400
91575399209211,2078cyclictest933849-21kworker/2:1+events20:57:162
9157479920919,2079cyclictest923758-21kworker/0:0+events19:37:500
91575399209010,2077cyclictest1008930-21kworker/2:3+events00:06:162
91574799208810,2075cyclictest923758-21kworker/0:0+events19:41:370
9157519920849,2072cyclictest943133-21kworker/1:2+events20:47:171
91575199208310,2069cyclictest1015010-21kworker/1:2+events00:37:541
9157539920789,2066cyclictest923669-21kworker/2:0+events19:33:152
9157579920716,2061cyclictest978489-21kworker/3:0+events22:28:343
9157519920628,2051cyclictest1013346-21kworker/1:0+events00:14:391
91575199205011,2036cyclictest1003749-21kworker/1:1+events00:17:411
91574799205010,2037cyclictest946494-21kworker/0:2+events20:43:510
9157579920487,2038cyclictest997438-21kworker/3:0+events23:24:423
91575199204610,2033cyclictest932112-21kworker/1:1+events20:13:141
91574799204510,2032cyclictest973658-21kworker/0:1+events22:22:280
91574799204210,2028cyclictest997287-21kworker/0:0+events23:44:080
91574799204010,2027cyclictest992586-21kworker/0:1+events23:22:010
91574799203411,2020cyclictest1010556-21kworker/0:0+events00:09:190
9157479920338,2021cyclictest1010556-21kworker/0:0+events00:19:370
91574799202510,2012cyclictest948097-21kworker/0:0+events20:58:470
91575399202010,2007cyclictest998887-21kworker/2:1+events23:43:232
9157519920129,2000cyclictest944748-21kworker/1:0+events21:11:221
9157479920097,1999cyclictest915507-21kworker/0:0+events19:15:060
91574799200510,1992cyclictest990868-21kworker/0:2+events23:16:160
9157579920035,1995cyclictest910502-21kworker/3:2+events19:13:143
91574799200311,1989cyclictest939967-21kworker/0:1+events20:45:230
91574799199811,1984cyclictest939967-21kworker/0:1+events20:23:370
91574799199810,1985cyclictest951275-21kworker/0:1+events21:05:430
9157519919859,1973cyclictest954598-21kworker/1:2+events21:21:171
91575399198410,1971cyclictest911382-21kworker/2:1+events19:25:392
91575399198310,1969cyclictest957533-21kworker/2:1+events21:24:232
9157519919828,1971cyclictest912315-21kworker/1:1+events19:13:381
9157479919735,1965cyclictest920519-21kworker/0:1+events19:32:320
9157539919715,1963cyclictest917346-21kworker/2:2+events19:17:442
9157539919627,1952cyclictest927460-21kworker/2:3+events19:59:052
9157479919628,1951cyclictest955893-21kworker/0:0+events21:22:500
9157479919619,1949cyclictest990868-21kworker/0:2+events23:10:560
91574799195010,1937cyclictest997287-21kworker/0:0+events23:27:440
91574799194710,1934cyclictest1010556-21kworker/0:0+events00:28:240
9157479919406,1931cyclictest998921-21kworker/0:2+events23:30:280
9157539919059,1893cyclictest911382-21kworker/2:1+events19:12:292
9157479919048,1893cyclictest929206-21kworker/0:2+events19:54:350
9157479918819,1869cyclictest907040-21kworker/0:1+events19:12:070
9157479918809,1868cyclictest973658-21kworker/0:1+events22:19:020
9153582155111,25sleep00-21swapper/019:07:230
9153182151113,33sleep20-21swapper/219:06:532
9155252146107,23sleep30-21swapper/319:09:313
9151972143113,24sleep10-21swapper/119:05:201
91574799209,7cyclictest989637-21perf23:00:000
915747992010,8cyclictest1009463-21irqstats00:00:140
91574799196,10cyclictest983323-21tr22:40:000
915747991916,2cyclictest689-21gmain21:55:000
915747991710,5cyclictest960909-21awk21:30:000
91574799166,6cyclictest355-21systemd-journal20:04:130
915747991613,2cyclictest0-21swapper/020:00:000
915747991610,4cyclictest739-21runrttasks23:47:230
91574799160,15cyclictest1007528-21/usr/sbin/munin23:55:230
91574799146,5cyclictest698-21ntpd20:25:190
91574799136,6cyclictest0-21swapper/021:45:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional