You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 05:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Wed Dec 31, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3635659958850,5881cyclictest359538-21kworker/3:1+events19:12:033
36355599585724,5830cyclictest351956-21kworker/0:0+events19:11:400
36355999577318,5751cyclictest361804-21kworker/1:1+events19:12:241
36356599321912,3201cyclictest370449-21kworker/3:0+events19:35:013
36356199305915,3040cyclictest368336-21kworker/2:1+events19:55:002
36355999276510,2750cyclictest420535-21kworker/1:0+events22:05:161
36355999276413,2746cyclictest450728-21kworker/1:0+events00:25:191
36356599269012,2674cyclictest449796-21kworker/3:0+events23:45:213
36356599249714,2480cyclictest460676-21kworker/3:2+events00:20:013
36355999249212,2477cyclictest425286-21kworker/1:1+events22:35:151
36355999247112,2456cyclictest388384-21kworker/1:2+events20:30:221
3635619924409,2427cyclictest397649-21kworker/2:2+events21:00:172
36355999237711,2361cyclictest468773-21kworker/1:2+events00:35:131
36355999233212,2317cyclictest442459-21kworker/1:0+events23:15:141
36355999230811,2294cyclictest386762-21kworker/1:0+events20:22:021
3635599923048,2293cyclictest396101-21kworker/1:0+events20:51:071
3635659922479,2233cyclictest407807-21kworker/3:2+events21:39:323
36356599224511,2231cyclictest442640-21kworker/3:2+events23:22:523
36356199224311,2228cyclictest440851-21kworker/2:2+events23:10:162
36355999222710,2213cyclictest417281-21kworker/1:0+events21:56:091
36356599222611,2211cyclictest373708-21kworker/3:1+events19:44:283
36355599222611,2211cyclictest434475-21kworker/0:2+events22:51:290
36355599220111,2187cyclictest384974-21kworker/0:2+events20:45:200
36356599216810,2155cyclictest370449-21kworker/3:0+events19:38:003
36356599216211,2147cyclictest379975-21kworker/3:0+events20:05:123
3635619921599,2146cyclictest437805-21kworker/2:1+events23:02:112
3635599921369,2124cyclictest442459-21kworker/1:0+events23:13:201
3635619921259,2110cyclictest452205-21kworker/2:0+events00:13:322
36355999212310,2109cyclictest385125-21kworker/1:2+events20:18:131
3635599921169,2104cyclictest415661-21kworker/1:1+events21:53:301
36355999211510,2102cyclictest414060-21kworker/1:2+events21:46:251
36355999211410,2101cyclictest436235-21kworker/1:0+events22:54:131
36355999211410,2101cyclictest378090-21kworker/1:1+events19:59:311
3635599921136,2103cyclictest404795-21kworker/1:0+events21:22:291
3635599921129,2100cyclictest414060-21kworker/1:2+events21:43:231
36355999211010,2097cyclictest407569-21kworker/1:1+events21:30:211
3635599921088,2097cyclictest425286-21kworker/1:1+events22:44:151
3635599921086,2099cyclictest402887-21kworker/1:2+events21:19:251
3635599921086,2099cyclictest372021-21kworker/1:2+events19:47:551
36355999210810,2094cyclictest439613-21kworker/1:2+events23:06:011
36355999210710,2094cyclictest423563-21kworker/1:2+events22:14:481
3635599921066,2097cyclictest425286-21kworker/1:1+events22:27:161
36355999210610,2093cyclictest420535-21kworker/1:0+events22:15:111
36355999210610,2093cyclictest361804-21kworker/1:1+events19:33:531
3635599921058,2094cyclictest388384-21kworker/1:2+events20:48:491
36355999210410,2090cyclictest388384-21kworker/1:2+events20:38:261
3635599921038,2092cyclictest409201-21kworker/1:2+events21:29:361
36355999210310,2090cyclictest407569-21kworker/1:1+events21:35:211
36355999210310,2089cyclictest450728-21kworker/1:0+events00:18:281
36355999210310,2089cyclictest372021-21kworker/1:2+events19:42:341
3635599921028,2090cyclictest378090-21kworker/1:1+events19:52:231
36356599210111,2087cyclictest457030-21kworker/3:1+events00:08:133
3635599921018,2090cyclictest453956-21kworker/1:1+events23:52:151
3635599921008,2088cyclictest460350-21kworker/1:1+events00:09:011
36355999210010,2087cyclictest379943-21kworker/1:2+events20:05:581
36355999209910,2086cyclictest423563-21kworker/1:2+events22:24:371
36355999209910,2086cyclictest399658-21kworker/1:0+events21:04:301
3635599920965,2088cyclictest386762-21kworker/1:0+events20:29:351
3635599920948,2083cyclictest447551-21kworker/1:2+events23:48:001
36355999209210,2079cyclictest436235-21kworker/1:0+events23:03:201
3635659920818,2070cyclictest442640-21kworker/3:2+events23:36:333
3635559920725,2064cyclictest384974-21kworker/0:2+events20:41:540
36356199206810,2055cyclictest423502-21kworker/2:1+events22:29:342
3635599920677,2057cyclictest455590-21kworker/1:2+events00:01:241
3635599920529,2040cyclictest466788-21kworker/1:1+events00:30:121
3635659920519,2039cyclictest421865-21kworker/3:1+events22:07:323
3635599920509,2038cyclictest434599-21kworker/1:2+events22:57:371
36355999205010,2037cyclictest368460-21kworker/1:2+events19:27:211
36356599204910,2036cyclictest376459-21kworker/3:2+events19:58:013
36356199204710,2034cyclictest402555-21kworker/2:1+events21:12:282
3635599920478,2035cyclictest447551-21kworker/1:2+events23:40:241
3635599920477,2037cyclictest383197-21kworker/1:1+events20:10:571
3635599920476,2038cyclictest361804-21kworker/1:1+events19:24:171
36356599204610,2033cyclictest376459-21kworker/3:2+events19:47:083
36356199204510,2032cyclictest428445-21kworker/2:2+events22:56:282
3635599920457,2035cyclictest379943-21kworker/1:2+events20:00:141
3635599920456,2037cyclictest447551-21kworker/1:2+events23:33:301
36355999204510,2032cyclictest397767-21kworker/1:1+events20:57:381
3635599920443,2038cyclictest465179-21kworker/1:2+events00:22:191
3635619920438,2032cyclictest452205-21kworker/2:0+events00:07:522
3635599920439,2031cyclictest425286-21kworker/1:1+events22:31:051
3635599920439,2031cyclictest402887-21kworker/1:2+events21:13:141
3635599920439,2031cyclictest361804-21kworker/1:1+events19:16:341
3635599920433,2036cyclictest445832-21kworker/1:1+events23:21:421
36356599204210,2029cyclictest460676-21kworker/3:2+events00:12:003
3635599920422,2036cyclictest445832-21kworker/1:1+events23:27:471
3635659920414,2034cyclictest453777-21kworker/3:2+events00:02:093
3635599920419,2029cyclictest401284-21kworker/1:1+events21:05:131
3635599920415,2033cyclictest394433-21kworker/1:1+events20:42:161
3635659920409,2028cyclictest436082-21kworker/3:2+events23:04:293
3635619920407,2031cyclictest378030-21kworker/2:2+events20:20:092
3635599920409,2028cyclictest418884-21kworker/1:2+events22:03:461
36355599204011,2026cyclictest404516-21kworker/0:0+events21:12:520
36356199203910,2026cyclictest404543-21kworker/2:0+events21:17:542
3635659920383,2032cyclictest401015-21kworker/3:0+events21:18:163
36356599203810,2024cyclictest453777-21kworker/3:2+events23:56:263
3635619920385,2030cyclictest428445-21kworker/2:2+events22:35:372
36356599203610,2023cyclictest463643-21kworker/3:1+events00:26:053
3635619920364,2029cyclictest378030-21kworker/2:2+events20:09:012
36356199203610,2023cyclictest392895-21kworker/2:0+events20:40:202
36355999203610,2023cyclictest445832-21kworker/1:1+events23:36:571
36356199203510,2021cyclictest407899-21kworker/2:1+events21:25:312
3635599920359,2023cyclictest425286-21kworker/1:1+events22:49:371
3635659920349,2022cyclictest453777-21kworker/3:2+events23:50:423
3635599920348,2023cyclictest455590-21kworker/1:2+events23:57:571
36356199203310,2020cyclictest452205-21kworker/2:0+events23:46:512
36356199203310,2020cyclictest431289-21kworker/2:0+events22:40:262
36356199203310,2020cyclictest368336-21kworker/2:1+events19:44:042
36356599203210,2019cyclictest439369-21kworker/3:0+events23:12:333
3635599920328,2021cyclictest370416-21kworker/1:0+events19:36:511
3635659920316,2022cyclictest468650-21kworker/3:2+events00:38:143
3635619920317,2021cyclictest463729-21kworker/2:1+events00:24:322
36356199203110,2018cyclictest402555-21kworker/2:1+events21:08:162
3635659920307,2020cyclictest421865-21kworker/3:1+events22:17:283
3635659920306,2021cyclictest366916-21kworker/3:1+events19:29:403
36356599203010,2017cyclictest407807-21kworker/3:2+events21:52:453
3635619920308,2019cyclictest378030-21kworker/2:2+events20:32:182
3635619920297,2019cyclictest468529-21kworker/2:0+events00:36:002
3635619920289,2016cyclictest452205-21kworker/2:0+events23:56:022
36356199202810,2015cyclictest452205-21kworker/2:0+events00:00:162
36356199202810,2014cyclictest381626-21kworker/2:1+events20:04:272
3635559920288,2017cyclictest426814-21kworker/0:2+events22:34:060
36355599202810,2014cyclictest384974-21kworker/0:2+events20:24:170
3635619920267,2016cyclictest428445-21kworker/2:2+events22:32:122
3635619920265,2018cyclictest394553-21kworker/2:1+events20:51:532
3635559920265,2018cyclictest466669-21kworker/0:0+events00:34:510
36356199202510,2011cyclictest465393-21kworker/2:2+events00:28:202
3635559920257,2015cyclictest391617-21kworker/0:0+events20:39:120
36355599202510,2012cyclictest370532-21kworker/0:1+events19:39:310
36356599202410,2011cyclictest463643-21kworker/3:1+events00:33:413
3635559920245,2017cyclictest388352-21kworker/0:0+events20:25:020
36356599202310,2011cyclictest381595-21kworker/3:1+events20:02:563
36356199202310,2010cyclictest368336-21kworker/2:1+events19:38:242
3635559920235,2015cyclictest441064-21kworker/0:0+events23:09:530
3635559920235,2015cyclictest384974-21kworker/0:2+events20:14:250
36356599202210,2009cyclictest428413-21kworker/3:0+events22:29:573
3635559920228,2011cyclictest376552-21kworker/0:1+events19:49:480
3635559920225,2014cyclictest441064-21kworker/0:0+events23:12:560
3635659920218,2010cyclictest428413-21kworker/3:0+events22:38:533
36356199202110,2008cyclictest446039-21kworker/2:1+events23:38:282
36356199202110,2008cyclictest414210-21kworker/2:2+events21:48:162
3635559920218,2010cyclictest412554-21kworker/0:1+events21:43:450
3635559920216,2012cyclictest450668-21kworker/0:1+events23:38:520
36356599202010,2007cyclictest364876-21kworker/3:0+events19:18:303
36355599202010,2007cyclictest418703-21kworker/0:2+events21:57:410
3635559920188,2007cyclictest466669-21kworker/0:0+events00:28:420
3635559920177,2007cyclictest437711-21kworker/0:0+events23:01:260
36355599201710,2004cyclictest439400-21kworker/0:1+events23:25:550
36355599201710,2004cyclictest420385-21kworker/0:1+events22:07:560
3635619920169,2004cyclictest440851-21kworker/2:2+events23:20:342
36356599201410,2001cyclictest388464-21kworker/3:1+events20:35:223
3635559920146,2006cyclictest452357-21kworker/0:2+events23:46:070
3635559920135,2006cyclictest374918-21kworker/0:0+events19:44:520
3635559920117,2001cyclictest384974-21kworker/0:2+events20:19:000
36355599201110,2000cyclictest366949-21kworker/0:0+events19:25:020
3635659920103,2004cyclictest428413-21kworker/3:0+events22:41:343
3635559920108,1999cyclictest406124-21kworker/0:1+events21:20:120
3635559920105,2002cyclictest425194-21kworker/0:0+events22:43:510
36356599200910,1996cyclictest406184-21kworker/3:1+events21:22:063
3635559920087,1998cyclictest383045-21kworker/0:0+events20:08:400
3635559920054,1998cyclictest456863-21kworker/0:0+events23:58:420
3635659920038,1992cyclictest407807-21kworker/3:2+events21:55:463
3635659920038,1992cyclictest396310-21kworker/3:1+events20:54:583
36355599200310,1990cyclictest421987-21kworker/0:0+events22:12:320
36356599200210,1989cyclictest394703-21kworker/3:0+events20:46:313
36355599200110,1988cyclictest425194-21kworker/0:0+events22:23:520
36356599199710,1984cyclictest383227-21kworker/3:2+events20:12:513
3635559919979,1985cyclictest409169-21kworker/0:2+events21:28:280
3635659919969,1984cyclictest442640-21kworker/3:2+events23:27:033
3635659919949,1982cyclictest396310-21kworker/3:1+events21:02:353
36356199199110,1978cyclictest428445-21kworker/2:2+events22:50:212
3635659919908,1979cyclictest449796-21kworker/3:0+events23:41:103
36356599199010,1977cyclictest392957-21kworker/3:2+events20:57:593
36356599199010,1977cyclictest392957-21kworker/3:2+events20:44:353
36356199199010,1977cyclictest388914-21kworker/2:1+events20:26:342
3635619919862,1981cyclictest394553-21kworker/2:1+events20:55:432
3635599919869,1974cyclictest450728-21kworker/1:0+events00:13:081
36356199198510,1972cyclictest421897-21kworker/2:0+events22:14:242
36355599198310,1970cyclictest409169-21kworker/0:2+events21:48:390
3635619919819,1969cyclictest368336-21kworker/2:1+events19:55:242
3635559919818,1970cyclictest404516-21kworker/0:0+events21:17:310
3635559919815,1973cyclictest389983-21kworker/0:1+events20:30:460
3635619919809,1968cyclictest406155-21kworker/2:2+events21:34:352
36355599198010,1967cyclictest412554-21kworker/0:1+events21:51:390
3635659919789,1966cyclictest383227-21kworker/3:2+events20:15:543
3635619919789,1967cyclictest423502-21kworker/2:1+events22:18:592
3635659919779,1965cyclictest428413-21kworker/3:0+events22:48:033
3635659919777,1967cyclictest376459-21kworker/3:2+events19:53:083
3635559919778,1966cyclictest452357-21kworker/0:2+events23:44:360
3635659919759,1963cyclictest401015-21kworker/3:0+events21:06:223
3635659919758,1963cyclictest364876-21kworker/3:0+events19:22:223
3635619919757,1964cyclictest414210-21kworker/2:2+events21:59:132
3635659919749,1964cyclictest421865-21kworker/3:1+events22:10:363
3635619919743,1968cyclictest410738-21kworker/2:0+events21:39:562
3635559919728,1961cyclictest384974-21kworker/0:2+events20:56:520
3635659919719,1959cyclictest428413-21kworker/3:0+events22:54:363
3635619919713,1965cyclictest385169-21kworker/2:1+events20:17:522
36356599197010,1957cyclictest439369-21kworker/3:0+events23:05:373
3635559919693,1963cyclictest449033-21kworker/0:0+events23:34:390
3635659919669,1954cyclictest440973-21kworker/3:1+events23:16:233
3635619919669,1954cyclictest368336-21kworker/2:1+events19:21:582
3635659919658,1954cyclictest426726-21kworker/3:2+events22:32:593
3635619919659,1953cyclictest423502-21kworker/2:1+events22:24:162
3635619919658,1954cyclictest378030-21kworker/2:2+events20:36:532
3635659919649,1952cyclictest412465-21kworker/3:1+events21:42:133
3635619919649,1952cyclictest468529-21kworker/2:0+events00:33:182
3635619919649,1952cyclictest452205-21kworker/2:0+events00:15:262
36356199196410,1951cyclictest446039-21kworker/2:1+events23:28:562
3635659919639,1951cyclictest463643-21kworker/3:1+events00:23:483
3635659919639,1951cyclictest407807-21kworker/3:2+events21:49:003
3635659919637,1953cyclictest407807-21kworker/3:2+events22:01:053
3635619919637,1953cyclictest435074-21kworker/2:0+events23:06:242
3635659919629,1949cyclictest401015-21kworker/3:0+events21:11:203
3635659919623,1956cyclictest401015-21kworker/3:0+events21:34:583
3635619919629,1950cyclictest415878-21kworker/2:0+events21:53:532
3635659919619,1948cyclictest421865-21kworker/3:1+events22:20:293
3635659919615,1953cyclictest401015-21kworker/3:0+events21:28:513
3635659919607,1950cyclictest388464-21kworker/3:1+events20:27:433
36356599196010,1947cyclictest436082-21kworker/3:2+events22:57:143
3635619919608,1949cyclictest452205-21kworker/2:0+events23:42:402
36356199196010,1947cyclictest364729-21kworker/2:0+events19:15:482
3635619919599,1947cyclictest404543-21kworker/2:0+events21:22:522
3635619919598,1948cyclictest368336-21kworker/2:1+events19:26:582
36356199195910,1946cyclictest392895-21kworker/2:0+events20:46:542
3635559919598,1948cyclictest468560-21kworker/0:2+events00:35:350
3635619919589,1946cyclictest447639-21kworker/2:0+events23:32:202
3635559919588,1947cyclictest423591-21kworker/0:2+events22:16:190
3635619919579,1946cyclictest414210-21kworker/2:2+events22:06:482
36356199195710,1944cyclictest368336-21kworker/2:1+events19:32:462
3635559919579,1945cyclictest458517-21kworker/0:1+events00:05:380
3635559919576,1948cyclictest462067-21kworker/0:1+events00:22:410
3635619919557,1945cyclictest412404-21kworker/2:1+events21:44:312
3635559919548,1943cyclictest374918-21kworker/0:0+events19:54:160
3635559919538,1942cyclictest397616-21kworker/0:0+events20:53:030
3635559919535,1945cyclictest444202-21kworker/0:2+events23:19:470
36355599195310,1940cyclictest366949-21kworker/0:0+events19:20:240
3635559919528,1941cyclictest452357-21kworker/0:2+events00:12:450
3635559919528,1941cyclictest425194-21kworker/0:0+events22:28:490
36355599195210,1939cyclictest434475-21kworker/0:2+events22:46:310
3635659919509,1938cyclictest388464-21kworker/3:1+events20:35:003
3635559919509,1939cyclictest431638-21kworker/0:1+events22:55:430
3635559919489,1936cyclictest425194-21kworker/0:0+events22:35:580
3635559919478,1936cyclictest380209-21kworker/0:2+events20:03:190
3635559919465,1939cyclictest366949-21kworker/0:0+events19:31:590
3635559919456,1936cyclictest409169-21kworker/0:2+events21:38:470
3635559919443,1938cyclictest452357-21kworker/0:2+events23:53:000
3635559919434,1936cyclictest399481-21kworker/0:1+events21:07:300
3635619919396,1931cyclictest378030-21kworker/2:2+events20:14:012
3635559919336,1924cyclictest452357-21kworker/0:2+events00:15:490
3635559919198,1908cyclictest399481-21kworker/0:1+events21:00:400
36355599191010,1897cyclictest376552-21kworker/0:1+events19:59:510
3635659918967,1886cyclictest386698-21kworker/3:0+events20:20:523
3635559918956,1886cyclictest415805-21kworker/0:0+events22:00:210
3635619918949,1884cyclictest440851-21kworker/2:2+events23:17:542
3635559918729,1860cyclictest452357-21kworker/0:2+events00:01:020
3635559918728,1861cyclictest364934-21kworker/0:2+events19:15:270
3635559918689,1856cyclictest409169-21kworker/0:2+events21:33:030
3635619918529,1840cyclictest375155-21kworker/2:0+events19:47:312
3635619918449,1832cyclictest361784-21kworker/2:2+events19:10:562
3635619918348,1823cyclictest452205-21kworker/2:0+events23:54:532
3635659918329,1820cyclictest447373-21kworker/3:1+events23:30:253
3631692165134,26sleep10-21swapper/119:07:011
36355599157154,2cyclictest439400-21kworker/0:1+pm23:24:590
3632932142106,22sleep00-21swapper/019:08:360
3631902142111,26sleep20-21swapper/219:07:182
3633902140109,26sleep30-21swapper/319:09:513
363561991913,4cyclictest434837-21grep22:50:002
363561991411,2cyclictest420406-21chrt22:02:402
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional