You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 23:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Thu Jan 01, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
84455499587525,5846cyclictest844348-21kworker/2:1+events19:11:572
84454799574219,5719cyclictest844112-21kworker/0:0+events19:11:330
84455299569826,5668cyclictest831820-21kworker/1:1+events19:11:111
8445579928159,2803cyclictest843772-21kworker/3:1+events19:12:443
84454799276713,2751cyclictest926534-21kworker/0:0+events23:25:350
84455499274813,2730cyclictest910748-21kworker/2:1+events22:50:122
84455299269314,2675cyclictest851127-21kworker/1:0+events19:30:171
84454799264112,2625cyclictest910467-21kworker/0:1+events22:35:160
84454799262413,2608cyclictest873490-21kworker/0:1+events20:40:160
84455299251612,2501cyclictest869005-21kworker/1:1+events20:35:191
84455499248012,2466cyclictest860555-21kworker/2:0+events20:05:162
84455299240212,2386cyclictest934539-21kworker/1:1+events00:10:151
84455799239212,2375cyclictest894902-21kworker/3:0+events22:00:123
84455299234311,2328cyclictest875116-21kworker/1:2+events20:45:121
84455799232812,2314cyclictest941837-21kworker/3:0+events00:15:123
84455799231112,2295cyclictest887046-21kworker/3:2+events21:23:243
84455299231011,2295cyclictest854904-21kworker/1:2+events19:45:121
8445479922708,2259cyclictest921956-21kworker/0:1+events23:33:360
84455799226810,2255cyclictest898351-21kworker/3:2+events22:22:423
8445549922429,2230cyclictest896420-21kworker/2:1+events21:52:082
8445579922357,2225cyclictest940235-21kworker/3:2+events00:08:443
84455299223511,2220cyclictest943505-21kworker/1:0+events00:28:091
84455299222310,2210cyclictest925177-21kworker/1:2+events23:35:271
84455299222211,2209cyclictest865375-21kworker/1:2+events20:20:001
84455299221811,2204cyclictest934539-21kworker/1:1+events00:06:281
8445529922179,2205cyclictest851127-21kworker/1:0+events19:35:151
84455499221411,2200cyclictest849348-21kworker/2:1+events19:34:292
84455299218810,2175cyclictest909146-21kworker/1:0+events22:36:451
84455799216710,2154cyclictest945163-21kworker/3:1+events00:34:383
8445529921678,2156cyclictest934539-21kworker/1:1+events23:49:521
84455299213611,2122cyclictest891266-21kworker/1:1+events21:34:311
8445479921328,2121cyclictest852435-21kworker/0:1+events19:34:050
8445579921307,2120cyclictest863888-21kworker/3:0+events20:16:163
84454799211810,2105cyclictest918602-21kworker/0:0+events23:05:340
8445579921179,2104cyclictest893252-21kworker/3:1+events21:40:183
8445529921179,2105cyclictest880053-21kworker/1:0+events21:05:291
84454799211610,2102cyclictest889689-21kworker/0:2+events21:27:360
8445479921159,2102cyclictest875180-21kworker/0:2+events20:58:080
8445479921139,2102cyclictest905947-21kworker/0:1+events22:20:050
84454799211310,2100cyclictest868915-21kworker/0:0+events20:38:230
8445479921117,2101cyclictest921956-21kworker/0:1+events23:38:080
8445549921097,2100cyclictest912336-21kworker/2:0+events22:41:262
8445479921099,2097cyclictest931553-21kworker/0:2+events00:13:390
8445479921096,2099cyclictest902677-21kworker/0:0+events22:18:100
84455299210410,2092cyclictest880053-21kworker/1:0+events21:00:061
8445479921046,2094cyclictest920295-21kworker/0:2+events23:02:530
8445479921039,2090cyclictest923674-21kworker/0:2+events23:18:020
84454799210110,2088cyclictest886794-21kworker/0:1+events21:23:460
84454799209910,2086cyclictest926534-21kworker/0:0+events23:22:300
84454799209810,2085cyclictest878258-21kworker/0:1+events20:52:030
8445479920974,2090cyclictest868915-21kworker/0:0+events20:23:250
8445549920928,2082cyclictest946582-21kworker/2:2+events00:30:042
84454799209210,2079cyclictest913890-21kworker/0:1+events22:45:580
84454799209210,2079cyclictest891445-21kworker/0:1+events22:07:470
8445529920862,2080cyclictest853004-21kworker/1:1+events20:03:201
8445479920808,2069cyclictest891445-21kworker/0:1+events21:56:450
8445579920768,2065cyclictest867345-21kworker/3:2+events20:21:553
84454799207610,2063cyclictest860347-21kworker/0:2+events19:56:550
84454799207310,2060cyclictest946642-21kworker/0:1+events00:29:180
8445549920729,2060cyclictest858772-21kworker/2:2+events19:55:002
8445479920718,2060cyclictest883171-21kworker/0:2+events21:08:320
84454799206910,2056cyclictest857549-21kworker/0:0+events20:06:260
84455299206610,2053cyclictest899600-21kworker/1:1+events22:18:331
84455499206511,2050cyclictest857145-21kworker/2:1+events19:48:552
8445479920658,2054cyclictest931553-21kworker/0:2+events00:16:230
84455799206310,2050cyclictest859542-21kworker/3:1+events20:01:063
8445549920597,2049cyclictest940089-21kworker/2:0+events00:19:512
8445549920589,2046cyclictest907277-21kworker/2:1+events22:23:512
84455799205710,2044cyclictest907424-21kworker/3:0+events22:34:333
8445579920566,2047cyclictest921899-21kworker/3:1+events23:21:443
84455799205610,2043cyclictest913684-21kworker/3:0+events22:45:153
8445549920558,2044cyclictest867150-21kworker/2:1+events20:19:382
84455499205510,2042cyclictest883400-21kworker/2:2+events21:15:242
84455499205310,2040cyclictest929830-21kworker/2:2+events23:47:392
8445479920533,2047cyclictest912172-21kworker/0:0+events22:40:390
8445579920527,2042cyclictest870427-21kworker/3:1+events20:29:073
8445579920519,2039cyclictest913684-21kworker/3:0+events22:56:443
8445479920517,2041cyclictest891445-21kworker/0:1+events22:04:010
84455799205010,2037cyclictest940235-21kworker/3:2+events00:22:313
84455799205010,2037cyclictest884921-21kworker/3:0+events21:15:473
84455799205010,2037cyclictest881625-21kworker/3:0+events21:06:163
8445549920507,2040cyclictest940089-21kworker/2:0+events00:11:232
8445479920509,2038cyclictest883171-21kworker/0:2+events21:12:440
84454799204810,2035cyclictest944952-21kworker/0:0+events00:37:400
8445579920479,2035cyclictest898351-21kworker/3:2+events21:55:573
8445579920474,2040cyclictest855844-21kworker/3:0+events19:49:403
84455799204710,2034cyclictest928106-21kworker/3:2+events23:32:023
8445549920478,2036cyclictest901225-21kworker/2:1+events22:13:352
84455799204610,2033cyclictest867345-21kworker/3:2+events20:49:013
84455499204610,2033cyclictest910748-21kworker/2:1+events22:39:522
8445479920469,2034cyclictest904285-21kworker/0:2+events22:31:060
8445479920469,2034cyclictest857549-21kworker/0:0+events19:53:500
8445479920468,2034cyclictest902677-21kworker/0:0+events22:13:120
8445479920466,2037cyclictest868915-21kworker/0:0+events20:29:300
84455799204510,2032cyclictest939555-21kworker/3:0+events00:02:413
8445579920449,2032cyclictest863888-21kworker/3:0+events20:10:353
8445549920447,2034cyclictest929830-21kworker/2:2+events23:38:552
84455499204410,2031cyclictest891356-21kworker/2:2+events21:39:072
84455499204410,2031cyclictest876987-21kworker/2:0+events21:11:332
8445479920443,2038cyclictest862289-21kworker/0:1+events20:04:540
8445579920438,2032cyclictest847688-21kworker/3:0+events19:31:483
84455799204310,2030cyclictest902556-21kworker/3:0+events22:07:243
8445549920439,2031cyclictest922195-21kworker/2:0+events23:17:172
84454799204310,2030cyclictest866974-21kworker/0:1+events20:18:100
84455799204210,2029cyclictest894902-21kworker/3:0+events21:53:413
8445549920428,2032cyclictest881716-21kworker/2:1+events21:05:082
8445529920428,2031cyclictest934539-21kworker/1:1+events00:01:311
8445529920426,2033cyclictest941779-21kworker/1:2+events00:23:371
8445479920428,2030cyclictest921956-21kworker/0:1+events23:41:340
8445579920417,2031cyclictest883289-21kworker/3:2+events21:13:533
84455799204110,2028cyclictest921899-21kworker/3:1+events23:08:353
8445479920414,2034cyclictest944952-21kworker/0:0+events00:34:160
84455799204010,2027cyclictest918666-21kworker/3:2+events23:00:123
84455799204010,2026cyclictest933172-21kworker/3:1+events23:48:233
8445549920408,2029cyclictest943569-21kworker/2:1+events00:27:462
8445549920407,2030cyclictest873553-21kworker/2:1+events20:38:012
84455299204010,2027cyclictest894755-21kworker/1:0+events21:53:171
84455799203910,2026cyclictest847688-21kworker/3:0+events19:17:173
8445549920398,2029cyclictest901225-21kworker/2:1+events22:05:072
8445529920395,2031cyclictest923499-21kworker/1:0+events23:17:411
8445529920395,2031cyclictest853004-21kworker/1:1+events19:54:131
8445529920394,2032cyclictest926801-21kworker/1:0+events23:25:121
8445479920394,2032cyclictest895200-21kworker/0:2+events21:47:050
8445479920393,2033cyclictest855902-21kworker/0:1+events19:47:510
8445479920392,2034cyclictest931553-21kworker/0:2+events23:52:270
8445529920389,2026cyclictest943505-21kworker/1:0+events00:32:461
8445529920383,2032cyclictest920173-21kworker/1:1+events23:23:401
8445479920389,2026cyclictest854072-21kworker/0:0+events19:39:060
8445479920379,2025cyclictest931553-21kworker/0:2+events23:58:540
8445479920379,2025cyclictest850829-21kworker/0:2+events19:44:480
8445579920367,2025cyclictest873790-21kworker/3:1+events21:03:113
8445479920369,2024cyclictest931553-21kworker/0:2+events00:23:590
8445479920368,2025cyclictest931553-21kworker/0:2+events00:01:080
84454799203610,2023cyclictest918602-21kworker/0:0+events23:12:030
84455799203510,2022cyclictest889626-21kworker/3:1+events21:28:213
8445479920359,2023cyclictest904285-21kworker/0:2+events22:26:080
8445479920359,2023cyclictest889689-21kworker/0:2+events21:34:100
8445479920359,2023cyclictest881534-21kworker/0:1+events21:03:350
8445579920349,2023cyclictest948069-21kworker/3:2+events00:36:323
8445579920336,2024cyclictest941837-21kworker/3:0+events00:26:373
84455499203310,2020cyclictest907277-21kworker/2:1+events22:25:442
8445529920339,2021cyclictest847812-21kworker/1:2+events19:29:321
84454799203310,2020cyclictest891445-21kworker/0:1+events21:39:550
8445529920326,2023cyclictest897966-21kworker/1:2+events21:58:161
8445479920308,2020cyclictest931553-21kworker/0:2+events00:09:530
84454799203010,2017cyclictest848280-21kworker/0:0+events19:25:420
8445549920297,2020cyclictest862766-21kworker/2:2+events20:45:362
84455799202810,2015cyclictest940235-21kworker/3:2+events00:12:553
84455499202810,2015cyclictest852703-21kworker/2:0+events19:42:302
8445579920278,2016cyclictest902556-21kworker/3:0+events22:15:533
84455299202710,2013cyclictest891266-21kworker/1:1+events21:42:311
84455799202610,2015cyclictest921899-21kworker/3:1+events23:15:283
8445529920268,2015cyclictest894755-21kworker/1:0+events21:48:171
84455299202610,2013cyclictest899600-21kworker/1:1+events22:20:291
8445529920259,2013cyclictest869005-21kworker/1:1+events20:34:081
8445529920258,2014cyclictest941779-21kworker/1:2+events00:19:041
84455299202510,2012cyclictest912081-21kworker/1:2+events22:47:071
8445579920233,2017cyclictest879997-21kworker/3:2+events20:58:553
8445549920239,2011cyclictest876987-21kworker/2:0+events20:56:372
8445529920238,2012cyclictest854904-21kworker/1:2+events19:43:151
8445529920228,2011cyclictest934539-21kworker/1:1+events23:53:151
8445529920209,2008cyclictest913744-21kworker/1:1+events22:54:001
8445549920198,2008cyclictest915251-21kworker/2:2+events22:49:032
8445549920194,2012cyclictest833261-21kworker/2:2+events19:18:482
8445529920198,2008cyclictest899600-21kworker/1:1+events22:08:331
8445579920183,2012cyclictest894902-21kworker/3:0+events21:45:563
8445529920187,2008cyclictest894755-21kworker/1:0+events22:03:371
84454799201710,2004cyclictest845885-21kworker/0:1+events19:23:260
8445479920169,2004cyclictest857549-21kworker/0:0+events20:13:140
8445529920144,2007cyclictest884592-21kworker/1:2+events21:11:121
8445579920139,2001cyclictest907424-21kworker/3:0+events22:28:253
8445549920117,2001cyclictest899326-21kworker/2:0+events21:57:072
84455299201110,1998cyclictest869005-21kworker/1:1+events20:42:331
8445479920118,2000cyclictest918602-21kworker/0:0+events22:57:520
8445479920117,2001cyclictest913890-21kworker/0:1+events22:52:070
8445529920106,2001cyclictest865375-21kworker/1:2+events20:17:251
84455499200810,1996cyclictest933230-21kworker/2:1+events00:05:432
8445479920079,1995cyclictest931553-21kworker/0:2+events23:46:530
84455299200510,1992cyclictest923499-21kworker/1:0+events23:13:111
84455499200210,1988cyclictest849348-21kworker/2:1+events19:37:592
8445529920019,1989cyclictest886195-21kworker/1:1+events21:19:571
8445579920005,1991cyclictest911990-21kworker/3:2+events22:40:143
8445579919993,1992cyclictest918666-21kworker/3:2+events23:14:403
84455799199810,1985cyclictest867345-21kworker/3:2+events20:40:403
84455499199810,1985cyclictest922195-21kworker/2:0+events23:26:432
8445529919985,1989cyclictest880053-21kworker/1:0+events21:24:111
8445529919978,1986cyclictest920173-21kworker/1:1+events23:09:221
84455299199610,1983cyclictest860496-21kworker/1:0+events19:59:111
8445549919958,1984cyclictest931491-21kworker/2:0+events23:43:042
8445549919947,1984cyclictest902858-21kworker/2:0+events22:19:412
8445479919934,1986cyclictest891445-21kworker/0:1+events21:50:370
8445579919926,1983cyclictest909051-21kworker/3:1+events22:35:383
8445549919929,1980cyclictest885188-21kworker/2:1+events21:25:422
8445579919906,1981cyclictest852496-21kworker/3:2+events19:37:353
8445549919909,1979cyclictest862766-21kworker/2:2+events20:31:482
8445579919893,1983cyclictest909051-21kworker/3:1+events22:51:443
8445479919899,1977cyclictest883171-21kworker/0:2+events21:17:200
8445549919888,1977cyclictest857145-21kworker/2:1+events20:01:482
84455499198610,1973cyclictest869189-21kworker/2:0+events20:27:142
8445549919832,1978cyclictest893282-21kworker/2:0+events21:42:542
8445579919829,1971cyclictest852496-21kworker/3:2+events19:40:593
8445579919827,1972cyclictest867345-21kworker/3:2+events20:33:213
8445579919808,1969cyclictest849496-21kworker/3:1+events19:29:553
8445579919807,1970cyclictest889626-21kworker/3:1+events21:30:413
8445579919807,1969cyclictest873790-21kworker/3:1+events20:52:243
84455799198010,1967cyclictest921899-21kworker/3:1+events23:25:583
8445549919809,1969cyclictest860555-21kworker/2:0+events20:12:042
8445549919807,1970cyclictest915251-21kworker/2:2+events22:55:102
8445579919799,1967cyclictest867345-21kworker/3:2+events20:39:323
8445579919799,1967cyclictest857470-21kworker/3:2+events19:51:543
8445549919799,1967cyclictest909114-21kworker/2:0+events22:30:452
8445549919789,1966cyclictest933230-21kworker/2:1+events23:50:352
8445579919769,1964cyclictest855844-21kworker/3:0+events19:59:353
8445579919769,1964cyclictest849496-21kworker/3:1+events19:24:343
8445549919767,1966cyclictest833261-21kworker/2:2+events19:26:042
84455499197610,1963cyclictest933230-21kworker/2:1+events23:58:092
8445529919768,1965cyclictest909146-21kworker/1:0+events22:32:381
8445579919759,1964cyclictest935007-21kworker/3:0+events23:50:583
8445579919758,1964cyclictest887046-21kworker/3:2+events21:38:443
8445579919758,1963cyclictest902556-21kworker/3:0+events22:11:153
8445549919759,1963cyclictest926622-21kworker/2:1+events23:23:172
8445549919759,1963cyclictest857145-21kworker/2:1+events19:58:502
8445579919748,1964cyclictest931520-21kworker/3:0+events23:40:033
8445579919747,1964cyclictest921899-21kworker/3:1+events23:35:493
8445549919745,1966cyclictest948247-21kworker/2:0+events00:35:462
84455499197410,1961cyclictest915251-21kworker/2:2+events23:06:422
8445529919748,1963cyclictest943505-21kworker/1:0+events00:35:241
8445579919737,1963cyclictest859542-21kworker/3:1+events20:05:393
84455499197310,1960cyclictest891356-21kworker/2:2+events21:48:412
8445529919727,1962cyclictest880053-21kworker/1:0+events21:36:051
8445549919706,1961cyclictest915251-21kworker/2:2+events23:04:502
8445529919709,1958cyclictest913744-21kworker/1:1+events22:43:221
8445529919709,1958cyclictest869005-21kworker/1:1+events20:26:041
8445579919697,1959cyclictest933172-21kworker/3:1+events23:55:543
8445549919698,1957cyclictest876987-21kworker/2:0+events21:04:222
8445529919692,1964cyclictest930870-21kworker/1:0+events23:43:501
84455299196710,1955cyclictest925177-21kworker/1:2+events23:32:241
84455299196710,1954cyclictest878408-21kworker/1:2+events20:53:551
8445529919662,1961cyclictest880053-21kworker/1:0+events21:25:191
8445479919659,1953cyclictest893346-21kworker/0:0+events21:43:410
8445529919649,1952cyclictest865375-21kworker/1:2+events20:14:001
8445529919639,1951cyclictest915463-21kworker/1:0+events22:58:151
8445529919639,1951cyclictest899600-21kworker/1:1+events22:27:171
8445529919618,1950cyclictest853004-21kworker/1:1+events20:09:031
8445529919616,1952cyclictest847812-21kworker/1:2+events19:24:111
8445529919599,1949cyclictest915463-21kworker/1:0+events23:00:351
8445529919592,1954cyclictest845707-21kworker/1:0+events19:17:391
8445529919589,1946cyclictest904194-21kworker/1:0+events22:12:471
8445549919549,1942cyclictest920507-21kworker/2:1+events23:10:542
8445479919547,1944cyclictest845885-21kworker/0:1+events19:16:520
8445529919539,1941cyclictest925177-21kworker/1:2+events23:57:441
84455499194410,1932cyclictest891356-21kworker/2:2+events22:04:242
8445549919409,1928cyclictest885188-21kworker/2:1+events21:33:002
8445549919359,1923cyclictest873553-21kworker/2:1+events20:51:382
8445549919329,1920cyclictest926622-21kworker/2:1+events23:32:482
8445479919208,1909cyclictest870515-21kworker/0:2+events20:32:120
8445549919168,1905cyclictest833261-21kworker/2:2+events19:21:522
8445529919139,1902cyclictest869005-21kworker/1:1+events20:55:061
8445549918999,1887cyclictest873553-21kworker/2:1+events20:41:242
8445479918618,1850cyclictest868915-21kworker/0:0+events20:46:210
8441472171141,25sleep00-21swapper/019:07:170
8441392146116,25sleep20-21swapper/219:07:112
8443462140109,25sleep10-21swapper/119:09:511
8443102138107,26sleep30-21swapper/319:09:243
844554991714,2cyclictest589-21cron00:05:002
84455499170,16cyclictest943977-21/usr/sbin/munin00:20:122
844554991512,2cyclictest584-21avahi-daemon20:20:012
844554991412,1cyclictest1440-21gnome-shell21:21:092
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional