You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 19:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Wed Dec 03, 2025 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
85853599302815,3007cyclictest871968-21kworker/1:2+events20:15:181
85853399281413,2796cyclictest932065-21kworker/0:1+events23:05:010
85854299269813,2680cyclictest888950-21kworker/3:1+events20:45:143
85853999262812,2612cyclictest900345-21kworker/2:0+events21:25:132
85854299249712,2482cyclictest962513-21kworker/3:1+events00:37:573
85853599249412,2478cyclictest898580-21kworker/1:2+events21:15:181
8585359924758,2464cyclictest914756-21kworker/1:1+events22:20:141
85853599247411,2459cyclictest871968-21kworker/1:2+events19:57:381
85853999245812,2443cyclictest905089-21kworker/2:1+events21:36:212
8585339924489,2437cyclictest893842-21kworker/0:0+events21:10:010
85854299244112,2425cyclictest914701-21kworker/3:2+events22:15:193
85853999244112,2425cyclictest957505-21kworker/2:3+events00:37:342
85854299243812,2423cyclictest881149-21kworker/3:2+events20:40:203
85854299243812,2423cyclictest881149-21kworker/3:2+events20:40:193
85853399243812,2423cyclictest911309-21kworker/0:0+events22:10:210
85853399240812,2392cyclictest943325-21kworker/0:1+events23:39:580
85853599240310,2390cyclictest871968-21kworker/1:2+events20:23:401
85853599239912,2384cyclictest959203-21kworker/1:1+events00:25:201
85853599239411,2380cyclictest930363-21kworker/1:1+events22:55:471
8585359923929,2379cyclictest919180-21kworker/1:0+events22:19:531
85853399239010,2377cyclictest949420-21kworker/0:1+events00:02:070
85853599238812,2373cyclictest898580-21kworker/1:2+events21:12:181
85853599238711,2373cyclictest903330-21kworker/1:1+events21:31:421
85853599238411,2370cyclictest940146-21kworker/1:0+events23:24:501
85853399236512,2350cyclictest880931-21kworker/0:1+events20:27:280
85854299236112,2346cyclictest866619-21kworker/3:0+events19:48:063
85853599235312,2338cyclictest898580-21kworker/1:2+events21:26:221
85854299234011,2326cyclictest938330-21kworker/3:0+events23:25:133
85854299233912,2324cyclictest960852-21kworker/3:2+events00:34:093
85854299233812,2323cyclictest901732-21kworker/3:2+events21:24:533
85853599233110,2318cyclictest896713-21kworker/1:0+events21:09:391
85853999232810,2315cyclictest951081-21kworker/2:2+events23:57:532
85853399232512,2309cyclictest908080-21kworker/0:0+events21:42:050
85853599229912,2284cyclictest945330-21kworker/1:0+events23:44:541
85854299229810,2285cyclictest938330-21kworker/3:0+events23:19:513
85853599226612,2251cyclictest909890-21kworker/1:1+events21:51:311
85853399226511,2250cyclictest954365-21kworker/0:0+events00:08:130
8585429922535,2245cyclictest954248-21kworker/3:0+events00:12:253
85853599224411,2230cyclictest928699-21kworker/1:2+events22:47:451
8585339922449,2232cyclictest888918-21kworker/0:2+events21:32:050
85853399224112,2225cyclictest920895-21kworker/0:1+events22:39:200
85853399224010,2227cyclictest890551-21kworker/0:1+events20:57:460
85853399223810,2225cyclictest935793-21kworker/0:2+events23:13:470
85853599223011,2215cyclictest885139-21kworker/1:2+events20:31:591
85853599222511,2211cyclictest932166-21kworker/1:0+events23:02:221
85853399222511,2210cyclictest914671-21kworker/0:2+events22:09:350
85853999222111,2207cyclictest878134-21kworker/2:2+events20:51:402
85853399222111,2208cyclictest957615-21kworker/0:2+events00:20:020
85853399222111,2207cyclictest909709-21kworker/0:1+events21:48:300
85853399222011,2206cyclictest933686-21kworker/0:0+events23:09:330
85853399221610,2203cyclictest928790-21kworker/0:2+events22:54:160
85853999221510,2201cyclictest873063-21kworker/2:2+events19:56:322
85853399221411,2200cyclictest869626-21kworker/0:2+events19:45:290
85853399221410,2201cyclictest880931-21kworker/0:1+events20:33:520
85853999220910,2195cyclictest878134-21kworker/2:2+events20:27:042
85853399220110,2188cyclictest863185-21kworker/0:2+events19:23:380
85853399219911,2186cyclictest888918-21kworker/0:2+events21:35:110
85853399219910,2186cyclictest893842-21kworker/0:0+events21:05:480
85853599219511,2181cyclictest959203-21kworker/1:1+events00:30:461
8585429921939,2181cyclictest918115-21kworker/3:1+events22:20:373
85853399219010,2176cyclictest893842-21kworker/0:0+events21:04:190
8585429921889,2175cyclictest866619-21kworker/3:0+events19:35:393
85853599218810,2175cyclictest930363-21kworker/1:1+events22:53:521
85853599218710,2171cyclictest871968-21kworker/1:2+events20:06:131
85853599218610,2173cyclictest912769-21kworker/1:0+events22:03:301
85853599218510,2171cyclictest906527-21kworker/1:2+events21:49:161
8585359921849,2172cyclictest922499-21kworker/1:0+events22:31:421
85853599218411,2170cyclictest940146-21kworker/1:0+events23:29:471
8585359921839,2172cyclictest888888-21kworker/1:0+events20:50:081
85853399218311,2169cyclictest864784-21kworker/0:0+events19:36:450
8585359921827,2171cyclictest941840-21kworker/1:2+events23:57:301
85853599218211,2167cyclictest954183-21kworker/1:0+events00:13:591
85853599218210,2169cyclictest924292-21kworker/1:1+events22:38:571
85853399218211,2168cyclictest920895-21kworker/0:1+events22:24:030
85853599218011,2165cyclictest865052-21kworker/1:1+events19:39:471
85853599218010,2167cyclictest954183-21kworker/1:0+events00:23:471
8585339921807,2169cyclictest898608-21kworker/0:1+events21:16:480
8585339921789,2166cyclictest938370-21kworker/0:0+events23:19:050
85853599217710,2164cyclictest887210-21kworker/1:1+events20:46:441
85853599217511,2161cyclictest871968-21kworker/1:2+events19:53:071
85853599217311,2158cyclictest896713-21kworker/1:0+events21:20:161
85853599217111,2157cyclictest941840-21kworker/1:2+events00:00:121
8585429921708,2159cyclictest931941-21kworker/3:2+events23:04:133
85853599216610,2153cyclictest906527-21kworker/1:2+events21:40:321
85853399216610,2153cyclictest909709-21kworker/0:1+events21:50:480
85854299216511,2151cyclictest903362-21kworker/3:1+events21:37:293
85853399216411,2150cyclictest960883-21kworker/0:0+events00:30:230
85853999216310,2150cyclictest936888-21kworker/2:2+events23:15:182
85853999215911,2145cyclictest920803-21kworker/2:1+events22:25:112
85853599215810,2144cyclictest930363-21kworker/1:1+events23:11:531
85853999215511,2141cyclictest865084-21kworker/2:1+events19:33:482
85853999215311,2139cyclictest940236-21kworker/2:2+events23:43:002
85853999215311,2139cyclictest933763-21kworker/2:0+events23:06:092
85853999215310,2140cyclictest957505-21kworker/2:3+events00:23:032
85853999215211,2137cyclictest928608-21kworker/2:1+events22:51:112
85853999215210,2139cyclictest863362-21kworker/2:0+events19:24:432
85853999215010,2137cyclictest902296-21kworker/2:2+events21:43:142
85853999214910,2136cyclictest911280-21kworker/2:2+events22:07:422
85854299214410,2131cyclictest949817-21kworker/3:2+events00:04:463
85853999214211,2128cyclictest878134-21kworker/2:2+events20:49:462
85854299214111,2127cyclictest938330-21kworker/3:0+events23:38:293
85854299214111,2127cyclictest866619-21kworker/3:0+events19:43:103
85854299214111,2126cyclictest954248-21kworker/3:0+events00:26:553
85853999214111,2126cyclictest887180-21kworker/2:0+events20:44:512
85853999214111,2126cyclictest887180-21kworker/2:0+events20:44:512
85853999214010,2127cyclictest906755-21kworker/2:0+events21:45:292
85854299213911,2125cyclictest874929-21kworker/3:1+events20:09:143
85854299213811,2124cyclictest952647-21kworker/3:1+events00:09:003
85854299213810,2125cyclictest893957-21kworker/3:0+events21:11:093
85853399213810,2125cyclictest853108-21kworker/0:1+events19:18:140
85854299213611,2122cyclictest943355-21kworker/3:2+events23:45:173
85853999213611,2122cyclictest919149-21kworker/2:2+events22:22:082
85853399213611,2122cyclictest874696-21kworker/0:0+events20:02:290
85854299213511,2122cyclictest893957-21kworker/3:0+events21:30:313
85853599213210,2119cyclictest917517-21kworker/1:2+events22:11:301
85854299213111,2117cyclictest935646-21kworker/3:1+events23:13:253
85854299213111,2117cyclictest908202-21kworker/3:2+events21:43:593
85854299213111,2117cyclictest874929-21kworker/3:1+events20:13:483
85854299213111,2116cyclictest923895-21kworker/3:0+events22:35:543
85854299213011,2116cyclictest954248-21kworker/3:0+events00:21:323
8585399921309,2119cyclictest947876-21kworker/2:0+events00:00:352
85853399213010,2117cyclictest871521-21kworker/0:1+events19:52:420
85854299212911,2115cyclictest881149-21kworker/3:2+events20:38:513
85854299212911,2115cyclictest881149-21kworker/3:2+events20:38:513
85854299212910,2116cyclictest943355-21kworker/3:2+events23:41:523
85853999212911,2115cyclictest902296-21kworker/2:2+events21:33:372
85853999212910,2116cyclictest914519-21kworker/2:0+events22:14:552
85854299212810,2115cyclictest890639-21kworker/3:0+events20:51:173
85854299212711,2114cyclictest881149-21kworker/3:2+events20:20:163
8585359921274,2120cyclictest912769-21kworker/1:0+events22:05:451
85853999212510,2112cyclictest882526-21kworker/2:1+events20:30:502
85853999212411,2110cyclictest893781-21kworker/2:2+events21:03:552
8585359921227,2112cyclictest881117-21kworker/1:1+events20:27:511
85854299211810,2105cyclictest918115-21kworker/3:1+events22:31:203
85854299211611,2102cyclictest884038-21kworker/3:0+events20:28:133
85854299211511,2101cyclictest938330-21kworker/3:0+events23:22:093
85854299211411,2100cyclictest941752-21kworker/3:1+events23:30:573
8585359921149,2102cyclictest930363-21kworker/1:1+events23:06:331
85853599211410,2101cyclictest941840-21kworker/1:2+events23:37:191
85854299211210,2099cyclictest927154-21kworker/3:0+events22:47:243
85853399211110,2098cyclictest939994-21kworker/0:1+events23:26:220
85854299210710,2093cyclictest946366-21kworker/3:1+events23:53:173
85854299209610,2083cyclictest901732-21kworker/3:2+events21:25:353
85853999209210,2079cyclictest869514-21kworker/2:0+events19:46:582
8585339920869,2074cyclictest952735-21kworker/0:2+events00:11:420
85854299208110,2068cyclictest909860-21kworker/3:1+events22:03:083
85853599208111,2067cyclictest954183-21kworker/1:0+events00:09:231
8585339920769,2063cyclictest946721-21kworker/0:0+events23:49:040
85853399207610,2063cyclictest959272-21kworker/0:1+events00:28:280
8585429920739,2061cyclictest888950-21kworker/3:1+events20:58:093
85854299207310,2060cyclictest909860-21kworker/3:1+events21:54:133
85853399207210,2059cyclictest946721-21kworker/0:0+events23:58:150
85853399207210,2059cyclictest885847-21kworker/0:0+events20:35:220
85853399207210,2059cyclictest885847-21kworker/0:0+events20:35:220
85853399207010,2057cyclictest949420-21kworker/0:1+events23:51:230
8585359920697,2059cyclictest941840-21kworker/1:2+events23:47:571
85853599206811,2053cyclictest887210-21kworker/1:1+events20:37:181
85853599206811,2053cyclictest887210-21kworker/1:1+events20:37:171
8585339920688,2057cyclictest935793-21kworker/0:2+events23:24:040
85853399206610,2053cyclictest956003-21kworker/0:1+events00:17:020
8585429920659,2053cyclictest914701-21kworker/3:2+events22:13:013
8585339920658,2053cyclictest901941-21kworker/0:1+events21:27:540
85853399206510,2052cyclictest869626-21kworker/0:2+events19:57:590
85853399206510,2052cyclictest864784-21kworker/0:0+events19:42:020
8585339920638,2052cyclictest864784-21kworker/0:0+events19:31:330
8585339920637,2053cyclictest888918-21kworker/0:2+events20:43:200
8585339920637,2053cyclictest888918-21kworker/0:2+events20:43:200
8585429920629,2049cyclictest949817-21kworker/3:2+events23:55:143
85854299206210,2051cyclictest911461-21kworker/3:0+events21:55:003
8585339920629,2050cyclictest876343-21kworker/0:1+events20:05:290
8585339920626,2053cyclictest919121-21kworker/0:2+events22:17:590
8585339920624,2055cyclictest885847-21kworker/0:0+events20:46:210
8585339920616,2052cyclictest890551-21kworker/0:1+events20:52:020
85853399206110,2048cyclictest930455-21kworker/0:0+events22:56:110
8585339920606,2051cyclictest957615-21kworker/0:2+events00:37:110
8585339920596,2050cyclictest888918-21kworker/0:2+events21:56:330
8585339920595,2051cyclictest943325-21kworker/0:1+events23:34:430
8585339920584,2051cyclictest922663-21kworker/0:0+events22:34:440
85853399205810,2045cyclictest919121-21kworker/0:2+events22:25:570
8585399920578,2045cyclictest922530-21kworker/2:0+events22:40:302
8585339920557,2045cyclictest920895-21kworker/0:1+events22:44:200
8585339920549,2042cyclictest864784-21kworker/0:0+events19:26:160
8585359920489,2036cyclictest869868-21kworker/1:0+events19:45:511
8585359920475,2038cyclictest890521-21kworker/1:2+events21:00:261
85853599204710,2034cyclictest906527-21kworker/1:2+events21:58:551
85853599204510,2032cyclictest954183-21kworker/1:0+events00:15:531
8585359920426,2033cyclictest869868-21kworker/1:0+events20:04:431
8585339920397,2029cyclictest882557-21kworker/0:0+events20:24:020
8585359920372,2032cyclictest863454-21kworker/1:0+events19:27:251
8585359920328,2021cyclictest938490-21kworker/1:2+events23:18:411
85853599203210,2019cyclictest940146-21kworker/1:0+events23:32:261
8585359920296,2020cyclictest962129-21kworker/1:2+events00:36:271
8585359920287,2017cyclictest906527-21kworker/1:2+events21:37:531
8585359920259,2013cyclictest892358-21kworker/1:1+events20:58:311
8585359920257,2015cyclictest871968-21kworker/1:2+events20:13:271
85853599202510,2012cyclictest859719-21kworker/1:2+events19:24:011
8585359920239,2011cyclictest924292-21kworker/1:1+events22:40:541
8585359920219,2008cyclictest859719-21kworker/1:2+events19:17:041
8585359920218,2009cyclictest914756-21kworker/1:1+events22:26:211
85854299201411,2000cyclictest871429-21kworker/3:2+events19:53:273
8585399920149,2003cyclictest865084-21kworker/2:1+events20:10:222
85853999201310,2000cyclictest878134-21kworker/2:2+events20:21:462
8585359920139,2001cyclictest866677-21kworker/1:2+events19:41:171
85853999200710,1994cyclictest922530-21kworker/2:0+events22:35:302
8585399920069,1994cyclictest912871-21kworker/2:1+events21:59:392
8585399920069,1994cyclictest906755-21kworker/2:0+events21:51:552
85853999200610,1993cyclictest861733-21kworker/2:2+events19:37:072
85853999200410,1992cyclictest859690-21kworker/2:1+events19:14:232
8585359920044,1996cyclictest865052-21kworker/1:1+events19:32:181
8585399920034,1996cyclictest892179-21kworker/2:0+events20:56:372
8585339920039,1991cyclictest927186-21kworker/0:0+events22:45:290
8585429920018,1990cyclictest892268-21kworker/3:2+events21:04:403
8585399920007,1990cyclictest917548-21kworker/2:1+events22:15:422
8585399920005,1991cyclictest900345-21kworker/2:0+events21:19:322
85853999200010,1987cyclictest865084-21kworker/2:1+events20:06:352
8585339920009,1988cyclictest888918-21kworker/0:2+events21:20:390
8585399919979,1985cyclictest878134-21kworker/2:2+events20:35:462
8585399919979,1985cyclictest878134-21kworker/2:2+events20:35:452
8585399919979,1985cyclictest861733-21kworker/2:2+events19:19:012
8585399919974,1990cyclictest873063-21kworker/2:2+events20:00:582
85853999199710,1984cyclictest960823-21kworker/2:1+events00:31:072
85853999199710,1984cyclictest925838-21kworker/2:2+events22:45:512
85854299199610,1983cyclictest918115-21kworker/3:1+events22:28:163
8585399919965,1988cyclictest911280-21kworker/2:2+events22:00:032
85853999199510,1982cyclictest954430-21kworker/2:0+events00:12:502
8585339919956,1986cyclictest880931-21kworker/0:1+events20:18:240
85854299199310,1980cyclictest881149-21kworker/3:2+events20:34:133
85853999199310,1980cyclictest869514-21kworker/2:0+events19:43:552
8585399919928,1981cyclictest896775-21kworker/2:1+events21:13:252
8585359919927,1982cyclictest885139-21kworker/1:2+events20:41:061
8585359919927,1982cyclictest885139-21kworker/1:2+events20:41:061
8585429919879,1975cyclictest879326-21kworker/3:0+events20:15:423
85853999198710,1974cyclictest957505-21kworker/2:3+events00:29:142
8585429919867,1976cyclictest866619-21kworker/3:0+events20:00:123
85854299198610,1973cyclictest908202-21kworker/3:2+events21:48:533
8585399919865,1978cyclictest896775-21kworker/2:1+events21:23:192
85854299198510,1973cyclictest893957-21kworker/3:0+events21:05:253
8585429919847,1974cyclictest927154-21kworker/3:0+events22:56:573
8585399919849,1971cyclictest938553-21kworker/2:0+events23:26:442
8585399919836,1974cyclictest938553-21kworker/2:0+events23:36:122
85853999198310,1970cyclictest951081-21kworker/2:2+events00:08:352
85853999198310,1970cyclictest892179-21kworker/2:0+events21:09:152
8585429919827,1972cyclictest863393-21kworker/3:2+events19:30:273
8585339919829,1970cyclictest877996-21kworker/0:0+events20:11:540
8585429919819,1969cyclictest925527-21kworker/3:2+events22:51:583
8585429919816,1972cyclictest893957-21kworker/3:0+events21:17:353
8585429919815,1973cyclictest871429-21kworker/3:2+events19:55:453
85854299198010,1967cyclictest927154-21kworker/3:0+events22:44:443
8585399919809,1969cyclictest946279-21kworker/2:1+events23:46:022
8585399919787,1968cyclictest947876-21kworker/2:0+events23:52:552
8585359919769,1964cyclictest858026-21kworker/1:1+events19:12:081
85854299197310,1960cyclictest914701-21kworker/3:2+events22:06:313
85854299197210,1959cyclictest863393-21kworker/3:2+events19:24:213
85854299197110,1958cyclictest852984-21kworker/3:2+events19:13:173
8585429919708,1959cyclictest863393-21kworker/3:2+events19:28:313
85853999196610,1953cyclictest928608-21kworker/2:1+events23:12:172
85853999196310,1949cyclictest931972-21kworker/2:2+events22:59:172
8585399919578,1946cyclictest920803-21kworker/2:1+events22:30:332
85853999194410,1931cyclictest938553-21kworker/2:0+events23:21:452
8585359919399,1927cyclictest949658-21kworker/1:0+events23:54:271
85853999193710,1924cyclictest931972-21kworker/2:2+events23:03:062
8585399919349,1922cyclictest951081-21kworker/2:2+events00:16:152
8585399919315,1923cyclictest865084-21kworker/2:1+events19:54:362
8585399919209,1908cyclictest938553-21kworker/2:0+events23:30:332
8585339919189,1906cyclictest911309-21kworker/0:0+events22:04:380
8585429919143,1908cyclictest954248-21kworker/3:0+events00:18:093
8585399919149,1903cyclictest861733-21kworker/2:2+events19:29:412
8585429918962,1891cyclictest933625-21kworker/3:0+events23:06:563
8585429918539,1841cyclictest859957-21kworker/3:1+events19:19:253
8585399918477,1837cyclictest878134-21kworker/2:2+events20:16:292
8580492160118,24sleep10-21swapper/119:06:491
8579212154127,21sleep30-21swapper/319:05:223
857982214294,16sleep20-21swapper/219:05:582
8580382139105,29sleep00-21swapper/019:06:390
85853399130,12cyclictest945887-21/usr/sbin/munin23:40:180
85853399120,12cyclictest0-21swapper/019:14:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional