You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 05:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Fri Dec 12, 2025 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
92378899279113,2774cyclictest956495-21kworker/0:1+events20:50:160
92379899275911,2744cyclictest945291-21kworker/3:0+events20:45:243
92379899272713,2710cyclictest1026496-21kworker/3:2+events00:35:233
92379399269014,2673cyclictest962741-21kworker/1:1+events21:12:101
92379599265213,2636cyclictest942210-21kworker/2:0+events20:10:212
92379599262511,2610cyclictest975483-21kworker/2:1+events21:55:242
92379399258112,2565cyclictest986875-21kworker/1:1+events22:30:191
92378899251210,2498cyclictest995058-21kworker/0:1+events23:00:210
92379399250010,2487cyclictest967672-21kworker/1:1+events21:40:201
92379399249011,2476cyclictest935197-21kworker/1:1+events19:48:181
92379899248912,2473cyclictest1026496-21kworker/3:2+events00:30:243
92378899246210,2449cyclictest1025163-21kworker/0:0+events00:30:000
92378899245612,2440cyclictest1010842-21kworker/0:0+events23:45:180
92378899243311,2419cyclictest993368-21kworker/0:0+events22:44:260
92378899243012,2414cyclictest982054-21kworker/0:2+events22:10:180
92378899242211,2407cyclictest980158-21kworker/0:0+events22:19:000
92378899241411,2400cyclictest929050-21kworker/0:0+events19:37:160
92379399241311,2398cyclictest1003762-21kworker/1:2+events23:26:531
9237989924099,2397cyclictest993247-21kworker/3:2+events22:46:163
9237889923969,2383cyclictest961111-21kworker/0:1+events21:05:220
92379899239012,2375cyclictest948550-21kworker/3:2+events20:34:213
92379899238912,2374cyclictest935288-21kworker/3:2+events19:45:183
92379899236412,2348cyclictest991536-21kworker/3:0+events23:00:453
92378899235611,2341cyclictest929050-21kworker/0:0+events19:40:190
92379599233912,2324cyclictest966030-21kworker/2:2+events21:32:172
92379399233911,2324cyclictest1018807-21kworker/1:0+events00:17:461
92379399233411,2319cyclictest964363-21kworker/1:2+events21:19:441
92378899233212,2316cyclictest938483-21kworker/0:1+events20:01:120
9237889923259,2313cyclictest1019975-21kworker/0:0+events00:05:540
9237889923179,2304cyclictest1021653-21kworker/0:1+events00:39:100
92379599230811,2294cyclictest954955-21kworker/2:1+events20:50:382
92378899229211,2278cyclictest933453-21kworker/0:2+events19:50:580
92379399229010,2276cyclictest994787-21kworker/1:1+events22:50:301
92379399227610,2263cyclictest986875-21kworker/1:1+events22:39:551
92379399227410,2260cyclictest937089-21kworker/1:2+events19:56:151
92379399227410,2260cyclictest937089-21kworker/1:2+events19:56:151
92379399227111,2256cyclictest991566-21kworker/1:2+events22:41:231
92379899227012,2255cyclictest1012163-21kworker/3:0+events23:49:543
92379399227011,2256cyclictest999616-21kworker/1:1+events23:14:431
92379399227010,2256cyclictest940080-21kworker/1:0+events20:42:411
92379399226911,2255cyclictest940080-21kworker/1:0+events20:35:491
92379399226811,2253cyclictest955011-21kworker/1:1+events20:54:231
92378899226812,2253cyclictest962799-21kworker/0:0+events21:12:310
92378899226810,2255cyclictest970655-21kworker/0:0+events21:36:550
92379899226711,2252cyclictest931970-21kworker/3:1+events19:41:513
92379399226711,2253cyclictest978790-21kworker/1:0+events22:24:131
92379399226711,2253cyclictest1015493-21kworker/1:2+events23:54:321
92379399226710,2254cyclictest1025042-21kworker/1:2+events00:24:151
92379599226612,2251cyclictest993527-21kworker/2:1+events23:13:582
92379399226611,2252cyclictest975449-21kworker/1:0+events21:50:311
92379399226611,2252cyclictest973826-21kworker/1:2+events21:46:481
92378899226611,2252cyclictest1001160-21kworker/0:1+events23:11:220
9237939922659,2253cyclictest1017096-21kworker/1:1+events00:03:151
92379399226410,2250cyclictest1009128-21kworker/1:0+events23:37:241
92379399226311,2249cyclictest996392-21kworker/1:0+events23:01:271
92379399226311,2249cyclictest959455-21kworker/1:2+events20:58:111
92378899226210,2249cyclictest951666-21kworker/0:1+events20:35:270
9237939922599,2247cyclictest965998-21kworker/1:0+events21:22:471
9237939922599,2246cyclictest961063-21kworker/1:0+events21:08:261
92379399225911,2245cyclictest985228-21kworker/1:2+events22:29:341
92379399225411,2239cyclictest978790-21kworker/1:0+events22:02:391
9237939922507,2240cyclictest1015493-21kworker/1:2+events23:58:391
92379899224711,2232cyclictest1020316-21kworker/3:2+events00:12:273
92379399224610,2233cyclictest932178-21kworker/1:2+events19:37:391
92378899224411,2230cyclictest959424-21kworker/0:2+events21:02:450
92379399224110,2228cyclictest942059-21kworker/1:1+events20:05:461
92379399224110,2228cyclictest942059-21kworker/1:1+events20:05:461
92378899223710,2223cyclictest967416-21kworker/0:1+events21:27:480
92378899223510,2222cyclictest970655-21kworker/0:0+events21:34:140
92378899223510,2222cyclictest1017319-21kworker/0:3+events00:01:190
92378899223111,2217cyclictest1001160-21kworker/0:1+events23:08:430
92379899223011,2216cyclictest978412-21kworker/3:2+events22:00:013
9237889922308,2218cyclictest943813-21kworker/0:0+events20:10:450
9237889922306,2221cyclictest983683-21kworker/0:1+events22:27:390
9237989922299,2217cyclictest1024824-21kworker/3:0+events00:29:153
92378899222910,2216cyclictest962799-21kworker/0:0+events21:15:350
92378899222811,2214cyclictest1007584-21kworker/0:0+events23:29:550
92379899222711,2213cyclictest999909-21kworker/3:2+events23:13:353
9237889922249,2211cyclictest1021653-21kworker/0:1+events00:19:410
92378899222411,2209cyclictest972321-21kworker/0:2+events21:47:520
92379399222111,2207cyclictest1025042-21kworker/1:2+events00:33:051
92378899222110,2207cyclictest988180-21kworker/0:0+events22:33:250
92378899221811,2204cyclictest1010842-21kworker/0:0+events23:41:310
92378899221810,2205cyclictest995058-21kworker/0:1+events22:53:320
92378899221710,2203cyclictest972321-21kworker/0:2+events21:57:200
92378899221611,2202cyclictest983683-21kworker/0:1+events22:21:130
92378899221510,2203cyclictest1012729-21kworker/0:2+events00:10:070
92378899221211,2199cyclictest1004477-21kworker/0:2+events23:20:190
92378899221111,2197cyclictest1023532-21kworker/0:2+events00:20:250
92379899220711,2192cyclictest953120-21kworker/3:1+events20:57:493
9237889922079,2195cyclictest1009186-21kworker/0:2+events23:35:340
92379399220611,2192cyclictest942059-21kworker/1:1+events20:03:521
92379899220010,2186cyclictest937209-21kworker/3:1+events19:55:303
92379899220010,2186cyclictest937209-21kworker/3:1+events19:55:303
92379599220011,2186cyclictest1001309-21kworker/2:0+events23:09:492
92378899220011,2185cyclictest1002787-21kworker/0:0+events23:16:350
92378899219911,2186cyclictest995058-21kworker/0:1+events22:55:460
9237989921989,2185cyclictest1007647-21kworker/3:1+events23:43:483
92379899219811,2184cyclictest982022-21kworker/3:0+events22:23:303
92379899219811,2184cyclictest1004358-21kworker/3:0+events23:22:393
92379899219612,2181cyclictest945291-21kworker/3:0+events20:41:543
92379899219611,2181cyclictest983752-21kworker/3:2+events22:16:433
92379899219610,2183cyclictest1007647-21kworker/3:1+events23:35:563
92379899219512,2179cyclictest959516-21kworker/3:0+events21:19:213
92379899219411,2180cyclictest946894-21kworker/3:1+events20:23:573
92379899219210,2179cyclictest1024824-21kworker/3:0+events00:24:363
9237989921909,2177cyclictest996541-21kworker/3:2+events22:57:403
92379899219011,2175cyclictest991536-21kworker/3:0+events22:53:553
92379399218910,2176cyclictest940080-21kworker/1:0+events20:21:411
9237989921886,2179cyclictest1013793-21kworker/3:2+events23:52:593
92379899218811,2174cyclictest988748-21kworker/3:2+events22:34:113
92379899218811,2174cyclictest968960-21kworker/3:0+events21:41:513
92379899218810,2176cyclictest1020316-21kworker/3:2+events00:15:073
9237989921879,2175cyclictest925152-21kworker/3:0+events19:28:553
92379899218711,2173cyclictest976813-21kworker/3:1+events22:08:443
92379899218711,2173cyclictest1007647-21kworker/3:1+events23:34:253
9237989921858,2174cyclictest945291-21kworker/3:0+events20:16:233
92379899218511,2171cyclictest968960-21kworker/3:0+events21:31:123
92379399218410,2171cyclictest991566-21kworker/1:2+events22:58:291
9237989921829,2170cyclictest962919-21kworker/3:1+events21:11:043
92379899218210,2169cyclictest965701-21kworker/3:2+events21:29:433
92379899217810,2164cyclictest999909-21kworker/3:2+events23:05:183
92378899217710,2164cyclictest965670-21kworker/0:2+events21:22:250
92379899217410,2161cyclictest943693-21kworker/3:2+events20:09:103
92379899217410,2161cyclictest943693-21kworker/3:2+events20:09:103
92379399217411,2160cyclictest945259-21kworker/1:2+events20:15:141
92379899217310,2161cyclictest976813-21kworker/3:1+events22:03:033
9237989921688,2157cyclictest948550-21kworker/3:2+events20:28:113
92379899216511,2150cyclictest959516-21kworker/3:0+events21:04:143
92379899216411,2150cyclictest961226-21kworker/3:2+events21:08:503
92379899216211,2148cyclictest931970-21kworker/3:1+events19:38:033
92378899215911,2145cyclictest930635-21kworker/0:1+events19:33:520
92379899215810,2144cyclictest953120-21kworker/3:1+events20:51:233
92379599214111,2127cyclictest942210-21kworker/2:0+events20:08:482
92379599214111,2127cyclictest942210-21kworker/2:0+events20:08:482
92379599214110,2127cyclictest979950-21kworker/2:0+events22:05:172
9237959921375,2129cyclictest954955-21kworker/2:1+events21:24:432
92379399213310,2120cyclictest927734-21kworker/1:2+events19:22:241
92378899213210,2119cyclictest1015280-21kworker/0:1+events23:51:250
92379599213011,2116cyclictest1024912-21kworker/2:1+events00:34:592
92379599213010,2117cyclictest954955-21kworker/2:1+events21:17:282
92379599212911,2115cyclictest975483-21kworker/2:1+events22:10:392
92379599212911,2115cyclictest936999-21kworker/2:1+events19:51:442
92379599212911,2115cyclictest928248-21kworker/2:0+events19:21:152
92379599212911,2115cyclictest1017352-21kworker/2:0+events00:15:542
92379599212911,2114cyclictest996362-21kworker/2:0+events22:53:102
92379599212811,2115cyclictest1023230-21kworker/2:2+events00:25:472
92379599212811,2114cyclictest981810-21kworker/2:2+events22:28:482
92379399212811,2114cyclictest999616-21kworker/1:1+events23:31:241
92379599212711,2113cyclictest936999-21kworker/2:1+events19:47:542
92379599212711,2112cyclictest1013974-21kworker/2:1+events23:50:162
92379599212611,2112cyclictest938604-21kworker/2:2+events19:58:552
92379599212611,2112cyclictest938604-21kworker/2:2+events19:58:552
92379599212611,2112cyclictest1030005-21kworker/2:2+events00:39:332
92379599212610,2113cyclictest990260-21kworker/2:0+events22:42:322
92379899212510,2112cyclictest937209-21kworker/3:1+events20:11:063
92379599212511,2111cyclictest940292-21kworker/2:1+events20:20:332
9237989921246,2115cyclictest982022-21kworker/3:0+events22:25:223
92379399212110,2107cyclictest1010993-21kworker/1:1+events23:49:291
92379599212011,2105cyclictest1017352-21kworker/2:0+events00:11:392
92379599211910,2106cyclictest993527-21kworker/2:1+events22:58:502
9237989921188,2107cyclictest1020316-21kworker/3:2+events00:09:443
92379399211810,2105cyclictest983566-21kworker/1:1+events22:17:061
92379599211711,2103cyclictest972081-21kworker/2:1+events21:37:192
92379399211710,2104cyclictest951513-21kworker/1:2+events20:32:481
9237939921169,2104cyclictest993188-21kworker/1:0+events22:45:311
92379599211511,2100cyclictest1015554-21kworker/2:2+events23:57:322
9237939921159,2103cyclictest983566-21kworker/1:1+events22:14:281
92378899211310,2100cyclictest938483-21kworker/0:1+events20:21:190
92379399211010,2097cyclictest925091-21kworker/1:0+events19:34:381
92379399210910,2096cyclictest967672-21kworker/1:1+events21:31:331
92379399210812,2093cyclictest999616-21kworker/1:1+events23:17:231
9237939921079,2095cyclictest940080-21kworker/1:0+events20:25:301
9237939921077,2097cyclictest945259-21kworker/1:2+events20:14:271
9237939921069,2094cyclictest1029879-21kworker/1:1+events00:37:161
92379599210410,2091cyclictest958373-21kworker/2:2+events20:59:422
92379599210211,2088cyclictest1001309-21kworker/2:0+events23:20:432
9237939921025,2093cyclictest925091-21kworker/1:0+events19:42:361
92379399210210,2085cyclictest967672-21kworker/1:1+events21:27:241
92379399210110,2088cyclictest1023288-21kworker/1:1+events00:26:311
9237939921009,2088cyclictest1003762-21kworker/1:2+events23:40:241
92379899209911,2085cyclictest968960-21kworker/3:0+events21:36:103
92379599209811,2084cyclictest954955-21kworker/2:1+events20:47:362
92379599209811,2084cyclictest1017352-21kworker/2:0+events00:09:212
92379599209811,2084cyclictest1004294-21kworker/2:2+events23:34:472
9237939920989,2086cyclictest1003762-21kworker/1:2+events23:23:251
9237959920959,2082cyclictest1023230-21kworker/2:2+events00:21:552
92379599209510,2083cyclictest940292-21kworker/2:1+events20:25:072
92379399209010,2077cyclictest951513-21kworker/1:2+events20:48:231
92378899209010,2076cyclictest978476-21kworker/0:1+events22:07:360
9237939920889,2076cyclictest1018807-21kworker/1:0+events00:06:391
9237889920889,2075cyclictest1012729-21kworker/0:2+events23:58:180
92378899208610,2073cyclictest949886-21kworker/0:2+events20:27:240
9237889920858,2074cyclictest993368-21kworker/0:0+events22:45:520
9237989920808,2069cyclictest991536-21kworker/3:0+events22:38:013
92379399208010,2067cyclictest955011-21kworker/1:1+events21:00:271
9237889920808,2069cyclictest972321-21kworker/0:2+events21:41:290
9237889920808,2069cyclictest933453-21kworker/0:2+events19:46:030
9237889920799,2066cyclictest1021653-21kworker/0:1+events00:31:110
9237889920764,2069cyclictest959424-21kworker/0:2+events20:57:250
92378899207610,2062cyclictest978476-21kworker/0:1+events22:03:240
9237889920747,2064cyclictest948283-21kworker/0:0+events20:44:120
92378899207410,2061cyclictest938483-21kworker/0:1+events20:06:070
92378899207410,2061cyclictest938483-21kworker/0:1+events20:06:070
92378899207410,2060cyclictest954893-21kworker/0:2+events20:48:440
92378899207310,2060cyclictest929050-21kworker/0:0+events19:26:110
92379399207210,2059cyclictest970505-21kworker/1:2+events21:35:461
92378899207110,2058cyclictest976842-21kworker/0:0+events21:54:170
92378899207110,2058cyclictest924916-21kworker/0:2+events19:17:230
9237889920709,2058cyclictest1007584-21kworker/0:0+events23:32:340
9237889920639,2051cyclictest938483-21kworker/0:1+events19:58:320
9237889920639,2051cyclictest938483-21kworker/0:1+events19:58:320
9237889920634,2056cyclictest950052-21kworker/0:3+events20:31:150
9237989920598,2048cyclictest986072-21kworker/3:1+events22:40:153
92379599205910,2045cyclictest962617-21kworker/2:2+events21:09:362
9237889920578,2046cyclictest938483-21kworker/0:1+events20:19:470
92379899205410,2041cyclictest925152-21kworker/3:0+events19:30:273
9237989920499,2037cyclictest1013793-21kworker/3:2+events23:55:183
92379899204810,2035cyclictest976813-21kworker/3:1+events22:11:263
9237989920444,2037cyclictest975216-21kworker/3:2+events21:49:473
9237939920446,2035cyclictest978790-21kworker/1:0+events22:07:131
9237939920426,2033cyclictest923320-21kworker/1:1+events19:18:091
9237989920403,2034cyclictest921810-21kworker/3:2+events19:14:223
92379599204011,2026cyclictest993527-21kworker/2:1+events23:04:322
9237889920409,2028cyclictest990048-21kworker/0:2+events22:38:240
9237989920389,2026cyclictest967322-21kworker/3:1+events21:22:013
9237939920389,2025cyclictest930452-21kworker/1:1+events19:28:321
9237989920366,2026cyclictest976813-21kworker/3:1+events21:52:033
9237959920353,2029cyclictest949975-21kworker/2:0+events20:30:542
9237959920349,2022cyclictest951698-21kworker/2:1+events20:36:122
9237989920338,2022cyclictest933633-21kworker/3:0+events19:52:073
92379899203310,2020cyclictest1004358-21kworker/3:0+events23:26:303
9237959920337,2023cyclictest1010575-21kworker/2:1+events23:38:082
92379599203310,2019cyclictest1007769-21kworker/2:0+events23:49:072
9237959920328,2021cyclictest968205-21kworker/2:0+events21:50:542
92379899203110,2018cyclictest945291-21kworker/3:0+events20:37:003
9237959920302,2025cyclictest920353-21kworker/2:1+events19:39:322
9237939920309,2018cyclictest925091-21kworker/1:0+events19:14:431
9237989920287,2018cyclictest999909-21kworker/3:2+events23:17:433
9237989920275,2019cyclictest927457-21kworker/3:1+events19:20:523
9237989920258,2014cyclictest921810-21kworker/3:2+events19:18:323
9237939920179,2006cyclictest935197-21kworker/1:1+events19:50:121
9237939920126,2003cyclictest977079-21kworker/1:2+events21:57:441
9237989920117,2001cyclictest1016975-21kworker/3:1+events00:02:503
9237959920005,1992cyclictest968205-21kworker/2:0+events21:28:112
9237889919999,1987cyclictest924916-21kworker/0:2+events19:12:070
9237959919948,1983cyclictest1004294-21kworker/2:2+events23:18:062
9237959919875,1979cyclictest975483-21kworker/2:1+events22:00:452
9237959919747,1963cyclictest940292-21kworker/2:1+events20:04:382
92379599197310,1960cyclictest954955-21kworker/2:1+events21:01:352
92379599197310,1960cyclictest1006103-21kworker/2:1+events23:26:072
9237959919718,1960cyclictest942210-21kworker/2:0+events20:17:082
9237959919718,1959cyclictest1007769-21kworker/2:0+events23:42:402
92379599197110,1958cyclictest981810-21kworker/2:2+events22:18:382
9237959919708,1959cyclictest988360-21kworker/2:1+events22:30:432
9237959919704,1963cyclictest949975-21kworker/2:0+events20:43:512
9237959919687,1958cyclictest954955-21kworker/2:1+events21:14:502
9237989919679,1956cyclictest938892-21kworker/3:2+events20:00:023
9237959919657,1955cyclictest973856-21kworker/2:2+events21:45:392
92379599196210,1949cyclictest981810-21kworker/2:2+events22:39:302
92379599196210,1949cyclictest920353-21kworker/2:1+events19:32:442
92379599196110,1948cyclictest920353-21kworker/2:1+events19:28:082
92379599195910,1946cyclictest1017352-21kworker/2:0+events00:04:242
9237959919524,1945cyclictest920353-21kworker/2:1+events19:17:472
92379599194410,1931cyclictest972081-21kworker/2:1+events21:40:432
9237959919139,1901cyclictest981810-21kworker/2:2+events22:22:002
92379599189410,1881cyclictest981810-21kworker/2:2+events22:49:432
92379599189410,1881cyclictest933512-21kworker/2:0+events19:41:282
92378899143140,2cyclictest924916-21kworker/0:2+pm19:24:510
9235482143110,28sleep30-21swapper/319:09:553
9232982142104,29sleep00-21swapper/019:06:430
9232732141109,27sleep20-21swapper/219:06:252
9232142141112,25sleep10-21swapper/119:05:401
923793993112,6cyclictest1001422-10awk23:09:591
92379599210,13cyclictest924271-21/usr/sbin/munin19:10:162
92379399135,5cyclictest1020900-21diskstats00:10:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional