You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 06:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Thu May 21, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
157144899363119,3609cyclictest1587534-21kworker/0:1+events20:15:180
157145399317714,3158cyclictest1664319-21kworker/1:2+events00:00:011
157145399311710,3102cyclictest1653127-21kworker/1:2+events23:35:161
157145399296713,2949cyclictest1666091-21kworker/1:1+events00:05:171
157144899279813,2780cyclictest1641848-21kworker/0:0+events22:55:180
157144899278212,2766cyclictest1574904-21kworker/0:2+events19:20:160
15714599927749,2761cyclictest1632185-21kworker/3:2+events22:25:363
157145399276413,2746cyclictest1590998-21kworker/1:1+events20:14:091
157145399276213,2745cyclictest1587653-21kworker/1:0+events20:08:021
15714489927526,2742cyclictest1618095-21kworker/0:1+events22:20:170
157145699273912,2724cyclictest1646559-21kworker/2:2+events23:30:002
157145999256212,2547cyclictest1622619-21kworker/3:2+events21:54:543
157145399255611,2541cyclictest1603592-21kworker/1:1+events20:50:131
157145999255512,2539cyclictest1597193-21kworker/3:1+events20:49:273
15714599925508,2538cyclictest1582930-21kworker/3:1+events19:54:163
15714599925449,2532cyclictest1642031-21kworker/3:2+events23:02:323
157145999254412,2528cyclictest1622619-21kworker/3:2+events22:08:303
157144899254111,2526cyclictest1659459-21kworker/0:0+events23:52:450
157145399253712,2521cyclictest1646751-21kworker/1:1+events23:11:151
157145399253712,2521cyclictest1613106-21kworker/1:2+events21:19:131
157145399253212,2516cyclictest1672744-21kworker/1:1+events00:29:581
157145399253112,2516cyclictest1632217-21kworker/1:1+events22:47:591
15714539925309,2517cyclictest1628609-21kworker/1:0+events22:09:141
157145399253012,2514cyclictest1632217-21kworker/1:1+events22:17:591
157145399253011,2515cyclictest1632217-21kworker/1:1+events22:25:141
157145399252511,2512cyclictest1666091-21kworker/1:1+events00:13:361
157145399252412,2508cyclictest1576468-21kworker/1:2+events19:30:541
157145399252312,2508cyclictest1675759-21kworker/1:0+events00:34:311
157144899251412,2499cyclictest1619692-21kworker/0:2+events21:41:430
15714489925089,2496cyclictest1659459-21kworker/0:0+events23:46:440
15714569925079,2494cyclictest1642205-21kworker/2:0+events23:07:532
157145699250712,2492cyclictest1667635-21kworker/2:0+events00:08:442
157145999250511,2490cyclictest1627591-21kworker/3:0+events22:10:443
15714489925059,2492cyclictest1613436-21kworker/0:0+events21:29:300
157145699250411,2490cyclictest1650375-21kworker/2:0+events23:24:002
157144899250412,2488cyclictest1587534-21kworker/0:1+events20:09:100
157145399250310,2490cyclictest1632217-21kworker/1:1+events22:41:121
157145399250212,2487cyclictest1654720-21kworker/1:0+events23:29:141
157144899250212,2487cyclictest1581129-21kworker/0:0+events19:40:310
157145999250114,2484cyclictest1632185-21kworker/3:2+events22:34:183
157145999250112,2485cyclictest1618046-21kworker/3:2+events21:33:203
157145699250112,2485cyclictest1581250-21kworker/2:1+events19:48:512
15714489924989,2486cyclictest1663574-21kworker/0:2+events00:09:070
157145699249612,2480cyclictest1638770-21kworker/2:1+events22:49:342
157145399249511,2482cyclictest1605226-21kworker/1:0+events21:00:061
157145999249412,2479cyclictest1674163-21kworker/3:2+events00:30:453
157145399249311,2478cyclictest1613106-21kworker/1:2+events21:21:281
157145399249210,2481cyclictest1664319-21kworker/1:2+events00:02:151
157145999249112,2476cyclictest1636907-21kworker/3:1+events22:44:353
157145999249112,2475cyclictest1666004-21kworker/3:2+events00:07:593
157145399249112,2475cyclictest1614764-21kworker/1:1+events21:25:141
157145999248912,2474cyclictest1670803-21kworker/3:1+events00:17:493
157145999248912,2474cyclictest1648169-21kworker/3:0+events23:28:513
157145999248912,2473cyclictest1648169-21kworker/3:0+events23:37:343
157145999248712,2471cyclictest1606822-21kworker/3:1+events21:00:543
157145999248711,2472cyclictest1582930-21kworker/3:1+events19:48:283
15714539924865,2477cyclictest1616363-21kworker/1:0+events21:31:241
157145999248512,2470cyclictest1646505-21kworker/3:1+events23:16:023
157145999248510,2471cyclictest1619883-21kworker/3:0+events21:43:583
157145999248412,2468cyclictest1633905-21kworker/3:0+events22:24:303
157144899248412,2468cyclictest1618095-21kworker/0:1+events21:38:580
157144899248411,2469cyclictest1670840-21kworker/0:0+events00:23:080
157145999248312,2468cyclictest1605018-21kworker/3:2+events20:56:433
157145699248210,2468cyclictest1579524-21kworker/2:0+events19:39:442
157145999248112,2466cyclictest1597193-21kworker/3:1+events20:30:523
157145999248111,2466cyclictest1669209-21kworker/3:0+events00:21:123
157145999247812,2463cyclictest1606822-21kworker/3:1+events21:20:213
157145699247812,2462cyclictest1611657-21kworker/2:2+events22:08:532
157145999247710,2464cyclictest1657838-21kworker/3:2+events23:40:153
157145999247612,2461cyclictest1572618-21kworker/3:0+events19:15:413
15714569924758,2464cyclictest1597344-21kworker/2:2+events20:38:472
15714539924716,2463cyclictest1653127-21kworker/1:2+events23:50:061
157145999247011,2455cyclictest1674163-21kworker/3:2+events00:35:593
157145399247012,2455cyclictest1626115-21kworker/1:2+events22:02:241
157145999246512,2450cyclictest1625937-21kworker/3:1+events21:59:033
157145999246412,2448cyclictest1597193-21kworker/3:1+events20:41:503
157145399246312,2447cyclictest1600251-21kworker/1:1+events20:39:321
157145999246112,2446cyclictest1659550-21kworker/3:1+events23:55:473
157145399246112,2445cyclictest1587653-21kworker/1:0+events20:03:481
157145399246111,2448cyclictest1669354-21kworker/1:2+events00:15:081
157145699246012,2446cyclictest1605105-21kworker/2:0+events21:05:062
157145999245912,2443cyclictest1642031-21kworker/3:2+events22:58:213
157145999245810,2445cyclictest1648169-21kworker/3:0+events23:45:573
157145399245512,2440cyclictest1653127-21kworker/1:2+events23:47:291
157145399245012,2434cyclictest1632217-21kworker/1:1+events22:22:551
157145399244912,2433cyclictest1643212-21kworker/1:0+events22:54:071
157145399244812,2434cyclictest1570959-21kworker/1:2+events19:16:041
157145399244812,2433cyclictest1646751-21kworker/1:1+events23:21:021
157145399244812,2432cyclictest1576468-21kworker/1:2+events19:24:511
157145399244811,2434cyclictest1635503-21kworker/1:0+events22:30:521
157145999244710,2433cyclictest1636907-21kworker/3:1+events22:53:223
157145399244712,2432cyclictest1621230-21kworker/1:2+events21:53:031
157145399244712,2431cyclictest1582812-21kworker/1:1+events19:51:331
157145399244612,2431cyclictest1616363-21kworker/1:0+events21:38:351
157145399244610,2433cyclictest1628609-21kworker/1:0+events22:11:281
157145399244412,2429cyclictest1610845-21kworker/1:1+events21:13:291
157145399244412,2428cyclictest1643212-21kworker/1:0+events23:01:241
157145399244412,2428cyclictest1614764-21kworker/1:1+events21:45:271
157145399244112,2426cyclictest1658018-21kworker/1:0+events23:41:001
157145399244011,2426cyclictest1589363-21kworker/1:2+events20:18:191
157145399243312,2418cyclictest1601955-21kworker/1:2+events20:45:151
157145999243011,2415cyclictest1669209-21kworker/3:0+events00:27:413
157144899242912,2413cyclictest1587534-21kworker/0:1+events20:25:540
157144899242911,2414cyclictest1618095-21kworker/0:1+events22:07:270
157145699242812,2413cyclictest1642205-21kworker/2:0+events22:51:252
157145399242611,2411cyclictest1572705-21kworker/1:1+events19:13:211
157144899242611,2411cyclictest1613436-21kworker/0:0+events21:33:420
157145699242511,2411cyclictest1581250-21kworker/2:1+events19:42:002
157144899242511,2410cyclictest1598678-21kworker/0:0+events20:31:350
157144899242510,2411cyclictest1647953-21kworker/0:1+events23:42:510
157145399242412,2409cyclictest1574754-21kworker/1:0+events19:26:211
157144899242412,2409cyclictest1674136-21kworker/0:1+events00:34:520
157145699242312,2408cyclictest1667635-21kworker/2:0+events00:30:222
157144899242312,2409cyclictest1641848-21kworker/0:0+events23:10:520
157144899242311,2408cyclictest1651626-21kworker/0:0+events23:25:300
15714489924230,2419cyclictest1676055-21kworker/0:2+events00:39:010
157144899242212,2406cyclictest1669236-21kworker/0:1+events00:17:260
157145699242112,2405cyclictest1667635-21kworker/2:0+events00:20:522
157145699242111,2407cyclictest1621203-21kworker/2:1+events21:44:192
157145699242110,2408cyclictest1598999-21kworker/2:1+events20:44:522
157144899242112,2407cyclictest1583076-21kworker/0:2+events19:50:020
157144899242112,2405cyclictest1632158-21kworker/0:2+events22:46:310
157144899242111,2406cyclictest1647953-21kworker/0:1+events23:58:300
157144899242111,2406cyclictest1647953-21kworker/0:1+events23:31:520
157145699242011,2406cyclictest1644820-21kworker/2:1+events22:57:112
157145699242011,2406cyclictest1611657-21kworker/2:2+events21:45:052
157145699242011,2406cyclictest1611657-21kworker/2:2+events21:39:222
157144899241911,2405cyclictest1611831-21kworker/0:2+events21:18:050
15714569924189,2405cyclictest1611657-21kworker/2:2+events22:10:212
157145699241810,2404cyclictest1589511-21kworker/2:1+events20:27:242
157145699241712,2402cyclictest1661386-21kworker/2:1+events23:51:142
157145399241710,2401cyclictest1582812-21kworker/1:1+events19:41:381
157145699241211,2397cyclictest1605105-21kworker/2:0+events21:12:232
157145699241111,2396cyclictest1646559-21kworker/2:2+events23:48:582
157144899241110,2397cyclictest1583076-21kworker/0:2+events19:59:130
157145699241010,2396cyclictest1598999-21kworker/2:1+events20:52:532
157144899241011,2395cyclictest1606705-21kworker/0:1+events21:22:360
157144899240911,2394cyclictest1647953-21kworker/0:1+events00:03:470
157145699240612,2393cyclictest1654870-21kworker/2:1+events23:31:092
157145399240610,2393cyclictest1603592-21kworker/1:1+events20:56:211
157144899240612,2392cyclictest1587534-21kworker/0:1+events20:12:140
157145699240311,2388cyclictest1669296-21kworker/2:2+events00:13:592
157145699239712,2382cyclictest1584443-21kworker/2:2+events20:05:202
157145699239512,2380cyclictest1614968-21kworker/2:0+events21:27:342
157145699239512,2379cyclictest1635356-21kworker/2:0+events22:36:582
157145699239410,2380cyclictest1598999-21kworker/2:1+events20:47:322
157145699239212,2377cyclictest1584443-21kworker/2:2+events19:58:262
157144899239212,2376cyclictest1572793-21kworker/0:0+events19:27:320
157145699239011,2376cyclictest1638770-21kworker/2:1+events22:45:002
157145399238911,2375cyclictest1653127-21kworker/1:2+events23:33:461
157144899238711,2373cyclictest1618095-21kworker/0:1+events21:47:450
157145699238410,2371cyclictest1625763-21kworker/2:1+events21:59:262
157144899238211,2367cyclictest1656208-21kworker/0:2+events23:39:060
157144899238111,2366cyclictest1594723-21kworker/0:0+events20:21:200
157144899236411,2350cyclictest1576651-21kworker/0:1+events19:46:120
157145399236011,2346cyclictest1586016-21kworker/1:2+events19:56:121
157144899235512,2340cyclictest1597042-21kworker/0:2+events20:36:090
157144899234711,2332cyclictest1606705-21kworker/0:1+events21:03:580
157145999234411,2330cyclictest1578107-21kworker/3:0+events19:32:023
15714539923419,2328cyclictest1621230-21kworker/1:2+events21:44:421
157145399233812,2324cyclictest1595447-21kworker/1:1+events20:25:301
15714599923324,2325cyclictest1584590-21kworker/3:0+events20:19:523
157145699233110,2318cyclictest1646559-21kworker/2:2+events23:19:292
157145399233112,2315cyclictest1669354-21kworker/1:2+events00:21:591
157145699231810,2305cyclictest1589511-21kworker/2:1+events20:11:522
157145699231712,2301cyclictest1605105-21kworker/2:0+events21:15:232
157145999230510,2292cyclictest1661444-21kworker/3:2+events23:52:233
157145999229612,2281cyclictest1625937-21kworker/3:1+events22:00:543
15714599922789,2266cyclictest1622619-21kworker/3:2+events21:46:573
157145999227510,2261cyclictest1580609-21kworker/3:2+events19:44:413
157145999227411,2260cyclictest1594029-21kworker/3:2+events20:27:473
157145999226911,2256cyclictest1648169-21kworker/3:0+events23:21:243
157145999226911,2254cyclictest1582930-21kworker/3:1+events19:58:063
157145999226811,2255cyclictest1584590-21kworker/3:0+events20:05:433
157145999226811,2254cyclictest1611595-21kworker/3:0+events21:17:193
157145999226710,2253cyclictest1587858-21kworker/3:2+events20:03:013
157145699226611,2252cyclictest1611657-21kworker/2:2+events22:01:402
157145399226611,2253cyclictest1576468-21kworker/1:2+events19:35:061
15714599922659,2253cyclictest1666004-21kworker/3:2+events00:14:233
15714599922659,2252cyclictest1578107-21kworker/3:0+events19:37:493
157145999226511,2250cyclictest1630520-21kworker/3:1+events22:16:503
157145999226510,2252cyclictest1609726-21kworker/3:2+events21:07:473
157145999226411,2249cyclictest1636907-21kworker/3:1+events22:38:503
15714599922639,2251cyclictest1666004-21kworker/3:2+events00:04:113
157145999226011,2246cyclictest1606822-21kworker/3:1+events21:11:363
157145999226011,2245cyclictest1598828-21kworker/3:0+events20:35:453
157145999225911,2245cyclictest1648169-21kworker/3:0+events23:11:583
157145999225511,2240cyclictest1654781-21kworker/3:1+events23:30:473
157145399225411,2237cyclictest1624458-21kworker/1:1+events21:56:461
157145999225310,2240cyclictest1574689-21kworker/3:1+events19:23:423
157145999225211,2237cyclictest1606822-21kworker/3:1+events21:35:123
157144899225212,2236cyclictest1608361-21kworker/0:0+events21:08:110
15714569922507,2240cyclictest1592365-21kworker/2:0+events20:16:022
157145399224911,2235cyclictest1677386-21kworker/1:1+events00:37:291
15714539922479,2236cyclictest1582812-21kworker/1:1+events19:45:041
15714539922367,2226cyclictest1644998-21kworker/1:2+events22:59:531
15714569922339,2220cyclictest1654870-21kworker/2:1+events23:38:212
157144899223310,2219cyclictest1635387-21kworker/0:1+events22:28:570
157145999223210,2218cyclictest1640159-21kworker/3:0+events22:46:543
157144899223011,2216cyclictest1643779-21kworker/0:2+events23:04:480
157144899222911,2214cyclictest1618095-21kworker/0:1+events21:58:150
15714569922275,2218cyclictest1629191-21kworker/2:1+events22:26:442
157145399222711,2213cyclictest1646751-21kworker/1:1+events23:09:241
157144899222711,2212cyclictest1618095-21kworker/0:1+events21:52:410
157144899222710,2213cyclictest1587534-21kworker/0:1+events20:04:570
15714539922269,2214cyclictest1646751-21kworker/1:1+events23:16:471
15714489922269,2214cyclictest1651626-21kworker/0:0+events23:22:100
157144899222611,2212cyclictest1651626-21kworker/0:0+events23:19:530
157144899222610,2212cyclictest1598678-21kworker/0:0+events20:54:500
157145399222510,2212cyclictest1601955-21kworker/1:2+events20:43:431
157144899222511,2211cyclictest1632158-21kworker/0:2+events22:19:070
157144899222510,2212cyclictest1597042-21kworker/0:2+events20:41:270
157145399222410,2210cyclictest1605226-21kworker/1:0+events21:09:181
157144899222411,2209cyclictest1638503-21kworker/0:0+events22:38:280
157145699222310,2209cyclictest1646559-21kworker/2:2+events23:41:452
157144899222310,2209cyclictest1572793-21kworker/0:0+events19:16:280
157145699222210,2208cyclictest1629191-21kworker/2:1+events22:31:142
157144899222211,2208cyclictest1663574-21kworker/0:2+events00:12:090
157144899222211,2208cyclictest1625966-21kworker/0:0+events22:00:300
157144899222211,2208cyclictest1576651-21kworker/0:1+events19:38:110
15714569922209,2208cyclictest1613349-21kworker/2:1+events21:23:232
157145699222010,2207cyclictest1593999-21kworker/2:2+events20:20:592
15714569922198,2208cyclictest1597344-21kworker/2:2+events20:31:582
157145699221910,2206cyclictest1629191-21kworker/2:1+events22:17:362
15714539922199,2208cyclictest1589363-21kworker/1:2+events20:20:371
157145699221811,2203cyclictest1598999-21kworker/2:1+events20:57:282
157145699221810,2205cyclictest1566820-21kworker/2:1+events19:17:592
157145699221810,2204cyclictest1616672-21kworker/2:1+events21:34:032
15714569922179,2205cyclictest1584443-21kworker/2:2+events19:52:432
157145699221711,2202cyclictest1584443-21kworker/2:2+events20:01:282
157145699221610,2203cyclictest1646559-21kworker/2:2+events00:02:382
157145399221610,2204cyclictest1589363-21kworker/1:2+events20:30:081
157144899221411,2200cyclictest1647953-21kworker/0:1+events23:07:290
157145699221311,2198cyclictest1667635-21kworker/2:0+events00:26:562
157145999220211,2187cyclictest1574689-21kworker/3:1+events19:29:513
157144899220211,2187cyclictest1632158-21kworker/0:2+events22:41:560
157144899220110,2188cyclictest1672501-21kworker/0:2+events00:28:030
157144899220110,2187cyclictest1606705-21kworker/0:1+events20:58:570
15714489922009,2188cyclictest1606705-21kworker/0:1+events21:10:500
15714489921978,2186cyclictest1602044-21kworker/0:1+events20:49:040
15714489921977,2186cyclictest1618095-21kworker/0:1+events22:11:060
157144899219710,2184cyclictest1579494-21kworker/0:2+events19:33:340
157145699219411,2179cyclictest1605105-21kworker/2:0+events21:01:162
157145699219010,2176cyclictest1648329-21kworker/2:3+events23:14:112
157145999218910,2177cyclictest1642031-21kworker/3:2+events23:05:333
157145699218711,2173cyclictest1646559-21kworker/2:2+events23:59:382
157145699218510,2172cyclictest1642205-21kworker/2:0+events23:03:152
157145399216310,2150cyclictest1635503-21kworker/1:0+events22:39:151
157145699213610,2123cyclictest1566820-21kworker/2:1+events19:25:362
157145999212211,2108cyclictest1590700-21kworker/3:1+events20:13:453
15714599921107,2100cyclictest1606822-21kworker/3:1+events21:27:573
15714569920704,2062cyclictest1566820-21kworker/2:1+events19:20:402
157145699206810,2055cyclictest1576202-21kworker/2:2+events19:32:472
157144899206610,2053cyclictest1569446-21kworker/0:1+events19:12:580
157145699206410,2051cyclictest1566820-21kworker/2:1+events19:14:302
15714599920469,2034cyclictest1603354-21kworker/3:0+events20:51:463
15714599920389,2026cyclictest1572618-21kworker/3:0+events19:12:353
157144899199110,1978cyclictest1640129-21kworker/0:1+events22:50:400
15710202187158,24sleep00-21swapper/019:06:180
15710182145111,29sleep30-21swapper/319:06:173
15711412144112,27sleep20-21swapper/219:07:522
15712862141111,25sleep10-21swapper/119:09:431
1571456991812,4cyclictest1670756-21runrttasks00:16:152
157145699180,5cyclictest1633348-21tr22:20:182
1571448991811,2cyclictest1636107-21/usr/sbin/munin22:30:130
1571459991611,3cyclictest1594506-21apt-get20:20:133
1571456991613,2cyclictest689-21gmain21:55:012
157145699135,5cyclictest1676483-21cat00:35:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional