You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 22:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Tue Jul 14, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
202302999396519,3942cyclictest2103633-21kworker/3:0+events23:30:173
202301899361415,3594cyclictest2054419-21kworker/1:0+events20:55:111
202301399347116,3451cyclictest2102274-21kworker/0:1+events23:25:190
202301899333210,3316cyclictest2037723-21kworker/1:2+events20:00:131
202301899328216,3261cyclictest2087996-21kworker/1:1+events23:00:191
202301399317015,3150cyclictest2072985-21kworker/0:0+events21:45:140
202302999315215,3132cyclictest2115635-21kworker/3:2+events00:00:193
202301399308815,3069cyclictest2005126-21kworker/0:1+events19:25:170
202302499305912,3041cyclictest2106890-21kworker/2:2+events23:35:122
202301899301015,2989cyclictest2087996-21kworker/1:1+events22:35:111
202302499296915,2950cyclictest2088147-21kworker/2:2+events22:55:202
202302999291914,2901cyclictest2065057-21kworker/3:2+events21:33:493
202301399290714,2889cyclictest2058540-21kworker/0:0+events21:10:010
202301399287914,2861cyclictest2052497-21kworker/0:2+events20:50:180
202302999287011,2849cyclictest2036117-21kworker/3:0+events20:20:153
20230249928538,2841cyclictest2026322-21kworker/2:2+events19:30:132
202301399285213,2835cyclictest2044116-21kworker/0:1+events20:38:070
202302499284614,2828cyclictest2032750-21kworker/2:2+events19:50:212
202302499284413,2827cyclictest2060198-21kworker/2:0+events21:09:372
20230249928420,2838cyclictest2029244-21kworker/2:0+events19:38:152
202301899283414,2816cyclictest2113207-21kworker/1:0+events23:47:461
202301399283314,2815cyclictest2098919-21kworker/0:0+events23:13:340
202301899282514,2807cyclictest2078050-21kworker/1:2+events22:02:411
202302499281611,2801cyclictest2055756-21kworker/2:0+events20:54:062
202301899281513,2798cyclictest2084502-21kworker/1:0+events22:22:461
202301399281413,2797cyclictest2116504-21kworker/0:0+events00:06:450
202301399281213,2795cyclictest2081128-21kworker/0:2+events22:10:380
20230249928087,2797cyclictest2081039-21kworker/2:2+events22:14:252
20230249928080,2804cyclictest2032750-21kworker/2:2+events20:13:532
202302499280713,2790cyclictest2081039-21kworker/2:2+events22:08:222
202301899280713,2790cyclictest2060287-21kworker/1:0+events21:04:221
202302499280613,2789cyclictest2088147-21kworker/2:2+events23:19:352
202302499280613,2789cyclictest2076536-21kworker/2:1+events22:01:322
202302999280514,2787cyclictest2052196-21kworker/3:1+events20:46:553
202301899280513,2788cyclictest2114819-21kworker/1:1+events23:57:161
202302499280413,2787cyclictest2126173-21kworker/2:2+events00:31:382
202301899280413,2787cyclictest2116721-21kworker/1:3+events00:03:431
202302499280313,2786cyclictest2049139-21kworker/2:2+events20:55:362
202301899280313,2788cyclictest2050951-21kworker/1:1+events20:41:571
202301899280313,2786cyclictest2094445-21kworker/1:0+events22:53:251
202301899280313,2786cyclictest2024427-21kworker/1:1+events19:18:071
202301899280113,2784cyclictest2076278-21kworker/1:0+events21:54:421
202302499280013,2783cyclictest2088147-21kworker/2:2+events22:34:072
202302499280013,2783cyclictest2044025-21kworker/2:0+events20:16:542
202301899280013,2783cyclictest2086129-21kworker/1:2+events22:26:121
202301899279913,2782cyclictest2066528-21kworker/1:1+events21:24:171
202301899279613,2780cyclictest2063546-21kworker/1:0+events21:35:441
20230189927910,2787cyclictest2106923-21kworker/1:1+events23:29:541
202301899279012,2775cyclictest2086129-21kworker/1:2+events22:31:301
202302499278813,2771cyclictest2088147-21kworker/2:2+events23:04:292
202301899278813,2770cyclictest2050951-21kworker/1:1+events20:45:241
202302999278612,2770cyclictest2066702-21kworker/3:1+events21:40:143
202302499278513,2768cyclictest2089814-21kworker/2:0+events22:42:492
202301899278512,2769cyclictest2046038-21kworker/1:1+events20:24:471
202301899278313,2766cyclictest2036088-21kworker/1:0+events19:58:431
202301899278313,2766cyclictest2036088-21kworker/1:0+events19:58:421
202302499278012,2764cyclictest2058509-21kworker/2:1+events21:13:032
202302499277714,2759cyclictest2032750-21kworker/2:2+events20:05:142
202302999277513,2758cyclictest2092618-21kworker/3:0+events22:42:033
202302999277413,2756cyclictest2074377-21kworker/3:0+events22:05:203
202302499277413,2758cyclictest2024158-21kworker/2:1+events19:20:462
202301899277413,2757cyclictest2056941-21kworker/1:2+events21:17:581
202302499277213,2757cyclictest2086217-21kworker/2:0+events22:25:022
202302999276413,2747cyclictest2111696-21kworker/3:2+events23:44:193
202302999276013,2743cyclictest2081217-21kworker/3:2+events22:28:553
202302999275713,2740cyclictest2028087-21kworker/3:1+events19:43:563
202302999275613,2739cyclictest2081217-21kworker/3:2+events22:22:223
202302999275613,2739cyclictest2065057-21kworker/3:2+events21:26:133
202302999275513,2739cyclictest2113363-21kworker/3:0+events23:53:323
202302999275513,2738cyclictest2095899-21kworker/3:2+events23:00:413
202302999275411,2739cyclictest2081217-21kworker/3:2+events22:14:473
202302999275013,2733cyclictest2036117-21kworker/3:0+events20:32:233
202302999274913,2732cyclictest2110072-21kworker/3:1+events00:10:543
202302499274912,2733cyclictest2099191-21kworker/2:1+events23:10:542
202302999274813,2731cyclictest2100819-21kworker/3:2+events23:15:503
202302999274813,2731cyclictest2060508-21kworker/3:3+events21:09:163
202302999274712,2731cyclictest2111696-21kworker/3:2+events23:46:133
202302999273913,2722cyclictest2103633-21kworker/3:0+events23:26:063
202301899273414,2716cyclictest2056941-21kworker/1:2+events21:10:461
202301899273212,2716cyclictest2030938-21kworker/1:0+events19:33:181
202302999272213,2705cyclictest2119541-21kworker/3:2+events00:15:543
202302999272112,2705cyclictest2049347-21kworker/3:2+events20:44:163
202302999272012,2704cyclictest2065057-21kworker/3:2+events21:23:563
202302999271912,2703cyclictest2028087-21kworker/3:1+events19:36:433
202302999271413,2697cyclictest2095899-21kworker/3:2+events22:58:033
202302999271411,2699cyclictest2036117-21kworker/3:0+events19:49:583
20230249927126,2704cyclictest2119663-21kworker/2:1+events00:15:082
202302999271113,2694cyclictest2129466-21kworker/3:0+events00:39:123
202302999271113,2694cyclictest2040770-21kworker/3:1+events20:04:273
202302999271013,2695cyclictest2037752-21kworker/3:2+events19:55:423
202302999271013,2695cyclictest2037752-21kworker/3:2+events19:55:413
202302999271013,2693cyclictest2091012-21kworker/3:1+events22:37:093
202302999270913,2694cyclictest2092618-21kworker/3:0+events22:45:023
202302999270913,2692cyclictest2110072-21kworker/3:1+events23:55:263
202302999270613,2689cyclictest2052196-21kworker/3:1+events21:16:033
202302999270613,2689cyclictest2049347-21kworker/3:2+events20:37:453
202302999270613,2689cyclictest2041009-21kworker/3:3+events20:08:373
202302999270413,2687cyclictest2089417-21kworker/3:0+events22:34:293
202302999270413,2687cyclictest2026292-21kworker/3:0+events19:23:043
202301399270413,2687cyclictest2058540-21kworker/0:0+events21:01:200
202302999270312,2687cyclictest2119541-21kworker/3:2+events00:22:033
202302999270312,2687cyclictest2036117-21kworker/3:0+events20:10:293
202302999270213,2685cyclictest2052196-21kworker/3:1+events21:03:133
202302999270210,2688cyclictest2091012-21kworker/3:1+events22:53:023
202302999269913,2683cyclictest2103633-21kworker/3:0+events23:23:063
202302999269913,2682cyclictest2036117-21kworker/3:0+events20:17:393
202302999269910,2685cyclictest2052196-21kworker/3:1+events20:56:233
202302999269813,2681cyclictest2069936-21kworker/3:0+events21:36:513
20230299926956,2685cyclictest2076588-21kworker/3:3+events21:58:523
202302999269511,2680cyclictest2024274-21kworker/3:2+events19:16:133
202301399269313,2678cyclictest2047597-21kworker/0:2+events20:25:090
202301899269214,2674cyclictest2026725-21kworker/1:0+events19:24:541
202302999269113,2674cyclictest2052196-21kworker/3:1+events21:11:553
202301399269113,2676cyclictest2074678-21kworker/0:1+events22:00:240
202301399269113,2674cyclictest2094414-21kworker/0:2+events22:54:550
202301399269113,2674cyclictest2084591-21kworker/0:2+events22:25:250
202301399269113,2674cyclictest2031217-21kworker/0:2+events19:47:140
202301399269013,2673cyclictest2074678-21kworker/0:1+events21:51:190
202302499268813,2671cyclictest2060198-21kworker/2:0+events21:02:282
20230139926889,2675cyclictest2116504-21kworker/0:0+events00:12:500
202302999268713,2670cyclictest2100819-21kworker/3:2+events23:13:563
202302999268412,2670cyclictest2083107-21kworker/3:1+events22:16:403
202301399268411,2669cyclictest2039203-21kworker/0:2+events20:06:200
202301899268313,2666cyclictest2076278-21kworker/1:0+events21:56:361
202302499268112,2665cyclictest2115105-21kworker/2:3+events00:05:142
202301399267813,2661cyclictest2078186-21kworker/0:0+events22:07:590
202302999267712,2661cyclictest2119541-21kworker/3:2+events00:32:003
202301899267513,2658cyclictest2100520-21kworker/1:2+events23:11:181
202302499267411,2658cyclictest2074533-21kworker/2:0+events21:50:542
202302499267211,2658cyclictest2044025-21kworker/2:0+events20:21:242
202301899267013,2653cyclictest2092784-21kworker/1:2+events22:48:291
202302499266913,2652cyclictest2050751-21kworker/2:0+events20:37:212
202302499266912,2653cyclictest2110279-21kworker/2:1+events23:44:422
202302499266911,2654cyclictest2032750-21kworker/2:2+events19:42:482
202301899266913,2652cyclictest2044144-21kworker/1:2+events20:12:451
202301899266613,2649cyclictest2063546-21kworker/1:0+events21:34:351
202302499266510,2651cyclictest2119663-21kworker/2:1+events00:20:542
202301899266413,2649cyclictest2119513-21kworker/1:0+events00:10:061
202301899266311,2648cyclictest2105325-21kworker/1:2+events23:41:381
202302499266213,2645cyclictest2076536-21kworker/2:1+events21:55:502
202301899266213,2645cyclictest2108775-21kworker/1:3+events23:36:211
202301399266012,2644cyclictest2067466-21kworker/0:1+events21:27:450
202301399265910,2647cyclictest2078186-21kworker/0:0+events22:15:100
202301399265813,2641cyclictest2116504-21kworker/0:0+events00:02:370
202301399265713,2640cyclictest2054177-21kworker/0:3+events20:48:470
20230139926564,2648cyclictest2039203-21kworker/0:2+events20:04:040
202301399265613,2639cyclictest2031217-21kworker/0:2+events19:44:170
202301399265511,2640cyclictest2119778-21kworker/0:1+events00:39:360
202301399264913,2632cyclictest2061826-21kworker/0:2+events21:11:090
202302499264513,2629cyclictest2114880-21kworker/2:1+events23:53:552
202301899264513,2628cyclictest2069908-21kworker/1:1+events22:10:581
202302499264413,2627cyclictest2088147-21kworker/2:2+events22:48:052
202301399264313,2627cyclictest2096047-21kworker/0:1+events23:05:380
202301399264213,2625cyclictest2098919-21kworker/0:0+events23:02:130
202301399264111,2626cyclictest2054177-21kworker/0:3+events20:57:520
202301399263913,2622cyclictest2092696-21kworker/0:1+events22:43:560
202301399263912,2623cyclictest2035964-21kworker/0:0+events19:55:180
202301399263912,2623cyclictest2035964-21kworker/0:0+events19:55:180
202301399263911,2624cyclictest2031217-21kworker/0:2+events19:37:080
202301399263813,2623cyclictest2065086-21kworker/0:2+events21:20:110
202301399263813,2621cyclictest2065086-21kworker/0:2+events21:19:250
202301899263513,2618cyclictest2054419-21kworker/1:0+events20:53:191
202301399263413,2617cyclictest2084591-21kworker/0:2+events22:32:580
202302999262711,2612cyclictest2036117-21kworker/3:0+events20:27:493
202302499262713,2610cyclictest2068098-21kworker/2:2+events21:42:342
202301399262713,2610cyclictest2044116-21kworker/0:1+events20:22:310
202302499262613,2609cyclictest2044025-21kworker/2:0+events20:25:552
202302499262612,2611cyclictest2049139-21kworker/2:2+events20:41:342
202301899262613,2609cyclictest2103706-21kworker/1:0+events23:21:551
202301399262613,2609cyclictest2050861-21kworker/0:0+events20:34:400
202302499262513,2608cyclictest2060198-21kworker/2:0+events21:23:092
202302499262413,2607cyclictest2115105-21kworker/2:3+events00:00:432
202302499262313,2606cyclictest2068098-21kworker/2:2+events21:47:562
202301899262310,2609cyclictest2126443-21kworker/1:2+events00:36:341
202301899262213,2607cyclictest2114819-21kworker/1:1+events00:25:321
202301899262213,2605cyclictest2103706-21kworker/1:0+events23:19:131
202301899262212,2606cyclictest2044144-21kworker/1:2+events20:18:001
202302999262113,2604cyclictest2028087-21kworker/3:1+events19:31:453
202301899262113,2605cyclictest2032547-21kworker/1:1+events19:43:351
202301399262113,2604cyclictest2119778-21kworker/0:1+events00:20:300
202301899262013,2604cyclictest2106923-21kworker/1:1+events23:32:121
202301899262013,2603cyclictest2029302-21kworker/1:2+events19:37:301
20230189926196,2609cyclictest2114819-21kworker/1:1+events00:06:001
202301899261813,2601cyclictest2122964-21kworker/1:0+events00:24:461
202301899261713,2601cyclictest2087996-21kworker/1:1+events22:56:061
20230189926168,2604cyclictest2063546-21kworker/1:0+events21:27:231
202302499261513,2598cyclictest2088147-21kworker/2:2+events22:37:522
202302499261512,2599cyclictest2084558-21kworker/2:1+events22:23:542
202301399261412,2599cyclictest2107104-21kworker/0:2+events23:35:580
202302499261313,2592cyclictest2068098-21kworker/2:2+events21:28:062
202301399260713,2590cyclictest2037574-21kworker/0:1+events19:53:230
202301399260712,2591cyclictest2071301-21kworker/0:2+events21:40:370
202302499260212,2587cyclictest2032750-21kworker/2:2+events19:59:052
202302499260212,2587cyclictest2032750-21kworker/2:2+events19:59:052
202301399259813,2581cyclictest2029569-21kworker/0:0+events19:30:370
202302499259413,2577cyclictest2121266-21kworker/2:2+events00:14:462
202301899259312,2579cyclictest2047652-21kworker/1:0+events20:35:031
202301399258413,2567cyclictest2044116-21kworker/0:1+events20:17:180
20230299925830,2579cyclictest2074377-21kworker/3:0+events21:50:113
20230249925806,2570cyclictest2054095-21kworker/2:1+events20:48:252
202302499258012,2564cyclictest2126173-21kworker/2:2+events00:29:212
202301899258012,2564cyclictest2069908-21kworker/1:1+events22:05:421
202302499257912,2565cyclictest2119663-21kworker/2:1+events00:35:492
202302499257812,2563cyclictest2035905-21kworker/2:0+events19:49:352
202302499257712,2562cyclictest2108532-21kworker/2:0+events23:33:442
202302499257712,2562cyclictest2032750-21kworker/2:2+events20:01:452
202302499257712,2561cyclictest2099191-21kworker/2:1+events23:23:292
202301399257712,2561cyclictest2126111-21kworker/0:0+events00:28:580
202301399257613,2559cyclictest2084591-21kworker/0:2+events22:35:590
202301899257512,2559cyclictest2069908-21kworker/1:1+events21:45:351
202302499257412,2559cyclictest2029244-21kworker/2:0+events19:26:462
202301899257313,2557cyclictest2069908-21kworker/1:1+events22:17:261
202301899257312,2557cyclictest2032547-21kworker/1:1+events19:48:491
202302499257212,2558cyclictest2068098-21kworker/2:2+events21:30:032
202302499257112,2555cyclictest2081039-21kworker/2:2+events22:18:082
202302499257111,2556cyclictest2099191-21kworker/2:1+events23:06:012
202301899257112,2556cyclictest2121328-21kworker/1:2+events00:15:311
202301899257012,2556cyclictest2056941-21kworker/1:2+events21:05:081
20230249925429,2529cyclictest2049139-21kworker/2:2+events20:32:462
202301899253314,2515cyclictest2047652-21kworker/1:0+events20:28:351
202301399252612,2510cyclictest2116504-21kworker/0:0+events23:59:320
202301399252312,2508cyclictest2098919-21kworker/0:0+events23:23:500
202301399252112,2506cyclictest2102274-21kworker/0:1+events23:16:120
202301899251311,2499cyclictest2036088-21kworker/1:0+events20:05:561
202301399250412,2488cyclictest2119778-21kworker/0:1+events00:33:530
202302999250012,2485cyclictest2028087-21kworker/3:1+events19:26:033
202301899249912,2484cyclictest2024427-21kworker/1:1+events19:26:241
202301899249812,2482cyclictest2105325-21kworker/1:2+events23:52:031
202301899249112,2475cyclictest2036088-21kworker/1:0+events19:54:321
202301399248911,2474cyclictest2067466-21kworker/0:1+events21:34:120
202302499248812,2472cyclictest2011638-21kworker/2:0+events19:11:372
202301899248612,2470cyclictest2126443-21kworker/1:2+events00:31:151
20230189924829,2469cyclictest2022743-21kworker/1:2+events19:12:221
202301899248012,2465cyclictest2069908-21kworker/1:1+events21:41:241
20230299924798,2467cyclictest2124625-21kworker/3:1+events00:27:053
202302999247812,2462cyclictest2022534-21kworker/3:1+events19:13:093
202302999247612,2460cyclictest2052196-21kworker/3:1+events20:51:273
20230299924759,2462cyclictest2028087-21kworker/3:1+events19:53:473
202302999247412,2460cyclictest2066702-21kworker/3:1+events21:46:003
202302999247311,2459cyclictest2103633-21kworker/3:0+events23:39:243
202302999247110,2457cyclictest2079557-21kworker/3:1+events22:04:143
202302999247012,2456cyclictest2110072-21kworker/3:1+events00:06:223
202301399246312,2447cyclictest2067466-21kworker/0:1+events21:39:500
202302499245913,2442cyclictest2063456-21kworker/2:2+events21:16:502
202302499244912,2433cyclictest2113146-21kworker/2:2+events23:47:242
202302499244412,2428cyclictest2099191-21kworker/2:1+events23:26:502
202301399243811,2423cyclictest2109979-21kworker/0:1+events23:50:290
202301399243712,2421cyclictest2113331-21kworker/0:2+events23:49:180
202302999243212,2416cyclictest2097477-21kworker/3:0+events23:07:073
202301399243210,2418cyclictest2084591-21kworker/0:2+events22:24:150
202301399242412,2408cyclictest2119778-21kworker/0:1+events00:16:170
202302499241610,2403cyclictest2095839-21kworker/2:1+events22:53:472
202301399241312,2397cyclictest2094414-21kworker/0:2+events22:56:300
202301399241212,2396cyclictest2094414-21kworker/0:2+events22:49:590
202301399241211,2397cyclictest2024128-21kworker/0:0+events19:17:460
202301399241112,2396cyclictest2039203-21kworker/0:2+events20:11:590
202301399241012,2395cyclictest2005126-21kworker/0:1+events19:23:460
202301399240512,2390cyclictest2050861-21kworker/0:0+events20:43:300
202301899239612,2380cyclictest2087996-21kworker/1:1+events23:06:241
20230249923948,2382cyclictest2024158-21kworker/2:1+events19:18:532
202301399239412,2378cyclictest2071301-21kworker/0:2+events21:59:380
202301899238812,2374cyclictest2049258-21kworker/1:2+events20:30:051
202301399237611,2362cyclictest2024128-21kworker/0:0+events19:14:430
202301399235112,2336cyclictest2109979-21kworker/0:1+events23:42:010
202302499234311,2330cyclictest2114880-21kworker/2:1+events23:56:532
202301899234012,2325cyclictest2092784-21kworker/1:2+events22:44:171
20224142190160,25sleep20-21swapper/219:05:252
20224702179149,25sleep00-21swapper/019:06:070
20227152143111,27sleep10-21swapper/119:09:161
20225202143109,28sleep30-21swapper/319:06:473
202301399281,9cyclictest2108759-21idleruntime-cro23:35:000
202302499177,3cyclictest191rcu_preempt21:35:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional