You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 14:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Sat Dec 27, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26384299957397,5728cyclictest2639512-21kworker/2:0+events19:11:272
263842399570821,5683cyclictest2628231-21kworker/0:1+events19:11:500
263843399381915,3800cyclictest2636618-21kworker/3:0+events19:11:043
263842699321312,3198cyclictest2635463-21kworker/1:0+events19:12:111
263842399295714,2939cyclictest2694926-21kworker/0:1+events22:15:010
263842399287814,2859cyclictest2658133-21kworker/0:2+events20:15:010
263842699279113,2773cyclictest2685368-21kworker/1:1+events21:35:211
263842699276913,2751cyclictest2683764-21kworker/1:0+events21:40:121
263843399271113,2694cyclictest2740214-21kworker/3:0+events00:25:173
263843399248511,2471cyclictest2673006-21kworker/3:2+events21:00:163
263842399244512,2429cyclictest2661274-21kworker/0:0+events20:30:180
263843399242112,2407cyclictest2711120-21kworker/3:1+events22:55:173
263843399240711,2393cyclictest2702833-21kworker/3:0+events22:39:453
263842999239311,2379cyclictest2666421-21kworker/2:0+events20:50:202
263842999236211,2347cyclictest2656317-21kworker/2:1+events20:24:142
263842999236211,2347cyclictest2656317-21kworker/2:1+events20:24:132
263842699235612,2340cyclictest2733709-21kworker/1:1+events00:19:361
263842999234112,2326cyclictest2639512-21kworker/2:0+events19:15:152
263843399230412,2290cyclictest2731832-21kworker/3:1+events00:30:133
263842999228310,2270cyclictest2656317-21kworker/2:1+events20:32:352
263842999227711,2263cyclictest2730380-21kworker/2:0+events00:02:242
263842699227411,2260cyclictest2698181-21kworker/1:0+events22:26:331
263842699227410,2262cyclictest2719198-21kworker/1:1+events23:25:471
263842699226711,2253cyclictest2646312-21kworker/1:2+events19:40:151
263842699226611,2251cyclictest2744602-21kworker/1:2+events00:38:111
263842399226610,2253cyclictest2694926-21kworker/0:1+events22:18:050
26384269922639,2250cyclictest2646312-21kworker/1:2+events19:34:341
263842399226311,2249cyclictest2677567-21kworker/0:1+events21:11:170
263842999226211,2248cyclictest2701236-21kworker/2:0+events22:32:522
263842999225811,2244cyclictest2728785-21kworker/2:1+events23:54:252
26384339922444,2237cyclictest2712770-21kworker/3:0+events23:11:103
263842399224411,2230cyclictest2736829-21kworker/0:2+events00:15:220
263842399223610,2223cyclictest2701308-21kworker/0:0+events22:36:210
26384269922297,2219cyclictest2727251-21kworker/1:0+events23:45:251
263843399222611,2211cyclictest2723767-21kworker/3:0+events23:40:133
263843399221911,2205cyclictest2721439-21kworker/3:1+events23:29:353
26384269922195,2211cyclictest2669546-21kworker/1:2+events20:48:051
263842999221311,2199cyclictest2733561-21kworker/2:2+events00:14:362
26384339922039,2190cyclictest2693424-21kworker/3:2+events22:12:013
263842399217210,2159cyclictest2714671-21kworker/0:0+events23:15:240
26384339921709,2157cyclictest2723767-21kworker/3:0+events23:37:103
26384339921698,2157cyclictest2731832-21kworker/3:1+events00:16:313
26384339921548,2143cyclictest2693424-21kworker/3:2+events22:27:373
263843399212210,2109cyclictest2702833-21kworker/3:0+events22:34:263
26384239921229,2110cyclictest2711409-21kworker/0:2+events23:04:440
263842699210511,2091cyclictest2676054-21kworker/1:2+events21:06:481
26384239921057,2094cyclictest2675941-21kworker/0:2+events21:03:200
26384299921004,2093cyclictest2674430-21kworker/2:1+events21:05:152
26384269920994,2092cyclictest2696554-21kworker/1:1+events22:10:541
263843399209810,2085cyclictest2728551-21kworker/3:0+events23:51:233
263842699209810,2084cyclictest2661307-21kworker/1:1+events20:18:281
263842999209010,2078cyclictest2651546-21kworker/2:1+events19:50:052
26384239920888,2076cyclictest2685460-21kworker/0:2+events21:43:130
263842399208610,2073cyclictest2672649-21kworker/0:0+events21:07:120
263843399208410,2071cyclictest2731832-21kworker/3:1+events00:20:223
26384299920849,2072cyclictest2738753-21kworker/2:1+events00:39:202
26384299920849,2072cyclictest2676384-21kworker/2:0+events21:10:562
263842699208410,2070cyclictest2711320-21kworker/1:2+events23:09:141
26384299920836,2074cyclictest2712916-21kworker/2:2+events23:01:182
26384299920834,2076cyclictest2720831-21kworker/2:0+events23:25:012
26384239920836,2074cyclictest2646433-21kworker/0:2+events19:35:430
26384299920828,2071cyclictest2719017-21kworker/2:2+events23:16:582
263842999208210,2069cyclictest2728785-21kworker/2:1+events23:56:192
26384269920829,2070cyclictest2641914-21kworker/1:1+events19:21:491
26384269920826,2074cyclictest2698181-21kworker/1:0+events22:30:121
263842699208210,2069cyclictest2724033-21kworker/1:1+events23:41:221
263842399208210,2069cyclictest2738465-21kworker/0:0+events00:22:590
26384299920816,2072cyclictest2678960-21kworker/2:2+events21:19:432
26384269920816,2072cyclictest2662969-21kworker/1:2+events20:34:521
26384239920818,2070cyclictest2658246-21kworker/0:3+events20:17:410
26384269920809,2068cyclictest2727251-21kworker/1:0+events00:02:461
26384269920799,2069cyclictest2714738-21kworker/1:1+events23:10:011
26384299920786,2069cyclictest2730380-21kworker/2:0+events00:05:492
26384299920786,2069cyclictest2666421-21kworker/2:0+events20:35:582
26384299920784,2071cyclictest2676384-21kworker/2:0+events21:27:192
263842999207810,2065cyclictest2656317-21kworker/2:1+events20:16:562
26384239920789,2066cyclictest2691653-21kworker/0:2+events22:09:450
26384239920787,2068cyclictest2705890-21kworker/0:1+events22:42:470
263842999207710,2064cyclictest2741460-21kworker/2:0+events00:26:452
26384269920775,2069cyclictest2735315-21kworker/1:2+events00:10:281
26384239920776,2068cyclictest2687089-21kworker/0:1+events21:45:560
26384239920776,2068cyclictest2679258-21kworker/0:0+events21:35:440
26384299920767,2066cyclictest2733561-21kworker/2:2+events00:24:072
263842699207610,2063cyclictest2735315-21kworker/1:2+events00:08:551
263842699207610,2063cyclictest2719198-21kworker/1:1+events23:23:061
263842699207610,2063cyclictest2649834-21kworker/1:1+events19:47:041
263842699207610,2062cyclictest2707805-21kworker/1:2+events22:43:091
26384269920759,2063cyclictest2653036-21kworker/1:1+events20:07:431
26384269920759,2062cyclictest2672682-21kworker/1:1+events20:57:121
26384269920758,2064cyclictest2693804-21kworker/1:0+events22:01:051
263842699207510,2061cyclictest2667865-21kworker/1:0+events20:42:031
26384239920759,2063cyclictest2683856-21kworker/0:1+events21:28:520
26384239920759,2063cyclictest2674338-21kworker/0:1+events20:59:060
263842399207510,2062cyclictest2730292-21kworker/0:1+events23:57:250
26384299920749,2062cyclictest2656317-21kworker/2:1+events20:11:552
263842999207410,2061cyclictest2699513-21kworker/2:2+events22:26:542
263842699207410,2061cyclictest2677655-21kworker/1:0+events21:19:211
26384239920748,2063cyclictest2650079-21kworker/0:2+events19:59:160
263842999207310,2060cyclictest2649891-21kworker/2:0+events19:44:032
263842699207310,2060cyclictest2691916-21kworker/1:2+events22:16:341
263842699207210,2059cyclictest2648184-21kworker/1:0+events19:38:231
26384239920718,2060cyclictest2709787-21kworker/0:0+events22:49:420
263842399207110,2058cyclictest2722282-21kworker/0:0+events23:32:370
26384299920709,2058cyclictest2714565-21kworker/2:0+events23:12:432
26384239920708,2059cyclictest2725489-21kworker/0:2+events23:42:510
263842399207010,2058cyclictest2658246-21kworker/0:3+events20:20:010
263842399207010,2058cyclictest2658246-21kworker/0:3+events20:20:000
263842399207010,2056cyclictest2672649-21kworker/0:0+events20:54:340
26384269920699,2057cyclictest2705857-21kworker/1:1+events22:51:121
263842999206810,2055cyclictest2720831-21kworker/2:0+events23:24:152
263842399206810,2055cyclictest2683856-21kworker/0:1+events21:32:160
263842399206810,2055cyclictest2679258-21kworker/0:0+events21:23:510
26384299920674,2060cyclictest2639512-21kworker/2:0+events19:24:312
26384269920676,2058cyclictest2661307-21kworker/1:1+events20:26:541
26384239920679,2055cyclictest2641522-21kworker/0:2+events19:21:260
263842399206610,2053cyclictest2648360-21kworker/0:1+events19:43:390
263843399206510,2052cyclictest2728551-21kworker/3:0+events23:49:553
26384299920658,2054cyclictest2648214-21kworker/2:2+events19:45:102
26384269920657,2055cyclictest2705857-21kworker/1:1+events22:49:191
26384239920657,2055cyclictest2667774-21kworker/0:0+events20:40:110
26384299920649,2052cyclictest2639512-21kworker/2:0+events19:30:182
26384299920646,2054cyclictest2701236-21kworker/2:0+events22:23:522
26384269920646,2055cyclictest2691916-21kworker/1:2+events21:55:491
26384269920644,2057cyclictest2738371-21kworker/1:0+events00:21:071
263842399206410,2051cyclictest2730292-21kworker/0:1+events23:54:470
263842399206410,2051cyclictest2687089-21kworker/0:1+events21:52:470
26384339920635,2055cyclictest2702833-21kworker/3:0+events22:42:243
26384299920635,2055cyclictest2676384-21kworker/2:0+events22:04:062
263843399206210,2049cyclictest2716105-21kworker/3:2+events23:19:153
26384269920629,2050cyclictest2653036-21kworker/1:1+events20:03:281
263843399206110,2048cyclictest2716105-21kworker/3:2+events23:20:473
26384269920617,2051cyclictest2683764-21kworker/1:0+events21:33:251
263842699206110,2048cyclictest2722397-21kworker/1:2+events23:33:221
26384339920583,2052cyclictest2661548-21kworker/3:0+events20:44:213
263843399205810,2045cyclictest2680775-21kworker/3:1+events21:49:013
263843399205810,2045cyclictest2648420-21kworker/3:2+events19:44:253
26384299920589,2046cyclictest2712916-21kworker/2:2+events23:06:362
263843399205710,2044cyclictest2680775-21kworker/3:1+events21:52:243
26384239920578,2046cyclictest2662910-21kworker/0:1+events20:48:260
263843399205510,2042cyclictest2735518-21kworker/3:0+events00:11:573
263843399205510,2042cyclictest2646463-21kworker/3:1+events19:58:543
263842699205410,2041cyclictest2727251-21kworker/1:0+events23:51:461
26384339920537,2043cyclictest2714508-21kworker/3:1+events23:08:073
263842999205310,2040cyclictest2711266-21kworker/2:1+events22:56:032
26384269920538,2042cyclictest2648184-21kworker/1:0+events19:55:051
263842699205310,2040cyclictest2648184-21kworker/1:0+events19:53:111
26384239920538,2042cyclictest2736829-21kworker/0:2+events00:13:270
26384269920526,2042cyclictest2686970-21kworker/1:2+events21:47:051
26384239920519,2039cyclictest2722282-21kworker/0:0+events23:28:020
26384299920509,2038cyclictest2702892-21kworker/2:1+events22:39:222
26384339920499,2037cyclictest2728551-21kworker/3:0+events23:57:483
26384339920489,2036cyclictest2646463-21kworker/3:1+events19:45:563
26384339920476,2038cyclictest2679138-21kworker/3:2+events21:23:293
263843399204710,2033cyclictest2688558-21kworker/3:0+events21:42:513
26384269920479,2035cyclictest2738371-21kworker/1:0+events00:26:231
26384339920469,2034cyclictest2680775-21kworker/3:1+events21:31:313
26384339920459,2033cyclictest2661548-21kworker/3:0+events20:36:213
26384299920458,2034cyclictest2704655-21kworker/2:2+events22:46:402
26384239920459,2032cyclictest2717622-21kworker/0:2+events23:14:160
26384239920458,2034cyclictest2628231-21kworker/0:1+events19:18:190
263843399204410,2031cyclictest2671081-21kworker/3:1+events20:50:423
263843399204210,2029cyclictest2721439-21kworker/3:1+events23:33:003
263842999204210,2029cyclictest2676384-21kworker/2:0+events21:24:132
26384339920419,2029cyclictest2691753-21kworker/3:0+events21:59:563
26384339920418,2030cyclictest2656378-21kworker/3:2+events20:23:513
26384339920418,2030cyclictest2656378-21kworker/3:2+events20:23:503
263843399204110,2028cyclictest2706158-21kworker/3:2+events23:00:553
26384299920417,2031cyclictest2674430-21kworker/2:1+events21:01:252
26384299920409,2028cyclictest2704655-21kworker/2:2+events22:41:172
26384339920397,2029cyclictest2682957-21kworker/3:0+events21:26:563
26384339920386,2029cyclictest2693424-21kworker/3:2+events22:19:373
26384239920386,2029cyclictest2717622-21kworker/0:2+events23:23:540
26384339920368,2025cyclictest2706158-21kworker/3:2+events22:47:033
26384239920314,2024cyclictest2735164-21kworker/0:1+events00:32:280
26384299920308,2019cyclictest2688844-21kworker/2:1+events21:48:392
26384239920307,2020cyclictest2713007-21kworker/0:1+events23:06:590
263843399202810,2015cyclictest2646463-21kworker/3:1+events19:51:143
26384269920268,2015cyclictest2679374-21kworker/1:2+events21:26:321
26384269920266,2017cyclictest2639839-21kworker/1:2+events19:17:551
26384339920258,2014cyclictest2731832-21kworker/3:1+events00:00:283
26384339920253,2019cyclictest2673006-21kworker/3:2+events20:56:503
26384269920239,2011cyclictest2641914-21kworker/1:1+events19:26:521
26384269920218,2010cyclictest2662969-21kworker/1:2+events20:37:281
26384239920219,2010cyclictest2691653-21kworker/0:2+events22:02:340
26384239920208,2008cyclictest2655022-21kworker/0:0+events20:04:130
26384299920198,2008cyclictest2666421-21kworker/2:0+events20:41:422
26384239920187,2008cyclictest2679258-21kworker/0:0+events21:15:300
26384269920159,2003cyclictest2691916-21kworker/1:2+events22:08:141
26384339920148,2003cyclictest2661548-21kworker/3:0+events21:05:373
26384299920149,2002cyclictest2693365-21kworker/2:1+events21:58:252
26384299920149,2002cyclictest2685554-21kworker/2:1+events21:39:052
26384299920147,2004cyclictest2724360-21kworker/2:0+events23:36:242
26384299920145,2006cyclictest2676384-21kworker/2:0+events21:50:552
26384269920149,2002cyclictest2711320-21kworker/1:2+events22:55:401
26384269920147,2004cyclictest2727251-21kworker/1:0+events23:57:041
26384269920146,2005cyclictest2659439-21kworker/1:2+events20:14:391
26384299920139,2001cyclictest2696706-21kworker/2:1+events22:15:462
26384299920138,2002cyclictest2695045-21kworker/2:2+events22:08:362
26384269920139,2001cyclictest2698181-21kworker/1:0+events22:25:001
26384269920139,2001cyclictest2672682-21kworker/1:1+events21:14:211
26384239920139,2001cyclictest2643156-21kworker/0:0+events19:32:580
263842999201210,1999cyclictest2687266-21kworker/2:2+events21:44:252
26384239920126,2004cyclictest2728699-21kworker/0:0+events23:49:310
26384269920116,2002cyclictest2688679-21kworker/1:1+events21:54:401
26384269920111,2007cyclictest2672682-21kworker/1:1+events21:04:041
26384239920118,2000cyclictest2699697-21kworker/0:2+events22:20:480
26384339920107,2000cyclictest2661548-21kworker/3:0+events21:17:043
26384299920108,1999cyclictest2707744-21kworker/2:0+events22:52:422
26384299920108,1999cyclictest2654341-21kworker/2:2+events19:58:312
26384269920109,1998cyclictest2717439-21kworker/1:0+events23:18:041
26384239920108,1999cyclictest2650079-21kworker/0:2+events19:45:340
26384339920099,1997cyclictest2656378-21kworker/3:2+events20:19:153
26384269920099,1997cyclictest2738371-21kworker/1:0+events00:31:431
263842699200910,1996cyclictest2698181-21kworker/1:0+events22:37:531
26384269920089,1996cyclictest2667865-21kworker/1:0+events20:51:291
26384299920079,1995cyclictest2649891-21kworker/2:0+events20:06:102
26384299920077,1997cyclictest2649891-21kworker/2:0+events20:01:102
26384239920079,1995cyclictest2661274-21kworker/0:0+events20:26:090
263842399200710,1994cyclictest2731980-21kworker/0:2+events00:01:590
26384339920065,1998cyclictest2632956-21kworker/3:2+events19:24:553
263843399200610,1993cyclictest2661548-21kworker/3:0+events20:49:333
263843399200610,1993cyclictest2659590-21kworker/3:1+events20:13:283
26384339920058,1994cyclictest2646463-21kworker/3:1+events20:03:523
26384269920054,1998cyclictest2717439-21kworker/1:0+events23:38:441
263842699200510,1992cyclictest2712977-21kworker/1:0+events23:03:571
26384299920049,1992cyclictest2645274-21kworker/2:1+events19:39:312
26384239920048,1993cyclictest2735164-21kworker/0:1+events00:07:220
26384239920044,1997cyclictest2662910-21kworker/0:1+events20:37:510
263842399200310,1990cyclictest2703079-21kworker/0:2+events22:32:070
26384239920028,1992cyclictest2650079-21kworker/0:2+events19:50:280
26384239920027,1992cyclictest2741855-21kworker/0:0+events00:35:530
263842399200110,1989cyclictest2652498-21kworker/0:1+events20:05:020
26384269920009,1988cyclictest2661307-21kworker/1:1+events20:21:551
26384269920009,1988cyclictest2661307-21kworker/1:1+events20:21:551
26384299919989,1986cyclictest2656317-21kworker/2:1+events20:29:342
26384239919987,1988cyclictest2691653-21kworker/0:2+events21:57:180
26384239919974,1990cyclictest2711409-21kworker/0:2+events22:59:490
26384339919969,1984cyclictest2661548-21kworker/3:0+events20:27:393
26384339919939,1981cyclictest2657983-21kworker/3:0+events20:08:063
26384339919929,1980cyclictest2644853-21kworker/3:0+events19:29:543
26384339919907,1980cyclictest2679138-21kworker/3:2+events21:13:573
263843399199010,1977cyclictest2693424-21kworker/3:2+events22:07:043
26384339919879,1975cyclictest2691753-21kworker/3:0+events22:04:493
26384339919849,1972cyclictest2644853-21kworker/3:0+events19:33:223
26384239919819,1969cyclictest2740114-21kworker/0:2+events00:28:160
26384299919808,1968cyclictest2722429-21kworker/2:2+events23:49:092
26384339919798,1968cyclictest2644853-21kworker/3:0+events19:37:393
26384339919779,1965cyclictest2706158-21kworker/3:2+events22:50:513
263843399197710,1964cyclictest2680775-21kworker/3:1+events21:36:273
26384339919769,1964cyclictest2693424-21kworker/3:2+events22:24:133
26384339919738,1962cyclictest2632956-21kworker/3:2+events19:16:243
26384339919733,1967cyclictest2664782-21kworker/3:2+events20:30:433
26384339919728,1961cyclictest2743325-21kworker/3:2+events00:39:413
26384339919706,1961cyclictest2733890-21kworker/3:2+events00:09:193
263842999196810,1955cyclictest2674430-21kworker/2:1+events20:59:542
26384299919658,1955cyclictest2676384-21kworker/2:0+events22:10:092
26384299919439,1931cyclictest2643410-21kworker/2:2+events19:26:282
26384239919369,1924cyclictest2725489-21kworker/0:2+events23:39:490
26384269919359,1923cyclictest2681810-21kworker/1:1+events21:24:351
26384299919327,1922cyclictest2733561-21kworker/2:2+events00:15:442
26384239919319,1919cyclictest2643156-21kworker/0:0+events19:27:140
26384239919278,1916cyclictest2709787-21kworker/0:0+events22:54:310
26378752145114,26sleep10-21swapper/119:09:111
26377592142106,30sleep20-21swapper/219:07:392
26377972141112,23sleep00-21swapper/019:08:100
26378222140108,27sleep30-21swapper/319:08:283
2638429991711,4cyclictest2671063-21chrt20:49:112
263842999170,15cyclictest2726193-21/usr/sbin/munin23:40:132
263842999170,15cyclictest2685569-21runrttasks21:34:162
263842399177,4cyclictest2702403-10awk22:25:190
263842999150,14cyclictest2743356-21taskset00:34:342
263842999140,2cyclictest2723749-21/usr/sbin/munin23:30:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional