You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 07:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Fri May 09, 2025 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
98742899417720,4150cyclictest1003892-21kworker/2:1+events20:30:002
98742199278013,2761cyclictest1054024-21kworker/0:1+events22:35:140
98742899277511,2759cyclictest1028680-21kworker/2:2+events21:45:132
98742199275613,2740cyclictest1087732-21kworker/0:2+events00:20:010
98743199275313,2735cyclictest995923-21kworker/3:0+events20:00:123
98742699271912,2703cyclictest1060410-21kworker/1:0+events22:55:191
98742699269712,2681cyclictest1016094-21kworker/1:2+events20:35:181
98742899269611,2681cyclictest987557-21kworker/2:2+events19:20:152
98742199269210,2679cyclictest1047367-21kworker/0:0+events22:25:220
98742199268211,2667cyclictest1019242-21kworker/0:2+events20:55:200
98743199267212,2655cyclictest1019186-21kworker/3:1+events21:05:133
98743199267212,2655cyclictest1019186-21kworker/3:1+events21:05:133
98742699266112,2647cyclictest1002179-21kworker/1:0+events19:55:161
98742699265413,2636cyclictest1066786-21kworker/1:2+events23:15:111
98743199265313,2637cyclictest1019186-21kworker/3:1+events20:50:013
98742699264511,2629cyclictest1051000-21kworker/1:2+events22:30:181
98742199255212,2537cyclictest1087732-21kworker/0:2+events00:30:180
98742199255011,2535cyclictest1086108-21kworker/0:0+events00:25:220
98743199254012,2524cyclictest1031636-21kworker/3:1+events21:25:183
98742699248912,2473cyclictest1016094-21kworker/1:2+events20:42:271
98742199247912,2463cyclictest1058931-21kworker/0:1+events22:51:110
98742699247811,2463cyclictest1047637-21kworker/1:2+events22:18:551
98742899247511,2460cyclictest1062155-21kworker/2:2+events23:14:492
98742199245712,2442cyclictest1084511-21kworker/0:1+events00:13:160
98742199243912,2424cyclictest1073166-21kworker/0:2+events23:35:190
98742699243411,2419cyclictest1027025-21kworker/1:1+events21:35:371
98743199242212,2406cyclictest1042627-21kworker/3:0+events22:05:193
98742699242012,2404cyclictest1051000-21kworker/1:2+events23:00:181
98743199240310,2389cyclictest1055915-21kworker/3:2+events22:42:063
98742899239712,2381cyclictest1014114-21kworker/2:0+events20:52:402
98742899239611,2382cyclictest1054084-21kworker/2:2+events22:45:522
98742899238912,2374cyclictest1003892-21kworker/2:1+events20:39:492
98742899238710,2374cyclictest1047429-21kworker/2:1+events22:28:262
98742199238712,2371cyclictest1048969-21kworker/0:1+events22:23:510
98742199235312,2337cyclictest1081210-21kworker/0:1+events23:58:070
9874289923466,2337cyclictest1071502-21kworker/2:2+events23:43:162
98743199234111,2326cyclictest1069843-21kworker/3:2+events23:27:423
98742699234010,2327cyclictest1063600-21kworker/1:1+events23:09:011
98743199233912,2324cyclictest1015827-21kworker/3:2+events20:36:463
98743199232812,2314cyclictest1078248-21kworker/3:1+events23:50:113
98743199232812,2312cyclictest995923-21kworker/3:0+events20:18:113
9874319923251,2320cyclictest1034837-21kworker/3:2+events21:40:133
98743199232512,2310cyclictest1019186-21kworker/3:1+events21:02:083
98743199232012,2304cyclictest1073138-21kworker/3:0+events23:40:383
98742699232011,2305cyclictest1046013-21kworker/1:1+events22:26:541
98742199232010,2307cyclictest1047367-21kworker/0:0+events22:15:500
98742899231910,2307cyclictest1076616-21kworker/2:0+events00:00:492
98742699231912,2304cyclictest1014173-21kworker/1:0+events20:29:351
98742699231612,2300cyclictest1027025-21kworker/1:1+events21:17:211
98743199230912,2294cyclictest1055915-21kworker/3:2+events22:50:493
98742199229811,2284cyclictest1019242-21kworker/0:2+events20:49:120
98743199229712,2282cyclictest1069843-21kworker/3:2+events23:37:343
98743199229512,2279cyclictest1029987-21kworker/3:0+events21:16:363
98743199227912,2265cyclictest1020870-21kworker/3:0+events20:54:563
98742699227111,2256cyclictest1041158-21kworker/1:1+events21:57:471
98742199226811,2254cyclictest1015887-21kworker/0:2+events20:33:260
98742199226410,2251cyclictest995546-21kworker/0:1+events19:34:210
98742699226211,2247cyclictest1082947-21kworker/1:0+events00:25:441
98742199226111,2247cyclictest1060555-21kworker/0:2+events22:59:310
98742699225911,2245cyclictest1004018-21kworker/1:2+events20:09:251
9874269922569,2244cyclictest1087791-21kworker/1:1+events00:21:081
98742699225611,2242cyclictest1033494-21kworker/1:2+events21:31:031
98742699225310,2239cyclictest1016094-21kworker/1:2+events20:49:371
98742699225310,2239cyclictest1008995-21kworker/1:0+events20:17:051
9874269922529,2240cyclictest995588-21kworker/1:0+events19:33:101
98742699225110,2238cyclictest1079652-21kworker/1:2+events00:06:291
98742199224710,2233cyclictest1038208-21kworker/0:2+events21:57:240
98743199223411,2220cyclictest994303-21kworker/3:2+events19:48:493
98743199222611,2213cyclictest979035-21kworker/3:1+events19:30:103
98743199222511,2210cyclictest1007282-21kworker/3:1+events20:11:413
98742899222211,2207cyclictest1084364-21kworker/2:1+events00:06:512
98742699222010,2207cyclictest1077983-21kworker/1:0+events23:45:581
98743199221810,2203cyclictest1042627-21kworker/3:0+events22:00:493
98743199221610,2203cyclictest995923-21kworker/3:0+events19:56:013
98742699221010,2197cyclictest988842-21kworker/1:2+events19:36:411
98742899220212,2188cyclictest1066650-21kworker/2:0+events23:20:062
98742899220111,2187cyclictest1003892-21kworker/2:1+events20:12:272
98742199219611,2181cyclictest1019242-21kworker/0:2+events21:04:510
98742199219510,2181cyclictest1073166-21kworker/0:2+events23:47:530
98742899218610,2173cyclictest1085960-21kworker/2:0+events00:14:212
98742199218611,2171cyclictest1007518-21kworker/0:2+events20:23:060
9874289921858,2174cyclictest1042921-21kworker/2:1+events22:01:572
98742899218510,2171cyclictest1057210-21kworker/2:0+events22:58:442
9874219921859,2173cyclictest1019242-21kworker/0:2+events21:34:510
98742899218411,2170cyclictest1049059-21kworker/2:0+events22:18:102
9874289921834,2175cyclictest1014114-21kworker/2:0+events20:32:392
98742899218312,2167cyclictest1035013-21kworker/2:0+events21:43:392
98742899218311,2169cyclictest1028680-21kworker/2:2+events21:52:502
98742899218310,2170cyclictest1044627-21kworker/2:0+events22:06:482
98742899218310,2169cyclictest1035013-21kworker/2:0+events21:37:332
9874219921839,2170cyclictest1044691-21kworker/0:2+events22:07:560
98742199218311,2169cyclictest997361-21kworker/0:0+events19:48:280
98742199218311,2168cyclictest1015887-21kworker/0:2+events20:35:410
98742899218011,2167cyclictest1092552-21kworker/2:1+events00:37:072
9874219921807,2170cyclictest1047367-21kworker/0:0+events22:34:060
98742199218010,2166cyclictest1025426-21kworker/0:0+events21:13:120
98742899217911,2164cyclictest1089236-21kworker/2:1+events00:24:132
98742699217911,2165cyclictest1027025-21kworker/1:1+events21:10:331
98742199217910,2166cyclictest995546-21kworker/0:1+events20:02:300
98742199217811,2164cyclictest1065404-21kworker/0:1+events23:11:460
98742199217810,2165cyclictest1041351-21kworker/0:1+events22:02:200
98742199217810,2164cyclictest1079584-21kworker/0:0+events23:52:030
98742199217711,2162cyclictest990953-21kworker/0:3+events19:35:560
98742199217711,2162cyclictest1063774-21kworker/0:0+events23:05:580
98742199217610,2163cyclictest1044691-21kworker/0:2+events22:13:340
98742199217610,2162cyclictest1013993-21kworker/0:0+events20:26:580
98742199217511,2160cyclictest1055884-21kworker/0:2+events22:40:110
98742199217510,2162cyclictest1071530-21kworker/0:0+events23:29:140
98743199217411,2160cyclictest1079848-21kworker/3:0+events00:34:053
9874219921749,2162cyclictest1034867-21kworker/0:0+events21:38:410
9874219921739,2161cyclictest1017569-21kworker/0:1+events20:40:340
98742899217110,2157cyclictest1022265-21kworker/2:2+events21:01:002
98742199216811,2154cyclictest990673-21kworker/0:1+events19:22:090
98742199216811,2154cyclictest1065404-21kworker/0:1+events23:24:210
98742899216710,2153cyclictest997419-21kworker/2:2+events19:40:292
9874219921669,2154cyclictest1079584-21kworker/0:0+events00:01:570
98742899216510,2151cyclictest1014114-21kworker/2:0+events20:47:202
98743199216411,2150cyclictest1057538-21kworker/3:0+events22:49:443
98742899216411,2150cyclictest1028680-21kworker/2:2+events22:11:162
98742899216411,2149cyclictest1003892-21kworker/2:1+events20:24:182
98742899216410,2150cyclictest1052394-21kworker/2:0+events22:30:412
9874289921638,2152cyclictest1085960-21kworker/2:0+events00:28:462
98742199216310,2150cyclictest1036557-21kworker/0:1+events21:43:170
98742899216210,2148cyclictest1026997-21kworker/2:0+events21:13:562
98742899216010,2147cyclictest1000287-21kworker/2:1+events19:47:442
9874289921578,2146cyclictest1014114-21kworker/2:0+events20:42:032
9874289921469,2133cyclictest1076616-21kworker/2:0+events23:49:482
98742199214511,2130cyclictest1065404-21kworker/0:1+events23:30:470
9874319921448,2132cyclictest1073138-21kworker/3:0+events23:48:173
98743199214411,2130cyclictest1065373-21kworker/3:0+events23:15:333
98743199214311,2128cyclictest1049124-21kworker/3:2+events22:26:093
98742699214310,2130cyclictest1058810-21kworker/1:1+events22:47:011
9874289921429,2130cyclictest1074732-21kworker/2:1+events23:39:512
98742199214110,2128cyclictest1030042-21kworker/0:1+events21:23:020
98742199213911,2125cyclictest1002149-21kworker/0:2+events19:59:260
98743199213811,2124cyclictest1015827-21kworker/3:2+events20:40:113
98742699213610,2123cyclictest1000535-21kworker/1:2+events19:53:231
98743199213311,2119cyclictest995923-21kworker/3:0+events20:30:223
98743199212911,2115cyclictest1045866-21kworker/3:2+events22:10:533
98743199212710,2113cyclictest1005620-21kworker/3:2+events20:05:563
9874219921257,2114cyclictest1019242-21kworker/0:2+events21:29:540
98743199212310,2110cyclictest1036526-21kworker/3:1+events21:54:453
9874269921238,2112cyclictest1012510-21kworker/1:1+events20:34:541
98743199212011,2105cyclictest1019186-21kworker/3:1+events20:58:223
98742699212011,2106cyclictest1022097-21kworker/1:1+events20:56:041
98743199211812,2103cyclictest1063718-21kworker/3:1+events23:22:483
98743199211811,2104cyclictest1012048-21kworker/3:1+events20:29:143
98743199211811,2103cyclictest1042627-21kworker/3:0+events21:56:163
98742899211810,2104cyclictest1026997-21kworker/2:0+events21:17:412
98742199211811,2104cyclictest1019242-21kworker/0:2+events20:53:030
9874319921174,2110cyclictest994303-21kworker/3:2+events19:37:043
98742699211710,2104cyclictest1049269-21kworker/1:0+events22:22:421
98743199211611,2102cyclictest988811-21kworker/3:2+events19:21:453
98743199211611,2102cyclictest1036526-21kworker/3:1+events21:47:313
98743199211611,2101cyclictest1063718-21kworker/3:1+events23:07:063
98743199211610,2103cyclictest1079848-21kworker/3:0+events23:59:413
98743199211511,2101cyclictest1092624-21kworker/3:2+events00:36:223
98743199211511,2100cyclictest1084336-21kworker/3:1+events00:07:143
9874269921159,2103cyclictest1051000-21kworker/1:2+events22:41:191
9874319921149,2102cyclictest1044246-21kworker/3:1+events22:21:563
98743199211411,2100cyclictest988811-21kworker/3:2+events19:18:493
98743199211411,2099cyclictest1050827-21kworker/3:0+events22:39:023
98743199211310,2099cyclictest1055915-21kworker/3:2+events22:57:123
9874269921096,2099cyclictest1051000-21kworker/1:2+events22:53:491
98742699210810,2095cyclictest1037940-21kworker/1:2+events21:51:191
98743199210610,2093cyclictest1079848-21kworker/3:0+events00:26:283
98742699210610,2092cyclictest988842-21kworker/1:2+events19:16:071
98742699210610,2092cyclictest1063600-21kworker/1:1+events23:31:101
98742699210511,2091cyclictest988842-21kworker/1:2+events19:41:411
98742699210510,2092cyclictest1023684-21kworker/1:2+events21:01:471
98742699210310,2090cyclictest1082947-21kworker/1:0+events00:15:501
98742699210310,2090cyclictest1082947-21kworker/1:0+events00:11:451
98742699210310,2090cyclictest1051000-21kworker/1:2+events22:37:321
9874269921017,2090cyclictest1031903-21kworker/1:0+events21:29:081
98742699210111,2086cyclictest1027025-21kworker/1:1+events21:20:461
98742699210110,2088cyclictest1046013-21kworker/1:1+events22:12:481
98742699210110,2087cyclictest1041158-21kworker/1:1+events22:01:121
98742699210110,2087cyclictest1005884-21kworker/1:1+events20:14:011
9874269921008,2089cyclictest1060410-21kworker/1:0+events23:10:591
98742699210011,2085cyclictest1037940-21kworker/1:2+events21:47:071
98743199209911,2084cyclictest1034837-21kworker/3:2+events21:32:353
98742899209910,2086cyclictest1085960-21kworker/2:0+events00:30:402
98742899209810,2085cyclictest1081600-21kworker/2:3+events00:16:352
98742699209812,2083cyclictest1089415-21kworker/1:2+events00:31:051
9874269920978,2086cyclictest1017778-21kworker/1:0+events20:50:221
98742699209711,2082cyclictest1094105-21kworker/1:0+events00:39:451
98742699209710,2084cyclictest1023684-21kworker/1:2+events21:07:531
98742699209710,2084cyclictest1023684-21kworker/1:2+events21:07:531
98742699209611,2082cyclictest1077983-21kworker/1:0+events23:55:291
98742699209610,2083cyclictest998859-21kworker/1:0+events19:46:361
98742699209610,2082cyclictest1073286-21kworker/1:2+events23:44:481
98742699209610,2082cyclictest1063600-21kworker/1:1+events23:26:341
98742699209511,2080cyclictest1079652-21kworker/1:2+events00:04:371
9874319920938,2082cyclictest992704-21kworker/3:0+events19:28:383
98742699209310,2080cyclictest1027025-21kworker/1:1+events21:42:541
9874269920899,2077cyclictest1002179-21kworker/1:0+events20:00:571
98742899208810,2075cyclictest1028680-21kworker/2:2+events21:23:232
9874319920828,2070cyclictest1001879-21kworker/3:1+events19:51:503
9874219920788,2067cyclictest988665-21kworker/0:0+events19:19:320
98743199207711,2063cyclictest1065373-21kworker/3:0+events23:12:533
98742199207411,2062cyclictest995546-21kworker/0:1+events20:15:090
98742899207310,2059cyclictest1057210-21kworker/2:0+events22:41:432
9874219920739,2061cyclictest1091046-21kworker/0:1+events00:38:590
98743199207111,2057cyclictest1089293-21kworker/3:2+events00:24:373
9874289920668,2055cyclictest997419-21kworker/2:2+events19:51:282
9874289920639,2050cyclictest1001912-21kworker/2:0+events20:01:212
98742899206110,2048cyclictest1025302-21kworker/2:1+events21:07:322
98742899206110,2048cyclictest1025302-21kworker/2:1+events21:07:322
9874269920609,2048cyclictest1008995-21kworker/1:0+events20:20:491
9874219920569,2044cyclictest1005679-21kworker/0:0+events20:07:070
98742199205011,2035cyclictest997361-21kworker/0:0+events19:53:000
9874289920497,2039cyclictest1050685-21kworker/2:2+events22:23:062
98743199204710,2035cyclictest995923-21kworker/3:0+events19:40:073
9874289920467,2036cyclictest1060469-21kworker/2:1+events22:54:332
9874269920468,2035cyclictest1068415-21kworker/1:0+events23:22:021
9874269920449,2032cyclictest987165-21kworker/1:1+events19:12:411
98742899204310,2030cyclictest1076616-21kworker/2:0+events23:51:202
9874219920439,2031cyclictest1074793-21kworker/0:0+events23:42:080
9874289920399,2026cyclictest1010572-21kworker/2:0+events20:18:562
9874289920396,2030cyclictest992614-21kworker/2:1+events19:27:292
98742899203810,2025cyclictest1028680-21kworker/2:2+events21:34:052
98742199203110,2017cyclictest1047367-21kworker/0:0+events22:47:480
98742199202910,2016cyclictest1019242-21kworker/0:2+events21:16:140
9874289920286,2019cyclictest1001912-21kworker/2:0+events19:58:202
9874269920284,2020cyclictest1077983-21kworker/1:0+events23:52:271
98742899202710,2014cyclictest1028680-21kworker/2:2+events21:59:202
9874289920269,2013cyclictest1071502-21kworker/2:2+events23:29:372
9874289920268,2015cyclictest1076616-21kworker/2:0+events23:58:532
98742199202610,2013cyclictest1060555-21kworker/0:2+events23:00:400
98742899202510,2012cyclictest1071502-21kworker/2:2+events23:32:182
98742899202510,2012cyclictest1005971-21kworker/2:2+events20:08:382
98743199202411,2010cyclictest1036526-21kworker/3:1+events21:39:503
98742899202410,2011cyclictest1064100-21kworker/2:1+events23:08:142
9874219920247,2014cyclictest1068248-21kworker/0:2+events23:18:340
98742199202410,2010cyclictest995546-21kworker/0:1+events20:10:320
98742199202311,2009cyclictest990953-21kworker/0:3+events19:27:060
98742199202110,2010cyclictest1087732-21kworker/0:2+events00:23:500
98742199202110,2008cyclictest1025426-21kworker/0:0+events21:06:000
98742199202110,2008cyclictest1025426-21kworker/0:0+events21:05:590
9874289920189,2006cyclictest1068368-21kworker/2:1+events23:17:472
9874219920176,2008cyclictest1038208-21kworker/0:2+events21:46:440
9874219920175,2009cyclictest1082858-21kworker/0:2+events00:07:580
98742699201110,1998cyclictest988842-21kworker/1:2+events19:22:561
98743199200511,1991cyclictest1012048-21kworker/3:1+events20:24:403
9874319920007,1990cyclictest1062033-21kworker/3:0+events23:01:033
9874289919897,1978cyclictest1057210-21kworker/2:0+events23:02:122
98742899198410,1971cyclictest987557-21kworker/2:2+events19:18:012
98743199197510,1962cyclictest1069843-21kworker/3:2+events23:32:433
9874319919738,1962cyclictest1025273-21kworker/3:2+events21:14:203
9874319919716,1961cyclictest1052453-21kworker/3:1+events22:33:423
98743199197110,1958cyclictest1047520-21kworker/3:0+events22:16:373
98742699196510,1952cyclictest993972-21kworker/1:1+events19:25:571
9874289919649,1952cyclictest994244-21kworker/2:0+events19:39:422
98743199196210,1948cyclictest1079848-21kworker/3:0+events00:17:443
98743199196110,1948cyclictest1079848-21kworker/3:0+events00:02:203
9874219919618,1949cyclictest997361-21kworker/0:0+events19:43:560
9874319919597,1949cyclictest1025273-21kworker/3:2+events21:21:093
98743199195910,1945cyclictest1079848-21kworker/3:0+events00:13:373
9874219919508,1938cyclictest986988-21kworker/0:2+events19:14:360
9874219919495,1941cyclictest1038208-21kworker/0:2+events21:54:220
9874269919378,1926cyclictest1042747-21kworker/1:0+events22:08:161
9874289919099,1898cyclictest981931-21kworker/2:1+events19:13:262
98743199189610,1883cyclictest988811-21kworker/3:2+events19:14:593
9870182173146,22sleep00-21swapper/019:07:160
9870152145108,32sleep20-21swapper/219:07:152
9869202143113,25sleep30-21swapper/319:06:043
9869712140107,28sleep10-21swapper/119:06:421
987426991915,2cyclictest1074942-21idleruntime-cro23:40:001
98742899170,4cyclictest1033415-21taskset21:28:382
98742899159,4cyclictest1054121-21apt-get22:35:012
98742899158,5cyclictest1022744-21apt-get20:55:142
98742899131,10cyclictest798-21runrttasks19:30:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional