You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-12 - 21:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Sun Jul 12, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
107306999354516,3524cyclictest1091110-21kworker/3:1+events20:05:223
107306999337512,3358cyclictest1116872-21kworker/3:0+events21:35:133
107306999333614,3317cyclictest1160757-21kworker/3:2+events23:43:423
107306499318816,3166cyclictest1128645-21kworker/1:2+events22:05:171
107305999316915,3149cyclictest1100468-21kworker/0:1+events20:35:010
107305999309215,3073cyclictest1116783-21kworker/0:1+events21:25:000
107306999306411,3049cyclictest1125030-21kworker/3:1+events21:50:213
107306999294414,2926cyclictest1155585-21kworker/3:0+events23:25:153
107306499288614,2869cyclictest1069160-21kworker/1:2+events19:15:131
107306499288614,2869cyclictest1069160-21kworker/1:2+events19:15:131
107306999287114,2853cyclictest1123169-21kworker/3:2+events21:41:133
107306699285911,2842cyclictest1141340-21kworker/2:2+events22:55:142
107306699285911,2842cyclictest1141340-21kworker/2:2+events22:55:142
10730669928520,2847cyclictest1115279-21kworker/2:0+events21:42:002
107306699284112,2826cyclictest1124521-21kworker/2:1+events22:10:132
107306999283313,2816cyclictest1157247-21kworker/3:2+events23:30:143
107306499282413,2807cyclictest1118445-21kworker/1:0+events21:30:191
107305999281311,2797cyclictest1135074-21kworker/0:2+events22:29:420
107306699280413,2787cyclictest1124521-21kworker/2:1+events22:07:332
107306999277312,2757cyclictest1130121-21kworker/3:1+events22:02:583
107305999276310,2749cyclictest1094241-21kworker/0:2+events20:15:510
107306999275914,2741cyclictest1110392-21kworker/3:2+events21:03:063
107306699275812,2742cyclictest1172229-21kworker/2:0+events00:36:452
107305999275712,2741cyclictest1121332-21kworker/0:0+events21:36:440
107306499275113,2733cyclictest1092672-21kworker/1:0+events20:10:121
107305999274913,2732cyclictest1139881-21kworker/0:3+events22:42:350
107306999274513,2728cyclictest1175415-21kworker/3:1+events00:27:123
107306999274513,2728cyclictest1173748-21kworker/3:2+events00:20:193
107306999274413,2727cyclictest1155585-21kworker/3:0+events23:46:223
107305999274213,2726cyclictest1116783-21kworker/0:1+events21:26:530
107305999274213,2724cyclictest1161000-21kworker/0:1+events23:45:160
107306999274013,2723cyclictest1118475-21kworker/3:2+events21:34:283
107305999273813,2721cyclictest1105628-21kworker/0:1+events21:03:290
107306699273612,2720cyclictest1138167-21kworker/2:1+events22:33:562
107305999273513,2718cyclictest1144270-21kworker/0:0+events22:49:050
107305999273012,2716cyclictest1139503-21kworker/0:0+events22:35:480
107306699272013,2703cyclictest1124521-21kworker/2:1+events21:59:332
107305999272013,2703cyclictest1092583-21kworker/0:1+events20:09:490
107306999271313,2696cyclictest1131900-21kworker/3:2+events22:11:223
107306699271213,2696cyclictest1150844-21kworker/2:2+events23:14:362
10730649927087,2697cyclictest1099103-21kworker/1:1+events20:50:131
107306999270613,2689cyclictest1147883-21kworker/3:0+events23:09:153
107306999270613,2689cyclictest1147883-21kworker/3:0+events22:59:183
107306999270613,2689cyclictest1147883-21kworker/3:0+events22:59:183
107305999270512,2689cyclictest1147913-21kworker/0:1+events23:06:570
107306999270213,2685cyclictest1102718-21kworker/3:3+events20:52:083
107306999270213,2685cyclictest1078096-21kworker/3:2+events19:24:493
107306699270213,2685cyclictest1081350-21kworker/2:1+events19:47:022
107306999270111,2685cyclictest1123169-21kworker/3:2+events21:59:573
107306999270013,2683cyclictest1135198-21kworker/3:0+events22:36:113
107306999270012,2684cyclictest1160757-21kworker/3:2+events23:53:353
107306999269812,2682cyclictest1078096-21kworker/3:2+events19:26:213
107306499269811,2683cyclictest1142697-21kworker/1:2+events22:45:171
107306999269713,2682cyclictest1160757-21kworker/3:2+events23:55:303
107306999269513,2678cyclictest1135198-21kworker/3:0+events22:42:593
107306999269413,2678cyclictest1112020-21kworker/3:1+events21:21:373
107306699269413,2677cyclictest1115279-21kworker/2:0+events21:23:072
107305999269013,2673cyclictest1157374-21kworker/0:2+events23:36:200
107306999268813,2671cyclictest1089418-21kworker/3:2+events20:34:383
107306999268612,2670cyclictest1084929-21kworker/3:0+events19:57:473
107306999268112,2665cyclictest1095906-21kworker/3:1+events20:22:463
107306999268111,2666cyclictest1112020-21kworker/3:1+events21:10:583
107305999268013,2664cyclictest1121332-21kworker/0:0+events21:53:260
107306999267912,2663cyclictest1089418-21kworker/3:2+events20:28:063
10730649926795,2670cyclictest1149688-21kworker/1:2+events23:21:031
107306699267813,2661cyclictest1089690-21kworker/2:2+events20:00:312
10730669926709,2657cyclictest1078023-21kworker/2:2+events19:26:432
107306699266413,2648cyclictest1175384-21kworker/2:1+events00:26:262
107305999266411,2649cyclictest1086383-21kworker/0:1+events19:52:260
107306499266213,2645cyclictest1088147-21kworker/1:1+events20:03:301
107306499266213,2645cyclictest1079764-21kworker/1:1+events19:40:311
107306499265613,2639cyclictest1134833-21kworker/1:0+events23:02:471
107306999265511,2640cyclictest1135198-21kworker/3:0+events22:23:553
107306699265511,2640cyclictest1146196-21kworker/2:1+events22:52:562
107305999265312,2637cyclictest1178592-21kworker/0:0+events00:37:330
107306499265212,2636cyclictest1125326-21kworker/1:0+events21:55:231
107306499265113,2634cyclictest1128645-21kworker/1:2+events22:17:011
107306499265013,2634cyclictest1164415-21kworker/1:3+events23:50:551
107306499264913,2632cyclictest1116811-21kworker/1:1+events21:43:551
107306699264513,2628cyclictest1172229-21kworker/2:0+events00:15:202
107306699264312,2627cyclictest1115279-21kworker/2:0+events21:45:272
107306499264213,2625cyclictest1099103-21kworker/1:1+events20:55:561
107306699264113,2624cyclictest1152802-21kworker/2:3+events23:42:112
10730669926378,2625cyclictest1152802-21kworker/2:3+events23:16:312
107306699263112,2615cyclictest1113646-21kworker/2:1+events21:19:402
107306699263112,2615cyclictest1113646-21kworker/2:1+events21:19:402
107305999263013,2613cyclictest1080973-21kworker/0:2+events19:36:160
107305999262913,2613cyclictest1088055-21kworker/0:2+events19:55:310
107305999262811,2613cyclictest1105628-21kworker/0:1+events20:58:380
107306499262612,2611cyclictest1125326-21kworker/1:0+events21:52:171
107306499262510,2613cyclictest1099103-21kworker/1:1+events20:30:231
107306699262413,2607cyclictest1176994-21kworker/2:2+events00:30:152
107306699262413,2607cyclictest1074488-21kworker/2:1+events19:16:222
107306699262413,2607cyclictest1074488-21kworker/2:1+events19:16:222
107306699262411,2609cyclictest1165478-21kworker/2:2+events00:00:552
107306699262313,2606cyclictest1105774-21kworker/2:2+events21:04:582
107306699262012,2603cyclictest1095777-21kworker/2:0+events20:32:182
10730669926197,2608cyclictest1155646-21kworker/2:0+events23:24:522
107306699261913,2602cyclictest1141340-21kworker/2:2+events22:46:482
107306999261711,2602cyclictest1084929-21kworker/3:0+events19:47:243
107305999261512,2599cyclictest1154230-21kworker/0:0+events23:33:180
107306699261013,2593cyclictest1124521-21kworker/2:1+events22:20:262
10730649926077,2596cyclictest1140351-21kworker/1:1+events22:36:551
107306999260212,2586cyclictest1108770-21kworker/3:0+events20:58:143
107306499260013,2583cyclictest1164046-21kworker/1:2+events23:47:291
107306499259913,2582cyclictest1167283-21kworker/1:0+events00:00:321
107306699259712,2582cyclictest1081350-21kworker/2:1+events19:43:582
107306499259313,2576cyclictest1099103-21kworker/1:1+events20:36:101
107305999259310,2580cyclictest1149540-21kworker/0:0+events23:04:430
107306999258613,2569cyclictest1149511-21kworker/3:1+events23:23:423
10730699925829,2569cyclictest1083208-21kworker/3:2+events19:44:213
107306699258112,2565cyclictest1157312-21kworker/2:1+events23:31:232
10730669925810,2578cyclictest1141340-21kworker/2:2+events22:44:542
107306699258012,2565cyclictest1079704-21kworker/2:0+events19:30:562
107306699258012,2564cyclictest1110300-21kworker/2:1+events21:06:062
107306699257812,2562cyclictest1119928-21kworker/2:1+events21:37:292
107306699257812,2562cyclictest1086505-21kworker/2:0+events19:58:572
107306499257812,2562cyclictest1113437-21kworker/1:2+events21:12:291
107306699257712,2561cyclictest1115279-21kworker/2:0+events21:28:022
107306699257612,2561cyclictest1081350-21kworker/2:1+events19:38:352
107306699257612,2560cyclictest1081350-21kworker/2:1+events19:52:032
10730669925749,2562cyclictest1100699-21kworker/2:2+events20:38:062
107306699257312,2558cyclictest1091126-21kworker/2:3+events20:11:192
107306699257212,2556cyclictest1124521-21kworker/2:1+events22:18:322
107306699257112,2555cyclictest1103970-21kworker/2:0+events20:46:072
107306699256912,2554cyclictest1160850-21kworker/2:1+events23:50:312
107306699256912,2553cyclictest1134745-21kworker/2:0+events22:38:262
107306699256912,2553cyclictest1078023-21kworker/2:2+events19:23:392
107306999256412,2548cyclictest1099220-21kworker/3:1+events20:44:563
107305999256210,2548cyclictest1107286-21kworker/0:0+events21:05:220
107306999256013,2543cyclictest1137980-21kworker/3:2+events22:51:473
107306699256011,2546cyclictest1155646-21kworker/2:0+events23:26:252
107306699255913,2543cyclictest1095777-21kworker/2:0+events20:19:192
107306999255112,2535cyclictest1102718-21kworker/3:3+events20:47:593
107305999254513,2529cyclictest1080973-21kworker/0:2+events19:34:220
10730649925424,2534cyclictest1149688-21kworker/1:2+events23:18:021
10730699925388,2526cyclictest1165992-21kworker/3:3+events00:04:013
107305999253212,2516cyclictest1100468-21kworker/0:1+events20:38:520
107305999252412,2508cyclictest1103247-21kworker/0:0+events20:45:200
10730599925214,2514cyclictest1084689-21kworker/0:0+events20:10:580
10730669925198,2507cyclictest1152802-21kworker/2:3+events23:39:032
107305999251912,2503cyclictest1163040-21kworker/0:0+events23:51:170
107306999251511,2500cyclictest1112020-21kworker/3:1+events21:09:083
107306699251113,2494cyclictest1124521-21kworker/2:1+events22:04:082
107305999251112,2495cyclictest1152565-21kworker/0:2+events23:16:090
107305999251112,2495cyclictest1142664-21kworker/0:1+events22:50:380
107306999251013,2494cyclictest1155585-21kworker/3:0+events23:39:513
107305999250712,2491cyclictest1076447-21kworker/0:0+events19:24:260
107306499250611,2491cyclictest1099103-21kworker/1:1+events20:43:261
10730599925069,2493cyclictest1084689-21kworker/0:0+events19:47:460
107305999250612,2490cyclictest1131631-21kworker/0:1+events22:13:130
107305999250611,2491cyclictest1121332-21kworker/0:0+events21:41:370
10730699925059,2493cyclictest1113677-21kworker/3:2+events21:15:303
10730699925059,2493cyclictest1113677-21kworker/3:2+events21:15:303
107305999250512,2489cyclictest1144270-21kworker/0:0+events22:55:360
107305999250512,2489cyclictest1144270-21kworker/0:0+events22:55:360
107305999250510,2491cyclictest1084689-21kworker/0:0+events20:02:030
10730599925049,2491cyclictest1170773-21kworker/0:3+events00:12:380
107305999250412,2489cyclictest1107286-21kworker/0:0+events21:12:050
107305999250412,2488cyclictest1107286-21kworker/0:0+events20:54:250
107305999250312,2488cyclictest1103247-21kworker/0:0+events20:42:210
10730599925027,2491cyclictest1157374-21kworker/0:2+events23:41:010
107306699250012,2484cyclictest1124521-21kworker/2:1+events21:53:492
10730599924978,2485cyclictest1175353-21kworker/0:2+events00:33:180
107306499249413,2477cyclictest1091045-21kworker/1:2+events20:15:291
107305999249312,2477cyclictest1121332-21kworker/0:0+events22:04:300
107305999249212,2477cyclictest1173561-21kworker/0:0+events00:16:500
107305999249212,2476cyclictest1119751-21kworker/0:2+events21:34:050
107306699249111,2476cyclictest1099044-21kworker/2:1+events20:53:172
10730599924918,2479cyclictest1137473-21kworker/0:1+events22:30:530
10730649924908,2478cyclictest1099103-21kworker/1:1+events21:15:521
10730649924908,2478cyclictest1099103-21kworker/1:1+events21:15:521
10730599924909,2477cyclictest1173561-21kworker/0:0+events00:25:390
107306499248911,2474cyclictest1170479-21kworker/1:2+events00:14:311
107306999248812,2472cyclictest1170420-21kworker/3:0+events00:19:543
107305999248712,2471cyclictest1097499-21kworker/0:2+events20:23:530
107306999248612,2471cyclictest1089418-21kworker/3:2+events20:12:503
107306999248611,2471cyclictest1102461-21kworker/3:0+events20:39:163
107306699248512,2470cyclictest1172229-21kworker/2:0+events00:23:452
107306699248411,2470cyclictest1165478-21kworker/2:2+events23:56:182
107306699248411,2470cyclictest1111896-21kworker/2:0+events21:11:432
107306999248312,2467cyclictest1089418-21kworker/3:2+events20:18:103
107306499247913,2462cyclictest1134833-21kworker/1:0+events22:57:291
107306499247913,2462cyclictest1134833-21kworker/1:0+events22:57:291
107306699247812,2462cyclictest1148004-21kworker/2:0+events23:05:502
107306999247712,2461cyclictest1137980-21kworker/3:2+events22:48:203
107305999247710,2463cyclictest1165647-21kworker/0:2+events23:58:120
107306999247512,2459cyclictest1170420-21kworker/3:0+events00:09:163
10730599924757,2464cyclictest1173561-21kworker/0:0+events00:23:210
107306999247312,2458cyclictest1172140-21kworker/3:1+events00:13:463
107306999247312,2457cyclictest1074519-21kworker/3:1+events19:35:533
107306499247312,2459cyclictest1134833-21kworker/1:0+events22:41:061
10730699924726,2462cyclictest1131900-21kworker/3:2+events22:17:223
107306999247212,2457cyclictest1078096-21kworker/3:2+events19:31:423
107306999247110,2457cyclictest1149511-21kworker/3:1+events23:14:583
107306499247112,2455cyclictest1134833-21kworker/1:0+events22:50:151
107306999246912,2454cyclictest1123169-21kworker/3:2+events21:49:153
107306999246911,2454cyclictest1084929-21kworker/3:0+events19:53:363
107305999246911,2454cyclictest1133353-21kworker/0:0+events22:15:330
107306999246812,2452cyclictest1173748-21kworker/3:2+events00:33:393
107306999246612,2450cyclictest1135198-21kworker/3:0+events22:27:493
107306499246412,2450cyclictest1084489-21kworker/1:0+events19:55:101
10730699924626,2452cyclictest1175415-21kworker/3:1+events00:35:133
107306999246212,2446cyclictest1064728-21kworker/3:0+events19:19:253
107306999246212,2446cyclictest1064728-21kworker/3:0+events19:19:253
107306999246212,2446cyclictest1064728-21kworker/3:0+events19:14:503
107305999246212,2447cyclictest1154230-21kworker/0:0+events23:20:170
107306999246011,2445cyclictest1137980-21kworker/3:2+events23:03:113
107306499246011,2445cyclictest1147970-21kworker/1:1+events23:09:381
107306699245812,2443cyclictest1091126-21kworker/2:3+events20:05:452
107306499245812,2443cyclictest1125326-21kworker/1:0+events22:02:351
107306999245712,2442cyclictest1089418-21kworker/3:2+events20:02:253
107306999245512,2440cyclictest1116872-21kworker/3:0+events21:28:253
107306499245512,2441cyclictest1113437-21kworker/1:2+events21:20:491
107306499244712,2431cyclictest1138108-21kworker/1:2+events22:32:471
107306499244711,2432cyclictest1170479-21kworker/1:2+events00:07:201
10730599924477,2437cyclictest1127042-21kworker/0:1+events21:57:180
107306499244612,2431cyclictest1086292-21kworker/1:2+events19:50:291
107305999244010,2426cyclictest1095844-21kworker/0:0+events20:27:220
10730649924397,2428cyclictest1081377-21kworker/1:2+events19:37:241
10730699924363,2430cyclictest1137980-21kworker/3:2+events22:33:323
107305999243510,2423cyclictest1078641-21kworker/0:1+events19:40:070
107306499243312,2418cyclictest1179902-21kworker/1:0+events00:37:091
107305999243210,2418cyclictest1076447-21kworker/0:0+events19:28:360
107306499242911,2414cyclictest1099103-21kworker/1:1+events20:48:201
107305999242912,2413cyclictest1167376-21kworker/0:1+events00:06:360
107306499242812,2412cyclictest1173776-21kworker/1:0+events00:19:321
107306499242611,2411cyclictest1084489-21kworker/1:0+events19:46:391
10730649924258,2414cyclictest1113437-21kworker/1:2+events21:27:151
107306499242512,2409cyclictest1134833-21kworker/1:0+events22:28:121
107306499242412,2408cyclictest1149688-21kworker/1:2+events23:11:551
107306499242312,2409cyclictest1091045-21kworker/1:2+events20:20:031
107306499242312,2407cyclictest1173776-21kworker/1:0+events00:21:251
107306499242311,2408cyclictest1116811-21kworker/1:1+events21:49:581
107306499242310,2409cyclictest1118445-21kworker/1:0+events21:39:441
107306499242212,2406cyclictest1134833-21kworker/1:0+events22:22:231
107306499242211,2407cyclictest1164415-21kworker/1:3+events23:57:041
107306499242211,2407cyclictest1078160-21kworker/1:0+events19:31:191
10730649924218,2410cyclictest1075198-21kworker/1:1+events19:20:101
107306499242112,2406cyclictest1128645-21kworker/1:2+events22:14:001
107306499242012,2404cyclictest1096052-21kworker/1:0+events20:28:291
107306499242011,2405cyclictest1088147-21kworker/1:1+events20:06:291
107306499241911,2405cyclictest1160575-21kworker/1:0+events23:40:371
107305999241612,2400cyclictest1064904-21kworker/0:1+events19:19:470
107305999241612,2400cyclictest1064904-21kworker/0:1+events19:19:470
107306499241311,2399cyclictest1149688-21kworker/1:2+events23:39:271
107305999241212,2396cyclictest1154230-21kworker/0:0+events23:28:200
107306499241112,2396cyclictest1155616-21kworker/1:1+events23:26:031
107305999240711,2393cyclictest1128859-21kworker/0:2+events22:07:550
10730599924069,2394cyclictest1107286-21kworker/0:0+events21:17:460
10730599924069,2394cyclictest1107286-21kworker/0:0+events21:17:460
107306499240512,2389cyclictest1172079-21kworker/1:1+events00:31:221
107305999240511,2390cyclictest1135074-21kworker/0:2+events22:21:140
107306699239512,2381cyclictest1091126-21kworker/2:3+events20:25:032
107306999239012,2375cyclictest1149511-21kworker/3:1+events23:19:103
107306699239012,2375cyclictest1134745-21kworker/2:0+events22:28:572
107306499238611,2371cyclictest1175472-21kworker/1:2+events00:26:021
107306999238112,2365cyclictest1130121-21kworker/3:1+events22:09:513
107305999237811,2364cyclictest1147913-21kworker/0:1+events23:14:130
107306699237312,2358cyclictest1168945-21kworker/2:1+events00:07:432
107306699237312,2358cyclictest1103970-21kworker/2:0+events20:43:492
107306499234211,2327cyclictest1099103-21kworker/1:1+events21:01:141
107306699233112,2315cyclictest1091126-21kworker/2:3+events20:23:302
107306699232911,2315cyclictest1107481-21kworker/2:0+events20:57:042
107306499232912,2314cyclictest1079764-21kworker/1:1+events19:28:141
107306699232612,2310cyclictest1069559-21kworker/2:0+events19:14:272
107306499232612,2312cyclictest1099103-21kworker/1:1+events21:05:431
107306699232410,2310cyclictest1162479-21kworker/2:0+events23:48:592
107305999223211,2218cyclictest1074221-21kworker/0:2+events19:11:460
107306499212710,2114cyclictest1069160-21kworker/1:2+events19:12:551
107306699211311,2100cyclictest1146196-21kworker/2:1+events23:00:052
10730669921029,2089cyclictest1170539-21kworker/2:2+events00:14:092
10730669921017,2090cyclictest1115279-21kworker/2:0+events21:33:182
10725442157110,24sleep20-21swapper/219:05:392
10727032152106,26sleep30-21swapper/319:07:403
1072755214692,46sleep10-21swapper/119:08:171
10713532143114,23sleep00-21swapper/019:05:010
1073064991814,2cyclictest1159395-21latency_hist23:35:011
107305999171,14cyclictest0-21swapper/021:45:130
1073059991710,5cyclictest1196-21gvfs-afc-volume00:00:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional