You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 04:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Mon May 11, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
98887599343916,3419cyclictest1025597-21kworker/3:0+events21:10:153
98887399306215,3044cyclictest992447-21kworker/2:3+events19:20:002
98887599304913,3031cyclictest1069029-21kworker/3:1+events23:20:183
98887599298714,2971cyclictest1009986-21kworker/3:2+events20:25:163
98886599295213,2934cyclictest1065657-21kworker/0:2+events23:10:170
98887599290314,2885cyclictest1067388-21kworker/3:0+events23:15:223
98887599287314,2853cyclictest1009986-21kworker/3:2+events20:35:133
98887399285812,2842cyclictest1083775-21kworker/2:1+events00:30:182
98887399285014,2833cyclictest1051730-21kworker/2:1+events22:30:012
98887599281713,2800cyclictest1045323-21kworker/3:2+events22:05:133
98886899281613,2798cyclictest997097-21kworker/1:0+events19:40:161
98886599280512,2789cyclictest1080349-21kworker/0:0+events00:05:170
98887599276513,2748cyclictest1034104-21kworker/3:3+events21:50:473
98887599276513,2748cyclictest1034104-21kworker/3:3+events21:50:473
98887599276213,2745cyclictest1073859-21kworker/3:1+events23:33:213
98886599272413,2709cyclictest1033838-21kworker/0:2+events21:50:010
98886599272413,2709cyclictest1033838-21kworker/0:2+events21:50:010
98886599272012,2702cyclictest1074039-21kworker/0:2+events23:35:140
98887399270211,2687cyclictest1025807-21kworker/2:2+events21:05:202
98887399268013,2664cyclictest1069088-21kworker/2:1+events23:30:172
98886599266913,2653cyclictest991515-21kworker/0:2+events19:30:170
98886899265113,2635cyclictest992293-21kworker/1:1+events19:35:171
98886899264413,2628cyclictest1027324-21kworker/1:1+events21:25:011
98887599263412,2619cyclictest1056218-21kworker/3:0+events22:40:183
98886599263113,2614cyclictest1000295-21kworker/0:0+events19:44:020
98886599262813,2611cyclictest1078568-21kworker/0:2+events23:53:280
98886599262412,2609cyclictest1033838-21kworker/0:2+events21:46:110
98887399259412,2579cyclictest1057901-21kworker/2:2+events22:44:262
98887599258813,2573cyclictest1088200-21kworker/3:0+events00:35:193
98886899258412,2568cyclictest1067203-21kworker/1:2+events23:24:091
98886899257812,2562cyclictest1024395-21kworker/1:2+events21:01:531
98886899257612,2560cyclictest1072406-21kworker/1:0+events23:28:461
9888659925749,2562cyclictest1080349-21kworker/0:0+events00:00:210
98887599256812,2552cyclictest1001919-21kworker/3:2+events19:49:413
98887599256812,2552cyclictest1001919-21kworker/3:2+events19:49:413
98886899256712,2553cyclictest1005217-21kworker/1:1+events20:00:241
98886899256312,2548cyclictest1042003-21kworker/1:2+events21:54:091
98886899256312,2548cyclictest1042003-21kworker/1:2+events21:54:091
9888759925599,2546cyclictest1019338-21kworker/3:2+events20:58:493
98886899255910,2545cyclictest1059319-21kworker/1:1+events22:48:411
98887599255311,2540cyclictest1034104-21kworker/3:3+events21:40:013
98886899255312,2537cyclictest1034613-21kworker/1:2+events21:31:131
98886899255012,2535cyclictest1016263-21kworker/1:0+events20:38:371
98886899254912,2533cyclictest1064327-21kworker/1:0+events23:08:221
98886899254912,2533cyclictest1062677-21kworker/1:1+events23:04:131
98886899254612,2532cyclictest992293-21kworker/1:1+events19:22:161
98886899254512,2530cyclictest1086834-21kworker/1:0+events00:25:471
98887399254412,2528cyclictest1050101-21kworker/2:0+events22:45:122
9888659925369,2523cyclictest1043633-21kworker/0:2+events22:06:210
98887599253512,2520cyclictest1056218-21kworker/3:0+events22:38:503
98886599253512,2520cyclictest1054609-21kworker/0:2+events22:38:280
98887599253310,2519cyclictest1065717-21kworker/3:2+events23:13:013
9888759925323,2525cyclictest1043663-21kworker/3:1+events21:59:303
98887599253212,2516cyclictest1034104-21kworker/3:3+events21:30:493
9888759925317,2520cyclictest1009986-21kworker/3:2+events20:31:003
98887599253112,2516cyclictest992047-21kworker/3:2+events19:18:323
98887599253112,2516cyclictest1037137-21kworker/3:0+events21:37:003
98886899253112,2516cyclictest1027324-21kworker/1:1+events21:13:581
98886599253110,2517cyclictest1027140-21kworker/0:2+events21:20:260
98887599253012,2515cyclictest1049797-21kworker/3:2+events22:16:363
98886599253011,2515cyclictest1040338-21kworker/0:0+events22:02:350
98886599252912,2514cyclictest1016022-21kworker/0:1+events20:34:260
98887399252812,2512cyclictest1069088-21kworker/2:1+events23:52:422
98886899252811,2515cyclictest1080141-21kworker/1:2+events00:15:081
98886599252812,2512cyclictest1088232-21kworker/0:2+events00:18:540
98886599252810,2514cyclictest1024237-21kworker/0:1+events21:00:440
98887599252712,2512cyclictest1025597-21kworker/3:0+events21:17:003
9888659925278,2515cyclictest1010015-21kworker/0:1+events20:22:400
98886599252612,2510cyclictest1091520-21kworker/0:2+events00:31:060
98886599252412,2508cyclictest1033838-21kworker/0:2+events21:29:420
98886599251912,2504cyclictest1022636-21kworker/0:2+events20:55:010
98887599251812,2502cyclictest1078869-21kworker/3:0+events23:58:513
98886599251812,2503cyclictest1059624-21kworker/0:0+events22:50:370
98886599251811,2503cyclictest1010015-21kworker/0:1+events20:15:550
98887599251411,2499cyclictest1093027-21kworker/3:1+events00:34:323
98886899251212,2496cyclictest997097-21kworker/1:0+events19:45:541
98886899251212,2496cyclictest997097-21kworker/1:0+events19:45:541
9888759925118,2499cyclictest1088200-21kworker/3:0+events00:22:433
98887599251012,2494cyclictest997212-21kworker/3:1+events19:35:393
98887599250912,2493cyclictest1059502-21kworker/3:0+events22:49:263
98887599250712,2491cyclictest1051412-21kworker/3:1+events22:24:433
98886899250712,2492cyclictest1030582-21kworker/1:2+events21:24:161
98886599250511,2491cyclictest1011613-21kworker/0:2+events20:25:400
98887599250412,2488cyclictest1051412-21kworker/3:1+events22:31:103
98886899250010,2487cyclictest1089793-21kworker/1:1+events00:32:581
9888689924995,2490cyclictest1053158-21kworker/1:0+events22:32:171
98887599249812,2482cyclictest1067388-21kworker/3:0+events23:25:423
98886899249810,2485cyclictest1072406-21kworker/1:0+events23:34:041
98887399249712,2482cyclictest995512-21kworker/2:1+events19:27:392
9888759924957,2484cyclictest1077202-21kworker/3:2+events23:44:203
98886899249512,2480cyclictest1043601-21kworker/1:1+events22:06:001
98886899249512,2479cyclictest1080141-21kworker/1:2+events23:54:161
98886899249412,2480cyclictest1016263-21kworker/1:0+events20:49:171
98886899249412,2478cyclictest1034613-21kworker/1:2+events21:43:311
98886599249312,2478cyclictest991515-21kworker/0:2+events19:21:340
98887399249212,2476cyclictest1006605-21kworker/2:2+events20:11:022
98886899249212,2478cyclictest1006844-21kworker/1:0+events20:12:101
98886899249212,2476cyclictest1022368-21kworker/1:1+events20:54:381
98886899249112,2476cyclictest1000382-21kworker/1:1+events19:53:071
98886899249112,2475cyclictest1056455-21kworker/1:0+events22:54:241
98886899249012,2474cyclictest1062677-21kworker/1:1+events22:58:551
98886599249012,2474cyclictest1048495-21kworker/0:1+events22:19:190
98886899248812,2473cyclictest1037347-21kworker/1:0+events22:18:311
98886899248511,2470cyclictest1001982-21kworker/1:2+events19:59:141
98886899248510,2471cyclictest988386-21kworker/1:2+events19:28:031
98887599248412,2468cyclictest1016053-21kworker/3:0+events20:41:183
98886899248412,2468cyclictest1083418-21kworker/1:1+events00:04:291
98886899248312,2468cyclictest1042003-21kworker/1:2+events21:55:191
98886899248312,2467cyclictest1039845-21kworker/1:1+events21:47:201
98886899248312,2467cyclictest1037347-21kworker/1:0+events22:01:251
98886899248310,2469cyclictest1062677-21kworker/1:1+events23:10:391
98886899248210,2469cyclictest1034613-21kworker/1:2+events21:38:311
98886599248111,2466cyclictest1033838-21kworker/0:2+events21:33:090
98886899248011,2466cyclictest1012881-21kworker/1:1+events20:30:131
98887399247912,2463cyclictest1016204-21kworker/2:0+events20:44:172
98886599247812,2462cyclictest1057989-21kworker/0:1+events22:49:500
98886899247712,2462cyclictest1010081-21kworker/1:2+events20:18:541
98887599247612,2460cyclictest1075488-21kworker/3:0+events23:37:513
98887399247612,2460cyclictest1006605-21kworker/2:2+events20:05:002
98886899247111,2456cyclictest1012881-21kworker/1:1+events20:43:311
9888689924709,2458cyclictest1014624-21kworker/1:2+events20:29:281
98887599246811,2453cyclictest1077202-21kworker/3:2+events23:46:153
9888759924645,2455cyclictest1025597-21kworker/3:0+events21:07:143
9888659924625,2451cyclictest1065657-21kworker/0:2+events23:15:430
98887599246012,2445cyclictest1034104-21kworker/3:3+events21:46:573
98886899245812,2442cyclictest1083418-21kworker/1:1+events00:11:221
98887599245712,2442cyclictest1059502-21kworker/3:0+events22:55:293
98886599245612,2440cyclictest1050743-21kworker/0:0+events22:23:100
98887599245212,2437cyclictest1019338-21kworker/3:2+events20:51:323
98887599245111,2436cyclictest1083330-21kworker/3:2+events00:12:063
9888659924517,2441cyclictest1089915-21kworker/0:1+events00:29:130
98887599245012,2434cyclictest1008360-21kworker/3:0+events20:12:343
98887599244912,2434cyclictest993972-21kworker/3:0+events19:32:593
98887599244812,2434cyclictest1019338-21kworker/3:2+events20:45:023
98887599244812,2433cyclictest997212-21kworker/3:1+events20:03:053
98886599244812,2433cyclictest1017623-21kworker/0:0+events20:40:310
98887599244712,2431cyclictest1062868-21kworker/3:1+events23:01:083
98887599244711,2432cyclictest1053005-21kworker/3:2+events22:27:433
98887599244612,2430cyclictest1078869-21kworker/3:0+events00:04:063
98887599244611,2431cyclictest1025597-21kworker/3:0+events21:03:483
98886599244612,2430cyclictest1041940-21kworker/0:1+events21:56:030
98887599244512,2430cyclictest1032000-21kworker/3:2+events21:27:453
98887599244512,2429cyclictest997212-21kworker/3:1+events19:50:283
98887599244511,2430cyclictest1059502-21kworker/3:0+events22:51:013
98886899244512,2430cyclictest1072406-21kworker/1:0+events23:59:591
98887599244412,2428cyclictest1003524-21kworker/3:0+events19:58:523
98887599244411,2429cyclictest997212-21kworker/3:1+events20:08:473
98887599244311,2428cyclictest1030370-21kworker/3:1+events21:22:213
98886599244310,2431cyclictest1037437-21kworker/0:1+events21:40:250
98887599244211,2427cyclictest1062868-21kworker/3:1+events23:06:513
98887599244211,2427cyclictest1040415-21kworker/3:0+events22:04:083
98887599244110,2427cyclictest1009986-21kworker/3:2+events20:22:173
98886899244111,2426cyclictest1077409-21kworker/1:1+events23:45:301
98886599244112,2425cyclictest1011613-21kworker/0:2+events20:48:070
98886599244111,2426cyclictest1057989-21kworker/0:1+events23:09:080
98887599243712,2422cyclictest1078869-21kworker/3:0+events00:05:393
98886599243712,2421cyclictest1043633-21kworker/0:2+events22:13:110
98887399243413,2417cyclictest1050101-21kworker/2:0+events22:21:132
98886599243412,2419cyclictest1001892-21kworker/0:2+events19:47:470
98886599243412,2419cyclictest1001892-21kworker/0:2+events19:47:470
9888689924339,2420cyclictest1006844-21kworker/1:0+events20:23:011
98886599243212,2417cyclictest988771-21kworker/0:0+events19:15:260
98887399242912,2415cyclictest1042064-21kworker/2:2+events21:56:272
98886599242811,2413cyclictest1057989-21kworker/0:1+events23:22:370
98886599242712,2411cyclictest1078568-21kworker/0:2+events23:56:100
9888659924268,2414cyclictest1054609-21kworker/0:2+events22:40:410
98886599242512,2409cyclictest1052975-21kworker/0:1+events22:26:360
98886599242512,2409cyclictest1033838-21kworker/0:2+events21:36:360
9888759924249,2412cyclictest992047-21kworker/3:2+events19:20:473
98886599242410,2411cyclictest1057989-21kworker/0:1+events23:00:460
98886599242312,2408cyclictest1000295-21kworker/0:0+events19:58:290
9888659924229,2409cyclictest1072435-21kworker/0:1+events23:31:500
98886599242210,2409cyclictest1006814-21kworker/0:1+events20:06:310
98887599241812,2403cyclictest1078869-21kworker/3:0+events23:50:263
98887599241710,2403cyclictest1009986-21kworker/3:2+events20:15:333
98887399241610,2402cyclictest992447-21kworker/2:3+events19:22:402
98887399240912,2394cyclictest1069088-21kworker/2:1+events23:24:552
98887399240812,2394cyclictest1043696-21kworker/2:0+events22:00:162
98887399240712,2392cyclictest1006605-21kworker/2:2+events20:09:102
98886599240612,2391cyclictest1011613-21kworker/0:2+events20:38:590
98886599240511,2391cyclictest1080349-21kworker/0:0+events00:20:260
98886899240011,2385cyclictest1027324-21kworker/1:1+events21:09:071
98887399239812,2384cyclictest1075457-21kworker/2:0+events23:40:052
98886599239812,2383cyclictest1094397-21kworker/0:0+events00:36:500
98887399239712,2381cyclictest1022456-21kworker/2:0+events20:55:462
9888659923968,2384cyclictest1000295-21kworker/0:0+events20:02:190
98887399239011,2376cyclictest1003754-21kworker/2:0+events19:56:342
98886599238811,2373cyclictest1070566-21kworker/0:2+events23:26:280
9888689923875,2378cyclictest1049346-21kworker/1:1+events22:36:091
98887399238012,2364cyclictest1017894-21kworker/2:1+events20:47:432
98886599238011,2366cyclictest985224-21kworker/0:1+events19:14:190
98886899237310,2359cyclictest1027324-21kworker/1:1+events21:15:511
98887399237112,2355cyclictest992447-21kworker/2:3+events19:46:412
98887399237112,2355cyclictest992447-21kworker/2:3+events19:46:412
98887399236812,2354cyclictest1037746-21kworker/2:0+events21:51:092
98887399236812,2354cyclictest1037746-21kworker/2:0+events21:51:092
98886599235812,2343cyclictest1000295-21kworker/0:0+events20:14:480
98886599234810,2335cyclictest991515-21kworker/0:2+events19:29:310
9888739923469,2334cyclictest1024150-21kworker/2:1+events21:02:372
98887399233712,2321cyclictest1086508-21kworker/2:0+events00:13:592
9888659923379,2324cyclictest1061269-21kworker/0:2+events22:59:400
98887399233512,2319cyclictest1009957-21kworker/2:0+events20:24:082
98887399233112,2315cyclictest1037746-21kworker/2:0+events21:46:342
9888689923319,2318cyclictest1067203-21kworker/1:2+events23:19:541
98886899233111,2318cyclictest1046979-21kworker/1:2+events22:10:071
98887399232912,2314cyclictest1065928-21kworker/2:0+events23:12:372
98887599232811,2313cyclictest993972-21kworker/3:0+events19:27:163
98887399232412,2309cyclictest992447-21kworker/2:3+events19:33:222
98887399232410,2311cyclictest1048464-21kworker/2:2+events22:19:412
98887399231911,2305cyclictest1081984-21kworker/2:0+events00:02:132
98887399231911,2304cyclictest1045350-21kworker/2:1+events22:13:572
98887399231611,2301cyclictest1035629-21kworker/2:2+events21:36:132
98887399231611,2301cyclictest1025807-21kworker/2:2+events21:12:532
98887399231511,2301cyclictest1069088-21kworker/2:1+events23:36:422
98887399231412,2297cyclictest1014590-21kworker/2:2+events20:32:552
98887399231312,2298cyclictest1050101-21kworker/2:0+events22:37:422
98887399231210,2299cyclictest1043696-21kworker/2:0+events22:08:352
98887599231110,2297cyclictest993972-21kworker/3:0+events19:40:393
98887399231112,2296cyclictest1059749-21kworker/2:1+events22:54:462
98887399231110,2298cyclictest995512-21kworker/2:1+events19:36:022
9888739923109,2297cyclictest1012937-21kworker/2:1+events20:27:322
9888739923097,2299cyclictest1050101-21kworker/2:0+events22:31:542
98887399230911,2294cyclictest1031876-21kworker/2:1+events21:29:182
98887399230812,2292cyclictest1080289-21kworker/2:2+events00:09:522
98887399230712,2292cyclictest1057901-21kworker/2:2+events23:01:552
98887399230311,2289cyclictest998878-21kworker/2:0+events19:42:102
98887399229011,2276cyclictest1083775-21kworker/2:1+events00:27:392
98887399229011,2275cyclictest1029114-21kworker/2:0+events21:17:242
98886899228611,2272cyclictest1049346-21kworker/1:1+events22:28:071
9888659922858,2274cyclictest1027140-21kworker/0:2+events21:16:370
98886899227611,2262cyclictest1093090-21kworker/1:0+events00:37:381
98886899227411,2260cyclictest1054760-21kworker/1:2+events22:43:441
98886899227111,2257cyclictest1075695-21kworker/1:2+events23:42:231
9888689922709,2257cyclictest1089793-21kworker/1:1+events00:23:051
98886899227011,2256cyclictest1072406-21kworker/1:0+events23:39:421
98886899226911,2255cyclictest1049346-21kworker/1:1+events22:22:001
98886899226910,2257cyclictest988386-21kworker/1:2+events19:15:041
98887599226810,2254cyclictest1088200-21kworker/3:0+events00:18:093
98886899226710,2254cyclictest1001982-21kworker/1:2+events20:08:241
98886899226411,2249cyclictest1080141-21kworker/1:2+events00:06:011
98886599226410,2250cyclictest1050743-21kworker/0:0+events22:30:230
98887399225711,2243cyclictest1070716-21kworker/2:0+events23:27:362
98886599225511,2241cyclictest1068940-21kworker/0:0+events23:44:420
9888759922489,2236cyclictest1089821-21kworker/3:1+events00:25:263
98887599224110,2227cyclictest1047976-21kworker/3:1+events22:11:163
98886599223811,2223cyclictest1078568-21kworker/0:2+events23:47:470
98887399223512,2220cyclictest1083775-21kworker/2:1+events00:21:132
9888659922348,2223cyclictest1080349-21kworker/0:0+events00:11:440
9888659922319,2219cyclictest998663-21kworker/0:1+events19:38:220
98886599222911,2214cyclictest1024237-21kworker/0:1+events21:08:450
98887399222811,2215cyclictest1075457-21kworker/2:0+events23:45:052
98886599222711,2213cyclictest1021035-21kworker/0:0+events20:59:330
98886599222411,2209cyclictest1000295-21kworker/0:0+events19:52:220
98887399222010,2206cyclictest1033992-21kworker/2:0+events21:34:162
98887399221212,2197cyclictest1025807-21kworker/2:2+events21:20:482
98887399214111,2126cyclictest1086508-21kworker/2:0+events00:38:232
98887399211911,2105cyclictest1020788-21kworker/2:2+events20:51:552
98887399211911,2105cyclictest1014590-21kworker/2:2+events20:36:432
98886899211810,2105cyclictest985712-21kworker/1:1+events19:10:561
98887399211711,2103cyclictest1057901-21kworker/2:2+events23:09:312
98887399211710,2103cyclictest1080289-21kworker/2:2+events23:59:132
98887399211611,2102cyclictest1062524-21kworker/2:0+events22:57:222
9888759921063,2099cyclictest989036-21kworker/3:1+events19:11:403
98887399210411,2089cyclictest1057901-21kworker/2:2+events23:19:332
98887399210211,2088cyclictest990249-21kworker/2:2+events19:14:412
98887399210211,2088cyclictest1035629-21kworker/2:2+events21:44:422
9888659920809,2068cyclictest1024237-21kworker/0:1+events21:11:000
9885642143113,25sleep30-21swapper/319:08:063
9886922141108,29sleep20-21swapper/219:09:452
9884672140112,23sleep10-21swapper/119:06:521
9885662139109,25sleep00-21swapper/019:08:070
98887399207,8cyclictest1010921-21grep20:15:192
98886899189,6cyclictest997387-21sh19:35:001
98886899170,15cyclictest1023547-21/usr/sbin/munin20:55:171
988873991610,1cyclictest191rcu_preempt00:15:222
98887399158,1cyclictest191rcu_preempt19:50:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional