You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 16:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Sun Jul 05, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
194242099341016,3390cyclictest1955869-21kworker/0:2+events20:15:100
194242699336116,3340cyclictest1996981-21kworker/2:1+events22:00:132
194242399315015,3131cyclictest1966475-21kworker/1:1+events20:40:191
194242399311914,3103cyclictest1940428-21kworker/1:2+events19:15:201
194243099302815,3008cyclictest1957232-21kworker/3:1+events20:10:163
194242699301814,2999cyclictest1969601-21kworker/2:1+events21:10:022
194242399297514,2955cyclictest1969779-21kworker/1:0+events20:50:131
194243099291214,2895cyclictest2038480-21kworker/3:1+events00:25:013
194242399290113,2885cyclictest1998457-21kworker/1:2+events22:05:121
194243099287213,2855cyclictest1964947-21kworker/3:1+events20:32:183
194243099286012,2844cyclictest1984196-21kworker/3:0+events21:29:043
194243099285113,2834cyclictest1989155-21kworker/3:0+events22:03:193
194243099284313,2825cyclictest2022412-21kworker/3:1+events23:25:163
194243099283512,2819cyclictest2008162-21kworker/3:2+events22:43:523
19424309928136,2803cyclictest2013114-21kworker/3:1+events22:53:063
194243099280913,2792cyclictest2031966-21kworker/3:0+events00:13:593
194243099280913,2792cyclictest1987492-21kworker/3:1+events21:30:133
194243099280313,2786cyclictest2044805-21kworker/3:2+events00:34:163
194243099280113,2785cyclictest1989155-21kworker/3:0+events21:47:373
194243099279713,2781cyclictest2036855-21kworker/3:2+events00:04:273
194243099279213,2775cyclictest2038480-21kworker/3:1+events00:22:443
194243099278912,2773cyclictest1961737-21kworker/3:2+events20:17:283
194242099278613,2770cyclictest1982435-21kworker/0:1+events21:20:190
194243099278213,2765cyclictest2035204-21kworker/3:1+events23:59:113
194243099278113,2765cyclictest2013114-21kworker/3:1+events23:01:103
194242099278110,2767cyclictest2024189-21kworker/0:2+events23:28:210
194242099278013,2763cyclictest1972712-21kworker/0:0+events20:43:430
194243099277812,2761cyclictest1947116-21kworker/3:0+events19:51:093
194243099277613,2759cyclictest1950305-21kworker/3:1+events19:33:133
194243099277612,2760cyclictest2020805-21kworker/3:2+events23:38:403
194242399277613,2759cyclictest1995136-21kworker/1:2+events21:55:421
194242099277613,2759cyclictest1966627-21kworker/0:0+events20:27:460
194242099277613,2759cyclictest1966627-21kworker/0:0+events20:27:450
19424309927747,2763cyclictest1989155-21kworker/3:0+events21:36:143
19424269927747,2763cyclictest1967989-21kworker/2:2+events20:35:012
194243099277313,2756cyclictest1980720-21kworker/3:2+events21:11:133
194243099276913,2752cyclictest1998488-21kworker/3:2+events22:24:223
194243099276913,2752cyclictest1995166-21kworker/3:2+events21:54:073
194242099276713,2750cyclictest1982435-21kworker/0:1+events21:18:260
194242099276113,2744cyclictest2025799-21kworker/0:0+events23:40:110
194242399275513,2738cyclictest1952316-21kworker/1:2+events19:54:341
194242399274411,2731cyclictest1977399-21kworker/1:2+events21:17:431
194243099274212,2726cyclictest1979111-21kworker/3:1+events21:06:363
194242099274213,2725cyclictest2005065-21kworker/0:1+events22:24:440
194242699273713,2721cyclictest2003353-21kworker/2:2+events22:20:562
194242399273710,2723cyclictest1977399-21kworker/1:2+events21:34:451
194242099273611,2721cyclictest2005065-21kworker/0:1+events22:33:100
194242399273513,2718cyclictest2017779-21kworker/1:0+events23:06:541
194242399273510,2721cyclictest1947146-21kworker/1:0+events19:30:561
194242399273413,2718cyclictest1990753-21kworker/1:1+events21:45:221
194242099273412,2718cyclictest1987360-21kworker/0:2+events21:39:440
194242399273213,2716cyclictest1953944-21kworker/1:1+events19:46:581
194242099272913,2714cyclictest1972712-21kworker/0:0+events21:05:060
194242399272313,2706cyclictest2033448-21kworker/1:2+events00:11:371
194242099272312,2707cyclictest1995103-21kworker/0:0+events22:17:480
194242099272213,2705cyclictest1974523-21kworker/0:1+events20:53:380
194242399272113,2704cyclictest1966475-21kworker/1:1+events20:47:311
194242699272013,2703cyclictest1995345-21kworker/2:0+events21:55:192
19424239927208,2708cyclictest2028679-21kworker/1:1+events23:59:591
194242099272013,2704cyclictest1995103-21kworker/0:0+events22:27:260
194243099271611,2701cyclictest1957232-21kworker/3:1+events20:01:253
194242399271612,2700cyclictest1980627-21kworker/1:0+events21:06:591
194242099271612,2702cyclictest2014585-21kworker/0:2+events23:12:370
194242099271612,2700cyclictest1964975-21kworker/0:1+events20:22:450
194242399271413,2697cyclictest2042989-21kworker/1:2+events00:21:591
194243099270212,2686cyclictest1989155-21kworker/3:0+events21:57:333
19424309927019,2688cyclictest2005354-21kworker/3:1+events22:33:323
194242699270113,2684cyclictest1953972-21kworker/2:0+events19:55:202
194242699269413,2677cyclictest1977547-21kworker/2:2+events21:01:372
194242699268913,2672cyclictest2024012-21kworker/2:0+events23:23:192
194242099268811,2673cyclictest2008369-21kworker/0:0+events22:35:300
194242099268613,2669cyclictest2045190-21kworker/0:1+events00:32:430
194243099268412,2668cyclictest2001749-21kworker/3:0+events22:19:453
19424209926819,2668cyclictest1972712-21kworker/0:0+events21:00:300
194242099267512,2661cyclictest1952224-21kworker/0:1+events19:56:500
194242699266711,2654cyclictest2011419-21kworker/2:1+events23:08:262
194242099266613,2651cyclictest1917260-21kworker/0:1+events19:30:090
194243099266413,2647cyclictest1966595-21kworker/3:2+events20:28:513
194243099266413,2647cyclictest1966595-21kworker/3:2+events20:28:513
194242399266313,2647cyclictest1940428-21kworker/1:2+events19:21:251
194243099266215,2643cyclictest1998488-21kworker/3:2+events22:08:363
194242699266112,2645cyclictest1957441-21kworker/2:2+events20:14:502
19424269926488,2636cyclictest1987181-21kworker/2:1+events21:38:122
194242699264810,2634cyclictest1953972-21kworker/2:0+events19:52:412
194242099264613,2629cyclictest2025799-21kworker/0:0+events23:31:230
19424309926418,2629cyclictest2020805-21kworker/3:2+events23:41:423
194242099264011,2627cyclictest2033023-21kworker/0:1+events00:10:090
194243099263713,2620cyclictest2009791-21kworker/3:0+events22:38:083
194243099262612,2610cyclictest2020805-21kworker/3:2+events23:30:363
194243099262610,2614cyclictest1998488-21kworker/3:2+events22:10:053
194242099262613,2610cyclictest2045190-21kworker/0:1+events00:38:090
194242699261512,2600cyclictest2005275-21kworker/2:0+events22:28:582
194243099261312,2597cyclictest1971416-21kworker/3:1+events20:47:093
194242099260810,2594cyclictest2029071-21kworker/0:2+events23:45:530
19424239926019,2588cyclictest2021046-21kworker/1:1+events23:18:011
194242699259213,2575cyclictest1935540-21kworker/2:2+events19:19:542
194242399259213,2577cyclictest2036707-21kworker/1:0+events00:05:131
19424209925909,2577cyclictest2020895-21kworker/0:1+events23:18:240
194242699258912,2573cyclictest1995345-21kworker/2:0+events22:07:262
19424209925859,2572cyclictest1952224-21kworker/0:1+events20:06:040
19424309925836,2573cyclictest2020805-21kworker/3:2+events23:19:113
19424239925838,2571cyclictest1989078-21kworker/1:0+events21:50:171
194243099258112,2565cyclictest1966595-21kworker/3:2+events20:44:293
194242699257911,2564cyclictest2035641-21kworker/2:1+events00:03:202
194242399257911,2564cyclictest2010077-21kworker/1:2+events22:48:291
194243099257812,2562cyclictest1966595-21kworker/3:2+events20:37:163
194243099257812,2562cyclictest1953912-21kworker/3:1+events19:48:063
194243099257710,2563cyclictest1975856-21kworker/3:2+events21:01:163
194243099257612,2560cyclictest1964947-21kworker/3:1+events20:23:533
194243099257312,2558cyclictest1945487-21kworker/3:1+events19:19:093
194242099257312,2557cyclictest1955869-21kworker/0:2+events20:10:400
194243099257211,2557cyclictest1953912-21kworker/3:1+events19:44:423
194242099257013,2554cyclictest1972712-21kworker/0:0+events21:13:550
194242099256912,2553cyclictest2009975-21kworker/0:1+events22:43:290
194242699256712,2551cyclictest2003353-21kworker/2:2+events22:38:552
194242099256510,2552cyclictest2012993-21kworker/0:0+events22:48:510
194243099256313,2546cyclictest1957232-21kworker/3:1+events19:57:143
194243099256010,2547cyclictest2013114-21kworker/3:1+events23:09:093
194243099255912,2543cyclictest2013114-21kworker/3:1+events22:59:393
194243099255611,2541cyclictest1980720-21kworker/3:2+events21:17:183
194243099255012,2535cyclictest1942153-21kworker/3:2+events19:29:463
194243099254811,2534cyclictest1982587-21kworker/3:1+events21:22:153
19424309925471,2542cyclictest1975856-21kworker/3:2+events20:56:413
194243099254712,2532cyclictest2014723-21kworker/3:0+events23:11:293
194243099254610,2532cyclictest2040162-21kworker/3:2+events00:16:373
194242399254412,2530cyclictest1947146-21kworker/1:0+events19:40:531
19424309925438,2531cyclictest2044805-21kworker/3:2+events00:35:493
194243099254312,2528cyclictest1960070-21kworker/3:0+events20:05:403
194243099254312,2527cyclictest2008162-21kworker/3:2+events22:45:273
19424269925376,2528cyclictest1971262-21kworker/2:0+events20:42:112
194242399252712,2511cyclictest2028679-21kworker/1:1+events23:37:071
194243099252612,2510cyclictest2022412-21kworker/3:1+events23:22:583
19424209925257,2514cyclictest2020895-21kworker/0:1+events23:39:260
194242399252212,2506cyclictest2021046-21kworker/1:1+events23:26:281
194242099252210,2508cyclictest1952224-21kworker/0:1+events19:50:210
194242399252112,2506cyclictest2024314-21kworker/1:2+events23:30:151
19424309925187,2507cyclictest1991609-21kworker/3:2+events21:41:383
194243099251811,2503cyclictest1942153-21kworker/3:2+events19:21:013
194242099251212,2497cyclictest2012993-21kworker/0:0+events22:55:260
194242399251112,2495cyclictest2017779-21kworker/1:0+events23:11:061
194242099250911,2495cyclictest1995103-21kworker/0:0+events21:56:240
194242399250612,2490cyclictest1961919-21kworker/1:1+events20:11:481
194242099250611,2491cyclictest2014585-21kworker/0:2+events23:00:480
194242399250412,2489cyclictest1990753-21kworker/1:1+events21:42:461
194242399250412,2488cyclictest2016118-21kworker/1:1+events22:59:151
194243099250112,2485cyclictest2020805-21kworker/3:2+events23:46:403
194242399250012,2484cyclictest1969779-21kworker/1:0+events20:35:451
194242399249912,2483cyclictest1968143-21kworker/1:2+events20:29:151
194242399249912,2483cyclictest1968143-21kworker/1:2+events20:29:151
194242099249912,2483cyclictest1995103-21kworker/0:0+events22:14:210
194242399249812,2481cyclictest1948747-21kworker/1:1+events19:37:041
194242099249812,2482cyclictest1974523-21kworker/0:1+events20:49:270
194243099249712,2482cyclictest2001749-21kworker/3:0+events22:25:533
194242399249712,2481cyclictest1998457-21kworker/1:2+events22:03:411
194242699249612,2480cyclictest2022323-21kworker/2:2+events23:16:292
19424239924969,2483cyclictest1977399-21kworker/1:2+events21:24:551
194242099249612,2480cyclictest1987360-21kworker/0:2+events21:32:100
194242099249612,2480cyclictest1982435-21kworker/0:1+events21:26:250
194242099249611,2481cyclictest1955869-21kworker/0:2+events20:37:370
19424239924959,2483cyclictest1940428-21kworker/1:2+events19:25:131
194242099249512,2481cyclictest1948660-21kworker/0:0+events19:35:070
194242399249412,2478cyclictest1977399-21kworker/1:2+events20:56:171
194243099249312,2477cyclictest2031966-21kworker/3:0+events23:53:053
19424209924928,2480cyclictest2033023-21kworker/0:1+events00:04:050
19424209924927,2481cyclictest1976124-21kworker/0:2+events20:57:040
194242099249212,2478cyclictest2017895-21kworker/0:0+events23:05:190
194243099249111,2476cyclictest2036855-21kworker/3:2+events00:08:163
194242399249112,2475cyclictest1952316-21kworker/1:2+events19:57:371
194242399249111,2477cyclictest2040115-21kworker/1:0+events00:38:301
194243099249011,2476cyclictest1975856-21kworker/3:2+events20:51:443
194242399249012,2474cyclictest2038512-21kworker/1:1+events00:17:001
194242399249012,2474cyclictest1977399-21kworker/1:2+events21:28:191
194242399248912,2474cyclictest2003139-21kworker/1:3+events22:21:431
194242399248912,2473cyclictest2000059-21kworker/1:1+events22:11:141
194242399248812,2473cyclictest1960040-21kworker/1:0+events20:16:211
194242099248812,2472cyclictest1955869-21kworker/0:2+events20:01:490
194242099248712,2472cyclictest2033023-21kworker/0:1+events23:51:350
194242399248610,2473cyclictest1966475-21kworker/1:1+events20:30:471
19424209924866,2476cyclictest1968557-21kworker/0:1+events20:33:270
194242399248512,2469cyclictest1977399-21kworker/1:2+events21:12:211
194242399248511,2470cyclictest1966475-21kworker/1:1+events20:23:301
194242099248512,2471cyclictest1990655-21kworker/0:0+events21:40:510
194242099248512,2469cyclictest2038183-21kworker/0:2+events00:19:170
194242099248512,2469cyclictest2038183-21kworker/0:2+events00:09:000
194242699248412,2468cyclictest1943804-21kworker/2:1+events19:24:272
19424209924849,2471cyclictest1948660-21kworker/0:0+events19:28:590
194242099248412,2468cyclictest2038183-21kworker/0:2+events00:26:300
19424239924839,2471cyclictest2040115-21kworker/1:0+events00:33:061
19424239924759,2462cyclictest2040115-21kworker/1:0+events00:26:541
194242699247411,2459cyclictest1963489-21kworker/2:1+events20:17:502
194242099247011,2455cyclictest2038183-21kworker/0:2+events00:23:520
194242699246712,2451cyclictest2027312-21kworker/2:0+events23:37:302
194242399246712,2451cyclictest2008338-21kworker/1:0+events22:34:421
194242699246212,2446cyclictest1950184-21kworker/2:1+events19:36:402
194242399246112,2445cyclictest1989078-21kworker/1:0+events21:35:521
19424239924609,2447cyclictest1952316-21kworker/1:2+events20:04:531
194242699245913,2442cyclictest1974651-21kworker/2:0+events20:51:212
194242399245910,2446cyclictest2028679-21kworker/1:1+events23:45:291
194242399245512,2439cyclictest2033448-21kworker/1:2+events23:54:361
194242399245212,2436cyclictest1979024-21kworker/1:1+events21:02:231
194242699245112,2435cyclictest1965094-21kworker/2:0+events20:21:112
194242099244912,2433cyclictest2020895-21kworker/0:1+events23:22:130
194242699244813,2431cyclictest2001689-21kworker/2:1+events22:19:212
194242699244712,2431cyclictest2011419-21kworker/2:1+events22:45:482
194242699244712,2431cyclictest1969601-21kworker/2:1+events20:57:272
194242699244712,2431cyclictest1935540-21kworker/2:2+events19:27:312
194242699244710,2434cyclictest1953972-21kworker/2:0+events19:49:162
19424269924468,2435cyclictest2038361-21kworker/2:2+events00:13:342
194242699244511,2430cyclictest1979263-21kworker/2:0+events21:25:402
194242699244511,2430cyclictest1957441-21kworker/2:2+events20:06:262
194242099244512,2430cyclictest2012993-21kworker/0:0+events22:52:420
194242699244412,2429cyclictest1993714-21kworker/2:2+events21:53:442
194242699244312,2427cyclictest2030539-21kworker/2:2+events23:57:412
194242099244110,2427cyclictest1917260-21kworker/0:1+events19:20:160
194242699243612,2420cyclictest1993714-21kworker/2:2+events21:49:542
194242699243512,2419cyclictest2019384-21kworker/2:0+events23:11:532
194242699243511,2420cyclictest1957441-21kworker/2:2+events20:03:232
194242699243412,2418cyclictest1988905-21kworker/2:2+events21:33:142
194242699243412,2418cyclictest1984421-21kworker/2:2+events21:24:082
194242099243411,2419cyclictest1992283-21kworker/0:1+events21:50:410
194242699243212,2417cyclictest1965094-21kworker/2:0+events20:29:382
194242699243212,2417cyclictest1965094-21kworker/2:0+events20:29:382
194242699243210,2420cyclictest2009703-21kworker/2:0+events22:40:062
19424269924319,2418cyclictest2041691-21kworker/2:0+events00:28:042
194242699242812,2412cyclictest1947480-21kworker/2:0+events19:30:322
194242399242612,2411cyclictest2010077-21kworker/1:2+events23:04:571
194242399242611,2412cyclictest2010077-21kworker/1:2+events22:51:551
194242699242312,2407cyclictest2011419-21kworker/2:1+events23:01:342
194242699241711,2402cyclictest2030539-21kworker/2:2+events23:53:512
194242099240912,2393cyclictest1995103-21kworker/0:0+events22:01:450
194242099240912,2393cyclictest1952224-21kworker/0:1+events19:40:290
194242699240512,2389cyclictest1972948-21kworker/2:2+events20:45:382
194242399240512,2389cyclictest2033448-21kworker/1:2+events00:01:511
194242099240512,2390cyclictest1987360-21kworker/0:2+events21:48:450
194242099240512,2390cyclictest1952224-21kworker/0:1+events19:46:110
194242399240412,2389cyclictest2006609-21kworker/1:1+events22:28:351
194242399240410,2390cyclictest1960040-21kworker/1:0+events20:09:531
194242099240310,2389cyclictest1943599-21kworker/0:0+events19:16:290
194242399240114,2384cyclictest1940428-21kworker/1:2+events19:14:121
194242399240114,2384cyclictest1940428-21kworker/1:2+events19:14:121
194242399240110,2387cyclictest2017779-21kworker/1:0+events23:21:041
194242099239811,2384cyclictest2033023-21kworker/0:1+events23:58:500
194242699239712,2383cyclictest2039995-21kworker/2:1+events00:16:132
194242699239711,2383cyclictest2025678-21kworker/2:1+events23:32:102
194242399239712,2381cyclictest2008338-21kworker/1:0+events22:41:591
194242699236712,2351cyclictest2006938-21kworker/2:1+events22:32:232
194242699236013,2345cyclictest2041691-21kworker/2:0+events00:30:462
194242699235412,2339cyclictest2030539-21kworker/2:2+events23:47:462
194242699235412,2338cyclictest1995345-21kworker/2:0+events22:13:572
194242699235211,2337cyclictest1950184-21kworker/2:1+events19:44:192
194242699235211,2337cyclictest1940461-21kworker/2:0+events19:11:332
194242699235211,2337cyclictest1940461-21kworker/2:0+events19:11:332
194242699235112,2336cyclictest2028920-21kworker/2:1+events23:44:202
194242699234912,2333cyclictest2046381-21kworker/2:2+events00:38:522
194242699234912,2333cyclictest2013028-21kworker/2:2+events22:51:322
194242699234912,2332cyclictest2022323-21kworker/2:2+events23:27:592
194242699234612,2332cyclictest1987181-21kworker/2:1+events21:40:062
194242699234312,2329cyclictest2041691-21kworker/2:0+events00:20:042
194242699232810,2314cyclictest2014695-21kworker/2:0+events22:56:572
194243099228410,2271cyclictest1947116-21kworker/3:0+events19:37:503
19424239922819,2269cyclictest2001782-21kworker/1:0+events22:18:591
194243099227111,2256cyclictest1932347-21kworker/3:0+events19:13:053
194243099227111,2256cyclictest1932347-21kworker/3:0+events19:13:053
194242099221411,2199cyclictest1998363-21kworker/0:1+events22:08:560
194242099221311,2199cyclictest1917260-21kworker/0:1+events19:11:570
194242099221311,2199cyclictest1917260-21kworker/0:1+events19:11:570
194242399217510,2162cyclictest2006609-21kworker/1:1+events22:36:391
194242699216711,2152cyclictest1969601-21kworker/2:1+events21:16:352
194242699216111,2146cyclictest1971262-21kworker/2:0+events20:39:342
194242699215610,2143cyclictest2032177-21kworker/2:0+events00:07:522
194242399214210,2128cyclictest2028679-21kworker/1:1+events23:40:571
194242699212511,2111cyclictest1979263-21kworker/2:0+events21:08:562
19418982155112,25sleep00-21swapper/019:06:170
19419962154112,24sleep10-21swapper/119:07:301
19419712142114,23sleep20-21swapper/219:07:112
19418962142111,26sleep30-21swapper/319:06:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional