You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 08:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Thu Mar 19, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
102006899317415,3155cyclictest1093215-21kworker/3:1+events23:35:163
102006599295814,2937cyclictest1096588-21kworker/2:3+events23:10:112
102006199294913,2930cyclictest1039260-21kworker/1:2+events20:10:121
102006599293313,2916cyclictest1068366-21kworker/2:0+events21:55:112
102006199279713,2780cyclictest1058184-21kworker/1:2+events21:11:391
10200689927828,2770cyclictest1047228-21kworker/3:1+events20:35:113
102006899277313,2755cyclictest1068518-21kworker/3:0+events21:50:173
102006899270711,2693cyclictest1060417-21kworker/3:2+events21:20:003
102006899270613,2690cyclictest1123269-21kworker/3:2+events00:30:013
102006599270513,2688cyclictest1066747-21kworker/2:1+events21:40:182
102006899270313,2686cyclictest1086179-21kworker/3:0+events22:35:123
102006599266510,2650cyclictest1021367-21kworker/2:1+events19:35:122
102006899264013,2623cyclictest1068518-21kworker/3:0+events21:45:173
102006199263813,2622cyclictest1073317-21kworker/1:0+events22:20:151
102006599258413,2567cyclictest1045506-21kworker/2:0+events20:30:152
102006199257212,2557cyclictest1089401-21kworker/1:2+events22:57:201
102006599256711,2553cyclictest1118609-21kworker/2:2+events00:20:132
102005999249912,2483cyclictest1074920-21kworker/0:1+events22:20:590
102006199249612,2480cyclictest1087778-21kworker/1:1+events22:45:471
102006199249612,2480cyclictest1071630-21kworker/1:1+events21:49:311
102005999249112,2476cyclictest1045359-21kworker/0:0+events20:29:540
102006199248812,2473cyclictest1050364-21kworker/1:1+events20:49:371
102006199248712,2471cyclictest1046900-21kworker/1:0+events20:44:221
102006599248612,2471cyclictest1053831-21kworker/2:1+events21:05:162
102006199248412,2468cyclictest1123325-21kworker/1:2+events00:35:201
102006599248312,2469cyclictest1107873-21kworker/2:0+events23:45:112
102006199248312,2468cyclictest1113594-21kworker/1:0+events00:01:111
102006899248012,2464cyclictest1110597-21kworker/3:0+events23:58:093
102006199247812,2463cyclictest1089401-21kworker/1:2+events23:18:091
102006199247812,2463cyclictest1086166-21kworker/1:0+events22:37:501
102006199247512,2460cyclictest1086166-21kworker/1:0+events22:33:171
102006199247212,2457cyclictest1054900-21kworker/1:0+events21:00:201
102006199246912,2454cyclictest1068430-21kworker/1:2+events21:51:451
102006599246212,2447cyclictest1115337-21kworker/2:2+events00:05:202
102006199246111,2447cyclictest1032739-21kworker/1:2+events19:59:101
102006599245912,2445cyclictest1021367-21kworker/2:1+events19:25:192
102006199245912,2444cyclictest1113594-21kworker/1:0+events23:56:381
102006199245911,2445cyclictest1107492-21kworker/1:2+events23:41:261
102006199245911,2445cyclictest1035886-21kworker/1:0+events20:00:201
102006599245612,2440cyclictest1102598-21kworker/2:0+events23:26:552
102006599245312,2438cyclictest1030118-21kworker/2:2+events19:41:362
102006599245212,2437cyclictest1068366-21kworker/2:0+events22:25:362
102006599245111,2437cyclictest1068366-21kworker/2:0+events22:36:432
102006599245012,2435cyclictest1110415-21kworker/2:1+events23:55:292
102006599244812,2433cyclictest1104198-21kworker/2:2+events23:44:262
102006599244812,2432cyclictest1076218-21kworker/2:2+events22:01:412
102006599244710,2433cyclictest1047134-21kworker/2:2+events20:55:182
102006899244612,2431cyclictest1093215-21kworker/3:1+events23:31:053
102006599244612,2431cyclictest1120656-21kworker/2:0+events00:28:512
102006599244612,2430cyclictest1066747-21kworker/2:1+events21:37:152
102006599244610,2433cyclictest1090727-21kworker/2:0+events22:46:122
102006599244512,2430cyclictest1096588-21kworker/2:3+events23:06:242
102006599243912,2424cyclictest1063266-21kworker/2:0+events21:23:472
102006199243610,2423cyclictest1050364-21kworker/1:1+events20:51:101
102006599243512,2419cyclictest1047134-21kworker/2:2+events20:39:462
102006899243312,2417cyclictest1066853-21kworker/3:1+events21:39:103
102006899243311,2418cyclictest1093215-21kworker/3:1+events23:20:283
102006599243212,2417cyclictest1017763-21kworker/2:0+events19:15:422
102006899242712,2411cyclictest1117143-21kworker/3:1+events00:17:113
102006899242512,2409cyclictest1094820-21kworker/3:0+events23:03:223
102006899242412,2409cyclictest1026429-21kworker/3:1+events19:27:573
102006899242411,2409cyclictest1066853-21kworker/3:1+events21:44:553
102006899242312,2408cyclictest1051698-21kworker/3:1+events20:52:183
102006899242210,2409cyclictest1117143-21kworker/3:1+events00:21:003
102006899242012,2406cyclictest1076279-21kworker/3:2+events22:10:243
102006899242012,2404cyclictest1043964-21kworker/3:2+events20:26:303
102006199241511,2401cyclictest1073317-21kworker/1:0+events22:11:551
102006199241212,2396cyclictest1089401-21kworker/1:2+events23:29:111
102006899240812,2393cyclictest1110597-21kworker/3:0+events23:53:113
102006599240311,2389cyclictest1051727-21kworker/2:0+events20:48:522
102006599239712,2383cyclictest1068366-21kworker/2:0+events22:10:022
102006899238911,2374cyclictest1065245-21kworker/3:2+events21:33:013
102006199238812,2372cyclictest1118458-21kworker/1:1+events00:29:151
102006899238312,2367cyclictest1053356-21kworker/3:0+events20:58:013
102006199237111,2357cyclictest1089401-21kworker/1:2+events22:50:481
102006899236312,2347cyclictest1056701-21kworker/3:1+events21:10:103
10200619923547,2344cyclictest1089401-21kworker/1:2+events23:08:151
102006199234911,2335cyclictest1083314-21kworker/1:1+events22:27:311
102006199234210,2329cyclictest1107492-21kworker/1:2+events23:39:541
10200689923405,2332cyclictest1023196-21kworker/3:0+events19:37:533
102006899234012,2324cyclictest1079771-21kworker/3:0+events22:23:163
102005999233512,2319cyclictest1089574-21kworker/0:2+events22:53:290
10200659923349,2321cyclictest1068366-21kworker/2:0+events22:05:262
102005999232412,2309cyclictest1084802-21kworker/0:1+events22:30:570
102006199231712,2302cyclictest1121693-21kworker/1:0+events00:24:461
102005999231214,2295cyclictest1083136-21kworker/0:2+events22:28:160
102005999231212,2297cyclictest1108879-21kworker/0:0+events23:42:540
102005999230911,2294cyclictest1092364-21kworker/0:0+events23:12:050
10200599923075,2299cyclictest1100895-21kworker/0:1+events23:20:050
102006599230612,2291cyclictest1058037-21kworker/2:2+events21:14:192
102005999230512,2290cyclictest1086412-21kworker/0:0+events22:38:130
102006199229811,2284cyclictest1115308-21kworker/1:2+events00:10:401
102005999229711,2283cyclictest1118550-21kworker/0:0+events00:17:330
102005999229510,2282cyclictest1035946-21kworker/0:2+events19:58:020
102006899229211,2279cyclictest1105711-21kworker/3:0+events23:40:383
102006199229110,2278cyclictest1068430-21kworker/1:2+events21:57:531
102006199228711,2273cyclictest1005113-21kworker/1:0+events19:27:341
10200689922847,2274cyclictest1053356-21kworker/3:0+events21:02:373
102006199227911,2265cyclictest1089401-21kworker/1:2+events22:42:011
102006199227210,2259cyclictest1054900-21kworker/1:0+events21:21:081
102006199226911,2255cyclictest1025038-21kworker/1:1+events19:31:001
102006199226910,2256cyclictest1060163-21kworker/1:1+events21:18:101
102006599226712,2252cyclictest1112021-21kworker/2:0+events00:04:102
102006199226711,2253cyclictest1028240-21kworker/1:2+events19:38:571
102006199226710,2254cyclictest1054900-21kworker/1:0+events21:06:021
102005999226511,2251cyclictest1048680-21kworker/0:0+events20:51:320
102006899226410,2251cyclictest1074562-21kworker/3:1+events22:02:043
102006899226211,2248cyclictest1110597-21kworker/3:0+events00:09:303
102005999225911,2245cyclictest1074920-21kworker/0:1+events22:11:340
102006599225811,2244cyclictest1116964-21kworker/2:1+events00:12:362
102005999225812,2243cyclictest1059954-21kworker/0:0+events21:36:500
102006899225711,2241cyclictest1031312-21kworker/3:2+events19:48:063
10200619922578,2246cyclictest1089401-21kworker/1:2+events23:02:161
102006199225712,2242cyclictest1089401-21kworker/1:2+events23:20:521
10200619922566,2246cyclictest1089401-21kworker/1:2+events23:32:131
10200619922559,2242cyclictest1040890-21kworker/1:1+events20:34:271
102006199225511,2241cyclictest1078169-21kworker/1:2+events22:18:451
10200619922548,2243cyclictest1089401-21kworker/1:2+events23:14:221
10200619922539,2240cyclictest1118458-21kworker/1:1+events00:31:521
10200619922519,2239cyclictest1109173-21kworker/1:1+events23:52:261
102006199225110,2238cyclictest1068430-21kworker/1:2+events21:38:451
102005999224310,2228cyclictest1118550-21kworker/0:0+events00:24:000
102006599224210,2229cyclictest1104198-21kworker/2:2+events23:33:212
102006599223511,2220cyclictest1021367-21kworker/2:1+events19:54:142
10200659922339,2221cyclictest1021367-21kworker/2:1+events20:00:432
102006599223310,2220cyclictest1034283-21kworker/2:2+events19:55:472
102006899223210,2219cyclictest1108971-21kworker/3:1+events23:46:423
102006599223211,2218cyclictest1100937-21kworker/2:1+events23:17:472
102006199223210,2219cyclictest1118458-21kworker/1:1+events00:19:271
102006899223110,2217cyclictest1110597-21kworker/3:0+events00:11:033
102006599223110,2218cyclictest1112021-21kworker/2:0+events23:54:442
102006599223110,2218cyclictest1058037-21kworker/2:2+events21:34:582
102006899222911,2215cyclictest1096464-21kworker/3:2+events23:14:013
102006899222910,2216cyclictest1083415-21kworker/3:3+events22:26:453
10200689922288,2217cyclictest1036236-21kworker/3:1+events20:05:373
102006899222811,2214cyclictest1083415-21kworker/3:3+events22:51:113
102006899222811,2214cyclictest1043964-21kworker/3:2+events20:40:543
102006899222810,2216cyclictest1093215-21kworker/3:1+events23:15:073
10200659922289,2216cyclictest1040622-21kworker/2:1+events20:19:192
102006599222810,2215cyclictest1120656-21kworker/2:0+events00:36:282
102006899222711,2213cyclictest1102169-21kworker/3:2+events23:26:103
102006599222710,2214cyclictest1068366-21kworker/2:0+events21:52:322
102006199222711,2213cyclictest1065125-21kworker/1:1+events21:31:531
102006599222511,2211cyclictest1093183-21kworker/2:1+events23:01:302
102006599222511,2210cyclictest1032680-21kworker/2:0+events19:50:002
102005999222511,2210cyclictest1059954-21kworker/0:0+events21:46:280
102006599222411,2209cyclictest1037812-21kworker/2:2+events20:13:152
102006599222410,2211cyclictest1083016-21kworker/2:1+events22:24:492
102006599222410,2210cyclictest1023442-21kworker/2:2+events19:32:072
102005999222412,2209cyclictest1079653-21kworker/0:0+events22:19:290
102006599222311,2209cyclictest1058037-21kworker/2:2+events21:26:532
102006899222211,2208cyclictest1074562-21kworker/3:1+events22:08:083
102006599222211,2208cyclictest1043902-21kworker/2:2+events20:25:422
102006599222210,2209cyclictest1040622-21kworker/2:1+events20:22:402
102005999222212,2207cyclictest1110536-21kworker/0:2+events23:49:450
10200689922219,2209cyclictest1083415-21kworker/3:3+events22:42:243
102006599222111,2207cyclictest1118609-21kworker/2:2+events00:30:222
10200689922199,2206cyclictest1040650-21kworker/3:2+events20:13:373
102006899221710,2204cyclictest1034580-21kworker/3:2+events20:01:303
10200689922167,2206cyclictest1028060-21kworker/3:2+events19:33:163
102006899221011,2196cyclictest1094820-21kworker/3:0+events22:59:393
102006899221011,2196cyclictest1043964-21kworker/3:2+events20:34:493
10200619922097,2199cyclictest1065125-21kworker/1:1+events21:28:251
102006899220810,2195cyclictest1110597-21kworker/3:0+events00:03:493
102006899220810,2195cyclictest1083415-21kworker/3:3+events22:31:433
102006899220610,2193cyclictest1036236-21kworker/3:1+events20:17:043
10200689922027,2192cyclictest1083415-21kworker/3:3+events22:47:213
102006899220211,2188cyclictest1065245-21kworker/3:2+events21:29:113
102006899220211,2188cyclictest1023196-21kworker/3:0+events19:23:263
102006899220210,2189cyclictest1060417-21kworker/3:2+events21:18:313
102006899220110,2188cyclictest1042254-21kworker/3:0+events20:21:553
102006899219910,2185cyclictest1120495-21kworker/3:0+events00:32:153
102005999219710,2185cyclictest1118550-21kworker/0:0+events00:12:580
102006199219610,2183cyclictest1023411-21kworker/1:2+events19:19:341
102006899219410,2181cyclictest1056701-21kworker/3:1+events21:07:523
102006599219411,2179cyclictest1048797-21kworker/2:1+events20:43:372
102006899218811,2174cyclictest1079771-21kworker/3:0+events22:16:513
102006199218811,2174cyclictest1066764-21kworker/1:0+events21:42:591
102005999218410,2171cyclictest1019657-21kworker/0:0+events19:20:220
10200659921818,2170cyclictest1116964-21kworker/2:1+events00:16:252
102006599216610,2153cyclictest1037812-21kworker/2:2+events20:05:142
102006199216610,2153cyclictest1048503-21kworker/1:2+events20:39:011
102005999216611,2152cyclictest1051760-21kworker/0:1+events20:48:280
102006899216411,2150cyclictest1043964-21kworker/3:2+events20:46:163
10200659921599,2147cyclictest1056438-21kworker/2:0+events21:03:232
102005999215812,2143cyclictest1105915-21kworker/0:2+events23:37:590
102006899215111,2137cyclictest1096464-21kworker/3:2+events23:07:323
102006199215010,2137cyclictest1039260-21kworker/1:2+events20:16:421
102006599214810,2135cyclictest1105888-21kworker/2:1+events23:36:262
102005999214410,2130cyclictest1104168-21kworker/0:1+events23:28:470
10200599921371,2133cyclictest1051760-21kworker/0:1+events21:12:260
102006899213210,2119cyclictest1029667-21kworker/3:1+events19:43:303
102005999213010,2117cyclictest1063670-21kworker/0:3+events21:29:350
102006599212810,2115cyclictest1023442-21kworker/2:2+events19:24:342
102006199212110,2108cyclictest1005113-21kworker/1:0+events19:40:511
102005999212110,2108cyclictest1029808-21kworker/0:1+events20:02:370
102005999211911,2105cyclictest1053384-21kworker/0:2+events20:55:430
102006199211810,2104cyclictest1005113-21kworker/1:0+events19:45:251
102005999211811,2103cyclictest1100895-21kworker/0:1+events23:18:320
10200619921179,2105cyclictest1040890-21kworker/1:1+events20:20:481
102006199211610,2103cyclictest1054900-21kworker/1:0+events20:57:391
102005999211610,2103cyclictest1039228-21kworker/0:2+events20:18:120
102006199211410,2101cyclictest1105857-21kworker/1:0+events23:49:221
10200599921149,2102cyclictest1029808-21kworker/0:1+events19:40:290
102005999211211,2099cyclictest1069936-21kworker/0:2+events22:00:100
10200659921119,2099cyclictest1059986-21kworker/2:1+events21:16:592
102006599210910,2096cyclictest1090727-21kworker/2:0+events22:52:432
102005999210911,2090cyclictest1092364-21kworker/0:0+events22:56:560
102006199210710,2094cyclictest1005113-21kworker/1:0+events19:22:171
102005999210710,2093cyclictest1059954-21kworker/0:0+events21:32:370
10200619921067,2095cyclictest1115308-21kworker/1:2+events00:07:591
102005999210610,2092cyclictest1113894-21kworker/0:2+events00:03:260
10200599921059,2092cyclictest1039228-21kworker/0:2+events20:38:140
10200689921049,2092cyclictest1120495-21kworker/3:0+events00:36:513
10200599921042,2099cyclictest1104168-21kworker/0:1+events23:53:340
102005999210411,2089cyclictest1039228-21kworker/0:2+events20:14:000
102005999210211,2088cyclictest1096292-21kworker/0:1+events23:03:440
102005999210211,2088cyclictest1089574-21kworker/0:2+events22:44:430
102005999210211,2088cyclictest1058067-21kworker/0:2+events21:07:300
10200599921017,2091cyclictest1069936-21kworker/0:2+events21:54:270
10200619920989,2085cyclictest1073317-21kworker/1:0+events22:09:381
10200619920972,2092cyclictest1040890-21kworker/1:1+events20:26:511
102006199209711,2083cyclictest1076188-21kworker/1:1+events22:02:251
102006199209510,2081cyclictest1035886-21kworker/1:0+events20:09:051
102005999209211,2078cyclictest1039228-21kworker/0:2+events20:32:300
102005999209210,2078cyclictest1069936-21kworker/0:2+events22:05:030
10200689920867,2076cyclictest1016288-21kworker/3:2+events19:19:583
102006899208410,2071cyclictest1032948-21kworker/3:0+events19:56:103
102006599207811,2064cyclictest1068366-21kworker/2:0+events22:15:222
102005999207710,2064cyclictest1033276-21kworker/0:0+events19:54:360
10200689920769,2064cyclictest1032948-21kworker/3:0+events19:53:033
10200689920768,2066cyclictest1068518-21kworker/3:0+events21:58:393
10200659920759,2062cyclictest1100937-21kworker/2:1+events23:21:372
10200659920699,2057cyclictest1066747-21kworker/2:1+events21:45:412
10200659920699,2057cyclictest1016110-21kworker/2:2+events19:11:142
102006599206910,2056cyclictest1090727-21kworker/2:0+events22:56:332
10200599920656,2056cyclictest1118550-21kworker/0:0+events00:26:380
10200689920606,2051cyclictest1021194-21kworker/3:1+events19:15:003
10200599920539,2040cyclictest1021455-21kworker/0:2+events19:18:250
102005999205010,2037cyclictest1061562-21kworker/0:2+events21:22:390
102006599204910,2036cyclictest1087892-21kworker/2:1+events22:40:542
10200619920435,2035cyclictest1020949-21kworker/1:1+events19:12:431
10200599920396,2030cyclictest1055110-21kworker/0:0+events21:03:460
10200599920099,1997cyclictest1031434-21kworker/0:2+events19:46:120
102005999198311,1969cyclictest1039228-21kworker/0:2+events20:20:010
10200599919819,1969cyclictest1104168-21kworker/0:1+events23:33:430
102005999197810,1965cyclictest1073287-21kworker/0:0+events21:59:010
10200659919749,1962cyclictest1068366-21kworker/2:0+events22:32:072
10200599919636,1953cyclictest1084802-21kworker/0:1+events22:46:590
10200599919629,1950cyclictest1059954-21kworker/0:0+events21:41:520
10200599919619,1950cyclictest1104168-21kworker/0:1+events23:55:080
10200599919607,1950cyclictest1125134-21kworker/0:2+events00:38:460
10200599919539,1941cyclictest1051760-21kworker/0:1+events21:16:150
10200599919519,1939cyclictest1039228-21kworker/0:2+events20:09:490
102005999195110,1938cyclictest1048680-21kworker/0:0+events20:41:400
10200599919492,1944cyclictest1028208-21kworker/0:2+events19:37:280
10200599919488,1937cyclictest1118550-21kworker/0:0+events00:34:570
10200599919488,1937cyclictest1019657-21kworker/0:0+events19:14:130
10200599919484,1940cyclictest1019657-21kworker/0:0+events19:34:240
10200619919479,1935cyclictest1031110-21kworker/1:1+events19:50:451
10200599919309,1918cyclictest1113894-21kworker/0:2+events00:06:050
10200599919297,1919cyclictest1092364-21kworker/0:0+events23:09:250
10195952153116,24sleep20-21swapper/219:06:312
10195592149103,41sleep10-21swapper/119:06:021
10195612143107,30sleep30-21swapper/319:06:043
10197982140106,29sleep00-21swapper/019:09:040
102006599160,4cyclictest1052844-21/usr/sbin/munin20:50:182
1020059991511,3cyclictest1025370-21/usr/sbin/munin19:25:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional