You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-10 - 16:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Thu Sep 10, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10030799333514,3316cyclictest91786-21kworker/0:2+events19:15:150
10030799321515,3196cyclictest127997-21kworker/0:1+events20:40:180
10032299315715,3137cyclictest142222-21kworker/3:0+events21:25:153
10032299301114,2992cyclictest142222-21kworker/3:0+events21:20:193
10031799282113,2803cyclictest135760-21kworker/2:0+events21:05:172
10032299280313,2785cyclictest190569-21kworker/3:0+events23:54:283
10030799279510,2780cyclictest157925-21kworker/0:0+events22:10:210
10031799271713,2701cyclictest173097-21kworker/2:0+events23:10:172
10031299270713,2688cyclictest138782-21kworker/1:0+events21:10:131
10031299269212,2676cyclictest156411-21kworker/1:2+events22:15:161
10032299266412,2648cyclictest131026-21kworker/3:0+events20:45:193
10030799265413,2639cyclictest126044-21kworker/0:0+events20:30:010
10031299263213,2615cyclictest134125-21kworker/1:2+events20:53:501
10032299262813,2611cyclictest176061-21kworker/3:1+events23:16:423
10032299261512,2599cyclictest116610-21kworker/3:0+events20:15:173
1003179926127,2602cyclictest156381-21kworker/2:1+events22:17:512
1003179925978,2586cyclictest116311-21kworker/2:1+events20:00:212
10032299259111,2576cyclictest195104-21kworker/3:0+events00:04:433
10032299258112,2565cyclictest187271-21kworker/3:2+events23:42:203
10032299257512,2559cyclictest111705-21kworker/3:1+events19:47:263
10031299255413,2537cyclictest143820-21kworker/1:1+events21:49:341
1003079925419,2528cyclictest91786-21kworker/0:2+events19:23:590
10031299253812,2522cyclictest113375-21kworker/1:0+events20:13:251
10030799253213,2515cyclictest139147-21kworker/0:0+events21:30:120
1003129925270,2523cyclictest165762-21kworker/1:2+events22:34:151
10031299250612,2490cyclictest187902-21kworker/1:1+events23:48:491
1003129925026,2492cyclictest198218-21kworker/1:1+events00:36:341
10032299249912,2484cyclictest161260-21kworker/3:0+events22:35:253
10032299249812,2482cyclictest161260-21kworker/3:0+events22:56:153
10032299249712,2482cyclictest172830-21kworker/3:1+events22:52:523
10032299249512,2480cyclictest142222-21kworker/3:0+events21:44:443
10032299249412,2478cyclictest142222-21kworker/3:0+events21:47:233
10031799248612,2472cyclictest142125-21kworker/2:1+events21:21:512
10031299248612,2472cyclictest156411-21kworker/1:2+events22:05:041
1003129924859,2472cyclictest132480-21kworker/1:0+events20:55:211
10031799248012,2464cyclictest193546-21kworker/2:0+events00:09:432
10031299247912,2465cyclictest164159-21kworker/1:0+events22:35:031
10032299247710,2464cyclictest203468-21kworker/3:2+events00:36:103
1003079924779,2464cyclictest139147-21kworker/0:0+events21:20:420
1003179924748,2462cyclictest135760-21kworker/2:0+events21:29:032
10031799247212,2457cyclictest113404-21kworker/2:2+events20:12:392
1003179924717,2460cyclictest190263-21kworker/2:1+events23:54:052
10031799247112,2455cyclictest161228-21kworker/2:0+events22:24:432
10030799246711,2453cyclictest171042-21kworker/0:0+events22:49:240
1003179924649,2452cyclictest154759-21kworker/2:0+events22:08:052
10032299245812,2443cyclictest101640-21kworker/3:0+events19:16:243
10031799245712,2441cyclictest193546-21kworker/2:0+events00:17:172
10032299245412,2439cyclictest116718-21kworker/3:3+events20:04:583
1003079924478,2435cyclictest177777-21kworker/0:1+events23:11:030
10030799244310,2429cyclictest164453-21kworker/0:2+events22:34:390
10030799243712,2421cyclictest139147-21kworker/0:0+events21:18:460
10031299243612,2420cyclictest177717-21kworker/1:1+events23:14:471
10030799243612,2420cyclictest159629-21kworker/0:1+events22:17:280
10031799243411,2419cyclictest124505-21kworker/2:0+events20:37:152
10030799243412,2419cyclictest171042-21kworker/0:0+events22:52:060
10030799243412,2418cyclictest129866-21kworker/0:2+events21:10:370
10030799243012,2414cyclictest179375-21kworker/0:2+events23:19:000
10030799242612,2410cyclictest198456-21kworker/0:0+events00:32:440
10030799242512,2410cyclictest110143-21kworker/0:0+events20:04:330
10032299242413,2407cyclictest113312-21kworker/3:2+events19:58:303
10031799242411,2408cyclictest119544-21kworker/2:1+events20:20:152
1003229924227,2412cyclictest153307-21kworker/3:1+events21:55:343
10031799242111,2406cyclictest105310-21kworker/2:0+events19:53:532
10030799242112,2406cyclictest122827-21kworker/0:2+events20:28:300
10031799242013,2404cyclictest169168-21kworker/2:2+events22:47:542
10031299241511,2400cyclictest173239-21kworker/1:0+events23:07:391
10030799241111,2397cyclictest172920-21kworker/0:1+events22:55:530
10031299241012,2396cyclictest156411-21kworker/1:2+events22:25:071
10031799240912,2394cyclictest147075-21kworker/2:1+events21:48:272
10031299240812,2393cyclictest110120-21kworker/1:2+events19:43:131
10031799240412,2390cyclictest180890-21kworker/2:1+events23:35:032
10031299240312,2387cyclictest173239-21kworker/1:0+events23:04:381
10032299240212,2386cyclictest151568-21kworker/3:2+events21:52:123
10031799240212,2386cyclictest173097-21kworker/2:0+events23:06:102
10031299240212,2387cyclictest148401-21kworker/1:0+events21:38:151
10031299240012,2386cyclictest124489-21kworker/1:1+events20:46:281
10031799239912,2384cyclictest119544-21kworker/2:1+events20:28:532
1003129923999,2387cyclictest156411-21kworker/1:2+events22:20:561
10032299239812,2383cyclictest161260-21kworker/3:0+events22:45:373
10031799239811,2384cyclictest126236-21kworker/2:2+events20:34:562
10031299239811,2383cyclictest124489-21kworker/1:1+events20:31:301
10031299239712,2382cyclictest198218-21kworker/1:1+events00:19:541
10031299239712,2381cyclictest153191-21kworker/1:0+events21:58:151
10031799239612,2381cyclictest185817-21kworker/2:2+events23:40:472
10031799239612,2381cyclictest153104-21kworker/2:2+events22:00:532
10031299239512,2380cyclictest113375-21kworker/1:0+events20:05:211
10031799239412,2378cyclictest174734-21kworker/2:1+events23:01:172
10031299239411,2380cyclictest134125-21kworker/1:2+events21:00:191
10032299239312,2377cyclictest187271-21kworker/3:2+events23:39:153
10032299239211,2377cyclictest203468-21kworker/3:2+events00:31:143
10031799239212,2377cyclictest149847-21kworker/2:2+events21:42:262
1003179923919,2380cyclictest169168-21kworker/2:2+events22:50:342
10031799239112,2376cyclictest147075-21kworker/2:1+events21:54:502
10031799239112,2375cyclictest180890-21kworker/2:1+events23:21:192
10031799239012,2374cyclictest130935-21kworker/2:2+events20:44:112
10031799239011,2376cyclictest193546-21kworker/2:0+events23:58:382
10030799239012,2374cyclictest179375-21kworker/0:2+events23:20:570
10030799239012,2374cyclictest176149-21kworker/0:2+events23:07:170
10031799238912,2373cyclictest162853-21kworker/2:2+events22:28:072
10031799238912,2373cyclictest119544-21kworker/2:1+events20:16:462
10030799238911,2374cyclictest184230-21kworker/0:2+events23:41:110
10031799238812,2372cyclictest119544-21kworker/2:1+events20:09:352
10030799238812,2372cyclictest198456-21kworker/0:0+events00:20:150
10030799238712,2371cyclictest139147-21kworker/0:0+events21:58:360
10031799238612,2371cyclictest129248-21kworker/2:1+events20:54:592
10030799238612,2372cyclictest156263-21kworker/0:1+events22:02:450
10030799238611,2372cyclictest110143-21kworker/0:0+events19:44:440
10032299238512,2369cyclictest195104-21kworker/3:0+events00:12:403
10031799238312,2368cyclictest153104-21kworker/2:2+events21:57:512
10031799238312,2368cyclictest130935-21kworker/2:2+events20:46:062
10030799238212,2368cyclictest196806-21kworker/0:2+events00:10:060
10032299238012,2366cyclictest161260-21kworker/3:0+events22:40:193
10031799237511,2360cyclictest161228-21kworker/2:0+events22:36:092
10031799237112,2357cyclictest193546-21kworker/2:0+events00:13:042
10030799236712,2351cyclictest121169-21kworker/0:0+events20:21:200
10030799236511,2350cyclictest110143-21kworker/0:0+events19:49:200
10030799236311,2347cyclictest108542-21kworker/0:2+events19:36:180
10030799236211,2347cyclictest110143-21kworker/0:0+events19:52:210
10030799236112,2345cyclictest113433-21kworker/0:2+events19:58:510
10030799236010,2347cyclictest135825-21kworker/0:0+events20:59:570
10030799235912,2344cyclictest127997-21kworker/0:1+events20:36:530
10030799235812,2343cyclictest139147-21kworker/0:0+events21:47:440
10030799235512,2340cyclictest117910-21kworker/0:1+events20:13:470
10030799235410,2340cyclictest129866-21kworker/0:2+events21:02:590
10030799235310,2339cyclictest184230-21kworker/0:2+events23:35:490
10030799235210,2338cyclictest117910-21kworker/0:1+events20:06:080
10030799235112,2336cyclictest182601-21kworker/0:1+events23:31:410
10030799235112,2336cyclictest166561-21kworker/0:1+events22:41:520
10030799235112,2336cyclictest153604-21kworker/0:2+events22:21:400
10030799235111,2336cyclictest132412-21kworker/0:0+events20:45:430
10030799235012,2335cyclictest148373-21kworker/0:1+events21:38:380
10031299234912,2334cyclictest167720-21kworker/1:1+events22:57:481
10031299234110,2327cyclictest103562-21kworker/1:2+events19:19:241
10032299234012,2325cyclictest198339-21kworker/3:1+events00:21:473
10030799233910,2326cyclictest202021-21kworker/0:2+events00:35:470
10031299233812,2323cyclictest153191-21kworker/1:0+events22:03:321
10031299233712,2321cyclictest134125-21kworker/1:2+events21:17:201
10031299233610,2322cyclictest171297-21kworker/1:2+events22:53:591
10031299233512,2321cyclictest110120-21kworker/1:2+events19:45:081
10031799233411,2320cyclictest180890-21kworker/2:1+events23:25:562
10031299233312,2317cyclictest190215-21kworker/1:2+events23:57:541
10032299233012,2314cyclictest174431-21kworker/3:2+events23:00:543
10032299233011,2316cyclictest119576-21kworker/3:1+events20:08:043
10031299232912,2313cyclictest115034-21kworker/1:2+events19:59:121
10032299232712,2311cyclictest179345-21kworker/3:0+events23:33:093
10032299232711,2313cyclictest187271-21kworker/3:2+events23:56:233
10031799232712,2312cyclictest162853-21kworker/2:2+events22:33:522
10032299232612,2310cyclictest119576-21kworker/3:1+events20:44:333
10032299232611,2311cyclictest119576-21kworker/3:1+events20:20:363
1003129923269,2314cyclictest121283-21kworker/1:2+events20:23:351
10031299232611,2311cyclictest193834-21kworker/1:3+events00:03:361
10032299232411,2310cyclictest179345-21kworker/3:0+events23:20:343
10032299232311,2309cyclictest154936-21kworker/3:2+events22:05:483
10031799232111,2307cyclictest113404-21kworker/2:2+events19:55:482
10030799232112,2306cyclictest196806-21kworker/0:2+events00:17:390
10032299232012,2304cyclictest119576-21kworker/3:1+events20:29:153
10031299232012,2305cyclictest181040-21kworker/1:0+events23:24:231
10031299231912,2304cyclictest156411-21kworker/1:2+events22:12:141
10032299231813,2301cyclictest119576-21kworker/3:1+events20:37:393
10032299231812,2303cyclictest96543-21kworker/3:1+events19:25:323
10031299231712,2301cyclictest179314-21kworker/1:2+events23:17:291
10032299231610,2302cyclictest196707-21kworker/3:2+events00:08:343
10031299231612,2300cyclictest113375-21kworker/1:0+events20:19:521
1003229923156,2306cyclictest137327-21kworker/3:2+events21:06:463
10031299231412,2299cyclictest129278-21kworker/1:2+events20:43:241
10030799231312,2298cyclictest139147-21kworker/0:0+events21:27:300
10031299231211,2297cyclictest142039-21kworker/1:0+events21:21:041
10032299231011,2295cyclictest142222-21kworker/3:0+events21:34:043
10031299231011,2296cyclictest121283-21kworker/1:2+events20:27:421
10032299230512,2289cyclictest119576-21kworker/3:1+events20:53:053
10031299230512,2290cyclictest134125-21kworker/1:2+events21:08:421
10032299230411,2290cyclictest139018-21kworker/3:1+events21:14:203
10031799230311,2288cyclictest130935-21kworker/2:2+events20:56:062
10030799230312,2288cyclictest137506-21kworker/0:1+events21:07:100
10032299230112,2286cyclictest154936-21kworker/3:2+events22:26:363
10032299230012,2284cyclictest116610-21kworker/3:0+events20:11:513
10032299229512,2280cyclictest164509-21kworker/3:1+events22:32:183
10030799229411,2280cyclictest106859-21kworker/0:1+events19:27:480
1003229922790,2275cyclictest135698-21kworker/3:0+events21:02:363
10032299227811,2264cyclictest101640-21kworker/3:0+events19:21:443
10030799227710,2263cyclictest198456-21kworker/0:0+events00:27:520
10030799227710,2263cyclictest198456-21kworker/0:0+events00:27:520
10032299227410,2260cyclictest154936-21kworker/3:2+events22:02:013
10032299227011,2256cyclictest183946-21kworker/3:2+events23:27:063
10031799226912,2255cyclictest145364-21kworker/2:2+events21:30:352
10032299225111,2237cyclictest106790-21kworker/3:2+events19:33:363
10031799224310,2230cyclictest105310-21kworker/2:0+events19:30:302
10030799224111,2226cyclictest139147-21kworker/0:0+events21:52:350
10030799223412,2219cyclictest108542-21kworker/0:2+events19:33:120
10031299223310,2220cyclictest185697-21kworker/1:0+events23:43:061
10030799221510,2202cyclictest166561-21kworker/0:1+events22:39:100
1003179922077,2197cyclictest188662-21kworker/2:0+events23:48:262
10030799220510,2192cyclictest157925-21kworker/0:0+events22:08:270
10031799219810,2185cyclictest198369-21kworker/2:1+events00:20:392
1003229921977,2187cyclictest201866-21kworker/3:0+events00:27:063
1003229921977,2187cyclictest201866-21kworker/3:0+events00:27:063
1003179921943,2188cyclictest111614-21kworker/2:1+events19:45:522
10031299219411,2181cyclictest199972-21kworker/1:0+events00:26:211
10031299219411,2181cyclictest199972-21kworker/1:0+events00:26:211
10032299219210,2179cyclictest126103-21kworker/3:0+events20:30:253
10030799218810,2175cyclictest121169-21kworker/0:0+events20:17:560
1003179921868,2174cyclictest135760-21kworker/2:0+events21:39:002
10031799218510,2172cyclictest140356-21kworker/2:2+events21:15:512
10031799218510,2171cyclictest101582-21kworker/2:0+events19:14:312
10031799218411,2169cyclictest203284-21kworker/2:0+events00:32:212
10031799218410,2171cyclictest103622-21kworker/2:2+events19:21:202
10031799218311,2169cyclictest135760-21kworker/2:0+events21:13:562
1003179921819,2168cyclictest198369-21kworker/2:1+events00:26:432
1003179921819,2168cyclictest198369-21kworker/2:1+events00:26:432
10031799218111,2166cyclictest105310-21kworker/2:0+events19:28:352
10031799218110,2168cyclictest180890-21kworker/2:1+events23:18:372
10031799218110,2168cyclictest105310-21kworker/2:0+events19:37:242
10032299218011,2166cyclictest185669-21kworker/3:1+events23:48:023
10031299218011,2165cyclictest184094-21kworker/1:2+events23:31:181
10031799217511,2161cyclictest99908-21kworker/2:1+events19:19:002
1003079921758,2163cyclictest184230-21kworker/0:2+events23:49:130
1003179921748,2163cyclictest154759-21kworker/2:0+events22:11:272
10031799217110,2158cyclictest180890-21kworker/2:1+events23:32:452
10031799217011,2156cyclictest161228-21kworker/2:0+events22:41:062
10030799216810,2155cyclictest191912-21kworker/0:1+events00:00:110
10030799216511,2150cyclictest139147-21kworker/0:0+events21:43:580
10032299216410,2151cyclictest198339-21kworker/3:1+events00:18:003
1003179921633,2157cyclictest203284-21kworker/2:0+events00:39:142
10030799216310,2150cyclictest195212-21kworker/0:0+events00:07:490
10030799216210,2150cyclictest182601-21kworker/0:1+events23:25:090
1003179921616,2151cyclictest105310-21kworker/2:0+events19:41:172
10030799216111,2146cyclictest129866-21kworker/0:2+events20:51:060
10030799216011,2146cyclictest184230-21kworker/0:2+events23:53:440
10030799215910,2146cyclictest159629-21kworker/0:1+events22:28:310
10031299215810,2145cyclictest111767-21kworker/1:1+events19:51:581
1003079921549,2142cyclictest176149-21kworker/0:2+events23:03:540
10030799214810,2134cyclictest184230-21kworker/0:2+events23:59:010
10031299213811,2124cyclictest113375-21kworker/1:0+events20:01:541
10032299213310,2119cyclictest139018-21kworker/3:1+events21:16:143
10032299213011,2116cyclictest108457-21kworker/3:0+events19:51:353
10031299211711,2102cyclictest143820-21kworker/1:1+events21:34:271
10031299211710,2103cyclictest151205-21kworker/1:2+events21:52:571
1003129921168,2104cyclictest167720-21kworker/1:1+events22:49:471
10031299211611,2101cyclictest101495-21kworker/1:0+events19:13:001
10031299211511,2101cyclictest191901-21kworker/1:0+events23:53:011
10031299211511,2101cyclictest185697-21kworker/1:0+events23:37:181
10031299211511,2100cyclictest198218-21kworker/1:1+events00:12:171
10031299211510,2102cyclictest169373-21kworker/1:0+events22:44:291
10031299211411,2100cyclictest198218-21kworker/1:1+events00:24:501
10031299211411,2100cyclictest124489-21kworker/1:1+events20:36:071
10031299211010,2098cyclictest99817-21kworker/1:1+events19:22:081
1003229921079,2095cyclictest154936-21kworker/3:2+events22:23:573
1003229921079,2094cyclictest108457-21kworker/3:0+events19:38:113
10032299210610,2093cyclictest154936-21kworker/3:2+events22:11:063
10031299210611,2092cyclictest108425-21kworker/1:1+events19:32:501
10031299210511,2092cyclictest196614-21kworker/1:0+events00:06:381
10032299210411,2090cyclictest176061-21kworker/3:1+events23:13:183
10031799210412,2089cyclictest190263-21kworker/2:1+events00:02:042
10031299210311,2089cyclictest108425-21kworker/1:1+events19:35:551
1003229921029,2090cyclictest108457-21kworker/3:0+events19:44:223
10032299210111,2086cyclictest148311-21kworker/3:1+events21:37:533
10032299210110,2088cyclictest176061-21kworker/3:1+events23:08:033
10032299210110,2088cyclictest154936-21kworker/3:2+events22:19:473
10031299209911,2084cyclictest143820-21kworker/1:1+events21:27:541
10032299209710,2084cyclictest101640-21kworker/3:0+events19:14:543
10030799209610,2083cyclictest99993-21kworker/0:0+events19:11:100
1003129920953,2088cyclictest103562-21kworker/1:2+events19:27:011
10032299208811,2073cyclictest119576-21kworker/3:1+events20:59:343
10031299206310,2051cyclictest143820-21kworker/1:1+events21:40:091
10031299196610,1948cyclictest177717-21kworker/1:1+events23:28:141
10031299196010,1947cyclictest203527-21kworker/1:2+events00:33:071
999172160104,24sleep10-21swapper/119:08:081
999542147104,24sleep00-21swapper/019:08:350
999072142107,30sleep20-21swapper/219:08:012
998732140106,29sleep30-21swapper/319:07:343
10031799160,14cyclictest173669-21/usr/sbin/munin22:55:132
10031799147,1cyclictest136950-21/usr/sbin/munin21:00:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional