You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 00:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Tue Sep 01, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3852399319215,3173cyclictest82303-21kworker/3:1+events21:35:133
3852399281513,2797cyclictest64553-21kworker/3:1+events20:45:123
3852399276313,2745cyclictest112387-21kworker/3:1+events23:00:183
3852199272113,2703cyclictest101474-21kworker/2:1+events22:35:132
3852399271513,2698cyclictest97867-21kworker/3:0+events22:18:423
3852399271313,2697cyclictest83969-21kworker/3:2+events21:45:333
3852399266912,2655cyclictest115854-21kworker/3:0+events23:10:113
3851299265013,2633cyclictest136531-21kworker/0:0+events00:22:050
3851299264412,2629cyclictest81015-21kworker/0:0+events21:24:130
3851299264313,2626cyclictest106063-21kworker/0:0+events22:37:300
3852399263213,2615cyclictest135078-21kworker/3:2+events00:19:043
3851799260012,2584cyclictest115823-21kworker/1:2+events23:13:141
3851799258212,2566cyclictest55874-21kworker/1:0+events20:02:011
3851799257812,2562cyclictest74413-21kworker/1:0+events21:09:411
3851799257812,2562cyclictest46571-21kworker/1:2+events19:37:221
3851799257410,2560cyclictest86969-21kworker/1:2+events22:06:341
3851799256912,2554cyclictest114221-21kworker/1:0+events23:03:451
385239925639,2550cyclictest139714-21kworker/3:0+events00:36:103
385219925639,2550cyclictest124397-21kworker/2:3+events23:39:102
3851799256212,2548cyclictest102928-21kworker/1:2+events22:34:491
3851799256211,2547cyclictest51406-21kworker/1:1+events19:53:341
3852199256012,2544cyclictest61100-21kworker/2:1+events20:24:042
3852199255711,2542cyclictest131242-21kworker/2:0+events00:06:332
3851799254013,2523cyclictest57743-21kworker/1:2+events20:15:131
3852399253812,2521cyclictest106244-21kworker/3:2+events23:05:163
3852399253412,2518cyclictest104643-21kworker/3:1+events22:40:523
3852399253111,2516cyclictest59490-21kworker/3:0+events20:17:333
385179925268,2515cyclictest102928-21kworker/1:2+events22:28:051
3852399252312,2507cyclictest97867-21kworker/3:0+events22:37:513
3851799252312,2507cyclictest139951-21kworker/1:1+events00:26:171
3852199251612,2500cyclictest41812-21kworker/2:2+events19:28:262
3851799250412,2488cyclictest96914-21kworker/1:1+events22:24:421
3852399250312,2488cyclictest41753-21kworker/3:2+events19:31:333
3852199250112,2485cyclictest124397-21kworker/2:3+events23:48:382
385179925018,2490cyclictest72657-21kworker/1:2+events20:56:171
3852199249712,2483cyclictest53028-21kworker/2:1+events19:55:032
3852199249612,2481cyclictest98132-21kworker/2:0+events22:27:002
3852199249612,2480cyclictest78451-21kworker/2:0+events21:36:222
3851799249612,2481cyclictest85206-21kworker/1:0+events21:34:041
3851799249612,2480cyclictest132754-21kworker/1:2+events00:00:481
3852199249512,2480cyclictest110994-21kworker/2:0+events23:01:492
3852199249512,2479cyclictest99823-21kworker/2:2+events22:20:362
3852199249512,2479cyclictest131242-21kworker/2:0+events23:56:392
3851799249512,2479cyclictest86969-21kworker/1:2+events22:02:221
3851799249511,2481cyclictest115823-21kworker/1:2+events23:18:101
3852199249412,2479cyclictest86999-21kworker/2:2+events21:48:332
3852199249312,2477cyclictest41812-21kworker/2:2+events19:22:442
3851799249312,2478cyclictest110871-21kworker/1:1+events22:52:381
3851299249312,2478cyclictest138200-21kworker/0:1+events00:28:580
3852199249112,2475cyclictest64585-21kworker/2:0+events21:01:382
3851299249011,2475cyclictest91861-21kworker/0:0+events22:00:500
3852399248812,2472cyclictest88826-21kworker/3:1+events21:53:103
3851799248812,2473cyclictest79099-21kworker/1:1+events21:16:351
3852399248712,2473cyclictest135078-21kworker/3:2+events00:25:073
3851799248612,2471cyclictest96914-21kworker/1:1+events22:16:251
385239924859,2474cyclictest80680-21kworker/3:0+events21:20:043
385239924846,2475cyclictest101444-21kworker/3:2+events22:23:343
3851799248410,2471cyclictest110871-21kworker/1:1+events22:55:221
3852399248312,2467cyclictest64553-21kworker/3:1+events21:07:453
385219924833,2477cyclictest134750-21kworker/2:1+events00:10:412
385219924833,2477cyclictest134750-21kworker/2:1+events00:10:412
385179924839,2470cyclictest48181-21kworker/1:0+events19:42:191
3851299248212,2466cyclictest129399-21kworker/0:1+events00:08:030
3852399248111,2467cyclictest115854-21kworker/3:0+events23:21:343
3852399248012,2464cyclictest82303-21kworker/3:1+events21:30:153
3852399247811,2464cyclictest101444-21kworker/3:2+events22:30:453
3852399247612,2461cyclictest64553-21kworker/3:1+events20:36:373
3851799247214,2454cyclictest131093-21kworker/1:0+events00:08:261
385239924708,2459cyclictest119398-21kworker/3:1+events23:27:183
3851799246612,2450cyclictest41870-21kworker/1:0+events19:24:131
3852399246510,2452cyclictest93687-21kworker/3:2+events22:14:293
3852399246510,2452cyclictest93687-21kworker/3:2+events22:14:283
3852199246512,2449cyclictest51376-21kworker/2:0+events19:49:532
3852399245910,2446cyclictest51708-21kworker/3:2+events20:00:263
3851299245612,2440cyclictest107684-21kworker/0:2+events22:45:490
3851299245512,2440cyclictest141410-21kworker/0:0+events00:35:480
3852399245211,2438cyclictest109538-21kworker/3:0+events22:53:023
3851799245113,2434cyclictest83576-21kworker/1:1+events21:43:141
3851299244612,2430cyclictest52686-21kworker/0:2+events20:10:180
3851299243612,2420cyclictest64583-21kworker/0:0+events20:34:390
3851799243111,2416cyclictest67731-21kworker/1:0+events20:37:441
3852399242711,2412cyclictest106244-21kworker/3:2+events22:56:063
3852399242510,2412cyclictest86814-21kworker/3:0+events21:41:433
3852199242012,2405cyclictest67760-21kworker/2:1+events20:39:362
3851299241711,2403cyclictest52686-21kworker/0:2+events19:58:330
3851799241612,2401cyclictest55874-21kworker/1:0+events20:06:141
3851299241612,2401cyclictest43458-21kworker/0:1+events19:30:010
3851299241512,2399cyclictest43458-21kworker/0:1+events19:32:210
3852399241412,2399cyclictest88826-21kworker/3:1+events21:56:383
3852399241412,2399cyclictest129313-21kworker/3:2+events23:57:473
385129924146,2404cyclictest114397-21kworker/0:2+events23:10:340
3851299241412,2398cyclictest106063-21kworker/0:0+events23:02:580
3852399241212,2397cyclictest88826-21kworker/3:1+events22:02:463
3852399241212,2396cyclictest101444-21kworker/3:2+events22:27:433
3851799241211,2397cyclictest104758-21kworker/1:1+events22:35:361
3851299241212,2397cyclictest127459-21kworker/0:0+events23:44:290
3851299241012,2394cyclictest74221-21kworker/0:2+events21:35:590
3851299241012,2394cyclictest68044-21kworker/0:1+events20:41:520
3852399240912,2393cyclictest68055-21kworker/3:0+events20:44:083
3852399240811,2394cyclictest106244-21kworker/3:2+events22:49:583
3852399240612,2390cyclictest64553-21kworker/3:1+events21:03:573
3852399240612,2390cyclictest139714-21kworker/3:0+events00:34:173
3851299240612,2391cyclictest136531-21kworker/0:0+events00:16:000
3851299240611,2391cyclictest100292-21kworker/0:2+events22:27:210
3852399240511,2390cyclictest124294-21kworker/3:2+events23:38:483
3851299240512,2389cyclictest28583-21kworker/0:0+events19:14:460
3852399240412,2388cyclictest135078-21kworker/3:2+events00:14:053
3852399240412,2388cyclictest135078-21kworker/3:2+events00:14:053
3852399240411,2390cyclictest59490-21kworker/3:0+events20:32:223
3852399240411,2390cyclictest119398-21kworker/3:1+events23:45:373
3852399240311,2390cyclictest48212-21kworker/3:0+events19:40:013
3852399240311,2388cyclictest80680-21kworker/3:0+events21:27:593
3852399240310,2391cyclictest134155-21kworker/3:1+events00:05:013
3852399240212,2386cyclictest134155-21kworker/3:1+events00:01:363
3852399240211,2388cyclictest72488-21kworker/3:0+events20:51:423
3851299240211,2388cyclictest127459-21kworker/0:0+events23:49:230
385239924019,2390cyclictest88826-21kworker/3:1+events22:05:033
3852399240112,2385cyclictest49840-21kworker/3:1+events20:08:073
3852399240012,2384cyclictest129313-21kworker/3:2+events23:50:333
3852399240011,2386cyclictest46603-21kworker/3:1+events19:38:053
3851299240012,2384cyclictest61057-21kworker/0:1+events20:22:090
3852399239912,2385cyclictest122687-21kworker/3:0+events23:30:013
3852399239911,2385cyclictest49840-21kworker/3:1+events19:52:303
385219923995,2391cyclictest131242-21kworker/2:0+events00:20:122
3852399239812,2382cyclictest49840-21kworker/3:1+events19:45:233
3852399239812,2382cyclictest126242-21kworker/3:0+events23:42:563
3852399239712,2381cyclictest39706-21kworker/3:0+events19:16:423
385219923949,2382cyclictest124397-21kworker/2:3+events23:41:502
3852199239312,2377cyclictest41812-21kworker/2:2+events20:16:242
385129923928,2381cyclictest74221-21kworker/0:2+events21:00:300
3851799239112,2375cyclictest102928-21kworker/1:2+events22:46:111
3852199239012,2374cyclictest85332-21kworker/2:1+events21:42:062
3852399238812,2373cyclictest41753-21kworker/3:2+events19:29:383
3852199238712,2373cyclictest138011-21kworker/2:2+events00:32:222
3852199238212,2366cyclictest93474-21kworker/2:1+events22:05:502
3852199238211,2367cyclictest104866-21kworker/2:0+events22:43:552
3851799238210,2368cyclictest131093-21kworker/1:0+events23:59:161
3851799237612,2361cyclictest72657-21kworker/1:2+events21:25:421
3851799237512,2359cyclictest115823-21kworker/1:2+events23:32:391
3851299236412,2348cyclictest46702-21kworker/0:0+events19:47:370
3851299236311,2349cyclictest43458-21kworker/0:1+events19:36:590
3852399235912,2345cyclictest115854-21kworker/3:0+events23:15:073
3851299235812,2343cyclictest91861-21kworker/0:0+events21:53:340
3852199235610,2342cyclictest78451-21kworker/2:0+events21:27:342
3851299235112,2336cyclictest116014-21kworker/0:1+events23:09:020
3851799234912,2333cyclictest60978-21kworker/1:0+events20:25:341
3851299234912,2333cyclictest88643-21kworker/0:1+events21:49:200
3851299234812,2333cyclictest86752-21kworker/0:0+events21:43:590
3851299234811,2334cyclictest70915-21kworker/0:0+events20:47:300
3851299234712,2332cyclictest46702-21kworker/0:0+events19:54:220
3851299234712,2332cyclictest131029-21kworker/0:2+events23:55:290
3852199234511,2331cyclictest112628-21kworker/2:2+events23:17:012
3851299234511,2331cyclictest106063-21kworker/0:0+events22:51:080
3851299234311,2330cyclictest100292-21kworker/0:2+events22:30:230
3852199234212,2327cyclictest78451-21kworker/2:0+events21:34:512
3851299234210,2329cyclictest131029-21kworker/0:2+events23:53:560
3851299234011,2326cyclictest61057-21kworker/0:1+events20:25:110
3851299233910,2325cyclictest77414-21kworker/0:1+events21:12:230
3851299233810,2325cyclictest96826-21kworker/0:0+events22:17:100
3851799233510,2322cyclictest86969-21kworker/1:2+events21:48:101
3851299233512,2321cyclictest90248-21kworker/0:2+events21:55:060
3851299233314,2316cyclictest39833-21kworker/0:1+events19:15:330
3851299233212,2316cyclictest79210-21kworker/0:3+events21:15:240
3851799233112,2316cyclictest138149-21kworker/1:0+events00:23:381
3851799233110,2317cyclictest72657-21kworker/1:2+events21:22:401
3852199233012,2314cyclictest99823-21kworker/2:2+events22:19:272
3851799233012,2314cyclictest86969-21kworker/1:2+events21:39:271
3851799233012,2314cyclictest60978-21kworker/1:0+events20:22:331
3852199232911,2314cyclictest74165-21kworker/2:1+events20:57:502
3852199232911,2314cyclictest107685-21kworker/2:2+events22:46:552
3851799232912,2314cyclictest93506-21kworker/1:0+events21:58:321
3851799232910,2317cyclictest119428-21kworker/1:0+events23:20:041
3851299232911,2315cyclictest85146-21kworker/0:1+events21:31:450
3851299232910,2316cyclictest28583-21kworker/0:0+events19:20:480
3852199232812,2312cyclictest64585-21kworker/2:0+events20:41:302
3852199232812,2312cyclictest142919-21kworker/2:1+events00:37:412
3851799232811,2313cyclictest86969-21kworker/1:2+events22:12:161
3851799232811,2313cyclictest86969-21kworker/1:2+events22:12:151
3851299232811,2314cyclictest55910-21kworker/0:0+events20:01:380
3851799232611,2312cyclictest70974-21kworker/1:1+events20:52:521
3851299232612,2310cyclictest129399-21kworker/0:1+events00:02:410
3851299232610,2313cyclictest46702-21kworker/0:0+events19:40:220
3851299232610,2313cyclictest114397-21kworker/0:2+events23:17:230
3852199232512,2310cyclictest80493-21kworker/2:1+events21:23:042
3851299232512,2310cyclictest96826-21kworker/0:0+events22:22:250
3851299232512,2310cyclictest66191-21kworker/0:2+events20:38:520
3852199232411,2309cyclictest44857-21kworker/2:1+events19:34:162
3851299232411,2310cyclictest117621-21kworker/0:0+events23:20:510
3851799232212,2306cyclictest53079-21kworker/1:2+events19:56:121
3851799232111,2307cyclictest59367-21kworker/1:1+events20:13:431
3851299232112,2306cyclictest52686-21kworker/0:2+events20:08:290
3851799232012,2304cyclictest67731-21kworker/1:0+events20:40:431
3851299232012,2304cyclictest70915-21kworker/0:0+events20:56:390
3851299231911,2305cyclictest121110-21kworker/0:2+events23:27:400
385219923185,2310cyclictest41812-21kworker/2:2+events20:06:352
3851799231712,2302cyclictest39736-21kworker/1:1+events19:33:301
3851799231710,2304cyclictest136474-21kworker/1:2+events00:32:001
3852199231312,2297cyclictest69381-21kworker/2:2+events20:53:592
3852199231312,2297cyclictest61100-21kworker/2:1+events20:26:192
3852199231012,2295cyclictest119331-21kworker/2:1+events23:20:282
3852399230112,2286cyclictest64553-21kworker/3:1+events20:58:353
3851799229310,2280cyclictest134506-21kworker/1:1+events00:12:361
3851799229310,2280cyclictest134506-21kworker/1:1+events00:12:361
3852399228712,2272cyclictest64553-21kworker/3:1+events21:13:543
3851799228412,2269cyclictest115823-21kworker/1:2+events23:08:411
3851799227811,2264cyclictest64696-21kworker/1:2+events20:33:101
3851799227612,2260cyclictest131093-21kworker/1:0+events23:54:191
385239922739,2261cyclictest59490-21kworker/3:0+events20:28:563
3852199227310,2259cyclictest109296-21kworker/2:1+events22:57:572
3851799226610,2253cyclictest64696-21kworker/1:2+events20:45:361
3851799225512,2239cyclictest102928-21kworker/1:2+events22:40:301
3851799225210,2238cyclictest115823-21kworker/1:2+events23:28:511
3851799224811,2234cyclictest129369-21kworker/1:2+events23:47:511
3852399224012,2225cyclictest139714-21kworker/3:0+events00:23:593
385179922396,2230cyclictest139951-21kworker/1:1+events00:36:321
3851299223612,2221cyclictest74221-21kworker/0:2+events21:29:310
385219922310,2228cyclictest75799-21kworker/2:2+events21:05:282
3852399222910,2215cyclictest59490-21kworker/3:0+events20:21:233
3851799222810,2215cyclictest74413-21kworker/1:0+events21:00:541
3852399220910,2195cyclictest51708-21kworker/3:2+events19:58:093
3852199220810,2194cyclictest112628-21kworker/2:2+events23:07:332
3852399220511,2191cyclictest49840-21kworker/3:1+events20:14:523
385129922059,2192cyclictest134934-21kworker/0:2+events00:11:050
385129922059,2192cyclictest134934-21kworker/0:2+events00:11:050
3852399220011,2186cyclictest77524-21kworker/3:2+events21:19:173
3852399220011,2186cyclictest41753-21kworker/3:2+events19:21:353
3851299219310,2179cyclictest59425-21kworker/0:0+events20:19:070
3852199217712,2161cyclictest141254-21kworker/2:0+events00:29:212
3851799217512,2160cyclictest41870-21kworker/1:0+events19:26:311
3852199217410,2161cyclictest41812-21kworker/2:2+events20:01:142
3852199215911,2145cyclictest109296-21kworker/2:1+events22:53:262
385219921578,2145cyclictest119331-21kworker/2:1+events23:28:042
3851299215211,2138cyclictest70915-21kworker/0:0+events20:53:130
3852199213310,2120cyclictest62990-21kworker/2:2+events20:33:542
3851799213110,2117cyclictest91410-21kworker/1:1+events21:54:421
3851299213111,2117cyclictest95189-21kworker/0:2+events22:08:500
3851299213110,2118cyclictest124855-21kworker/0:1+events23:37:160
3851299212511,2110cyclictest75826-21kworker/0:0+events21:06:370
3851299212210,2109cyclictest117621-21kworker/0:0+events23:34:110
3851799212011,2106cyclictest122804-21kworker/1:0+events23:40:421
3851299211511,2100cyclictest110889-21kworker/0:2+events22:56:530
385219921077,2097cyclictest59399-21kworker/2:0+events20:12:582
3852199210711,2093cyclictest88944-21kworker/2:0+events21:51:392
3852199210711,2093cyclictest121225-21kworker/2:0+events23:30:462
3852199210711,2092cyclictest129552-21kworker/2:1+events23:50:572
3852199210710,2094cyclictest132896-21kworker/2:2+events00:03:052
3851799210710,2093cyclictest134506-21kworker/1:1+events00:15:131
3852199210611,2092cyclictest78451-21kworker/2:0+events21:16:582
3852199210511,2091cyclictest93474-21kworker/2:1+events22:11:082
3852199210511,2091cyclictest93474-21kworker/2:1+events22:11:072
3851799210511,2091cyclictest49807-21kworker/1:2+events19:47:581
3852199210411,2091cyclictest38013-21kworker/2:1+events19:15:102
3852199210411,2090cyclictest78451-21kworker/2:0+events21:10:512
385219921039,2091cyclictest41812-21kworker/2:2+events19:52:072
3852199210311,2089cyclictest112628-21kworker/2:2+events23:10:572
3852199210311,2088cyclictest103076-21kworker/2:2+events22:31:502
385219921028,2091cyclictest41812-21kworker/2:2+events19:37:432
3851799209811,2083cyclictest125834-21kworker/1:1+events23:38:251
3852199209711,2083cyclictest41812-21kworker/2:2+events19:43:502
3851799209511,2081cyclictest36402-21kworker/1:2+events19:17:051
3852199206510,2051cyclictest138011-21kworker/2:2+events00:17:552
385179920599,2047cyclictest72657-21kworker/1:2+events21:14:181
385239920427,2032cyclictest39706-21kworker/3:0+events19:13:393
385129920107,2000cyclictest95189-21kworker/0:2+events22:13:020
385129920107,2000cyclictest95189-21kworker/0:2+events22:13:020
3851299196210,1949cyclictest139812-21kworker/0:2+events00:31:370
3852199194910,1936cyclictest38013-21kworker/2:1+events19:12:542
3851299194910,1937cyclictest106063-21kworker/0:0+events22:40:070
385179919455,1937cyclictest38063-21kworker/1:0+events19:11:231
3852199193010,1917cyclictest86999-21kworker/2:2+events21:57:232
380642195165,26sleep20-21swapper/219:07:102
380882173144,24sleep30-21swapper/319:07:263
379762141107,28sleep10-21swapper/119:06:051
381412139101,22sleep00-21swapper/019:08:080
38521992014,2cyclictest191rcu_preempt20:45:182
3852199154,9cyclictest421ktimers/222:05:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional