You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 16:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Sat Aug 22, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
368990699319116,3171cyclictest3776342-21kworker/0:2+events00:00:140
368991899309115,3071cyclictest3698438-21kworker/3:2+events19:50:133
368990699284413,2825cyclictest3763905-21kworker/0:3+events23:20:140
368991199281714,2799cyclictest3762208-21kworker/1:2+events22:55:131
368991199280013,2783cyclictest3776310-21kworker/1:0+events23:48:471
368990699275513,2740cyclictest3790121-21kworker/0:1+events00:25:190
368991899275412,2738cyclictest3787807-21kworker/3:1+events00:21:303
368991199274011,2725cyclictest3787691-21kworker/1:1+events00:23:031
368991599273613,2720cyclictest3711217-21kworker/2:2+events21:00:002
368991899272613,2710cyclictest3771421-21kworker/3:1+events23:25:123
368991899271613,2699cyclictest3779420-21kworker/3:0+events23:55:173
36899189927039,2690cyclictest3704692-21kworker/3:1+events19:57:293
368990699267513,2658cyclictest3736544-21kworker/0:0+events21:35:140
368990699265813,2641cyclictest3734909-21kworker/0:1+events21:40:140
368991199262213,2605cyclictest3758846-21kworker/1:2+events22:43:301
368990699261913,2602cyclictest3752772-21kworker/0:2+events22:30:130
368991199259812,2582cyclictest3771406-21kworker/1:0+events23:21:001
368990699259412,2580cyclictest3787660-21kworker/0:0+events00:20:220
368990699259114,2573cyclictest3763905-21kworker/0:3+events23:14:520
368990699257312,2557cyclictest3774711-21kworker/0:0+events23:34:490
368990699257212,2556cyclictest3701644-21kworker/0:1+events19:47:580
368990699256912,2553cyclictest3743166-21kworker/0:2+events22:15:520
368991199256412,2548cyclictest3730152-21kworker/1:0+events21:14:421
368991199256412,2548cyclictest3691419-21kworker/1:3+events19:15:201
368990699256412,2548cyclictest3762062-21kworker/0:2+events22:53:410
368991199256012,2545cyclictest3776310-21kworker/1:0+events23:40:521
368991199255712,2541cyclictest3760580-21kworker/1:1+events22:53:181
368991199255412,2538cyclictest3787691-21kworker/1:1+events00:12:061
368990699255412,2538cyclictest3727370-21kworker/0:1+events21:08:350
368990699255212,2536cyclictest3734909-21kworker/0:1+events21:47:220
36899119925509,2537cyclictest3714201-21kworker/1:2+events20:23:101
368991199254812,2532cyclictest3717460-21kworker/1:1+events20:34:571
368990699254712,2531cyclictest3788026-21kworker/0:3+events00:17:420
368990699254611,2531cyclictest3763660-21kworker/0:0+events22:58:370
368990699254412,2528cyclictest3777998-21kworker/0:1+events23:48:270
368991199254314,2525cyclictest3728553-21kworker/1:2+events21:21:141
368991199254111,2526cyclictest3762208-21kworker/1:2+events23:05:511
36899069925385,2530cyclictest3786056-21kworker/0:1+events00:06:450
368991199253412,2518cyclictest3737909-21kworker/1:1+events21:48:321
368991199252912,2514cyclictest3776310-21kworker/1:0+events23:58:191
368991199252210,2508cyclictest3712540-21kworker/1:1+events20:16:381
368990699251810,2505cyclictest3698083-21kworker/0:0+events19:35:510
36899189925148,2502cyclictest3700696-21kworker/3:1+events19:45:203
36899069925138,2503cyclictest3707831-21kworker/0:2+events20:10:080
368991199250511,2491cyclictest3783267-21kworker/1:3+events00:03:171
368990699250311,2484cyclictest3717719-21kworker/0:2+events20:43:170
36899119925029,2489cyclictest3744471-21kworker/1:1+events22:27:311
368991199250012,2484cyclictest3746086-21kworker/1:2+events22:06:131
368990699249912,2483cyclictest3734909-21kworker/0:1+events21:31:500
368990699249812,2482cyclictest3722142-21kworker/0:0+events20:52:030
36899119924969,2481cyclictest3714201-21kworker/1:2+events20:48:581
368991199249512,2480cyclictest3731758-21kworker/1:1+events21:27:151
368990699249512,2480cyclictest3795830-21kworker/0:0+events00:37:010
368991199249411,2479cyclictest3733412-21kworker/1:0+events21:54:111
368990699249412,2480cyclictest3703301-21kworker/0:0+events19:55:100
368990699249312,2477cyclictest3763905-21kworker/0:3+events23:02:230
368991199249211,2478cyclictest3707953-21kworker/1:0+events20:04:011
368990699249212,2476cyclictest3703301-21kworker/0:0+events19:52:520
368991199249012,2474cyclictest3722420-21kworker/1:1+events21:08:131
368990699249012,2474cyclictest3763905-21kworker/0:3+events23:16:240
368990699249010,2476cyclictest3758753-21kworker/0:0+events22:46:540
368990699248812,2472cyclictest3699713-21kworker/0:2+events19:44:560
368991199248712,2472cyclictest3787691-21kworker/1:1+events00:35:541
368991199248712,2471cyclictest3776310-21kworker/1:0+events23:38:341
368991199248711,2474cyclictest3762208-21kworker/1:2+events23:00:061
368990699248712,2473cyclictest3717719-21kworker/0:2+events20:45:350
368990699248712,2472cyclictest3769868-21kworker/0:1+events23:37:020
368990699248512,2471cyclictest3696418-21kworker/0:1+events19:31:410
368991899248411,2469cyclictest3725199-21kworker/3:0+events21:01:093
368991199248411,2469cyclictest3773074-21kworker/1:2+events23:27:321
368990699248411,2469cyclictest3766297-21kworker/0:1+events23:08:050
368991199248312,2467cyclictest3694877-21kworker/1:0+events19:25:131
368991199248212,2466cyclictest3747745-21kworker/1:0+events22:12:231
368990699248211,2467cyclictest3691331-21kworker/0:1+events19:16:280
368991199248112,2465cyclictest3776310-21kworker/1:0+events23:52:371
368991899248012,2464cyclictest3750941-21kworker/3:0+events23:09:353
368990699248012,2465cyclictest3743166-21kworker/0:2+events22:13:340
36899189924798,2467cyclictest3760938-21kworker/3:2+events22:51:053
36899119924799,2466cyclictest3684509-21kworker/1:1+events19:42:431
36899189924785,2469cyclictest3765479-21kworker/3:3+events23:36:423
368991199247811,2463cyclictest3774684-21kworker/1:1+events23:32:531
368991899247712,2461cyclictest3733266-21kworker/3:0+events21:25:243
368991199247711,2463cyclictest3698168-21kworker/1:0+events19:34:411
368991899247611,2461cyclictest3733266-21kworker/3:0+events21:23:293
368991899247512,2460cyclictest3715956-21kworker/3:2+events20:53:103
368991899247412,2459cyclictest3698438-21kworker/3:2+events19:38:543
368991899247412,2458cyclictest3749353-21kworker/3:1+events22:17:003
368990699247411,2459cyclictest3743166-21kworker/0:2+events22:02:250
368991899247312,2458cyclictest3765479-21kworker/3:3+events23:21:243
368991899247312,2457cyclictest3750941-21kworker/3:0+events22:58:583
368991199247210,2458cyclictest3722420-21kworker/1:1+events21:04:311
368990699247012,2455cyclictest3717719-21kworker/0:2+events20:39:550
36899189924678,2455cyclictest3728414-21kworker/3:2+events21:17:223
368991199246712,2452cyclictest3733412-21kworker/1:0+events21:56:061
368991199246711,2453cyclictest3747745-21kworker/1:0+events22:16:141
368991199246711,2453cyclictest3733412-21kworker/1:0+events21:38:201
368991199246710,2454cyclictest3762208-21kworker/1:2+events23:13:001
368990699246712,2451cyclictest3779599-21kworker/0:0+events23:50:200
368990699246711,2453cyclictest3714348-21kworker/0:2+events20:28:250
368991199246610,2453cyclictest3746086-21kworker/1:2+events22:02:031
368991199246610,2453cyclictest3686173-21kworker/1:2+events19:13:041
368991199246610,2452cyclictest3719067-21kworker/1:0+events20:51:161
368991199246510,2451cyclictest3701448-21kworker/1:2+events19:57:061
368991199246412,2448cyclictest3783267-21kworker/1:3+events00:06:211
368991199245912,2443cyclictest3725307-21kworker/1:2+events20:58:071
368991199245711,2443cyclictest3787691-21kworker/1:1+events00:34:001
368990699245512,2440cyclictest3731144-21kworker/0:0+events21:20:510
368991199245312,2438cyclictest3709805-21kworker/1:2+events20:14:451
36899069924539,2440cyclictest3733115-21kworker/0:2+events21:28:240
368991899245212,2437cyclictest3750941-21kworker/3:0+events22:26:253
368990699245112,2435cyclictest3712724-21kworker/0:1+events20:23:340
368991899245010,2436cyclictest3719269-21kworker/3:0+events20:46:453
368991899244712,2431cyclictest3746116-21kworker/3:0+events22:04:213
36899189924429,2430cyclictest3769808-21kworker/3:0+events23:16:003
368990699243812,2422cyclictest3752772-21kworker/0:2+events22:26:460
368991899243410,2421cyclictest3755766-21kworker/3:1+events22:37:033
368991899243312,2418cyclictest3738088-21kworker/3:0+events21:46:353
368991199242812,2413cyclictest3758846-21kworker/1:2+events22:45:231
368991899242011,2405cyclictest3750941-21kworker/3:0+events23:03:303
368990699241911,2404cyclictest3725399-21kworker/0:2+events20:59:150
368991899241712,2402cyclictest3789702-21kworker/3:2+events00:19:593
368990699240711,2393cyclictest3773107-21kworker/0:2+events23:28:180
368990699240612,2390cyclictest3703301-21kworker/0:0+events20:06:150
36899119924029,2389cyclictest3728553-21kworker/1:2+events21:18:541
368990699240211,2387cyclictest3776342-21kworker/0:2+events23:43:540
368991899240112,2386cyclictest3700696-21kworker/3:1+events19:43:503
368991899239612,2381cyclictest3725199-21kworker/3:0+events20:57:433
368991899239612,2380cyclictest3750941-21kworker/3:0+events22:41:363
368991899239512,2379cyclictest3749353-21kworker/3:1+events22:23:003
36899069923949,2381cyclictest3752772-21kworker/0:2+events22:41:140
368991899239312,2379cyclictest3704692-21kworker/3:1+events20:00:103
368991899239312,2378cyclictest3711145-21kworker/3:0+events20:33:253
368991899239212,2376cyclictest3786219-21kworker/3:0+events00:09:503
368991899239211,2377cyclictest3709512-21kworker/3:2+events20:13:143
368990699239211,2378cyclictest3711084-21kworker/0:0+events20:18:100
36899189923919,2378cyclictest3734870-21kworker/3:1+events21:37:333
368991899239112,2376cyclictest3787807-21kworker/3:1+events00:33:143
368991899239111,2376cyclictest3787807-21kworker/3:1+events00:25:433
368991899239012,2374cyclictest3709512-21kworker/3:2+events20:19:223
368991899238911,2374cyclictest3765479-21kworker/3:3+events23:33:393
368991899238812,2372cyclictest3744505-21kworker/3:1+events21:56:523
368991899238811,2374cyclictest3715956-21kworker/3:2+events20:37:163
368991899238712,2372cyclictest3723395-21kworker/3:1+events21:07:533
368991899238712,2372cyclictest3704692-21kworker/3:1+events20:07:253
368991899238512,2369cyclictest3777838-21kworker/3:1+events23:42:463
368991899238510,2372cyclictest3711145-21kworker/3:0+events20:27:153
368991899238410,2370cyclictest3711145-21kworker/3:0+events20:23:553
368991899237912,2363cyclictest3728414-21kworker/3:2+events21:42:523
368991199236510,2352cyclictest3698168-21kworker/1:0+events19:37:451
368991899234811,2334cyclictest3765479-21kworker/3:3+events23:10:203
368991899234711,2334cyclictest3742150-21kworker/3:2+events22:10:263
368991599234610,2333cyclictest3767090-21kworker/2:1+events23:41:162
368990699234412,2329cyclictest3734909-21kworker/0:1+events21:52:170
368991599234012,2324cyclictest3711217-21kworker/2:2+events20:39:332
368991599233712,2321cyclictest3752618-21kworker/2:0+events23:11:512
36899189923298,2317cyclictest3719269-21kworker/3:0+events20:41:493
368991599232212,2308cyclictest3783266-21kworker/2:3+events00:05:352
368990699232210,2307cyclictest3743166-21kworker/0:2+events21:57:580
368990699231910,2306cyclictest3707831-21kworker/0:2+events20:04:460
368991599231611,2302cyclictest3725517-21kworker/2:0+events21:06:222
368991599231412,2300cyclictest3728406-21kworker/2:1+events21:27:382
368991599231412,2299cyclictest3746294-21kworker/2:1+events22:16:372
368991599231111,2297cyclictest3739850-21kworker/2:2+events22:03:582
368991899230011,2286cyclictest3730032-21kworker/3:0+events21:13:113
368991199230012,2285cyclictest3791394-21kworker/1:0+events00:26:061
368991199229610,2282cyclictest3754351-21kworker/1:2+events22:32:301
368991199228911,2274cyclictest3719067-21kworker/1:0+events20:39:091
368991199228811,2273cyclictest3714201-21kworker/1:2+events20:27:401
368991199227411,2259cyclictest3684509-21kworker/1:1+events19:49:511
368991199227111,2256cyclictest3733412-21kworker/1:0+events21:43:391
368991199227111,2256cyclictest3733412-21kworker/1:0+events21:33:411
36899159922699,2256cyclictest3695114-21kworker/2:0+events20:14:232
368991899226811,2253cyclictest3777838-21kworker/3:1+events23:49:343
368991199226711,2252cyclictest3694877-21kworker/1:0+events19:21:471
368991199226610,2253cyclictest3744471-21kworker/1:1+events22:36:171
368991599226512,2249cyclictest3719155-21kworker/2:0+events20:40:432
368990699226510,2252cyclictest3727370-21kworker/0:1+events21:10:520
368990699226410,2251cyclictest3781489-21kworker/0:1+events23:56:240
368991199226311,2249cyclictest3762208-21kworker/1:2+events23:18:181
368990699226311,2249cyclictest3727370-21kworker/0:1+events21:18:330
368990699226210,2249cyclictest3790121-21kworker/0:1+events00:30:340
368990699226111,2244cyclictest3722142-21kworker/0:0+events21:01:520
368990699226110,2248cyclictest3786056-21kworker/0:1+events00:10:110
368991899226010,2247cyclictest3742150-21kworker/3:2+events22:06:373
368990699225810,2245cyclictest3693670-21kworker/0:0+events19:24:260
368991899225711,2242cyclictest3693542-21kworker/3:0+events19:32:013
36899119922519,2238cyclictest3787691-21kworker/1:1+events00:19:361
36899189922429,2229cyclictest3738088-21kworker/3:0+events21:50:243
36899159922299,2217cyclictest3787899-21kworker/2:1+events00:15:482
36899069922246,2214cyclictest3752772-21kworker/0:2+events22:38:120
368990699220611,2192cyclictest3712724-21kworker/0:1+events20:34:100
36899069922048,2193cyclictest3743166-21kworker/0:2+events22:09:180
368991199219210,2179cyclictest3706295-21kworker/1:1+events20:05:311
368991899219011,2176cyclictest3689591-21kworker/3:2+events19:16:513
368991899219011,2175cyclictest3728414-21kworker/3:2+events21:33:193
36899189921889,2175cyclictest3786219-21kworker/3:0+events00:13:113
368991899218811,2173cyclictest3750941-21kworker/3:0+events22:46:313
36899189921878,2175cyclictest3754170-21kworker/3:2+events22:32:523
368991899218711,2173cyclictest3695150-21kworker/3:2+events19:29:253
368990699218610,2173cyclictest3749415-21kworker/0:1+events22:23:200
368991899218011,2166cyclictest3781289-21kworker/3:2+events23:53:213
368991899217211,2158cyclictest3691275-21kworker/3:1+events19:20:153
368991599216110,2148cyclictest3728406-21kworker/2:1+events21:31:052
36899119921578,2146cyclictest3744471-21kworker/1:1+events22:24:301
368991899215611,2142cyclictest3794528-21kworker/3:0+events00:35:303
368991599214012,2125cyclictest3783266-21kworker/2:3+events00:14:192
368991199213910,2126cyclictest3701448-21kworker/1:2+events19:53:381
368991599212911,2116cyclictest3695114-21kworker/2:0+events19:30:102
36899069921279,2115cyclictest3678096-21kworker/0:0+events19:12:420
368991599212311,2108cyclictest3750838-21kworker/2:2+events22:23:452
368991599211711,2103cyclictest3747955-21kworker/2:0+events22:11:592
368991199211712,2102cyclictest3714201-21kworker/1:2+events20:41:031
368991599211311,2100cyclictest3734832-21kworker/2:0+events21:58:442
368991599209210,2079cyclictest3703180-21kworker/2:2+events19:50:362
36899159920904,2083cyclictest3779510-21kworker/2:0+events23:59:522
368990699207410,2061cyclictest3689558-21kworker/0:2+events19:25:350
368991899203110,2018cyclictest3689591-21kworker/3:2+events19:14:113
368991599198310,1970cyclictest3691572-21kworker/2:2+events19:24:052
36899159919799,1967cyclictest3777789-21kworker/2:2+events23:48:052
36899159919738,1961cyclictest3783266-21kworker/2:3+events00:23:262
368991599197010,1956cyclictest3752618-21kworker/2:0+events22:35:292
36899159919466,1937cyclictest3688367-21kworker/2:1+events19:15:422
36899159919445,1936cyclictest3695114-21kworker/2:0+events19:47:372
36893702192162,25sleep10-21swapper/119:05:511
36894812154104,29sleep30-21swapper/319:07:183
36893422152107,26sleep00-21swapper/019:05:300
36883632151107,25sleep20-21swapper/219:05:032
368991599103100,2cyclictest3746294-21kworker/2:1+pm22:09:532
3689915996628,24cyclictest0-21swapper/222:59:592
3689915993511,15cyclictest3706563-10awk20:00:002
368991599291,23cyclictest3781530-21munin-run23:55:002
368991599280,25cyclictest0-21swapper/220:15:172
368991599271,20cyclictest3794591-21sleep00:34:592
368991599265,11cyclictest3766215-21ld23:05:172
368991599241,20cyclictest3699963-21dpkg19:40:002
368991599240,24cyclictest3690449-21memory19:10:152
368991599240,22cyclictest3775817-21/usr/sbin/munin23:35:192
3689915992312,10cyclictest3726050-21hddtemp_smartct21:00:132
368991599231,19cyclictest3716082-21perf-exec20:29:592
3689915992111,8cyclictest3765102-21taskset23:00:432
368991599211,14cyclictest3796174-21readlink00:40:002
368991599210,13cyclictest3696003-21ntpq19:25:142
368991599201,16cyclictest3770192-21cat23:19:592
368991599201,16cyclictest3701825-21munin-run19:45:012
368991599200,7cyclictest740-21snmpd23:26:292
368991599200,19cyclictest3754163-21runrttasks22:28:082
368991599200,18cyclictest3760632-21taskset22:49:172
368991599200,15cyclictest3714502-21awk20:24:592
368991599200,14cyclictest3730558-21apt-get21:15:122
3689915991911,6cyclictest3733080-21users21:20:212
368991599191,16cyclictest3717015-21ps20:30:202
368991599191,15cyclictest3755921-21basename22:34:592
368991599191,12cyclictest3739840-21sh21:45:002
368991599190,19cyclictest0-21swapper/222:40:122
368991599190,18cyclictest3774891-21taskset23:34:382
368991599190,16cyclictest3784839-21basename00:05:012
3689915991811,5cyclictest3741517-21seq21:48:262
368991599181,14cyclictest3743243-21idleruntime-cro21:55:012
368991599181,14cyclictest3723972-21munin-run20:54:592
368991599181,14cyclictest1-21systemd21:40:002
368991599180,15cyclictest3771004-21ntpq23:20:172
368991599180,15cyclictest3707344-21/usr/sbin/munin20:00:162
3689915991713,2cyclictest421ktimers/221:10:142
3689915991711,4cyclictest3792224-21/usr/sbin/munin00:25:172
3689915991710,5cyclictest3709541-21chrt20:07:532
368991599160,14cyclictest3761686-21smartctlcvt22:50:202
368991599160,14cyclictest3721626-21ntpq20:45:162
3689918991411,2cyclictest1585-21gdbus00:00:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional