You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 07:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Wed Apr 29, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
370900099323716,3216cyclictest3770374-21kworker/2:1+events22:15:192
370899699293014,2912cyclictest3797529-21kworker/1:2+events23:46:461
370900099290312,2887cyclictest3778151-21kworker/2:0+events23:20:172
370900099289414,2878cyclictest3727313-21kworker/2:1+events20:05:212
370899699288213,2866cyclictest3795641-21kworker/1:1+events23:35:021
370900499287214,2855cyclictest3742763-21kworker/3:2+events21:10:133
370900099283014,2810cyclictest3811720-21kworker/2:1+events00:30:202
370899499277013,2753cyclictest3797233-21kworker/0:1+events23:41:490
370900099274711,2732cyclictest3778151-21kworker/2:0+events23:15:212
37090009927438,2732cyclictest3795082-21kworker/2:1+events23:40:182
370900499272613,2709cyclictest3760726-21kworker/3:3+events22:05:013
370900499271513,2698cyclictest3795462-21kworker/3:0+events23:45:143
370899699267913,2663cyclictest3779732-21kworker/1:0+events22:48:211
370899499258511,2571cyclictest3743005-21kworker/0:1+events20:51:280
370900099255912,2544cyclictest3800702-21kworker/2:1+events23:49:252
370899699253512,2519cyclictest3752550-21kworker/1:0+events21:24:131
370900499252312,2507cyclictest3810276-21kworker/3:2+events00:23:313
370899699251013,2493cyclictest3779732-21kworker/1:0+events22:52:081
370900099250912,2493cyclictest3741252-21kworker/2:2+events20:48:262
37089949925069,2493cyclictest3726533-21kworker/0:2+events20:45:010
37089949925069,2493cyclictest3726533-21kworker/0:2+events20:45:000
370900499250211,2487cyclictest3728356-21kworker/3:2+events20:06:523
370899499250011,2486cyclictest3755591-21kworker/0:1+events21:34:540
370899499250010,2486cyclictest3750656-21kworker/0:1+events21:13:150
370899699249911,2485cyclictest3736299-21kworker/1:2+events20:54:571
370899499249912,2484cyclictest3782993-21kworker/0:2+events22:59:410
370899499249412,2478cyclictest3759352-21kworker/0:0+events21:40:370
370899499249412,2478cyclictest3718664-21kworker/0:0+events19:54:470
370899499249212,2478cyclictest3726533-21kworker/0:2+events20:23:580
37089949924899,2477cyclictest3786297-21kworker/0:1+events23:23:190
37089949924886,2478cyclictest3726533-21kworker/0:2+events21:07:110
370899699248312,2468cyclictest3767080-21kworker/1:1+events22:06:351
370899499248312,2469cyclictest3716971-21kworker/0:1+events19:35:020
37089949924829,2469cyclictest3811840-21kworker/0:0+events00:30:410
370899699248012,2465cyclictest3790725-21kworker/1:2+events23:19:541
370900499247713,2460cyclictest3744458-21kworker/3:1+events20:55:223
370899699247610,2462cyclictest3800486-21kworker/1:1+events23:51:201
37089969924746,2464cyclictest3779732-21kworker/1:0+events23:01:571
370900099247312,2457cyclictest3754079-21kworker/2:1+events21:28:472
37089969924717,2460cyclictest3736299-21kworker/1:2+events20:27:021
370899699247110,2457cyclictest3722247-21kworker/1:0+events19:51:461
370900099247012,2452cyclictest3754079-21kworker/2:1+events21:43:412
370899699247012,2455cyclictest3814805-21kworker/1:0+events00:37:321
370899699246812,2452cyclictest3773515-21kworker/1:1+events22:30:151
370899699246212,2446cyclictest3747482-21kworker/1:0+events21:07:341
370899499246012,2444cyclictest3752289-21kworker/0:0+events21:24:370
370899699245912,2444cyclictest3803880-21kworker/1:1+events00:11:171
370900099245812,2443cyclictest3810048-21kworker/2:0+events00:19:162
370900099245812,2443cyclictest3739624-21kworker/2:1+events20:51:062
370899699245811,2443cyclictest3739655-21kworker/1:0+events20:41:341
370899699245811,2443cyclictest3739655-21kworker/1:0+events20:41:331
370899699245712,2441cyclictest3763745-21kworker/1:2+events21:54:491
370899699245712,2441cyclictest3724856-21kworker/1:1+events19:55:541
370899499245712,2442cyclictest3726533-21kworker/0:2+events20:05:430
370900099245611,2442cyclictest3723525-21kworker/2:0+events20:00:002
370899499245612,2440cyclictest3731642-21kworker/0:1+events20:15:150
370899499245512,2439cyclictest3745799-21kworker/0:0+events20:57:170
370900099245112,2435cyclictest3715360-21kworker/2:2+events19:37:452
370899499245112,2435cyclictest3721922-21kworker/0:2+events19:45:420
370899699245012,2435cyclictest3747482-21kworker/1:0+events21:02:581
370900099244811,2433cyclictest3729957-21kworker/2:0+events20:26:392
370899699244812,2433cyclictest3733343-21kworker/1:0+events20:22:511
370900099244712,2433cyclictest3778151-21kworker/2:0+events22:45:442
370900099244612,2430cyclictest3754079-21kworker/2:1+events21:30:192
37089949924459,2432cyclictest3765404-21kworker/0:2+events22:22:110
37090009924438,2432cyclictest3813529-21kworker/2:2+events00:36:012
370899499244212,2427cyclictest3807026-21kworker/0:2+events00:28:260
370900099244012,2424cyclictest3729957-21kworker/2:0+events20:17:332
370899499243712,2421cyclictest3790816-21kworker/0:0+events23:18:210
370899499243711,2422cyclictest3765404-21kworker/0:2+events22:14:100
370900099243510,2421cyclictest3750567-21kworker/2:0+events21:22:212
370899499243512,2419cyclictest3759352-21kworker/0:0+events21:47:120
37090049924349,2421cyclictest3715393-21kworker/3:2+events19:36:363
370899699243412,2418cyclictest3773515-21kworker/1:1+events22:44:341
37089949924329,2419cyclictest3752289-21kworker/0:0+events21:29:100
370899499242912,2413cyclictest3765404-21kworker/0:2+events22:19:300
370900499242812,2412cyclictest3757165-21kworker/3:0+events21:38:413
370899699242311,2409cyclictest3749082-21kworker/1:1+events21:38:171
370900499242212,2406cyclictest3744458-21kworker/3:1+events21:01:283
37090009924218,2409cyclictest3715360-21kworker/2:2+events20:02:192
370900499241610,2402cyclictest3802250-21kworker/3:1+events00:01:423
370900099241612,2402cyclictest3800702-21kworker/2:1+events00:00:342
370899499241612,2400cyclictest3798915-21kworker/0:0+events23:48:150
370900499241410,2401cyclictest3792230-21kworker/3:1+events23:26:473
370899499241412,2398cyclictest3797233-21kworker/0:1+events23:37:420
370899699241212,2397cyclictest3794044-21kworker/1:2+events23:32:211
370900499241012,2394cyclictest3813171-21kworker/3:1+events00:33:223
37089949924099,2396cyclictest3708321-21kworker/0:2+events19:25:510
370899499240912,2394cyclictest3736629-21kworker/0:0+events20:31:140
370899499240812,2393cyclictest3752289-21kworker/0:0+events21:18:580
370900099240612,2390cyclictest3715360-21kworker/2:2+events19:44:102
370899499240612,2391cyclictest3729895-21kworker/0:0+events20:10:400
370899499240611,2391cyclictest3794103-21kworker/0:0+events23:32:460
370899499240512,2391cyclictest3781395-21kworker/0:1+events22:50:420
370899499240512,2389cyclictest3759352-21kworker/0:0+events21:52:070
370899499240511,2391cyclictest3765404-21kworker/0:2+events22:06:570
370899499240412,2388cyclictest3784619-21kworker/0:0+events23:00:250
370899699240311,2389cyclictest3715377-21kworker/1:2+events19:45:201
370899499240312,2388cyclictest3726533-21kworker/0:2+events20:37:420
370900099240212,2387cyclictest3729957-21kworker/2:0+events20:20:342
370899499240211,2388cyclictest3798915-21kworker/0:0+events23:51:440
370899499240112,2385cyclictest3807026-21kworker/0:2+events00:18:080
370899499240010,2387cyclictest3807026-21kworker/0:2+events00:21:360
370899699239913,2382cyclictest3797529-21kworker/1:2+events23:42:101
370899699239812,2383cyclictest3718695-21kworker/1:1+events19:40:201
370899499239812,2383cyclictest3800643-21kworker/0:2+events23:56:440
370899499239812,2383cyclictest3765404-21kworker/0:2+events22:00:500
370899499239811,2383cyclictest3745799-21kworker/0:0+events21:04:070
370900499239712,2382cyclictest3795462-21kworker/3:0+events23:36:563
370899699239712,2381cyclictest3736299-21kworker/1:2+events20:59:331
370899499239612,2380cyclictest3776487-21kworker/0:2+events22:42:140
370899699239512,2380cyclictest3730073-21kworker/1:1+events20:16:001
370900099239412,2378cyclictest3703930-21kworker/2:1+events19:33:102
37089969923949,2382cyclictest3770258-21kworker/1:0+events22:16:511
370899699239312,2378cyclictest3749082-21kworker/1:1+events21:41:001
370900099239211,2377cyclictest3748930-21kworker/2:1+events21:06:472
370899699239212,2376cyclictest3779732-21kworker/1:0+events23:07:161
370899699239211,2378cyclictest3797529-21kworker/1:2+events23:59:241
370899699239010,2376cyclictest3736299-21kworker/1:2+events20:49:341
370900099238911,2374cyclictest3763714-21kworker/2:0+events22:02:232
370899699238912,2374cyclictest3805613-21kworker/1:0+events00:07:051
370899699238911,2375cyclictest3813141-21kworker/1:2+events00:31:521
370899699238911,2375cyclictest3779732-21kworker/1:0+events23:28:391
370899499238912,2375cyclictest3776487-21kworker/0:2+events22:36:400
370900099238812,2372cyclictest3723525-21kworker/2:0+events19:53:372
370899699238812,2373cyclictest3730073-21kworker/1:1+events20:08:211
370899699238812,2372cyclictest3803880-21kworker/1:1+events00:00:111
370899499238811,2374cyclictest3718664-21kworker/0:0+events19:44:330
370899699238712,2373cyclictest3749082-21kworker/1:1+events21:46:491
370899699238712,2371cyclictest3749082-21kworker/1:1+events21:17:041
370900099238611,2372cyclictest3773339-21kworker/2:2+events22:40:472
370900099238611,2371cyclictest3786034-21kworker/2:1+events23:03:522
370899699238511,2371cyclictest3726503-21kworker/1:2+events20:04:571
370899699238412,2369cyclictest3773515-21kworker/1:1+events22:57:471
370899699238412,2368cyclictest3749082-21kworker/1:1+events21:13:391
370900099238312,2368cyclictest3773339-21kworker/2:2+events22:26:012
370900099238312,2367cyclictest3803914-21kworker/2:2+events00:09:002
37090009923829,2370cyclictest3792529-21kworker/2:2+events23:25:152
370900099238112,2366cyclictest3797296-21kworker/2:0+events23:54:042
37089969923815,2372cyclictest3755471-21kworker/1:2+events21:32:381
370899699238012,2366cyclictest3803880-21kworker/1:1+events00:15:021
370900499237912,2364cyclictest3797327-21kworker/3:2+events23:42:543
370899699237711,2363cyclictest3717033-21kworker/1:0+events19:33:551
370899699237112,2356cyclictest3730073-21kworker/1:1+events20:32:241
37090009923679,2354cyclictest3729957-21kworker/2:0+events20:38:052
370900499236411,2351cyclictest3741163-21kworker/3:0+events20:45:223
370900099236312,2348cyclictest3738025-21kworker/2:2+events20:33:332
37089949923636,2353cyclictest3807026-21kworker/0:2+events00:10:300
370900099236212,2347cyclictest3742884-21kworker/2:0+events21:00:182
370900099236212,2346cyclictest3762091-21kworker/2:2+events21:51:222
370900099236210,2348cyclictest3742884-21kworker/2:0+events20:55:442
370900499236112,2346cyclictest3710731-21kworker/3:0+events19:26:123
370900099236112,2346cyclictest3811720-21kworker/2:1+events00:23:532
370899699235911,2344cyclictest3773515-21kworker/1:1+events22:39:181
370900099235712,2341cyclictest3750567-21kworker/2:0+events21:14:022
370900099235512,2339cyclictest3765316-21kworker/2:2+events22:09:132
370900099235412,2339cyclictest3739624-21kworker/2:1+events20:41:562
370900099235412,2339cyclictest3739624-21kworker/2:1+events20:41:562
370900099235412,2338cyclictest3778151-21kworker/2:0+events23:14:102
370900099235412,2338cyclictest3763714-21kworker/2:0+events22:12:182
370900499235312,2337cyclictest3760726-21kworker/3:3+events22:20:413
370900099235312,2339cyclictest3778151-21kworker/2:0+events23:05:022
370900499235212,2337cyclictest3771646-21kworker/3:0+events22:19:533
370900499235212,2337cyclictest3726681-21kworker/3:0+events20:01:353
370900499235112,2336cyclictest3795462-21kworker/3:0+events23:53:423
370900499235012,2335cyclictest3763625-21kworker/3:0+events21:55:123
370900499235012,2335cyclictest3751936-21kworker/3:0+events21:19:453
370900499235012,2334cyclictest3807084-21kworker/3:0+events00:14:403
370900099234912,2333cyclictest3792529-21kworker/2:2+events23:30:292
370900499234810,2334cyclictest3775034-21kworker/3:1+events22:29:053
370900099234811,2334cyclictest3773339-21kworker/2:2+events22:22:572
370900099234810,2334cyclictest3810048-21kworker/2:0+events00:27:402
370900099234712,2332cyclictest3763714-21kworker/2:0+events21:55:342
370900499234212,2326cyclictest3781259-21kworker/3:2+events22:50:183
370900499234111,2326cyclictest3726681-21kworker/3:0+events20:14:293
370900499234011,2326cyclictest3775034-21kworker/3:1+events22:46:073
370900499234011,2326cyclictest3763625-21kworker/3:0+events21:52:523
370899499234011,2326cyclictest3723795-21kworker/0:1+events19:57:220
370900499233912,2323cyclictest3784651-21kworker/3:1+events23:00:053
370900499233612,2321cyclictest3760726-21kworker/3:3+events21:47:353
370899499233112,2315cyclictest3776487-21kworker/0:2+events22:33:410
370900499232812,2313cyclictest3792230-21kworker/3:1+events23:31:363
370900499232711,2312cyclictest3715393-21kworker/3:2+events19:31:153
370900499232512,2310cyclictest3741163-21kworker/3:0+events20:43:053
370900499232512,2310cyclictest3741163-21kworker/3:0+events20:43:043
370900499232311,2309cyclictest3804009-21kworker/3:2+events00:09:233
370899699232112,2305cyclictest3699040-21kworker/1:2+events19:19:451
370900499231612,2302cyclictest3760726-21kworker/3:3+events22:10:213
370900499231312,2298cyclictest3816375-21kworker/3:2+events00:37:543
370900499231011,2295cyclictest3787698-21kworker/3:2+events23:20:403
370900499231010,2297cyclictest3724966-21kworker/3:2+events19:55:303
37090049923029,2290cyclictest3733098-21kworker/3:1+events20:16:243
370899499229912,2283cyclictest3786297-21kworker/0:1+events23:27:110
370899499229711,2283cyclictest3715302-21kworker/0:0+events19:30:270
370900499229210,2279cyclictest3771646-21kworker/3:0+events22:33:163
370900499229210,2279cyclictest3723319-21kworker/3:0+events19:48:013
370900499227511,2261cyclictest3784651-21kworker/3:1+events23:09:593
370899699226811,2253cyclictest3715377-21kworker/1:2+events19:38:501
370900099226512,2250cyclictest3800702-21kworker/2:1+events23:58:162
370900099225311,2239cyclictest3770374-21kworker/2:1+events22:34:042
37089969922509,2238cyclictest3699040-21kworker/1:2+events19:13:141
370900099224710,2234cyclictest3750567-21kworker/2:0+events21:19:222
37089969922389,2225cyclictest3803880-21kworker/1:1+events00:29:101
370900499223110,2217cyclictest3742763-21kworker/3:2+events20:54:123
370900099223012,2215cyclictest3781456-21kworker/2:1+events22:51:022
370900499222910,2216cyclictest3733098-21kworker/3:1+events20:33:563
370900499222812,2213cyclictest3733098-21kworker/3:1+events20:35:283
370899499222812,2213cyclictest3811840-21kworker/0:0+events00:39:470
370900499222412,2209cyclictest3807084-21kworker/3:0+events00:19:403
370899499221610,2202cyclictest3805333-21kworker/0:0+events00:08:390
37089949922157,2205cyclictest3773575-21kworker/0:1+events22:27:350
370899499220911,2195cyclictest3802409-21kworker/0:1+events00:02:060
37090009922089,2195cyclictest3784322-21kworker/2:2+events22:58:572
370899499220711,2193cyclictest3734961-21kworker/0:1+events20:27:240
370899499220510,2191cyclictest3779701-21kworker/0:0+events22:48:450
370899499220411,2190cyclictest3708321-21kworker/0:2+events19:19:230
37089949922039,2190cyclictest3757209-21kworker/0:2+events21:36:010
370899499220212,2187cyclictest3708321-21kworker/0:2+events19:13:380
370899499219910,2186cyclictest3759352-21kworker/0:0+events21:56:410
37089969921989,2184cyclictest3763745-21kworker/1:2+events22:24:051
37089949921939,2181cyclictest3741373-21kworker/0:0+events20:48:490
370900099219011,2176cyclictest3703930-21kworker/2:1+events19:28:542
370899699219011,2176cyclictest3789091-21kworker/1:1+events23:14:571
370899699219010,2177cyclictest3730073-21kworker/1:1+events20:13:171
370899699218711,2173cyclictest3761998-21kworker/1:0+events21:58:371
37089969921848,2172cyclictest3810293-21kworker/1:0+events00:24:411
370899699218411,2170cyclictest3763745-21kworker/1:2+events22:02:451
370899699218411,2169cyclictest3763745-21kworker/1:2+events22:13:041
370899699218410,2172cyclictest3713735-21kworker/1:0+events19:25:061
37089969921839,2171cyclictest3739655-21kworker/1:0+events20:39:381
370900499218011,2165cyclictest3749330-21kworker/3:1+events21:28:253
370899699217811,2164cyclictest3763745-21kworker/1:2+events22:27:101
370900499217610,2162cyclictest3779674-21kworker/3:0+events22:55:293
370900499217412,2159cyclictest3807084-21kworker/3:0+events00:28:023
370900099216811,2154cyclictest3754079-21kworker/2:1+events21:36:252
37090049921667,2155cyclictest3733098-21kworker/3:1+events20:29:193
370900099216611,2152cyclictest3754079-21kworker/2:1+events21:45:382
370900099216111,2147cyclictest3703930-21kworker/2:1+events19:23:562
37090009921608,2149cyclictest3773339-21kworker/2:2+events22:37:502
370900099215910,2146cyclictest3715360-21kworker/2:2+events19:49:532
370900499215310,2139cyclictest3713763-21kworker/3:1+events19:43:493
370900099215311,2139cyclictest3703930-21kworker/2:1+events19:15:582
370900099215210,2138cyclictest3715360-21kworker/2:2+events20:11:032
370900499215010,2137cyclictest3778000-21kworker/3:2+events22:39:413
370900499214410,2130cyclictest3787698-21kworker/3:2+events23:10:443
370900499214112,2126cyclictest3795462-21kworker/3:0+events23:55:593
370900499214111,2126cyclictest3753909-21kworker/3:2+events21:34:083
370900499214011,2126cyclictest3767258-21kworker/3:0+events22:08:053
370900499214011,2126cyclictest3733098-21kworker/3:1+events20:20:573
370900499213911,2125cyclictest3775034-21kworker/3:1+events22:41:543
370900499213911,2125cyclictest3758798-21kworker/3:1+events21:42:093
370900499213811,2125cyclictest3706925-21kworker/3:2+events19:15:123
37089969921379,2125cyclictest3749082-21kworker/1:1+events21:27:411
37090049921318,2120cyclictest3749330-21kworker/3:1+events21:23:293
370900499212911,2115cyclictest3723319-21kworker/3:0+events19:50:383
370900499212911,2113cyclictest3713763-21kworker/3:1+events19:22:033
37089949921248,2113cyclictest3786297-21kworker/0:1+events23:11:540
370900099209110,2077cyclictest3803914-21kworker/2:2+events00:13:092
37090049920752,2070cyclictest3705311-21kworker/3:1+events19:14:013
37089969920757,2065cyclictest3713735-21kworker/1:0+events19:23:331
37089949920429,2030cyclictest3712405-21kworker/0:1+events19:20:320
370900099203910,2026cyclictest3795082-21kworker/2:1+events23:36:332
37090049920289,2016cyclictest3789358-21kworker/3:0+events23:17:133
37089969920244,2017cyclictest3779732-21kworker/1:0+events23:22:351
37090049919745,1966cyclictest3747688-21kworker/3:0+events21:07:563
370900099194510,1932cyclictest3710208-21kworker/2:0+events19:12:542
37082572156113,25sleep10-21swapper/119:06:091
37084412147102,25sleep30-21swapper/319:08:303
37085272146103,23sleep00-21swapper/019:09:350
3708425214195,30sleep20-21swapper/219:08:172
3708994991711,5cyclictest171ktimers/023:10:010
370899499167,6cyclictest3727447-21memory20:00:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional