You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-28 - 20:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Sat Jun 28, 2025 00:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
378195399333917,3309cyclictest3847542-21kworker/3:1+events22:40:153
378194699278615,2766cyclictest3872953-21kworker/1:1+events00:10:131
378194899276913,2750cyclictest3844139-21kworker/2:0+events22:25:152
378194699275413,2737cyclictest3807378-21kworker/1:2+events20:35:181
378194699268813,2670cyclictest3807378-21kworker/1:2+events20:30:161
378195399266112,2645cyclictest3857319-21kworker/3:2+events23:10:003
378194399261212,2596cyclictest3858384-21kworker/0:0+events23:25:190
378194699258012,2564cyclictest3850441-21kworker/1:0+events22:49:081
378195399252812,2512cyclictest3796200-21kworker/3:1+events20:07:483
37819539925278,2515cyclictest3864797-21kworker/3:0+events23:29:093
378194399250710,2493cyclictest3821650-21kworker/0:0+events21:27:240
378194399250512,2490cyclictest3826695-21kworker/0:1+events21:46:210
378194399250512,2490cyclictest3826695-21kworker/0:1+events21:46:210
378194699249812,2482cyclictest3858297-21kworker/1:2+events23:20:441
378194699249712,2482cyclictest3844377-21kworker/1:2+events22:39:521
378194699249512,2479cyclictest3834396-21kworker/1:1+events21:52:501
378194699249512,2479cyclictest3834396-21kworker/1:1+events21:52:501
378194899249312,2478cyclictest3811891-21kworker/2:2+events20:44:262
378194699249012,2475cyclictest3820447-21kworker/1:2+events21:33:551
378194899248911,2474cyclictest3876931-21kworker/2:0+events00:06:482
378194899247812,2462cyclictest3869574-21kworker/2:2+events23:43:392
378194699246912,2454cyclictest3788260-21kworker/1:2+events19:28:351
378195399244811,2433cyclictest3866432-21kworker/3:2+events23:35:153
378195399244512,2429cyclictest3825125-21kworker/3:1+events21:41:543
378195399244312,2427cyclictest3863163-21kworker/3:1+events23:23:023
378194399244312,2427cyclictest3856754-21kworker/0:1+events23:06:560
378195399244012,2425cyclictest3868236-21kworker/3:0+events23:42:083
378195399244012,2424cyclictest3874224-21kworker/3:2+events00:03:233
378195399243812,2423cyclictest3847542-21kworker/3:1+events22:55:573
378195399243811,2424cyclictest3829576-21kworker/3:2+events21:45:163
378195399243811,2424cyclictest3829576-21kworker/3:2+events21:45:153
378195399243811,2424cyclictest3812095-21kworker/3:1+events20:48:123
378194399243612,2421cyclictest3801092-21kworker/0:0+events20:11:150
378195399243511,2420cyclictest3864797-21kworker/3:0+events23:32:353
378195399243212,2416cyclictest3836125-21kworker/3:1+events22:02:253
378194399243012,2415cyclictest3867796-21kworker/0:2+events23:39:050
378194399242812,2413cyclictest3858384-21kworker/0:0+events23:17:370
378194399242812,2413cyclictest3858384-21kworker/0:0+events23:17:370
378194399242812,2412cyclictest3856754-21kworker/0:1+events23:02:460
378195399242711,2413cyclictest3817729-21kworker/3:0+events21:16:133
378195399242610,2412cyclictest3850589-21kworker/3:2+events22:47:363
378194399242312,2407cyclictest3839870-21kworker/0:1+events22:18:200
378194399242312,2407cyclictest3797715-21kworker/0:0+events19:59:460
378194399242212,2406cyclictest3789777-21kworker/0:2+events19:54:250
378194399242211,2407cyclictest3826695-21kworker/0:1+events21:33:310
378194399242112,2406cyclictest3789777-21kworker/0:2+events19:36:570
378194399242012,2405cyclictest3797715-21kworker/0:0+events20:01:200
378194399241911,2404cyclictest3861591-21kworker/0:1+events23:21:300
378194399241712,2402cyclictest3796075-21kworker/0:1+events20:18:290
378194399241611,2402cyclictest3839870-21kworker/0:1+events22:41:500
378195399241012,2396cyclictest3814011-21kworker/3:0+events20:50:043
378194399240712,2391cyclictest3834484-21kworker/0:0+events21:59:470
378194399240512,2390cyclictest3810412-21kworker/0:1+events20:37:580
378195399240412,2388cyclictest3872594-21kworker/3:0+events23:52:253
378194399240412,2388cyclictest3832764-21kworker/0:2+events21:53:140
378194399240412,2388cyclictest3832764-21kworker/0:2+events21:53:130
378195399240110,2389cyclictest3845913-21kworker/3:2+events22:30:073
378194399240110,2387cyclictest3858384-21kworker/0:0+events23:31:280
37819489923989,2386cyclictest3861510-21kworker/2:2+events23:21:542
378194699239612,2381cyclictest3858297-21kworker/1:2+events23:08:051
378194399237312,2358cyclictest3885652-21kworker/0:1+events00:33:530
37819439923699,2357cyclictest3871294-21kworker/0:1+events00:09:290
378194899236211,2347cyclictest3833103-21kworker/2:2+events21:52:272
378194899236211,2347cyclictest3833103-21kworker/2:2+events21:52:272
378195399236110,2348cyclictest3796200-21kworker/3:1+events19:55:323
378195399234310,2329cyclictest3861499-21kworker/3:2+events23:18:013
378195399234310,2329cyclictest3861499-21kworker/3:2+events23:18:003
378195399234011,2326cyclictest3794571-21kworker/3:0+events19:54:483
378194699234011,2326cyclictest3834396-21kworker/1:1+events21:56:441
378194899233811,2323cyclictest3842518-21kworker/2:1+events22:23:192
37819539923306,2320cyclictest3786747-21kworker/3:0+events19:32:483
378194699232611,2311cyclictest3855428-21kworker/1:0+events23:02:221
378194899232311,2309cyclictest3804176-21kworker/2:1+events20:20:492
378194699231911,2304cyclictest3869358-21kworker/1:1+events23:45:121
37819539923188,2307cyclictest3808803-21kworker/3:2+events20:57:193
378194699231012,2294cyclictest3876064-21kworker/1:0+events00:04:101
378195399230711,2291cyclictest3876274-21kworker/3:0+events00:06:273
378194699230512,2289cyclictest3788260-21kworker/1:2+events19:34:171
378194899230312,2288cyclictest3804176-21kworker/2:1+events20:27:182
378194699228810,2275cyclictest3788260-21kworker/1:2+events19:38:291
378194399228612,2270cyclictest3813897-21kworker/0:1+events20:54:400
378194899227611,2261cyclictest3800940-21kworker/2:1+events20:08:112
378194899227411,2260cyclictest3842518-21kworker/2:1+events22:18:412
378194899227411,2260cyclictest3804176-21kworker/2:1+events20:35:402
378194899227311,2258cyclictest3884062-21kworker/2:0+events00:29:192
378194899227311,2258cyclictest3818600-21kworker/2:1+events21:02:432
378194899227211,2257cyclictest3786804-21kworker/2:0+events19:24:462
378194899227111,2256cyclictest3786804-21kworker/2:0+events19:39:592
378194899227110,2258cyclictest3796082-21kworker/2:1+events19:57:532
378194899227011,2256cyclictest3850652-21kworker/2:2+events23:09:362
378194899227011,2256cyclictest3837458-21kworker/2:1+events22:05:292
378194899227011,2256cyclictest3786804-21kworker/2:0+events19:41:532
378194899227010,2257cyclictest3797683-21kworker/2:2+events20:13:352
37819489922699,2256cyclictest3866354-21kworker/2:1+events23:33:212
37819489922698,2257cyclictest3821810-21kworker/2:1+events21:21:122
378194899226910,2256cyclictest3815315-21kworker/2:2+events21:14:212
378194899226910,2256cyclictest3815315-21kworker/2:2+events21:05:402
378194899226910,2255cyclictest3855976-21kworker/2:0+events23:04:172
378195399226810,2254cyclictest3817729-21kworker/3:0+events21:08:173
378194899226810,2255cyclictest3793508-21kworker/2:2+events19:49:292
378194899226810,2254cyclictest3872797-21kworker/2:2+events23:58:282
378194899226810,2254cyclictest3859895-21kworker/2:0+events23:17:152
378194899226810,2254cyclictest3859895-21kworker/2:0+events23:17:152
378194899226810,2254cyclictest3842518-21kworker/2:1+events22:32:432
378195399226710,2253cyclictest3859868-21kworker/3:1+events23:14:133
378194899226711,2252cyclictest3815315-21kworker/2:2+events20:58:272
378194899226710,2254cyclictest3797683-21kworker/2:2+events20:15:512
378194399226711,2252cyclictest3847307-21kworker/0:2+events22:59:220
378194899226611,2251cyclictest3852257-21kworker/2:1+events22:57:272
378194899226411,2249cyclictest3850652-21kworker/2:2+events22:49:302
378194399226411,2251cyclictest3867796-21kworker/0:2+events23:55:030
37819539922634,2256cyclictest3817729-21kworker/3:0+events21:20:263
37819489922629,2249cyclictest3882459-21kworker/2:2+events00:33:062
378194899226211,2248cyclictest3833103-21kworker/2:2+events21:59:242
378194899226210,2249cyclictest3864746-21kworker/2:0+events23:29:322
378194899226210,2248cyclictest3823400-21kworker/2:0+events21:37:212
378194899226110,2249cyclictest3797683-21kworker/2:2+events20:00:102
378194899225511,2241cyclictest3785162-21kworker/2:1+events19:27:492
37819489922549,2241cyclictest3804176-21kworker/2:1+events20:50:502
378194899225310,2240cyclictest3869574-21kworker/2:2+events23:46:442
37819489922528,2240cyclictest3833103-21kworker/2:2+events22:03:562
378194899225210,2239cyclictest3786804-21kworker/2:0+events19:51:442
378195399225110,2237cyclictest3874224-21kworker/3:2+events23:59:123
378194899225011,2236cyclictest3821810-21kworker/2:1+events21:18:082
378194399225012,2234cyclictest3847307-21kworker/0:2+events22:39:070
37819489922489,2236cyclictest3871194-21kworker/2:0+events23:51:162
378194899223910,2226cyclictest3807461-21kworker/2:2+events20:33:442
378194399223910,2225cyclictest3804270-21kworker/0:2+events20:34:540
37819539922386,2228cyclictest3825125-21kworker/3:1+events21:27:013
378195399223710,2224cyclictest3839053-21kworker/3:2+events22:08:513
378195399223710,2223cyclictest3791315-21kworker/3:1+events19:43:243
378195399223610,2222cyclictest3847542-21kworker/3:1+events23:04:393
378194399223611,2222cyclictest3839870-21kworker/0:1+events22:22:560
37819489922359,2223cyclictest3823400-21kworker/2:0+events21:43:002
378194399223410,2220cyclictest3837808-21kworker/0:2+events22:09:140
378195399223311,2220cyclictest3832824-21kworker/3:0+events22:23:433
378195399223310,2219cyclictest3817729-21kworker/3:0+events21:01:113
378195399223210,2219cyclictest3791315-21kworker/3:1+events19:38:063
378194899223111,2217cyclictest3823400-21kworker/2:0+events21:31:372
378195399223011,2215cyclictest3832824-21kworker/3:0+events21:57:063
378195399223010,2217cyclictest3807143-21kworker/3:1+events20:26:563
378195399223010,2216cyclictest3829576-21kworker/3:2+events21:36:583
378195399222911,2214cyclictest3874224-21kworker/3:2+events00:16:403
37819539922287,2217cyclictest3863163-21kworker/3:1+events23:48:583
378194399222811,2214cyclictest3801092-21kworker/0:0+events20:23:030
378195399222710,2214cyclictest3879507-21kworker/3:1+events00:25:533
378195399222710,2214cyclictest3796200-21kworker/3:1+events20:14:443
378195399222710,2213cyclictest3820258-21kworker/3:2+events21:12:493
378194399222710,2213cyclictest3805954-21kworker/0:1+events20:29:530
378194399222710,2213cyclictest3788170-21kworker/0:0+events19:27:260
378194399222611,2212cyclictest3871294-21kworker/0:1+events23:50:540
378194399222610,2213cyclictest3847307-21kworker/0:2+events22:47:570
378195399222510,2212cyclictest3844289-21kworker/3:1+events22:27:063
378194399222511,2211cyclictest3881136-21kworker/0:0+events00:23:330
378195399222411,2209cyclictest3802699-21kworker/3:2+events20:16:143
378195399222411,2209cyclictest3779761-21kworker/3:1+events19:19:463
37819439922249,2212cyclictest3808769-21kworker/0:0+events20:47:040
378194399222410,2209cyclictest3813897-21kworker/0:1+events20:56:560
378195399222311,2209cyclictest3808803-21kworker/3:2+events20:40:393
378194399222311,2209cyclictest3831138-21kworker/0:0+events21:43:230
378194399222310,2210cyclictest3839870-21kworker/0:1+events22:34:340
378194399222211,2207cyclictest3813897-21kworker/0:1+events21:09:250
378194399222010,2206cyclictest3783535-21kworker/0:3+events19:24:240
378195399221911,2205cyclictest3847542-21kworker/3:1+events22:52:553
37819439922199,2207cyclictest3877935-21kworker/0:0+events00:14:010
37819439922179,2204cyclictest3856754-21kworker/0:1+events23:11:080
378194399221611,2202cyclictest3834484-21kworker/0:0+events22:10:210
378194399221410,2201cyclictest3881136-21kworker/0:0+events00:35:470
378195399220911,2194cyclictest3832824-21kworker/3:0+events22:11:543
378194399220911,2196cyclictest3821650-21kworker/0:0+events21:15:060
378195399220810,2196cyclictest3804376-21kworker/3:0+events20:21:103
37819539922079,2194cyclictest3804376-21kworker/3:0+events20:36:023
378195399220611,2192cyclictest3832824-21kworker/3:0+events22:39:293
378194399220510,2191cyclictest3874162-21kworker/0:0+events00:00:210
37819439922048,2193cyclictest3824939-21kworker/0:2+events21:36:340
378194399220311,2189cyclictest3789777-21kworker/0:2+events19:45:170
378194399220310,2189cyclictest3799400-21kworker/0:2+events20:06:150
378195399220211,2188cyclictest3840711-21kworker/3:1+events22:16:503
37819439922018,2189cyclictest3781517-21kworker/0:0+events19:19:220
37819439922009,2188cyclictest3789777-21kworker/0:2+events19:43:460
378194399220011,2185cyclictest3844043-21kworker/0:0+events22:26:220
378194399219911,2185cyclictest3834484-21kworker/0:0+events22:03:100
378194399219811,2183cyclictest3810412-21kworker/0:1+events20:41:020
378194399219711,2184cyclictest3867796-21kworker/0:2+events23:43:150
378195399219511,2181cyclictest3881256-21kworker/3:0+events00:23:113
378195399219210,2179cyclictest3883981-21kworker/3:2+events00:38:053
37819469921909,2178cyclictest3825061-21kworker/1:1+events21:39:141
37819489921899,2177cyclictest3823400-21kworker/2:0+events21:49:012
37819489921899,2177cyclictest3823400-21kworker/2:0+events21:49:012
378194399218911,2175cyclictest3824939-21kworker/0:2+events21:24:190
378194399218911,2175cyclictest3817218-21kworker/0:2+events21:10:560
378194699218310,2170cyclictest3791524-21kworker/1:1+events19:45:401
37819489921789,2165cyclictest3882459-21kworker/2:2+events00:37:412
378195399217711,2163cyclictest3797834-21kworker/3:2+events20:02:073
378194899215111,2137cyclictest3866354-21kworker/2:1+events23:35:382
378194699213712,2123cyclictest3804030-21kworker/1:0+events20:20:021
378194699213210,2119cyclictest3858297-21kworker/1:2+events23:57:441
37819489921189,2105cyclictest3880833-21kworker/2:0+events00:17:262
378194899211810,2105cyclictest3823400-21kworker/2:0+events21:29:202
378194899211810,2104cyclictest3852257-21kworker/2:1+events22:51:262
378194899211710,2105cyclictest3804176-21kworker/2:1+events20:45:342
378194699211611,2102cyclictest3794478-21kworker/1:0+events20:05:091
378194699211510,2102cyclictest3872953-21kworker/1:1+events00:22:481
378194899211410,2101cyclictest3879229-21kworker/2:2+events00:13:382
378194699211410,2101cyclictest3858297-21kworker/1:2+events23:32:131
378194899211210,2098cyclictest3858300-21kworker/2:1+events23:13:282
378194699211010,2097cyclictest3866377-21kworker/1:0+events23:36:471
378194699210811,2093cyclictest3837684-21kworker/1:1+events22:16:051
378195399210711,2094cyclictest3832824-21kworker/3:0+events21:50:103
378195399210711,2094cyclictest3832824-21kworker/3:0+events21:50:103
378194699210711,2092cyclictest3799312-21kworker/1:1+events20:02:301
378194699210710,2094cyclictest3858297-21kworker/1:2+events23:44:021
378194899210611,2091cyclictest3839066-21kworker/2:0+events22:11:092
37819469921069,2094cyclictest3830003-21kworker/1:2+events21:49:481
37819469921069,2094cyclictest3830003-21kworker/1:2+events21:49:481
378194699210611,2091cyclictest3872953-21kworker/1:1+events00:18:581
378194699210611,2091cyclictest3837684-21kworker/1:1+events22:13:031
378194699210611,2091cyclictest3799312-21kworker/1:1+events20:10:521
378194699210610,2093cyclictest3799312-21kworker/1:1+events20:15:301
378195399210510,2091cyclictest3885713-21kworker/3:0+events00:33:313
378194699210511,2091cyclictest3872953-21kworker/1:1+events00:07:341
378194699210510,2092cyclictest3858297-21kworker/1:2+events23:27:371
37819469921048,2092cyclictest3825061-21kworker/1:1+events21:25:051
378194699210411,2089cyclictest3832794-21kworker/1:0+events22:07:211
378194699210211,2088cyclictest3837684-21kworker/1:1+events22:04:431
378194699210211,2087cyclictest3847663-21kworker/1:1+events22:50:161
378194699210011,2086cyclictest3847663-21kworker/1:1+events22:41:251
37819469920997,2088cyclictest3805775-21kworker/1:1+events20:26:091
378194699209911,2085cyclictest3783428-21kworker/1:1+events19:20:551
378194699209910,2086cyclictest3858297-21kworker/1:2+events23:13:521
378194899209710,2083cyclictest3783160-21kworker/2:2+events19:17:302
378194699209711,2082cyclictest3815468-21kworker/1:0+events20:53:321
378194699209410,2080cyclictest3817128-21kworker/1:1+events21:13:571
378194699209111,2077cyclictest3817128-21kworker/1:1+events21:04:561
378195399209010,2077cyclictest3794571-21kworker/3:0+events19:47:583
37819489920888,2077cyclictest3775324-21kworker/2:0+events19:14:512
378195399208410,2071cyclictest3876274-21kworker/3:0+events00:11:213
37819539920818,2069cyclictest3826777-21kworker/3:0+events21:34:173
378195399208010,2066cyclictest3786747-21kworker/3:0+events19:24:013
37819439920796,2070cyclictest3786562-21kworker/0:1+events19:30:310
37819539920749,2062cyclictest3783077-21kworker/3:2+events19:26:423
37819439920733,2067cyclictest3879536-21kworker/0:2+events00:27:460
37819439920699,2056cyclictest3817218-21kworker/0:2+events21:00:470
37819539920687,2058cyclictest3808803-21kworker/3:2+events20:34:083
378194399206710,2054cyclictest3879536-21kworker/0:2+events00:15:320
378194899206310,2050cyclictest3842518-21kworker/2:1+events22:42:562
37819439920604,2053cyclictest3869567-21kworker/0:0+events23:48:140
378194699205810,2045cyclictest3844377-21kworker/1:2+events22:29:441
37819489920288,2017cyclictest3842518-21kworker/2:1+events22:36:522
37819469920247,2014cyclictest3796109-21kworker/1:2+events19:53:391
37819539920098,1998cyclictest3781395-21kworker/3:0+events19:11:013
378194699200510,1992cyclictest3823430-21kworker/1:0+events21:23:101
378194699198511,1970cyclictest3885684-21kworker/1:1+events00:36:101
37819439919819,1969cyclictest3779822-21kworker/0:1+events19:12:320
37819469919753,1968cyclictest3807378-21kworker/1:2+events20:46:191
37819489919747,1963cyclictest3872797-21kworker/2:2+events00:03:482
37819469919627,1952cyclictest3818812-21kworker/1:0+events21:09:031
37819469919607,1949cyclictest3809316-21kworker/1:0+events20:40:171
378194699196010,1947cyclictest3796109-21kworker/1:2+events19:55:571
378194699195610,1943cyclictest3815468-21kworker/1:0+events20:55:491
378194699195410,1941cyclictest3842480-21kworker/1:0+events22:24:511
378194699195110,1938cyclictest3884011-21kworker/1:2+events00:27:251
37819489919496,1939cyclictest3788468-21kworker/2:2+events19:34:392
378194699194510,1932cyclictest3881049-21kworker/1:0+events00:30:511
37819469919436,1934cyclictest3820447-21kworker/1:2+events21:18:311
37819469919424,1935cyclictest3775196-21kworker/1:0+events19:18:161
378194699194010,1927cyclictest3870995-21kworker/1:0+events23:50:311
37819469919366,1927cyclictest3842480-21kworker/1:0+events22:33:491
378194699193210,1919cyclictest3825061-21kworker/1:1+events21:44:541
37819469919132,1908cyclictest3847663-21kworker/1:1+events22:59:441
37819469919069,1894cyclictest3775196-21kworker/1:0+events19:12:091
37819469919063,1900cyclictest3788260-21kworker/1:2+events19:42:391
37815892151109,36sleep10-21swapper/119:08:501
37814562150104,26sleep30-21swapper/319:07:063
37816172144115,24sleep20-21swapper/219:09:112
37814952141106,30sleep00-21swapper/019:07:360
378194899180,16cyclictest3881738-21irqstats00:20:192
378194699180,11cyclictest3860724-21hddtemp_smartct23:15:251
378194699180,11cyclictest3860724-21hddtemp_smartct23:15:251
378194399148,4cyclictest3853086-21ld22:50:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional