You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-12 - 14:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Jun 12, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2197211393,15sleep20-21swapper/207:07:362
2034211289,18sleep00-21swapper/007:05:300
987211097,6sleep10-21swapper/107:05:151
206429685,6sleep30-21swapper/307:05:533
279602810,0sleep10-21swapper/112:02:101
186792690,0sleep00-21swapper/010:47:130
129702690,0sleep20-21swapper/211:46:442
3712600,1sleep30-21swapper/312:07:093
241199278,18cyclictest0-21swapper/109:30:131
39872260,1sleep20-21swapper/212:10:252
241199260,8cyclictest0-21swapper/110:20:111
241099265,19cyclictest0-21swapper/007:25:120
314832250,0sleep00-21swapper/008:20:140
241299250,2cyclictest0-21swapper/210:30:142
128292250,0sleep10-21swapper/111:46:311
327462230,0sleep10-21swapper/110:29:311
203002230,1sleep00-21swapper/009:43:520
241399221,12cyclictest5129-21runrttasks09:30:133
241399220,13cyclictest0-21swapper/310:20:123
79352210,1sleep07938-21mailstats07:20:230
241399211,3cyclictest0-21swapper/310:40:113
241399210,12cyclictest16001-21munin-node3
241099212,2cyclictest10556-21ssh11:45:120
320072200,0sleep00-21swapper/012:05:540
2411992016,3cyclictest14542-21kworker/u8:212:26:041
2411992016,2cyclictest7643-21kworker/u8:012:16:041
2412991915,2cyclictest0-21swapper/209:50:112
241299191,15cyclictest0-21swapper/212:25:132
241399180,11cyclictest18900-21diskmemload11:13:513
2411991815,2cyclictest9947-21kworker/u8:209:35:041
241199180,13cyclictest15128-21kworker/1:111:51:041
241099180,2cyclictest0-21swapper/010:20:110
241399172,7cyclictest0-21swapper/307:39:013
241399172,6cyclictest0-21swapper/312:00:013
241399170,7cyclictest0-21swapper/312:33:023
241299171,3cyclictest21361-21cut10:50:132
241299171,14cyclictest0-21swapper/210:05:002
2411991714,2cyclictest30447-21kworker/u8:111:09:041
2411991714,2cyclictest30447-21kworker/u8:111:09:041
2411991714,2cyclictest26296-21kworker/u8:112:37:041
2411991714,2cyclictest26296-21kworker/u8:112:34:051
2411991714,2cyclictest16182-21kworker/u8:011:18:041
2410991712,3cyclictest8364-21ssh11:10:110
50552160,1sleep00-21swapper/010:34:110
241399162,6cyclictest0-21swapper/311:28:583
241399161,7cyclictest0-21swapper/307:24:023
241399161,6cyclictest0-21swapper/311:05:003
241399161,13cyclictest23726-21fschecks_time08:00:143
2411991613,2cyclictest8380-21kworker/u8:107:33:041
2411991613,2cyclictest7643-21kworker/u8:012:22:041
2411991613,2cyclictest30690-21kworker/u8:011:36:041
2411991613,2cyclictest30447-21kworker/u8:111:14:011
2411991613,2cyclictest28548-21kworker/u8:007:14:051
2411991613,2cyclictest28341-21kworker/u8:009:29:041
2411991613,2cyclictest28341-21kworker/u8:009:21:051
2411991613,2cyclictest16587-21kworker/u8:009:11:041
241199160,14cyclictest0-21swapper/108:25:181
241099160,2cyclictest0-21swapper/007:35:180
241399152,7cyclictest0-21swapper/308:10:003
241399151,3cyclictest22707-21cat09:45:243
2413991510,3cyclictest0-21swapper/309:40:173
241399150,6cyclictest0-21swapper/307:29:013
241299152,7cyclictest0-21swapper/207:40:002
2412991510,3cyclictest0-21swapper/212:01:562
2411991512,2cyclictest23-21ksoftirqd/107:20:121
2411991512,2cyclictest22639-21kworker/u8:308:09:041
2411991512,2cyclictest18900-21diskmemload11:43:281
2411991512,2cyclictest16454-21kworker/u8:010:18:041
241199150,13cyclictest0-21swapper/110:00:061
2410991510,3cyclictest20645-21ssh10:16:130
241099150,13cyclictest18900-21diskmemload09:49:510
241399149,3cyclictest0-21swapper/312:27:013
241399142,7cyclictest0-21swapper/311:45:013
241399142,5cyclictest0-21swapper/309:20:003
241399141,3cyclictest27890-21perl12:35:153
241299149,3cyclictest20050-21sed10:15:272
241299142,6cyclictest0-21swapper/208:25:002
2412991410,2cyclictest4360-21lldpd11:51:402
241299140,2cyclictest0-21swapper/211:36:032
241299140,13cyclictest0-21swapper/211:09:442
241299140,13cyclictest0-21swapper/211:09:432
241299140,12cyclictest3527-21ssh09:26:002
241299140,12cyclictest0-21swapper/210:36:102
241299140,12cyclictest0-21swapper/210:13:342
2411991411,2cyclictest8580-21kworker/u8:108:54:041
2411991411,2cyclictest30891-21kworker/u8:208:39:041
2411991411,2cyclictest30690-21kworker/u8:011:32:041
2411991411,2cyclictest28515-21kworker/u8:112:10:051
2411991411,2cyclictest22639-21kworker/u8:308:03:051
2411991411,2cyclictest20750-21kworker/u8:008:11:041
2411991411,2cyclictest20750-21kworker/u8:008:11:041
2411991411,2cyclictest16587-21kworker/u8:009:02:041
2411991411,2cyclictest0-21swapper/110:11:191
241199140,2cyclictest0-21swapper/111:26:581
241199140,2cyclictest0-21swapper/110:40:281
241199140,2cyclictest0-21swapper/109:05:181
241199140,13cyclictest0-21swapper/108:55:181
241199140,12cyclictest0-21swapper/110:37:501
2410991411,2cyclictest18900-21diskmemload10:11:510
2410991411,2cyclictest0-21swapper/009:35:270
241099140,3cyclictest0-21swapper/009:00:160
241099140,12cyclictest4112-21wc11:05:170
241099140,12cyclictest4112-21wc11:05:170
241099140,12cyclictest30820-21ssh11:32:120
241099140,12cyclictest18900-21diskmemload10:25:510
241099140,12cyclictest0-21swapper/011:54:160
241099140,12cyclictest0-21swapper/011:15:210
241099140,12cyclictest0-21swapper/010:35:150
241399132,8cyclictest0-21swapper/310:35:003
241399132,6cyclictest0-21swapper/310:10:003
241399132,6cyclictest0-21swapper/308:40:003
241399131,7cyclictest622-21ssh10:30:003
241399131,3cyclictest0-21swapper/309:51:543
241399130,3cyclictest0-21swapper/309:00:273
241399130,2cyclictest0-21swapper/307:35:003
241299138,3cyclictest7407-21df_abs08:40:112
241299138,3cyclictest16667-21ssh11:18:092
241299132,7cyclictest3325-21copy10:00:002
241299131,2cyclictest0-21swapper/209:30:122
2412991310,2cyclictest18900-21diskmemload11:56:272
2412991310,2cyclictest0-21swapper/212:36:402
2412991310,2cyclictest0-21swapper/212:30:192
2412991310,2cyclictest0-21swapper/212:16:432
2412991310,2cyclictest0-21swapper/211:41:082
2412991310,2cyclictest0-21swapper/211:25:502
2412991310,2cyclictest0-21swapper/210:57:042
2412991310,2cyclictest0-21swapper/210:49:042
2412991310,2cyclictest0-21swapper/210:06:272
2412991310,2cyclictest0-21swapper/209:20:402
2412991310,2cyclictest0-21swapper/209:13:592
241299130,2cyclictest0-21swapper/210:41:432
241299130,2cyclictest0-21swapper/209:37:102
241299130,12cyclictest0-21swapper/211:30:042
241299130,12cyclictest0-21swapper/211:22:132
241299130,12cyclictest0-21swapper/211:10:352
241299130,11cyclictest25466-21ssh10:20:582
241299130,11cyclictest0-21swapper/212:07:162
2411991310,2cyclictest30891-21kworker/u8:208:20:041
2411991310,2cyclictest18900-21diskmemload11:56:301
2411991310,2cyclictest10475-21kworker/u8:207:35:051
2411991310,2cyclictest0-21swapper/110:51:181
2411991310,2cyclictest0-21swapper/110:05:201
2411991310,2cyclictest0-21swapper/109:56:381
2411991310,2cyclictest0-21swapper/109:40:261
241199130,2cyclictest26973-21irqstats09:50:161
241199130,2cyclictest0-21swapper/110:30:321
241199130,2cyclictest0-21swapper/109:46:581
241199130,2cyclictest0-21swapper/109:18:281
241199130,12cyclictest0-21swapper/111:00:381
241199130,12cyclictest0-21swapper/110:45:281
241199130,12cyclictest0-21swapper/108:45:181
241199130,11cyclictest0-21swapper/111:22:361
241099139,2cyclictest0-21swapper/009:56:250
2410991310,2cyclictest18900-21diskmemload12:03:000
2410991310,2cyclictest0-21swapper/012:16:550
2410991310,2cyclictest0-21swapper/012:10:430
2410991310,2cyclictest0-21swapper/011:25:540
2410991310,2cyclictest0-21swapper/011:00:040
2410991310,2cyclictest0-21swapper/010:03:020
2410991310,2cyclictest0-21swapper/009:26:550
2410991310,2cyclictest0-21swapper/009:22:110
2410991310,2cyclictest0-21swapper/009:19:210
241099130,2cyclictest2183-21ssh11:35:330
241099130,2cyclictest11-21rcuc/010:55:040
241099130,2cyclictest0-21swapper/012:25:300
241099130,2cyclictest0-21swapper/011:56:210
241099130,2cyclictest0-21swapper/010:51:310
241099130,2cyclictest0-21swapper/009:11:560
241099130,12cyclictest0-21swapper/012:24:000
241099130,12cyclictest0-21swapper/011:20:310
241099130,12cyclictest0-21swapper/010:41:410
241099130,12cyclictest0-21swapper/009:54:310
241099130,12cyclictest0-21swapper/009:30:210
241099130,11cyclictest0-21swapper/011:40:020
241399129,2cyclictest0-21swapper/312:00:153
241399129,2cyclictest0-21swapper/311:45:163
241399129,2cyclictest0-21swapper/311:35:223
241399129,2cyclictest0-21swapper/309:55:293
241399127,3cyclictest0-21swapper/307:55:243
241399122,7cyclictest0-21swapper/311:18:583
241399122,7cyclictest0-21swapper/310:03:583
241399122,7cyclictest0-21swapper/309:36:583
241399121,9cyclictest0-21swapper/308:16:353
241399120,11cyclictest0-21swapper/309:10:123
241399120,10cyclictest0-21swapper/310:39:023
241299129,2cyclictest0-21swapper/212:20:032
241299129,2cyclictest0-21swapper/210:26:062
241299129,2cyclictest0-21swapper/209:17:282
241299127,3cyclictest29724-21cut08:15:142
241299125,4cyclictest0-21swapper/208:26:262
241299122,7cyclictest0-21swapper/208:35:002
241299122,7cyclictest0-21swapper/207:28:582
241299120,2cyclictest0-21swapper/209:45:512
241299120,11cyclictest0-21swapper/211:00:252
241199129,2cyclictest12598-21kworker/u8:007:45:041
241199129,2cyclictest0-21swapper/107:15:161
241199128,2cyclictest15500-21cut07:40:131
241199120,9cyclictest0-21swapper/108:41:041
241199120,2cyclictest0-21swapper/110:55:321
241199120,11cyclictest0-21swapper/112:05:481
241199120,11cyclictest0-21swapper/107:50:151
241199120,11cyclictest0-21swapper/107:25:251
241099129,2cyclictest0-21swapper/012:35:070
241099129,2cyclictest0-21swapper/010:05:260
241099129,2cyclictest0-21swapper/008:00:120
241099129,2cyclictest0-21swapper/007:45:120
241099121,9cyclictest14870-21munin-run09:00:000
241099120,2cyclictest0-21swapper/009:05:210
241099120,11cyclictest0-21swapper/012:32:240
241099120,11cyclictest0-21swapper/008:15:130
241399118,2cyclictest16827-21ssh10:12:533
241399118,2cyclictest0-21swapper/311:20:253
241399116,3cyclictest4467-21latency_hist07:15:003
241399116,3cyclictest29176-21latency_hist08:15:013
241399116,3cyclictest29176-21latency_hist08:15:003
241399116,3cyclictest11356-21grep08:50:133
241399116,3cyclictest10871-21latency_hist08:50:003
241399112,7cyclictest0-21swapper/307:48:023
241399112,7cyclictest0-21swapper/307:17:583
241399112,6cyclictest0-21swapper/309:20:003
241399110,9cyclictest18900-21diskmemload12:11:103
241399110,9cyclictest0-21swapper/311:52:423
241399110,9cyclictest0-21swapper/311:32:023
241399110,9cyclictest0-21swapper/310:16:343
241399110,2cyclictest0-21swapper/309:05:153
241399110,10cyclictest0-21swapper/312:24:483
241299118,2cyclictest0-21swapper/208:30:192
241299111,7cyclictest0-21swapper/207:51:012
241299110,3cyclictest0-21swapper/207:38:002
241199110,9cyclictest0-21swapper/108:15:191
241199110,2cyclictest0-21swapper/108:31:051
241099118,2cyclictest0-21swapper/007:40:160
241099118,2cyclictest0-21swapper/007:30:260
241099117,2cyclictest0-21swapper/008:05:190
241099110,1cyclictest0-21swapper/007:55:260
241399107,2cyclictest0-21swapper/307:50:233
241399106,2cyclictest26980-21rt-features10:55:243
241399105,3cyclictest7986-21wc08:40:163
241399105,3cyclictest4713-21NetworkManager07:41:573
241399105,3cyclictest21517-21hwlatdetect10:50:143
241399104,4cyclictest4606-21sshd08:34:193
241399102,7cyclictest0-21swapper/308:56:013
241399100,9cyclictest0-21swapper/311:05:183
241399100,9cyclictest0-21swapper/311:05:183
241399100,9cyclictest0-21swapper/309:26:023
241399100,8cyclictest32142-21munin-node3
241299107,2cyclictest17202-21aten2.4-expect09:05:132
241299105,3cyclictest21262-21basename07:55:132
241299105,3cyclictest15354-21tr09:00:172
241299102,7cyclictest0-21swapper/208:53:582
241299102,7cyclictest0-21swapper/208:09:582
241299102,6cyclictest0-21swapper/208:10:262
241299102,6cyclictest0-21swapper/208:10:252
241299101,5cyclictest0-21swapper/207:10:112
241299100,7cyclictest0-21swapper/207:20:022
241299100,6cyclictest0-21swapper/207:17:572
241199106,3cyclictest14400-21kworker/1:207:55:121
241099101,5cyclictest0-21swapper/008:40:000
241099100,3cyclictest4540-21cron08:40:000
24139994,3cyclictest1874-21sendmail_mailst08:25:233
24139990,8cyclictest0-21swapper/312:15:353
24129994,3cyclictest23576-21df_abs08:00:132
24129994,3cyclictest18900-21diskmemload09:40:012
24129994,3cyclictest18216-21grep07:45:242
24129994,3cyclictest11002-21aten2.4-expect07:30:132
24129994,3cyclictest0-21swapper/208:45:132
24129991,6cyclictest0-21swapper/208:55:132
24109996,2cyclictest0-21swapper/008:46:520
24109996,2cyclictest0-21swapper/008:30:140
24109994,3cyclictest27831-21hwlatdetect08:10:170
24109994,3cyclictest27831-21hwlatdetect08:10:170
24109994,3cyclictest19857-21latency07:50:160
24109990,8cyclictest0-21swapper/008:51:220
24109990,8cyclictest0-21swapper/008:28:310
24109983,3cyclictest4755-21aten2.4_r3power07:15:130
24109982,4cyclictest2900-21cpuspeed_turbos07:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional