You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-05 - 18:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackaslot0.osadl.org (updated Sat Jul 05, 2025 12:44:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
258472960,1sleep116627-21diskmemload09:22:381
13672900,1sleep01360-21bash10:04:310
240922630,0sleep124088-21bash11:00:571
300632580,2sleep216627-21diskmemload10:41:352
89432560,1sleep11507-21nfsd10:12:571
57422560,0sleep15720-21sshd09:54:071
310962550,1sleep231070-21sshd11:20:142
126982550,1sleep212696-21sshd10:59:542
10542550,0sleep10-21swapper/109:30:481
317182540,1sleep131703-21sshd09:11:401
300542540,0sleep230052-21bash09:15:262
109052540,0sleep10-21swapper/110:31:411
316592530,0sleep30-21swapper/310:30:233
326382520,1sleep332632-21sshd12:16:273
185772520,0sleep20-21swapper/212:18:102
241592510,1sleep30-21swapper/312:39:233
251452500,1sleep21722-21runrttasks12:24:432
2332525024,8sleep10-21swapper/107:06:051
216092500,0sleep10-21swapper/111:54:501
149242500,0sleep30-21swapper/310:50:103
2150524921,9sleep30-21swapper/307:05:073
2349224823,10sleep00-21swapper/007:08:130
179722480,0sleep00-21swapper/012:21:020
293732470,0sleep00-21swapper/010:58:120
2230924725,18sleep20-21swapper/207:05:222
161392460,0sleep116627-21diskmemload10:40:141
144462460,0sleep30-21swapper/310:17:133
291292450,1sleep229123-21sshd11:01:302
126092450,0sleep20-21swapper/212:29:282
78652440,0sleep30-21swapper/310:27:343
199382400,0sleep00-21swapper/009:10:200
2386799320,31cyclictest0-21swapper/108:15:161
23872992417,6cyclictest0-21swapper/212:38:022
161622230,0sleep00-21swapper/012:09:080
69582210,4sleep337-21rcuc/309:12:353
23877992119,1cyclictest0-21swapper/311:00:583
2387299211,1cyclictest350-21sshd11:32:102
187032210,0sleep30-21swapper/312:30:013
127032210,0sleep20-21swapper/210:35:552
86962200,1sleep28672-21sshd10:16:322
23867992017,2cyclictest0-21swapper/109:57:501
257652190,5sleep20-21swapper/210:07:062
2387299190,18cyclictest5182-21sshd09:57:432
2387299190,12cyclictest15073-21sshd12:09:012
2386299199,2cyclictest15026-21sshd11:15:410
23862991918,1cyclictest1089-21sshd11:44:060
10212190,1sleep21507-21nfsd11:52:542
23877991817,1cyclictest0-21swapper/310:42:203
23877991816,1cyclictest0-21swapper/310:24:403
23877991816,1cyclictest0-21swapper/310:05:563
2387299189,1cyclictest0-21swapper/211:45:112
2387299188,2cyclictest9264-21sshd11:12:172
2387299188,1cyclictest0-21swapper/211:15:542
2387299187,6cyclictest0-21swapper/211:58:572
23872991816,1cyclictest0-21swapper/212:14:022
23872991816,1cyclictest0-21swapper/209:40:032
2387299180,13cyclictest0-21swapper/210:52:412
2386299188,5cyclictest31475-21sshd11:11:190
23862991815,2cyclictest25287-21sshd11:46:130
2386299180,17cyclictest0-21swapper/008:08:140
175692180,0sleep117568-21sshd10:28:481
2387799174,2cyclictest39-21ksoftirqd/310:03:053
2387799170,9cyclictest0-21swapper/311:29:293
2387299178,1cyclictest31358-21bash09:23:172
2387299178,1cyclictest12599-21sshd10:20:422
2387299171,10cyclictest0-21swapper/209:12:552
2387299170,1cyclictest0-21swapper/212:31:432
2387299170,10cyclictest0-21swapper/211:35:102
2386299179,7cyclictest41ktimersoftd/010:06:220
2386299177,5cyclictest22023-21bash11:37:050
2386299177,4cyclictest3862-21bash10:15:570
2386299172,5cyclictest27023-21sshd10:54:430
2386299171,13cyclictest26988-21sshd12:36:360
172432170,1sleep317242-21sshd10:56:553
311662160,1sleep01722-21runrttasks10:38:090
283102160,0sleep20-21swapper/210:03:542
2387799161,4cyclictest37-21rcuc/311:44:433
23872991611,5cyclictest0-21swapper/209:53:252
2387299160,1cyclictest25103-21bash11:43:192
2387299160,10cyclictest0-21swapper/211:25:142
2387299160,10cyclictest0-21swapper/211:05:342
2386299169,3cyclictest2797-21sshd10:26:580
2386299168,4cyclictest0-21swapper/012:12:510
2386299168,2cyclictest0-21swapper/010:21:400
2386299162,13cyclictest20272-21sshd11:34:010
23862991611,1cyclictest0-21swapper/012:15:190
2386299160,5cyclictest31385-21sshd10:41:440
2386299160,4cyclictest5077-21sshd11:53:170
2386299160,3cyclictest0-21swapper/012:26:290
123892160,0sleep016627-21diskmemload11:21:240
63862150,0sleep10-21swapper/112:14:091
264992150,1sleep226484-21sshd10:33:542
2387799159,3cyclictest0-21swapper/311:31:003
2387799159,2cyclictest0-21swapper/309:39:143
2387799155,9cyclictest39-21ksoftirqd/310:36:573
2387799152,1cyclictest37-21rcuc/312:12:473
23877991513,1cyclictest39-21ksoftirqd/311:55:123
23877991513,1cyclictest39-21ksoftirqd/309:29:273
23877991513,1cyclictest37-21rcuc/311:51:543
2387799150,9cyclictest0-21swapper/312:09:033
2387799150,14cyclictest1506-21nfsd09:41:213
2387299150,12cyclictest0-21swapper/210:46:012
23867991514,1cyclictest0-21swapper/111:17:261
2386799150,5cyclictest14652-21bash12:20:411
2386799150,4cyclictest5855-21sshd11:05:461
2386799150,12cyclictest0-21swapper/111:40:071
2386299159,5cyclictest2974-21sshd09:23:460
2386299159,2cyclictest0-21swapper/011:56:390
2386299158,3cyclictest4995-21sshd11:26:380
2386299158,3cyclictest2485-21sshd09:46:130
2386299152,11cyclictest3795-21cut09:50:120
2386299151,3cyclictest28968-21sshd09:56:400
2386299151,11cyclictest22257-21sshd11:07:310
2386299150,5cyclictest4881-21bash09:16:190
2386299150,14cyclictest41ktimersoftd/009:32:460
2386299150,11cyclictest0-21swapper/010:12:180
2386299150,11cyclictest0-21swapper/009:38:410
188522150,2sleep018854-21sshd12:03:260
130072150,1sleep113005-21sshd10:46:351
53942140,0sleep10-21swapper/109:27:391
53452140,0sleep20-21swapper/208:45:152
47952140,0sleep00-21swapper/008:45:000
2387799148,2cyclictest24279-21cp10:14:473
2387799148,2cyclictest16664-21sshd11:15:513
2387799147,2cyclictest7009-21bash12:25:543
2387799144,1cyclictest39-21ksoftirqd/312:02:213
23877991413,1cyclictest39-21ksoftirqd/312:20:503
23877991413,1cyclictest37-21rcuc/309:23:453
23877991412,1cyclictest39-21ksoftirqd/311:46:373
23877991412,1cyclictest39-21ksoftirqd/311:36:093
23877991412,1cyclictest39-21ksoftirqd/311:23:453
23877991412,1cyclictest39-21ksoftirqd/311:10:543
23877991412,1cyclictest39-21ksoftirqd/309:45:013
23877991412,1cyclictest39-21ksoftirqd/309:31:183
23877991412,1cyclictest39-21ksoftirqd/309:16:433
23872991411,2cyclictest115950irq/25-eth009:28:382
2386799149,2cyclictest23614-21sshd09:45:051
2386799140,13cyclictest0-21swapper/110:17:401
2386299148,2cyclictest0-21swapper/012:30:460
2386299147,6cyclictest0-21swapper/010:45:310
2386299142,3cyclictest24294-21bash09:41:090
2386299140,4cyclictest31155-21sshd10:34:290
2386299140,11cyclictest0-21swapper/011:01:060
2387799134,1cyclictest39-21ksoftirqd/310:45:303
23877991312,1cyclictest39-21ksoftirqd/309:57:223
23877991312,1cyclictest39-21ksoftirqd/309:50:123
2387799130,12cyclictest0-21swapper/311:08:283
2387299139,1cyclictest0-21swapper/212:01:572
2387299131,11cyclictest0-21swapper/210:28:092
2387299130,2cyclictest0-21swapper/210:11:292
2387299130,12cyclictest0-21swapper/209:45:042
2386799139,3cyclictest0-21swapper/109:37:001
2386799139,1cyclictest0-21swapper/111:55:021
2386799138,4cyclictest19299-21sshd09:40:331
2386799138,4cyclictest0-21swapper/109:17:191
2386799131,9cyclictest5057-21sshd11:20:411
23867991312,1cyclictest31277-21sshd11:46:471
2386799131,1cyclictest115950irq/25-eth012:32:121
23867991311,1cyclictest10020-21rm10:52:571
2386799130,4cyclictest1614-21sshd10:58:421
2386799130,2cyclictest0-21swapper/110:21:151
2386799130,12cyclictest23771-21sshd12:36:191
2386799130,12cyclictest19373-21sshd12:09:251
2386799130,12cyclictest0-21swapper/112:19:321
2386799130,11cyclictest0-21swapper/110:00:161
2386799130,10cyclictest15407-21bash12:26:421
2386299132,3cyclictest27226-21sshd09:26:260
2387299129,2cyclictest0-21swapper/209:36:222
2387299129,2cyclictest0-21swapper/208:20:152
2387299120,11cyclictest0-21swapper/209:32:412
2386799129,2cyclictest0-21swapper/112:00:051
2386799129,2cyclictest0-21swapper/110:36:211
2386799129,2cyclictest0-21swapper/110:06:001
23867991211,1cyclictest0-21swapper/107:50:201
2386799121,10cyclictest0-21swapper/111:25:081
2386799121,10cyclictest0-21swapper/111:10:461
2386799120,11cyclictest0-21swapper/111:30:281
2386299122,9cyclictest0-21swapper/007:50:160
2387799119,1cyclictest0-21swapper/309:10:013
23877991110,1cyclictest0-21swapper/308:55:333
2387799110,11cyclictest0-21swapper/307:19:553
2387799110,10cyclictest0-21swapper/308:36:493
2387799110,10cyclictest0-21swapper/307:55:163
23872991110,1cyclictest0-21swapper/208:56:522
23872991110,1cyclictest0-21swapper/207:31:212
2387299110,1cyclictest0-21swapper/207:28:062
2387299110,11cyclictest0-21swapper/209:01:102
2387299110,11cyclictest0-21swapper/208:12:282
2386799118,2cyclictest0-21swapper/108:10:151
23867991110,1cyclictest0-21swapper/108:58:451
23867991110,1cyclictest0-21swapper/107:24:121
2386799110,11cyclictest0-21swapper/107:35:001
2386799110,10cyclictest0-21swapper/111:35:141
2386799110,10cyclictest0-21swapper/109:05:161
2386799110,10cyclictest0-21swapper/108:45:141
2386299111,9cyclictest41ktimersoftd/008:45:150
2386299111,9cyclictest27808-21munin-node08:25:250
2386299111,6cyclictest0-21swapper/007:15:160
2386299110,8cyclictest0-21swapper/007:20:270
2386299110,6cyclictest0-21swapper/008:10:240
2386299110,5cyclictest0-21swapper/007:35:130
2386299110,10cyclictest0-21swapper/009:00:140
2387799109,1cyclictest0-21swapper/308:06:233
2387799109,1cyclictest0-21swapper/307:39:403
2387799109,1cyclictest0-21swapper/307:34:273
2387799108,1cyclictest0-21swapper/308:40:193
2387799100,9cyclictest5583-21fschecks_time08:45:153
2387799100,9cyclictest0-21swapper/307:20:253
2387799100,1cyclictest30876-21perl08:30:163
2387299109,1cyclictest0-21swapper/208:19:472
2387299109,1cyclictest0-21swapper/207:56:062
2387299108,1cyclictest30906-21perl08:30:172
2387299108,1cyclictest16675-21fschecks_time08:00:162
2387299108,1cyclictest0-21swapper/208:05:162
2386799109,1cyclictest0-21swapper/109:01:531
2386799109,1cyclictest0-21swapper/108:36:001
2386799109,1cyclictest0-21swapper/108:07:181
2386799109,1cyclictest0-21swapper/107:15:011
2386799108,1cyclictest14227-21perl07:55:161
2386799107,2cyclictest0-21swapper/107:30:151
2386799100,1cyclictest9589-21perl07:45:151
2386799100,1cyclictest7880-21fschecks_time08:50:171
2386799100,10cyclictest0-21swapper/108:23:551
2386299108,1cyclictest0-21swapper/008:50:170
2386299100,9cyclictest15079-21fschecks_time09:05:180
238779998,1cyclictest0-21swapper/308:52:033
238779998,1cyclictest0-21swapper/307:43:443
238779991,7cyclictest0-21swapper/308:10:243
238779990,9cyclictest0-21swapper/309:00:533
238779990,9cyclictest0-21swapper/308:03:293
238779990,9cyclictest0-21swapper/307:26:333
238779990,1cyclictest0-21swapper/308:25:153
238729997,1cyclictest0-21swapper/208:50:182
238729997,1cyclictest0-21swapper/208:35:172
238729993,5cyclictest0-21swapper/207:47:582
238729990,1cyclictest0-21swapper/207:15:162
238679998,1cyclictest0-21swapper/108:30:391
238679998,1cyclictest0-21swapper/107:29:041
238629998,1cyclictest0-21swapper/008:30:150
238629997,1cyclictest0-21swapper/008:20:170
238629990,5cyclictest0-21swapper/008:15:140
238779987,1cyclictest0-21swapper/307:10:103
238779985,2cyclictest11718-21munin-node07:50:173
238779983,3cyclictest39-21ksoftirqd/308:15:273
238779981,6cyclictest0-21swapper/307:45:133
238729988,0cyclictest3329-21conntrack08:40:202
238729982,4cyclictest0-21swapper/209:05:202
238729982,4cyclictest0-21swapper/207:35:212
238729980,7cyclictest0-21swapper/207:21:132
238679980,7cyclictest0-21swapper/108:25:191
238629987,1cyclictest815-21perl08:35:160
238629983,2cyclictest0-21swapper/007:25:190
238629981,6cyclictest0-21swapper/007:40:180
238629980,7cyclictest0-21swapper/007:30:230
238629980,2cyclictest15940-21munin-node08:00:170
238779975,1cyclictest26062-21fschecks_time08:20:163
238729975,1cyclictest6614-21cpu07:40:142
238729970,6cyclictest0-21swapper/208:25:152
238729970,6cyclictest0-21swapper/207:50:132
238729970,6cyclictest0-21swapper/207:10:152
238679975,1cyclictest16676-21fschecks_time08:00:161
238679971,5cyclictest0-21swapper/107:10:211
238679970,6cyclictest0-21swapper/108:40:251
238679970,6cyclictest0-21swapper/107:40:231
238629974,1cyclictest0-21swapper/007:45:160
238629971,5cyclictest9644-21munin-node08:55:110
238629971,4cyclictest0-21swapper/007:58:090
238629970,6cyclictest0-21swapper/007:10:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional