You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-17 - 15:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackaslot0.osadl.org (updated Wed Sep 17, 2025 12:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
457021130,0sleep24497-21sshd10:27:032
209121050,0sleep32079-21sshd11:56:143
42952960,1sleep013377-21diskmemload10:56:060
195392880,0sleep219540-21sshd09:36:382
172672880,0sleep30-21swapper/310:49:443
174642660,0sleep10-21swapper/111:06:561
68932640,1sleep06874-21sshd09:19:190
266172620,1sleep30-21swapper/311:04:543
154592620,1sleep015439-21sshd10:19:080
82902590,2sleep12066399cyclictest12:10:461
323782580,0sleep20-21swapper/212:38:322
68882560,0sleep00-21swapper/010:33:180
207862560,0sleep00-21swapper/010:46:360
125332560,0sleep212462-21sshd10:49:062
245662550,1sleep024560-21sshd11:28:220
117212550,0sleep20-21swapper/211:57:052
29792540,0sleep10-21swapper/109:29:091
178752530,0sleep117878-21id11:21:541
12102530,0sleep21211-21sshd11:14:262
72142520,0sleep10-21swapper/110:00:221
2032325231,8sleep00-21swapper/007:09:060
2023425229,9sleep10-21swapper/107:07:591
1955825229,19sleep30-21swapper/307:05:243
56692510,0sleep10-21swapper/110:21:091
300242510,1sleep230014-21sshd10:17:252
247252510,0sleep324723-21sshd10:38:023
2011225128,19sleep20-21swapper/207:06:272
189012510,1sleep10-21swapper/109:46:071
140432510,0sleep114010-21sshd11:30:201
289302500,1sleep21591-21sshd11:46:512
101322500,1sleep110128-21bash10:45:371
146742490,0sleep30-21swapper/312:17:063
232602480,0sleep30-21swapper/310:50:163
87912470,0sleep00-21swapper/009:48:190
314602460,1sleep231458-21sshd12:21:172
213212450,0sleep20-21swapper/209:46:212
78802440,0sleep10-21swapper/109:35:301
252602410,0sleep00-21swapper/012:29:210
2066599360,33cyclictest0-21swapper/308:50:173
2066299330,32cyclictest0-21swapper/008:00:180
2066499280,28cyclictest0-21swapper/207:10:372
235542270,0sleep123553-21sshd11:43:141
2066499270,27cyclictest0-21swapper/208:42:042
20665992622,4cyclictest2329-21sshd09:18:513
2066499252,23cyclictest0-21swapper/207:32:452
18662250,1sleep120660-21cyclictest12:35:381
2066499242,22cyclictest0-21swapper/209:05:292
2066499240,24cyclictest0-21swapper/208:54:252
20664992321,2cyclictest1927-21sshd09:44:412
2066499230,23cyclictest0-21swapper/208:58:252
2066499230,23cyclictest0-21swapper/207:47:542
20663992321,1cyclictest15350-21sshd09:51:521
274732220,0sleep00-21swapper/009:34:250
2066499220,22cyclictest0-21swapper/208:03:412
2066499220,22cyclictest0-21swapper/207:43:532
2066499210,21cyclictest0-21swapper/208:36:162
2066499210,21cyclictest0-21swapper/207:54:382
20662992119,1cyclictest29237-21sshd12:09:560
2066499200,20cyclictest0-21swapper/212:26:342
2066499200,1cyclictest736-21sshd10:41:562
284532190,1sleep013377-21diskmemload10:11:150
273092190,1sleep30-21swapper/310:26:083
20665991917,1cyclictest0-21swapper/312:27:433
20664991918,1cyclictest698-21sshd09:21:402
20662991918,1cyclictest12408-21sshd11:42:070
123812190,0sleep28-21rcu_preempt12:16:522
73092180,1sleep07284-21sshd12:36:100
53552180,1sleep35331-21sshd12:02:073
218332180,1sleep11722-21runrttasks10:53:541
20664991816,1cyclictest7574-21sshd12:10:432
2066499170,17cyclictest0-21swapper/209:00:432
201142170,0sleep337-21rcuc/311:36:473
300022160,1sleep129998-21bash09:11:501
225862160,1sleep00-21swapper/011:13:240
212322160,0sleep30-21swapper/310:13:383
20664991613,3cyclictest1507-21nfsd12:09:042
2066399161,14cyclictest0-21swapper/107:20:131
2066399161,14cyclictest0-21swapper/107:20:131
2066299160,5cyclictest0-21swapper/010:42:310
2066299160,2cyclictest26593-21sshd10:02:080
2066299160,15cyclictest0-21swapper/010:35:460
169262160,1sleep016927-21bash11:18:490
156462160,1sleep015648-21bash12:00:160
114552160,1sleep00-21swapper/012:30:490
100532160,0sleep00-21swapper/011:06:150
269342150,0sleep01722-21runrttasks11:31:270
210322150,1sleep3381ktimersoftd/311:19:133
2066599152,10cyclictest115950irq/25-eth012:23:083
20665991513,1cyclictest0-21swapper/310:16:273
2066599150,14cyclictest0-21swapper/311:54:163
2066599150,14cyclictest0-21swapper/311:54:163
2066599150,14cyclictest0-21swapper/311:06:033
2066599150,14cyclictest0-21swapper/309:45:353
2066499155,9cyclictest9994-21sshd09:19:372
20664991514,1cyclictest26169-21sshd10:20:082
2066499150,13cyclictest0-21swapper/211:16:362
2066399150,14cyclictest0-21swapper/112:28:371
2066399150,14cyclictest0-21swapper/110:08:541
2066399150,14cyclictest0-21swapper/107:30:161
2066299159,3cyclictest0-21swapper/010:23:030
20662991514,1cyclictest0-21swapper/010:25:280
2066299151,11cyclictest0-21swapper/009:38:080
2066299150,8cyclictest32358-21cp11:35:020
2066299150,5cyclictest493-21jbd2/dm-0-809:25:530
207712140,0sleep120764-21sshd09:43:021
20665991412,1cyclictest13377-21diskmemload10:30:033
2066599140,13cyclictest0-21swapper/312:31:123
2066599140,13cyclictest0-21swapper/311:27:083
2066599140,13cyclictest0-21swapper/309:53:513
2066599140,13cyclictest0-21swapper/309:13:293
2066599140,13cyclictest0-21swapper/308:04:063
2066599140,11cyclictest0-21swapper/310:42:183
20664991413,1cyclictest5778-21sshd12:33:142
20664991413,1cyclictest1507-21nfsd11:29:382
20664991412,1cyclictest14410-21sshd10:57:392
20664991412,1cyclictest0-21swapper/210:14:082
20664991410,3cyclictest16386-21kworker/u8:011:50:452
20664991410,3cyclictest16386-21kworker/u8:011:50:452
2066499140,13cyclictest0-21swapper/211:05:412
2066499140,13cyclictest0-21swapper/209:10:232
20663991412,1cyclictest8608-21sshd11:29:551
20663991410,1cyclictest0-21swapper/110:59:221
2066399140,14cyclictest0-21swapper/111:11:571
2066299147,6cyclictest21688-21sshd12:14:550
2066299143,10cyclictest12722-21sshd11:21:250
20662991412,1cyclictest13973-21sshd10:06:530
20662991411,2cyclictest0-21swapper/009:56:050
2066299140,4cyclictest0-21swapper/010:51:450
2066299140,3cyclictest0-21swapper/009:40:210
2066299140,13cyclictest13377-21diskmemload09:20:240
2066299140,11cyclictest0-21swapper/012:20:200
2066299140,11cyclictest0-21swapper/011:52:280
2066299140,11cyclictest0-21swapper/011:52:270
157202140,0sleep30-21swapper/311:12:483
50042130,1sleep25005-21sshd10:33:082
39502130,1sleep03930-21sshd12:18:590
2066599139,3cyclictest0-21swapper/308:05:153
2066599139,1cyclictest0-21swapper/310:05:493
2066599138,4cyclictest0-21swapper/309:31:213
2066599138,2cyclictest0-21swapper/309:39:013
20665991311,1cyclictest27925-21sshd09:44:003
20665991311,1cyclictest0-21swapper/310:58:053
20665991311,1cyclictest0-21swapper/309:27:133
2066599131,11cyclictest0-21swapper/307:55:143
2066599130,2cyclictest0-21swapper/311:32:143
2066599130,12cyclictest3613-21sshd11:47:343
2066599130,12cyclictest20865-21sshd10:01:353
2066599130,12cyclictest1591-21sshd11:23:573
2066599130,12cyclictest0-21swapper/309:55:263
2066599130,12cyclictest0-21swapper/309:24:573
2066499139,4cyclictest0-21swapper/209:32:202
2066499139,3cyclictest0-21swapper/209:58:592
2066499139,3cyclictest0-21swapper/208:25:162
2066499138,4cyclictest6944-21sshd11:38:392
2066499138,4cyclictest0-21swapper/210:06:062
2066499138,4cyclictest0-21swapper/209:50:302
20664991312,1cyclictest115950irq/25-eth010:53:372
2066499131,11cyclictest0-21swapper/212:00:142
2066499131,11cyclictest0-21swapper/210:39:242
20664991310,2cyclictest0-21swapper/209:29:552
2066499130,4cyclictest0-21swapper/210:01:372
2066499130,12cyclictest27575-21sshd11:34:362
2066499130,12cyclictest0-21swapper/211:20:302
2066399139,1cyclictest0-21swapper/109:55:571
2066399131,11cyclictest0-21swapper/112:06:451
20663991310,2cyclictest0-21swapper/107:55:171
2066399130,4cyclictest28266-21sshd09:18:061
2066399130,2cyclictest30110-21bash12:01:261
2066399130,13cyclictest0-21swapper/110:28:081
2066399130,12cyclictest3359-21bash11:50:391
2066399130,12cyclictest3359-21bash11:50:381
2066399130,12cyclictest31209-21sshd12:21:161
2066399130,12cyclictest22158-21sshd11:36:581
2066399130,12cyclictest0-21swapper/112:33:301
2066399130,12cyclictest0-21swapper/111:57:531
2066399130,12cyclictest0-21swapper/111:18:061
2066399130,12cyclictest0-21swapper/110:38:181
2066399130,12cyclictest0-21swapper/110:10:131
2066399130,12cyclictest0-21swapper/109:23:521
2066299139,1cyclictest0-21swapper/011:58:160
2066299138,4cyclictest13749-21sshd11:48:370
2066299138,4cyclictest0-21swapper/009:50:500
2066299130,8cyclictest28361-21sshd11:01:580
2066599129,2cyclictest7323-21sshd12:05:113
2066599129,2cyclictest0-21swapper/312:35:183
2066599129,2cyclictest0-21swapper/310:20:043
2066599129,2cyclictest0-21swapper/308:55:213
2066599129,2cyclictest0-21swapper/308:45:153
2066599129,2cyclictest0-21swapper/307:45:153
2066599128,3cyclictest0-21swapper/308:30:103
2066599121,10cyclictest0-21swapper/312:10:333
2066599121,10cyclictest0-21swapper/307:40:143
2066599120,11cyclictest0-21swapper/311:40:123
2066499129,2cyclictest0-21swapper/207:25:162
2066499121,1cyclictest115950irq/25-eth011:41:302
2066499121,10cyclictest0-21swapper/208:20:152
2066499121,10cyclictest0-21swapper/208:15:162
2066499120,1cyclictest0-21swapper/211:00:582
2066399129,2cyclictest0-21swapper/111:00:341
2066399129,2cyclictest0-21swapper/109:31:031
2066399129,2cyclictest0-21swapper/109:05:161
2066399129,2cyclictest0-21swapper/108:20:141
2066399128,4cyclictest22020-21bash10:16:411
2066399128,4cyclictest11520-21sshd12:16:481
2066399128,1cyclictest0-21swapper/110:30:021
2066399121,10cyclictest0-21swapper/108:40:161
2066399120,3cyclictest19691-21sshd10:40:401
2066399120,11cyclictest0-21swapper/111:45:101
2066399120,11cyclictest0-21swapper/108:45:111
2066399120,11cyclictest0-21swapper/107:15:021
2066399120,11cyclictest0-21swapper/107:15:011
2066299129,2cyclictest0-21swapper/008:35:170
2066299129,2cyclictest0-21swapper/008:15:140
2066299129,2cyclictest0-21swapper/007:45:140
2066299129,2cyclictest0-21swapper/007:20:210
2066299129,2cyclictest0-21swapper/007:20:200
2066299121,10cyclictest0-21swapper/009:00:160
20662991210,1cyclictest7975-21apache_volume07:50:130
2066299120,11cyclictest18136-21sshd09:10:210
2066299120,11cyclictest0-21swapper/008:30:110
2066299120,11cyclictest0-21swapper/007:55:150
2066599118,2cyclictest0-21swapper/309:00:173
2066599118,2cyclictest0-21swapper/307:20:113
2066599118,2cyclictest0-21swapper/307:20:113
2066599111,1cyclictest0-21swapper/307:30:153
2066599110,11cyclictest0-21swapper/308:25:143
2066599110,10cyclictest0-21swapper/308:40:203
2066599110,10cyclictest0-21swapper/307:25:143
2066499118,2cyclictest0-21swapper/208:30:112
20664991110,1cyclictest0-21swapper/208:46:142
2066499110,10cyclictest23074-21irqstats07:15:012
2066499110,10cyclictest23074-21irqstats07:15:012
2066499110,10cyclictest0-21swapper/208:10:152
2066499110,10cyclictest0-21swapper/207:35:222
2066499110,10cyclictest0-21swapper/207:20:152
2066499110,10cyclictest0-21swapper/207:20:152
2066399119,1cyclictest0-21swapper/108:25:171
2066399118,2cyclictest0-21swapper/108:15:141
2066399118,2cyclictest0-21swapper/108:00:171
2066399110,2cyclictest0-21swapper/108:55:141
2066399110,10cyclictest30546-21grep08:35:221
2066399110,10cyclictest0-21swapper/109:00:161
2066399110,10cyclictest0-21swapper/108:30:131
2066399110,10cyclictest0-21swapper/108:10:141
2066399110,10cyclictest0-21swapper/107:45:231
2066399110,10cyclictest0-21swapper/107:35:111
2066299119,1cyclictest0-21swapper/007:30:160
2066299119,1cyclictest0-21swapper/007:25:270
2066299116,4cyclictest0-21swapper/007:40:200
2066299110,2cyclictest0-21swapper/008:10:150
2066299110,10cyclictest32337-21fschecks_time08:40:190
2066599108,1cyclictest20687-21apache_volume07:10:133
2066599100,9cyclictest22241-21apache_processe08:20:133
2066599100,9cyclictest19863-21apache_volume08:15:133
2066599100,9cyclictest17927-21diskstats08:10:153
2066599100,9cyclictest11675-21diskstats09:05:173
2066599100,9cyclictest0-21swapper/308:35:143
2066599100,1cyclictest8319-21cstates07:50:153
2066599100,1cyclictest24499-21fschecks_time07:15:163
2066599100,1cyclictest24499-21fschecks_time07:15:163
2066499100,9cyclictest11417-21ls07:55:212
2066399108,1cyclictest8764-21smartctl07:50:171
2066399108,1cyclictest4086-21apache_volume08:50:121
2066399108,1cyclictest28826-21expr07:25:151
2066399100,1cyclictest5371-21latency_hist07:45:001
2066399100,1cyclictest16391-21ntp_states08:05:211
2066299109,1cyclictest0-21swapper/008:48:470
2066299100,9cyclictest23517-21ntp_states08:20:220
2066299100,9cyclictest15114-21apache_processe08:05:120
2066299100,9cyclictest0-21swapper/008:55:200
2066299100,9cyclictest0-21swapper/008:50:140
2066299100,9cyclictest0-21swapper/007:15:220
2066299100,9cyclictest0-21swapper/007:15:210
2066299100,9cyclictest0-21swapper/007:10:170
2066299100,7cyclictest0-21swapper/009:06:560
2066299100,1cyclictest26111-21ls08:25:250
2066299100,10cyclictest0-21swapper/007:35:070
206659996,2cyclictest0-21swapper/307:35:143
206649990,9cyclictest0-21swapper/208:05:182
206639970,6cyclictest0-21swapper/107:10:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional