You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-14 - 01:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Sat Sep 13, 2025 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
231742980,1sleep21507-21nfsd09:18:072
4682950,1sleep228-21rcuc/211:11:302
71922910,0sleep07193-21id10:00:050
198992870,1sleep019897-21sshd12:09:380
178392870,0sleep00-21swapper/012:11:500
29042800,23sleep3115950irq/25-eth009:22:383
37292680,4sleep00-21swapper/009:32:080
303662660,1sleep330365-21sshd09:25:143
680426527,34sleep10-21swapper/107:05:141
42492620,0sleep24241-21sshd10:21:462
883526026,20sleep20-21swapper/207:08:572
288502590,1sleep00-21swapper/010:18:030
202362580,1sleep21506-21nfsd12:36:242
188772570,1sleep30-21swapper/310:04:203
279772560,1sleep027976-21sshd09:52:310
27162560,1sleep21722-21runrttasks12:15:322
231652560,0sleep00-21swapper/010:51:490
157292560,1sleep30-21swapper/311:54:373
78412550,0sleep37804-21sshd11:09:103
5092550,4sleep1115950irq/25-eth012:00:451
298062550,0sleep20-21swapper/211:01:482
281242550,0sleep20-21swapper/209:12:342
234622550,1sleep023459-21bash12:24:320
863125426,24sleep00-21swapper/007:06:210
306002540,0sleep10-21swapper/109:31:371
19262540,0sleep20-21swapper/209:53:092
317872530,0sleep10-21swapper/109:15:511
867825226,9sleep30-21swapper/307:06:573
254652510,1sleep00-21swapper/012:27:040
19652510,1sleep11964-21bash12:27:441
83672500,0sleep30-21swapper/311:58:593
137052500,0sleep013704-21sshd12:35:540
7412490,1sleep0738-21bash11:05:230
227142490,0sleep10-21swapper/111:13:341
43792470,0sleep10-21swapper/111:58:411
232172470,0sleep38-21rcu_preempt12:05:003
115882470,0sleep30-21swapper/311:44:003
105112470,0sleep20-21swapper/211:24:442
201002430,1sleep11722-21runrttasks11:41:421
34792390,0sleep00-21swapper/009:25:390
305612380,0sleep10-21swapper/111:50:481
284432360,0sleep00-21swapper/009:12:370
245572290,0sleep224558-21sshd09:58:382
203282250,0sleep320327-21sshd11:13:193
31572230,1sleep10-21swapper/110:46:541
9184992220,1cyclictest0-21swapper/312:21:083
9182992220,1cyclictest16016-21sshd11:06:521
9183992119,1cyclictest0-21swapper/210:56:372
9183992115,5cyclictest0-21swapper/212:11:482
9182992119,1cyclictest7797-21sshd09:13:441
918499200,19cyclictest115950irq/25-eth010:06:193
918399204,6cyclictest7659-21cp12:30:332
918399192,1cyclictest115950irq/25-eth012:28:442
918399191,1cyclictest12050irq/23-ehci_hcd10:26:262
918399190,1cyclictest13153-21bash12:06:352
110582190,0sleep11722-21runrttasks12:16:111
94252180,1sleep19402-21sshd11:21:391
918499185,12cyclictest39-21ksoftirqd/309:44:543
9184991817,1cyclictest10073-21sshd12:33:143
918399188,5cyclictest0-21swapper/210:32:102
918399181,1cyclictest0-21swapper/211:58:372
918399180,1cyclictest115950irq/25-eth011:09:002
918399180,1cyclictest0-21swapper/211:28:492
918399180,17cyclictest14049-21bash10:07:092
304092180,0sleep010-21rcuc/011:48:220
236892180,0sleep01895-21diskmemload11:13:410
918499177,3cyclictest39-21ksoftirqd/311:32:043
918399178,8cyclictest20802-21sshd09:45:502
918399171,1cyclictest15633-21sshd09:33:162
918399170,1cyclictest4619-21sshd10:40:452
918399170,1cyclictest19440-21sshd11:52:262
918399170,1cyclictest0-21swapper/212:20:202
918399170,16cyclictest0-21swapper/211:32:302
9182991715,1cyclictest19226-21sshd12:09:331
9182991715,1cyclictest14490-21sshd10:07:121
220182170,1sleep021990-21sshd10:11:140
150182170,0sleep315021-21sshd10:10:333
9184991614,1cyclictest39-21ksoftirqd/312:11:223
9184991614,1cyclictest39-21ksoftirqd/311:23:113
9184991614,1cyclictest39-21ksoftirqd/310:35:013
9184991613,2cyclictest39-21ksoftirqd/310:45:263
918499160,1cyclictest39-21ksoftirqd/310:23:043
918499160,1cyclictest29492-21sshd11:17:243
918399168,7cyclictest0-21swapper/210:10:262
918399161,2cyclictest0-21swapper/207:15:022
918399161,1cyclictest0-21swapper/210:50:392
918399161,1cyclictest0-21swapper/209:21:142
918399160,2cyclictest0-21swapper/211:35:272
918399160,2cyclictest0-21swapper/210:02:252
918399160,1cyclictest7412-21sshd10:47:172
918399160,1cyclictest23267-21sshd11:47:432
918399160,1cyclictest1526-21id12:03:182
918399160,1cyclictest0-21swapper/211:17:302
918399160,1cyclictest0-21swapper/209:35:272
918399160,15cyclictest31381-21id10:15:112
918399160,15cyclictest0-21swapper/210:35:192
918199160,1cyclictest1591-21sshd10:32:290
918199160,12cyclictest9637-21sshd09:35:350
251422160,0sleep10-21swapper/112:36:461
211072160,6sleep339-21ksoftirqd/309:30:393
195562160,2sleep1918299cyclictest09:57:571
918499156,1cyclictest39-21ksoftirqd/312:39:113
918499155,9cyclictest39-21ksoftirqd/311:45:243
9184991514,1cyclictest39-21ksoftirqd/309:12:413
9184991513,1cyclictest39-21ksoftirqd/309:52:293
9184991513,1cyclictest39-21ksoftirqd/309:46:483
9184991513,1cyclictest39-21ksoftirqd/309:16:313
9184991513,1cyclictest37-21rcuc/312:19:233
918499150,4cyclictest9305-21sshd10:56:573
918499150,13cyclictest1591-21sshd09:36:463
918399158,6cyclictest28896-21apache_volume07:50:132
918399151,1cyclictest115950irq/25-eth009:40:062
918399150,9cyclictest22221-21diskstats07:35:152
918399150,2cyclictest0-21swapper/208:30:212
918399150,1cyclictest18973-21sshd11:41:352
918399150,1cyclictest1507-21nfsd09:25:012
918399150,14cyclictest9456-21tr07:10:142
918299159,5cyclictest0-21swapper/110:11:421
918299150,14cyclictest0-21swapper/111:33:391
918199159,5cyclictest0-21swapper/009:48:050
918199159,3cyclictest0-21swapper/011:22:010
918199158,4cyclictest25340-21sshd11:26:050
918199158,4cyclictest0-21swapper/012:00:590
9181991513,1cyclictest0-21swapper/009:55:120
9181991511,3cyclictest20194-21sshd11:55:000
918199151,13cyclictest0-21swapper/010:09:470
918499148,2cyclictest39-21ksoftirqd/310:15:033
918499148,1cyclictest39-21ksoftirqd/310:51:193
918499145,1cyclictest39-21ksoftirqd/310:41:103
918499145,1cyclictest39-21ksoftirqd/310:30:163
918499141,2cyclictest0-21swapper/309:56:043
9184991412,1cyclictest39-21ksoftirqd/311:00:303
9184991412,1cyclictest21860-21sshd11:38:223
918499140,1cyclictest0-21swapper/311:26:393
918399148,5cyclictest30505-21fschecks_time09:00:182
918399140,9cyclictest0-21swapper/207:55:012
918399140,1cyclictest26288-21ntp_states08:50:222
918399140,1cyclictest21594-21ntp_states08:40:532
918399140,1cyclictest0-21swapper/207:45:252
918299149,2cyclictest16174-21sshd10:04:051
918299148,2cyclictest0-21swapper/112:21:011
9182991412,1cyclictest26203-21sshd11:45:171
918299140,1cyclictest0-21swapper/110:40:461
918299140,13cyclictest21341-21sshd09:51:551
918299140,13cyclictest0-21swapper/111:15:301
918299140,13cyclictest0-21swapper/110:59:591
918199149,4cyclictest0-21swapper/007:41:110
918199140,2cyclictest0-21swapper/010:20:480
918199140,13cyclictest0-21swapper/011:43:430
918199140,13cyclictest0-21swapper/009:15:520
918199140,11cyclictest0-21swapper/010:25:420
47402140,0sleep00-21swapper/012:32:490
918499135,4cyclictest39-21ksoftirqd/310:25:153
9184991311,1cyclictest39-21ksoftirqd/312:25:043
918499130,12cyclictest15921-21ntp_states07:20:223
918399135,7cyclictest32286-21munin-node09:05:132
918399130,9cyclictest19380-21latency_hist07:30:012
918299139,1cyclictest0-21swapper/109:42:281
918299137,5cyclictest0-21swapper/110:36:221
918299133,9cyclictest3458-21sshd10:21:421
918299131,1cyclictest115950irq/25-eth009:45:411
9182991311,1cyclictest29280-21sshd11:26:351
918299131,11cyclictest0-21swapper/110:25:141
918299130,2cyclictest0-21swapper/112:34:021
918299130,12cyclictest5356-21bash09:22:521
918299130,12cyclictest23394-21sshd09:36:521
918299130,12cyclictest19707-21sshd09:27:111
918299130,12cyclictest0-21swapper/110:33:431
918299130,12cyclictest0-21swapper/110:15:261
918299130,10cyclictest16769-21sshd11:37:541
918199139,3cyclictest0-21swapper/009:05:130
918199138,3cyclictest0-21swapper/011:56:520
918199138,3cyclictest0-21swapper/011:30:180
918199138,2cyclictest12961-21sshd09:42:020
918199131,1cyclictest0-21swapper/010:58:570
9181991311,1cyclictest0-21swapper/010:44:130
9181991310,1cyclictest0-21swapper/011:38:230
918199130,4cyclictest8002-21bash12:18:280
918199130,12cyclictest28301-21bash10:46:040
918199130,12cyclictest1507-21nfsd11:16:420
918199130,12cyclictest0-21swapper/011:00:210
243382130,0sleep324333-21sshd12:07:283
918499129,2cyclictest0-21swapper/308:05:243
918499121,10cyclictest0-21swapper/308:50:143
918499121,10cyclictest0-21swapper/308:45:163
918499121,10cyclictest0-21swapper/308:25:153
918499121,10cyclictest0-21swapper/307:35:133
9184991210,1cyclictest39-21ksoftirqd/307:15:023
918399129,2cyclictest0-21swapper/208:35:122
918399129,2cyclictest0-21swapper/208:15:162
918399128,4cyclictest15721-21ls07:20:202
918399121,2cyclictest0-21swapper/208:55:222
918399121,1cyclictest0-21swapper/208:05:212
9183991210,1cyclictest0-21swapper/207:30:152
918399120,1cyclictest23268-21tune2fs08:45:152
918299129,2cyclictest0-21swapper/108:45:121
918299128,1cyclictest0-21swapper/111:00:361
918299128,1cyclictest0-21swapper/110:51:001
918299121,10cyclictest0-21swapper/108:40:561
918299121,10cyclictest0-21swapper/108:35:121
918299121,10cyclictest0-21swapper/108:05:141
918299121,10cyclictest0-21swapper/108:00:301
918299120,11cyclictest0-21swapper/112:13:181
918299120,11cyclictest0-21swapper/108:10:121
918299120,11cyclictest0-21swapper/107:55:211
918299120,11cyclictest0-21swapper/107:25:141
918199129,2cyclictest0-21swapper/008:00:310
918199128,3cyclictest0-21swapper/008:45:160
918199128,3cyclictest0-21swapper/008:15:130
918199121,2cyclictest0-21swapper/007:10:200
918199121,10cyclictest0-21swapper/007:55:120
918199120,1cyclictest0-21swapper/010:37:150
918199120,11cyclictest0-21swapper/009:20:260
918199120,11cyclictest0-21swapper/009:00:180
918199120,11cyclictest0-21swapper/007:50:120
918499118,2cyclictest0-21swapper/308:30:123
918499118,2cyclictest0-21swapper/307:30:133
918499118,2cyclictest0-21swapper/307:25:133
918499111,1cyclictest0-21swapper/307:55:153
918499110,2cyclictest0-21swapper/308:10:113
918499110,10cyclictest0-21swapper/309:00:193
918499110,10cyclictest0-21swapper/308:20:123
918499110,10cyclictest0-21swapper/308:00:133
918499110,10cyclictest0-21swapper/307:52:233
918499110,10cyclictest0-21swapper/307:45:153
918499110,10cyclictest0-21swapper/307:40:143
918499110,10cyclictest0-21swapper/307:10:153
918399118,3cyclictest7108-21strings08:10:192
918399118,2cyclictest0-21swapper/208:20:132
918399117,4cyclictest0-21swapper/208:00:142
918399110,10cyclictest0-21swapper/207:40:142
918299119,1cyclictest0-21swapper/108:55:181
918299119,1cyclictest0-21swapper/108:25:171
918299118,3cyclictest0-21swapper/107:20:241
918299118,2cyclictest0-21swapper/107:50:161
918299118,2cyclictest0-21swapper/107:40:161
918299118,2cyclictest0-21swapper/107:30:151
918299110,9cyclictest0-21swapper/108:30:161
918299110,2cyclictest0-21swapper/107:10:151
918299110,11cyclictest0-21swapper/107:35:411
918299110,10cyclictest976-21ntp_states09:05:211
918299110,10cyclictest0-21swapper/108:20:131
918299110,10cyclictest0-21swapper/107:45:171
918199119,1cyclictest14402-21ntp_states08:25:220
918199119,1cyclictest0-21swapper/007:25:230
918199112,5cyclictest14426-21awk07:20:000
918199110,2cyclictest0-21swapper/008:55:170
918199110,2cyclictest0-21swapper/008:40:480
918199110,2cyclictest0-21swapper/008:10:130
918199110,2cyclictest0-21swapper/008:05:160
918199110,10cyclictest11453-21perl08:20:150
918199110,10cyclictest0-21swapper/007:45:130
918199110,10cyclictest0-21swapper/007:35:120
918199110,10cyclictest0-21swapper/007:30:190
918499108,2cyclictest0-21swapper/308:40:523
918499108,1cyclictest0-21swapper/309:05:143
918499100,1cyclictest8817-21diskstats08:15:153
918499100,1cyclictest0-21swapper/308:35:203
918399108,1cyclictest0-21swapper/208:25:142
918299100,9cyclictest0-21swapper/108:50:151
918299100,1cyclictest30567-21smartctl09:00:191
918299100,1cyclictest11948-21memory07:15:011
918299100,10cyclictest0-21swapper/108:18:001
918199100,9cyclictest25013-21apache_volume08:50:140
918199100,9cyclictest15771-21nfsd407:20:200
918199100,9cyclictest0-21swapper/008:35:300
918199100,9cyclictest0-21swapper/008:30:170
91849998,1cyclictest0-21swapper/308:55:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional