You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-27 - 02:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackaslot0.osadl.org (updated Mon Feb 26, 2024 12:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1250221010,1sleep112501-21sshd11:01:201
254652970,1sleep339-21ksoftirqd/309:58:363
5362870,0sleep17754-21diskmemload10:02:061
134532650,1sleep113455-21bash11:35:551
303082630,1sleep10-21swapper/109:32:131
229802570,2sleep010-21rcuc/010:21:280
324982550,0sleep132486-21sshd12:15:121
295202540,0sleep10-21swapper/110:27:511
177912540,5sleep230-21ksoftirqd/209:43:042
243302530,0sleep224316-21sshd11:31:422
242702520,2sleep00-21swapper/011:05:240
201102520,0sleep00-21swapper/009:25:190
124842520,1sleep012482-21bash09:36:250
38512510,0sleep00-21swapper/009:12:220
143102510,1sleep214281-21sshd09:10:272
263792500,0sleep30-21swapper/311:39:323
144842500,1sleep20-21swapper/211:38:352
1425925028,18sleep20-21swapper/207:05:432
89832490,0sleep20-21swapper/211:40:352
314252490,0sleep00-21swapper/012:20:080
184332490,0sleep018428-21sshd11:46:230
1433724927,19sleep10-21swapper/107:06:431
109382490,1sleep210934-21sshd09:30:232
76602480,0sleep30-21swapper/310:23:043
264762480,1sleep27754-21diskmemload10:04:312
1459724825,19sleep00-21swapper/007:09:540
1328324823,21sleep30-21swapper/307:05:313
261272460,0sleep226123-21sshd12:24:472
221692450,0sleep30-21swapper/309:22:353
103982450,0sleep30-21swapper/310:49:203
201312410,0sleep30-21swapper/311:07:553
82912370,0sleep30-21swapper/311:58:123
186382360,0sleep018634-21rm11:41:220
207542260,0sleep07754-21diskmemload11:13:210
123772260,0sleep212378-21id10:35:012
140982240,0sleep014082-21sshd12:06:100
240872230,0sleep00-21swapper/011:39:210
11122230,1sleep20-21swapper/211:00:252
14864992220,1cyclictest12578-21sshd10:46:321
14866992116,4cyclictest17592-21sshd11:15:413
14865992119,1cyclictest0-21swapper/211:59:012
14864992119,1cyclictest23843-21sshd12:11:581
14863992120,1cyclictest8587-21sshd09:21:230
102982210,1sleep310280-21sshd10:08:543
14866992018,1cyclictest0-21swapper/310:18:523
14864992018,1cyclictest31088-21sshd09:26:121
14864992018,1cyclictest10860-21sshd11:48:211
324302190,1sleep332397-21sshd11:11:363
257742190,0sleep125765-21sshd09:37:551
153442190,1sleep215342-21sshd09:36:442
14866991917,1cyclictest0-21swapper/311:32:023
1486699191,10cyclictest39-21ksoftirqd/312:25:153
325062180,0sleep132500-21cp12:00:061
321912180,0sleep20-21swapper/209:23:342
14865991817,1cyclictest0-21swapper/211:50:152
72062170,0sleep27195-21sshd12:18:142
242142170,1sleep124209-21apache_accesses09:55:221
175162170,1sleep10-21swapper/111:56:211
1486699175,1cyclictest39-21ksoftirqd/310:38:013
1486699170,3cyclictest16163-21sshd12:01:163
14864991715,1cyclictest11370-21sshd11:25:371
126952170,1sleep012700-21bash12:38:470
86622160,0sleep20-21swapper/210:20:192
316532160,0sleep00-21swapper/012:30:140
17172160,1sleep01695-21sshd11:57:400
1486699166,2cyclictest120050irq/25-eth012:06:483
1486699161,3cyclictest362-21sshd10:57:293
1486699160,2cyclictest9554-21sshd09:36:083
14865991614,1cyclictest3679-21sshd12:12:572
1486399169,2cyclictest0-21swapper/010:41:330
1486399160,15cyclictest0-21swapper/009:54:480
185062150,0sleep00-21swapper/009:45:580
168842150,0sleep10-21swapper/112:26:301
164792150,1sleep016474-21sshd09:42:540
1486699158,3cyclictest12751-21sshd09:42:343
14866991513,1cyclictest381ktimersoftd/309:27:523
1486699150,1cyclictest0-21swapper/312:34:223
1486599155,1cyclictest30-21ksoftirqd/212:00:182
14865991514,1cyclictest0-21swapper/212:34:472
14865991514,1cyclictest0-21swapper/209:46:322
1486499159,1cyclictest0-21swapper/110:11:291
1486499158,2cyclictest0-21swapper/110:20:391
1486499155,6cyclictest0-21swapper/111:19:231
14864991513,1cyclictest29760-21sshd11:52:181
14864991511,1cyclictest127950irq/26-eth1-rx-09:44:451
1486499150,10cyclictest0-21swapper/112:06:551
1486399158,4cyclictest0-21swapper/010:25:040
1486399157,5cyclictest0-21swapper/010:08:260
14863991513,1cyclictest0-21swapper/010:16:100
1486399150,13cyclictest0-21swapper/010:58:080
133322150,0sleep041ktimersoftd/011:15:250
106282150,0sleep10-21swapper/111:09:531
3822140,1sleep21784-21runrttasks10:08:002
257842140,1sleep20-21swapper/211:11:032
1486699149,4cyclictest0-21swapper/310:33:413
1486699144,9cyclictest39-21ksoftirqd/310:41:593
1486699143,9cyclictest120050irq/25-eth011:04:573
1486699143,5cyclictest5741-21bash11:25:183
1486699143,3cyclictest7310-21strings12:10:423
14866991413,1cyclictest39-21ksoftirqd/311:40:513
1486699141,1cyclictest9744-21sshd12:15:513
1486699140,13cyclictest381ktimersoftd/311:48:513
1486599149,2cyclictest0-21swapper/212:35:102
14865991412,1cyclictest30-21ksoftirqd/211:09:232
1486599140,13cyclictest0-21swapper/212:26:382
1486499148,1cyclictest0-21swapper/110:16:191
1486499143,4cyclictest30172-21id11:11:251
14864991412,1cyclictest3070-21sshd11:40:141
1486499140,2cyclictest0-21swapper/112:37:181
1486499140,1cyclictest0-21swapper/109:50:591
1486499140,13cyclictest0-21swapper/111:21:221
1486499140,13cyclictest0-21swapper/107:33:281
1486399148,3cyclictest0-21swapper/012:00:350
1486399148,3cyclictest0-21swapper/010:30:140
1486399148,3cyclictest0-21swapper/010:12:110
14863991412,1cyclictest8760-21sshd09:56:550
14863991412,1cyclictest0-21swapper/011:32:110
1486399140,3cyclictest0-21swapper/012:15:000
1486399140,3cyclictest0-21swapper/011:25:510
1486399140,3cyclictest0-21swapper/011:24:050
1486399140,13cyclictest18881-21sshd12:11:340
1486399140,11cyclictest14952-21sshd12:26:210
1486399140,11cyclictest0-21swapper/010:50:250
1486399140,11cyclictest0-21swapper/009:16:370
133632140,0sleep10-21swapper/110:40:401
133302140,1sleep20-21swapper/211:48:332
219762130,1sleep221973-21bash11:26:292
17872130,0sleep20-21swapper/209:29:352
1486699138,4cyclictest0-21swapper/312:35:203
1486699134,9cyclictest39-21ksoftirqd/311:50:193
1486699132,1cyclictest28852-21bash12:22:263
1486699132,1cyclictest25617-21cp10:50:363
1486699132,1cyclictest25452-21bash09:52:243
1486699132,1cyclictest18641-21sshd10:12:273
14866991312,1cyclictest39-21ksoftirqd/310:25:313
14866991312,1cyclictest39-21ksoftirqd/309:12:383
14866991311,1cyclictest8288-21sshd09:45:123
1486699131,11cyclictest10387-21sshd09:30:213
1486699130,1cyclictest15924-21id09:16:133
1486699130,12cyclictest9532-21sshd10:02:583
1486699130,12cyclictest13569-21sshd11:20:393
1486599138,4cyclictest5203-21sshd10:31:192
1486599138,2cyclictest23061-21sshd09:19:532
1486599138,2cyclictest12637-21sshd09:54:132
14865991312,1cyclictest30-21ksoftirqd/210:52:002
14865991312,1cyclictest30-21ksoftirqd/210:17:092
14865991311,1cyclictest14179-21sshd12:06:102
1486599131,11cyclictest0-21swapper/210:57:232
1486599130,12cyclictest2989-21sshd10:48:362
1486599130,12cyclictest26328-21sshd11:21:462
1486599130,12cyclictest18998-21sshd10:12:272
1486599130,12cyclictest0-21swapper/211:18:122
1486599130,12cyclictest0-21swapper/210:42:522
1486499139,3cyclictest0-21swapper/110:30:111
1486499139,1cyclictest0-21swapper/110:55:341
1486499138,1cyclictest0-21swapper/109:20:291
1486499136,2cyclictest22703-21bash12:21:561
1486499135,8cyclictest0-21swapper/108:55:271
1486499132,10cyclictest6906-21sshd11:30:251
1486499130,4cyclictest26346-21bash12:32:161
1486499130,12cyclictest5933-21sshd09:12:321
1486499130,12cyclictest22271-21sshd09:46:191
1486499130,12cyclictest22134-21sshd10:50:221
1486399139,3cyclictest0-21swapper/010:00:090
1486399131,11cyclictest0-21swapper/010:35:200
1486399130,12cyclictest0-21swapper/011:00:340
1486399130,12cyclictest0-21swapper/010:48:250
1486399130,11cyclictest13719-21sshd09:30:330
1486399130,11cyclictest0-21swapper/011:51:250
1486599126,5cyclictest12045-21bash10:29:082
14865991210,1cyclictest0-21swapper/209:55:502
1486499127,1cyclictest0-21swapper/110:38:551
1486499122,9cyclictest1632-21sshd09:15:161
1486499120,3cyclictest0-21swapper/110:05:221
1486499120,12cyclictest0-21swapper/108:18:391
1486499120,12cyclictest0-21swapper/107:40:541
1486499120,11cyclictest0-21swapper/107:25:221
1486499120,11cyclictest0-21swapper/107:21:031
1486399121,10cyclictest0-21swapper/007:15:010
1486399120,11cyclictest0-21swapper/008:45:250
1486699111,9cyclictest381ktimersoftd/307:15:013
14866991110,1cyclictest0-21swapper/307:27:073
1486699110,1cyclictest0-21swapper/308:06:083
1486499118,2cyclictest0-21swapper/107:15:011
1486499113,8cyclictest0-21swapper/107:48:151
1486499110,11cyclictest0-21swapper/108:36:251
1486499110,10cyclictest0-21swapper/107:55:271
1486699109,1cyclictest0-21swapper/308:49:213
1486699109,1cyclictest0-21swapper/308:19:233
1486699109,1cyclictest0-21swapper/308:12:463
1486699109,1cyclictest0-21swapper/307:58:353
1486699109,1cyclictest0-21swapper/307:41:313
1486699100,10cyclictest0-21swapper/309:03:243
1486699100,10cyclictest0-21swapper/308:36:413
1486599108,1cyclictest17628-21sensors_fan07:15:002
1486499103,7cyclictest0-21swapper/108:31:261
1486499102,8cyclictest0-21swapper/108:50:511
1486499102,8cyclictest0-21swapper/107:12:111
1486499102,3cyclictest127950irq/26-eth1-rx-08:25:361
1486499100,10cyclictest0-21swapper/108:20:241
1486499100,10cyclictest0-21swapper/107:35:141
1486399100,9cyclictest0-21swapper/008:02:070
1486399100,9cyclictest0-21swapper/007:45:220
1486399100,10cyclictest0-21swapper/007:39:550
148659998,1cyclictest0-21swapper/208:15:262
148659991,7cyclictest0-21swapper/207:20:272
148659990,6cyclictest0-21swapper/208:35:112
148649990,9cyclictest0-21swapper/108:42:431
148639991,7cyclictest0-21swapper/007:55:370
148639991,6cyclictest0-21swapper/008:10:090
148639990,7cyclictest0-21swapper/008:30:230
148639990,7cyclictest0-21swapper/008:20:250
148639990,7cyclictest0-21swapper/008:15:320
148639990,7cyclictest0-21swapper/008:05:230
148639990,1cyclictest3951-21users07:50:320
148639990,1cyclictest0-21swapper/008:25:240
148639990,1cyclictest0-21swapper/007:40:020
148669987,1cyclictest0-21swapper/308:56:053
148669981,6cyclictest0-21swapper/307:50:243
148669981,6cyclictest0-21swapper/307:20:383
148659982,6cyclictest0-21swapper/207:50:262
148659982,2cyclictest0-21swapper/208:55:292
148659981,5cyclictest0-21swapper/207:25:272
148659980,8cyclictest0-21swapper/208:05:542
148659980,7cyclictest0-21swapper/207:37:142
148659980,1cyclictest0-21swapper/209:09:412
148659980,1cyclictest0-21swapper/208:31:222
148649980,8cyclictest0-21swapper/108:45:171
148649980,7cyclictest3583-21fschecks_count09:00:211
148649980,7cyclictest0-21swapper/108:05:311
148639985,2cyclictest0-21swapper/009:00:170
148639984,2cyclictest0-21swapper/007:25:270
148639983,4cyclictest0-21swapper/007:20:290
148639982,3cyclictest31560-21hddtemp_smartct08:50:280
148639982,3cyclictest0-21swapper/007:10:320
148639980,7cyclictest0-21swapper/008:40:300
148639980,5cyclictest0-21swapper/008:55:270
148639980,2cyclictest0-21swapper/008:35:190
148669976,1cyclictest0-21swapper/308:24:443
148669975,1cyclictest26863-21users07:30:383
148669974,1cyclictest120050irq/25-eth009:10:013
148669971,5cyclictest0-21swapper/308:50:263
148669971,5cyclictest0-21swapper/308:30:253
148669970,7cyclictest0-21swapper/308:25:293
148669970,6cyclictest0-21swapper/308:40:193
148669970,6cyclictest0-21swapper/307:45:313
148669970,6cyclictest0-21swapper/307:35:263
148669970,6cyclictest0-21swapper/307:10:233
148669970,2cyclictest0-21swapper/308:00:193
148659976,1cyclictest0-21swapper/208:48:402
148659975,1cyclictest15337-21df_inode07:10:252
148659973,2cyclictest0-21swapper/209:00:232
148659970,7cyclictest0-21swapper/208:25:312
148659970,6cyclictest0-21swapper/208:20:242
148659970,6cyclictest0-21swapper/208:00:212
148659970,6cyclictest0-21swapper/207:45:222
148659970,6cyclictest0-21swapper/207:40:222
148659970,5cyclictest0-21swapper/208:10:242
148659970,3cyclictest0-21swapper/208:50:302
148649971,5cyclictest0-21swapper/108:10:241
148649970,7cyclictest0-21swapper/109:05:091
148649970,6cyclictest0-21swapper/108:00:241
148639970,6cyclictest0-21swapper/009:05:270
148639970,2cyclictest0-21swapper/007:35:000
148659965,1cyclictest30-21ksoftirqd/208:40:242
148659964,1cyclictest26127-21memory07:30:322
148659960,5cyclictest0-21swapper/207:55:232
148649960,5cyclictest0-21swapper/107:50:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional