You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-22 - 06:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackaslot0.osadl.org (updated Fri Jun 21, 2024 12:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
360921060,0sleep13606-21cp09:17:261
134912920,1sleep20-21swapper/211:17:462
110612920,0sleep10-21swapper/111:04:361
251002640,0sleep025082-21sshd09:26:580
248042630,1sleep21784-21runrttasks12:26:452
216432620,0sleep30-21swapper/311:57:423
152002600,0sleep00-21swapper/011:56:580
56332590,1sleep20-21swapper/211:52:532
280892590,0sleep30-21swapper/310:11:163
136542590,0sleep00-21swapper/012:03:230
36622580,1sleep13661-21sshd10:08:551
300432580,1sleep222607-21diskmemload11:55:132
127862570,1sleep312781-21sshd10:50:433
236632560,0sleep223661-21sshd11:12:252
202112560,1sleep020196-21sshd11:41:160
311972540,0sleep20-21swapper/208:20:002
293862540,1sleep029355-21sshd11:06:180
2925925427,9sleep10-21swapper/107:06:341
131662540,1sleep113165-21bash11:24:181
127122540,0sleep31784-21runrttasks12:08:553
61702530,0sleep16167-21cp11:46:221
198272530,1sleep219814-21sshd12:23:332
88322510,1sleep18834-21nfsd407:30:241
67302510,5sleep30-21swapper/309:17:533
119672510,1sleep111937-21sshd12:31:171
31012500,0sleep13100-21sshd10:46:321
2919925029,18sleep30-21swapper/307:05:483
250012500,0sleep21784-21runrttasks10:03:542
238912500,0sleep10-21swapper/111:57:561
225972500,0sleep022607-21diskmemload10:34:460
14482500,0sleep01447-21sshd09:44:290
66812490,0sleep20-21swapper/210:46:582
61452490,0sleep322607-21diskmemload09:41:283
31972490,0sleep20-21swapper/210:22:212
2741924926,18sleep20-21swapper/207:05:152
25092490,1sleep122607-21diskmemload09:57:531
72322480,0sleep30-21swapper/309:58:223
2740324825,19sleep00-21swapper/007:05:090
248122480,1sleep21784-21runrttasks09:33:342
235142480,0sleep20-21swapper/211:28:282
296652470,0sleep30-21swapper/310:45:503
190242470,1sleep319025-21sshd09:32:593
133082470,1sleep31784-21runrttasks11:14:433
319322460,0sleep20-21swapper/210:35:512
274852460,0sleep10-21swapper/111:28:511
265012440,0sleep30-21swapper/310:17:453
322872430,0sleep30-21swapper/311:35:513
46812340,0sleep04683-21id10:05:130
71372230,1sleep10-21swapper/110:43:441
232802230,1sleep11784-21runrttasks08:00:311
29794992220,1cyclictest31831-21sshd10:52:451
2979699210,20cyclictest0-21swapper/309:36:043
2979599200,1cyclictest22094-21sshd12:12:302
2979599200,19cyclictest0-21swapper/210:33:182
2979399200,19cyclictest24780-21tr11:25:230
323082180,1sleep132263-21sshd11:06:401
29796991817,1cyclictest0-21swapper/310:00:363
22402180,0sleep10-21swapper/109:31:121
155002180,0sleep30-21swapper/311:44:113
130262180,1sleep11784-21runrttasks12:39:581
84742170,0sleep30-21swapper/311:00:563
29796991715,1cyclictest0-21swapper/312:17:303
29793991715,1cyclictest14881-21sshd11:47:160
50952160,1sleep25079-21sshd09:38:032
2979599160,1cyclictest0-21swapper/210:40:202
2979499160,15cyclictest0-21swapper/109:28:431
2979399160,10cyclictest0-21swapper/010:43:270
296902160,1sleep38-21rcu_preempt10:31:573
29795991513,1cyclictest30-21ksoftirqd/212:00:382
29795991513,1cyclictest0-21swapper/210:10:402
2979599151,12cyclictest0-21swapper/210:29:492
29794991513,1cyclictest3040-21sshd09:20:521
2979499150,14cyclictest16371-21sshd12:17:381
2979399159,3cyclictest0-21swapper/010:56:240
2979399158,4cyclictest14551-21bash10:54:210
2979399155,4cyclictest0-21swapper/007:56:000
2979399151,13cyclictest0-21swapper/012:15:040
2979399150,12cyclictest0-21swapper/009:34:390
221782150,1sleep10-21swapper/112:09:461
196122150,1sleep10-21swapper/110:03:181
2979699149,2cyclictest14881-21sshd09:22:143
2979699149,2cyclictest0-21swapper/311:17:413
29796991412,1cyclictest10994-21sshd10:40:463
29796991412,1cyclictest0-21swapper/312:25:313
2979699140,5cyclictest8372-21sshd12:33:533
2979699140,13cyclictest30504-21sshd12:35:403
2979699140,13cyclictest0-21swapper/312:04:063
2979699140,13cyclictest0-21swapper/309:46:523
2979599142,1cyclictest120050irq/25-eth009:53:252
29795991412,1cyclictest30-21ksoftirqd/209:18:132
2979499149,4cyclictest25032-21bash11:51:291
2979499149,2cyclictest0-21swapper/112:20:451
2979499149,2cyclictest0-21swapper/109:48:551
29794991413,1cyclictest0-21swapper/109:50:351
29794991411,2cyclictest18100-21sshd10:58:081
2979499141,12cyclictest14204-21cp12:11:501
2979499140,8cyclictest0-21swapper/109:05:521
2979499140,13cyclictest0-21swapper/110:18:371
2979399149,4cyclictest0-21swapper/010:13:040
2979399149,1cyclictest0-21swapper/011:54:530
2979399148,4cyclictest22695-21sshd10:21:010
2979399142,1cyclictest0-21swapper/010:26:320
2979399141,3cyclictest7427-21sshd09:45:050
29793991410,1cyclictest0-21swapper/011:30:320
2979399140,3cyclictest0-21swapper/011:01:380
2979399140,3cyclictest0-21swapper/010:38:000
2979399140,3cyclictest0-21swapper/010:04:420
2979399140,2cyclictest32052-21sshd10:15:110
2979399140,13cyclictest20706-21bash10:45:040
2979399140,13cyclictest1547-21nfsd12:12:370
2979399140,13cyclictest0-21swapper/012:05:420
2979399140,13cyclictest0-21swapper/009:10:060
2979399140,12cyclictest9005-21sshd09:35:130
2979399140,11cyclictest0-21swapper/009:23:390
182072140,0sleep00-21swapper/011:37:550
158302140,0sleep10-21swapper/110:34:021
140962140,0sleep10-21swapper/109:12:141
2979699139,1cyclictest0-21swapper/312:14:503
2979699138,2cyclictest21059-21sshd10:55:003
2979699137,5cyclictest0-21swapper/309:54:173
2979699131,1cyclictest29589-21sshd11:25:453
2979699131,1cyclictest120050irq/25-eth009:25:063
2979699130,4cyclictest5397-21bash11:23:293
2979699130,2cyclictest0-21swapper/312:24:233
2979699130,2cyclictest0-21swapper/311:47:243
2979699130,12cyclictest23958-21sshd11:09:133
2979699130,12cyclictest23717-21sshd11:51:213
2979699130,12cyclictest0-21swapper/310:05:023
2979699130,10cyclictest6641-21sshd10:36:473
2979599139,1cyclictest0-21swapper/212:31:422
2979599139,1cyclictest0-21swapper/209:12:512
2979599138,4cyclictest0-21swapper/210:55:462
29795991312,1cyclictest30-21ksoftirqd/209:55:402
2979599131,1cyclictest10250irq/24-ahci[00011:33:342
29795991311,1cyclictest30-21ksoftirqd/211:06:192
29795991311,1cyclictest30-21ksoftirqd/209:46:092
2979599130,4cyclictest0-21swapper/211:23:432
2979599130,12cyclictest3105-21bash09:20:532
2979599130,12cyclictest22607-21diskmemload11:03:082
2979599130,12cyclictest0-21swapper/211:48:272
2979599130,12cyclictest0-21swapper/211:35:172
2979599130,12cyclictest0-21swapper/209:40:132
2979599130,10cyclictest0-21swapper/211:44:532
2979499139,3cyclictest25978-21sshd09:36:531
2979499139,1cyclictest0-21swapper/110:29:281
2979499138,4cyclictest18846-21ls10:10:231
2979499138,2cyclictest0-21swapper/112:27:011
2979499131,9cyclictest120050irq/25-eth011:35:131
2979499131,11cyclictest0-21swapper/110:20:301
2979499131,11cyclictest0-21swapper/109:41:411
2979499130,4cyclictest0-21swapper/111:16:091
2979499130,12cyclictest32579-21sshd10:35:551
2979499130,12cyclictest17829-21sshd11:30:581
2979499130,12cyclictest0-21swapper/111:42:101
2979499130,10cyclictest0-21swapper/111:11:351
2979399139,3cyclictest20078-21sshd12:26:200
2979399139,3cyclictest0-21swapper/009:51:050
2979399138,3cyclictest10142-21sshd11:11:050
2979399138,2cyclictest27232-21sshd11:15:560
2979399137,3cyclictest0-21swapper/012:38:550
2979399131,1cyclictest0-21swapper/012:30:130
2979399130,12cyclictest30262-21sshd12:21:350
2979399130,12cyclictest25478-21sshd11:22:060
2979399130,12cyclictest0-21swapper/009:56:060
28022130,0sleep00-21swapper/009:17:220
213302130,1sleep221328-21sshd12:15:152
173172130,0sleep30-21swapper/310:23:503
2979699127,4cyclictest22607-21diskmemload11:31:303
2979699123,8cyclictest0-21swapper/307:34:303
2979699121,9cyclictest10250irq/24-ahci[00009:11:553
2979699120,12cyclictest0-21swapper/310:26:243
2979599129,2cyclictest0-21swapper/210:05:172
2979599129,2cyclictest0-21swapper/209:25:062
2979599121,2cyclictest0-21swapper/212:35:112
2979599121,2cyclictest0-21swapper/212:05:072
2979599121,10cyclictest0-21swapper/210:50:152
29795991210,1cyclictest31384-21sshd10:15:052
2979499129,2cyclictest0-21swapper/112:00:161
2979499120,8cyclictest0-21swapper/107:38:501
2979699119,1cyclictest0-21swapper/307:15:013
2979599118,2cyclictest0-21swapper/207:15:022
2979599110,11cyclictest0-21swapper/208:41:322
2979599110,11cyclictest0-21swapper/208:02:592
2979599110,11cyclictest0-21swapper/207:45:252
2979599110,10cyclictest0-21swapper/209:07:472
2979499119,1cyclictest0-21swapper/107:15:031
2979399110,1cyclictest0-21swapper/008:15:180
2979399110,10cyclictest0-21swapper/007:15:010
2979699109,1cyclictest0-21swapper/307:39:063
2979699100,9cyclictest22619-21munin-run09:10:003
2979699100,9cyclictest0-21swapper/307:12:303
2979699100,10cyclictest0-21swapper/307:28:373
2979599109,1cyclictest0-21swapper/208:27:082
2979599109,1cyclictest0-21swapper/208:22:222
2979599109,1cyclictest0-21swapper/208:12:512
2979599109,1cyclictest0-21swapper/208:08:052
2979599109,1cyclictest0-21swapper/207:57:382
2979599109,1cyclictest0-21swapper/207:14:112
29795991010,0cyclictest0-21swapper/209:00:142
2979599100,1cyclictest0-21swapper/208:36:472
2979599100,10cyclictest0-21swapper/207:52:242
2979499103,7cyclictest0-21swapper/109:03:281
2979499100,6cyclictest0-21swapper/108:45:521
2979499100,10cyclictest0-21swapper/108:25:111
2979399109,1cyclictest0-21swapper/008:20:310
2979399109,1cyclictest0-21swapper/007:52:120
2979399100,9cyclictest0-21swapper/008:35:130
2979399100,9cyclictest0-21swapper/008:09:580
297969999,0cyclictest0-21swapper/307:55:213
297969998,1cyclictest0-21swapper/309:00:103
297969998,1cyclictest0-21swapper/308:01:103
297969998,1cyclictest0-21swapper/307:48:303
297969990,8cyclictest0-21swapper/308:44:223
297969990,8cyclictest0-21swapper/308:39:153
297969990,1cyclictest0-21swapper/308:07:053
297959998,1cyclictest0-21swapper/208:52:552
297959998,1cyclictest0-21swapper/208:31:542
297949990,5cyclictest0-21swapper/107:20:321
297939998,1cyclictest0-21swapper/009:06:110
297939998,1cyclictest0-21swapper/008:54:130
297939998,1cyclictest0-21swapper/008:25:460
297939990,9cyclictest0-21swapper/008:31:130
297939990,7cyclictest19409-21rt-features09:00:310
297939990,6cyclictest0-21swapper/007:27:450
297939990,1cyclictest0-21swapper/007:21:460
297939990,0cyclictest0-21swapper/008:46:260
297969987,1cyclictest0-21swapper/308:28:273
297969981,6cyclictest0-21swapper/308:55:133
297969981,6cyclictest0-21swapper/308:50:313
297969981,6cyclictest0-21swapper/308:20:143
297969981,6cyclictest0-21swapper/308:15:263
297969981,6cyclictest0-21swapper/307:20:173
297959988,0cyclictest0-21swapper/207:28:222
297959981,6cyclictest0-21swapper/207:35:132
297959981,6cyclictest0-21swapper/207:20:192
297949987,1cyclictest0-21swapper/108:44:071
297949987,1cyclictest0-21swapper/108:31:281
297949981,6cyclictest0-21swapper/108:20:191
297949981,6cyclictest0-21swapper/107:25:151
297949980,8cyclictest0-21swapper/108:50:041
297949980,5cyclictest0-21swapper/108:56:461
297949980,5cyclictest0-21swapper/107:42:481
297949980,4cyclictest0-21swapper/108:09:371
297939988,0cyclictest0-21swapper/007:11:310
297939981,6cyclictest0-21swapper/008:55:150
297939980,8cyclictest0-21swapper/008:42:090
297939980,7cyclictest0-21swapper/007:35:100
297939980,6cyclictest0-21swapper/007:40:130
297939980,5cyclictest0-21swapper/008:03:300
297969975,1cyclictest17324-21munin-node07:50:133
297969971,5cyclictest0-21swapper/308:10:323
297969971,5cyclictest0-21swapper/307:40:103
297969970,6cyclictest0-21swapper/308:45:183
297969970,6cyclictest0-21swapper/308:30:263
297959971,6cyclictest0-21swapper/208:55:232
297959970,6cyclictest0-21swapper/208:45:132
297959970,6cyclictest0-21swapper/207:40:142
297959970,6cyclictest0-21swapper/207:30:132
297949975,1cyclictest31127-21chrt07:10:301
297949970,6cyclictest20416-21ipmitool07:55:211
297949970,6cyclictest0-21swapper/108:15:451
297949970,6cyclictest0-21swapper/107:45:351
297949970,4cyclictest0-21swapper/108:36:521
297949970,4cyclictest0-21swapper/108:13:361
297949970,4cyclictest0-21swapper/107:54:201
297939970,6cyclictest0-21swapper/008:10:170
297939970,6cyclictest0-21swapper/007:30:120
297939960,1cyclictest0-21swapper/007:45:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional