You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 13:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Fri Apr 19, 2024 00:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1772921230,0sleep117713-21sshd22:24:171
161382980,1sleep119-21rcuc/122:52:381
152572980,1sleep22606-21diskmemload21:21:252
169692930,1sleep3979999cyclictest00:05:043
273162880,1sleep127299-21sshd23:03:481
231592880,1sleep01784-21runrttasks23:49:420
181432840,1sleep11784-21runrttasks21:50:491
181432840,1sleep11784-21runrttasks21:50:491
153602770,12sleep0120050irq/25-eth022:13:470
940026528,19sleep20-21swapper/219:08:162
182422650,0sleep30-21swapper/323:56:593
28012640,0sleep30-21swapper/322:49:003
934426226,18sleep00-21swapper/019:07:340
229192620,1sleep20-21swapper/223:08:312
230872610,1sleep31784-21runrttasks22:06:373
201682610,0sleep120169-21sshd23:15:551
206382600,0sleep31547-21nfsd22:03:563
112592600,0sleep10-21swapper/122:26:181
938425924,32sleep10-21swapper/119:08:031
131692590,1sleep213140-21sshd21:29:182
141212580,1sleep214115-21bash21:58:182
75102570,0sleep10-21swapper/123:07:161
57532570,0sleep15751-21bash21:25:561
28102570,1sleep22809-21sshd00:31:392
9562560,1sleep01784-21runrttasks22:33:150
51412560,0sleep35139-21sshd23:22:293
248982560,1sleep024881-21sshd23:57:330
139432560,1sleep313917-21sshd23:38:403
58722550,0sleep00-21swapper/022:59:340
919625432,18sleep30-21swapper/319:05:483
311482540,0sleep20-21swapper/200:03:272
181982540,0sleep318175-21sshd21:13:443
122562530,1sleep00-21swapper/023:41:010
298252520,1sleep329806-21sshd21:20:023
322992510,0sleep00-21swapper/022:38:240
239302510,0sleep121-21ksoftirqd/121:24:511
228502510,1sleep21784-21runrttasks00:39:332
58062500,1sleep010-21rcuc/000:23:120
30052500,1sleep23004-21sshd23:40:192
270282500,0sleep20-21swapper/221:14:282
266012500,0sleep010-21rcuc/021:43:450
239012500,0sleep10-21swapper/122:17:001
101502490,1sleep31784-21runrttasks22:57:183
65412480,0sleep20-21swapper/223:38:022
277802480,0sleep10-21swapper/123:47:281
99262470,0sleep10-21swapper/100:07:101
248632470,0sleep10-21swapper/100:36:391
136282470,0sleep10-21swapper/121:47:561
241632460,0sleep10-21swapper/121:35:301
127562460,0sleep00-21swapper/021:26:310
37002450,0sleep30-21swapper/323:32:393
143442450,0sleep20-21swapper/221:15:562
203862400,1sleep00-21swapper/021:53:400
203862400,1sleep00-21swapper/021:53:400
264812250,0sleep30-21swapper/322:53:293
9796992321,1cyclictest30957-21sshd23:06:330
73372230,1sleep22606-21diskmemload22:05:232
9797992220,1cyclictest31136-21sshd23:37:261
979799221,16cyclictest29943-21sshd22:58:541
9796992221,1cyclictest8509-21sshd21:10:240
39532210,6sleep03-21ksoftirqd/022:15:240
191162210,0sleep30-21swapper/300:18:543
123672200,1sleep212366-21bash23:30:412
117912200,0sleep119-21rcuc/122:34:071
979699190,1cyclictest29743-21sshd23:26:590
163922190,5sleep230-21ksoftirqd/200:13:122
159482190,1sleep115944-21sshd00:24:051
979799189,8cyclictest14472-21sshd00:32:461
979799189,8cyclictest120050irq/25-eth000:18:091
979799188,1cyclictest120050irq/25-eth023:34:521
979799188,1cyclictest0-21swapper/100:12:171
9797991812,5cyclictest0-21swapper/121:11:591
979799180,1cyclictest0-21swapper/122:45:451
979799180,1cyclictest0-21swapper/122:01:541
224782180,0sleep01784-21runrttasks00:39:310
201092180,0sleep220081-21sshd23:26:132
9798991714,2cyclictest305-21sshd22:25:242
979799179,7cyclictest0-21swapper/121:32:521
979799179,1cyclictest120050irq/25-eth000:28:531
979799178,6cyclictest0-21swapper/123:12:581
979799177,1cyclictest0-21swapper/122:43:221
979799177,1cyclictest0-21swapper/122:36:331
979799170,2cyclictest0-21swapper/120:15:121
979799170,16cyclictest8607-21ntp_states22:05:281
979699172,1cyclictest3770-21sshd21:23:090
9796991715,1cyclictest3-21ksoftirqd/000:32:550
9796991713,3cyclictest3-21ksoftirqd/000:18:410
9796991712,2cyclictest3-21ksoftirqd/022:46:170
979699171,1cyclictest3-21ksoftirqd/023:04:450
979799169,6cyclictest0-21swapper/123:40:111
979799169,6cyclictest0-21swapper/123:27:221
979799160,2cyclictest0-21swapper/122:13:431
979799160,15cyclictest9714-21sshd23:56:181
979799160,15cyclictest6368-21sshd23:50:531
979799160,15cyclictest28120-21sshd23:21:441
979799160,15cyclictest18392-21bash21:43:051
979799160,15cyclictest0-21swapper/121:15:211
979799160,15cyclictest0-21swapper/100:01:351
979799160,10cyclictest0-21swapper/121:58:411
9796991615,1cyclictest10-21rcuc/023:33:240
9796991614,1cyclictest2519-21sshd21:33:440
9796991613,3cyclictest10-21rcuc/022:08:540
36592160,0sleep30-21swapper/300:31:453
308832160,1sleep230879-21sshd22:45:582
217162160,1sleep021713-21seq22:53:050
9799991514,1cyclictest0-21swapper/323:19:283
9799991513,1cyclictest10961-21id22:36:383
979999150,11cyclictest0-21swapper/321:34:123
9798991513,1cyclictest22674-21sshd00:16:242
979799150,1cyclictest29255-21ntp_states20:55:181
979799150,1cyclictest2651-21sshd21:10:001
979799150,1cyclictest20878-21apache_volume20:40:121
979699155,9cyclictest3-21ksoftirqd/021:36:170
979699155,1cyclictest3-21ksoftirqd/023:36:490
9796991513,1cyclictest3-21ksoftirqd/023:17:510
9796991513,1cyclictest30057-21sshd22:27:510
979699150,4cyclictest0-21swapper/023:11:360
979699150,12cyclictest0-21swapper/021:56:100
979699150,11cyclictest0-21swapper/023:20:280
304612150,1sleep21784-21runrttasks22:58:572
205182150,0sleep30-21swapper/322:27:053
9799991412,1cyclictest14187-21sshd21:53:093
9799991412,1cyclictest14187-21sshd21:53:093
979999140,13cyclictest0-21swapper/300:10:253
9798991412,1cyclictest3495-21sshd00:09:262
9798991411,2cyclictest2606-21diskmemload22:12:552
979899140,13cyclictest31681-21sshd21:36:072
979899140,13cyclictest28339-21sshd21:46:312
979899140,13cyclictest0-21swapper/222:17:002
979899140,13cyclictest0-21swapper/200:22:402
979799140,9cyclictest0-21swapper/121:00:111
979699149,4cyclictest10-21rcuc/023:51:250
979699148,3cyclictest3024-21sshd00:25:470
9796991413,1cyclictest3-21ksoftirqd/022:02:340
9796991413,1cyclictest3-21ksoftirqd/021:46:290
9796991413,1cyclictest3-21ksoftirqd/000:13:490
9796991412,2cyclictest3-21ksoftirqd/022:40:290
9796991411,1cyclictest3-21ksoftirqd/022:21:300
979699140,13cyclictest0-21swapper/021:15:350
66162140,0sleep36615-21bash23:14:563
27622140,1sleep22763-21sshd23:19:482
979999139,3cyclictest0-21swapper/319:35:143
979999139,1cyclictest0-21swapper/323:46:593
979999139,1cyclictest0-21swapper/321:48:043
979999139,1cyclictest0-21swapper/321:35:083
979999138,4cyclictest9741-21sshd22:23:393
979999138,4cyclictest17580-21sshd21:42:593
979999132,10cyclictest1500-21sshd00:20:103
979999130,12cyclictest0-21swapper/323:05:043
979999130,12cyclictest0-21swapper/323:02:423
979999130,12cyclictest0-21swapper/322:16:063
979999130,12cyclictest0-21swapper/321:57:253
979999130,12cyclictest0-21swapper/321:25:223
979999130,10cyclictest6449-21sshd00:01:153
979999130,10cyclictest27014-21sshd22:14:443
979999130,10cyclictest0-21swapper/323:43:083
979899138,4cyclictest2606-21diskmemload23:00:222
979899138,2cyclictest0-21swapper/223:55:242
979899138,1cyclictest0-21swapper/223:22:212
979899138,1cyclictest0-21swapper/222:38:542
979899130,12cyclictest2646-21sshd23:50:332
979899130,12cyclictest22707-21sshd21:40:412
979899130,12cyclictest13078-21sshd22:00:412
979899130,12cyclictest12935-21cp23:46:142
979799139,3cyclictest0-21swapper/120:45:141
979799138,0cyclictest0-21swapper/120:35:171
979799130,9cyclictest0-21swapper/120:00:241
979699133,9cyclictest3-21ksoftirqd/000:05:310
9796991312,1cyclictest3-21ksoftirqd/000:00:100
979999129,2cyclictest0-21swapper/323:51:183
979999129,2cyclictest0-21swapper/323:26:123
979999129,2cyclictest0-21swapper/322:30:513
979999129,2cyclictest0-21swapper/320:50:113
979999122,1cyclictest7117-21sshd21:15:233
979999121,10cyclictest0-21swapper/322:41:323
979999121,10cyclictest0-21swapper/320:55:103
979999121,10cyclictest0-21swapper/319:15:013
979999120,1cyclictest120050irq/25-eth000:26:313
979999120,12cyclictest0-21swapper/300:35:233
979899129,2cyclictest0-21swapper/220:05:152
979899128,4cyclictest0-21swapper/222:21:542
9798991211,1cyclictest2606-21diskmemload21:32:462
9798991211,1cyclictest0-21swapper/221:53:272
9798991211,1cyclictest0-21swapper/221:53:272
979899121,10cyclictest0-21swapper/223:10:302
9798991210,1cyclictest0-21swapper/222:41:342
9798991210,1cyclictest0-21swapper/200:26:532
979899120,12cyclictest0-21swapper/222:33:052
979799129,2cyclictest0-21swapper/120:50:191
979799128,3cyclictest0-21swapper/120:10:141
979799120,3cyclictest0-21swapper/119:55:111
979799120,11cyclictest0-21swapper/119:45:231
979699129,2cyclictest0-21swapper/021:05:180
979699129,2cyclictest0-21swapper/020:25:110
979699129,2cyclictest0-21swapper/019:25:110
979699120,11cyclictest0-21swapper/020:05:140
979999119,1cyclictest0-21swapper/320:35:173
979999118,2cyclictest0-21swapper/320:05:153
979999117,3cyclictest0-21swapper/319:30:143
9799991110,1cyclictest0-21swapper/320:15:113
979999110,2cyclictest0-21swapper/319:55:123
979999110,10cyclictest0-21swapper/321:05:513
979999110,10cyclictest0-21swapper/320:20:113
979999110,10cyclictest0-21swapper/319:40:113
979899118,2cyclictest0-21swapper/221:05:132
979899110,3cyclictest0-21swapper/220:30:122
979899110,2cyclictest0-21swapper/219:20:142
979899110,1cyclictest0-21swapper/219:26:282
979899110,10cyclictest0-21swapper/222:50:122
979899110,10cyclictest0-21swapper/220:45:122
979899110,10cyclictest0-21swapper/220:35:162
979899110,10cyclictest0-21swapper/220:19:332
979899110,10cyclictest0-21swapper/219:55:092
979899110,10cyclictest0-21swapper/219:30:152
979799119,1cyclictest0-21swapper/120:05:121
979799119,1cyclictest0-21swapper/119:40:141
979799118,2cyclictest0-21swapper/120:30:131
979799111,1cyclictest0-21swapper/119:15:011
979699119,1cyclictest0-21swapper/020:55:130
979699119,1cyclictest0-21swapper/020:45:160
979699111,1cyclictest10-21rcuc/020:15:150
9796991110,1cyclictest0-21swapper/019:30:190
979699110,2cyclictest0-21swapper/020:50:100
979699110,10cyclictest12211-21irqstats19:15:000
979699110,10cyclictest0-21swapper/021:00:210
979699110,10cyclictest0-21swapper/020:20:140
979699110,10cyclictest0-21swapper/019:40:210
979999109,1cyclictest0-21swapper/321:02:223
979999109,1cyclictest0-21swapper/319:24:203
979999108,1cyclictest23245-21apache_processe20:45:133
979999108,1cyclictest16558-21diskstats20:30:123
979999108,1cyclictest10598-21conntrack19:10:153
979999100,9cyclictest29513-21apache_volume19:50:113
979999100,9cyclictest27915-21fw_conntrack19:45:163
979999100,9cyclictest15377-21ls20:25:243
979999100,9cyclictest0-21swapper/320:40:263
979999100,1cyclictest6615-21apache_volume20:10:113
979999100,1cyclictest0-21swapper/319:25:123
979899109,1cyclictest0-21swapper/220:41:152
979899109,1cyclictest0-21swapper/219:50:162
979899108,1cyclictest6614-21apache_volume20:10:112
979899108,1cyclictest27577-21diskstats19:45:152
979899108,1cyclictest14168-21df_inode20:25:122
979899100,9cyclictest2660-21smartctl20:00:202
979899100,9cyclictest26047-21ntp_states19:40:212
979899100,9cyclictest25614-21apache_volume20:50:092
979899100,9cyclictest10591-21perl19:10:142
979899100,9cyclictest0-21swapper/220:20:162
979899100,1cyclictest0-21swapper/219:15:022
979799100,9cyclictest11740-21df20:20:141
979799100,1cyclictest18006-21df19:25:111
979799100,1cyclictest0-21swapper/119:50:141
979799100,1cyclictest0-21swapper/119:35:161
979699108,1cyclictest32256-21df19:55:100
979699108,1cyclictest23676-21ntp_states19:35:220
979699108,1cyclictest1867-21apache_volume20:00:120
979699108,1cyclictest16122-21apache_volume20:30:100
979699108,1cyclictest15259-21apache_volume19:20:120
979699100,1cyclictest27140-21apache_volume19:45:110
97999998,1cyclictest0-21swapper/320:00:203
97989998,1cyclictest0-21swapper/220:55:102
97989998,1cyclictest0-21swapper/219:35:122
97979990,1cyclictest0-21swapper/119:20:121
97969990,9cyclictest0-21swapper/020:40:130
97969990,9cyclictest0-21swapper/019:50:110
97979981,6cyclictest0-21swapper/119:30:221
97969980,6cyclictest0-21swapper/020:10:100
97989976,1cyclictest0-21swapper/221:01:222
97979976,1cyclictest14046-21cstates20:25:111
97979970,6cyclictest0-21swapper/119:10:101
97969970,5cyclictest10093-21cat19:10:130
97969970,5cyclictest0-21swapper/020:35:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional