You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 13:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Thu Apr 25, 2024 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
518221010,0sleep25183-21bash00:20:312
2828321010,1sleep328264-21sshd23:26:513
2828321010,1sleep328264-21sshd23:26:513
145732990,2sleep00-21swapper/021:21:560
145732990,2sleep00-21swapper/021:21:560
153572970,1sleep015313-21sshd23:47:160
227702960,2sleep31035699cyclictest23:34:293
238282940,0sleep223830-21id00:25:362
130812900,0sleep013080-21sshd21:37:540
125992830,0sleep212594-21rm23:06:482
249322630,1sleep224921-21sshd22:02:082
92932620,1sleep30-21swapper/321:55:403
51422620,1sleep05128-21sshd22:23:380
156202600,1sleep015594-21sshd23:15:100
156202600,1sleep015594-21sshd23:15:100
80422580,0sleep10-21swapper/123:54:461
304372570,0sleep10-21swapper/122:25:361
299292570,0sleep08-21rcu_preempt22:10:150
112272570,0sleep311202-21sshd21:37:453
39582560,0sleep30-21swapper/300:14:073
27112560,1sleep00-21swapper/022:41:540
236942560,0sleep20-21swapper/222:51:242
77072550,1sleep010-21rcuc/021:50:280
183582550,1sleep118349-21sshd23:20:411
180632550,1sleep00-21swapper/021:48:480
129652550,0sleep10-21swapper/122:37:251
1005125528,23sleep10-21swapper/119:09:281
77982540,1sleep339-21ksoftirqd/323:22:303
77642540,0sleep37766-21sshd00:08:383
215152540,1sleep30-21swapper/323:07:363
182002540,1sleep118199-21sshd23:42:081
119172540,1sleep211912-21bash00:09:012
796125327,8sleep30-21swapper/319:05:093
199232530,1sleep11784-21runrttasks20:45:281
122942530,0sleep11784-21runrttasks22:08:521
981025225,9sleep00-21swapper/019:06:310
271322520,0sleep027129-21bash23:10:410
226362520,1sleep00-21swapper/021:25:200
212082520,0sleep221207-21bash23:12:572
142542520,1sleep114197-21sshd22:40:131
986225027,19sleep20-21swapper/219:07:052
272832500,0sleep127271-21sshd00:22:461
95492490,1sleep00-21swapper/000:08:470
6942470,0sleep339-21ksoftirqd/323:56:443
321122470,0sleep10-21swapper/121:28:531
311012470,0sleep20-21swapper/221:17:572
264132470,0sleep20-21swapper/200:04:322
213022470,0sleep121282-21sshd23:45:081
258852460,0sleep00-21swapper/022:27:540
173032450,0sleep217305-21id00:31:092
181772430,0sleep30-21swapper/321:14:183
290792390,1sleep329068-21sshd23:51:033
209562330,0sleep30-21swapper/300:18:563
1035699221,20cyclictest24627-21id00:37:373
10355992019,1cyclictest0-21swapper/223:53:292
10355991917,1cyclictest24494-21sshd21:49:212
10355991816,1cyclictest5140-21sshd22:34:132
3512170,0sleep20-21swapper/222:44:232
129292170,1sleep012922-21sshd22:08:560
124392170,0sleep312333-21sshd21:43:103
10355991715,1cyclictest0-21swapper/221:35:182
10354991715,1cyclictest8747-21sshd22:52:551
1035399170,14cyclictest0-21swapper/000:02:480
313252160,0sleep10-21swapper/122:23:071
305672160,0sleep130560-21sshd21:49:501
30222160,1sleep33020-21bash23:16:453
30222160,1sleep33020-21bash23:16:453
265052160,1sleep20-21swapper/223:45:302
10356991613,2cyclictest0-21swapper/322:29:023
10353991614,1cyclictest17212-21sshd23:52:480
10353991614,1cyclictest15959-21sshd22:01:260
10353991610,5cyclictest32401-21sshd00:38:200
1035399160,12cyclictest3532-21rm00:17:050
54822150,1sleep25486-21sshd22:58:052
54822150,1sleep25486-21sshd22:58:052
171302150,0sleep21784-21runrttasks22:48:162
1035599150,14cyclictest0-21swapper/223:42:122
10354991513,1cyclictest21-21ksoftirqd/121:56:131
10354991513,1cyclictest21-21ksoftirqd/121:38:281
10354991512,2cyclictest5218-21sshd23:35:341
1035499151,13cyclictest0-21swapper/100:10:441
10354991510,2cyclictest21-21ksoftirqd/122:48:261
1035499150,11cyclictest0-21swapper/123:55:321
1035399159,3cyclictest0-21swapper/022:15:270
1035399159,3cyclictest0-21swapper/021:56:400
1035399155,1cyclictest17932-21sshd22:32:360
1035399150,13cyclictest0-21swapper/023:21:010
1035399150,12cyclictest0-21swapper/023:02:240
320202140,1sleep132000-21sshd00:02:081
242802140,1sleep324279-21sshd22:09:513
148082140,2sleep31035699cyclictest21:45:543
1035699149,2cyclictest0-21swapper/323:40:403
1035699148,5cyclictest0-21swapper/323:39:303
1035699144,9cyclictest10881-21sshd23:49:383
1035599140,13cyclictest0-21swapper/221:14:332
1035499144,9cyclictest21-21ksoftirqd/122:11:291
1035499144,1cyclictest21-21ksoftirqd/123:33:561
1035499144,1cyclictest21-21ksoftirqd/121:54:131
1035499143,8cyclictest21-21ksoftirqd/100:32:061
10354991413,1cyclictest21-21ksoftirqd/122:02:351
10354991413,1cyclictest21-21ksoftirqd/121:21:411
10354991413,1cyclictest21-21ksoftirqd/121:21:411
10354991412,1cyclictest21-21ksoftirqd/121:16:461
10354991412,1cyclictest21-21ksoftirqd/100:25:261
10354991411,1cyclictest21-21ksoftirqd/122:17:511
10354991410,1cyclictest21-21ksoftirqd/100:05:101
1035399143,10cyclictest0-21swapper/000:30:580
1035399142,11cyclictest0-21swapper/022:38:430
10353991410,1cyclictest7611-21sshd21:40:090
1035399140,3cyclictest16484-21sshd00:21:380
1035399140,13cyclictest0-21swapper/000:11:460
1035399140,11cyclictest0-21swapper/022:47:350
1035399140,11cyclictest0-21swapper/021:30:080
1035399140,11cyclictest0-21swapper/021:16:200
1035399140,10cyclictest31468-21sshd00:26:250
1035699139,3cyclictest0-21swapper/322:54:123
1035699139,3cyclictest0-21swapper/322:04:573
1035699139,1cyclictest0-21swapper/322:43:483
1035699138,4cyclictest16420-21sshd21:51:093
1035699138,2cyclictest0-21swapper/322:15:463
10356991311,1cyclictest19926-21sshd00:22:003
10356991311,1cyclictest0-21swapper/300:28:223
1035699130,2cyclictest24577-21sshd22:35:413
1035699130,1cyclictest0-21swapper/321:21:513
1035699130,1cyclictest0-21swapper/321:21:513
1035699130,12cyclictest0-21swapper/323:01:243
1035699130,12cyclictest0-21swapper/322:58:483
1035699130,12cyclictest0-21swapper/322:58:483
1035699130,12cyclictest0-21swapper/322:11:113
1035699130,12cyclictest0-21swapper/300:34:513
1035699130,10cyclictest30330-21sshd00:01:593
1035699130,0cyclictest26980-21sshd23:10:413
1035599139,3cyclictest0-21swapper/200:35:122
1035599139,1cyclictest0-21swapper/223:56:212
1035599138,4cyclictest7354-21sshd21:42:442
1035599138,4cyclictest0-21swapper/221:34:432
10355991311,1cyclictest537-21sshd00:10:482
10355991311,1cyclictest492-21jbd2/dm-0-821:53:502
10355991311,1cyclictest21813-21sshd22:07:022
1035599131,11cyclictest0-21swapper/219:15:012
1035599130,4cyclictest6483-21sshd21:21:162
1035599130,4cyclictest6483-21sshd21:21:152
1035599130,4cyclictest0-21swapper/223:17:432
1035599130,4cyclictest0-21swapper/223:17:422
1035599130,1cyclictest0-21swapper/221:57:182
1035599130,13cyclictest0-21swapper/222:10:202
1035599130,12cyclictest6016-21id23:00:472
1035599130,12cyclictest0-21swapper/223:32:012
1035599130,12cyclictest0-21swapper/222:23:122
1035599130,12cyclictest0-21swapper/222:18:022
1035499138,2cyclictest14377-21sshd21:32:401
1035499135,1cyclictest21-21ksoftirqd/122:55:361
1035499135,1cyclictest21-21ksoftirqd/122:55:361
1035499134,2cyclictest21-21ksoftirqd/123:29:381
1035499134,2cyclictest21-21ksoftirqd/123:29:381
1035499133,1cyclictest21-21ksoftirqd/100:15:321
10354991311,1cyclictest21-21ksoftirqd/123:05:121
10354991311,1cyclictest21-21ksoftirqd/123:01:151
10354991311,1cyclictest21-21ksoftirqd/122:32:381
1035499130,1cyclictest0-21swapper/123:10:071
1035499130,12cyclictest0-21swapper/121:10:081
1035499130,10cyclictest0-21swapper/121:43:111
1035399139,3cyclictest0-21swapper/023:55:110
1035399138,2cyclictest8347-21sshd23:38:380
1035399137,3cyclictest0-21swapper/023:43:290
1035399131,3cyclictest0-21swapper/022:58:590
1035399131,3cyclictest0-21swapper/022:58:590
1035399130,1cyclictest5373-21munin-node23:30:180
1035399130,1cyclictest31826-21sshd23:05:380
1035399130,12cyclictest0-21swapper/023:25:200
1035399130,12cyclictest0-21swapper/023:25:190
1035399130,11cyclictest0-21swapper/022:50:570
1035399130,10cyclictest0-21swapper/021:10:020
283892120,0sleep30-21swapper/321:25:483
1035699129,2cyclictest0-21swapper/322:20:123
1035699128,2cyclictest0-21swapper/321:16:283
1035699120,1cyclictest0-21swapper/322:46:293
1035699120,11cyclictest13848-21sshd21:30:043
1035699120,11cyclictest0-21swapper/322:31:533
1035599129,2cyclictest0-21swapper/222:25:282
1035599129,2cyclictest0-21swapper/221:28:022
1035599128,1cyclictest0-21swapper/223:35:272
10355991210,1cyclictest1546-21nfsd22:35:312
1035599120,11cyclictest21958-21sshd23:26:192
1035599120,11cyclictest21958-21sshd23:26:192
1035599120,11cyclictest19832-21sshd23:20:482
1035599120,11cyclictest0-21swapper/200:15:102
1035499121,2cyclictest0-21swapper/100:35:471
10354991210,1cyclictest16177-21sshd23:15:141
10354991210,1cyclictest16177-21sshd23:15:131
1035699110,11cyclictest0-21swapper/321:00:453
1035399110,8cyclictest0-21swapper/020:45:250
1035699109,1cyclictest0-21swapper/320:33:423
1035699109,1cyclictest0-21swapper/320:26:093
1035699109,1cyclictest0-21swapper/319:56:113
1035699102,7cyclictest0-21swapper/320:41:033
1035699102,7cyclictest0-21swapper/320:15:323
1035699100,10cyclictest0-21swapper/320:51:483
1035699100,10cyclictest0-21swapper/320:10:553
1035499109,1cyclictest0-21swapper/119:15:021
1035499100,9cyclictest0-21swapper/120:00:301
1035499100,10cyclictest0-21swapper/120:55:121
1035499100,10cyclictest0-21swapper/119:55:461
1035499100,10cyclictest0-21swapper/119:35:031
1035499100,10cyclictest0-21swapper/119:34:561
1035499100,0cyclictest0-21swapper/120:05:151
1035399105,2cyclictest0-21swapper/019:40:180
1035399101,8cyclictest0-21swapper/019:30:180
1035399100,9cyclictest0-21swapper/019:15:010
1035399100,10cyclictest0-21swapper/020:33:020
103569996,1cyclictest18224-21kworker/3:119:16:273
103559990,5cyclictest0-21swapper/219:40:032
103549995,4cyclictest21-21ksoftirqd/119:49:571
103549990,9cyclictest0-21swapper/121:06:501
103549990,9cyclictest0-21swapper/120:39:411
103549990,9cyclictest0-21swapper/120:14:481
103549990,6cyclictest0-21swapper/120:53:201
103539997,2cyclictest0-21swapper/021:10:010
103539994,5cyclictest0-21swapper/020:04:470
103539992,4cyclictest19875-21perf19:40:010
103539991,5cyclictest0-21swapper/020:25:200
103539990,9cyclictest0-21swapper/020:44:590
103539990,8cyclictest0-21swapper/019:45:210
103539990,7cyclictest0-21swapper/020:05:170
103569983,4cyclictest28961-21cat21:05:213
103569981,6cyclictest0-21swapper/320:45:223
103569981,6cyclictest0-21swapper/319:40:123
103569980,7cyclictest0-21swapper/320:37:333
103559986,1cyclictest30516-21bash21:10:002
103559983,5cyclictest0-21swapper/219:10:482
103559983,5cyclictest0-21swapper/219:10:482
103559981,6cyclictest0-21swapper/220:55:232
103559981,6cyclictest0-21swapper/220:50:152
103559981,6cyclictest0-21swapper/219:50:142
103559980,7cyclictest0-21swapper/221:00:172
103559980,5cyclictest0-21swapper/220:33:022
103549983,5cyclictest0-21swapper/120:33:591
103549983,5cyclictest0-21swapper/120:16:381
103549983,5cyclictest0-21swapper/119:40:021
103549983,5cyclictest0-21swapper/119:25:161
103549983,3cyclictest0-21swapper/119:21:361
103549982,6cyclictest0-21swapper/120:23:161
103549981,6cyclictest0-21swapper/120:40:261
103549981,6cyclictest0-21swapper/120:25:291
103549981,6cyclictest0-21swapper/119:50:131
103549980,8cyclictest0-21swapper/121:00:121
103549980,8cyclictest0-21swapper/119:11:321
103549980,8cyclictest0-21swapper/119:11:321
103539983,5cyclictest0-21swapper/019:10:330
103539983,5cyclictest0-21swapper/019:10:320
103539981,6cyclictest0-21swapper/020:20:180
103539980,7cyclictest0-21swapper/020:16:180
103539980,7cyclictest0-21swapper/020:10:320
103539980,1cyclictest0-21swapper/020:55:170
103569975,1cyclictest8688-21taskset20:23:313
103569975,1cyclictest17506-21df_inode19:30:093
103569971,5cyclictest0-21swapper/320:00:133
103569971,5cyclictest0-21swapper/319:50:323
103569971,5cyclictest0-21swapper/319:45:113
103569971,5cyclictest0-21swapper/319:20:063
103569970,6cyclictest0-21swapper/320:55:163
103569970,6cyclictest0-21swapper/319:10:113
103569970,6cyclictest0-21swapper/319:10:113
103559971,5cyclictest0-21swapper/220:20:262
103559971,5cyclictest0-21swapper/220:05:162
103559971,5cyclictest0-21swapper/219:30:162
103559971,5cyclictest0-21swapper/219:29:482
103559970,6cyclictest0-21swapper/220:45:132
103559970,6cyclictest0-21swapper/220:40:032
103559970,6cyclictest0-21swapper/220:35:112
103559970,6cyclictest0-21swapper/220:10:282
103559970,6cyclictest0-21swapper/219:45:182
103559970,6cyclictest0-21swapper/219:20:072
103559970,1cyclictest0-21swapper/219:55:132
103539976,1cyclictest0-21swapper/019:50:180
103539974,2cyclictest0-21swapper/020:35:090
103539971,5cyclictest0-21swapper/019:20:090
103539970,7cyclictest0-21swapper/021:00:130
103539970,7cyclictest0-21swapper/019:25:530
103539970,5cyclictest21002-21atenall_rapower20:50:100
103539970,5cyclictest0-21swapper/019:55:100
103569960,5cyclictest19980-21cat19:40:013
103569960,5cyclictest0-21swapper/320:05:113
103559964,1cyclictest30269-21fschecks_time20:00:202
103559962,4cyclictest0-21swapper/220:15:222
103559960,5cyclictest0-21swapper/220:25:132
103569955,0cyclictest18224-21kworker/3:119:25:043
103559950,4cyclictest0-21swapper/219:35:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional