You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-23 - 17:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4.osadl.org (updated Sat Sep 23, 2023 12:44:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1531212562,7sleep20-21swapper/207:07:292
1474212565,7sleep00-21swapper/007:06:430
1423212567,6sleep10-21swapper/107:06:041
17102111102,6sleep30-21swapper/307:09:473
2300221100,0sleep022998-21ssh12:29:300
50532740,0sleep30-21swapper/309:20:233
50532740,0sleep30-21swapper/309:20:223
194472670,0sleep00-21swapper/009:10:260
144642640,0sleep314467-21cpuspeed_turbos12:25:203
135142640,0sleep30-21swapper/309:40:253
71702630,0sleep10-21swapper/111:15:251
50402610,0sleep30-21swapper/311:13:503
327292600,1sleep30-21swapper/312:34:343
175442600,1sleep30-21swapper/309:58:233
92702580,0sleep09273-21needreboot12:20:280
230632580,1sleep10-21swapper/109:29:291
251912560,0sleep00-21swapper/011:05:540
287742540,0sleep00-21swapper/011:58:410
188999310,29cyclictest0-21swapper/211:15:202
1889992827,1cyclictest0-21swapper/212:30:202
1889992722,5cyclictest0-21swapper/207:31:302
188999270,26cyclictest0-21swapper/210:24:132
188999270,26cyclictest0-21swapper/209:36:012
188999270,25cyclictest0-21swapper/209:27:242
188299277,19cyclictest0-21swapper/011:11:280
1889992622,3cyclictest0-21swapper/208:38:102
188999260,25cyclictest0-21swapper/211:23:022
188299260,25cyclictest0-21swapper/011:00:270
188999250,24cyclictest0-21swapper/212:35:232
188999250,24cyclictest0-21swapper/210:18:492
188999250,24cyclictest0-21swapper/210:12:492
188299250,24cyclictest0-21swapper/010:39:230
1889992422,2cyclictest0-21swapper/208:53:302
1889992422,2cyclictest0-21swapper/208:47:102
1889992421,2cyclictest0-21swapper/208:08:082
1889992417,6cyclictest0-21swapper/210:54:022
188999240,18cyclictest0-21swapper/211:14:342
188999240,18cyclictest0-21swapper/209:10:122
188699244,18cyclictest0-21swapper/110:00:201
188699240,23cyclictest0-21swapper/110:33:401
188299242,21cyclictest0-21swapper/011:25:070
1882992415,8cyclictest0-21swapper/010:34:580
188299240,23cyclictest0-21swapper/010:55:590
2764922319,3sleep30-21swapper/307:28:533
1889992321,1cyclictest0-21swapper/208:00:292
188999231,16cyclictest0-21swapper/209:51:412
1889992310,7cyclictest18265-21snmpd11:35:232
188999230,22cyclictest0-21swapper/211:56:022
188999230,22cyclictest0-21swapper/211:25:592
188999230,22cyclictest0-21swapper/210:43:282
188999230,22cyclictest0-21swapper/210:36:302
1886992314,8cyclictest0-21swapper/112:03:401
188699231,21cyclictest0-21swapper/107:16:381
188699230,22cyclictest0-21swapper/110:55:001
188699230,22cyclictest0-21swapper/109:11:081
188699230,22cyclictest0-21swapper/108:41:241
188299238,14cyclictest0-21swapper/012:16:220
188299238,14cyclictest0-21swapper/008:10:250
188299230,22cyclictest0-21swapper/012:09:550
188299230,22cyclictest0-21swapper/010:43:500
188299230,22cyclictest0-21swapper/010:26:430
188299230,22cyclictest0-21swapper/010:02:180
188299230,22cyclictest0-21swapper/009:25:160
1045322319,3sleep30-21swapper/309:04:143
411222218,3sleep30-21swapper/308:02:143
3070722218,3sleep30-21swapper/307:58:173
1889992217,4cyclictest0-21swapper/207:28:112
1889992216,6cyclictest0-21swapper/209:46:342
188999220,21cyclictest0-21swapper/212:05:482
188999220,21cyclictest0-21swapper/212:03:312
188999220,21cyclictest0-21swapper/211:54:592
188999220,21cyclictest0-21swapper/211:44:272
188999220,21cyclictest0-21swapper/211:30:462
188999220,21cyclictest0-21swapper/211:05:032
1886992219,3cyclictest0-21swapper/109:01:371
1886992214,7cyclictest0-21swapper/111:11:561
188699221,20cyclictest0-21swapper/109:41:271
188699220,3cyclictest0-21swapper/112:31:251
188699220,21cyclictest0-21swapper/112:37:271
188699220,21cyclictest0-21swapper/112:29:011
188699220,21cyclictest0-21swapper/112:11:031
188699220,21cyclictest0-21swapper/112:06:151
188699220,21cyclictest0-21swapper/111:51:331
188699220,21cyclictest0-21swapper/111:45:091
188699220,21cyclictest0-21swapper/111:40:211
188699220,21cyclictest0-21swapper/111:27:001
188699220,21cyclictest0-21swapper/111:20:501
188699220,21cyclictest0-21swapper/111:06:071
188699220,21cyclictest0-21swapper/111:00:031
188699220,21cyclictest0-21swapper/110:48:511
188699220,21cyclictest0-21swapper/110:36:551
188699220,21cyclictest0-21swapper/110:25:111
188699220,21cyclictest0-21swapper/110:21:131
188699220,21cyclictest0-21swapper/110:17:131
188699220,21cyclictest0-21swapper/110:06:511
188699220,21cyclictest0-21swapper/109:56:111
188699220,21cyclictest0-21swapper/109:54:111
188699220,21cyclictest0-21swapper/109:24:211
188699220,21cyclictest0-21swapper/109:24:211
188699220,21cyclictest0-21swapper/107:46:441
188699220,21cyclictest0-21swapper/107:14:541
1882992213,8cyclictest0-21swapper/010:46:380
188299220,21cyclictest0-21swapper/011:51:190
188299220,21cyclictest0-21swapper/011:44:120
188299220,21cyclictest0-21swapper/011:38:270
188299220,21cyclictest0-21swapper/010:52:490
188299220,21cyclictest0-21swapper/010:14:280
188299220,21cyclictest0-21swapper/009:55:210
188299220,21cyclictest0-21swapper/009:54:140
188299220,20cyclictest0-21swapper/011:45:070
1312922217,3sleep30-21swapper/307:43:473
301102210,9sleep30-21swapper/311:41:323
188999217,13cyclictest0-21swapper/210:30:312
188999216,14cyclictest0-21swapper/209:40:202
1889992117,3cyclictest0-21swapper/212:22:462
1889992117,3cyclictest0-21swapper/212:15:252
1889992115,5cyclictest0-21swapper/210:57:072
188999210,20cyclictest0-21swapper/212:25:372
188999210,20cyclictest0-21swapper/212:11:432
188999210,20cyclictest0-21swapper/211:45:592
188999210,20cyclictest0-21swapper/211:04:362
188999210,20cyclictest0-21swapper/210:06:122
188999210,20cyclictest0-21swapper/210:01:022
188999210,20cyclictest0-21swapper/209:55:432
188999210,20cyclictest0-21swapper/209:31:152
188999210,20cyclictest0-21swapper/209:22:282
188999210,20cyclictest0-21swapper/209:22:272
188999210,20cyclictest0-21swapper/209:15:482
188999210,20cyclictest0-21swapper/207:35:562
1886992118,3cyclictest0-21swapper/107:52:081
188699211,19cyclictest0-21swapper/109:35:141
1886992110,4cyclictest0-21swapper/111:59:321
188699210,4cyclictest0-21swapper/108:52:241
188699210,3cyclictest0-21swapper/107:37:171
188699210,20cyclictest0-21swapper/112:15:401
188699210,20cyclictest0-21swapper/111:38:391
188699210,20cyclictest0-21swapper/110:52:041
188699210,20cyclictest0-21swapper/110:44:491
188699210,20cyclictest0-21swapper/110:13:541
188699210,20cyclictest0-21swapper/109:49:381
188699210,20cyclictest0-21swapper/109:34:271
188699210,20cyclictest0-21swapper/109:15:231
188699210,20cyclictest0-21swapper/108:46:221
188699210,20cyclictest0-21swapper/108:29:301
188699210,20cyclictest0-21swapper/108:07:271
188699210,20cyclictest0-21swapper/108:04:411
188699210,20cyclictest0-21swapper/107:58:151
188699210,20cyclictest0-21swapper/107:23:391
188299210,3cyclictest0-21swapper/008:15:200
188299210,20cyclictest0-21swapper/012:31:540
188299210,20cyclictest0-21swapper/012:10:340
188299210,20cyclictest0-21swapper/011:21:290
188299210,20cyclictest0-21swapper/011:15:120
188299210,20cyclictest0-21swapper/010:20:060
188299210,20cyclictest0-21swapper/010:17:580
188299210,20cyclictest0-21swapper/009:47:100
188299210,20cyclictest0-21swapper/009:30:500
188299210,15cyclictest0-21swapper/009:41:120
265442200,0sleep30-21swapper/311:07:303
1889992018,2cyclictest0-21swapper/209:03:462
1889992018,2cyclictest0-21swapper/208:19:452
1889992018,1cyclictest18265-21snmpd08:23:462
1889992017,2cyclictest18265-21snmpd10:46:342
1889992016,3cyclictest0-21swapper/207:51:022
1889992016,3cyclictest0-21swapper/207:48:542
1889992016,2cyclictest7647-21cron08:35:002
1889992012,7cyclictest0-21swapper/208:12:402
188999201,12cyclictest0-21swapper/210:25:282
188999200,2cyclictest0-21swapper/208:28:182
188699202,16cyclictest0-21swapper/111:30:241
1886992013,7cyclictest0-21swapper/112:20:001
1886992012,7cyclictest0-21swapper/108:56:331
188699200,2cyclictest0-21swapper/108:35:311
188699200,2cyclictest0-21swapper/108:17:451
1882992018,1cyclictest18265-21snmpd10:07:380
1882992018,1cyclictest18265-21snmpd08:41:240
1882992018,1cyclictest18265-21snmpd08:25:210
1882992018,1cyclictest18265-21snmpd08:04:320
1882992018,1cyclictest18265-21snmpd07:50:120
1882992012,7cyclictest0-21swapper/012:02:200
1882992012,7cyclictest0-21swapper/009:15:210
188299200,19cyclictest0-21swapper/012:38:590
188299200,19cyclictest0-21swapper/011:31:140
1677122016,3sleep30-21swapper/308:15:033
2274521914,3sleep30-21swapper/310:15:483
1889991917,2cyclictest0-21swapper/207:40:412
1889991917,1cyclictest18265-21snmpd07:22:032
1889991917,1cyclictest18265-21snmpd07:13:482
1889991916,3cyclictest0-21swapper/207:17:472
1889991915,3cyclictest0-21swapper/207:57:512
1886991917,2cyclictest0-21swapper/108:14:171
1886991916,3cyclictest0-21swapper/108:21:011
188699190,18cyclictest0-21swapper/107:28:231
1882991917,1cyclictest18265-21snmpd09:24:520
1882991917,1cyclictest18265-21snmpd09:24:510
1882991917,1cyclictest18265-21snmpd09:08:190
1882991917,1cyclictest18265-21snmpd08:37:120
1882991917,1cyclictest18265-21snmpd07:57:170
1882991917,1cyclictest18265-21snmpd07:34:290
1882991917,1cyclictest18265-21snmpd07:19:290
188299190,18cyclictest0-21swapper/007:37:050
2509321814,3sleep30-21swapper/308:47:073
1889991816,1cyclictest18265-21snmpd09:07:182
1889991816,1cyclictest18265-21snmpd08:56:482
1886991815,3cyclictest0-21swapper/108:30:301
188299185,8cyclictest1405-21/usr/sbin/munin09:35:220
1882991816,2cyclictest0-21swapper/007:23:570
1882991816,1cyclictest18265-21snmpd09:01:240
1882991816,1cyclictest18265-21snmpd08:55:460
1882991816,1cyclictest18265-21snmpd08:51:390
1882991816,1cyclictest18265-21snmpd08:46:070
1882991816,1cyclictest18265-21snmpd08:32:220
1882991816,1cyclictest18265-21snmpd08:07:090
1882991816,1cyclictest18265-21snmpd07:46:260
2952621711,3sleep30-21swapper/309:49:083
2554921714,2sleep30-21swapper/308:50:083
1889991715,1cyclictest18265-21snmpd08:42:212
188699170,16cyclictest0-21swapper/107:32:331
188299179,7cyclictest0-21swapper/007:40:280
1882991715,1cyclictest18265-21snmpd08:24:190
1882991715,1cyclictest18265-21snmpd07:11:090
164982175,3sleep30-21swapper/312:09:163
345821610,3sleep30-21swapper/312:19:213
2225121610,3sleep30-21swapper/311:38:463
188699162,1cyclictest12954-21sshd07:41:311
188299160,15cyclictest0-21swapper/007:25:320
1606421611,3sleep30-21swapper/309:05:373
1216121611,2sleep30-21swapper/312:23:093
1886991513,2cyclictest0-21swapper/109:05:061
16842159,3sleep30-21swapper/309:17:433
1939821410,3sleep30-21swapper/308:44:143
100332149,3sleep30-21swapper/309:39:023
91372139,2sleep30-21swapper/312:38:323
49592139,3sleep30-21swapper/308:05:053
264272137,3sleep30-21swapper/311:55:543
248982138,4sleep30-21swapper/307:54:203
216392139,3sleep30-21swapper/307:22:013
20082138,3sleep30-21swapper/307:10:033
162142139,3sleep30-21swapper/308:10:553
126952130,3sleep30-21swapper/311:16:243
70772128,3sleep30-21swapper/307:37:343
69072126,3sleep30-21swapper/312:04:183
46502126,3sleep30-21swapper/310:07:293
45942128,3sleep30-21swapper/308:59:403
315012120,3sleep30-21swapper/310:36:423
267952127,3sleep30-21swapper/310:02:143
166382126,3sleep30-21swapper/311:02:223
156502125,4sleep30-21swapper/307:15:553
134542128,3sleep30-21swapper/307:45:043
133502128,3sleep30-21swapper/308:37:183
132612126,3sleep30-21swapper/310:28:293
300492114,4sleep30-21swapper/310:53:213
178292110,1sleep30-21swapper/311:52:053
10182116,3sleep30-21swapper/307:33:033
64182104,3sleep30-21swapper/310:57:003
244812105,3sleep30-21swapper/311:23:253
236732103,4sleep30-21swapper/309:12:023
19792106,3sleep30-21swapper/308:30:043
148582104,3sleep30-21swapper/310:30:053
14322106,3sleep30-21swapper/308:26:013
101622105,2sleep30-21swapper/311:49:283
922293,3sleep30-21swapper/309:34:573
5946293,3sleep30-21swapper/309:52:403
4135290,1sleep30-21swapper/311:30:183
3461291,5sleep30-21swapper/310:40:233
24960293,3sleep30-21swapper/312:12:563
18907295,2sleep30-21swapper/310:46:553
13656293,3sleep30-21swapper/310:11:393
390281,4sleep30-21swapper/310:20:353
27964283,3sleep30-21swapper/308:20:473
26171281,4sleep30-21swapper/311:25:053
20361281,4sleep30-21swapper/309:26:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional