You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 06:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot3.osadl.org (updated Thu Apr 25, 2024 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1303477991912,5cyclictest0-21swapper/323:15:133
130347799130,12cyclictest0-21swapper/322:45:113
1303477991210,1cyclictest0-21swapper/321:30:153
130347799120,11cyclictest0-21swapper/320:15:223
130347799120,11cyclictest0-21swapper/319:50:123
1303477991111,0cyclictest0-21swapper/322:05:113
1303477991111,0cyclictest0-21swapper/322:00:113
1303477991111,0cyclictest0-21swapper/319:45:113
1303477991111,0cyclictest0-21swapper/319:30:083
130347799110,11cyclictest0-21swapper/323:45:133
130347799110,11cyclictest0-21swapper/322:40:223
130347799110,11cyclictest0-21swapper/319:44:563
130347799110,0cyclictest0-21swapper/323:25:003
130347799110,0cyclictest0-21swapper/320:25:113
130347799110,0cyclictest0-21swapper/300:15:303
1303477991010,0cyclictest0-21swapper/322:20:083
1303477991010,0cyclictest0-21swapper/321:41:143
1303477991010,0cyclictest0-21swapper/320:55:113
1303477991010,0cyclictest0-21swapper/320:20:123
1303477991010,0cyclictest0-21swapper/300:10:143
130347799100,10cyclictest0-21swapper/320:45:193
130347799100,0cyclictest0-21swapper/322:50:193
130347799100,0cyclictest0-21swapper/321:15:133
130347799100,0cyclictest0-21swapper/321:00:133
13034779999,0cyclictest0-21swapper/321:20:093
13034779999,0cyclictest0-21swapper/319:20:073
13034779999,0cyclictest0-21swapper/300:20:113
13034779990,9cyclictest0-21swapper/323:05:013
13034779990,9cyclictest0-21swapper/300:31:263
13034779988,0cyclictest0-21swapper/322:59:283
13034779988,0cyclictest0-21swapper/322:37:293
13034779988,0cyclictest0-21swapper/321:50:113
13034779988,0cyclictest0-21swapper/321:25:123
13034779988,0cyclictest0-21swapper/320:35:103
13034779988,0cyclictest0-21swapper/320:15:003
13034779988,0cyclictest0-21swapper/300:10:013
13034779980,8cyclictest0-21swapper/300:40:013
13034779980,0cyclictest0-21swapper/300:00:253
13034779977,0cyclictest0-21swapper/323:54:223
13034779977,0cyclictest0-21swapper/323:10:273
13034779977,0cyclictest0-21swapper/322:26:313
13034779977,0cyclictest0-21swapper/320:07:083
13034779977,0cyclictest0-21swapper/319:19:483
13034779977,0cyclictest0-21swapper/319:10:193
13034779970,0cyclictest0-21swapper/322:15:113
1303293270,3sleep30-21swapper/319:09:563
13034779966,0cyclictest0-21swapper/323:43:243
13034779966,0cyclictest0-21swapper/323:35:103
13034779966,0cyclictest0-21swapper/323:05:093
13034779966,0cyclictest0-21swapper/321:35:013
13034779965,0cyclictest0-21swapper/321:46:343
13129850,2rtkit-daemon717-21lldpd22:15:140
13129850,2rtkit-daemon538-21systemd-logind21:22:300
13129850,1rtkit-daemon0-21swapper/019:05:230
13034779954,0cyclictest0-21swapper/320:50:093
13034779950,5cyclictest0-21swapper/321:10:283
13034779950,5cyclictest0-21swapper/300:00:003
1303007252,2sleep20-21swapper/219:06:142
1302062250,3sleep11302115-21awk19:05:181
1325248240,0sleep20-21swapper/220:15:112
1313689241,1sleep00-21swapper/019:45:110
13129840,2rtkit-daemon717-21lldpd21:15:510
13129840,2rtkit-daemon717-21lldpd19:32:200
13129840,2rtkit-daemon356-21systemd-journal21:59:290
13129840,2rtkit-daemon1311-21rtkit-daemon21:10:350
13129840,2rtkit-daemon1305460-21munin-node22:25:000
13129840,1rtkit-daemon717-21lldpd22:58:140
13129840,1rtkit-daemon356-21systemd-journal00:18:170
13129840,1rtkit-daemon3191333-21snmpd19:42:540
13129840,1rtkit-daemon1357476-21apt-get21:35:160
13034779940,4cyclictest0-21swapper/322:30:393
13034779940,4cyclictest0-21swapper/321:05:183
13034779940,4cyclictest0-21swapper/320:30:243
13034779940,3cyclictest0-21swapper/320:00:143
13034779940,3cyclictest0-21swapper/319:56:273
13034779940,3cyclictest0-21swapper/300:26:163
1419519230,0sleep00-21swapper/000:00:130
1417366230,1sleep21417392-21apt-get23:55:102
1409310230,0sleep00-21swapper/023:35:200
1383165230,1sleep21383191-21apt-get22:35:112
1366189230,1sleep21366215-21apt-get21:55:122
1319481230,1sleep21319509-21apt-get20:00:142
13129830,1rtkit-daemon717-21lldpd23:00:530
13129830,1rtkit-daemon717-21lldpd21:40:210
13129830,1rtkit-daemon717-21lldpd20:38:510
13129830,1rtkit-daemon717-21lldpd20:22:060
13129830,1rtkit-daemon717-21lldpd00:21:530
13129830,1rtkit-daemon717-21lldpd00:12:070
13129830,1rtkit-daemon714-21ntpd22:37:230
13129830,1rtkit-daemon714-21ntpd20:00:150
13129830,1rtkit-daemon617-21gmain00:32:170
13129830,1rtkit-daemon375-21systemd-udevd20:34:300
13129830,1rtkit-daemon375-21systemd-udevd19:22:290
13129830,1rtkit-daemon356-21systemd-journal22:47:150
13129830,1rtkit-daemon356-21systemd-journal22:00:010
13129830,1rtkit-daemon3191333-21snmpd22:30:510
13129830,1rtkit-daemon1431402-21ssh00:25:290
13129830,1rtkit-daemon1415985-21strings23:50:200
13129830,1rtkit-daemon1398808-21ntp_states23:10:160
13129830,1rtkit-daemon1373486-21find22:10:210
13129830,1rtkit-daemon1353995-21ntp_states21:25:200
13129830,1rtkit-daemon1305460-21munin-node23:43:030
13129830,1rtkit-daemon1305460-21munin-node21:30:380
13129830,1rtkit-daemon1-21systemd23:30:460
13129830,1rtkit-daemon1-21systemd23:06:200
13129830,1rtkit-daemon1-21systemd22:43:180
13129830,1rtkit-daemon1-21systemd22:21:540
13129830,1rtkit-daemon1-21systemd22:08:060
13129830,1rtkit-daemon1-21systemd21:52:200
13129830,1rtkit-daemon1-21systemd21:46:190
13129830,1rtkit-daemon1-21systemd20:45:250
13129830,1rtkit-daemon1-21systemd20:14:170
13129830,1rtkit-daemon1-21systemd19:16:180
13129830,1rtkit-daemon1-21systemd00:35:510
13129830,1rtkit-daemon0-21swapper/023:55:150
13129830,1rtkit-daemon0-21swapper/023:25:210
13129830,1rtkit-daemon0-21swapper/022:53:020
13129830,0rtkit-daemon0-21swapper/023:21:550
13034779933,0cyclictest0-21swapper/323:30:433
13034779930,3cyclictest0-21swapper/322:12:383
13034779930,3cyclictest0-21swapper/319:35:063
13034779930,3cyclictest0-21swapper/319:25:143
13034779930,1cyclictest0-21swapper/320:40:103
13034779930,0cyclictest0-21swapper/321:55:113
1433606221,1sleep236-21ksoftirqd/200:31:332
1425348220,0sleep20-21swapper/200:12:512
1415687220,1sleep11415710-21fw_packets23:50:181
1405994220,1sleep10-21swapper/123:27:481
1387427220,1sleep21387453-21apt-get22:45:112
1386109220,1sleep11386227-21sendmail_mailqu22:40:211
1381744220,1sleep11381844-21ntp_offset22:30:211
1378668220,0sleep20-21swapper/222:24:532
1361370220,1sleep11361374-21ssh21:44:261
1348609220,1sleep20-21swapper/221:14:262
1345614220,1sleep21345669-21ntp_states21:05:212
1341701220,1sleep00-21swapper/020:55:180
1332312220,1sleep20-21swapper/220:30:282
1331834220,1sleep10-21swapper/120:30:231
1326233220,1sleep10-21swapper/120:15:261
1313442220,1sleep21313450-21latency_hist19:45:012
13129820,1rtkit-daemon714-21ntpd19:55:440
13129820,1rtkit-daemon617-21gmain20:25:150
13129820,1rtkit-daemon1234-21cron19:25:590
13129820,1rtkit-daemon1-21systemd21:01:170
13129820,1rtkit-daemon1-21systemd20:50:030
13129820,1rtkit-daemon1-21systemd20:05:160
13129820,1rtkit-daemon1-21systemd19:35:190
13129820,1rtkit-daemon1-21systemd00:05:220
13129820,0rtkit-daemon0-21swapper/023:45:200
13129820,0rtkit-daemon0-21swapper/023:15:230
13129820,0rtkit-daemon0-21swapper/021:05:030
13129820,0rtkit-daemon0-21swapper/020:40:150
13129820,0rtkit-daemon0-21swapper/020:15:040
13129820,0rtkit-daemon0-21swapper/019:50:400
13129820,0rtkit-daemon0-21swapper/019:10:110
13034779920,2cyclictest1404386-21chrt23:25:093
1434490210,0sleep20-21swapper/200:35:172
1434382210,0sleep10-21swapper/100:35:161
1432210210,0sleep10-21swapper/100:30:121
1430253210,0sleep20-21swapper/200:25:162
1430220210,0sleep10-21swapper/100:25:151
1428205210,0sleep10-21swapper/100:20:151
1427961210,0sleep20-21swapper/200:20:082
1425944210,1sleep21425854-21/usr/sbin/munin00:15:162
1425893210,0sleep10-21swapper/100:15:151
1423984210,0sleep11424169-21df00:10:181
1422379210,0sleep20-21swapper/200:05:202
1421813210,0sleep10-21swapper/100:05:151
1419812210,0sleep10-21swapper/100:00:181
1419590210,0sleep20-21swapper/200:00:152
1417815210,0sleep10-21swapper/123:55:171
1415252210,0sleep20-21swapper/223:50:112
1413129210,0sleep10-21swapper/123:45:051
1412626210,0sleep20-21swapper/223:45:022
1410915210,0sleep10-21swapper/123:40:121
1410489210,0sleep20-21swapper/223:40:012
1408614210,0sleep10-21swapper/123:35:051
1408376210,0sleep20-21swapper/223:35:022
1406539210,0sleep10-21swapper/123:30:131
1406255210,0sleep20-21swapper/223:30:022
1405006210,0sleep20-21swapper/223:25:172
1402735210,0sleep10-21swapper/123:20:161
1402425210,1sleep20-21swapper/223:20:132
1400295210,0sleep10-21swapper/123:15:161
1400135210,0sleep21400163-21apt-get23:15:132
1398200210,0sleep20-21swapper/223:10:132
1398107210,0sleep10-21swapper/123:10:111
1396744210,0sleep20-21swapper/223:05:202
1395887210,0sleep10-21swapper/123:05:031
1394030210,0sleep20-21swapper/223:00:162
1393918210,0sleep10-21swapper/123:00:151
1392107210,0sleep20-21swapper/222:55:152
1391654210,0sleep10-21swapper/122:55:101
1389809210,0sleep10-21swapper/122:50:141
1389542210,0sleep21389568-21apt-get22:50:112
1387691210,0sleep10-21swapper/122:45:141
1386228210,0sleep20-21swapper/222:40:222
1383155210,0sleep10-21swapper/122:35:061
1381845210,0sleep20-21swapper/222:30:222
1378938210,0sleep10-21swapper/122:25:121
1378689210,0sleep20-21swapper/222:25:022
1377241210,0sleep10-21swapper/122:20:131
1375257210,0sleep10-21swapper/122:15:161
1375046210,0sleep20-21swapper/222:15:132
1372831210,0sleep10-21swapper/122:10:151
1372591210,0sleep20-21swapper/222:10:132
1371212210,0sleep20-21swapper/222:05:202
1370447210,0sleep10-21swapper/122:05:121
1369652210,0sleep20-21swapper/222:00:252
1368354210,0sleep10-21swapper/122:00:121
1366424210,0sleep10-21swapper/121:55:141
1364356210,0sleep10-21swapper/121:50:151
1364093210,0sleep20-21swapper/221:50:112
1362426210,0sleep20-21swapper/221:45:202
1361998210,0sleep10-21swapper/121:45:151
1360097210,0sleep20-21swapper/221:40:202
1357605210,0sleep20-21swapper/221:35:182
1357542210,0sleep10-21swapper/121:35:181
1355468210,0sleep10-21swapper/121:30:181
1355350210,0sleep20-21swapper/221:30:152
1353461210,0sleep20-21swapper/221:25:152
1353339210,0sleep10-21swapper/121:25:131
1352706210,0sleep10-21swapper/121:22:541
1351084210,0sleep20-21swapper/221:20:092
1348974210,0sleep20-21swapper/221:15:142
1348934210,0sleep10-21swapper/121:15:131
1346555210,0sleep10-21swapper/121:10:001
1345493210,0sleep10-21swapper/121:05:211
1343244210,0sleep10-21swapper/121:00:161
1342632210,0sleep20-21swapper/221:00:012
1340994210,0sleep10-21swapper/120:55:111
1340709210,0sleep20-21swapper/220:55:012
1339544210,0sleep20-21swapper/220:50:162
1339522210,0sleep10-21swapper/120:50:161
1337543210,0sleep20-21swapper/220:45:172
1337376210,0sleep10-21swapper/120:45:161
1335336210,0sleep20-21swapper/220:40:122
1335241210,0sleep10-21swapper/120:40:111
1333272210,0sleep20-21swapper/220:35:112
1333232210,0sleep10-21swapper/120:35:111
1329807210,0sleep10-21swapper/120:25:151
1329382210,0sleep20-21swapper/220:25:122
1327616210,0sleep20-21swapper/220:20:142
1327521210,0sleep10-21swapper/120:20:131
1323450210,0sleep20-21swapper/220:10:152
1323356210,0sleep10-21swapper/120:10:141
1321833210,0sleep10-21swapper/120:05:171
1321495210,0sleep20-21swapper/220:05:132
1319212210,0sleep10-21swapper/120:00:011
1318216210,0sleep20-21swapper/219:55:222
1317288210,0sleep10-21swapper/119:55:011
1315880210,0sleep10-21swapper/119:50:161
1315367210,0sleep20-21swapper/219:50:012
1315140210,0sleep10-21swapper/119:47:081
1313792210,0sleep20-21swapper/219:45:132
1312440210,0sleep10-21swapper/119:40:161
1311266210,0sleep20-21swapper/219:37:042
1309617210,0sleep20-21swapper/219:30:132
1309190210,0sleep10-21swapper/119:30:081
1308863210,0sleep20-21swapper/219:28:572
1308679210,0sleep10-21swapper/119:26:351
1307088210,0sleep20-21swapper/219:20:112
1307075210,0sleep10-21swapper/119:20:111
1306161210,0sleep10-21swapper/119:17:151
1303675210,0sleep20-21swapper/219:10:122
1303615210,0sleep10-21swapper/119:10:101
1311110200,0sleep10-21swapper/119:35:031
1305987200,0sleep20-21swapper/219:15:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional