You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 02:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Fri Apr 19, 2024 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
100815499142,11cyclictest0-21swapper/322:40:133
100815499129,1cyclictest0-21swapper/300:25:123
100815499120,11cyclictest0-21swapper/300:15:013
1008154991111,0cyclictest0-21swapper/322:20:113
1008154991111,0cyclictest0-21swapper/321:20:013
1008154991110,1cyclictest0-21swapper/323:32:143
100815499110,11cyclictest0-21swapper/322:19:523
100815499110,0cyclictest0-21swapper/319:55:093
100815499110,0cyclictest0-21swapper/300:05:143
1008154991010,0cyclictest0-21swapper/323:45:173
1008154991010,0cyclictest0-21swapper/320:50:013
100815499100,10cyclictest0-21swapper/323:20:113
100815499100,10cyclictest0-21swapper/320:45:013
100815499100,10cyclictest0-21swapper/320:05:163
100815499100,10cyclictest0-21swapper/319:30:233
100815499100,0cyclictest0-21swapper/322:35:013
100815499100,0cyclictest0-21swapper/322:25:073
100815499100,0cyclictest0-21swapper/321:55:223
100815499100,0cyclictest0-21swapper/320:55:173
100815499100,0cyclictest0-21swapper/320:30:183
10081549999,0cyclictest0-21swapper/320:24:563
10081549999,0cyclictest0-21swapper/320:00:123
10081549999,0cyclictest0-21swapper/319:24:563
10081549990,9cyclictest0-21swapper/319:45:113
10081549990,8cyclictest0-21swapper/320:55:013
10081549990,0cyclictest0-21swapper/322:00:143
10081549988,0cyclictest0-21swapper/323:26:543
10081549988,0cyclictest0-21swapper/323:10:113
10081549988,0cyclictest0-21swapper/322:56:333
10081549988,0cyclictest0-21swapper/322:10:013
10081549988,0cyclictest0-21swapper/321:00:203
10081549988,0cyclictest0-21swapper/319:10:113
10081549987,1cyclictest1043096-21taskset20:38:163
10081549980,7cyclictest0-21swapper/323:15:143
13129870,3rtkit-daemon617-21gmain19:09:590
10081549977,0cyclictest0-21swapper/323:40:123
10081549977,0cyclictest0-21swapper/322:35:123
10081549977,0cyclictest0-21swapper/321:25:133
10081549977,0cyclictest0-21swapper/321:10:143
10081549977,0cyclictest0-21swapper/320:25:123
10081549977,0cyclictest0-21swapper/320:10:113
10081549976,1cyclictest0-21swapper/322:50:123
10081549970,0cyclictest0-21swapper/321:30:583
10081549970,0cyclictest0-21swapper/319:50:203
1007616272,3sleep20-21swapper/219:05:232
10081549966,0cyclictest0-21swapper/323:35:183
10081549966,0cyclictest0-21swapper/323:01:523
10081549966,0cyclictest0-21swapper/319:37:013
10081549964,2cyclictest1125954-21sleep23:55:013
10081549960,5cyclictest0-21swapper/321:35:123
13129850,2rtkit-daemon717-21lldpd21:56:150
13129850,1rtkit-daemon717-21lldpd22:24:500
10081549955,0cyclictest0-21swapper/323:55:123
10081549955,0cyclictest0-21swapper/323:05:193
10081549955,0cyclictest0-21swapper/321:40:103
10081549955,0cyclictest0-21swapper/321:21:093
10081549955,0cyclictest0-21swapper/319:15:103
10081549955,0cyclictest0-21swapper/300:15:053
10081549954,0cyclictest0-21swapper/300:00:113
10081549951,4cyclictest0-21swapper/322:06:493
1007978250,2sleep30-21swapper/319:09:563
1005825251,2sleep10-21swapper/119:05:011
13129840,2rtkit-daemon717-21lldpd22:33:500
13129840,2rtkit-daemon538-21systemd-logind21:47:290
13129840,2rtkit-daemon3191333-21snmpd22:09:570
13129840,1rtkit-daemon717-21lldpd23:37:510
13129840,1rtkit-daemon356-21systemd-journal23:53:300
13129840,1rtkit-daemon1028092-21apt-get20:00:120
13129840,1rtkit-daemon1010147-21munin-node22:40:050
13129840,0rtkit-daemon0-21swapper/022:38:440
13129840,0rtkit-daemon0-21swapper/021:10:510
1145019240,0sleep00-21swapper/000:35:270
10081549944,0cyclictest0-21swapper/322:45:103
10081549944,0cyclictest0-21swapper/321:05:123
10081549944,0cyclictest0-21swapper/300:35:123
10081549940,4cyclictest0-21swapper/320:15:113
10081549940,4cyclictest0-21swapper/319:30:013
10081549940,3cyclictest0-21swapper/321:51:083
10081549940,3cyclictest0-21swapper/321:46:013
10081549940,3cyclictest0-21swapper/319:40:293
13129830,1rtkit-daemon717-21lldpd23:15:500
13129830,1rtkit-daemon717-21lldpd22:45:350
13129830,1rtkit-daemon717-21lldpd20:53:480
13129830,1rtkit-daemon717-21lldpd20:22:510
13129830,1rtkit-daemon714-21ntpd00:07:030
13129830,1rtkit-daemon617-21gmain21:31:390
13129830,1rtkit-daemon617-21gmain19:40:150
13129830,1rtkit-daemon539-21wpa_supplicant21:38:560
13129830,1rtkit-daemon538-21systemd-logind19:12:090
13129830,1rtkit-daemon375-21systemd-udevd19:46:290
13129830,1rtkit-daemon356-21systemd-journal22:03:530
13129830,1rtkit-daemon356-21systemd-journal21:50:290
13129830,1rtkit-daemon356-21systemd-journal19:51:530
13129830,1rtkit-daemon356-21systemd-journal00:04:560
13129830,1rtkit-daemon3191333-21snmpd23:55:160
13129830,1rtkit-daemon3191333-21snmpd23:21:390
13129830,1rtkit-daemon3191333-21snmpd23:01:550
13129830,1rtkit-daemon269977-21sendmail-mta22:28:580
13129830,1rtkit-daemon269977-21sendmail-mta20:45:130
13129830,1rtkit-daemon269977-21sendmail-mta00:15:330
13129830,1rtkit-daemon1-21systemd23:46:010
13129830,1rtkit-daemon1-21systemd23:10:060
13129830,1rtkit-daemon1-21systemd22:57:210
13129830,1rtkit-daemon1-21systemd22:50:380
13129830,1rtkit-daemon1-21systemd22:16:440
13129830,1rtkit-daemon1-21systemd22:11:210
13129830,1rtkit-daemon1-21systemd21:41:530
13129830,1rtkit-daemon1-21systemd21:27:410
13129830,1rtkit-daemon1-21systemd21:15:420
13129830,1rtkit-daemon1-21systemd21:01:550
13129830,1rtkit-daemon1-21systemd19:55:060
13129830,1rtkit-daemon1-21systemd19:25:180
13129830,1rtkit-daemon1-21systemd00:25:380
13129830,1rtkit-daemon1-21systemd00:21:000
13129830,1rtkit-daemon1-21systemd00:12:220
13129830,1rtkit-daemon1035594-21cat20:20:010
13129830,1rtkit-daemon1010147-21munin-node23:40:160
13129830,1rtkit-daemon1010147-21munin-node19:15:030
1107075230,2sleep10-21swapper/123:10:111
1072845230,1sleep10-21swapper/121:50:111
1068614230,1sleep11068640-21apt-get21:40:101
1055337230,1sleep21055363-21apt-get21:10:132
10081549930,0cyclictest0-21swapper/300:30:063
10081549930,0cyclictest0-21swapper/300:20:073
13129820,1rtkit-daemon714-21ntpd00:30:120
13129820,1rtkit-daemon3191333-21snmpd20:10:260
13129820,1rtkit-daemon3191333-21snmpd19:30:010
13129820,1rtkit-daemon269977-21sendmail-mta20:30:030
13129820,1rtkit-daemon1-21systemd21:05:100
13129820,1rtkit-daemon1-21systemd20:55:090
13129820,1rtkit-daemon1-21systemd20:40:130
13129820,1rtkit-daemon1-21systemd20:05:550
13129820,1rtkit-daemon1-21systemd19:35:130
13129820,1rtkit-daemon1-21systemd19:20:090
13129820,1rtkit-daemon1010147-21munin-node23:30:420
13129820,1rtkit-daemon1010147-21munin-node21:21:530
13129820,1rtkit-daemon1010147-21munin-node20:35:090
13129820,0rtkit-daemon1311-21rtkit-daemon23:25:330
13129820,0rtkit-daemon0-21swapper/023:05:210
13129820,0rtkit-daemon0-21swapper/020:25:180
1142356220,1sleep11142392-21pmu-power00:30:191
1138840220,0sleep20-21swapper/200:24:082
1133655220,1sleep11133872-21users00:10:221
1129455220,1sleep11129577-21grep00:00:211
1122783220,1sleep11122930-21sensors_temp23:45:201
1120597220,0sleep20-21swapper/223:40:182
1115638220,1sleep10-21swapper/123:30:111
1111775220,1sleep11111842-21interrupts23:20:161
1109269220,1sleep10-21swapper/123:15:141
1105247220,1sleep11105392-21diskstats23:05:151
1104380220,1sleep10-21swapper/123:02:141
1103348220,1sleep21103456-21memory23:00:162
1080572220,1sleep20-21swapper/222:05:412
1047894220,1sleep21048066-21strings20:50:162
1026124220,0sleep20-21swapper/219:55:092
1025859220,0sleep10-21swapper/119:54:521
1020408220,1sleep21020534-21cpu19:40:132
1019131220,1sleep11019200-21awk19:35:191
1144144210,0sleep20-21swapper/200:35:172
1144121210,0sleep10-21swapper/100:35:161
1142028210,0sleep20-21swapper/200:30:172
1139829210,0sleep10-21swapper/100:25:151
1139458210,0sleep20-21swapper/200:25:122
1137515210,0sleep10-21swapper/100:20:151
1135460210,0sleep20-21swapper/200:15:202
1134972210,0sleep10-21swapper/100:15:151
1132560210,0sleep20-21swapper/200:10:112
1130511210,0sleep20-21swapper/200:05:152
1130453210,0sleep10-21swapper/100:05:141
1128331210,0sleep20-21swapper/200:00:112
1127631210,0sleep10-21swapper/123:56:301
1126549210,0sleep20-21swapper/223:55:152
1124297210,0sleep20-21swapper/223:50:142
1124049210,0sleep10-21swapper/123:50:051
1121793210,0sleep20-21swapper/223:45:022
1119917210,0sleep10-21swapper/123:40:131
1117821210,0sleep10-21swapper/123:35:121
1117439210,0sleep20-21swapper/223:35:012
1115316210,0sleep20-21swapper/223:30:012
1113442210,0sleep20-21swapper/223:25:092
1113436210,0sleep10-21swapper/123:25:041
1111326210,0sleep20-21swapper/223:20:092
1110069210,0sleep20-21swapper/223:15:242
1107104210,0sleep20-21swapper/223:10:122
1104960210,0sleep20-21swapper/223:05:122
1101486210,0sleep10-21swapper/122:55:181
1100702210,0sleep20-21swapper/222:55:112
1099206210,0sleep20-21swapper/222:50:192
1098683210,0sleep10-21swapper/122:50:141
1096471210,0sleep20-21swapper/222:45:112
1096257210,0sleep10-21swapper/122:45:011
1095032210,0sleep20-21swapper/222:40:182
1094080210,0sleep10-21swapper/122:40:011
1093691210,0sleep20-21swapper/222:36:462
1092271210,0sleep10-21swapper/122:35:131
1091665210,0sleep20-21swapper/222:32:342
1089838210,0sleep10-21swapper/122:30:001
1088401210,0sleep20-21swapper/222:25:142
1088157210,0sleep10-21swapper/122:25:131
1086471210,0sleep10-21swapper/122:20:161
1086021210,0sleep20-21swapper/222:20:132
1084459210,0sleep20-21swapper/222:15:172
1084325210,0sleep10-21swapper/122:15:151
1083054210,0sleep20-21swapper/222:11:332
1082750210,0sleep10-21swapper/122:10:201
1079484210,0sleep10-21swapper/122:05:151
1078095210,0sleep10-21swapper/122:00:231
1077295210,0sleep20-21swapper/222:00:162
1075579210,0sleep10-21swapper/121:55:191
1075224210,0sleep20-21swapper/221:55:162
1072874210,0sleep20-21swapper/221:50:122
1071153210,0sleep10-21swapper/121:45:141
1070734210,0sleep20-21swapper/221:45:112
1068643210,0sleep20-21swapper/221:40:112
1066640210,0sleep20-21swapper/221:35:152
1066376210,0sleep10-21swapper/121:35:141
1064286210,0sleep20-21swapper/221:30:152
1064269210,0sleep10-21swapper/121:30:141
1061759210,0sleep20-21swapper/221:25:142
1061730210,0sleep10-21swapper/121:25:131
1060003210,0sleep10-21swapper/121:20:131
1059604210,0sleep20-21swapper/221:20:102
1057548210,0sleep10-21swapper/121:15:131
1057205210,0sleep20-21swapper/221:15:022
1055496210,0sleep10-21swapper/121:10:161
1053633210,0sleep20-21swapper/221:05:172
1053585210,0sleep10-21swapper/121:05:161
1051663210,0sleep10-21swapper/121:00:161
1051228210,0sleep20-21swapper/221:00:132
1049426210,0sleep20-21swapper/220:55:132
1047438210,0sleep10-21swapper/120:50:111
1045862210,0sleep20-21swapper/220:45:162
1045682210,0sleep10-21swapper/120:45:151
1044958210,0sleep20-21swapper/220:42:122
1044234210,0sleep10-21swapper/120:40:191
1041982210,0sleep20-21swapper/220:35:162
1041712210,0sleep10-21swapper/120:35:151
1039630210,0sleep10-21swapper/120:30:101
1037744210,1sleep20-21swapper/220:25:112
1037699210,0sleep10-21swapper/120:25:061
1036041210,0sleep20-21swapper/220:20:152
1035908210,0sleep10-21swapper/120:20:141
1034211210,0sleep20-21swapper/220:15:132
1033959210,0sleep10-21swapper/120:15:131
1031910210,1sleep20-21swapper/220:10:102
1031666210,0sleep10-21swapper/120:10:011
1030418210,0sleep20-21swapper/220:05:142
1029742210,0sleep10-21swapper/120:05:011
1028522210,0sleep10-21swapper/120:00:171
1027797210,0sleep20-21swapper/220:00:012
1026540210,0sleep10-21swapper/119:55:121
1023950210,0sleep20-21swapper/219:50:012
1022268210,0sleep10-21swapper/119:45:081
1022027210,0sleep20-21swapper/219:45:002
1020349210,0sleep10-21swapper/119:40:121
1018407210,0sleep20-21swapper/219:35:122
1017788210,0sleep20-21swapper/219:30:232
1016576210,0sleep10-21swapper/119:30:151
1015162210,0sleep10-21swapper/119:25:151
1014814210,0sleep20-21swapper/219:25:122
1013308210,0sleep10-21swapper/119:20:191
1013057210,0sleep20-21swapper/219:20:162
1011229210,0sleep20-21swapper/219:15:152
1010683210,0sleep10-21swapper/119:15:101
1009087210,0sleep10-21swapper/119:10:181
1008301210,0sleep20-21swapper/219:10:112
1049262200,0sleep10-21swapper/120:55:041
1039621200,0sleep20-21swapper/220:30:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional