You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-18 - 20:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Sat Oct 18, 2025 12:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
101980099139,2cyclictest0-21swapper/312:00:143
101980099130,11cyclictest0-21swapper/311:15:163
1019800991211,0cyclictest0-21swapper/311:20:143
101980099120,1cyclictest0-21swapper/309:10:133
101980099120,11cyclictest69450irq/121-eno109:25:143
101980099120,11cyclictest0-21swapper/311:25:023
101980099120,11cyclictest0-21swapper/308:10:203
101980099119,1cyclictest0-21swapper/307:30:133
1019800991111,0cyclictest69450irq/121-eno110:15:283
1019800991110,0cyclictest69450irq/121-eno112:25:103
101980099110,9cyclictest1050199-21taskset08:25:173
101980099110,10cyclictest69450irq/121-eno112:10:153
101980099110,10cyclictest69450irq/121-eno111:50:203
101980099110,10cyclictest69450irq/121-eno110:05:123
101980099110,10cyclictest69450irq/121-eno109:48:403
101980099110,10cyclictest0-21swapper/312:05:163
101980099110,10cyclictest0-21swapper/310:25:133
101980099110,10cyclictest0-21swapper/310:20:253
101980099110,0cyclictest0-21swapper/310:00:203
101980099110,0cyclictest0-21swapper/309:00:163
101980099110,0cyclictest0-21swapper/308:30:173
101980099108,1cyclictest0-21swapper/311:40:143
101980099108,1cyclictest0-21swapper/309:20:013
101980099106,2cyclictest0-21swapper/311:30:143
1019800991010,0cyclictest69450irq/121-eno112:20:183
1019800991010,0cyclictest69450irq/121-eno109:58:233
1019800991010,0cyclictest69450irq/121-eno108:15:463
1019800991010,0cyclictest69450irq/121-eno107:50:143
1019800991010,0cyclictest69450irq/121-eno107:15:163
1019800991010,0cyclictest0-21swapper/308:55:143
101980099100,9cyclictest69450irq/121-eno111:58:403
101980099100,9cyclictest69450irq/121-eno111:35:163
101980099100,9cyclictest69450irq/121-eno109:05:143
101980099100,9cyclictest69450irq/121-eno108:00:153
101980099100,9cyclictest0-21swapper/310:55:233
101980099100,10cyclictest0-21swapper/307:50:003
101980099100,0cyclictest0-21swapper/311:05:013
10198009999,0cyclictest69450irq/121-eno112:38:343
10198009999,0cyclictest69450irq/121-eno110:45:153
10198009999,0cyclictest69450irq/121-eno110:36:563
10198009999,0cyclictest0-21swapper/310:55:013
10198009999,0cyclictest0-21swapper/309:35:013
10198009999,0cyclictest0-21swapper/308:40:013
10198009998,1cyclictest69450irq/121-eno108:54:423
10198009998,0cyclictest0-21swapper/310:40:263
10198009990,8cyclictest69450irq/121-eno112:31:073
10198009990,8cyclictest69450irq/121-eno109:35:433
10198009990,8cyclictest0-21swapper/307:10:213
10198009988,0cyclictest69450irq/121-eno110:10:073
10198009988,0cyclictest69450irq/121-eno109:52:593
10198009988,0cyclictest69450irq/121-eno109:20:183
10198009988,0cyclictest69450irq/121-eno107:55:203
10198009988,0cyclictest69450irq/121-eno107:25:163
10198009980,7cyclictest69450irq/121-eno111:02:503
10198009980,7cyclictest69450irq/121-eno110:30:023
10198009980,7cyclictest69450irq/121-eno108:20:143
10198009980,7cyclictest0-21swapper/311:10:153
10198009977,0cyclictest0-21swapper/307:40:203
10198009970,6cyclictest69450irq/121-eno112:15:093
10198009970,6cyclictest69450irq/121-eno108:35:133
10198009970,6cyclictest69450irq/121-eno107:20:223
10198009966,0cyclictest69450irq/121-eno109:40:243
10198009966,0cyclictest0-21swapper/307:39:553
10198009960,6cyclictest69450irq/121-eno108:05:203
10198009960,0cyclictest0-21swapper/311:45:173
1017747261,3sleep30-21swapper/307:05:003
10198009955,0cyclictest0-21swapper/308:45:203
1117496240,3sleep11117500-21ssh11:08:071
1019621242,1sleep10-21swapper/107:09:361
1017983242,1sleep20-21swapper/207:05:042
1118455230,1sleep01118591-21memory11:10:220
1079878230,1sleep01079904-21apt-get09:40:120
1062082230,2sleep01061589-21/usr/sbin/munin08:55:170
1055851230,1sleep11055877-21apt-get08:40:131
1022337230,1sleep11022363-21apt-get07:15:121
1017981231,1sleep00-21swapper/007:05:020
1154723220,1sleep21154886-21cpuspeed_turbos12:35:172
1149530220,1sleep00-21swapper/012:21:460
1137049220,1sleep00-21swapper/011:55:010
1133130220,1sleep01133156-21apt-get11:45:120
1129708220,1sleep11129789-21awk11:35:241
1126452220,1sleep00-21swapper/011:28:510
1109015220,0sleep20-21swapper/210:49:312
1102365221,1sleep11097929-21kworker/u16:3+xprtiod10:31:081
1100454220,1sleep21100912-21apt-key10:30:012
1091076220,1sleep00-21swapper/010:05:260
1086070220,1sleep11086096-21apt-get09:55:141
1085656220,1sleep20-21swapper/209:53:392
1085155220,1sleep00-21swapper/009:50:210
1077849220,1sleep11077875-21apt-get09:35:131
1072354220,1sleep01072410-21ntp_states09:20:190
1071096220,1sleep21071208-21sort09:20:012
1062235220,1sleep11062366-21/usr/sbin/munin08:55:181
1057764220,1sleep10-21swapper/108:45:141
1056814220,0sleep00-21swapper/008:40:200
1051748220,0sleep11051774-21apt-get08:30:171
1050872220,1sleep01051122-21users08:25:240
1049318220,1sleep11049360-21apt-config08:25:001
1036917220,1sleep00-21swapper/007:50:210
1155219210,0sleep10-21swapper/112:35:201
1154587210,0sleep00-21swapper/012:35:070
1153660210,0sleep10-21swapper/112:31:201
1153014210,1sleep00-21swapper/012:30:190
1152242210,0sleep20-21swapper/212:30:132
1151496210,0sleep10-21swapper/112:25:441
1150445210,0sleep00-21swapper/012:25:190
1150180210,0sleep20-21swapper/212:25:162
1149502210,0sleep20-21swapper/212:21:322
1146984210,0sleep10-21swapper/112:15:231
1145865210,0sleep20-21swapper/212:15:162
1142944210,0sleep10-21swapper/112:06:341
1141936210,0sleep20-21swapper/212:05:192
1141248210,0sleep00-21swapper/012:05:010
1141148210,0sleep10-21swapper/112:04:101
1140943210,1sleep00-21swapper/012:02:210
1139455210,0sleep20-21swapper/212:00:152
1139102210,0sleep20-21swapper/211:59:432
1138607210,0sleep10-21swapper/111:55:221
1137301210,0sleep00-21swapper/011:55:130
1136523210,0sleep10-21swapper/111:50:251
1135204210,0sleep20-21swapper/211:50:102
1133917210,0sleep20-21swapper/211:45:172
1133159210,0sleep10-21swapper/111:45:131
1132625210,0sleep20-21swapper/211:42:502
1131285210,0sleep10-21swapper/111:40:171
1131119210,0sleep00-21swapper/011:40:160
1130559210,0sleep20-21swapper/211:38:102
1127492210,0sleep00-21swapper/011:30:190
1126969210,0sleep10-21swapper/111:30:161
1126840210,0sleep20-21swapper/211:30:132
1126059210,0sleep10-21swapper/111:25:241
1123274210,0sleep01113800-21kworker/u16:3+rpciod11:20:230
1122446210,0sleep10-21swapper/111:20:151
1122385210,0sleep20-21swapper/211:20:042
1120227210,0sleep10-21swapper/111:15:191
1120041210,0sleep20-21swapper/211:15:162
1119783210,0sleep00-21swapper/011:15:020
1118592210,0sleep10-21swapper/111:10:231
1118096210,0sleep20-21swapper/211:10:202
1115890210,0sleep20-21swapper/211:05:162
1115634210,0sleep00-21swapper/011:05:020
1115443210,0sleep10-21swapper/111:03:221
1115123210,0sleep20-21swapper/211:00:352
1114520210,0sleep00-21swapper/011:00:210
1113506210,0sleep20-21swapper/210:59:552
1111694210,0sleep00-21swapper/010:55:170
1110792210,0sleep20-21swapper/210:51:432
1109318210,0sleep00-21swapper/010:50:050
1109078210,0sleep10-21swapper/110:50:021
1107768210,0sleep10-21swapper/110:45:171
1107685210,1sleep00-21swapper/010:45:160
1106680210,0sleep10-21swapper/110:42:171
1106475210,0sleep20-21swapper/210:40:342
1105154210,0sleep00-21swapper/010:40:080
1104437210,0sleep10-21swapper/110:36:011
1103185210,0sleep20-21swapper/210:35:182
1103063210,0sleep00-21swapper/010:35:160
1100968210,1sleep00-21swapper/010:30:110
1099160210,0sleep10-21swapper/110:25:201
1098793210,0sleep20-21swapper/210:25:172
1098118210,0sleep00-21swapper/010:22:430
1097891210,0sleep10-21swapper/110:20:441
1097174210,0sleep20-21swapper/210:20:212
1094950210,0sleep20-21swapper/210:15:162
1094867210,0sleep10-21swapper/110:15:151
1094619210,0sleep00-21swapper/010:15:130
1093803210,0sleep20-21swapper/210:11:402
1092856210,0sleep10-21swapper/110:10:191
1092349210,0sleep00-21swapper/010:10:140
1090791210,0sleep10-21swapper/110:05:231
1089089210,1sleep00-21swapper/010:00:210
1088193210,0sleep10-21swapper/110:00:131
1086720210,0sleep20-21swapper/209:55:192
1086496210,0sleep00-21swapper/009:55:170
1085414210,0sleep10-21swapper/109:51:261
1081967210,0sleep20-21swapper/209:45:142
1081936210,0sleep10-21swapper/109:45:131
1081903210,0sleep00-21swapper/009:45:120
1081607210,0sleep10-21swapper/109:44:371
1080601210,0sleep20-21swapper/209:40:222
1079441210,1sleep00-21swapper/009:38:160
1078894210,0sleep20-21swapper/209:35:222
1077168210,0sleep10-21swapper/109:30:251
1076483210,0sleep20-21swapper/209:30:172
1076285210,0sleep00-21swapper/009:30:150
1073602210,0sleep20-21swapper/209:25:132
1073597210,0sleep10-21swapper/109:25:121
1072967210,0sleep10-21swapper/109:20:431
1072961210,0sleep20-21swapper/209:20:412
1070773210,0sleep10-21swapper/109:16:441
1069467210,0sleep01-21systemd09:15:150
1068743210,1sleep00-21swapper/009:11:140
1068524210,0sleep10-21swapper/109:10:231
1065436210,0sleep10-21swapper/109:05:151
1064156210,0sleep10-21swapper/109:00:311
1064003210,0sleep00-21swapper/009:00:300
1061711210,0sleep20-21swapper/208:55:152
1060982210,0sleep20-21swapper/208:50:272
1060973210,0sleep00-21swapper/008:50:210
1059797210,0sleep10-21swapper/108:50:141
1058189210,0sleep00-21swapper/008:45:170
1057793210,0sleep20-21swapper/208:45:152
1054237210,0sleep20-21swapper/208:35:182
1053921210,0sleep00-21swapper/008:35:160
1049892210,0sleep10-21swapper/108:25:161
1049828210,0sleep21049857-21sshd08:25:122
1045603210,0sleep20-21swapper/208:15:332
1045599210,0sleep00-21swapper/008:15:310
1044341210,0sleep10-21swapper/108:10:201
1043600210,0sleep00-21swapper/008:10:150
1043280210,1sleep00-21swapper/008:09:510
1041628210,0sleep10-21swapper/108:05:111
1040762210,0sleep20-21swapper/208:00:202
1040608210,0sleep00-21swapper/008:00:180
1039267210,0sleep10-21swapper/107:57:431
1039128210,0sleep00-21swapper/007:55:540
1039086210,0sleep20-21swapper/207:55:242
1037267210,0sleep10-21swapper/107:51:341
1035094210,0sleep10-21swapper/107:45:221
1034580210,0sleep20-21swapper/207:45:182
1033712210,0sleep00-21swapper/007:45:010
1033353210,0sleep00-21swapper/007:40:250
1032501210,0sleep20-21swapper/207:40:192
1030918210,0sleep00-21swapper/007:35:200
1030043210,0sleep20-21swapper/207:35:142
1030014210,0sleep10-21swapper/107:35:131
1028539210,0sleep00-21swapper/007:30:160
1028160210,0sleep20-21swapper/207:30:142
1027856210,0sleep10-21swapper/107:30:011
1027033210,0sleep00-21swapper/007:25:200
1026626210,0sleep10-21swapper/107:25:171
1026188210,0sleep20-21swapper/207:25:142
1025062210,0sleep00-21swapper/007:20:200
1024274210,0sleep20-21swapper/207:20:142
1023108210,0sleep00-21swapper/007:15:190
1021619210,0sleep10-21swapper/107:15:001
1020539210,0sleep00-21swapper/007:10:190
1148040200,0sleep10-21swapper/112:20:031
1145658200,0sleep00-21swapper/012:15:020
1143571200,0sleep20-21swapper/212:10:042
1143570200,0sleep10-21swapper/112:10:031
1143358200,0sleep00-21swapper/012:10:020
1128916200,0sleep00-21swapper/011:35:020
1124735200,0sleep20-21swapper/211:25:052
1111172200,0sleep10-21swapper/110:55:021
1098617200,0sleep00-21swapper/010:25:030
1090251200,0sleep20-21swapper/210:05:042
1088162200,0sleep20-21swapper/210:00:032
1073582200,0sleep00-21swapper/009:25:030
1067337200,0sleep20-21swapper/209:10:042
1065422200,0sleep20-21swapper/209:05:032
1065420200,0sleep00-21swapper/009:05:020
1063509200,0sleep20-21swapper/209:00:042
1055837200,0sleep20-21swapper/208:40:022
1053408200,0sleep10-21swapper/108:35:011
1051730200,0sleep00-21swapper/008:30:040
1051727200,0sleep20-21swapper/208:30:022
1047641200,0sleep00-21swapper/008:20:030
1047122200,0sleep20-21swapper/208:20:012
1045443200,0sleep10-21swapper/108:15:041
1043294200,0sleep20-21swapper/208:10:012
1041619200,0sleep20-21swapper/208:05:042
1039705200,0sleep10-21swapper/108:00:021
1035858200,0sleep20-21swapper/207:50:032
1032032200,0sleep10-21swapper/107:40:021
1024003200,0sleep10-21swapper/107:20:001
1021826200,0sleep20-21swapper/207:15:012
1019658200,0sleep20-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional