You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-19 - 13:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Wed Jun 19, 2024 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1694199120,11cyclictest0-21swapper/319:50:123
1694199120,11cyclictest0-21swapper/319:25:123
16941991111,0cyclictest0-21swapper/320:25:123
1694199110,11cyclictest0-21swapper/323:50:283
1694199110,11cyclictest0-21swapper/321:20:113
1694199110,11cyclictest0-21swapper/321:15:123
1694199110,11cyclictest0-21swapper/320:15:133
1694199110,0cyclictest0-21swapper/323:20:103
1694199109,1cyclictest0-21swapper/319:20:103
1694199108,1cyclictest0-21swapper/319:15:123
16941991010,0cyclictest0-21swapper/323:15:133
16941991010,0cyclictest0-21swapper/322:55:123
16941991010,0cyclictest0-21swapper/322:10:143
16941991010,0cyclictest0-21swapper/320:05:003
1694199100,10cyclictest0-21swapper/323:05:143
1694199100,10cyclictest0-21swapper/320:40:003
1694199100,0cyclictest0-21swapper/323:30:213
1694199100,0cyclictest0-21swapper/321:50:203
1694199100,0cyclictest0-21swapper/321:45:133
1694199100,0cyclictest0-21swapper/300:20:133
169419999,0cyclictest0-21swapper/322:27:513
169419999,0cyclictest0-21swapper/321:43:553
169419999,0cyclictest0-21swapper/319:40:123
169419999,0cyclictest0-21swapper/319:10:083
169419990,9cyclictest0-21swapper/323:55:103
169419990,9cyclictest0-21swapper/319:30:263
169419990,9cyclictest0-21swapper/300:20:003
169419990,9cyclictest0-21swapper/300:05:243
169419988,0cyclictest0-21swapper/321:30:013
169419988,0cyclictest0-21swapper/320:55:263
169419980,8cyclictest0-21swapper/320:10:203
169419977,0cyclictest0-21swapper/322:55:013
169419977,0cyclictest0-21swapper/322:40:013
13129870,3rtkit-daemon1-21systemd19:09:090
169419966,0cyclictest0-21swapper/323:44:443
169419966,0cyclictest0-21swapper/322:45:143
169419966,0cyclictest0-21swapper/322:15:013
169419966,0cyclictest0-21swapper/300:28:403
169419960,6cyclictest0-21swapper/300:10:203
15084261,4sleep30-21swapper/319:05:033
169419955,0cyclictest0-21swapper/323:10:143
169419955,0cyclictest0-21swapper/322:30:303
169419955,0cyclictest0-21swapper/321:00:133
169419955,0cyclictest0-21swapper/320:40:123
169419955,0cyclictest0-21swapper/320:05:033
169419955,0cyclictest0-21swapper/300:35:143
169419950,5cyclictest0-21swapper/322:05:223
169419950,5cyclictest0-21swapper/300:33:333
16460250,1sleep20-21swapper/219:06:032
13129850,2rtkit-daemon356-21systemd-journal23:19:572
18650243,1sleep114885-21kworker/1:119:13:331
169419944,0cyclictest0-21swapper/323:35:193
169419944,0cyclictest0-21swapper/323:00:483
169419944,0cyclictest0-21swapper/322:40:273
169419944,0cyclictest0-21swapper/321:39:563
169419944,0cyclictest0-21swapper/320:48:593
169419944,0cyclictest0-21swapper/320:33:003
169419941,2cyclictest0-21swapper/321:05:143
169419941,2cyclictest0-21swapper/319:45:123
15087241,2sleep10-21swapper/119:05:051
13129840,2rtkit-daemon717-21lldpd22:41:492
13129840,2rtkit-daemon538-21systemd-logind22:52:302
13129840,2rtkit-daemon375-21systemd-udevd19:50:290
13129840,2rtkit-daemon356-21systemd-journal23:46:302
13129840,2rtkit-daemon356-21systemd-journal21:09:572
13129840,1rtkit-daemon717-21lldpd21:57:512
13129840,1rtkit-daemon375-21systemd-udevd23:34:292
13129840,1rtkit-daemon375-21systemd-udevd20:50:302
88151230,1sleep188177-21apt-get22:05:111
169419933,0cyclictest0-21swapper/323:45:123
169419933,0cyclictest0-21swapper/322:20:133
169419933,0cyclictest0-21swapper/321:27:473
169419933,0cyclictest0-21swapper/319:56:263
169419933,0cyclictest0-21swapper/300:00:013
169419931,1cyclictest0-21swapper/323:25:113
169419931,1cyclictest0-21swapper/320:50:143
169419931,1cyclictest0-21swapper/319:35:123
169419930,2cyclictest0-21swapper/322:05:013
169419930,1cyclictest0-21swapper/321:55:113
169419930,1cyclictest0-21swapper/321:10:133
13129830,2rtkit-daemon18948-21munin-node23:00:052
13129830,2rtkit-daemon1-21systemd20:05:160
13129830,2rtkit-daemon1-21systemd19:20:140
13129830,2rtkit-daemon0-21swapper/020:25:570
13129830,1rtkit-daemon714-21ntpd00:25:222
13129830,1rtkit-daemon617-21gmain21:28:132
13129830,1rtkit-daemon617-21gmain20:02:330
13129830,1rtkit-daemon539-21wpa_supplicant22:02:562
13129830,1rtkit-daemon538-21systemd-logind22:59:292
13129830,1rtkit-daemon538-21systemd-logind22:47:292
13129830,1rtkit-daemon538-21systemd-logind19:27:290
13129830,1rtkit-daemon356-21systemd-journal00:37:022
13129830,1rtkit-daemon18948-21munin-node21:45:032
13129830,1rtkit-daemon18948-21munin-node21:19:012
13129830,1rtkit-daemon18948-21munin-node20:40:302
13129830,1rtkit-daemon146186-21dpkg00:20:022
13129830,1rtkit-daemon1-21systemd23:57:382
13129830,1rtkit-daemon1-21systemd23:41:222
13129830,1rtkit-daemon1-21systemd23:27:162
13129830,1rtkit-daemon1-21systemd23:20:192
13129830,1rtkit-daemon1-21systemd23:07:002
13129830,1rtkit-daemon1-21systemd22:30:572
13129830,1rtkit-daemon1-21systemd22:27:552
13129830,1rtkit-daemon1-21systemd22:15:062
13129830,1rtkit-daemon1-21systemd21:50:042
13129830,1rtkit-daemon1-21systemd21:37:572
13129830,1rtkit-daemon1-21systemd21:12:092
13129830,1rtkit-daemon1-21systemd20:35:232
13129830,1rtkit-daemon1-21systemd19:30:210
13129830,1rtkit-daemon1-21systemd19:19:560
13129830,1rtkit-daemon1-21systemd00:33:012
13129830,1rtkit-daemon1-21systemd00:18:122
13129830,1rtkit-daemon1-21systemd00:08:052
13129830,1rtkit-daemon117622-21sh23:10:352
95326220,1sleep295415-21memory22:20:222
92632220,1sleep00-21swapper/022:15:020
87617220,1sleep083376-21kworker/u8:022:02:380
86410220,1sleep186491-21fw_packets22:00:181
85540220,0sleep00-21swapper/021:58:090
79663220,0sleep00-21swapper/021:45:130
77089220,0sleep00-21swapper/021:38:280
76622220,1sleep176720-21users21:35:251
74682220,1sleep10-21swapper/121:31:011
69243220,0sleep10-21swapper/121:20:161
68787220,1sleep068838-21aten_r1power_en21:20:110
68060220,0sleep00-21swapper/021:16:230
53592220,1sleep10-21swapper/120:40:221
53323220,1sleep00-21swapper/020:40:170
39772220,0sleep239094-21/usr/sbin/munin20:05:222
31082220,1sleep231109-21systemd-run19:45:002
169419920,1cyclictest0-21swapper/320:20:013
150157220,0sleep00-21swapper/000:29:060
146291220,1sleep00-21swapper/000:20:130
145415220,0sleep0145417-21ssh00:17:130
144389220,1sleep1144407-21irqstats00:15:221
136288220,1sleep00-21swapper/023:55:240
133003220,1sleep10-21swapper/123:50:011
132590220,0sleep00-21swapper/023:46:310
13129820,1rtkit-daemon714-21ntpd20:55:232
13129820,1rtkit-daemon714-21ntpd20:45:112
13129820,1rtkit-daemon714-21ntpd19:55:100
13129820,1rtkit-daemon617-21gmain21:30:212
13129820,1rtkit-daemon42331-21vmstat20:10:240
13129820,1rtkit-daemon36-21ksoftirqd/220:28:292
13129820,1rtkit-daemon3191333-21snmpd22:35:442
13129820,1rtkit-daemon2237006-21sendmail-mta00:00:352
13129820,1rtkit-daemon2121-21packagekitd23:35:142
13129820,1rtkit-daemon18948-21munin-node21:00:472
13129820,1rtkit-daemon18948-21munin-node19:35:190
13129820,1rtkit-daemon1-21systemd21:40:302
13129820,1rtkit-daemon1-21systemd20:15:030
13129820,1rtkit-daemon1-21systemd19:45:100
13129820,1rtkit-daemon1-21systemd19:10:020
13129820,0rtkit-daemon0-21swapper/223:50:192
13129820,0rtkit-daemon0-21swapper/222:11:192
13129820,0rtkit-daemon0-21swapper/222:05:252
13129820,0rtkit-daemon0-21swapper/221:20:242
13129820,0rtkit-daemon0-21swapper/220:30:032
13129820,0rtkit-daemon0-21swapper/200:10:182
13129820,0rtkit-daemon0-21swapper/020:20:050
13129820,0rtkit-daemon0-21swapper/019:40:080
124383220,1sleep00-21swapper/023:28:540
116024220,1sleep00-21swapper/023:10:010
114163220,1sleep1114188-21apt23:05:141
100400221,1sleep1272-21plymouthd22:30:481
96986210,0sleep00-21swapper/022:25:150
96903210,0sleep10-21swapper/122:25:081
96304210,0sleep00-21swapper/022:22:030
95299210,0sleep10-21swapper/122:20:201
92648210,0sleep10-21swapper/122:15:111
90727210,0sleep10-21swapper/122:10:191
90277210,0sleep00-21swapper/022:10:140
88141210,0sleep00-21swapper/022:05:060
83891210,0sleep10-21swapper/121:55:101
82288210,0sleep10-21swapper/121:50:181
81869210,0sleep00-21swapper/021:50:130
79409210,0sleep10-21swapper/121:45:021
78434210,0sleep00-21swapper/021:40:240
77273210,0sleep10-21swapper/121:40:011
73557210,0sleep00-21swapper/021:30:160
71062210,0sleep00-21swapper/021:25:160
70889210,0sleep10-21swapper/121:25:041
66622210,0sleep10-21swapper/121:15:121
65274210,0sleep00-21swapper/021:10:230
64680210,0sleep10-21swapper/121:10:161
62625210,0sleep10-21swapper/121:05:151
62585210,1sleep00-21swapper/021:05:140
62012210,0sleep00-21swapper/021:00:540
61176210,0sleep10-21swapper/121:00:191
58817210,0sleep10-21swapper/120:55:151
58743210,0sleep00-21swapper/020:55:140
56792210,0sleep00-21swapper/020:50:140
56783210,0sleep10-21swapper/120:50:071
55245210,0sleep10-21swapper/120:45:181
54621210,0sleep00-21swapper/020:45:010
52374210,0sleep00-21swapper/020:36:130
51603210,0sleep151715-21strings20:35:191
49040210,0sleep10-21swapper/120:30:141
48789210,0sleep00-21swapper/020:30:010
46865210,0sleep10-21swapper/120:25:011
45864210,0sleep20-21swapper/220:20:192
44658210,0sleep10-21swapper/120:20:011
43228210,0sleep10-21swapper/120:15:171
42966210,0sleep20-21swapper/220:15:142
41280210,0sleep20-21swapper/220:10:132
40772210,0sleep10-21swapper/120:10:001
39095210,0sleep10-21swapper/120:05:121
37236210,0sleep10-21swapper/120:00:161
36902210,0sleep20-21swapper/220:00:012
35516210,0sleep10-21swapper/119:55:201
34979210,0sleep20-21swapper/219:55:012
33866210,0sleep10-21swapper/119:50:201
33256210,0sleep20-21swapper/219:50:132
31839210,0sleep10-21swapper/119:45:191
31332210,0sleep231358-21apt-get19:45:122
29512210,0sleep10-21swapper/119:40:151
27890210,0sleep20-21swapper/219:35:172
27726210,0sleep10-21swapper/119:35:161
25706210,0sleep10-21swapper/119:30:141
25539210,0sleep20-21swapper/219:30:112
23606210,0sleep20-21swapper/219:25:152
23442210,0sleep10-21swapper/119:25:141
21448210,0sleep20-21swapper/219:20:122
21424210,0sleep10-21swapper/119:20:101
19739210,0sleep20-21swapper/219:15:152
19580210,0sleep10-21swapper/119:15:141
17345210,0sleep20-21swapper/219:10:142
152666210,0sleep10-21swapper/100:35:151
152638210,0sleep00-21swapper/000:35:140
150965210,0sleep00-21swapper/000:30:220
150607210,0sleep10-21swapper/100:30:191
148870210,0sleep10-21swapper/100:25:261
146320210,0sleep10-21swapper/100:20:141
141899210,0sleep10-21swapper/100:10:141
141886210,0sleep00-21swapper/000:10:130
140441210,0sleep00-21swapper/000:05:240
139647210,0sleep10-21swapper/100:05:131
137526210,0sleep00-21swapper/000:00:120
137252210,0sleep10-21swapper/100:00:011
135496210,0sleep10-21swapper/123:55:131
133878210,0sleep00-21swapper/023:50:200
133267210,0sleep10-21swapper/123:50:131
130363210,0sleep00-21swapper/023:40:310
129525210,0sleep10-21swapper/123:40:201
127336210,0sleep00-21swapper/023:35:190
127024210,0sleep10-21swapper/123:35:161
126095210,0sleep00-21swapper/023:30:260
124807210,0sleep10-21swapper/123:30:111
122631210,0sleep10-21swapper/123:25:031
120962210,0sleep10-21swapper/123:20:151
120530210,0sleep00-21swapper/023:20:100
118879210,0sleep10-21swapper/123:15:191
118421210,0sleep00-21swapper/023:15:140
116515210,0sleep0116708-21df23:10:170
116282210,0sleep1116307-21apt-get23:10:141
112333210,0sleep00-21swapper/023:00:170
111768210,0sleep10-21swapper/123:00:021
109924210,0sleep00-21swapper/022:55:120
109652210,0sleep10-21swapper/122:55:011
108212210,0sleep00-21swapper/022:50:160
107827210,0sleep10-21swapper/122:50:131
106155210,0sleep00-21swapper/022:45:200
105858210,0sleep10-21swapper/122:45:171
103989210,0sleep00-21swapper/022:40:200
103682210,0sleep1103734-21aten_r1power_vo22:40:171
102881210,0sleep00-21swapper/022:36:390
101408210,0sleep10-21swapper/122:35:121
100539210,0sleep00-21swapper/022:31:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional