You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 00:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Mon Dec 01, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
407922899150,13cyclictest0-21swapper/310:50:123
4079228991211,0cyclictest0-21swapper/309:00:113
407922899120,1cyclictest0-21swapper/308:45:023
407922899120,11cyclictest0-21swapper/309:35:203
407922899120,11cyclictest0-21swapper/308:55:133
407922899120,0cyclictest0-21swapper/308:35:153
4079228991111,0cyclictest0-21swapper/312:00:123
4079228991111,0cyclictest0-21swapper/311:45:133
4079228991111,0cyclictest0-21swapper/311:40:143
4079228991110,1cyclictest69450irq/121-eno111:56:593
407922899110,9cyclictest69450irq/121-eno112:25:013
407922899110,11cyclictest0-21swapper/308:50:013
407922899110,11cyclictest0-21swapper/308:27:503
407922899110,10cyclictest69450irq/121-eno108:30:183
407922899110,10cyclictest0-21swapper/312:20:023
407922899110,10cyclictest0-21swapper/309:30:113
407922899110,0cyclictest0-21swapper/312:35:133
407922899110,0cyclictest0-21swapper/312:10:143
407922899110,0cyclictest0-21swapper/311:30:013
407922899110,0cyclictest0-21swapper/310:15:173
407922899109,1cyclictest69450irq/121-eno110:10:183
407922899109,0cyclictest69450irq/121-eno111:35:143
4079228991010,0cyclictest69450irq/121-eno112:05:173
4079228991010,0cyclictest69450irq/121-eno111:51:133
4079228991010,0cyclictest69450irq/121-eno110:55:163
4079228991010,0cyclictest69450irq/121-eno110:21:043
4079228991010,0cyclictest69450irq/121-eno110:06:043
4079228991010,0cyclictest0-21swapper/307:20:013
407922899100,9cyclictest69450irq/121-eno110:27:043
407922899100,9cyclictest69450irq/121-eno108:10:193
407922899100,10cyclictest0-21swapper/309:15:283
407922899100,0cyclictest0-21swapper/312:30:143
407922899100,0cyclictest0-21swapper/309:40:123
407922899100,0cyclictest0-21swapper/308:50:223
407922899100,0cyclictest0-21swapper/308:00:113
407922899100,0cyclictest0-21swapper/308:00:103
40792289999,0cyclictest69450irq/121-eno107:25:203
40792289999,0cyclictest69450irq/121-eno107:10:173
40792289999,0cyclictest0-21swapper/311:00:143
40792289999,0cyclictest0-21swapper/310:35:013
40792289999,0cyclictest0-21swapper/309:45:143
40792289999,0cyclictest0-21swapper/307:35:153
40792289991,6cyclictest69450irq/121-eno107:20:113
40792289990,8cyclictest69450irq/121-eno112:20:123
40792289990,8cyclictest69450irq/121-eno111:20:203
40792289990,8cyclictest69450irq/121-eno110:45:133
40792289990,8cyclictest0-21swapper/310:00:203
40792289990,8cyclictest0-21swapper/308:15:223
40792289990,0cyclictest0-21swapper/309:20:133
40792289988,0cyclictest69450irq/121-eno111:15:253
40792289988,0cyclictest69450irq/121-eno111:09:303
40792289988,0cyclictest69450irq/121-eno109:13:173
40792289988,0cyclictest0-21swapper/309:50:123
40792289988,0cyclictest0-21swapper/308:20:133
40792289980,7cyclictest69450irq/121-eno111:30:023
40792289977,0cyclictest69450irq/121-eno111:12:473
40792289977,0cyclictest69450irq/121-eno110:44:083
40792289977,0cyclictest69450irq/121-eno109:59:263
40792289977,0cyclictest69450irq/121-eno109:25:243
40792289977,0cyclictest69450irq/121-eno109:05:413
40792289977,0cyclictest69450irq/121-eno107:55:033
40792289977,0cyclictest0-21swapper/310:35:203
40792289976,1cyclictest0-21swapper/307:40:123
40792289970,6cyclictest69450irq/121-eno107:45:203
40792289966,0cyclictest0-21swapper/308:05:223
4129863253,1sleep04104681-21kworker/0:1+events09:15:500
4079028250,1sleep10-21swapper/107:09:131
4078337251,2sleep30-21swapper/307:05:213
40792289940,3cyclictest4095299-21chrt07:50:033
40792289940,3cyclictest0-21swapper/307:30:123
4078903241,2sleep00-21swapper/007:07:350
4077668241,1sleep20-21swapper/207:05:162
4185359230,0sleep10-21swapper/111:30:161
4147123230,2sleep14147274-21grep10:00:141
4134760230,1sleep04134788-21apt-get09:30:110
4107017230,2sleep04107263-21diskstats08:20:160
4104893230,1sleep24104919-21apt-get08:15:142
7959220,2sleep27963-21ssh12:10:112
4193193220,0sleep00-21swapper/011:49:120
4179423220,1sleep24179594-21python311:15:202
4166900220,1sleep14167072-21python310:45:221
4164046220,1sleep20-21swapper/210:40:192
4161637220,1sleep00-21swapper/010:34:560
4148814220,0sleep00-21swapper/010:04:530
4139186220,1sleep04139268-21irqstats09:40:170
4133855220,0sleep00-21swapper/009:26:000
4132240220,1sleep14132265-21sleep09:25:001
4124789220,1sleep04124871-21irqstats09:05:180
4120336220,1sleep04120547-21tr08:55:130
4118485220,1sleep14118517-21cpu08:50:141
4117827221,1sleep2451ktimers/208:46:442
4112697220,1sleep14112993-21df08:35:171
4111273220,1sleep14111424-21ntp_states08:30:181
4099586220,1sleep04099668-21irqstats08:00:140
4099586220,1sleep04099668-21irqstats08:00:140
4081058220,1sleep24081550-21sendmail_mailst07:15:022
2264220,1sleep02440-21ntp_kernel_pll_11:55:160
16604220,1sleep20-21swapper/212:30:142
12329220,1sleep00-21swapper/012:20:150
8784210,0sleep10-21swapper/112:10:181
8697210,0sleep00-21swapper/012:10:170
7242210,1sleep00-21swapper/012:05:540
6064210,0sleep20-21swapper/212:05:162
5381210,0sleep20-21swapper/212:02:552
5106210,0sleep00-21swapper/012:00:290
4194197210,0sleep10-21swapper/111:50:221
4193731210,0sleep20-21swapper/211:50:192
4193547210,0sleep00-21swapper/011:50:170
4192829210,0sleep10-21swapper/111:46:011
4191983210,0sleep20-21swapper/211:45:182
4190744210,0sleep20-21swapper/211:41:022
4189557210,0sleep10-21swapper/111:40:161
4187752210,0sleep00-21swapper/011:35:150
4187442210,0sleep20-21swapper/211:35:142
4187296210,0sleep10-21swapper/111:35:131
4186480210,0sleep20-21swapper/211:30:252
4184893210,0sleep00-21swapper/011:30:030
4183107210,0sleep10-21swapper/111:25:171
4182944210,0sleep00-21swapper/011:25:160
4182821210,0sleep20-21swapper/211:25:132
4182499210,0sleep10-21swapper/111:24:271
4181924210,0sleep20-21swapper/211:20:212
4181577210,0sleep00-21swapper/011:20:180
4179930210,0sleep00-21swapper/011:15:260
4178713210,0sleep10-21swapper/111:15:151
4177891210,0sleep00-21swapper/011:10:510
4176958210,0sleep20-21swapper/211:10:172
4176690210,0sleep10-21swapper/111:10:161
4175128210,0sleep10-21swapper/111:05:181
4174614210,0sleep20-21swapper/211:05:152
4172428210,0sleep20-21swapper/211:00:152
4172368210,0sleep00-21swapper/011:00:140
4172343210,0sleep10-21swapper/111:00:021
4171925210,0sleep20-21swapper/210:58:362
4171250210,0sleep00-21swapper/010:55:210
4170790210,0sleep10-21swapper/110:55:191
4169508210,0sleep10-21swapper/110:50:331
4168339210,0sleep20-21swapper/210:50:142
4168179210,0sleep00-21swapper/010:50:120
4167554210,0sleep20-21swapper/210:46:432
4166876210,0sleep00-21swapper/010:45:210
4165323210,0sleep00-21swapper/010:40:280
4164017210,0sleep10-21swapper/110:40:171
4163468210,0sleep20-21swapper/210:37:412
4162338210,0sleep10-21swapper/110:35:161
4162072210,1sleep04162337-21diskstats10:35:150
4159794210,0sleep10-21swapper/110:30:051
4159555210,0sleep20-21swapper/210:30:022
4159396210,0sleep00-21swapper/010:28:350
4157864210,0sleep10-21swapper/110:25:161
4157208210,0sleep20-21swapper/210:25:012
4156918210,0sleep10-21swapper/110:22:281
4155096210,0sleep20-21swapper/210:20:002
4154999210,0sleep00-21swapper/010:19:110
4154604210,0sleep10-21swapper/110:15:441
4153261210,0sleep20-21swapper/210:15:132
4151974210,0sleep20-21swapper/210:10:202
4151264210,0sleep00-21swapper/010:10:140
4151153210,0sleep10-21swapper/110:10:031
4150261210,0sleep20-21swapper/210:05:232
4149881210,0sleep00-21swapper/010:05:220
4149088210,0sleep10-21swapper/110:05:151
4146985210,0sleep20-21swapper/210:00:042
4145044210,0sleep10-21swapper/109:55:141
4144931210,0sleep00-21swapper/009:55:130
4143661210,0sleep20-21swapper/209:50:192
4142905210,0sleep10-21swapper/109:50:141
4142560210,0sleep00-21swapper/009:50:010
4141778210,0sleep00-21swapper/009:45:240
4140893210,0sleep20-21swapper/209:45:182
4140736210,0sleep10-21swapper/109:45:131
4140081210,0sleep20-21swapper/209:40:422
4138473210,0sleep10-21swapper/109:40:011
4136911210,0sleep00-21swapper/009:35:160
4136757210,0sleep10-21swapper/109:35:141
4136735210,0sleep20-21swapper/209:35:072
4134246210,0sleep10-21swapper/109:30:001
4133462210,0sleep10-21swapper/109:25:251
4130669210,0sleep00-21swapper/009:20:150
4128232210,1sleep14128322-21apt-config09:15:031
4127992210,0sleep20-21swapper/209:15:002
4127851210,0sleep20-21swapper/209:13:252
4126457210,0sleep00-21swapper/009:10:150
4124872210,0sleep10-21swapper/109:05:191
4124427210,0sleep20-21swapper/209:05:162
4123699210,1sleep00-21swapper/009:03:110
4123144210,0sleep14122178-21/usr/sbin/munin09:00:181
4122685210,0sleep20-21swapper/209:00:152
4118360210,0sleep00-21swapper/008:50:130
4117211210,0sleep10-21swapper/108:45:221
4114931210,0sleep00-21swapper/008:40:160
4112604210,0sleep00-21swapper/008:35:160
4112275210,1sleep00-21swapper/008:34:250
4110057210,0sleep10-21swapper/108:25:321
4109787210,0sleep00-21swapper/008:25:190
4108846210,0sleep20-21swapper/208:25:132
4108022210,0sleep20-21swapper/208:20:212
4105047210,0sleep00-21swapper/008:15:150
4104518210,0sleep10-21swapper/108:13:231
4103241210,0sleep00-21swapper/008:10:180
4103043210,0sleep20-21swapper/208:10:162
4101841210,0sleep00-21swapper/008:05:230
4101449210,0sleep10-21swapper/108:05:201
4101073210,0sleep20-21swapper/208:05:162
4100638210,0sleep20-21swapper/208:02:412
4100638210,0sleep20-21swapper/208:02:402
4100461210,0sleep10-21swapper/108:00:271
4100461210,0sleep10-21swapper/108:00:271
4098704210,0sleep10-21swapper/107:57:401
4098267210,0sleep00-21swapper/007:55:220
4096614210,0sleep00-21swapper/007:50:250
4095433210,0sleep10-21swapper/107:50:141
4094449210,0sleep20-21swapper/207:45:272
4093541210,0sleep00-21swapper/007:45:220
4093423210,0sleep10-21swapper/107:45:141
4092803210,1sleep00-21swapper/007:40:320
4092302210,0sleep10-21swapper/107:40:181
4089967210,0sleep00-21swapper/007:35:160
4089636210,0sleep20-21swapper/207:35:142
4089206210,0sleep10-21swapper/107:35:011
4087527210,1sleep00-21swapper/007:30:050
4087277210,1sleep10-21swapper/107:29:531
4086529210,0sleep00-21swapper/007:25:200
4086246210,0sleep20-21swapper/207:25:192
4083897210,0sleep20-21swapper/207:20:132
4083712210,0sleep04083753-21aten_r1power_cu07:20:110
4080175210,0sleep00-21swapper/007:10:190
4079818210,0sleep10-21swapper/107:10:161
4079394210,0sleep20-21swapper/207:10:132
3973210,0sleep10-21swapper/112:00:141
2441210,0sleep10-21swapper/111:55:171
19501210,0sleep00-21swapper/012:35:200
1941210,0sleep20-21swapper/211:55:142
19217210,0sleep20-21swapper/212:35:172
16760210,0sleep00-21swapper/012:30:160
14613210,0sleep00-21swapper/012:25:140
13058210,0sleep10-21swapper/112:20:201
12161210,0sleep20-21swapper/212:20:122
10571210,0sleep00-21swapper/012:15:180
5856200,0sleep10-21swapper/112:05:031
4189348200,0sleep00-21swapper/011:40:040
4174192200,0sleep00-21swapper/011:05:010
4155354200,0sleep00-21swapper/010:20:030
4144875200,0sleep20-21swapper/209:55:032
4134485200,0sleep20-21swapper/209:30:012
4132266200,0sleep20-21swapper/209:25:012
4130247200,0sleep20-21swapper/209:20:022
4126257200,0sleep10-21swapper/109:10:041
4120233200,0sleep20-21swapper/208:55:042
4120232200,0sleep10-21swapper/108:55:031
4118319200,0sleep20-21swapper/208:50:032
4116410200,0sleep00-21swapper/008:45:050
4114492200,0sleep20-21swapper/208:40:032
4114237200,0sleep10-21swapper/108:40:011
4112558200,0sleep20-21swapper/208:35:022
4110410200,0sleep20-21swapper/208:30:032
4106821200,0sleep10-21swapper/108:20:041
4104882200,0sleep10-21swapper/108:15:051
4097211200,0sleep20-21swapper/207:55:042
4095298200,0sleep20-21swapper/207:50:032
4091473200,0sleep20-21swapper/207:40:032
4087524200,0sleep20-21swapper/207:30:032
4087289200,0sleep10-21swapper/107:30:021
4083701200,0sleep10-21swapper/107:20:041
4081765200,0sleep10-21swapper/107:15:051
4081764200,0sleep00-21swapper/007:15:040
18680200,0sleep10-21swapper/112:35:041
16589200,0sleep10-21swapper/112:30:051
14501200,0sleep20-21swapper/212:25:042
14500200,0sleep10-21swapper/112:25:031
10033200,0sleep20-21swapper/212:15:052
10032200,0sleep10-21swapper/112:15:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional