# KeyError Setting Mixture Proportions for Mixture Model

**URL:** <https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217>\
**Category:** Questions\
**Created:** [May 7, 2019, 12:05am UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217 "2019-05-07T00:05:55Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![dmenager](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/dmenager/32/1686_2.png) [@dmenager](https://discourse.pymc.io/u/dmenager)\
**Post date:** [May 7, 2019, 12:05am UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/1 "2019-05-07T00:05:55Z")

</div>

I have the following model:

```
pOn ~ Beta(alpha, beta)
on ~ Bernoulli(pOn)
w = [on, (1 - on)]
tri_giv_on ~ Bernoulli(p)
tri_giv_not_on ~ Bernoulli(q) 
triangle ~ BernoulliMixture(w, [tri_giv_on, tri_giv_not_on])

```

I’ve tried to implement it using pymc3

```
with pymc3.Model() as model:
   pOn = pymc3.Beta('pOn', alpha=on_count, beta=(schema_count - on_count));
   on = pymc3.Bernoulli('on', pOn)

   triangle_mixture_weights = [on, (1. - on)]
   tri_giv_on = pymc3.Bernoulli.dist(pTri_given_not_on + tri_delta_on)
   tri_giv_not_on = pymc3.Bernoulli.dist(pTri_given_not_on)
   triangle = pymc3.Mixture('triangle', w=triangle_mixture_weights, \
                               comp_dists=[tri_giv_on, tri_giv_not_on], \
                               shape=2)
   res = pymc3.sample_prior_predictive(1000)  

```

So, the model isn’t perfect. There are some things I can do to make it better, but still,I’m thinking that conceptually, this should work. This, however, isn’t the case. When I run the model, python tells me:

```
Traceback (most recent call last):
  File "test.py", line 114, in <module>
    res = pymc3.sample_prior_predictive(n)
  File "/usr/local/lib/python2.7/dist-packages/pymc3/sampling.py", line 1325, in sample_prior_predictive
    values = draw_values([model[name] for name in names], size=samples)
  File "/usr/local/lib/python2.7/dist-packages/pymc3/distributions/distribution.py", line 369, in draw_values
    size=size)
  File "/usr/local/lib/python2.7/dist-packages/pymc3/distributions/distribution.py", line 463, in _draw_value
    return param.random(point=point, size=size)
  File "/usr/local/lib/python2.7/dist-packages/pymc3/model.py", line 43, in __call__
    return getattr(self.obj, self.method_name)(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/pymc3/distributions/mixture.py", line 166, in random
    size=size).squeeze()
  File "/usr/local/lib/python2.7/dist-packages/pymc3/distributions/distribution.py", line 621, in generate_samples
    samples = [generator(*args, **kwargs).reshape(size_tup + (1,)) for _ in range(np.prod(suffix, dtype=int))]
  File "/usr/local/lib/python2.7/dist-packages/pymc3/distributions/dist_math.py", line 322, in random_choice
    size = kwargs.pop('size')
KeyError: 'size'

```

I’m not exactly sure what this error is about, but python is happy when I replace `pOn` and `on` random variables with a new scalar variable `on = 1.`.

**NOTE:** When i do `pymc3.sample(1000)` instead of `pymc3.sample_prior_predictive(1000)`, python is happy too.

---

<div class="post-metadata">

**Author:** ![junpenglao](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/junpenglao/32/8_2.png) [@junpenglao](https://discourse.pymc.io/u/junpenglao)\
**Post date:** [May 7, 2019, 1:45am UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/2 "2019-05-07T01:45:49Z")

</div>

seems to be shape related - @lucianopaz could you take a look?

meanwhile, @dmenager you should upgrade to python3 - py2 is not supported by pymc3 any more and your code might break at some point!

---

<div class="post-metadata">

**Author:** ![dmenager](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/dmenager/32/1686_2.png) [@dmenager](https://discourse.pymc.io/u/dmenager)\
**Post date:** [May 7, 2019, 4:48am UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/3 "2019-05-07T04:48:21Z")

</div>

Ah, alright! I’ll switch over to python 3!

---

<div class="post-metadata">

**Author:** ![lucianopaz](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/lucianopaz/32/2186_2.png) [@lucianopaz](https://discourse.pymc.io/u/lucianopaz)\
**Post date:** [May 7, 2019, 5:19am UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/4 "2019-05-07T05:19:55Z")

</div>

Are you running pymc3.6? If yes, you will have to install the current master branch, which only works on python\>=3.5, and retry.

The current master has done many changes to almost all of the involved components of the traceback you posted: we’ve changed `Mixture`, `random_choice` and `generate_samples`. So your error will, in the best scenario, be fixed or, in the worse case, have a different traceback.

---

<div class="post-metadata">

**Author:** ![dmenager](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/dmenager/32/1686_2.png) [@dmenager](https://discourse.pymc.io/u/dmenager)\
**Post date:** [May 7, 2019, 6:15pm UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/5 "2019-05-07T18:15:58Z")

</div>

@lucianopaz, I’m noticing some interesting behavior now that I’ve updated python to 3.5. I installed pymc 3.6 using pip3 install.

The odd behavior I’m observing is that sometimes the code runs, but other times it doesn’t. After running the code two consecutive times, I got:

```
Traceback (most recent call last):
  File "test.py", line 114, in <module>
    res = pymc3.sample_prior_predictive(n)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/sampling.py", line 1325, in sample_prior_predictive
    values = draw_values([model[name] for name in names], size=samples)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/distributions/distribution.py", line 369, in draw_values
    size=size)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/distributions/distribution.py", line 463, in _draw_value
    return param.random(point=point, size=size)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/model.py", line 43, in __call__
    return getattr(self.obj, self.method_name)(*args, **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/distributions/mixture.py", line 152, in random
    w = draw_values([self.w], point=point)[0]
  File "/usr/local/lib/python3.5/dist-packages/pymc3/distributions/distribution.py", line 400, in draw_values
    size=size)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/distributions/distribution.py", line 508, in _draw_value
    output = np.array([func(*v) for v in zip(*values)])
TypeError: zip argument #2 must support iteration

```

AND

```
Traceback (most recent call last):
  File "test.py", line 114, in <module>
    res = pymc3.sample_prior_predictive(n)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/sampling.py", line 1325, in sample_prior_predictive
    values = draw_values([model[name] for name in names], size=samples)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/distributions/distribution.py", line 369, in draw_values
    size=size)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/distributions/distribution.py", line 463, in _draw_value
    return param.random(point=point, size=size)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/model.py", line 43, in __call__
    return getattr(self.obj, self.method_name)(*args, **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/distributions/mixture.py", line 166, in random
    size=size).squeeze()
  File "/usr/local/lib/python3.5/dist-packages/pymc3/distributions/distribution.py", line 621, in generate_samples
    samples = [generator(*args, **kwargs).reshape(size_tup + (1,)) for _ in range(np.prod(suffix, dtype=int))]
  File "/usr/local/lib/python3.5/dist-packages/pymc3/distributions/distribution.py", line 621, in <listcomp>
    samples = [generator(*args, **kwargs).reshape(size_tup + (1,)) for _ in range(np.prod(suffix, dtype=int))]
  File "/usr/local/lib/python3.5/dist-packages/pymc3/distributions/dist_math.py", line 322, in random_choice
    size = kwargs.pop('size')
KeyError: 'size'
```

---

<div class="post-metadata">

**Author:** ![lucianopaz](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/lucianopaz/32/2186_2.png) [@lucianopaz](https://discourse.pymc.io/u/lucianopaz)\
**Post date:** [May 7, 2019, 6:53pm UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/6 "2019-05-07T18:53:05Z")

</div>

You’re still installing version 3.6, not the current master branch which is the unfinished version 3.7. To install that you need to

```auto
pip3 uninstall pymc3
pip3 install git+https://github.com/pymc-devs/pymc3.git

```

---

<div class="post-metadata">

**Author:** ![dmenager](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/dmenager/32/1686_2.png) [@dmenager](https://discourse.pymc.io/u/dmenager)\
**Post date:** [May 8, 2019, 2:53am UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/7 "2019-05-08T02:53:21Z")

</div>

When I run the code, I can sample the prior predictive, but when I try to sample the posterior, I get an error related to theano in the sampler:

```
Multiprocess sampling (2 chains in 2 jobs)
CompoundStep
>Metropolis: [triangle]
>NUTS: [pOn, pos]
>BinaryGibbsMetropolis: [on]
Sampling 2 chains: 0%| | 0/3000 [00:00<?, ?draws/s]
pymc3.parallel_sampling.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/theano/compile/function_module.py", line 903, in __call__
    self.fn() if output_subset is None else\
TypeError: expected type_num 5 (NPY_INT32) got 7

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/pymc3/parallel_sampling.py", line 110, in run
    self._start_loop()
  File "/usr/local/lib/python3.5/dist-packages/pymc3/parallel_sampling.py", line 160, in _start_loop
    point, stats = self._compute_point()
  File "/usr/local/lib/python3.5/dist-packages/pymc3/parallel_sampling.py", line 191, in _compute_point
    point, stats = self._step_method.step(self._point)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/step_methods/compound.py", line 27, in step
    point, state = method.step(point)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/step_methods/arraystep.py", line 175, in step
    apoint, stats = self.astep(self.bij.map(point))
  File "/usr/local/lib/python3.5/dist-packages/pymc3/step_methods/metropolis.py", line 162, in astep
    accept = self.delta_logp(q, q0)
  File "/usr/local/lib/python3.5/dist-packages/theano/compile/function_module.py", line 917, in __call__
    storage_map=getattr(self.fn, 'storage_map', None))
  File "/usr/local/lib/python3.5/dist-packages/theano/gof/link.py", line 325, in raise_with_op
    reraise(exc_type, exc_value, exc_trace)
  File "/usr/lib/python3/dist-packages/six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.5/dist-packages/theano/compile/function_module.py", line 903, in __call__
    self.fn() if output_subset is None else\
TypeError: expected type_num 5 (NPY_INT32) got 7
Apply node that caused the error: Elemwise{Composite{Cast{int8}((GE(i0, i1) * LE(i0, i2)))}}(InplaceDimShuffle{0,x}.0, TensorConstant{(1, 1) of 0}, TensorConstant{(1, 1) of 1})
Toposort index: 22
Inputs types: [TensorType(int32, col), TensorType(int8, (True, True)), TensorType(int8, (True, True))]
Inputs shapes: [(2, 1), (1, 1), (1, 1)]
Inputs strides: [(8, 8), (1, 1), (1, 1)]
Inputs values: [array([[2],
       [0]]), array([[0]], dtype=int8), array([[1]], dtype=int8)]
Outputs clients: [[Elemwise{Composite{Switch(i0, Switch(i1, i2, i3), i4)}}(Elemwise{Composite{Cast{int8}((GE(i0, i1) * LE(i0, i2)))}}.0, InplaceDimShuffle{0,x}.0, TensorConstant{(1, 1) of 0.0}, TensorConstant{(1, 1) of -inf}, TensorConstant{(1, 1) of -inf}), Elemwise{Composite{Switch(i0, Switch(i1, i2, i3), i4)}}(Elemwise{Composite{Cast{int8}((GE(i0, i1) * LE(i0, i2)))}}.0, InplaceDimShuffle{0,x}.0, TensorConstant{(1, 1) of ..4393873245}, TensorConstant{(1, 1) of ..2804325936}, TensorConstant{(1, 1) of -inf})]]

HINT: Re-running with most Theano optimization disabled could give you a back-trace of when this node was created. This can be done with by setting the Theano flag 'optimizer=fast_compile'. If that does not work, Theano optimizations can be disabled with 'optimizer=None'.
HINT: Use the Theano flag 'exception_verbosity=high' for a debugprint and storage map footprint of this apply node.
"""

The above exception was the direct cause of the following exception:

TypeError: expected type_num 5 (NPY_INT32) got 7
Apply node that caused the error: Elemwise{Composite{Cast{int8}((GE(i0, i1) * LE(i0, i2)))}}(InplaceDimShuffle{0,x}.0, TensorConstant{(1, 1) of 0}, TensorConstant{(1, 1) of 1})
Toposort index: 22
Inputs types: [TensorType(int32, col), TensorType(int8, (True, True)), TensorType(int8, (True, True))]
Inputs shapes: [(2, 1), (1, 1), (1, 1)]
Inputs strides: [(8, 8), (1, 1), (1, 1)]
Inputs values: [array([[2],
       [0]]), array([[0]], dtype=int8), array([[1]], dtype=int8)]
Outputs clients: [[Elemwise{Composite{Switch(i0, Switch(i1, i2, i3), i4)}}(Elemwise{Composite{Cast{int8}((GE(i0, i1) * LE(i0, i2)))}}.0, InplaceDimShuffle{0,x}.0, TensorConstant{(1, 1) of 0.0}, TensorConstant{(1, 1) of -inf}, TensorConstant{(1, 1) of -inf}), Elemwise{Composite{Switch(i0, Switch(i1, i2, i3), i4)}}(Elemwise{Composite{Cast{int8}((GE(i0, i1) * LE(i0, i2)))}}.0, InplaceDimShuffle{0,x}.0, TensorConstant{(1, 1) of ..4393873245}, TensorConstant{(1, 1) of ..2804325936}, TensorConstant{(1, 1) of -inf})]]

HINT: Re-running with most Theano optimization disabled could give you a back-trace of when this node was created. This can be done with by setting the Theano flag 'optimizer=fast_compile'. If that does not work, Theano optimizations can be disabled with 'optimizer=None'.
HINT: Use the Theano flag 'exception_verbosity=high' for a debugprint and storage map footprint of this apply node.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "test.py", line 114, in <module>
    res = pymc3.sample(n)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/sampling.py", line 432, in sample
    trace = _mp_sample(**sample_args)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/sampling.py", line 965, in _mp_sample
    for draw in sampler:
  File "/usr/local/lib/python3.5/dist-packages/pymc3/parallel_sampling.py", line 393, in __iter__
    draw = ProcessAdapter.recv_draw(self._active)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/parallel_sampling.py", line 297, in recv_draw
    raise error from old_error
RuntimeError: Chain 1 failed.
```

---

<div class="post-metadata">

**Author:** ![lucianopaz](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/lucianopaz/32/2186_2.png) [@lucianopaz](https://discourse.pymc.io/u/lucianopaz)\
**Post date:** [May 8, 2019, 4:25am UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/8 "2019-05-08T04:25:39Z")

</div>

Try setting the dtype like this

> [@dmenager](#):
>
> `on = pymc3.Bernoulli('on', pOn, dtype="int64")`

If that doesn’t work, it may be related to an issue we’re looking into but haven’t fully identified that slowed our run times.

---

<div class="post-metadata">

**Author:** ![lucianopaz](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/lucianopaz/32/2186_2.png) [@lucianopaz](https://discourse.pymc.io/u/lucianopaz)\
**Post date:** [May 8, 2019, 4:40am UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/9 "2019-05-08T04:40:21Z")

</div>

Ok, so I think that I found the cause of the bug [here](https://github.com/pymc-devs/pymc3/blob/master/pymc3/step_methods/metropolis.py#L152-154), where the `int64` dtype (which is type\_num 7) is forced by the step method instead of looking at the variables’ particular dtype (`int32` by default). I’ll work on a patch soon but for now, setting `on`'s dtype to int64 should do the trick

---

<div class="post-metadata">

**Author:** ![lucianopaz](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/lucianopaz/32/2186_2.png) [@lucianopaz](https://discourse.pymc.io/u/lucianopaz)\
**Post date:** [May 8, 2019, 7:55am UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/10 "2019-05-08T07:55:36Z")

</div>

One other thing, why do you set `triangle`'s `shape=2`?

---

<div class="post-metadata">

**Author:** ![dmenager](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/dmenager/32/1686_2.png) [@dmenager](https://discourse.pymc.io/u/dmenager)\
**Post date:** [May 8, 2019, 6:29pm UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/11 "2019-05-08T18:29:11Z")

</div>

Well,

I set `triangle`'s `shape=2` probably mistakenly. I’ve been trying to understand the shape argument. I was thinking that since I have two mixture components, the mixture model will have `shape=2`. What I really want is a binary variable where `triangle` is either 1 or 0.

I just set `shape=1`, and `testval=1.`, and it seems ok. I still get the error about the chain failing.

---

<div class="post-metadata">

**Author:** ![dmenager](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/dmenager/32/1686_2.png) [@dmenager](https://discourse.pymc.io/u/dmenager)\
**Post date:** [May 8, 2019, 6:33pm UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/12 "2019-05-08T18:33:54Z")

</div>

I applied this change:

```
n = 1000
with pymc3.Model() as model:
   # On 
   pOn = pymc3.Beta('pOn', alpha=on_count, beta=(schema_count - on_count))
   on = pymc3.Bernoulli('on', p=pOn, dtype="int64")

   # Triangle
   
   triangle_mixture_weights = [on, (1. - on)]
   tri_giv_on = pymc3.Bernoulli.dist(pTri_given_not_on + tri_delta_on)
   tri_giv_not_on = pymc3.Bernoulli.dist(pTri_given_not_on)
   triangle = pymc3.Mixture('triangle', w=triangle_mixture_weights, \
                            comp_dists=[tri_giv_on, tri_giv_not_on], \
                            shape=2)
   res = pymc3.sample(n)

```

I receive the following error:

```
Multiprocess sampling (2 chains in 2 jobs)
CompoundStep
>NUTS: [pOn, pos]
>Metropolis: [triangle]
>BinaryGibbsMetropolis: [on]
Sampling 2 chains: 0%| | 0/3000 [00:00<?, ?draws/s]
pymc3.parallel_sampling.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/theano/compile/function_module.py", line 903, in __call__
    self.fn() if output_subset is None else\
TypeError: expected type_num 5 (NPY_INT32) got 7

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/pymc3/parallel_sampling.py", line 110, in run
    self._start_loop()
  File "/usr/local/lib/python3.5/dist-packages/pymc3/parallel_sampling.py", line 160, in _start_loop
    point, stats = self._compute_point()
  File "/usr/local/lib/python3.5/dist-packages/pymc3/parallel_sampling.py", line 191, in _compute_point
    point, stats = self._step_method.step(self._point)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/step_methods/compound.py", line 27, in step
    point, state = method.step(point)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/step_methods/arraystep.py", line 175, in step
    apoint, stats = self.astep(self.bij.map(point))
  File "/usr/local/lib/python3.5/dist-packages/pymc3/step_methods/metropolis.py", line 162, in astep
    accept = self.delta_logp(q, q0)
  File "/usr/local/lib/python3.5/dist-packages/theano/compile/function_module.py", line 917, in __call__
    storage_map=getattr(self.fn, 'storage_map', None))
  File "/usr/local/lib/python3.5/dist-packages/theano/gof/link.py", line 325, in raise_with_op
    reraise(exc_type, exc_value, exc_trace)
  File "/usr/lib/python3/dist-packages/six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.5/dist-packages/theano/compile/function_module.py", line 903, in __call__
    self.fn() if output_subset is None else\
TypeError: expected type_num 5 (NPY_INT32) got 7
Apply node that caused the error: Elemwise{Composite{Cast{int8}((GE(i0, i1) * LE(i0, i2)))}}(InplaceDimShuffle{0,x}.0, TensorConstant{(1, 1) of 0}, TensorConstant{(1, 1) of 1})
Toposort index: 22
Inputs types: [TensorType(int32, col), TensorType(int8, (True, True)), TensorType(int8, (True, True))]
Inputs shapes: [(2, 1), (1, 1), (1, 1)]
Inputs strides: [(8, 8), (1, 1), (1, 1)]
Inputs values: [array([[2],
       [4]]), array([[0]], dtype=int8), array([[1]], dtype=int8)]
Outputs clients: [[Elemwise{Composite{Switch(i0, Switch(i1, i2, i3), i4)}}(Elemwise{Composite{Cast{int8}((GE(i0, i1) * LE(i0, i2)))}}.0, InplaceDimShuffle{0,x}.0, TensorConstant{(1, 1) of 0.0}, TensorConstant{(1, 1) of -inf}, TensorConstant{(1, 1) of -inf}), Elemwise{Composite{Switch(i0, Switch(i1, i2, i3), i4)}}(Elemwise{Composite{Cast{int8}((GE(i0, i1) * LE(i0, i2)))}}.0, InplaceDimShuffle{0,x}.0, TensorConstant{(1, 1) of ..4393873245}, TensorConstant{(1, 1) of ..2804325936}, TensorConstant{(1, 1) of -inf})]]

HINT: Re-running with most Theano optimization disabled could give you a back-trace of when this node was created. This can be done with by setting the Theano flag 'optimizer=fast_compile'. If that does not work, Theano optimizations can be disabled with 'optimizer=None'.
HINT: Use the Theano flag 'exception_verbosity=high' for a debugprint and storage map footprint of this apply node.
"""

The above exception was the direct cause of the following exception:

TypeError: expected type_num 5 (NPY_INT32) got 7
Apply node that caused the error: Elemwise{Composite{Cast{int8}((GE(i0, i1) * LE(i0, i2)))}}(InplaceDimShuffle{0,x}.0, TensorConstant{(1, 1) of 0}, TensorConstant{(1, 1) of 1})
Toposort index: 22
Inputs types: [TensorType(int32, col), TensorType(int8, (True, True)), TensorType(int8, (True, True))]
Inputs shapes: [(2, 1), (1, 1), (1, 1)]
Inputs strides: [(8, 8), (1, 1), (1, 1)]
Inputs values: [array([[2],
       [4]]), array([[0]], dtype=int8), array([[1]], dtype=int8)]
Outputs clients: [[Elemwise{Composite{Switch(i0, Switch(i1, i2, i3), i4)}}(Elemwise{Composite{Cast{int8}((GE(i0, i1) * LE(i0, i2)))}}.0, InplaceDimShuffle{0,x}.0, TensorConstant{(1, 1) of 0.0}, TensorConstant{(1, 1) of -inf}, TensorConstant{(1, 1) of -inf}), Elemwise{Composite{Switch(i0, Switch(i1, i2, i3), i4)}}(Elemwise{Composite{Cast{int8}((GE(i0, i1) * LE(i0, i2)))}}.0, InplaceDimShuffle{0,x}.0, TensorConstant{(1, 1) of ..4393873245}, TensorConstant{(1, 1) of ..2804325936}, TensorConstant{(1, 1) of -inf})]]

HINT: Re-running with most Theano optimization disabled could give you a back-trace of when this node was created. This can be done with by setting the Theano flag 'optimizer=fast_compile'. If that does not work, Theano optimizations can be disabled with 'optimizer=None'.
HINT: Use the Theano flag 'exception_verbosity=high' for a debugprint and storage map footprint of this apply node.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "test.py", line 114, in <module>
    res = pymc3.sample(n)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/sampling.py", line 432, in sample
    trace = _mp_sample(**sample_args)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/sampling.py", line 965, in _mp_sample
    for draw in sampler:
  File "/usr/local/lib/python3.5/dist-packages/pymc3/parallel_sampling.py", line 393, in __iter__
    draw = ProcessAdapter.recv_draw(self._active)
  File "/usr/local/lib/python3.5/dist-packages/pymc3/parallel_sampling.py", line 297, in recv_draw
    raise error from old_error
RuntimeError: Chain 1 failed.
```

---

<div class="post-metadata">

**Author:** ![lucianopaz](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/lucianopaz/32/2186_2.png) [@lucianopaz](https://discourse.pymc.io/u/lucianopaz)\
**Post date:** [May 8, 2019, 6:54pm UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/13 "2019-05-08T18:54:38Z")

</div>

Hmm, could I ask what the values of `on_count` and `schema_count` were?

---

<div class="post-metadata">

**Author:** ![dmenager](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/dmenager/32/1686_2.png) [@dmenager](https://discourse.pymc.io/u/dmenager)\
**Post date:** [May 8, 2019, 7:08pm UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/14 "2019-05-08T19:08:34Z")

</div>

```
on_count = 3
schema_count = 10

```

and I represented them as floats too:

```
on_count = 3.
schema_count = 10.

```

but I got the same result.

And for completeness:

```
pTri_given_on = 1.
pTri_given_not_on = .7
tri_delta_on = pTri_given_on - pTri_given_not_on
```

---

<div class="post-metadata">

**Author:** ![lucianopaz](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/lucianopaz/32/2186_2.png) [@lucianopaz](https://discourse.pymc.io/u/lucianopaz)\
**Post date:** [May 8, 2019, 7:44pm UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/15 "2019-05-08T19:44:56Z")

</div>

Yes, we need to write a notebook on shape handling.

Your confusion is really common. There are two quantities that characterize a mixture: the number of components (distributions that go into the mixture, in your case 2), and the shape of the outputed value (what the shape of a single call to `random()` is). The mixtures’ components can be specified in one of two ways:

1. As a list of distributions. The len of the list specifies the number of components
2. As a single multidimensional distribution. The `shape[-1]` of this distribution encodes the number of components.

So what’s the mixtures’ shape? Well, if your components are scalars, like yours, your mixtures’ distribution shape should also be 1 (or left blank which is basically the same). Why did shape=2 work? Because it assumed that you were stacking 2 independent scalars that came from the same underlying mixture distribution, much like what is assumed when you do `Normal(..., shape=2)`.

In the first case, the `len` of the list informs the number of mixture components  
has the number of componente

---

<div class="post-metadata">

**Author:** ![lucianopaz](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/lucianopaz/32/2186_2.png) [@lucianopaz](https://discourse.pymc.io/u/lucianopaz)\
**Post date:** [May 8, 2019, 7:46pm UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/16 "2019-05-08T19:46:21Z")

</div>

Thanks, I’ll try to reproduce your error tomorrow and get back to you

---

<div class="post-metadata">

**Author:** ![dmenager](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/dmenager/32/1686_2.png) [@dmenager](https://discourse.pymc.io/u/dmenager)\
**Post date:** [May 8, 2019, 7:52pm UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/17 "2019-05-08T19:52:18Z")

</div>

Ah, ok this makes a lot of sense. Thank you!

---

<div class="post-metadata">

**Author:** ![dmenager](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/dmenager/32/1686_2.png) [@dmenager](https://discourse.pymc.io/u/dmenager)\
**Post date:** [May 9, 2019, 7:23pm UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/18 "2019-05-09T19:23:22Z")

</div>

I don’t mean to rush you, but have you had any luck reproducing the error?

---

<div class="post-metadata">

**Author:** ![lucianopaz](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/lucianopaz/32/2186_2.png) [@lucianopaz](https://discourse.pymc.io/u/lucianopaz)\
**Post date:** [May 10, 2019, 4:46am UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/19 "2019-05-10T04:46:09Z")

</div>

I managed to reproduce your error. To fix it you just have to declare the mixtures dtype as int64:

```python
n = 1000
on_count = 3
schema_count = 10
pTri_given_on = 1.
pTri_given_not_on = .7
tri_delta_on = pTri_given_on - pTri_given_not_on
with pymc3.Model() as model:
    # On
    pOn = pymc3.Beta('pOn', alpha=on_count, beta=(schema_count - on_count))
    on = pymc3.Bernoulli('on', p=pOn)

    # Triangle
    triangle_mixture_weights = [on, (1. - on)]
    tri_giv_on = pymc3.Bernoulli.dist(pTri_given_not_on + tri_delta_on)
    tri_giv_not_on = pymc3.Bernoulli.dist(pTri_given_not_on)
    triangle = pymc3.Mixture('triangle', w=triangle_mixture_weights,
                             comp_dists=[tri_giv_on, tri_giv_not_on],
                             shape=2, dtype="int64")
    res = pymc3.sample(n)

```

Note that you havent passed observed to triangle. When I did, everything worked regardless of passing dtype or not.

---

<div class="post-metadata">

**Author:** ![dmenager](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.pymc.io/dmenager/32/1686_2.png) [@dmenager](https://discourse.pymc.io/u/dmenager)\
**Post date:** [May 10, 2019, 5:14am UTC](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217/20 "2019-05-10T05:14:25Z")

</div>

Ah ok, thank you! I’m glad it was a simple fix. Also, `shape=1`, right?

[Next page](https://discourse.pymc.io/t/keyerror-setting-mixture-proportions-for-mixture-model/3217.md?page=2)