Some remark of MXNet (Backed by Apache and Amazon):
- Static and dynamic graphs. Does optimisations for static graphs using nnvm.
- Custom ops in python (similar to theano). C++ ops should be reasonably straight forward as well. Good control over memory locations of variables.
- Good support for automatic parallelisation.