I have implemented a special kvstore named kvstore_speical. It is useful for some model parallel problem like distributed fc.
There are some details in the README.md
It is written in mxnet_v1.0.0.
It is work well in the multi card single pc, but still has one problem in multi card multi pcs(maybe crush after hours or days, and put out a strange error in van.cc.).
I ask for help, anyone can help me to put it into the master of mxnet.
Welcome for further discussion.