...
This behaviour is the same as when doing pip install horovod for TensorFlow and PyTorch support. When those libraries are not present, Horovod installation will fail.
(a) design using callbacks (b) simplified design
Figure 2. How Horovod interacts with MXNet engine
...