...

• Added zero gradients to rounding operators including `rint`, `ceil`, `floor`, `trunc`, and `fix` (#9040)

• Added `use_global_stats` in `nn.BatchNorm` (#9420)
• Added `axis` argument to `SequenceLast`, `SequenceMask` and `SequenceReverse` operators (#9306)
• Added `lazy_update` option for standard `SGD` & `Adam` optimizer with `row_sparse` gradients (#9468, #9189)
• Added `select` option in `Block.collect_params` to support regex (#9348)
• Added support for (one-to-one and sequence-to-one) inference on explicit unrolled RNN models in R (#9022) 

...

Deprecations

• The Scala API name space is still called "ml.dmlc". The name space is likely be changed in a future release to "org.apache" and might brake existing applications and scripts (#9579, #9324)

...