...
The related issue: apache/incubator-pegasus#495
Rate-limiting of reads
Pegasus has the throttling of writes but has no support of the throttling of reads. This version introduces QPS-based throttling of reads.
Optimizations and improvements
Support HDFS as a remote storage provider of Bulk-Load/Backup/Restore
For most of our use-cases of bulk-load, HDFS is the default choice of remote storage for the Spark-generated files.
In this version, we add support for HDFS as well as the rate-limiting of HDFS downloading/uploading.
Fixed Issues
Known Issues
...
Apache Pegasus 2.2.0 是一个功能版本。所有的改动都被总结在: https://github.com/apache/incubator-pegasus/issues/696。
...
使用文档: http://pegasus.apache.org/administration/hotspot-detection
读限流
Pegasus有写限流但没有读限流的支持. 在这个版本我们引入了基于QPS的读限流.
优化和改进
支持HDFS用于BulkLoad/Backup/Restore
在我们绝大多数的BulkLoad用户场景,HDFS都是Spark生成文件的默认存储。在这一版本中,我们提供了HDFS以及HDFS文件上传下载的支持。