...
In case of real-time tables, the current Kafka Low Level Consumption protocol requires the Pinot Controller to synchronously upload the segment being committed to a deep storage system (behind the PinotFS interface - eg: NFS / HDFS). If this deep storage system is unavailable, the table ingestion will come to a halt.
This is a big concern because of the following reasons:
...