...
For more details, have a look at Kafka's producer configuration page.
I see "Unable to load realm info from SCDynamicStore" in my logs. Why?
This is a Java 6 bug that has no real impact to Samza. It does appear in the logs in certain circumstances. More details are available on HADOOP-7489.
Why is my job processing old messages?
There are several ways in which this can occur:
...
Note that the first two configurations also have system-level settings(i.e. systems.<your system>.samza.reset.offset and systems.<your system>.samza.offset.default).
How should Samza be run on AWS?
From Gian Merlino:
We've been using Samza in production on AWS for a little over a month. We're just using the YARN runner on a mostly stock hadoop 2.4.0 cluster (not EMR). Our experience is that c3s work well for the YARN instances and i2s work well for the Kafka instances. Things have been pretty solid with that setup.
...