Versions Compared

Old Version 1

changes.mady.by.user Geoff Anderson

Saved on

compared with

New Version Current

changes.mady.by.user Ewen Cheslack-Postava

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Status

Current state:  "Under Discussion" Accepted

Discussion thread: here

JIRA: JIRA for adding initial ducktape tests, JIRA for tracking porting of existing tests

Released: 0.8.3

Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).

...

    • Begin with a patch that adds new system test directory as a sibling of the old one. This directory will have bootstrap scripts for Vagrant, a few specific 'services' such as KafkaService and ZookeeperService, and a few new system tests.

    • Make sure provisioning and setup scripts are in a state where everyone in the community can reasonably easily run the full test suite on their own testbed.

    • Once test coverage with new tests is roughly a superset of old system test coverage, old system_tests directory will be removed. Roadmap for this is here.

    • Existing system_tests roughly cover the following, and new tests should cover these categories before deleting the existing directory:

      • Producer performance (producer_perf, which has wrappers for kafka.tools.ProducerPerformance)

      • Various correctness tests in the face of broker failover (replication_testsuite)

      • Consumer offset management in the face of consumer failure (offset_management)

      • Mirror maker tests which propagate data across broker clusters in the face of various types of failure.

...