Child pages
  • tutorial - set up and run Kafka system tests with ducktape
Skip to end of metadata
Go to start of metadata

This tutorial will show you how to set up a test cluster and run Kafka system tests on your local machine. I'll assume here that you have a clone of Kafka trunk.

This is broken down into a series of short-ish videos. A summary of the commands run is below each video clip, so you can skip any video clip if you want to.

 


Ensure Vagrant and Virtualbox are installed

We'll need both Vagrant and Virtualbox to create a test cluster

To install Vagrant, go here

To install Virtualbox, go here

 


Bootstrap Vagrant for system testing 

 


Bring up the test cluster

This part is fairly simple, but can take a while, so bring a good book.

 


Run the tests

Here I'll install ducktape, introduce a few useful ducktape commands, show how to actually run the tests, and give an overview of test output.

 

 

 

 

 

  • No labels

1 Comment

  1. Are these instructions supposed to work on a VM? I've set up an Ubuntu VM with Vagrant and VirtualBox and have followed these steps. When I try vagrant up I get this error:

     

    Bringing machine 'worker1' up with 'virtualbox' provider...
    Bringing machine 'worker2' up with 'virtualbox' provider...
    Bringing machine 'worker3' up with 'virtualbox' provider...
    Bringing machine 'worker4' up with 'virtualbox' provider...
    Bringing machine 'worker5' up with 'virtualbox' provider...
    Bringing machine 'worker6' up with 'virtualbox' provider...
    Bringing machine 'worker7' up with 'virtualbox' provider...
    Bringing machine 'worker8' up with 'virtualbox' provider...
    Bringing machine 'worker9' up with 'virtualbox' provider...
    Bringing machine 'worker10' up with 'virtualbox' provider...

    ==> worker1: Box 'kafkatest-worker' could not be found. Attempting to find and install...
        worker1: Box Provider: virtualbox

       worker1: Box Version: >= 0

    ==> worker1: Box file was not detected as metadata. Adding it directly...

    ==> worker1: Adding box 'kafkatest-worker' (v0) for provider: virtualbox
        worker1: Downloading: kafkatest-worker

    An error occurred while downloading the remote file. The error
    message, if any, is reproduced below. Please fix this error and try

    again. 

    Couldn't open file /home/ubuntu/kafka/kafkatest-worker