Getting Kafka Example running in Docker

Hello,

I’m trying to get the Kafka ingestion example (http://druid.io/docs/latest/Tutorial:-Loading-Streaming-Data.html) running in a new Docker cluster I’ve been trying to set up and I’m having an issue querying. My docker project can be found here:

https://github.com/andrewserff/docker-druid

Take a look at the read me on how to start it all. Once I have it up and running, I’m just following the example on how to ingest some sample data. I run the sample data in, and I see it announce a new segment. Then I try to query the realtime node and it just hangs and eventually times out. I don’t see many error in the logs when I start up besides one about the overlord not being able to create a table that looks like this:

Caused by: org.apache.derby.client.am.SqlException: Error for batch element #0: Table/View ‘DRUID_CONFIG’ already exists in Schema ‘APP’.

But I’m told that should be ok. The other WARN message I see every so often is:

DEBG ‘druid-coordinator’ stdout output:

WARN [DatabaseSegmentManager-Exec–0] io.druid.metadata.SQLMetadataSegmentManager - No segments found in the database!

If anyone can help me out in figuring out the problem, that would be great!

Thanks!

Andrew

I finally figured this out and have it working now. There were properties that changed from 0.6 to 0.7.0 that were causing problems, but I also reverted all the configs to the examples from the distro. Now it all runs! You can find it here:

Just by running ‘docker-compose up’ you can have a druid cluster up and running with kafka ready to ingest some data!

Andrew