[druid-user] How do I configure the variety of ports used by Druid in docker-compose?

Hi everybody,

My very own distributed app already uses some of the ports used by Druid when deployed to docker-compose.

I tried to change the exposed ports (EXPOSED_PORT:INTERNAL_PORT) mapping in the docker-compose file used by druid, but when I ran druid in docker-compose it seemed to go haywire.

Can anybody please tell me how I change the ports used by Druid so that it will be compatible with my docker-compose app?

Thank you.

Sincerely,

Marco A. Villalobos

Hi Marco,

Are you putting your app and druid containers together in a single “network”?
If that is the case, then it won’t be about exposed vs internal because the communication would all be internal.
That means that you will need to change the individual process configurations to use a different port.
Each process configuration file called runtime.properties (usually found under /opt/druid/conf/cluster/[data|master|query]//runtime.properties) contains druid.plaintextPort and druid.tlsPort
which allow you to control which port(s) they use.
Take a look at the docs here for more details.

Sergio

Right. I am putting my app and druid together under one docker-compose file under the same network.

So, in order to do this, does that mean I’ll need to extend the druid docker image and and add a few awk scripts to change the runtime.properties?

That seems like a lot of trouble. Is there an easier way?

Yes. Take a look at Docker · Apache Druid
It describes the use of environment files to override default settings in the docker image.
Look at the concept of the DRUID_CONFIG_${service} environment variables that allow you to specify service specific config files that contain service specific overrides, which is what I think you need to achieve this.

Let us know how it goes.

Thanks,
Sergio

1 Like

I tried to follow the instructions but I must be doing something wrong.

I created a github example of this to try and get this working.

I am trying to make all the ports in the 2XXXX range. For example, overlord would be 28090.

https://github.com/minmay/druid-docker-compose

I would appreciate any advice given to me. Thank you.

Marco A. Villalobos

What you did is what I understood as well, so I’m not sure what is wrong with that approach.
A simple alternative may exist at the end of this section: Docker · Apache Druid

It points out that you can override any process specific property using environment variables in the docker-compose file, such as:

coordinator.druid:
build:
context: docker

env_file:

  • envs/druid.env
    environment:

- druid_plaintextPort=28081

historical.druid:

build:

context: docker

env_file:

  • envs/druid.env
    environment:
    - druid_plaintextPort=28083

Seems like a simpler way of overriding just the variables you need to, instead of providing a whole config file.
I have not tested this, but that’s what I’m understanding. Let us know how it goes.

Sergio

when I docker compose up, I receive an exception similar to this (sorry for the long text):

docker-compose logs broker.druid
Attaching to broker.druid
broker.druid | 2022-01-20T01:47:32+0000 startup service broker
broker.druid | Setting druid.host=172.21.0.8 in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.indexer.runner.javaOptsArray=["-server", “-Xmx1g”, “-Xms1g”, “-XX:MaxDirectMemorySize=3g”, “-Duser.timezone=UTC”, “-Dfile.encoding=UTF-8”, “-Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager”] in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.indexer.logs.type=file in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.extensions.loadList=[“druid-histogram”, “druid-datasketches”, “druid-lookups-cached-global”, “postgresql-metadata-storage”, “druid-kafka-indexing-service”] in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.processing.numMergeBuffers=2 in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.metadata.storage.host= in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.coordinator.balancer.strategy=cachingCost in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.metadata.storage.type=postgresql in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.processing.numThreads=2 in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.metadata.storage.connector.connectURI=jdbc:postgresql://postgres.druid:25432/druid in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.storage.type=local in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.metadata.storage.connector.user=druid in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.zk.service.host=zookeeper.druid in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.indexer.logs.directory=/opt/shared/indexing-logs in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.indexer.fork.property.druid.processing.buffer.sizeBytes=256MiB in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.storage.storageDirectory=/opt/shared/segments in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.metadata.storage.connector.password=supersecretpassword in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | Setting druid.emitter.logging.logLevel=debug in /tmp/conf/druid/cluster/query/broker/runtime.properties
broker.druid | 2022-01-20T01:47:37,734 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.2.5.Final
broker.druid | 2022-01-20T01:47:39,970 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-tdigestsketch], jars: t-digest-3.2.jar, druid-tdigestsketch-0.22.1.jar
broker.druid | 2022-01-20T01:47:39,990 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-histogram], jars: druid-histogram-0.22.1.jar
broker.druid | 2022-01-20T01:47:39,995 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-datasketches], jars: commons-math3-3.6.1.jar, druid-datasketches-0.22.1.jar
broker.druid | 2022-01-20T01:47:40,011 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [gce-extensions], jars: google-api-client-1.26.0.jar, google-http-client-jackson2-1.26.0.jar, google-api-services-compute-v1-rev20190607-1.26.0.jar, google-oauth-client-1.26.0.jar, google-http-client-1.26.0.jar, gce-extensions-0.22.1.jar, j2objc-annotations-1.1.jar, guava-16.0.1.jar
broker.druid | 2022-01-20T01:47:40,043 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kafka-extraction-namespace], jars: kafka-clients-2.8.0.jar, druid-lookups-cached-global-0.22.1.jar, zstd-jni-1.3.3-1.jar, druid-kafka-extraction-namespace-0.22.1.jar, mapdb-1.0.8.jar, snappy-java-1.1.8.1.jar, lz4-java-1.7.1.jar
broker.druid | 2022-01-20T01:47:40,065 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-avro-extensions], jars: common-utils-5.5.1.jar, snappy-java-1.1.7.3.jar, velocity-engine-core-2.2.jar, schema-repo-client-0.1.3.jar, gson-2.3.1.jar, jakarta.inject-2.6.1.jar, schema-repo-common-0.1.3.jar, schema-repo-api-0.1.3.jar, avro-ipc-jetty-1.9.2.jar, jakarta.activation-1.2.1.jar, swagger-annotations-1.6.0.jar, kafka-clients-5.5.1-ccs.jar, javax.annotation-api-1.3.2.jar, druid-avro-extensions-0.22.1.jar, common-config-5.5.1.jar, osgi-resource-locator-1.0.3.jar, zstd-jni-1.3.3-1.jar, jersey-common-2.30.jar, jakarta.annotation-api-1.3.5.jar, slf4j-api-1.7.25.jar, avro-ipc-1.9.2.jar, kafka-schema-registry-client-5.5.1.jar, jersey-client-1.19.3.jar, avro-1.9.2.jar, avro-mapred-1.9.2.jar, lz4-java-1.7.1.jar, schema-repo-avro-0.1.3.jar
broker.druid | 2022-01-20T01:47:40,139 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-redis-cache], jars: commons-pool2-2.4.2.jar, druid-redis-cache-0.22.1.jar, jedis-2.9.0.jar
broker.druid | 2022-01-20T01:47:40,153 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-opentsdb-emitter], jars: druid-opentsdb-emitter-0.22.1.jar, jsr311-api-1.1.1.jar, jersey-core-1.19.3.jar, jersey-client-1.19.3.jar
broker.druid | 2022-01-20T01:47:40,169 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-cassandra-storage], jars: stringtemplate-3.2.jar, json-simple-1.1.jar, uuid-3.2.0.jar, astyanax-1.0.1.jar, cassandra-thrift-1.0.8.jar, jamm-0.2.5.jar, cassandra-all-1.0.8.jar, jettison-1.3.1.jar, snakeyaml-1.6.jar, snappy-java-1.0.4.1.jar, antlr-2.7.7.jar, concurrentlinkedhashmap-lru-1.2.jar, antlr-3.2.jar, antlr-runtime-3.2.jar, stax-api-1.0.1.jar, libthrift-0.6.1.jar, avro-1.4.0-cassandra-1.jar, druid-cassandra-storage-0.22.1.jar, org.apache.servicemix.bundles.commons-csv-1.0-r706900_3.jar, guava-16.0.1.jar
broker.druid | 2022-01-20T01:47:40,226 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [materialized-view-maintenance], jars: materialized-view-maintenance-0.22.1.jar
broker.druid | 2022-01-20T01:47:40,233 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [kafka-emitter], jars: kafka-clients-2.8.0.jar, kafka-emitter-0.22.1.jar, zstd-jni-1.3.3-1.jar, slf4j-api-1.7.25.jar, snappy-java-1.1.8.1.jar, lz4-java-1.7.1.jar
broker.druid | 2022-01-20T01:47:40,260 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kinesis-indexing-service], jars: aws-java-sdk-kinesis-1.12.37.jar, jmespath-java-1.12.37.jar, aws-java-sdk-sts-1.12.37.jar, druid-kinesis-indexing-service-0.22.1.jar
broker.druid | 2022-01-20T01:47:40,272 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [simple-client-sslcontext], jars: simple-client-sslcontext-0.22.1.jar
broker.druid | 2022-01-20T01:47:40,301 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-influxdb-emitter], jars: fastutil-extra-8.5.4.jar, netty-resolver-dns-4.1.68.Final.jar, jboss-logging-3.2.1.Final.jar, jsr305-2.0.1.jar, log4j-1.2-api-2.15.0.jar, shims-0.9.0.jar, netty-buffer-4.1.68.Final.jar, jackson-jq-0.0.10.jar, netty-codec-dns-4.1.68.Final.jar, druid-hll-0.22.1.jar, commons-collections4-4.2.jar, netty-reactive-streams-2.0.0.jar, netty-codec-4.1.68.Final.jar, validation-api-1.1.0.Final.jar, jvm-attach-api-1.5.jar, druid-core-0.22.1.jar, netty-transport-native-epoll-4.1.68.Final-linux-x86_64.jar, guice-4.1.0.jar, commons-io-2.11.0.jar, druid-processing-0.22.1.jar, accessors-smart-1.2.jar, commons-math3-3.6.1.jar, commons-net-3.6.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, netty-codec-socks-4.1.68.Final.jar, javax.inject-1.jar, joda-time-2.10.5.jar, asm-tree-7.1.jar, netty-3.10.6.Final.jar, asm-7.1.jar, plexus-utils-3.0.24.jar, jackson-datatype-guava-2.10.5.jar, netty-common-4.1.68.Final.jar, xz-1.8.jar, cron-scheduler-0.1.jar, async-http-client-netty-utils-2.5.3.jar, sigar-1.6.5.132.jar, icu4j-55.1.jar, netty-transport-4.1.68.Final.jar, javax.el-api-3.0.0.jar, async-http-client-2.5.3.jar, error_prone_annotations-2.8.0.jar, jackson-datatype-joda-2.10.5.jar, json-path-2.3.0.jar, json-smart-2.3.jar, jaxb-api-2.3.1.jar, guice-multibindings-4.1.0.jar, zstd-jni-1.3.3-1.jar, classmate-1.1.0.jar, config-magic-0.9.jar, compress-lzf-1.0.4.jar, fastutil-core-8.5.4.jar, disruptor-3.3.6.jar, joni-2.1.27.jar, hibernate-validator-5.2.5.Final.jar, commons-text-1.3.jar, aopalliance-1.0.jar, reactive-streams-1.0.2.jar, RoaringBitmap-0.9.0.jar, fastutil-8.5.4.jar, jackson-dataformat-smile-2.10.5.jar, maven-artifact-3.6.0.jar, netty-handler-4.1.68.Final.jar, rhino-1.7.11.jar, log4j-core-2.15.0.jar, jna-4.5.1.jar, commons-codec-1.13.jar, slf4j-api-1.7.25.jar, antlr4-runtime-4.5.1.jar, netty-transport-native-unix-common-4.1.68.Final.jar, commons-lang3-3.8.1.jar, javax.activation-api-1.2.0.jar, checker-qual-2.5.7.jar, airline-0.7.jar, druid-influxdb-emitter-0.22.1.jar, jcodings-1.0.43.jar, opencsv-4.6.jar, asm-analysis-7.1.jar, javax.el-3.0.0.jar, asm-commons-7.1.jar, datasketches-java-2.0.0.jar, log4j-slf4j-impl-2.15.0.jar, jcl-over-slf4j-1.7.12.jar, log4j-api-2.15.0.jar, jdbi-2.63.1.jar, extendedset-0.22.1.jar, lz4-java-1.7.1.jar, netty-handler-proxy-4.1.68.Final.jar, netty-resolver-4.1.68.Final.jar, log4j-jul-2.15.0.jar, httpclient-4.5.10.jar, commons-lang-2.6.jar, netty-codec-http-4.1.68.Final.jar, guava-16.0.1.jar, datasketches-memory-1.3.0.jar, javax.activation-1.2.0.jar
broker.druid | 2022-01-20T01:47:40,534 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-aws-rds-extensions], jars: jmespath-java-1.12.37.jar, aws-java-sdk-rds-1.12.37.jar, ion-java-1.0.2.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, joda-time-2.10.5.jar, druid-aws-rds-extensions-0.22.1.jar, jackson-dataformat-cbor-2.10.5.jar, commons-codec-1.13.jar, aws-java-sdk-core-1.12.37.jar, httpclient-4.5.10.jar
broker.druid | 2022-01-20T01:47:40,554 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-stats], jars: commons-math3-3.6.1.jar, druid-stats-0.22.1.jar
broker.druid | 2022-01-20T01:47:40,577 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-ranger-security], jars: metrics-core-2.2.0.jar, hadoop-mapreduce-client-shuffle-2.8.5.jar, jna-platform-5.2.0.jar, jackson-mapper-asl-1.9.13.jar, hadoop-mapreduce-client-jobclient-2.8.5.jar, scala-library-2.11.12.jar, druid-ranger-security-0.22.1.jar, hadoop-auth-2.8.5.jar, htrace-core4-4.0.1-incubating.jar, xmlenc-0.52.jar, commons-collections-3.2.2.jar, solr-solrj-7.7.1.jar, woodstox-core-asl-4.4.1.jar, commons-io-2.11.0.jar, httpmime-4.5.3.jar, accessors-smart-1.2.jar, jersey-bundle-1.19.3.jar, commons-math3-3.6.1.jar, commons-net-3.6.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, jackson-jaxrs-1.9.13.jar, asm-7.1.jar, jetty-sslengine-6.1.26.jar, gethostname4j-0.0.2.jar, apacheds-i18n-2.0.0-M15.jar, curator-framework-4.3.0.jar, ranger-plugins-audit-2.0.0.jar, scala-logging_2.11-3.9.0.jar, eclipselink-2.5.2.jar, leveldbjni-all-1.8.jar, scala-reflect-2.11.12.jar, commons-configuration-1.6.jar, curator-recipes-4.3.0.jar, zkclient-0.10.jar, api-util-1.0.3.jar, hadoop-mapreduce-client-common-2.8.5.jar, jsp-api-2.1.jar, json-smart-2.3.jar, hadoop-yarn-server-common-2.8.5.jar, commonj.sdo-2.1.1.jar, gson-2.2.4.jar, jopt-simple-5.0.4.jar, jna-4.5.1.jar, apacheds-kerberos-codec-2.0.0-M15.jar, hadoop-common-2.8.5.jar, snappy-java-1.1.7.1.jar, ranger-plugins-common-2.0.0.jar, log4j-1.2.17.jar, commons-codec-1.13.jar, slf4j-api-1.7.25.jar, jsr311-api-1.1.1.jar, jcip-annotations-1.0-1.jar, hadoop-annotations-2.8.5.jar, hadoop-yarn-client-2.8.5.jar, jackson-core-asl-1.9.13.jar, kafka-clients-2.0.0.jar, javax.persistence-2.1.0.jar, jcl-over-slf4j-1.7.12.jar, api-asn1-api-1.0.0-M20.jar, hadoop-client-2.8.5.jar, kafka_2.11-2.0.0.jar, commons-digester-1.8.jar, ranger-plugins-cred-2.0.0.jar, stax2-api-3.1.4.jar, httpclient-4.5.10.jar, nimbus-jose-jwt-4.41.1.jar, noggit-0.8.jar, guava-16.0.1.jar, hadoop-mapreduce-client-app-2.8.5.jar, hadoop-yarn-api-2.8.5.jar
broker.druid | 2022-01-20T01:47:40,769 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service], jars: kafka-clients-2.8.0.jar, zstd-jni-1.3.3-1.jar, snappy-java-1.1.8.1.jar, druid-kafka-indexing-service-0.22.1.jar, lz4-java-1.7.1.jar
broker.druid | 2022-01-20T01:47:40,777 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-influx-extensions], jars: druid-influx-extensions-0.22.1.jar, antlr4-runtime-4.5.1.jar
broker.druid | 2022-01-20T01:47:40,793 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-bloom-filter], jars: druid-bloom-filter-0.22.1.jar, hive-storage-api-2.7.1.jar, commons-lang-2.6.jar
broker.druid | 2022-01-20T01:47:40,795 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-google-extensions], jars: druid-google-extensions-0.22.1.jar, google-api-services-storage-v1-rev20190523-1.26.0.jar
broker.druid | 2022-01-20T01:47:40,802 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-virtual-columns], jars: druid-virtual-columns-0.22.1.jar
broker.druid | 2022-01-20T01:47:40,808 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-cloudfiles-extensions], jars: jclouds-core-1.9.1.jar, guice-assistedinject-3.0.jar, rackspace-cloudfiles-uk-1.9.1.jar, javax.inject-1.jar, openstack-swift-1.9.1.jar, rackspace-cloudfiles-us-1.9.1.jar, gson-2.3.jar, rackspace-cloudidentity-1.9.1.jar, jclouds-blobstore-1.9.1.jar, jsr250-api-1.0.jar, jclouds-slf4j-1.9.1.jar, rackspace-cloudfiles-1.9.1.jar, openstack-keystone-1.9.1.jar, jackson-module-guice-2.10.5.jar, jsr311-api-1.1.1.jar, druid-cloudfiles-extensions-0.22.1.jar, guice-3.0.jar, guice-multibindings-3.0.jar, rocoto-6.2.jar, guava-16.0.1.jar
broker.druid | 2022-01-20T01:47:40,832 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [dropwizard-emitter], jars: metrics-jmx-4.0.0.jar, dropwizard-emitter-0.22.1.jar, slf4j-api-1.7.25.jar, metrics-core-4.0.0.jar
broker.druid | 2022-01-20T01:47:40,848 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [aliyun-oss-extensions], jars: opentracing-util-0.33.0.jar, aliyun-java-sdk-core-4.5.10.jar, aliyun-java-sdk-ram-3.1.0.jar, jdom2-2.0.6.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, aliyun-sdk-oss-3.11.3.jar, opentracing-noop-0.33.0.jar, jaxb-api-2.3.1.jar, gson-2.8.6.jar, stax-api-1.0.1.jar, ini4j-0.5.4.jar, opentracing-api-0.33.0.jar, commons-codec-1.13.jar, slf4j-api-1.7.25.jar, aliyun-java-sdk-kms-2.11.0.jar, javax.activation-api-1.2.0.jar, org.jacoco.agent-0.8.5-runtime.jar, httpclient-4.5.10.jar, aliyun-oss-extensions-0.22.1.jar, jettison-1.1.jar
broker.druid | 2022-01-20T01:47:40,899 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage], jars: postgresql-42.2.14.jar, postgresql-metadata-storage-0.22.1.jar
broker.druid | 2022-01-20T01:47:40,906 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-orc-extensions], jars: orc-core-1.6.9.jar, orc-shims-1.6.9.jar, jackson-mapper-asl-1.9.13.jar, hadoop-auth-2.8.5.jar, htrace-core4-4.0.1-incubating.jar, hadoop-mapreduce-client-core-2.8.5.jar, hadoop-hdfs-client-2.8.5.jar, protobuf-java-3.11.0.jar, commons-configuration-1.6.jar, aircompressor-0.19.jar, annotations-17.0.0.jar, hadoop-common-2.8.5.jar, hadoop-annotations-2.8.5.jar, commons-lang3-3.8.1.jar, jackson-core-asl-1.9.13.jar, hive-storage-api-2.7.1.jar, druid-orc-extensions-0.22.1.jar, orc-mapreduce-1.6.9.jar, threeten-extra-1.5.0.jar, commons-digester-1.8.jar
broker.druid | 2022-01-20T01:47:40,965 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-azure-extensions], jars: guice-4.1.0.jar, javax.inject-1.jar, guice-assistedinject-4.1.0.jar, druid-azure-extensions-0.22.1.jar, aopalliance-1.0.jar, azure-storage-8.6.0.jar, azure-keyvault-core-1.0.0.jar, guava-16.0.1.jar
broker.druid | 2022-01-20T01:47:40,989 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-s3-extensions], jars: jmespath-java-1.12.37.jar, druid-s3-extensions-0.22.1.jar, ion-java-1.0.2.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, joda-time-2.10.5.jar, aws-java-sdk-sts-1.12.37.jar, jackson-dataformat-cbor-2.10.5.jar, commons-codec-1.13.jar, aws-java-sdk-core-1.12.37.jar, httpclient-4.5.10.jar
broker.druid | 2022-01-20T01:47:41,032 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [statsd-emitter], jars: asm-util-7.1.jar, jnr-a64asm-1.0.0.jar, java-dogstatsd-client-2.13.0.jar, jnr-enxio-0.30.jar, asm-tree-7.1.jar, jnr-posix-3.0.61.jar, asm-7.1.jar, jffi-1.2.23-native.jar, statsd-emitter-0.22.1.jar, jnr-x86asm-1.0.2.jar, jnr-ffi-2.1.16.jar, jffi-1.2.23.jar, jnr-unixsocket-0.36.jar, jnr-constants-0.9.17.jar, asm-analysis-7.1.jar, asm-commons-7.1.jar
broker.druid | 2022-01-20T01:47:41,084 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [mysql-metadata-storage], jars: mysql-metadata-storage-0.22.1.jar
broker.druid | 2022-01-20T01:47:41,089 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [graphite-emitter], jars: metrics-graphite-3.1.2.jar, graphite-emitter-0.22.1.jar, slf4j-api-1.7.25.jar, metrics-core-4.0.0.jar
broker.druid | 2022-01-20T01:47:41,100 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [ambari-metrics-emitter], jars: ambari-metrics-common-2.7.0.0.0.jar, jackson-xc-1.9.13.jar, commons-io-2.11.0.jar, commons-math3-3.6.1.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, curator-framework-4.3.0.jar, curator-client-4.3.0.jar, commons-codec-1.13.jar, slf4j-api-1.7.25.jar, hadoop-annotations-2.8.5.jar, httpclient-4.5.10.jar, commons-lang-2.6.jar, guava-16.0.1.jar, gson-2.2.2.jar, ambari-metrics-emitter-0.22.1.jar
broker.druid | 2022-01-20T01:47:41,156 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-parquet-extensions], jars: audience-annotations-0.12.0.jar, jackson-mapper-asl-1.9.13.jar, parquet-avro-1.12.0.jar, hadoop-auth-2.8.5.jar, htrace-core4-4.0.1-incubating.jar, parquet-common-1.12.0.jar, hadoop-mapreduce-client-core-2.8.5.jar, parquet-column-1.12.0.jar, hadoop-hdfs-client-2.8.5.jar, parquet-jackson-1.12.0.jar, parquet-encoding-1.12.0.jar, commons-configuration-1.6.jar, javax.annotation-api-1.3.2.jar, zstd-jni-1.3.3-1.jar, hadoop-common-2.8.5.jar, slf4j-api-1.7.25.jar, hadoop-annotations-2.8.5.jar, jackson-core-asl-1.9.13.jar, parquet-format-structures-1.12.0.jar, snappy-java-1.1.8.jar, parquet-hadoop-1.12.0.jar, avro-1.9.2.jar, druid-parquet-extensions-0.22.1.jar
broker.druid | 2022-01-20T01:47:41,237 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kerberos], jars: hadoop-auth-2.8.5.jar, druid-kerberos-0.22.1.jar, apacheds-i18n-2.0.0-M15.jar, commons-configuration-1.6.jar, api-util-1.0.3.jar, jsp-api-2.1.jar, apacheds-kerberos-codec-2.0.0-M15.jar, hadoop-common-2.8.5.jar, api-asn1-api-1.0.0-M20.jar
broker.druid | 2022-01-20T01:47:41,262 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-lookups-cached-single], jars: stringtemplate-3.2.jar, antlr-2.7.7.jar, druid-lookups-cached-single-0.22.1.jar, mapdb-1.0.8.jar
broker.druid | 2022-01-20T01:47:41,281 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global], jars: druid-lookups-cached-global-0.22.1.jar, mapdb-1.0.8.jar
broker.druid | 2022-01-20T01:47:41,294 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-hdfs-storage], jars: hadoop-mapreduce-client-shuffle-2.8.5.jar, hadoop-aws-2.8.5.jar, jackson-mapper-asl-1.9.13.jar, hadoop-mapreduce-client-jobclient-2.8.5.jar, hadoop-auth-2.8.5.jar, htrace-core4-4.0.1-incubating.jar, xmlenc-0.52.jar, commons-collections-3.2.2.jar, jmespath-java-1.12.37.jar, hadoop-mapreduce-client-core-2.8.5.jar, hadoop-hdfs-client-2.8.5.jar, ion-java-1.0.2.jar, accessors-smart-1.2.jar, commons-net-3.6.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, joda-time-2.10.5.jar, asm-7.1.jar, jetty-sslengine-6.1.26.jar, apacheds-i18n-2.0.0-M15.jar, curator-framework-4.3.0.jar, leveldbjni-all-1.8.jar, commons-configuration-1.6.jar, curator-recipes-4.3.0.jar, api-util-1.0.3.jar, hadoop-mapreduce-client-common-2.8.5.jar, jackson-dataformat-cbor-2.10.5.jar, jsp-api-2.1.jar, json-smart-2.3.jar, aws-java-sdk-s3-1.12.37.jar, hadoop-yarn-server-common-2.8.5.jar, gson-2.2.4.jar, apacheds-kerberos-codec-2.0.0-M15.jar, hadoop-common-2.8.5.jar, commons-codec-1.13.jar, aws-java-sdk-core-1.12.37.jar, jcip-annotations-1.0-1.jar, hadoop-annotations-2.8.5.jar, hadoop-yarn-client-2.8.5.jar, jackson-core-asl-1.9.13.jar, aws-java-sdk-kms-1.12.37.jar, druid-hdfs-storage-0.22.1.jar, api-asn1-api-1.0.0-M20.jar, hadoop-client-2.8.5.jar, commons-digester-1.8.jar, httpclient-4.5.10.jar, nimbus-jose-jwt-4.41.1.jar, hadoop-mapreduce-client-app-2.8.5.jar, hadoop-yarn-api-2.8.5.jar
broker.druid | 2022-01-20T01:47:41,452 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kubernetes-extensions], jars: swagger-annotations-1.6.2.jar, jsr305-2.0.1.jar, commons-collections4-4.2.jar, bcpkix-jdk15on-1.66.jar, sundr-codegen-0.22.0.jar, resourcecify-annotations-0.22.0.jar, client-java-extended-10.0.1.jar, commons-io-2.11.0.jar, bcprov-ext-jdk15on-1.68.jar, joda-convert-2.2.1.jar, simpleclient_common-0.9.0.jar, joda-time-2.10.5.jar, protobuf-java-3.11.0.jar, bucket4j-core-4.10.0.jar, snakeyaml-1.27.jar, simpleclient_httpserver-0.9.0.jar, javax.annotation-api-1.3.2.jar, okhttp-3.14.9.jar, zjsonpatch-0.4.11.jar, gson-fire-1.8.4.jar, okio-1.17.2.jar, gson-2.8.6.jar, sundr-core-0.22.0.jar, client-java-10.0.1.jar, commons-codec-1.13.jar, slf4j-api-1.7.25.jar, client-java-proto-10.0.1.jar, simpleclient-0.9.0.jar, bcprov-jdk15on-1.68.jar, builder-annotations-0.22.0.jar, commons-lang3-3.8.1.jar, client-java-api-10.0.1.jar, druid-kubernetes-extensions-0.22.1.jar, logging-interceptor-3.14.9.jar, jose4j-0.7.2.jar, guava-16.0.1.jar
broker.druid | 2022-01-20T01:47:41,568 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-ec2-extensions], jars: druid-ec2-extensions-0.22.1.jar
broker.druid | 2022-01-20T01:47:41,574 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-time-min-max], jars: druid-time-min-max-0.22.1.jar
broker.druid | 2022-01-20T01:47:41,578 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-protobuf-extensions], jars: druid-protobuf-extensions-0.22.1.jar
broker.druid | 2022-01-20T01:47:41,587 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-thrift-extensions], jars: druid-thrift-extensions-0.22.1.jar, json-simple-1.1.jar, protobuf-java-3.11.0.jar, elephant-bird-core-4.17.jar, javax.annotation-api-1.3.2.jar, slf4j-api-1.7.25.jar, elephant-bird-hadoop-compat-4.17.jar, commons-lang-2.6.jar, guava-16.0.1.jar, libthrift-0.13.0.jar
broker.druid | 2022-01-20T01:47:41,625 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [sqlserver-metadata-storage], jars: sqlserver-metadata-storage-0.22.1.jar
broker.druid | 2022-01-20T01:47:41,627 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [materialized-view-selection], jars: materialized-view-maintenance-0.22.1.jar, materialized-view-selection-0.22.1.jar
broker.druid | 2022-01-20T01:47:41,629 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-moving-average-query], jars: druid-moving-average-query-0.22.1.jar
broker.druid | 2022-01-20T01:47:41,635 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-distinctcount], jars: druid-distinctcount-0.22.1.jar
broker.druid | 2022-01-20T01:47:41,639 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-pac4j], jars: activation-1.1.1.jar, druid-pac4j-0.22.1.jar, pac4j-oidc-3.8.3.jar, accessors-smart-1.2.jar, javax.mail-1.6.1.jar, asm-7.1.jar, lang-tag-1.5.jar, pac4j-core-3.8.3.jar, json-smart-2.3.jar, nimbus-jose-jwt-7.9.jar, slf4j-api-1.7.25.jar, oauth2-oidc-sdk-6.5.jar, jcip-annotations-1.0-1.jar
broker.druid | 2022-01-20T01:47:41,668 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-basic-security], jars: druid-basic-security-0.22.1.jar
broker.druid | 2022-01-20T01:47:42,786 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-tdigestsketch], jars: t-digest-3.2.jar, druid-tdigestsketch-0.22.1.jar
broker.druid | 2022-01-20T01:47:42,813 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-histogram], jars: druid-histogram-0.22.1.jar
broker.druid | 2022-01-20T01:47:42,870 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-datasketches], jars: commons-math3-3.6.1.jar, druid-datasketches-0.22.1.jar
broker.druid | 2022-01-20T01:47:42,941 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [gce-extensions], jars: google-api-client-1.26.0.jar, google-http-client-jackson2-1.26.0.jar, google-api-services-compute-v1-rev20190607-1.26.0.jar, google-oauth-client-1.26.0.jar, google-http-client-1.26.0.jar, gce-extensions-0.22.1.jar, j2objc-annotations-1.1.jar, guava-16.0.1.jar
broker.druid | 2022-01-20T01:47:42,947 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kafka-extraction-namespace], jars: kafka-clients-2.8.0.jar, druid-lookups-cached-global-0.22.1.jar, zstd-jni-1.3.3-1.jar, druid-kafka-extraction-namespace-0.22.1.jar, mapdb-1.0.8.jar, snappy-java-1.1.8.1.jar, lz4-java-1.7.1.jar
broker.druid | 2022-01-20T01:47:42,984 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-avro-extensions], jars: common-utils-5.5.1.jar, snappy-java-1.1.7.3.jar, velocity-engine-core-2.2.jar, schema-repo-client-0.1.3.jar, gson-2.3.1.jar, jakarta.inject-2.6.1.jar, schema-repo-common-0.1.3.jar, schema-repo-api-0.1.3.jar, avro-ipc-jetty-1.9.2.jar, jakarta.activation-1.2.1.jar, swagger-annotations-1.6.0.jar, kafka-clients-5.5.1-ccs.jar, javax.annotation-api-1.3.2.jar, druid-avro-extensions-0.22.1.jar, common-config-5.5.1.jar, osgi-resource-locator-1.0.3.jar, zstd-jni-1.3.3-1.jar, jersey-common-2.30.jar, jakarta.annotation-api-1.3.5.jar, slf4j-api-1.7.25.jar, avro-ipc-1.9.2.jar, kafka-schema-registry-client-5.5.1.jar, jersey-client-1.19.3.jar, avro-1.9.2.jar, avro-mapred-1.9.2.jar, lz4-java-1.7.1.jar, schema-repo-avro-0.1.3.jar
broker.druid | 2022-01-20T01:47:43,008 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-redis-cache], jars: commons-pool2-2.4.2.jar, druid-redis-cache-0.22.1.jar, jedis-2.9.0.jar
broker.druid | 2022-01-20T01:47:43,028 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-opentsdb-emitter], jars: druid-opentsdb-emitter-0.22.1.jar, jsr311-api-1.1.1.jar, jersey-core-1.19.3.jar, jersey-client-1.19.3.jar
broker.druid | 2022-01-20T01:47:43,045 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-cassandra-storage], jars: stringtemplate-3.2.jar, json-simple-1.1.jar, uuid-3.2.0.jar, astyanax-1.0.1.jar, cassandra-thrift-1.0.8.jar, jamm-0.2.5.jar, cassandra-all-1.0.8.jar, jettison-1.3.1.jar, snakeyaml-1.6.jar, snappy-java-1.0.4.1.jar, antlr-2.7.7.jar, concurrentlinkedhashmap-lru-1.2.jar, antlr-3.2.jar, antlr-runtime-3.2.jar, stax-api-1.0.1.jar, libthrift-0.6.1.jar, avro-1.4.0-cassandra-1.jar, druid-cassandra-storage-0.22.1.jar, org.apache.servicemix.bundles.commons-csv-1.0-r706900_3.jar, guava-16.0.1.jar
broker.druid | 2022-01-20T01:47:43,066 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [materialized-view-maintenance], jars: materialized-view-maintenance-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,080 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [kafka-emitter], jars: kafka-clients-2.8.0.jar, kafka-emitter-0.22.1.jar, zstd-jni-1.3.3-1.jar, slf4j-api-1.7.25.jar, snappy-java-1.1.8.1.jar, lz4-java-1.7.1.jar
broker.druid | 2022-01-20T01:47:43,101 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kinesis-indexing-service], jars: aws-java-sdk-kinesis-1.12.37.jar, jmespath-java-1.12.37.jar, aws-java-sdk-sts-1.12.37.jar, druid-kinesis-indexing-service-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,110 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [simple-client-sslcontext], jars: simple-client-sslcontext-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,141 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-influxdb-emitter], jars: fastutil-extra-8.5.4.jar, netty-resolver-dns-4.1.68.Final.jar, jboss-logging-3.2.1.Final.jar, jsr305-2.0.1.jar, log4j-1.2-api-2.15.0.jar, shims-0.9.0.jar, netty-buffer-4.1.68.Final.jar, jackson-jq-0.0.10.jar, netty-codec-dns-4.1.68.Final.jar, druid-hll-0.22.1.jar, commons-collections4-4.2.jar, netty-reactive-streams-2.0.0.jar, netty-codec-4.1.68.Final.jar, validation-api-1.1.0.Final.jar, jvm-attach-api-1.5.jar, druid-core-0.22.1.jar, netty-transport-native-epoll-4.1.68.Final-linux-x86_64.jar, guice-4.1.0.jar, commons-io-2.11.0.jar, druid-processing-0.22.1.jar, accessors-smart-1.2.jar, commons-math3-3.6.1.jar, commons-net-3.6.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, netty-codec-socks-4.1.68.Final.jar, javax.inject-1.jar, joda-time-2.10.5.jar, asm-tree-7.1.jar, netty-3.10.6.Final.jar, asm-7.1.jar, plexus-utils-3.0.24.jar, jackson-datatype-guava-2.10.5.jar, netty-common-4.1.68.Final.jar, xz-1.8.jar, cron-scheduler-0.1.jar, async-http-client-netty-utils-2.5.3.jar, sigar-1.6.5.132.jar, icu4j-55.1.jar, netty-transport-4.1.68.Final.jar, javax.el-api-3.0.0.jar, async-http-client-2.5.3.jar, error_prone_annotations-2.8.0.jar, jackson-datatype-joda-2.10.5.jar, json-path-2.3.0.jar, json-smart-2.3.jar, jaxb-api-2.3.1.jar, guice-multibindings-4.1.0.jar, zstd-jni-1.3.3-1.jar, classmate-1.1.0.jar, config-magic-0.9.jar, compress-lzf-1.0.4.jar, fastutil-core-8.5.4.jar, disruptor-3.3.6.jar, joni-2.1.27.jar, hibernate-validator-5.2.5.Final.jar, commons-text-1.3.jar, aopalliance-1.0.jar, reactive-streams-1.0.2.jar, RoaringBitmap-0.9.0.jar, fastutil-8.5.4.jar, jackson-dataformat-smile-2.10.5.jar, maven-artifact-3.6.0.jar, netty-handler-4.1.68.Final.jar, rhino-1.7.11.jar, log4j-core-2.15.0.jar, jna-4.5.1.jar, commons-codec-1.13.jar, slf4j-api-1.7.25.jar, antlr4-runtime-4.5.1.jar, netty-transport-native-unix-common-4.1.68.Final.jar, commons-lang3-3.8.1.jar, javax.activation-api-1.2.0.jar, checker-qual-2.5.7.jar, airline-0.7.jar, druid-influxdb-emitter-0.22.1.jar, jcodings-1.0.43.jar, opencsv-4.6.jar, asm-analysis-7.1.jar, javax.el-3.0.0.jar, asm-commons-7.1.jar, datasketches-java-2.0.0.jar, log4j-slf4j-impl-2.15.0.jar, jcl-over-slf4j-1.7.12.jar, log4j-api-2.15.0.jar, jdbi-2.63.1.jar, extendedset-0.22.1.jar, lz4-java-1.7.1.jar, netty-handler-proxy-4.1.68.Final.jar, netty-resolver-4.1.68.Final.jar, log4j-jul-2.15.0.jar, httpclient-4.5.10.jar, commons-lang-2.6.jar, netty-codec-http-4.1.68.Final.jar, guava-16.0.1.jar, datasketches-memory-1.3.0.jar, javax.activation-1.2.0.jar
broker.druid | 2022-01-20T01:47:43,162 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-aws-rds-extensions], jars: jmespath-java-1.12.37.jar, aws-java-sdk-rds-1.12.37.jar, ion-java-1.0.2.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, joda-time-2.10.5.jar, druid-aws-rds-extensions-0.22.1.jar, jackson-dataformat-cbor-2.10.5.jar, commons-codec-1.13.jar, aws-java-sdk-core-1.12.37.jar, httpclient-4.5.10.jar
broker.druid | 2022-01-20T01:47:43,167 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-stats], jars: commons-math3-3.6.1.jar, druid-stats-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,197 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-ranger-security], jars: metrics-core-2.2.0.jar, hadoop-mapreduce-client-shuffle-2.8.5.jar, jna-platform-5.2.0.jar, jackson-mapper-asl-1.9.13.jar, hadoop-mapreduce-client-jobclient-2.8.5.jar, scala-library-2.11.12.jar, druid-ranger-security-0.22.1.jar, hadoop-auth-2.8.5.jar, htrace-core4-4.0.1-incubating.jar, xmlenc-0.52.jar, commons-collections-3.2.2.jar, solr-solrj-7.7.1.jar, woodstox-core-asl-4.4.1.jar, commons-io-2.11.0.jar, httpmime-4.5.3.jar, accessors-smart-1.2.jar, jersey-bundle-1.19.3.jar, commons-math3-3.6.1.jar, commons-net-3.6.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, jackson-jaxrs-1.9.13.jar, asm-7.1.jar, jetty-sslengine-6.1.26.jar, gethostname4j-0.0.2.jar, apacheds-i18n-2.0.0-M15.jar, curator-framework-4.3.0.jar, ranger-plugins-audit-2.0.0.jar, scala-logging_2.11-3.9.0.jar, eclipselink-2.5.2.jar, leveldbjni-all-1.8.jar, scala-reflect-2.11.12.jar, commons-configuration-1.6.jar, curator-recipes-4.3.0.jar, zkclient-0.10.jar, api-util-1.0.3.jar, hadoop-mapreduce-client-common-2.8.5.jar, jsp-api-2.1.jar, json-smart-2.3.jar, hadoop-yarn-server-common-2.8.5.jar, commonj.sdo-2.1.1.jar, gson-2.2.4.jar, jopt-simple-5.0.4.jar, jna-4.5.1.jar, apacheds-kerberos-codec-2.0.0-M15.jar, hadoop-common-2.8.5.jar, snappy-java-1.1.7.1.jar, ranger-plugins-common-2.0.0.jar, log4j-1.2.17.jar, commons-codec-1.13.jar, slf4j-api-1.7.25.jar, jsr311-api-1.1.1.jar, jcip-annotations-1.0-1.jar, hadoop-annotations-2.8.5.jar, hadoop-yarn-client-2.8.5.jar, jackson-core-asl-1.9.13.jar, kafka-clients-2.0.0.jar, javax.persistence-2.1.0.jar, jcl-over-slf4j-1.7.12.jar, api-asn1-api-1.0.0-M20.jar, hadoop-client-2.8.5.jar, kafka_2.11-2.0.0.jar, commons-digester-1.8.jar, ranger-plugins-cred-2.0.0.jar, stax2-api-3.1.4.jar, httpclient-4.5.10.jar, nimbus-jose-jwt-4.41.1.jar, noggit-0.8.jar, guava-16.0.1.jar, hadoop-mapreduce-client-app-2.8.5.jar, hadoop-yarn-api-2.8.5.jar
broker.druid | 2022-01-20T01:47:43,214 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service], jars: kafka-clients-2.8.0.jar, zstd-jni-1.3.3-1.jar, snappy-java-1.1.8.1.jar, druid-kafka-indexing-service-0.22.1.jar, lz4-java-1.7.1.jar
broker.druid | 2022-01-20T01:47:43,231 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-influx-extensions], jars: druid-influx-extensions-0.22.1.jar, antlr4-runtime-4.5.1.jar
broker.druid | 2022-01-20T01:47:43,235 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-bloom-filter], jars: druid-bloom-filter-0.22.1.jar, hive-storage-api-2.7.1.jar, commons-lang-2.6.jar
broker.druid | 2022-01-20T01:47:43,243 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-google-extensions], jars: druid-google-extensions-0.22.1.jar, google-api-services-storage-v1-rev20190523-1.26.0.jar
broker.druid | 2022-01-20T01:47:43,255 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-virtual-columns], jars: druid-virtual-columns-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,264 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-cloudfiles-extensions], jars: jclouds-core-1.9.1.jar, guice-assistedinject-3.0.jar, rackspace-cloudfiles-uk-1.9.1.jar, javax.inject-1.jar, openstack-swift-1.9.1.jar, rackspace-cloudfiles-us-1.9.1.jar, gson-2.3.jar, rackspace-cloudidentity-1.9.1.jar, jclouds-blobstore-1.9.1.jar, jsr250-api-1.0.jar, jclouds-slf4j-1.9.1.jar, rackspace-cloudfiles-1.9.1.jar, openstack-keystone-1.9.1.jar, jackson-module-guice-2.10.5.jar, jsr311-api-1.1.1.jar, druid-cloudfiles-extensions-0.22.1.jar, guice-3.0.jar, guice-multibindings-3.0.jar, rocoto-6.2.jar, guava-16.0.1.jar
broker.druid | 2022-01-20T01:47:43,352 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [dropwizard-emitter], jars: metrics-jmx-4.0.0.jar, dropwizard-emitter-0.22.1.jar, slf4j-api-1.7.25.jar, metrics-core-4.0.0.jar
broker.druid | 2022-01-20T01:47:43,373 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [aliyun-oss-extensions], jars: opentracing-util-0.33.0.jar, aliyun-java-sdk-core-4.5.10.jar, aliyun-java-sdk-ram-3.1.0.jar, jdom2-2.0.6.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, aliyun-sdk-oss-3.11.3.jar, opentracing-noop-0.33.0.jar, jaxb-api-2.3.1.jar, gson-2.8.6.jar, stax-api-1.0.1.jar, ini4j-0.5.4.jar, opentracing-api-0.33.0.jar, commons-codec-1.13.jar, slf4j-api-1.7.25.jar, aliyun-java-sdk-kms-2.11.0.jar, javax.activation-api-1.2.0.jar, org.jacoco.agent-0.8.5-runtime.jar, httpclient-4.5.10.jar, aliyun-oss-extensions-0.22.1.jar, jettison-1.1.jar
broker.druid | 2022-01-20T01:47:43,397 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage], jars: postgresql-42.2.14.jar, postgresql-metadata-storage-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,417 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-orc-extensions], jars: orc-core-1.6.9.jar, orc-shims-1.6.9.jar, jackson-mapper-asl-1.9.13.jar, hadoop-auth-2.8.5.jar, htrace-core4-4.0.1-incubating.jar, hadoop-mapreduce-client-core-2.8.5.jar, hadoop-hdfs-client-2.8.5.jar, protobuf-java-3.11.0.jar, commons-configuration-1.6.jar, aircompressor-0.19.jar, annotations-17.0.0.jar, hadoop-common-2.8.5.jar, hadoop-annotations-2.8.5.jar, commons-lang3-3.8.1.jar, jackson-core-asl-1.9.13.jar, hive-storage-api-2.7.1.jar, druid-orc-extensions-0.22.1.jar, orc-mapreduce-1.6.9.jar, threeten-extra-1.5.0.jar, commons-digester-1.8.jar
broker.druid | 2022-01-20T01:47:43,426 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-azure-extensions], jars: guice-4.1.0.jar, javax.inject-1.jar, guice-assistedinject-4.1.0.jar, druid-azure-extensions-0.22.1.jar, aopalliance-1.0.jar, azure-storage-8.6.0.jar, azure-keyvault-core-1.0.0.jar, guava-16.0.1.jar
broker.druid | 2022-01-20T01:47:43,452 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-s3-extensions], jars: jmespath-java-1.12.37.jar, druid-s3-extensions-0.22.1.jar, ion-java-1.0.2.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, joda-time-2.10.5.jar, aws-java-sdk-sts-1.12.37.jar, jackson-dataformat-cbor-2.10.5.jar, commons-codec-1.13.jar, aws-java-sdk-core-1.12.37.jar, httpclient-4.5.10.jar
broker.druid | 2022-01-20T01:47:43,475 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [statsd-emitter], jars: asm-util-7.1.jar, jnr-a64asm-1.0.0.jar, java-dogstatsd-client-2.13.0.jar, jnr-enxio-0.30.jar, asm-tree-7.1.jar, jnr-posix-3.0.61.jar, asm-7.1.jar, jffi-1.2.23-native.jar, statsd-emitter-0.22.1.jar, jnr-x86asm-1.0.2.jar, jnr-ffi-2.1.16.jar, jffi-1.2.23.jar, jnr-unixsocket-0.36.jar, jnr-constants-0.9.17.jar, asm-analysis-7.1.jar, asm-commons-7.1.jar
broker.druid | 2022-01-20T01:47:43,508 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [mysql-metadata-storage], jars: mysql-metadata-storage-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,540 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [graphite-emitter], jars: metrics-graphite-3.1.2.jar, graphite-emitter-0.22.1.jar, slf4j-api-1.7.25.jar, metrics-core-4.0.0.jar
broker.druid | 2022-01-20T01:47:43,559 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [ambari-metrics-emitter], jars: ambari-metrics-common-2.7.0.0.0.jar, jackson-xc-1.9.13.jar, commons-io-2.11.0.jar, commons-math3-3.6.1.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, curator-framework-4.3.0.jar, curator-client-4.3.0.jar, commons-codec-1.13.jar, slf4j-api-1.7.25.jar, hadoop-annotations-2.8.5.jar, httpclient-4.5.10.jar, commons-lang-2.6.jar, guava-16.0.1.jar, gson-2.2.2.jar, ambari-metrics-emitter-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,570 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-parquet-extensions], jars: audience-annotations-0.12.0.jar, jackson-mapper-asl-1.9.13.jar, parquet-avro-1.12.0.jar, hadoop-auth-2.8.5.jar, htrace-core4-4.0.1-incubating.jar, parquet-common-1.12.0.jar, hadoop-mapreduce-client-core-2.8.5.jar, parquet-column-1.12.0.jar, hadoop-hdfs-client-2.8.5.jar, parquet-jackson-1.12.0.jar, parquet-encoding-1.12.0.jar, commons-configuration-1.6.jar, javax.annotation-api-1.3.2.jar, zstd-jni-1.3.3-1.jar, hadoop-common-2.8.5.jar, slf4j-api-1.7.25.jar, hadoop-annotations-2.8.5.jar, jackson-core-asl-1.9.13.jar, parquet-format-structures-1.12.0.jar, snappy-java-1.1.8.jar, parquet-hadoop-1.12.0.jar, avro-1.9.2.jar, druid-parquet-extensions-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,586 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kerberos], jars: hadoop-auth-2.8.5.jar, druid-kerberos-0.22.1.jar, apacheds-i18n-2.0.0-M15.jar, commons-configuration-1.6.jar, api-util-1.0.3.jar, jsp-api-2.1.jar, apacheds-kerberos-codec-2.0.0-M15.jar, hadoop-common-2.8.5.jar, api-asn1-api-1.0.0-M20.jar
broker.druid | 2022-01-20T01:47:43,603 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-lookups-cached-single], jars: stringtemplate-3.2.jar, antlr-2.7.7.jar, druid-lookups-cached-single-0.22.1.jar, mapdb-1.0.8.jar
broker.druid | 2022-01-20T01:47:43,609 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global], jars: druid-lookups-cached-global-0.22.1.jar, mapdb-1.0.8.jar
broker.druid | 2022-01-20T01:47:43,619 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-hdfs-storage], jars: hadoop-mapreduce-client-shuffle-2.8.5.jar, hadoop-aws-2.8.5.jar, jackson-mapper-asl-1.9.13.jar, hadoop-mapreduce-client-jobclient-2.8.5.jar, hadoop-auth-2.8.5.jar, htrace-core4-4.0.1-incubating.jar, xmlenc-0.52.jar, commons-collections-3.2.2.jar, jmespath-java-1.12.37.jar, hadoop-mapreduce-client-core-2.8.5.jar, hadoop-hdfs-client-2.8.5.jar, ion-java-1.0.2.jar, accessors-smart-1.2.jar, commons-net-3.6.jar, commons-logging-1.1.1.jar, httpcore-4.4.11.jar, joda-time-2.10.5.jar, asm-7.1.jar, jetty-sslengine-6.1.26.jar, apacheds-i18n-2.0.0-M15.jar, curator-framework-4.3.0.jar, leveldbjni-all-1.8.jar, commons-configuration-1.6.jar, curator-recipes-4.3.0.jar, api-util-1.0.3.jar, hadoop-mapreduce-client-common-2.8.5.jar, jackson-dataformat-cbor-2.10.5.jar, jsp-api-2.1.jar, json-smart-2.3.jar, aws-java-sdk-s3-1.12.37.jar, hadoop-yarn-server-common-2.8.5.jar, gson-2.2.4.jar, apacheds-kerberos-codec-2.0.0-M15.jar, hadoop-common-2.8.5.jar, commons-codec-1.13.jar, aws-java-sdk-core-1.12.37.jar, jcip-annotations-1.0-1.jar, hadoop-annotations-2.8.5.jar, hadoop-yarn-client-2.8.5.jar, jackson-core-asl-1.9.13.jar, aws-java-sdk-kms-1.12.37.jar, druid-hdfs-storage-0.22.1.jar, api-asn1-api-1.0.0-M20.jar, hadoop-client-2.8.5.jar, commons-digester-1.8.jar, httpclient-4.5.10.jar, nimbus-jose-jwt-4.41.1.jar, hadoop-mapreduce-client-app-2.8.5.jar, hadoop-yarn-api-2.8.5.jar
broker.druid | 2022-01-20T01:47:43,635 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kubernetes-extensions], jars: swagger-annotations-1.6.2.jar, jsr305-2.0.1.jar, commons-collections4-4.2.jar, bcpkix-jdk15on-1.66.jar, sundr-codegen-0.22.0.jar, resourcecify-annotations-0.22.0.jar, client-java-extended-10.0.1.jar, commons-io-2.11.0.jar, bcprov-ext-jdk15on-1.68.jar, joda-convert-2.2.1.jar, simpleclient_common-0.9.0.jar, joda-time-2.10.5.jar, protobuf-java-3.11.0.jar, bucket4j-core-4.10.0.jar, snakeyaml-1.27.jar, simpleclient_httpserver-0.9.0.jar, javax.annotation-api-1.3.2.jar, okhttp-3.14.9.jar, zjsonpatch-0.4.11.jar, gson-fire-1.8.4.jar, okio-1.17.2.jar, gson-2.8.6.jar, sundr-core-0.22.0.jar, client-java-10.0.1.jar, commons-codec-1.13.jar, slf4j-api-1.7.25.jar, client-java-proto-10.0.1.jar, simpleclient-0.9.0.jar, bcprov-jdk15on-1.68.jar, builder-annotations-0.22.0.jar, commons-lang3-3.8.1.jar, client-java-api-10.0.1.jar, druid-kubernetes-extensions-0.22.1.jar, logging-interceptor-3.14.9.jar, jose4j-0.7.2.jar, guava-16.0.1.jar
broker.druid | 2022-01-20T01:47:43,644 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-ec2-extensions], jars: druid-ec2-extensions-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,654 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-time-min-max], jars: druid-time-min-max-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,657 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-protobuf-extensions], jars: druid-protobuf-extensions-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,670 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-thrift-extensions], jars: druid-thrift-extensions-0.22.1.jar, json-simple-1.1.jar, protobuf-java-3.11.0.jar, elephant-bird-core-4.17.jar, javax.annotation-api-1.3.2.jar, slf4j-api-1.7.25.jar, elephant-bird-hadoop-compat-4.17.jar, commons-lang-2.6.jar, guava-16.0.1.jar, libthrift-0.13.0.jar
broker.druid | 2022-01-20T01:47:43,674 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [sqlserver-metadata-storage], jars: sqlserver-metadata-storage-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,677 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [materialized-view-selection], jars: materialized-view-maintenance-0.22.1.jar, materialized-view-selection-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,691 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-moving-average-query], jars: druid-moving-average-query-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,705 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-distinctcount], jars: druid-distinctcount-0.22.1.jar
broker.druid | 2022-01-20T01:47:43,709 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-pac4j], jars: activation-1.1.1.jar, druid-pac4j-0.22.1.jar, pac4j-oidc-3.8.3.jar, accessors-smart-1.2.jar, javax.mail-1.6.1.jar, asm-7.1.jar, lang-tag-1.5.jar, pac4j-core-3.8.3.jar, json-smart-2.3.jar, nimbus-jose-jwt-7.9.jar, slf4j-api-1.7.25.jar, oauth2-oidc-sdk-6.5.jar, jcip-annotations-1.0-1.jar
broker.druid | 2022-01-20T01:47:43,723 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-basic-security], jars: druid-basic-security-0.22.1.jar
broker.druid | 2022-01-20T01:47:44,167 INFO [main] org.apache.druid.storage.google.GoogleStorageDruidModule - Getting jackson modules…
broker.druid | 2022-01-20T01:47:44,208 INFO [main] org.apache.druid.storage.cloudfiles.CloudFilesStorageDruidModule - Getting jackson modules…
broker.druid | 2022-01-20T01:47:50,046 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
broker.druid | 2022-01-20T01:47:50,513 INFO [main] org.apache.druid.storage.google.GoogleStorageDruidModule - Configuring GoogleStorageDruidModule…
broker.druid | 2022-01-20T01:47:50,551 INFO [main] org.apache.druid.storage.cloudfiles.CloudFilesStorageDruidModule - Configuring CloudFilesStorageDruidModule…
broker.druid | 2022-01-20T01:47:50,564 INFO [main] org.apache.druid.storage.cloudfiles.CloudFilesStorageDruidModule - Configured CloudFilesStorageDruidModule.
broker.druid | 2022-01-20T01:47:51,145 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
broker.druid | 2022-01-20T01:47:52,997 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
broker.druid | 2022-01-20T01:47:55,143 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
broker.druid | Exception in thread “main” java.lang.RuntimeException: com.google.inject.CreationException: Unable to create injector, see the following errors:
broker.druid |
broker.druid | 1) A binding to com.google.common.base.Supplier<org.apache.druid.server.audit.SQLAuditManagerConfig> was already configured at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule).
broker.druid | at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.mysql.MySQLMetadataStorageModule)
broker.druid |
broker.druid | 2) A binding to com.google.common.base.Supplier<org.apache.druid.server.audit.SQLAuditManagerConfig> was already configured at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule).
broker.druid | at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.sqlserver.SQLServerMetadataStorageModule)
broker.druid |
broker.druid | 3) A binding to org.apache.druid.server.audit.SQLAuditManagerConfig was already configured at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:152) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule).
broker.druid | at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:152) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.mysql.MySQLMetadataStorageModule)
broker.druid |
broker.druid | 4) A binding to org.apache.druid.server.audit.SQLAuditManagerConfig was already configured at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:152) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule).
broker.druid | at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:152) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.sqlserver.SQLServerMetadataStorageModule)
broker.druid |
broker.druid | 4 errors
broker.druid | at org.apache.druid.cli.GuiceRunnable.makeInjector(GuiceRunnable.java:72)
broker.druid | at org.apache.druid.cli.ServerRunnable.run(ServerRunnable.java:62)
broker.druid | at org.apache.druid.cli.Main.main(Main.java:113)
broker.druid | Caused by: com.google.inject.CreationException: Unable to create injector, see the following errors:
broker.druid |
broker.druid | 1) A binding to com.google.common.base.Supplier<org.apache.druid.server.audit.SQLAuditManagerConfig> was already configured at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule).
broker.druid | at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.mysql.MySQLMetadataStorageModule)
broker.druid |
broker.druid | 2) A binding to com.google.common.base.Supplier<org.apache.druid.server.audit.SQLAuditManagerConfig> was already configured at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule).
broker.druid | at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.sqlserver.SQLServerMetadataStorageModule)
broker.druid |
broker.druid | 3) A binding to org.apache.druid.server.audit.SQLAuditManagerConfig was already configured at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:152) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule).
broker.druid | at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:152) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.mysql.MySQLMetadataStorageModule)
broker.druid |
broker.druid | 4) A binding to org.apache.druid.server.audit.SQLAuditManagerConfig was already configured at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:152) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule).
broker.druid | at org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:152) (via modules: com.google.inject.util.Modules$OverrideModule → org.apache.druid.metadata.storage.sqlserver.SQLServerMetadataStorageModule)
broker.druid |
broker.druid | 4 errors
broker.druid | at com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:470)
broker.druid | at com.google.inject.internal.InternalInjectorCreator.initializeStatically(InternalInjectorCreator.java:155)
broker.druid | at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:107)
broker.druid | at com.google.inject.Guice.createInjector(Guice.java:99)
broker.druid | at com.google.inject.Guice.createInjector(Guice.java:73)
broker.druid | at com.google.inject.Guice.createInjector(Guice.java:62)
broker.druid | at org.apache.druid.initialization.Initialization.makeInjectorWithModules(Initialization.java:433)
broker.druid | at org.apache.druid.cli.GuiceRunnable.makeInjector(GuiceRunnable.java:69)
broker.druid | … 2 more

I like your idea on simplifying the configuration.

I was merely trying to follow the instructions. I’ll try what you suggested and see if that changes anything.

Thank you. This worked.

The approach in which I provide property files per each service and change the port does not work. Perhaps it does not overlay that single property.

Using just an environment override of the port per each service works.

Here is an example of the docker-compose.yml or you can also view the commit that I pushed: https://github.com/minmay/druid-docker-compose

version: “3.7”
services:

postgres.druid:
container_name: postgres.druid
image: postgres:latest
volumes:

  • metadata_data:/var/lib/postgresql/data
    environment:
  • POSTGRES_PASSWORD=supersecretpassword
  • POSTGRES_USER=druid
  • POSTGRES_DB=druid
  • PGPORT=25432
    ports:
  • “25432:25432”

Need 3.5 or later for container nodes

zookeeper.druid:
container_name: zookeeper.druid
image: zookeeper:3.5
ports:

  • “2181:2181”
    environment:
  • ZOO_MY_ID=1

coordinator.druid:
image: apache/druid:0.22.1
container_name: coordinator.druid
volumes:

  • druid_shared:/opt/shared
  • coordinator_var:/opt/druid/var
    depends_on:
  • zookeeper.druid
  • postgres.druid
    ports:
  • “28081:28081”
    command:
  • coordinator
    env_file:
  • envs/druid.env
    environment:
  • druid_plaintextPort=28081

broker.druid:
image: apache/druid:0.22.1
container_name: broker.druid
volumes:

  • broker_var:/opt/druid/var
    depends_on:
  • zookeeper.druid
  • postgres.druid
  • coordinator.druid
    ports:
  • “28082:28082”
    command:
  • broker
    env_file:
  • envs/druid.env
    environment:
  • druid_plaintextPort=28082

historical.druid:
image: apache/druid:0.22.1
container_name: historical.druid
volumes:

  • druid_shared:/opt/shared
  • historical_var:/opt/druid/var
    depends_on:
  • zookeeper.druid
  • postgres.druid
  • coordinator.druid
    ports:
  • “28083:28083”
    command:
  • historical
    env_file:
  • envs/druid.env
    environment:
  • druid_plaintextPort=28083

middlemanager.druid:
image: apache/druid:0.22.1
container_name: middlemanager.druid
volumes:

  • druid_shared:/opt/shared
  • middle_var:/opt/druid/var
    depends_on:
  • zookeeper.druid
  • postgres.druid
  • coordinator.druid
    ports:
  • “28091:28091”
  • “28100-28105:28100-28105”
    command:
  • middleManager
    env_file:
  • envs/druid.env
    environment:
  • druid_plaintextPort=28091
  • druid_indexer_runner_startPort=28100
  • druid_indexer_runner_endPort=28105

router.druid:
image: apache/druid:0.22.1
container_name: router.druid
volumes:

  • router_var:/opt/druid/var
    depends_on:
  • zookeeper.druid
  • postgres.druid
  • coordinator.druid
    ports:
  • “28888:28888”
    command:
  • router
    env_file:
  • envs/druid.env
    environment:
  • druid_plaintextPort=28888

volumes:
metadata_data: {}
middle_var: {}
historical_var: {}
broker_var: {}
coordinator_var: {}
router_var: {}
druid_shared: {}

Glad to hear it. So, you might also want to remove the new docker image created with your docker file. Since none of those configuration files are needed now you can probably revert to the original image.