Ingestion-tutorial is 0.0% finished loading

MS_Lee · June 11, 2019, 6:11pm

Hi,

Finally i run my cluster i am able start all my processes when i was trying to ingest the data in to the cluster task is executing as SUCCESS state but data is not inserting.

I checked the var/tmp folder it creating empty directories

Task will be go on as ingestion-tutorial is 0.0% finished loading…

Beginning indexing data for ingestion-tutorial

Task started: index_ingestion-tutorial_2019-06-11T17:07:13.994Z

Task log: http://localhost:8090/druid/indexer/v1/task/index_ingestion-tutorial_2019-06-11T17:07:13.994Z/log

Task status: http://localhost:8090/druid/indexer/v1/task/index_ingestion-tutorial_2019-06-11T17:07:13.994Z/status

Task index_ingestion-tutorial_2019-06-11T17:07:13.994Z still running…

Task finished with status: SUCCESS

Completed indexing data for ingestion-tutorial. Now loading indexed data onto the cluster…

ingestion-tutorial is 0.0% finished loading…

and i noticed one more exception has been raised

Invoking stop method[public void org.apache.druid.java.util.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[ServiceEmitter{serviceDimensions={service=druid/middleManager,

Appreciate your help

MS_Lee · June 11, 2019, 11:39pm

An addition please find the status of the job it is in WAITING,

{"task":"index_wikipedia_2019-06-11T23:18:01.197Z","status":{"id":"index_wikipedia_2019-06-11T23:18:01.197Z","type":"index","createdTime":"2019-06-11T23:18:01.198Z","queueInsertionTime":"1970-01-01T00:00:00.000Z","statusCode":"SUCCESS","status":"SUCCESS","runnerStatusCode":"WAITING","duration":10950,"location":{"host":null,"port":-1,"tlsPort":-1},"dataSource":"wikipedia","errorMsg":null}}

please find the below middle manager config


druid.host=10.12.51.110
druid.service=druid/middleManager
druid.plaintextPort=8091

# Number of tasks per middleManager
druid.worker.capacity=3

# Task launch parameters
druid.indexer.runner.javaOpts=-server -Xmx2g -Duser.timezone=UTC -Dfile.encoding=UTF-8 -XX:MaxDirectMemorySize=4g -XX:+ExitOnOutOfMemoryError -Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager
druid.indexer.task.baseTaskDir=var/druid/task

# HTTP server threads
druid.server.http.numThreads=25

# Processing threads and buffers on Peons
druid.indexer.fork.property.druid.processing.buffer.sizeBytes=536870912
druid.indexer.fork.property.druid.processing.numThreads=2

# Hadoop indexing
druid.indexer.task.hadoopWorkingPath=var/druid/hadoop-tmp

Chris_Goll · June 11, 2019, 11:42pm

Does anything get created here when running it?
var/druid/task

MS_Lee · June 11, 2019, 11:53pm

An addition to Middle manager config please find below PEON log and common.runtime properties

druid.startup.logging.logProperties=true

MS_Lee · June 11, 2019, 11:58pm

Hi Chris,

I can see the EMPTY folders in var/druid/task

assignedTasks completedTasks restore.json

Chris_Goll · June 12, 2019, 12:33am

Since you have several nodes running the same service, have you made sure to create all of your directories for all of the nodes?

Chris_Goll · June 12, 2019, 12:36am

Also, I highly recommend setting the ports that each service type will use in the runtime.properties

MS_Lee · June 12, 2019, 3:19am

Hi Chris,

i have below structure of my cluster

2 nodes (MM and Overlord, ZK, ) and Derby in one of the node

1 Node (ZK, hisorical)

1 Node (Historical)

2 Nodes (Middle Manager)

2 Nodes (Brokers)