Failed to load indexed data onto the cluster

I am ingesting data to druid by using csv. There are no problem if I ingestion by using unified-console but keep failed by using console. I been troubleshoot this for whole days and still cannot get this solved.

I am running druid in single server but submitting below command to console

bin/post-index-task --file /data/upload_druid.json --url http://localhost:8081

Task started: index_parallel_ticket_details2_2020-03-26T06:55:19.652Z

Task log: http://localhost:8081/druid/indexer/v1/task/index_parallel_ticket_details2_2020-03-26T06:55:19.652Z/log

Task status: http://localhost:8081/druid/indexer/v1/task/index_parallel_ticket_details2_2020-03-26T06:55:19.652Z/status

Task index_parallel_ticket_details2_2020-03-26T06:55:19.652Z still running…

Task index_parallel_ticket_details2_2020-03-26T06:55:19.652Z still running…

Task finished with status: SUCCESS

Completed indexing data for ticket_details2. Now loading indexed data onto the cluster…

ticket_details2 is 0.0% finished loading…

ticket_details2 is 0.0% finished loading…

ticket_details2 is 0.0% finished loading…

ticket_details2 is 0.0% finished loading…

ticket_details2 is 0.0% finished loading…

ticket_details2 is 0.0% finished loading…

ticket_details2 is 0.0% finished loading…

ticket_details2 is 0.0% finished loading…

ticket_details2 is 0.0% finished loading…

ticket_details2 is 0.0% finished loading…

ticket_details2 is 0.0% finished loading…

ticket_details2 is 0.0% finished loading…

log.txt (109 KB)

Hi Ls Poh,


Do you mean when you ingest the same CSV file via Unified console , it creates the datasource and segmengts ?

There is no error in the task, the task runs successfully but In the attached task log, I see below :

2020-03-26T06:55:28,768 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Processed[0] events, **unparseable[228]**, thrownAway[0].
2020-03-26T06:55:28,779 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.task.IndexTask - Published segments: []

It seem that an issue with your data not. As you can see above from the log, all the 228 rows were unparseable. Please double check your data and if possible please share some sample csv file.

Thanks and Regards,
Vaibhav

Yes, If i follow step by step at unified console it success. Attached is the sample csv file. Thanks so much for your help

ticket_details_sector_delta.csv (6.99 KB)

1 Like

Solved after i added columns and segment

cool!!

I managed to uploaded it but the column data all mess up. How can I make sure the column is ingested correctly?