Index_parallel type failed to ingest data

Apache Druid Q&A Google Groups
#1

Hi Team,
I’m trying to ingest data in druid with “index_parallel” type but I’m getting error :

{“error”:“Could not resolve type id ‘index_parallel’ into a subtype of [simple type, class io.druid.indexing.common.task.Task]\n at [Source: HttpInputOverHTTP@5774dbdd[c=2631,q=1,[0]=EOF,s=STREAM]; line: 1, column: 4]”}

Same index configuration works well for same data if I change index_parallel to index

In my case, we are loading good amount of data in to druid - 15 nodes cluster. and need to verify parallelism for multiple middle manager.

Any idea/help would be really appreciated !!!

Thanks,

Kiran

#2

I’m using druid : 0.12.3 with 15 nodes cluster

#3

Hey Kiran,

Parallel native indexing was only made available in 0.13 which hasn’t been fully released yet.

See the following release notes: https://github.com/apache/incubator-druid/issues/6442

Alternative you can look at hadoop batch ingestion in 0.12.3.

Best regards,

Dylan

#4

Hi Dylan,
Appreciated your feedback, basically I’d like to run multiple index ingestion job on druid 15 nodes cluster, but I’m getting error for one of job every time.

Here is post :

https://groups.google.com/forum/#!searchin/druid-user/parallel|sort:date/druid-user/VxmzJ8EWTCE/LKvORMH0BAAJ

any idea/help would be really appreciated !!!

thanks

Kiran