Batch Ingestion

Hi Community,

Is there any way i can use batch ingestion similar to KAFKA Indexing service where i can ingest data from multiple source mentioning the same data source and segment.

I have collector (data being collected) at 15-20 places for the same time segment and i need to run batch job to load all those files every hour.

Regards,

Arpan Khagram

+91 8308993200

Yes you can for instance provide a list of paths to the hadoop batch ingestion.