Where to find the JSON task file from an already ingested datasource?

Hi everyone,

When ingesting a new datasource into Druid, a JSON task file is created with the ingestion configuration.

The question is, where can I find that JSON file once the datasource has been processed succesfully?

That is important because I want to review the ingestion configuration.

Thanks in advance,

Fernando

Hi Fernando,

  1. You can look for paylod section:

image.png

or

  1. You can look into the task log: search for "org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: "

eg :

2020-02-05T13:35:59,152 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
  "type" : "index_parallel",
  "id" : "index_parallel_wikiticker_2020-02-05T13:35:25.075Z",
  "resource" : {
    "availabilityGroup" : "index_parallel_wikiticker_2020-02-05T13:35:25.075Z",
    "requiredCapacity" : 1
  },
  "spec" : {

OR
3 You can make an API call ( to overlord or router) to retrive the payload for a task :

Endpoint : /druid/indexer/v1/task/{taskId}
Retrieve the 'payload' of a task.

![image.png|3210x658](upload://jxhfXMIIX11fuz9ujzdbfMBmXjg.png)

ref :[https://druid.apache.org/docs/latest/operations/api-reference.html#overlord](https://druid.apache.org/docs/latest/operations/api-reference.html#overlord)

Hope this helps.

Thanks and Regards,
Vaibhav

Hi Vaibhav,

Your response taught me good points.

But, when a task is completed and the new datasource appears in the “DataloaderUI>Datasources” view, periodically, completed tasks are removed from the
“DataloaderUI>tasks” view.

Here is my question, when a completed task disappears from the “DataloaderUI>tasks” view, how can I recover the JSON configuration of the task that generated a datasource?

Thanks again,

Fernando