Unable to load the file in to druid with field separator as | character and row separator as newline character

Hi All,

When iam submitting the index task ,index task status showing as success but data not loading in to druid.

Iam trying to loading CSV file into druid.

csv file field separator : |

row separator :newlinecharcter(\r\n or \n)

Below is my index task json:

{
“type”: “index”,
“spec”: {
“dataSchema”: {
“metricsSpec”: [
{
“name”: “edrcount”,
“type”: “count”
}
],
“parser”: {
“parseSpec”: {
“dimensionsSpec”: {
“dimensions”: [
“intcolumn1”,
“intcolumn2”,
“intcolumn3”
]
},
“columns”: [
“stringcolumn1”,
“stringcolumn2”,
“datecolumn1”,
“intcolumn1”,
“intcolumn2”,
“intcolumn3”,
“intcolumn4”
],
“format”: “csv”,
“timestampSpec”: {
“format”: “yyyy-MM-dd HH:mm:ss”,
“column”: “datecolumn1”
}
},
“type”: “string”
},
“granularitySpec”: {
“intervals”: [
“2018-01-01/2018-08-31”
],
“segmentGranularity”: “day”,
“queryGranularity”: “day”,
“type”: “uniform”
},
“dataSource”: “test_summary_12”
},
“ioConfig”: {
“firehose”: {
“baseDir”: “/apps/datafiles_1/testfiles/”,
“filter”: “testfile.txt”,
“type”: “local”
},
“appendToExisting”: “true”,
“type”: “index”
},
“tuningConfig”: {
“targetPartitionSize”: 5000000,
“type”: “index”,
“maxRowsInMemory”: 39999
}
}
}

Please submit how to load csv data into druid.

Thanks in advance.

Hi,

Can you check the task logs for any errors/warning?. Also, you can check if any segments are created for the tasks in the druid console. Goto Segments tab and filter on the data source.

If the segments are not loaded you can see coordinator logs.

Thanks,
Hemanth