Unparseable timestamp found! error

Hi,

I am getting

Caused by: io.druid.java.util.common.parsers.ParseException: Unparseable timestamp found!
	at io.druid.data.input.impl.MapInputRowParser.parse(MapInputRowParser.java:75) ~[druid-api-0.10.0.jar:0.10.0]
	at io.druid.data.input.impl.StringInputRowParser.parseMap(StringInputRowParser.java:139) ~[druid-api-0.10.0.jar:0.10.0]
	at io.druid.data.input.impl.StringInputRowParser.parse(StringInputRowParser.java:134) ~[druid-api-0.10.0.jar:0.10.0]
	at io.druid.indexer.HadoopDruidIndexerMapper.parseInputRow(HadoopDruidIndexerMapper.java:101) ~[druid-indexing-hadoop-0.10.0.jar:0.10.0]
	at io.druid.indexer.HadoopDruidIndexerMapper.map(HadoopDruidIndexerMapper.java:72) ~[druid-indexing-hadoop-0.10.0.jar:0.10.0]
	at io.druid.indexer.DetermineHashedPartitionsJob$DetermineCardinalityMapper.run(DetermineHashedPartitionsJob.java:285) ~[druid-indexing-hadoop-0.10.0.jar:0.10.0]
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) ~[hadoop-mapreduce-client-core-2.3.0.jar:?]
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) ~[hadoop-mapreduce-client-core-2.3.0.jar:?]
	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) ~[hadoop-mapreduce-client-common-2.3.0.jar:?]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_25]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_25]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_25]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_25]
	at java.lang.Thread.run(Thread.java:745) ~[?:1.8.0_25]

Attached in the index json file and the simple csv data file.

I am specifying the date pattern as d-MMM-yy for values like 11-Feb-92
like

"timestampSpec" : {
            "format" : "d-MMM-yy",
            "column" : "date_DATE"
          },


I need some guidance on how can I solve this issue

Regards

sample1.csv (61 Bytes)

index.json (1.13 KB)

Hi ,

anything on this above issue ?

I am facing the sam error in the druid 0.13 version

and my error is something like :

Caused by: java.lang.IllegalArgumentException: Invalid format: “2019-04-09 14:34:07.801” is malformed at " 14:34:07.801"

my index spec looks like :

“intervals”: [

      "2019-04-08/2019-04-09"

“parser”: {

    "type": "parquet",

    "parseSpec": {

      "format": "timeAndDims",

      "timestampSpec": {

        "format": "iso",

        "column": "etl_load_datetm"

Druid is not expecting HH:mm:ss

Hi Anusha,

You can use the timestamp_parse expression:

http://druid.io/docs/latest/misc/math-expr.html

inside a transformSpec:

http://druid.io/docs/latest/ingestion/transform-spec.html

it might look something like:

“dataSchema” : {

“transformSpec”: {

“transforms”: [

{

“type”: “expression”,

“name”: “date_DATE”,

“expression”: “timestamp_parse(date_DATE,‘yyyy/MM/dd HH:mm:ss’,‘UTC’)”

}

“parser” : {

“type” : “string”,

“parseSpec” : {

“timestampSpec”: {

“column”: “date_DATE”,

“format”: “yyyy/MM/dd HH:mm:ss”

}

Best,

Caroline