Setting the type on a dimension fails on Horton 2.6 and Druid 0.9.2

Hi,

I have an issue. I have my druid connected to horton works 2.6 (hadoop 2.7.3) with Druid 0.9.2. When I try to specify the type of the column. I get the following error in the indexing phase. It appears like the Long dimension handler is failing to load. Any suggestions?

Error: com.metamx.common.IAE: Could not create handler from invalid column type: LONG
	at io.druid.segment.DimensionHandlerUtil.getHandlerFromCapabilities(DimensionHandlerUtil.java:41)
	at io.druid.segment.incremental.IncrementalIndex.<init>(IncrementalIndex.java:376)
	at io.druid.segment.incremental.OnheapIncrementalIndex.<init>(OnheapIncrementalIndex.java:67)
	at io.druid.segment.incremental.OnheapIncrementalIndex.<init>(OnheapIncrementalIndex.java:140)
	at io.druid.indexer.IndexGeneratorJob.makeIncrementalIndex(IndexGeneratorJob.java:240)
	at io.druid.indexer.IndexGeneratorJob.access$000(IndexGeneratorJob.java:97)
	at io.druid.indexer.IndexGeneratorJob$IndexGeneratorReducer.reduce(IndexGeneratorJob.java:561)
	at io.druid.indexer.IndexGeneratorJob$IndexGeneratorReducer.reduce(IndexGeneratorJob.java:478)
	at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171)
	at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)


My indexing request as follows for my test case:

{

  "type" : "index_hadoop",
  "spec" : {
    "ioConfig" : {
      "type" : "hadoop",
      "inputSpec" : {
        "type" : "static",
        "paths" : "ingest/test3-data.json"
      }
    },
    "dataSchema" : {
      "dataSource" : "test3",
      "granularitySpec" : {
        "type" : "uniform",
        "segmentGranularity" : "month",
        "queryGranularity" : "none",
        "intervals" : ["2014-01-01/2016-12-18"]
      },
      "parser" : {
        "type" : "hadoopyString",
        "parseSpec" : {
          "format" : "json",
          "dimensionsSpec" : {
            "dimensions" : [
                "long_field",
                "float_field",
                "string_field" ]
          },
          "timestampSpec" : {
            "format" : "iso",
            "column" : "dt"
          }
        }
      },

"metricsSpec" : [

{

"name" : "count",

"type" : "count"

}

]

},

"tuningConfig" : {

"type" : "hadoop",

"partitionsSpec" :

{

"type": "hashed",

"targetPartitionSize": 5000000

},

"jobProperties" : {

"mapreduce.job.classloader": true,

"mapreduce.map.java.opts":"-Duser.timezone=UTC -Dfile.encoding=UTF-8 -XX:+PrintGCDetails -XX:+PrintGCTimeStamps",

"mapreduce.reduce.java.opts":"-Duser.timezone=UTC -Dfile.encoding=UTF-8 -XX:+PrintGCDetails -XX:+PrintGCTimeStamps",

"mapreduce.job.classloader.system.classes":"-javax.validation.,java.,javax.,org.apache.commons.logging.,org.apache.log4j.,org.ap$

}

}

},

"hadoopDependencyCoordinates": [

"org.apache.hadoop:hadoop-client:2.7.3"

]

}

test data:

{"dt":"2015-01-27T10:41:00.000-08:00","long_field":1,"float_field":1.1,"string_field":"test"}

{"dt":"2015-01-27T10:42:00.000-08:00","long_field":2,"float_field":1.760106894,"string_field":"frana"}

{"dt":"2015-01-27T10:43:00.000-08:00","long_field":3,"float_field":1.771505822,"string_field":"michael"}

{"dt":"2015-01-27T10:44:00.000-08:00","long_field":4,"float_field":1.807722187,"string_field":"marcello"}

{"dt":"2015-01-27T10:45:00.000-08:00","long_field":5,"float_field":2.516319295,"string_field":"fred"}

{"dt":"2015-01-27T10:46:00.000-08:00","long_field":6,"float_field":3.430155087,"string_field":"arnon"}

{"dt":"2015-01-27T10:47:00.000-08:00","long_field":7,"float_field":4.396839297,"string_field":"andy"}

{"dt":"2015-01-27T10:48:00.000-08:00","long_field":8,"float_field":4.471777967,"string_field":"jule"}

{"dt":"2015-01-27T10:49:00.000-08:00","long_field":9,"float_field":4.796479435,"string_field":"ed"}

{"dt":"2015-01-27T10:50:00.000-08:00","long_field":1,"float_field":5.76385278,"string_field":"my"}

Hi,
long dimension handling is added in druid 0.10.0 as part of https://github.com/druid-io/druid/pull/3966

you will need to upgrade your druid installation to 0.10.0 for this.

Awesome and Thank you! I wished I asked earlier. I had spent a lot time trying to trouble shoot that.