Segment descriptor.json missing loadSpec object

Hi all,

Trying to play around with the insert segment tool so I downloaded a segment off the S3 deep storage. The descriptor.json file that accompanies the segment was missing data compared to the data saved in metadata MySQL segments table and fails importing (unless I manually edit the descriptor.json). The data is ingested via Tranquility (Kafka).

The descriptor.json file in S3 deep storage:

{

"binaryVersion": null,

"dataSource": "<datasource>",

"dimensions": "<dimensions>",

"identifier": "<datasource>_2017-07-03T00:00:00.000Z_2017-07-04T00:00:00.000Z_2017-07-03T00:00:22.123Z",

"interval": "2017-07-03T00:00:00.000Z/2017-07-04T00:00:00.000Z",

"loadSpec": {

},

"metrics": "<metrics>",

"shardSpec": {

    "partitionNum": 0,

    "type": "linear"

},

"size": 0,

"version": "2017-07-03T00:00:22.123Z"

}

In the segments table for the same segment:

{

"binaryVersion": 9,

"dataSource": "<datasource>",

"dimensions": "<dimensions>",

"identifier": "<datasource>_2017-07-03T00:00:00.000Z_2017-07-04T00:00:00.000Z_2017-07-03T00:00:22.123Z",

"interval": "2017-07-03T00:00:00.000Z/2017-07-04T00:00:00.000Z",

"loadSpec": {

    "bucket": "<bucket>",

    "key": "segments/<datasource>/2017-07-03T00:00:00.000Z_2017-07-04T00:00:00.000Z/2017-07-03T00:00:22.123Z/0/index.zip",

    "type": "s3_zip"

},

"metrics": "<metrics>",

"shardSpec": {

    "partitionNum": 0,

    "type": "linear"

},

"size": 269109007,

"version": "2017-07-03T00:00:22.123Z"

}

Does this situation make sense? An NPE is thrown here https://github.com/druid-io/druid/blob/master/server/src/main/java/io/druid/segment/loading/LocalDataSegmentFinder.java#L78

Is this a configuration problem?

Thanks

Itamar

Hi
I also faced same issue. For me it loadspec is empty for both tranquility and batch events.
Unable to use insert segment tool.

Thanks
Sidharth