'List' type converted to NULL about emr-dynamodb-connector

[naataaniitsosie]

@itsgrimetime I'm politely asking for an update. Has this problem been addressed?

[astj]

I also encountered similar trouble. I got NULL on parsing a List property of Binary data as array<binary>.

According to AWS EMR release guide, Hive array can be mapped to "number set (NS), string set (SS), or binary set (BS)". Does it mean I cannot use List properties to import to Hive?

[itsgrimetime]

@sebastien-de-saint-florent @astj Thanks for bringing this to our attention, and we apologize for the latency in response. Just so you know, we are tracking this issue internally and hope to look at it in the near future. I'll be sure to update you here when we have more information.

[0xCafeDude]

I was facing the same problem while trying to use the connector with spark. I noticed that same information can be obtained by calling the getL api instead of the getSS api on AttributeValue

[itsgrimetime]

@sebastien-de-saint-florent @naataaniitsosie @astj @0xCafeDude sorry for taking so long to get to this. I've finally gotten some time to investigate and found that the connector assumes a List type is actually a StringSet, and that assumption gets propagated and causes the DynamoDBObjectInspector to receive the SS attribute (which is null) instead of the L attribute. I'm hoping to have a fix for this posted soon. Thanks again for your patience.

[itsgrimetime]

Oh - actually, I just realized #71 takes care of this, and adds additional types. I'll review that and see if we can't get it closed out.