ClassCastException VIntWritable and java.lang.Integer about elasticsearch-hadoop

[costin]

What's your Hive/Hadoop environment (versions, OS, etc...)?

[marcelopaesrech]

Now I am using Mac OS, with Hadoop 1.2.0,Hive 0.11 and ES 0.90.2. I tried with Hadoop 0.23 as well, but I caught the same problem.

I tried in linux too with a cluster and the same error appeared.

[marcelopaesrech]

The ESSerDE just have a parser implementation to STRUCT and ARRAY. When values like String come from ES, they type is Text. So when Hive convert data Text to String, probably call toString method. But with Long or Integer values, Hive tries to cast to a specific class (in this case Integer).

I made some changes in parser ESSerDe and they work fine.

[costin]

Marcelo, ESSerDe is currently uncomplete and it will be addressed by the mapping feature (wip). I've tried to fix it but in the current format (Writable to Hive) it cannot be done in a reliable way.
In fact, it is a reason the current rewrite of mapping (or deserializing) started - I hope to have something shortly that I can incorporate into trunk and push out.