storing data in Hbase (Bytes conversion) about happybase

[wbolster]

That should definitely work. Have you actually tried the minimal example from your bug report? Unfortunately the error messages from the Thrift layer are not always clear. Can you provide the exact error message?

[wbolster]

Ah, I think you forgot to specify a column family. The column name should be something like cf1:col1, not just col1.

[salvager]

row = str("row")
col1 = str("fam1:col1")
value1 = str("value1")

table.put( row , {col1: value1})

Actually, after specifying the family too it did fail. I got the same error message. I pasted the error message from thrift server below.

13/02/01 13:45:17 WARN thrift.ThriftServerRunner$HBaseHandler: Failed 1 action: DoNotRetryIOException: 1 time, servers with issues: LucidN23:60020,
org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 1 action: DoNotRetryIOException: 1 time, servers with issues: LucidN23:60020,
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatchCallback(HConnectionManager.java:1601)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1377)
at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:916)
at org.apache.hadoop.hbase.client.HTable.doPut(HTable.java:772)
at org.apache.hadoop.hbase.client.HTable.put(HTable.java:755)
at org.apache.hadoop.hbase.thrift.ThriftServerRunner$HBaseHandler.mutateRowsTs(ThriftServerRunner.java:1058)
at org.apache.hadoop.hbase.thrift.ThriftServerRunner$HBaseHandler.mutateRows(ThriftServerRunner.java:1007)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.thrift.HbaseHandlerMetricsProxy.invoke(HbaseHandlerMetricsProxy.java:65)
at $Proxy6.mutateRows(Unknown Source)
at org.apache.hadoop.hbase.thrift.generated.Hbase$Processor$mutateRows.getResult(Hbase.java:4110)
at org.apache.hadoop.hbase.thrift.generated.Hbase$Processor$mutateRows.getResult(Hbase.java:4098)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:32)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
at org.apache.hadoop.hbase.thrift.TBoundedThreadPoolServer$ClientConnnection.run(TBoundedThreadPoolServer.java:287)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

The error from python side is

Traceback (most recent call last):
File "uploadDataHbase.py", line 15, in
table.put( row , {col1: value1})
File "/usr/local/lib/python2.7/dist-packages/happybase/api.py", line 618, in put
batch.put(row, data)
File "/usr/local/lib/python2.7/dist-packages/happybase/api.py", line 841, in exit
self.send()
File "/usr/local/lib/python2.7/dist-packages/happybase/api.py", line 779, in send
self.table.client.mutateRows(self.table.name, bms)
File "/usr/local/lib/python2.7/dist-packages/happybase/hbase/Hbase.py", line 1450, in mutateRows
self.recv_mutateRows()
File "/usr/local/lib/python2.7/dist-packages/happybase/hbase/Hbase.py", line 1472, in recv_mutateRows
raise result.io
happybase.hbase.ttypes.IOError: IOError(_message='Failed 1 action: DoNotRetryIOException: 1 time, servers with issues: LucidN23:60020, ')

I get the error message only when i do a 'put' operation. I am able to scan well without any errors

Thank you

[wbolster]

Does the table exist? Does the column family exist? What does table.families() return?

[salvager]

Sorry about that. I was more worried about Byte conversion that i forgot to check families.

After i created the column family, it did work :)

Thanks man

[wbolster]

Glad to hear. Feel free to ask help for any other issues you may have.

[sandeepsingh]

Hi i am getting this error, Please help me.

happybase.hbase.ttypes.IOError: IOError(_message='org.apache.hadoop.hbase.NamespaceNotFoundException: Crawler)

[wbolster]

that's unrelated, and lacks information. can't help you with that