mlshapiro / read-protobuf Goto Github PK

hi！This library does a very good job of implementing the relevant functionality, but in the ipynb file, i see %time to calculate running time. It may be not very accurate, is it possible to compare his performance after a more accurate test？It doesn't really matter how fast it is, often the write and read times are acceptable, just exploring if there is a faster way to implement based on python.

Hi, read-protobuf is more like a deserializer. I am wondering if it is possible to implement a serializer along with it. Is that more difficult?

Another option (perhaps better than the MessageToJson option) is to use the following code:

from google.protobuf.json_format import MessageToDict

proto_dict = MessageToDict(proto_obj)

Source: https://googleapis.dev/python/protobuf/latest/google/protobuf/json_format.html

I get the following error while using read_protobuf:

File "/usr/local/lib/python2.7/dist-packages/read_protobuf.py", line 143, in read_protobuf
df = pd.DataFrame(data)
File "/usr/local/lib/python2.7/dist-packages/pandas/core/frame.py", line 348, in init
mgr = self._init_dict(data, index, columns, dtype=dtype)
File "/usr/local/lib/python2.7/dist-packages/pandas/core/frame.py", line 459, in _init_dict
return _arrays_to_mgr(arrays, data_names, index, columns, dtype=dtype)
File "/usr/local/lib/python2.7/dist-packages/pandas/core/frame.py", line 7356, in _arrays_to_mgr
index = extract_index(arrays)
File "/usr/local/lib/python2.7/dist-packages/pandas/core/frame.py", line 7393, in extract_index
raise ValueError('If using all scalar values, you must pass'
ValueError: If using all scalar values, you must pass an index

It appears that this library breaks with protobuf>=4.0.0

It would be awesome if you could upgrade support to the latest protobuf library