bblfsh / python-client Goto Github PK

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/google/protobuf/internal/type_checkers.py", line 182, in CheckValue
    proposed_value = proposed_value.decode('utf-8')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe9 in position 69: invalid continuation byte

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Applications/PyCharm.app/Contents/helpers/pydev/pydevd.py", line 1599, in <module>
    globals = debugger.run(setup['file'], None, None, is_module)
  File "/Applications/PyCharm.app/Contents/helpers/pydev/pydevd.py", line 1026, in run
    pydev_imports.execfile(file, globals, locals)  # execute the script
  File "/Applications/PyCharm.app/Contents/helpers/pydev/_pydev_imps/_pydev_execfile.py", line 18, in execfile
    exec(compile(contents+"\n", file, 'exec'), glob, loc)
  File "/Users/k/sourced/ast2vec/how_to_use_ast2vec.py", line 4, in <module>
    res = client.parse("../bad_file/IsoEncoding.java")
  File "/usr/local/lib/python3.6/site-packages/bblfsh/client.py", line 56, in parse
    language=self._scramble_language(language))
  File "/usr/local/lib/python3.6/site-packages/google/protobuf/internal/python_message.py", line 526, in init
    setattr(self, field_name, field_value)
  File "/usr/local/lib/python3.6/site-packages/google/protobuf/internal/python_message.py", line 662, in field_setter
    new_value = type_checker.CheckValue(new_value)
  File "/usr/local/lib/python3.6/site-packages/google/protobuf/internal/type_checkers.py", line 187, in CheckValue
    (proposed_value))
ValueError: b'package my.pack;\n\npublic class IsoEncoding {\n\n    private String entr\xe9e;\n    public IsoEncoding(String maCha\xeene) {\n        this.entr\xe9e = maCha\xeene;\n    }\n\n    private String r\xe9cup\xe9rerUneEntr\xe9e() {\n        return this.entr\xe9e;\n    }\n}' has type bytes, but isn't valid UTF-8 encoding. Non-UTF-8 strings must be converted to unicode objects before being added.

Failed to build bblfsh
Installing collected packages: bblfsh, chardet, certifi, urllib3, idna, requests
Running setup.py install for bblfsh ... error
Complete output from command /opt/rh/rh-python35/root/usr/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-phlmbc69/b
blfsh/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))"
 install --record /tmp/pip-kkd6eyh4-record/install-record.txt --single-version-externally-managed --compile:
    running install
    running build
    running build_py
    creating build
    creating build/lib.linux-x86_64-3.5
    creating build/lib.linux-x86_64-3.5/bblfsh
    copying bblfsh/__main__.py -> build/lib.linux-x86_64-3.5/bblfsh
    copying bblfsh/launcher.py -> build/lib.linux-x86_64-3.5/bblfsh
    copying bblfsh/aliases.py -> build/lib.linux-x86_64-3.5/bblfsh
    copying bblfsh/sdkversion.py -> build/lib.linux-x86_64-3.5/bblfsh
    copying bblfsh/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh
    copying bblfsh/client.py -> build/lib.linux-x86_64-3.5/bblfsh
    copying bblfsh/test.py -> build/lib.linux-x86_64-3.5/bblfsh
    creating build/lib.linux-x86_64-3.5/bblfsh/gopkg
    copying bblfsh/gopkg/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh/gopkg
    creating build/lib.linux-x86_64-3.5/bblfsh/github
    copying bblfsh/github/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh/github
    creating build/lib.linux-x86_64-3.5/bblfsh/gopkg/in
    copying bblfsh/gopkg/in/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh/gopkg/in
    creating build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh
    copying bblfsh/gopkg/in/bblfsh/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh
    creating build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh/sdk
    copying bblfsh/gopkg/in/bblfsh/sdk/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh/sdk
    creating build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh/sdk/v1
    copying bblfsh/gopkg/in/bblfsh/sdk/v1/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh/sdk/v1
    creating build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh/sdk/v1/uast
    copying bblfsh/gopkg/in/bblfsh/sdk/v1/uast/generated_pb2.py -> build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh/sdk/v1/uast
    copying bblfsh/gopkg/in/bblfsh/sdk/v1/uast/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh/sdk/v1/uast
    creating build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh/sdk/v1/protocol
    copying bblfsh/gopkg/in/bblfsh/sdk/v1/protocol/generated_pb2.py -> build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh/sdk/v1/protocol
    copying bblfsh/gopkg/in/bblfsh/sdk/v1/protocol/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh/sdk/v1/protocol
    copying bblfsh/gopkg/in/bblfsh/sdk/v1/protocol/generated_pb2_grpc.py -> build/lib.linux-x86_64-3.5/bblfsh/gopkg/in/bblfsh/sdk/v1/protocol
    creating build/lib.linux-x86_64-3.5/bblfsh/github/com
    copying bblfsh/github/com/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh/github/com
    creating build/lib.linux-x86_64-3.5/bblfsh/github/com/gogo
    copying bblfsh/github/com/gogo/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh/github/com/gogo
    creating build/lib.linux-x86_64-3.5/bblfsh/github/com/gogo/protobuf
    copying bblfsh/github/com/gogo/protobuf/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh/github/com/gogo/protobuf
    creating build/lib.linux-x86_64-3.5/bblfsh/github/com/gogo/protobuf/gogoproto
    copying bblfsh/github/com/gogo/protobuf/gogoproto/gogo_pb2.py -> build/lib.linux-x86_64-3.5/bblfsh/github/com/gogo/protobuf/gogoproto
    copying bblfsh/github/com/gogo/protobuf/gogoproto/__init__.py -> build/lib.linux-x86_64-3.5/bblfsh/github/com/gogo/protobuf/gogoproto
    running build_ext
curl -SL https://github.com/bblfsh/libuast/releases/download/v1.6.0/libuast-v1.6.0.tar.gz | tar xz
      % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                     Dload  Upload   Total   Spent    Left  Speed
    100   611    0   611    0     0   2395      0 --:--:-- --:--:-- --:--:--  2405
    100 21511  100 21511    0     0  42866      0 --:--:-- --:--:-- --:--:-- 42866
    mv libuast-v1.6.0 libuast
    cp -a libuast/src bblfsh/libuast
    rm -rf libuast
    building 'bblfsh.pyuast' extension
    creating build/temp.linux-x86_64-3.5
    creating build/temp.linux-x86_64-3.5/bblfsh
    creating build/temp.linux-x86_64-3.5/bblfsh/libuast
    g++ -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-
strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -I/opt/rh/rh-python35/root/usr/include -O
2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=gener
ic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Ibblfsh/libuast/ -I/usr/local/include -I/usr/local/include/libxml2 -I/usr/include -I/usr/include/libxml2 -
I/opt/rh/rh-python35/root/usr/include/python3.5m -c bblfsh/pyuast.c -o build/temp.linux-x86_64-3.5/bblfsh/pyuast.o -std=c++11
    g++ -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-
strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -I/opt/rh/rh-python35/root/usr/include -O
2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=gener
ic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Ibblfsh/libuast/ -I/usr/local/include -I/usr/local/include/libxml2 -I/usr/include -I/usr/include/libxml2 -
I/opt/rh/rh-python35/root/usr/include/python3.5m -c bblfsh/libuast/uast.cc -o build/temp.linux-x86_64-3.5/bblfsh/libuast/uast.o -std=c++11
    In file included from bblfsh/libuast/uast.cc:4:0:
    bblfsh/libuast/uast_private.h:4:25: fatal error: libxml/tree.h: No such file or directory
     #include <libxml/tree.h>
                             ^
    compilation terminated.
    error: command 'g++' failed with exit status 1

    ----------------------------------------
Command "/opt/rh/rh-python35/root/usr/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-phlmbc69/bblfsh/setup.py';f=getatt
r(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/p
ip-kkd6eyh4-record/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-build-phlmbc69/bblfsh/

pip3 install bblfsh
Collecting bblfsh
  Downloading bblfsh-0.1.0.tar.gz
    Complete output from command python setup.py egg_info:
    make: *** No rule to make target 'deps'.  Stop.
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-build-m2t1aa3i/bblfsh/setup.py", line 16, in <module>
        subprocess.check_output(['make', 'deps'])
      File "/usr/lib/python3.5/subprocess.py", line 626, in check_output
        **kwargs).stdout
      File "/usr/lib/python3.5/subprocess.py", line 708, in run
        output=stdout, stderr=stderr)
    subprocess.CalledProcessError: Command '['make', 'deps']' returned non-zero exit status 2

    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-m2t1aa3i/bblfsh/

git clone https://github.com/bblfsh/client-python.git
cd client-python
make install

Cloning into 'client-python'...
remote: Counting objects: 280, done.
remote: Compressing objects: 100% (17/17), done.
remote: Total 280 (delta 11), reused 21 (delta 8), pack-reused 255
Receiving objects: 100% (280/280), 131.22 KiB | 0 bytes/s, done.
Resolving deltas: 100% (132/132), done.
make: *** No rule to make target `install'.  Stop.

git clone https://github.com/bblfsh/client-python.git
cd client-python
pip3 install .

import generated_pb2 as generated__pb2

Could not find a version that satisfies the requirement bblfsh<3.0,>=2.12.7 (from lookout-sdk==0.2.0) (from versions: 0.0.4, 0.0.5, 0.1.0, 0.2.0, 0.2.1, 0.2.3, 1.0.0, 1.0.1, 1.1.0, 2.0.0, 2.1.0, 2.2.1, 2.3.0, 2.3.1, 2.4.0, 2.4.1, 2.5.1, 2.6.0, 2.6.1, 2.8.0, 2.8.1, 2.8.2, 2.9.0, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 2.9.5, 2.9.6, 2.9.8, 2.9.10, 2.9.12, 2.9.13, 2.9.14, 2.10.0, 2.10.1, 2.11.0, 2.11.1, 2.11.2, 2.12.0, 2.12.1, 2.12.2, 2.12.3, 2.12.4, 2.12.5, 2.12.6)

In file included from bblfsh/libuast/uast.cc:4:
bblfsh/libuast/uast_private.h:4:10: fatal error: 'libxml/tree.h' file not found
#include <libxml/tree.h>
         ^~~~~~~~~~~~~~~
1 error generated.
error: command 'g++' failed with exit status 1

616|[# noqa]| # noqa
| # noqa

0|argparse|import a|i
0|os|im|i
0|tempfile|import a|i
0|unittest|import a|i
0|sourced.ml.tests.models|import argparse
import |i
0|paths|impor|i
0|sourced.ml.models|import argparse
i|i
0|Topics|import|i
0|sourced.ml.cmd|import argpars|i
0|bigartm2asdf|import argpa|i
0|source|import|i
0|!=|im|i
0|prefix|import|i
0|input|impor|i
0|output|import|i
0|prefix|import|i
0|==|im|i
184|TopicsTests|TopicsTests|TopicsTests

import bblfsh
client = bblfsh.BblfshClient("0.0.0.0:9432")
uast = client.parse("/path/to/src-d/gemini/gemini/python/setup.py").uast
list(bblfsh.filter(uast, "//@roleLiteral"))

#0  PyFilter (self=<optimized out>, args=<optimized out>) at bblfsh/pyuast.c:168
#1  0x00000000004e10ef in PyCFunction_Call () at ../Objects/methodobject.c:109
#2  0x00000000005240b4 in call_function (oparg=<optimized out>, pp_stack=0x7fffffffbde0) at ../Python/ceval.c:4705
#3  PyEval_EvalFrameEx () at ../Python/ceval.c:3236
#4  0x000000000052cf19 in _PyEval_EvalCodeWithName () at ../Python/ceval.c:4018
#5  0x000000000052dbcf in PyEval_EvalCodeEx () at ../Python/ceval.c:4039
#6  PyEval_EvalCode (co=<optimized out>, globals=<optimized out>, locals=<optimized out>) at ../Python/ceval.c:777
#7  0x0000000000543075 in builtin_exec_impl.isra.11 (locals=
    {'_i2': 'client = bblfsh.BblfshClient("0.0.0.0:9432")', 'bblfsh': <module at remote 0x7ffff3285d68>, '_sh': <module at remote 0x7ffff475def8>, '_iii': 'client = bblfsh.BblfshClient("0.0.0.0:9432")', '_': <Node at remote 0x7ffff4b973f8>, 'In': ['', 'import bblfsh', 'client = bblfsh.BblfshClient("0.0.0.0:9432")', 'uast = client.parse("setup.py").uast', 'uast', 'list(bblfsh.filter(uast, "//@roleLiteral"))'], '_oh': {4: <...>}, '_i3': 'uast = client.parse("setup.py").uast', '__package__': None, '_ii': 'uast = client.parse("setup.py").uast', 'Out': {...}, 'client': <BblfshClient(_channel=<Channel(_channel=<grpc._cython.cygrpc.Channel at remote 0x7ffff4b744a8>, _connectivity_state=<_ChannelConnectivityState(callbacks_and_connectivities=[[<function at remote 0x7ffff329cb70>, <ChannelConnectivity(_name_='READY', __objclass__=<EnumMeta(__module__='grpc', __new__=<function at remote 0x7ffff5d0d7b8>, _member_map_={'TRANSIENT_FAILURE': <ChannelConnectivity(_name_='TRANSIENT_FAILURE', __objclass__=<...>, _value_=(3, 'tran...(truncated), 
    globals={'_i2': 'client = bblfsh.BblfshClient("0.0.0.0:9432")', 'bblfsh': <module at remote 0x7ffff3285d68>, '_sh': <module at remote 0x7ffff475def8>, '_iii': 'client = bblfsh.BblfshClient("0.0.0.0:9432")', '_': <Node at remote 0x7ffff4b973f8>, 'In': ['', 'import bblfsh', 'client = bblfsh.BblfshClient("0.0.0.0:9432")', 'uast = client.parse("setup.py").uast', 'uast', 'list(bblfsh.filter(uast, "//@roleLiteral"))'], '_oh': {4: <...>}, '_i3': 'uast = client.parse("setup.py").uast', '__package__': None, '_ii': 'uast = client.parse("setup.py").uast', 'Out': {...}, 'client': <BblfshClient(_channel=<Channel(_channel=<grpc._cython.cygrpc.Channel at remote 0x7ffff4b744a8>, _connectivity_state=<_ChannelConnectivityState(callbacks_and_connectivities=[[<function at remote 0x7ffff329cb70>, <ChannelConnectivity(_name_='READY', __objclass__=<EnumMeta(__module__='grpc', __new__=<function at remote 0x7ffff5d0d7b8>, _member_map_={'TRANSIENT_FAILURE': <ChannelConnectivity(_name_='TRANSIENT_FAILURE', __objclass__=<...>, _value_=(3, 'tran...(truncated), source=<code at remote 0x7ffff202e150>) at ../Python/bltinmodule.c:957
#8  builtin_exec () at ../Python/clinic/bltinmodule.c.h:275
#9  0x00000000004e10ef in PyCFunction_Call () at ../Objects/methodobject.c:109
#10 0x00000000005240b4 in call_function (oparg=<optimized out>, pp_stack=0x7fffffffc0b0) at ../Python/ceval.c:4705
#11 PyEval_EvalFrameEx () at ../Python/ceval.c:3236
#12 0x000000000052cf19 in _PyEval_EvalCodeWithName () at ../Python/ceval.c:4018
#13 0x0000000000528b3f in fast_function (nk=<optimized out>, na=<optimized out>, n=<optimized out>, pp_stack=0x7fffffffc2c0, func=<optimized out>)
    at ../Python/ceval.c:4813
#14 call_function (oparg=<optimized out>, pp_stack=0x7fffffffc2c0) at ../Python/ceval.c:4730

static PyObject *PyFilter(PyObject *self, PyObject *args)                                                                                                    │
   │150     {                                                                                                                                                            │
   │151       PyObject *obj = NULL;                                                                                                                                      │
   │152       const char *query = NULL;                                                                                                                                  │
   │153       if (!PyArg_ParseTuple(args, "Os", &obj, &query))                                                                                                           │
   │154         return NULL;                                                                                                                                             │
   │155                                                                                                                                                                  │
   │156       Nodes *nodes = UastFilter(ctx, obj, query);                                                                                                                │
   │157       if (!nodes) {                                                                                                                                              │
   │158         char *error = LastError();                                                                                                                               │
   │159         PyErr_SetString(PyExc_RuntimeError, error);                                                                                                              │
   │160         free(error);                                                                                                                                             │
   │161         return NULL;                                                                                                                                             │
   │162       }                                                                                                                                                          │
   │163       int len = NodesSize(nodes);                                                                                                                                │
   │164       PyObject *list = PyList_New(len);                                                                                                                          │
   │165                                                                                                                                                                  │
   │166       for (int i = 0; i < len; i++) {                                                                                                                            │
   │167         PyObject *node = (PyObject *)NodeAt(nodes, i);                                                                                                           │
  >│168         Py_INCREF(node);                                                                                                                                         │
   │169         PyList_SET_ITEM(list, i, node);                                                                                                                          │
   │170       }                                                                                                                                                          │
   │171       NodesFree(nodes);                                                                                                                                          │
   │172       return PySeqIter_New(list);                                                                                                                                │
   │173     }

(gdb) p node
$1 = 0x0

(gdb) py-bt
Traceback (most recent call first):
  <built-in method filter of module object at remote 0x7ffff3285ef8>
  File "<ipython-input-5-f6a6d28734b6>", line 1, in <module>
  <built-in method exec of module object at remote 0x7ffff7fbc5e8>
  File "/usr/local/lib/python3.5/dist-packages/IPython/core/interactiveshell.py", line 2881, in run_code
    exec(code_obj, self.user_global_ns, self.user_ns)

docker run -it --rm python:3.7.0-stretch bash
pip3 install bblfsh
python3 -c "import bblfsh.github.com.gogo.protobuf.gogoproto.gogo_pb2"

In [1]: import bblfsh
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-1-e99ccc08549f> in <module>()
----> 1 import bblfsh

/usr/local/lib/python3.5/dist-packages/bblfsh/__init__.py in <module>()
----> 1 from bblfsh.client import BblfshClient
      2 from bblfsh.pyuast import filter, iterator
      3 from bblfsh.aliases import *
      4 
      5 class TreeOrder:

/usr/local/lib/python3.5/dist-packages/bblfsh/client.py in <module>()
      4 import grpc
      5 
----> 6 from bblfsh.aliases import ParseRequest, NativeParseRequest, VersionRequest, ProtocolServiceStub
      7 from bblfsh.sdkversion import VERSION
      8 

/usr/local/lib/python3.5/dist-packages/bblfsh/aliases.py in <module>()
     24 
     25 ParseResponse = importlib.import_module(
---> 26     "bblfsh.gopkg.in.bblfsh.sdk.%s.protocol.generated_pb2" % VERSION).ParseResponse
     27 
     28 NativeParseResponse = importlib.import_module(

/usr/lib/python3.5/importlib/__init__.py in import_module(name, package)
    124                 break
    125             level += 1
--> 126     return _bootstrap._gcd_import(name[level:], package, level)
    127 
    128 

/usr/local/lib/python3.5/dist-packages/bblfsh/gopkg/in/bblfsh/sdk/v1/protocol/generated_pb2.py in <module>()
    101       message_type=None, enum_type=None, containing_type=None,
    102       is_extension=False, extension_scope=None,
--> 103       options=None, file=DESCRIPTOR),
    104     _descriptor.FieldDescriptor(
    105       name='language', full_name='gopkg.in.bblfsh.sdk.v1.protocol.NativeParseRequest.language', index=1,

TypeError: __new__() got an unexpected keyword argument 'file'

grpcio>=1.3,<=2.0
grpcio-tools>=1.3,<2.0

 install_requires=[" install_requires=["grpcio==1.10.0", "grpcio-tools==1.10.0", "docker", "protobuf>=3.4.0"],==1.10.0", "grpcio-tools==1.10.0", "docker", "protobuf>=3.4.0"],

0|argparse|import a|i
0|os|im|i
0|tempfile|import a|i
0|unittest|import a|i
0|sourced.ml.tests.models|import argparse
import |i
0|paths|impor|i
0|sourced.ml.models|import argparse
i|i
0|Topics|import|i
0|sourced.ml.cmd|import argpars|i
0|bigartm2asdf|import argpa|i
0|source|import|i
0|!=|im|i
0|prefix|import|i
0|input|impor|i
0|output|import|i
0|prefix|import|i
0|==|im|i
184|TopicsTests|TopicsTests|TopicsTests

0|argparse|import a|i
0|os|im|i

0|==|im|i
0|!=|im|i

0|source|import|i
0|prefix|import|i
0|input|impor|i
0|output|import|i
0|prefix|import|i

wget https://raw.githubusercontent.com/lumoslabs/aleph/master/vendor/assets/javascripts/ace/mode-pgsql.js

ERROR:root:Exception deserializing message!
Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/grpc/_common.py", line 87, in _transform
    return transformer(message)
google.protobuf.message.DecodeError: Error parsing message
Traceback (most recent call last):
  File "/home/k/.local/lib/python3.5/site-packages/IPython/core/interactiveshell.py", line 2910, in run_code
    exec(code_obj, self.user_global_ns, self.user_ns)
  File "<ipython-input-33-6f0fa647fcd6>", line 1, in <module>
    resp = bf.parse("/home/k/sourced/workdir/mode-pgsql.js")
  File "/usr/local/lib/python3.5/dist-packages/bblfsh/client.py", line 74, in parse
    return self._stub.Parse(request, timeout=timeout)
  File "/usr/local/lib/python3.5/dist-packages/grpc/_channel.py", line 487, in call
    return _end_unary_response_blocking(state, call, False, deadline)
  File "/usr/local/lib/python3.5/dist-packages/grpc/_channel.py", line 437, in _end_unary_response_blocking
    raise _Rendezvous(state, None, None, deadline)
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with (StatusCode.INTERNAL, Exception deserializing response!)>

REPOSITORY                       TAG                 IMAGE ID                                                                  CREATED             SIZE
bblfsh/bblfshd                   latest              sha256:fb5eb6936c67c20f451daddc09a4648cc26da978041af36f9f70b246f71d804d   13 days ago         173MB

| javascript | docker://bblfsh/javascript-driver:latest | dev-adcd1b4 | beta      | 11 days  | alpine | 1.9 | 8.9.3-r0    |

Command "/Users/k/test/.venv-py3/bin/python3.6 -u -c "import setuptools, tokenize;__file__='/private/var/folders/v5/3pvllllj4l1dvx7s_2qkq0_40000gn/T/pip-build-y50usx77/grpcio/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /var/folders/v5/3pvllllj4l1dvx7s_2qkq0_40000gn/T/pip-5owjmdjl-record/install-record.txt --single-version-externally-managed --compile --install-headers /Users/k/test/.venv-py3/bin/../include/site/python3.6/grpcio" failed with error code 1 in /private/var/folders/v5/3pvllllj4l1dvx7s_2qkq0_40000gn/T/pip-build-y50usx77/grpcio/

#  Token    Internal Role  Roles Tree                          
                                                               
   ||       Module         FILE                                
1  ||       Assign         ┣ BINARY, ASSIGNMENT, EXPRESSION    
1  |a|      Name           ┃ ┣ LEFT, IDENTIFIER, EXPRESSION    
1  |<nil>|  NoneLiteral    ┗ ┗ LITERAL, NULL, EXPRESSION, RIGHT

org.apache.spark.api.python.PythonException: Traceback (most recent call last):
  File "/opt/spark/python/lib/pyspark.zip/pyspark/worker.py", line 177, in main
    process()
  File "/opt/spark/python/lib/pyspark.zip/pyspark/worker.py", line 172, in process
    serializer.dump_stream(func(split_index, iterator), outfile)
  File "/opt/spark/python/lib/pyspark.zip/pyspark/serializers.py", line 268, in dump_stream
    vs = list(itertools.islice(iterator, batch))
  File "/usr/local/lib/python3.4/dist-packages/sourced/ml/transformers/basic.py", line 186, in deserialize_uast
  File "/usr/local/lib/python3.4/dist-packages/sourced/ml/transformers/basic.py", line 186, in <listcomp>
google.protobuf.message.DecodeError: Error parsing message

	at org.apache.spark.api.python.PythonRunner$$anon$1.read(PythonRDD.scala:193)
	at org.apache.spark.api.python.PythonRunner$$anon$1.next(PythonRDD.scala:156)
	at org.apache.spark.api.python.PythonRunner$$anon$1.next(PythonRDD.scala:152)
	at org.apache.spark.InterruptibleIterator.next(InterruptibleIterator.scala:40)
	at org.apache.spark.storage.memory.MemoryStore.putIteratorAsBytes(MemoryStore.scala:372)
	at org.apache.spark.storage.BlockManager$$anonfun$doPutIterator$1.apply(BlockManager.scala:1055)
	at org.apache.spark.storage.BlockManager$$anonfun$doPutIterator$1.apply(BlockManager.scala:1029)
	at org.apache.spark.storage.BlockManager.doPut(BlockManager.scala:969)
	at org.apache.spark.storage.BlockManager.doPutIterator(BlockManager.scala:1029)
	at org.apache.spark.storage.BlockManager.getOrElseUpdate(BlockManager.scala:760)
	at org.apache.spark.rdd.RDD.getOrCompute(RDD.scala:334)
	at org.apache.spark.rdd.RDD.iterator(RDD.scala:285)
	at org.apache.spark.api.python.PythonRDD.compute(PythonRDD.scala:63)
	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
	at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
	at org.apache.spark.api.python.PairwiseRDD.compute(PythonRDD.scala:395)
	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
	at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:96)
	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:53)
	at org.apache.spark.scheduler.Task.run(Task.scala:108)
	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:335)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

18/04/04 14:11:56 WARN Bblfsh: FATAL os/src/shell/micropython/tests/pyboard.py: Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/python_driver/requestprocessor.py", line 139, in process_request
    '\n------ Python3 errors:\n%s' % codeinfo['py3_ast_errors']
Exception: Errors produced trying to get an AST for both Python versions
------ Python2 errors:
[b'Traceback (most recent call last):\n  File "<string>", line 1, in <module>\n  File "/usr/lib/python2.7/site-packages/pydetector/ast2dict.py", line 19, in ast2dict\n    return visitor.parse()\n  File "/usr/lib/python2.7/site-packages/pydetector/ast2dict.py", line 45, in parse\n    tree = ast.parse(self.codestr, mode=\'exec\')\n  File "/usr/lib/python2.7/ast.py", line 37, in parse\n    return compile(source, filename, mode, PyCF_ONLY_AST)\n  File "<unknown>", line 1\n    ../tools/pyboard.py\n    ^\nSyntaxError: invalid syntax\n']
------ Python3 errors:
['Traceback (most recent call last):\n  File "/usr/lib/python3.6/site-packages/pydetector/ast_checks.py", line 53, in check_ast\n    current_ast = ast2dict(code)\n  File "/usr/lib/python3.6/site-packages/pydetector/ast2dict.py", line 19, in ast2dict\n    return visitor.parse()\n  File "/usr/lib/python3.6/site-packages/pydetector/ast2dict.py", line 45, in parse\n    tree = ast.parse(self.codestr, mode=\'exec\')\n  File "/usr/lib/python3.6/ast.py", line 35, in parse\n    return compile(source, filename, mode, PyCF_ONLY_AST)\n  File "<unknown>", line 1\n    ../tools/pyboard.py\n    ^\nSyntaxError: invalid syntax\n']

elapsed {
}
version: "v2.4.1"
build {
  seconds: -62135596800
}