Windows - SyntaxError: invalid syntax about ethereum-etl

[medvedev1088]

What version of python are you using?

[RaianeQC]

Version python 3.7

[RaianeQC]

I will install version python 3.5

[RaianeQC]

Now I have problem

When execute:

python export_blocks_and_transactions.py -s 0 -e 5499999 -b 100000 --ipc-path ~\.\pipe\geth.ipc --blocks-output blocks.csv --transactions-output transactions.csv

I have problem below:

Traceback (most recent call last):
File "export_blocks_and_transactions.py", line 35, in
job.run()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\base_job.py", line 7, in run
self._end()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\export_blocks_job.py", line 57, in _end
super()._end()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\batch_export_job.py", line 56, in _end
self.executor.shutdown()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\executors\fail_safe_executor.py", line 16, in shutdown
self._check_completed_futures()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\executors\fail_safe_executor.py", line 24, in _check_completed_futures
future.result()
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures_base.py", line 398, in result
return self.__get_result()
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures_base.py", line 357, in __get_result
raise self._exception
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\base_job.py", line 5, in run
self._export()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\batch_export_job.py", line 42, in _export
self.executor.submit(self._fail_safe_export_batch, batch_start, batch_end)
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\executors\fail_safe_executor.py", line 8, in submit
self._check_completed_futures()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\executors\fail_safe_executor.py", line 24, in _check_completed_futures
future.result()
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures_base.py", line 398, in result
return self.__get_result()
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures_base.py", line 357, in __get_result
raise self._exception
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures\thread.py", line 55, in run
result = self.fn(*self.args, **self.kwargs)
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\batch_export_job.py", line 50, in _fail_safe_export_batch
self._export_batch(block_number, block_number)
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\export_blocks_job.py", line 42, in _export_batch
response = self.ipc_wrapper.make_request(json.dumps(blocks_rpc))
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\ipc.py", line 34, in make_request
with self._lock, self._socket as sock:
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\site-packages\web3\providers\ipc.py", line 45, in enter
self.sock = self._open()
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\site-packages\web3\providers\ipc.py", line 58, in _open
return get_ipc_socket(self.ipc_path)
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\site-packages\web3\providers\ipc.py", line 26, in get_ipc_socket
return NamedPipe(ipc_path)
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\site-packages\web3\utils\windows.py", line 19, in init
raise IOError(err)
OSError: (3, 'CreateFile', 'O sistema não pode encontrar o caminho especificado.')

[medvedev1088]

Seems you are using Windows. Try these instructions https://github.com/medvedev1088/ethereum-etl#running-in-windows

[medvedev1088]

In particular the file path should be \\.\pipe\geth.ipc

[RaianeQC]

I run in GIT Bash, ./export_all.sh -s 0 -e 999999 -b 100000 -i '\.\pipe\geth.ipc' -o output

But i have problem below:

Traceback (most recent call last):
File "export_blocks_and_transactions.py", line 35, in
job.run()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\base_job.py", line 7, in run
self._end()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\export_blocks_job.py", line 57, in _end
super()._end()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\batch_export_job.py", line 56, in _end
self.executor.shutdown()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\executors\fail_safe_executor.py", line 16, in shutdown
self._check_completed_futures()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\executors\fail_safe_executor.py", line 24, in _check_completed_futures
future.result()
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures_base.py", line 398, in result
return self.__get_result()
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures_base.py", line 357, in __get_result
raise self._exception
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\base_job.py", line 5, in run
self._export()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\batch_export_job.py", line 42, in _export
self.executor.submit(self._fail_safe_export_batch, batch_start, batch_end)
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\executors\fail_safe_executor.py", line 8, in submit
self._check_completed_futures()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\executors\fail_safe_executor.py", line 24, in _check_completed_futures
future.result()
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures_base.py", line 398, in result
return self.__get_result()
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures_base.py", line 357, in __get_result
raise self._exception
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures\thread.py", line 55, in run
result = self.fn(*self.args, **self.kwargs)
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\batch_export_job.py", line 50, in _fail_safe_export_batch
self._export_batch(block_number, block_number)
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\export_blocks_job.py", line 42, in _export_batch
response = self.ipc_wrapper.make_request(json.dumps(blocks_rpc))
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\ipc.py", line 34, in make_request
with self._lock, self._socket as sock:
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\site-packages\web3\providers\ipc.py", line 45, in enter
self.sock = self._open()
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\site-packages\web3\providers\ipc.py", line 58, in _open
return get_ipc_socket(self.ipc_path)
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\site-packages\web3\providers\ipc.py", line 26, in get_ipc_socket
return NamedPipe(ipc_path)
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\site-packages\web3\utils\windows.py", line 19, in init
raise IOError(err)

[medvedev1088]

After raise IOError(err) you have the same message as before? OSError: (3, 'CreateFile', 'O sistema não pode encontrar o caminho especificado.')
Check that geth is running. The message says that the ipc file doesn't exist.

[RaianeQC]

Thank very Much.

I have other problem:

Traceback (most recent call last):
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\base_job.py", line 5, in run
self._export()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\batch_export_job.py", line 42, in _export
self.executor.submit(self._fail_safe_export_batch, batch_start, batch_end)
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\executors\fail_safe_executor.py", line 8, in submit
self._check_completed_futures()
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\executors\fail_safe_executor.py", line 24, in _check_completed_futures
future.result()
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures_base.py", line 398, in result
return self.__get_result()
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures_base.py", line 357, in __get_result
raise self._exception
File "C:\Users\XPS\AppData\Local\Programs\Python\Python35-32\lib\concurrent\futures\thread.py", line 55, in run
result = self.fn(*self.args, **self.kwargs)
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\batch_export_job.py", line 46, in _fail_safe_export_batch
self._export_batch(batch_start, batch_end)
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\export_blocks_job.py", line 44, in _export_batch
blocks = [self.block_mapper.json_dict_to_block(result) for result in results]
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\jobs\export_blocks_job.py", line 44, in
blocks = [self.block_mapper.json_dict_to_block(result) for result in results]
File "C:\Users\XPS\Documents\Python-Ethereum\ethereum-etl-master\ethereumetl\utils.py", line 25, in rpc_response_batch_to_results
raise ValueError('result is null in response {}'.format(response_item))
ValueError: result is null in response {'result': None, 'jsonrpc': '2.0', 'id': 0}

[RaianeQC]

Thank you, you helped me a lot.

I'll study your script.

I'm very grateful.

[t2y]

It seems that #35 is the same cause as this. It's duplicated issue.