mathieulavoie / bitcluster Goto Github PK
View Code? Open in Web Editor NEWHome Page: https://www.bit-cluster.com
License: MIT License
Home Page: https://www.bit-cluster.com
License: MIT License
Hi,
Is this project still active?
The page http://dev.bit-cluster.com/magnet for downloading the database is not working (for me). Error message: ERR_CONNECTION_REFUSED comes up.
Does anybody knows what to do?
Thanks a lot!
BitCluster should integrate caching and become more efficient. To do so, it would be useful to make it multi-thread.
I noticed that there are only 116 Multisig addresses in the updated database, this can be confirmed by querying db.getCollection('addresses').find({_id : {$regex : "^3.*"}});
in the mongoDB.
Looking deeper I noticed that address_utils.py
throws an error when seeing multisig addresses:
Pubkey not in recognized format
Transaction 6cbc0f757619a5535e1fd967487d33f75ed12153a06db8c661473a2813b17d26 Unable To Parse SigScript b'00483045022100d69...
I'm working on a fix for this and will send a pull request when it's ready and tested.
The value of shadow addresses should be investigated.
A new collection should be created with the conversion rate between BTC and USD. This collection should auto-update as new blocks are integrated into BitCluster.
Last version is 443000, almost behind of 50000 blocks . Hosted instance (dev.bit-cluster.com) is up to date thought.
Do an installation procedure to get Bitcluster run on your own machine.
User has reported that some addresses including 1Bz6tMM3N9tzMsXFX.... could not be found using the tool.
Block 317777 crawled
Block 317778 crawled
Traceback (most recent call last):
File "build_cluster.py", line 52, in
start()
File "build_cluster.py", line 17, in start
while builder.crawl_block(block_id):
File "/opt/Bitcluster/crawler/base_crawler.py", line 27, in crawl_block
block = self.proxy.getblock(hash)
File "/home/apollo/.local/share/virtualenvs/Bitcluster/lib/python3.4/site-packages/bitcoin/rpc.py", line 382, in getblock
r = self._call('getblock', block_hash, False)
File "/home/apollo/.local/share/virtualenvs/Bitcluster/lib/python3.4/site-packages/bitcoin/rpc.py", line 186, in _call
response = self._get_response()
File "/home/apollo/.local/share/virtualenvs/Bitcluster/lib/python3.4/site-packages/bitcoin/rpc.py", line 207, in _get_response
http_response = self.__conn.getresponse()
File "/usr/lib/python3.4/http/client.py", line 1172, in getresponse
response.begin()
File "/usr/lib/python3.4/http/client.py", line 351, in begin
version, status, reason = self._read_status()
File "/usr/lib/python3.4/http/client.py", line 313, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/lib/python3.4/socket.py", line 371, in readinto
return self._sock.recv_into(b)
socket.timeout: timed out
This is probably due to some kind of network connectivity issue. Is there a known way to improve reliability ? Like an auto retry or a longer wait time.
Can we as well restart the Build script up to the last block crawled or it needs to start from 1 every time ? Will that affect the mapping afterwards ?
Also can we get explanations on whats in a block exactly ? I suppose :
Any insights on the reason of this error? it happened while rebuilding the cluster database.
http.client.CannotSendRequest: Request-sent
Reconnecting and retrying...(1/10)
Caught an unhandled exception. See stacktrace:
ERROR:root:Request-sent
Traceback (most recent call last):
File "/root/bitcluster/crawler/base_crawler.py", line 37, in crawl_block
block_hash = self.proxy.getblockhash(block_id)
File "/usr/local/lib/python3.5/dist-packages/bitcoin/rpc.py", line 429, in getblockhash
return lx(self._call('getblockhash', height))
File "/usr/local/lib/python3.5/dist-packages/bitcoin/rpc.py", line 199, in _call
'Content-type': 'application/json'})
File "/usr/lib/python3.5/http/client.py", line 1106, in request
self._send_request(method, url, body, headers)
File "/usr/lib/python3.5/http/client.py", line 1141, in _send_request
self.putrequest(method, url, **skips)
File "/usr/lib/python3.5/http/client.py", line 974, in putrequest
raise CannotSendRequest(self.__state)
http.client.CannotSendRequest: Request-sent
Reconnecting and retrying...(1/10)
BitCluster should be able to auto-update itself.
The database should have one more collection that stores the nodeID and the label (name) of nodes. A scraper could be built to scrape the labels of wallet addresses off of reputable sources.
As none of the Database peers have over 95% of the database files, the download can never complete. Please join the torrent with the full file set, so that it may be resumed. Thank you
Hi,
We have been trying to download an updated DB from torrents but there no seeds. Is there a time we can schedule so we can download it ?
Sincerely,
Hello! I have a problem with
"Block 274900 crawled
Caught an error from Bitcoind RCP, Reconnecting and retrying...(1/10)
Block 275000 crawled" or
Caught an error from Bitcoind RCP, Reconnecting and retrying...(1/10)
Block 270300 crawled
Caught an error from Bitcoind RCP, Reconnecting and retrying...(1/10)
Caught an error from Bitcoind RCP, Reconnecting and retrying...(2/10)
Traceback (most recent call last):
File "build_cluster.py", line 54, in
start()
File "build_cluster.py", line 17, in start
while builder.crawl_block(block_id):
File "C:\Bitcluster\crawler\base_crawler.py", line 34, in crawl_block
block_hash = self.proxy.getblockhash(block_id)
File "C:\Users\alexm\AppData\Local\Programs\Python\Python35-32\lib\site-packages\bitcoin\rpc.py", line 381, in getblockhash
return lx(self._call('getblockhash', height))
File "C:\Users\alexm\AppData\Local\Programs\Python\Python35-32\lib\site-packages\bitcoin\rpc.py", line 154, in _call
response = self._get_response()
File "C:\Users\alexm\AppData\Local\Programs\Python\Python35-32\lib\site-packages\bitcoin\rpc.py", line 175, in _get_response
http_response = self.__conn.getresponse()
File "C:\Users\alexm\AppData\Local\Programs\Python\Python35-32\lib\http\client.py", line 1197, in getresponse
response.begin()
File "C:\Users\alexm\AppData\Local\Programs\Python\Python35-32\lib\http\client.py", line 297, in begin
version, status, reason = self._read_status()
File "C:\Users\alexm\AppData\Local\Programs\Python\Python35-32\lib\http\client.py", line 258, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "C:\Users\alexm\AppData\Local\Programs\Python\Python35-32\lib\socket.py", line 575, in readinto
return self._sock.recv_into(b)
Creating the database from scratch
I have core i7 and 8 GB RAM
Sincerely,
Hi,
Is this project still active?
The page http://dev.bit-cluster.com/magnet for downloading the database is not working (for me). Error message: ERR_CONNECTION_REFUSED comes up.
Does anybody knows what to do?
Thanks a lot!
Hi,
I am not too sure about the procedure to update the database after it has been build from the one available through torrent download.
What I tried to do :
*This step is failing with an http error BadStatusLine
Can you please tell how I should proceed to update ?
Is there a way to update using the DB available through torrent ? Is it up to date ?
BitCluster should provide the users with a visual representation of bitcoin transfers. The user could select a node and see the TOP 10 incoming and outgoing nodes who have sent/received bitcoins in relation to the node. The amount of the transfers should be printed in the graph and the % that the TOP 10 represents should be indicated.
The users could navigate the graph by clicking on nodes. Only nodes that are relevant to the new node (maximum of 2 transfers away) should be kept on the graph.
There should be an option to toggle between nodeID and labels in the graph.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.