Comments (5)
if you use top
or htop
you will see the cpu and memory use of the process, which gives you some processing indications.
from blocksci.
I see blocksci_parser working in htop. But it takes only 0.7% CPU and 228MB memory. I have a system which has a RAM of 6.8 GB.
When I try to import it in python3.5 , it gives a segmentation fault.
`
Python 3.5.2 (default, Nov 23 2017, 16:37:01)
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
import blocksci
chain = blocksci.Blockchain("/mnt/disk1/blocksci_data")
Segmentation fault (core dumped)
`
from blocksci.
Hi @pranay01,
The segmentation fault is from the python module is likely due to corruption of some sort in the data located at /mnt/disk1/blocksci_data
. The code is still fairly research quality so it doesn't handle the unexpected very well 😄
Have you tried the new release of BlockSci that we released yesterday? It should provide feedback through the entire process. If I remember correctly, the previous version didn't provide feedback during the initial block header parsing stage. Now all stages should provide percentage done estimates.
The full parse process takes a little under a day at this time. The many data processing takes about 8 hours and then there is a long index generation process. BlockSci doesn't require complete chain data and the parser in fact has a --max-block parameter that lets you process only up to a given block height.
from blocksci.
@hkalodner - Is the data set you are using in development publically available?
from blocksci.
I'm not exactly sure what you mean by data set. BlockSci's data is generated directly from raw blockchain data. The readme links to an EC2 AMI which has a BlockSci instance running on it which contains the full Bitcoin blockchain as of a couple days ago. Additionally the data can be generated on any machine running a Bitcoin full node.
from blocksci.
Related Issues (20)
- How to filter txes within a period of time
- Is there a way to get the string for nonstandard and multis addresses HOT 5
- Can't install Blocksci failing on pip3 install HOT 1
- I'd be happy to maintain this project if you do not have the time. HOT 8
- Always Segmentation fault (core dumped) at 36xxxx/678615 block HOT 1
- blocksci_parser throws "Error while interacting with RPC" Exception
- Can anyone please tell me how to install BlockSCI step by step HOT 1
- Parsing the blockchain on Ubuntu 18.04 HOT 4
- Iterators returned by fluent interface routines reset randomly
- Address clustering heuristic in BlockSci
- std::runtime_error Abort trap: 6
- from ._blocksci import * issue
- Error. HOT 1
- BlockSci always returns empty lists, no matter which function I call HOT 3
- Any alternative to chain.address_from_string() not working, returning null for valid address strings? HOT 1
- How to modify BlockSci to capture Taproot PTTR addresses/transactions? Volunteers please! HOT 2
- CSV Export Tool
- ERROR CODE 1
- Issue with BlockSci Parser Execution
- Data base help. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from blocksci.