can't extract bor snapshot archive to 3413 gb disk drive about bor

[martinboehm]

It would be greatly beneficial if the parts of the snapshot were extractible individually. Currently, the process involves downloading the parts, merging them into a single large file (and subsequently deleting the individual parts), and then extracting the data from the large file. This necessitates the disk space to be twice as large as the final extracted data.

[pratikspatil024]

Hi @rmlcu - the size of the snapshot keeps increasing as the chain progresses. So the space requirements will also increase over time. That being said, there are some scripts available on this page which might help you. Also, the total size of the current snapshot is available here.

[0x090909]

@martinboehm you can extract while downloading with wget using this command
wget -q -O - "part url" | tar -I zstd -xvf -

in "part url" use the list of urls one by one, you get in here https://snapshot-download.polygon.technology/bor-mainnet-parts.txt

[martinboehm]

@0x090909 Thank you for your answer. Unfortunately, it does not work. The parts are not independent, they must be first put together. For example, when trying to extract the first part of heimdall-mumbai snapshot, I get:

wget -q -O - https://snapshot-download.polygon.technology/heimdall-mumbai-snapshot-bulk-2024-02-01-part-aa | tar -I zstd   -xvf -
application.db/
application.db/142082.ldb
...
blockstore.db/711218.ldb
/*stdin*\ : Read error (39) : premature end
tar: Unexpected EOF in archive
tar: Unexpected EOF in archive
tar: Error is not recoverable: exiting now

[0x090909]

@martinboehm https://snapshots.vaultstaking.com/polygon/

This is another snapshot of the chaindata, thank me later

[martinboehm]

@0x090909 Thank you!

[0x090909]

@martinboehm Hey martin did you manage to fully syncronize? I setup the 7 march snapshot and for a day it went good but at some point I got a bad block error, and my sync stopped. Is your working okay?

My node stopped syncing at block number https://polygonscan.com/block/54467995

please let me know

[martinboehm]

@0x090909 Yes, I downloaded the March 9 snapshot and so far without any problem. I got bad block problems before several times. I followed this https://docs.polygon.technology/pos/how-to/troubleshoot/known-issues/ procedure. Usually the restart helped but once I had to do the "Solution 3" to get it unstuck.

[0x090909]

@martinboehm what is your configuration? in terms of storage, are you keeping all the chain in a NVME? or NVME + HDD

[martinboehm]

@0x090909 All on NVME.

[cffls]

Looks like the solution above worked. Closing this issue. Feel free to reopen if the issue still exists.