Coder Social home page Coder Social logo

Comments (1)

darrenldl avatar darrenldl commented on August 26, 2024

Why "the number of parity shards to be below the number of data shards."?

The recommendation was likely made in relation to performance, as the time required grows quadratically with the number of parity shards used. And most people only want a percentage of overhead that is less than 100% if it's for error recovery purposes.

Can the number of parity shards more than the number of data shards?

The only restriction is that the data + parity shard count must not exceed 256 in total, as reedsolomon uses Galois field (2^8).

I see sia.tech can split data in to 30 segments, and recover from any 10 of 30 segments , can reedsolomon do this ?

You can emulate the behaviour of the Sia software by picking data shard count of 10 and parity shard count of 20, and distribute each shard to a unique host. Picking parity shard count of 20 means you can lose up to 20 shards of the 30 shards, which is same as being able to recover from any 10 of the shards.

Note that Sia could be using a more complex scheme to achieve the same behaviour, but the above arrangement is the most straightforward way of doing so.

from reedsolomon.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.