Comments (5)
I believe both of the above features mentioned here are in fact the same feature: the ability to query specific chunks from blocks, from the P2P network (e.g. using a DHT).
The actual second feature we need is for nodes to be able to query messages from blocks based on their namespace, rather than their index in the block. The former is needed for clients to be able to download the messages for their application, and the latter is needed for clients to be able to do data availability checks and recover full blocks.
from celestia-core.
It can be part of the same service/DHT, but my point is that the "two features" in your original post are actually the same feature, and the actual second feature we need is querying by namespace. The only difference is that you need to query chunks by namespace, not by index.
from celestia-core.
The actual second feature we need is for nodes to be able to query messages from blocks based on their namespace
I think, a simple way to implement this is would be a RPC service for the Namespaced Merkle Tree (the already offers this feature) backed by a DB. The p2p layer could be used to find nodes that offer this capability. On the p2p-layer this would only require some form of "service discovery". Or are there any reasons this should work similarly to the other feature (querying chunks from block directly from a p2p network)?
from celestia-core.
With #85 (comment), the sampling and data extraction can be achieved via querying the IPFS DAG:
The coordinates only need to be translated into a path that the ipld plugin can resolve: e.g. the coordinate (0,0)
could correspond to CID/0/...0/0
. A dag get request would return back the underlying share M_i
. This can be used for both the light clients (or validator nodes that choose not to download message to validate the erasure coding) to validate the block (as in validate its data availability) as well as nodes that want to recover the whole block (which would need to traverse the whole tree).
We can later opimize this via graphsync instead of bitswap which aims to reduce the number of roundtrips when resolving a path.
from celestia-core.
I think this issue is rather confusing and the ADR introduced in #170 as well as the issue #221 better capture the work that needs happen.
from celestia-core.
Related Issues (20)
- Peers disconnect frequently despite running default software HOT 1
- Benchmark the consensus reactor HOT 1
- Do we check this? i.e. rp.EndRow > rp.StartRow. If not, do we want to check this? HOT 2
- Consistent row proof range
- govulncheck fails on main branch HOT 1
- Expand TxStatus to include rejected transactions
- Remove v0 mempool HOT 2
- TestTxPool_ConcurrentlyAddingTx is flaky
- Port and test consensus reactor contention fixes
- Prototype using QUIC instead of tcp and proprietary handshakes HOT 1
- Compare duplicate messages with copy in receive
- Deprecate v0 mempool HOT 4
- Allow the user to request a proof of the tx's inclusion if it has been committed
- RequestPrepareProposal has unclear comments HOT 1
- Remove outdated TODO HOT 1
- Add ability to subscribe to block data via grpc HOT 2
- Add ability to request a block via its hash HOT 1
- Port not blocking on receives work from upstream HOT 1
- Expand `TxInfo` to save the resulting code of the transaction
- Proposal: Use CometBFT protos
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from celestia-core.