Drop transaction meta about stellar-protocol

[osyed]

I totally agree. The core stellard servers should not be carrying this data. But there should be servers that interface between the clients and the stellard servers that can provide this data (the client serving servers). Perhaps the current stellar-wallet servers can be enhanced to provide this service. It essentially becomes a three tier architecture. A while back I had proposed such an architecture for bitcoin.
http://arimaa.com/bitcoin

[donovanhide]

Is the idea to just remove the TxnMeta column from the sqlite transactions.db? Or is it also to remove the Metadata from the transaction leaf nodes in the nodestore? By my observations of the Ripple nodestore, 90% of the disk space is used by the account state tree inner nodes and LedgerHashes, so getting rid of TransactionMetadata isn't really going to solve the disk space issue:

https://gist.github.com/donovanhide/11272001

I agree that it is inane that the nodestore isn't indexed so you can extract it from there rather than having it duplicated in RawTxn and TxnMeta fields in the sqlite db. Also consider that determining the AffectedNodes from the before and after state in the Account State is not straightforwards...

[nullstyle]

@osyed IMO the stellar-wallet is not the appropriate service to integrate the expanded transaction data into... rather, I believe it should be its own service that is public and available to anyone without authentication.

To that aim, I have a proof-of-concept ledger indexing system built that indexes ledgers as they close into an elastic search server. My plan is to polish that up and ship a RESTful service alongside the indexer that lets people slice/dice/filter transactions easily. In the future, we can add further materializations built upon the raw data that will allow simpler integrations.

Thoughts?

[osyed]

@nullstyle that sounds awesome. I agree the stellar-wallet server is probably not the best place to add the meta service. Having a separate server for this sounds like a good idea.

[jedmccaleb]

this is done now