partial compaction of index/kvs only. about moss

[steveyen]

hehe, indeed! that's why i shouldn't be in accounting :-)

[steveyen]

A related thought is if that if the max key-len in a segment is less than 24-bits, then perhaps those bits can also be used for other purposes, like the above idea to reference a buf.

[mschoch]

Before you go spending bits we don't have, my understanding is that we only have 8 bits left over.

64 - data offset
4 - opteration type
24 - key len
28 - val len
8 - reserved

Also those 8 reserved bits are not contiguous, 4 are near the operation and 4 are near the value len.

[hisundar]

The kvs/index arrays can only be merged when there are no key space overlaps right?

[steveyen]

The kvs/index arrays can only be merged when there are no key space overlaps right?

Hi, unless I'm too pre-coffee about this, I'm thinking they can be merged, even when there are overlaps. That is, a kvs entry currently has info like this...

op, bufOffset, keyLen, valLen

And the proposal is to add one more thing, like...

op, bufIdx, bufOffset, keyLen, valLen

The bufIdx would tell us which buf to use.

That way, at read time, there's less binary searching... that is, currently, moss will binary search through multiple kvs arrays as it moves down through the segment stack. Instead, it would just binary search through a single kvs array (which refers to multiple buf's).

One wrinkle (related to my lack ability to account correctly) is w.r.t. how many bits we can afford to give to a bufIdx field.