Recycle goroutine doing compaction about frostdb

[brancz]

I think it's important that we keep the write path non-blocking/lock-free, so I wonder if we could find another way. Maybe we could just mark the granule to need compaction and have the compaction go routines just cycle through the granules to pick up the ones that need compaction? Happy for other suggestions but not spawning a go routine at every insert is obviously not a long term option (I think we always knew this but just punted on that when we initially wrote this).

[thorfour]

Yea, when I initially wrote that I played around with buffered channels as well as a mark and sweep style. This one performed the best, and until we better understood the characteristics of how it performed decided to defer solving this.

[brancz]

Potentially wild idea, what if we used a sync pool for reusing goroutines?

[brancz]

Never mind we would end up leaking goroutines.