cluster selection based on stability is really sensitive to the selection of fall_off_size about hdbscan

[lmcinnes]

Thanks for the compliments on the implementation. I admit that the automatic cluster selection may not be to everyone's taste, but it is a good default for a large number of cases. Since the single_linkage_tree_ and condensed_tree_ are both exposed as attributes of the model after fitting I feel those who wish to do something else are able to should they desire to do so.

On the other hand, if the question is one of sensitivity to the min_samples parameter (rather than min_cluster_size) I may have some answers there. I have been working on a different algorithms that essentially operates over all (or potentially just many) min_samples values and computes a total stability over the combined epsilon and min_samples space. This requires some significant rethinking of how to interpret the algorithm, and I've been drawing heavily from persistent homology (and more accurately persistent homotopy) theory to get something workable. There are still a number of details to hammer out and some work to be done to ensure the resulting algorithm really does return useful clusterings, but I believe it has significant promise.