sdgym.benchmark function bug about sdgym

[csala]

Hi @johnson18404 Thanks for reporting this.

The problem that you see is that the synthesizer argument of the benchmark function is expected to be a callable, which means that it can either be a function or method, but not a class instance.

If you look at the Benchmarking the Demo Synthesizers section in the README, you will find an example about how to evaluate the included synthesizers using the benchmark function, which is by passing the synthesizer.fit_sample method to the benchmark function:

synthesizer = IndependentSynthesizer()
scores = benchmark(synthesizer.fit_sample)

[johnson18404]

I get it. It seems that I misunderstood the argument meanings. Thank you.