questions about fetures supported by Resemblyzer about resemblyzer

[CorentinJ]

Use live audio stream instead of static audio files

Yes it's possible and I had plans to implement it but no time to allocate to it (it's not trivial). Might be something I do in the future but no promises.
See the offline (as in the non-streaming approach) code here. To make it online (i.e. streaming), you'll need the following:

• A threading or async mechanism to both continuously record audio and derive embeddings. From an implementation point of view, this is the hardest bit. You'll want to keep recording audio without interruption and at the same time periodically generate partial embeddings. Your implementation will be dependent on whatever library you use for recording audio and what mechanism it provides to inform you of the length of the audio currently recorded. I can recommend sounddevice, although I am unsure of the specifics for this problem yet.
• To rewrite compute_partial_slices to yield partial segments in an online fashion. The good news is that your function should be simpler than mine, because you don't have to care about the coverage of the last partial. You'll probably not need to return the wav partials either, unless needed for debugging or visualizations.
• Finally you can use the remainder of embed_utterance to compute your embeds. Your batch size should be proportional to the maximum latency you can afford. If your application can have up to a 1s delay, then your batch size can be the number of partials in one second. The fastest solution will have a batch size of 1, but it will be more compute-intensive. You should also determine whether you want to be doing inference on CPU or GPU. The voice encoder is a fairly light model and so CPU inference may even be faster than GPU inference for small batch sizes (due to the time it takes to move the data) but maybe doing inference on the CPU will be problematic if you're recording audio at the same time.

Number of speakers unknown in the beginning of the audio stream.

See #10, a very similar thread.

Pre-trained english model for diarization.

Unfortunately diarization in general is not in my scope, I don't know what the SOTA is.