Kafka Messaging extension: Ability to create/provision Reactive Kafka Consumers dynamically(Runtime) without @Incoming annotations about quarkus

[quarkus-bot]

/cc @alesj (kafka), @cescoffier (kafka), @ozangunalp (kafka)

[xqianwang]

@cescoffier @ozangunalp Some suggestions or insights please.

[cescoffier]

Reactive messaging has been designed for a declarative model where you know the topics in advance.

You can use regexp on the consuming side or metadata on the producing side to handle dynamic topics. Note that for regexp, it will only fetch new topics when metadata are refreshed (that's periodic).

If you need more dynamism, you can use the bare Kafka client for this. Note that you will need to make sure you understand how Kafka consumers and producers work. Also, creating Kafka topic dynamically has costs on the broker - make sure you understand that before creating millions of topics.

[xqianwang]

Reactive messaging has been designed for a declarative model where you know the topics in advance.

You can use regexp on the consuming side or metadata on the producing side to handle dynamic topics. Note that for regexp, it will only fetch new topics when metadata are refreshed (that's periodic).

If you need more dynamism, you can use the bare Kafka client for this. Note that you will need to make sure you understand how Kafka consumers and producers work. Also, creating Kafka topic dynamically has costs on the broker - make sure you understand that before creating millions of topics.

Thanks for reply. For the webhook use case, how can I handle it with reactive messaging?