Coder Social home page Coder Social logo

Comments (4)

mfontanini avatar mfontanini commented on June 1, 2024

I just tried this and it works as expected, I'm using rdkafka 0.9.5. Keep in mind that the offset reset policy just means "if there is not an offset for this consumer in this topic/partition, then use this policy". This means that if you do this:

  • Start consuming
  • Produce 1 message
  • Consumer sees the message and commits it
  • Stop consumer
  • Produce 1 message
  • Start consumer

Then the consumer will see that one new message because it did have an offset but this new message has an offset larger than the last committed one, hence you receive the message.

from cppkafka.

fmvin avatar fmvin commented on June 1, 2024

Thanks a lot for explaination.
When please advice an appropriate solution how to consume only these messages which are produced after consumer starts.

from cppkafka.

mfontanini avatar mfontanini commented on June 1, 2024

You can just not commit any messages and use reset policy latest. That way there's never an offset committed for a topic/partition for that consumer, hence every time you'll start at the end of each queue.

from cppkafka.

fmvin avatar fmvin commented on June 1, 2024

You can just not commit any messages and use reset policy latest. That way there's never an offset committed for a topic/partition for that consumer, hence every time you'll start at the end of each queue.

It works now as I expected. Thanks a lot.

from cppkafka.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.