Unexpected error during batch delivery about aiokafka

[KPull]

After a couple of days trying to get to the bottom of this, we have resolved the issue by changing the order of sending the offsets and sending the records within the transaction, like so:

async with producer.transaction():
  await producer.send_offsets_to_transaction({topic_partition: commit_offsets}, self.__group_id)
  for record in records_to_write:
      await producer.send(record.topic, value=record.value, key=record.key)

Given that this has solved the problem, it means that there is some sort of race condition within the library that is only triggered when using Kafka 3.7.