hoodie.properties.backup file does not exist about hudi

[danny0405]

Maybe this is what you need: #8609, but you are right, it looks like the table.properties has been updated frequently after the upgrade, can you add some log in HoodieTableConfig and let's see why the update is triggered.

[danny0405]

Are these failing jobs uses separate compaction with Spark, or do they have concurernt write with Spark writers?

[danny0405]

Spark enables the MDT while Flink does not, maybe that's the reason why the table properties are updated frequently.

[donghaihu]

Flink for writing.

[donghaihu]

enables

How can we configure it to avoid this issue?

[danny0405]

I mean did you have both Spark and Flink job writing into the same table, if it is, you might need to disable the MDT on Spark writer.

[donghaihu]

I mean did you have both Spark and Flink job writing into the same table, if it is, you might need to disable the MDT on Spark writer.

Oh. We don't have that scenario. Each table only has one fink task responsible for writing; there is no situation where multiple sinks correspond to one table.

[donghaihu]

@danny0405 ：I found that this situation tends to occur after Session tasks report errors.