Presto Alluxio sdk Cache issue for file changes of the same s3 URI about presto

[imjalpreet]

CC: @beinan @apc999

[beinan]

For error 2, it should be fixed in 310 right? We haven't seen this issue for a while now.

Yes, I believe so

[diablo47]

presto 0.285.1 + alluxio 310 have this issue as well

[beinan]

There is a hack on presto side to fix this issue by adding the last_modified_timestamp into the cache key. Let me try to find the code change or I will post a PR for this issue later

[beinan]

Hi @diablo47 , here is the fix: #22750

A new config should be added to enable this cache refresh feature as below:

cache.last-modified-time-check-enabled = true

do you mind to give it a shot? Thanks!

[zacw7]

For error 2, it should be fixed in 310 right? We haven't seen this issue for a while now.

[beinan]

fix: #22750 merged.

[diablo47]

Hi @diablo47 , here is the fix: #22750

A new config should be added to enable this cache refresh feature as below:

cache.last-modified-time-check-enabled = true

do you mind to give it a shot? Thanks!

Hi beinan, thank you for this fix, I will try it along with alluxio 310