Insight into error `awswrangler.exceptions.QueryFailed: Iceberg cannot access the requested resource` about aws-sdk-pandas

[kukushking]

Hi @plbremer does this consistently reproduce? Does your role have S3 permissions to both COMPANY-lab-data-lake and COMPANY-lab-a2p-commons-metabase-output buckets, as well as KMS, and Glue permissions? Have you tried running it as Admin?

The error is coming from the Athena service and unfortunately lacking information that would help to debug. You might be able to find more error details in CloudTrail, otherwise I suggest to raise AWS support request and include query id that would help service team with RCA.

[plbremer]

@kukushking thanks for taking the time to respond

for all those curious, I am not sure which permissions exactly did the trick, but I can say that adding

• "athena:StartQueryExecution",
• "athena:StopQueryExecution"
• "glue:Create*"

resolved this issue