To have a python script to compare the Athena metadata with the S3 data structure and add the new partitions without having the overhead of scanning all the files in the bucket.
gautam-shanbhag / aws-load-new-partitions-programmatically Goto Github PK
View Code? Open in Web Editor NEWTo have a python script to compare the Athena metadata with the S3 data structure and add the new partitions without having the overhead of scanning all the files in the bucket.