DynamoDBToS3Operator using native export functionality. about airflow

[boring-cyborg]

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

[jayceslesar]

Is this ask possible? The only method in the dynamo boto3 client listed that seems relevant is export_table_to_point_in_time which the existing codebase already supports

airflow/airflow/providers/amazon/aws/transfers/dynamodb_to_s3.py

Line 156 in 6b92145

def _export_table_to_point_in_time(self):

.

Doesn't seem that a native export is possible without PITR enabled.

The only thing the existing Airflow implementation/passthrough seems to be missing are two (optional) arguments:

1. ExportType
2. IncrementalExportSpecification

[gyli]

I agree with @jayceslesar that ExportTableToPointInTime is the only API provided in boto to export DynamoDB data to S3, based on AWS's blog introducing this native export.

@Kuhlmann-Itagyba-bah You may try DynamoDBToS3Operator with argument export_time specified, so it will use _export_table_to_point_in_time method for export.