data-integrations / ftp-plugins

FTP source and sink plugins

ftp-plugins

FTP source and sink plugins

ftp-plugins's Issues

How to pull a file file from a NFS (network file system,on-premise machine with disk mounted) as source into Data fusion

Issue type: Feature Request

Problem you have encountered:
I ran into an issue when I wanted to have a feature to be supported to fetch a file from a NFS (network file system,on-premise machine with disk mounted) as a source.

What you expected to happen:

1. A data fusion plugin or this ftp-plugin to perform file fetching with NFS source can be set and
2. A file polling can be possible when new files appear from the source and will be picked up automatically or a scheduler can be set together with ftp fetching from NFS source.

Other information (workarounds you have tried, documentation consulted, etc):
I tried to share a solution by considering [1] and combining airflow ftp operators under schedule to fetch a file from a NFS(network file system) source using FTP protocol. It seems there is no existing file or FTP plugin that can do the file fetching using a scheduler.

[1] https://stackoverflow.com/questions/48248369/how-to-implement-polling-in-airflow