Implement a small distributed file system (supporting stand-alone) for resource uploading instead of hdfs. about dolphinscheduler

[Baoqi]

I would suggest use https://github.com/minio/minio to replace HDFS, since:

1. it is relatively easy. and it implements AWS S3 API
2. it also have wrapper around common fs, like, AWS, azure, even HDFS

[lzy305]

+1

[RustRw]

https://github.com/sjqzhang/go-fastdfs Simple expansion, support for breakpoints, etc.

[Davidsong1989]

+1

[Baoqi]

Details information about how to use HDFS/ Local FileSystem / AWS S3 (or Minio Server), please see pull request #267

[msftgitsklsd]

这个单机版本可以用吗？具体怎么用呢？

[Baoqi]

这个单机版本可以用吗？具体怎么用呢？

Yes, please refer to #267 for the detailed usage. Especially part 3, how to use with Minio .

Note: that was based on dev-1.1.0 branch, but in the newest 1.2.0 branch, the configuration files may be in different location, please double check.