shenbaise / hadoop-transfer-tool

hadoop-transfer-tool

hadoop-transfer-tool

hadoop-transfer-tool

hadoop & ftp file transfer tool

this tool is used to transfer files to hdfs.

usage: transfer [-D ] [-d ] [--echo ] [-F ] [-H ] [-h] [--list ] [-o ] [-P ] [-p ] [--shutdown ] [--start ] [-t ] [-U ]

example 1: java -jar transfer.jar -H 192.168.. -F /dir -D /ttt -U usr -P anonymous -t ftp

example 2: java -jar transfer.jar -H 192.168.. -p 9000 -F /ttt -D /zzz -U usr -t hdfs

-D,--destination destination directory

-d,--delete delete files after tansfer.[true|false]

--echo <arg>          print file name transferring

-F,--filename file or directory to transfer

-H,--host hostname of the avro source

-h,--help get help infomation

--list <arg>          list all tasks

-o,--option overwrite,append or ignore if file exist on hdfs,o for overwrite,a for append,i for ignore.[a|i|o]

-P,--password password

-p,--port port of the avro source

--shutdown <arg>      shutdown a task.[task ID]

--start <arg>         start a task [task ID]

-t,--type type of resources. support ftp,hdfs.[ftp|hdfs]

-U,--user user name

this tool is used to transfer files to hdfs.

it support ftp & hdfs.

======================

[email protected]