Coder Social home page Coder Social logo

averyzhong / hdfs-over-sftp Goto Github PK

View Code? Open in Web Editor NEW
12.0 2.0 7.0 36 KB

SFTP server which works on the top of HDFS,It is based on Apache sshd to access and operate HDFS through SFTP protocol

Java 100.00%
hdfs sftp hdfs-over-sftp hadoop-filesystem

hdfs-over-sftp's Introduction

hdfs-over-sftp

SFTP server which works on the top of HDFS

Hdfs-over-sftp is an open source project based on Apache sshd to access and operate HDFS through SFTP protocol

How to Run?

  1. Import project to your IDE(e.g: Intellij Idea).
  2. Edit the resources/hdfs-over-sftp.properties file & resources/users.properties as yours.
  3. Run com.avery.hdfs.sftp.SftpServer#main.
  4. Inputsftp -oPort=2233 -o HostKeyAlgorithms=+ssh-dss yourusername@localhost at your terminal and press "Return" key.
  5. Enter "yes".
  6. Enter your password and press "Return" key.
AveryZhong$ sftp -oPort=2233 -o HostKeyAlgorithms=+ssh-dss admin@localhost
admin@localhost's password: 
Connected to admin@localhost.
sftp> ls          
hbase               inject              log                 logs                merger              
opt                 security            test                tmp                 
user                words.txt           
sftp> 

Configurations

Server config

Edit the resources/hdfs-over-sftp.properties file as yours, some config like this:

# sftp server host & port
host = localhost
port = 2233
# hdfs uri
hdfs-uri = hdfs://host:port

Users config

Edit the resources/users.properties file file as yours, some config like this:

# username: admin, password: 123456 (md5 format)
sftpserver.user.admin.userpassword = e10adc3949ba59abbe56e057f20f883e
sftpserver.user.admin.homedirectory = /log
sftpserver.user.admin.enableflag = true

# username: sftpuser, password: 123456 (md5 format)
sftpserver.user.sftpuser.userpassword = e10adc3949ba59abbe56e057f20f883e
sftpserver.user.sftpuser.homedirectory = /log/log-download
sftpserver.user.sftpuser.enableflag = true

License

Copyright 2019 AveryZhong

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

  http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

hdfs-over-sftp's People

Contributors

averyzhong avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

hdfs-over-sftp's Issues

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.