Skip to content

OneMainF/hdfs-over-ftp

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

hdfs-over-ftp

FTP server based on Apache FtpServer which works on a top of HDFS.

Features

  • Supports Apache FtpServer 1.0.6
  • Active and passive connections
  • SSL support
  • Passwords are stored as MD5 hashes
  • Users locked into home directory (configured per user)
  • Supports using FTP user or specified user to connect to HDFS
  • JMX for remote statistics viewing and reset
  • Can run on YARN using Apache Slider - see hdfs-over-ftp-slider
  • Can add uploaded filename to Apache ActiveMQ queue
  • Option to create missing directories

Requirements

  • Java (tested with Java 7)
  • Maven
  • HDFS (2.7.1)

Building

  • mvn package (run unit tests and build)
  • mvn verify (run unit tests, build, and run integration tests)

Configuration

  • Set users in configuration/users.properties
  • Set server options in configuration/hdfs-over-ftp.properties (see comments in file)
  • Set log configuration in configuration/log4j.xml (set to console by default)

Running

  1. Change Java options in start-server.sh
  2. Start server using start-server.sh (use --approot to define application root - include trailing slash)

References

hdfs-over-ftp

License

Apache License 2.0

About

FTP server which works on a top of HDFS

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 99.3%
  • Shell 0.7%