Skip to content

Latest commit

 

History

History
14 lines (10 loc) · 675 Bytes

sftploadtobronze.md

File metadata and controls

14 lines (10 loc) · 675 Bytes

Documentation Home | AWS Home

S3 Load to Bronze

This execution template will load data from an SFTP location into a DataFrame using the DownloadSFTPToHDFSWithDataFrame, call the LoadToParquet pipeline, and use the WriteDataFrameToHDFS pipeline to store the data in the bronze zone (HDFS) as parquet.

General Information

Id: load_data_bronze_sftp_hdfs

Name: Load SFTP to Bronze HDFS

Form

A custom form allows configuring the download and input parameters as well as controlling the pipeline behavior.