Skip to content

Under Development: A Singer tap for extracting data from Parquet, built using the Singer SDK: https://gitlab.com/meltano/singer-sdk

License

Notifications You must be signed in to change notification settings

dataops-tk/tap-parquet

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

tap-parquet

This Singer tap was created using the Singer SDK.

About Parquet

Parquet is a portable, type-aware, columnar, compressed, splittable, and cloud-friendly format.

For more information why Parquet is increasingly used in big data applications, see this comparison.

Getting Started

Testing Guide

Create tests within the tap_parquet/tests subfolder and then run:

poetry install
poetry run pytest

Singer SDK Dev Guide

See the dev guide for more instructions on how to use the Singer SDK to develop your own taps and targets.

Config Guide

Accepted Config Options

Currently only a single config option is expected:

  • filepath - absolute path to a parquet source file.

Source Authentication and Authorization

N/A. Cloud support is not yet available.

About

Under Development: A Singer tap for extracting data from Parquet, built using the Singer SDK: https://gitlab.com/meltano/singer-sdk

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages