Saisoku is a Python module that helps you build complex pipelines of batch file/directory transfer/sync jobs.

Tasks around metadata.

Pulling games from the Lichess API into a PostgreSQL database for data analysis.

A Streamlit Application to assist doctors in prediction of Heart Diseases based on their medical readings & characteristics.

amplicon analysisng pipelines based on luigi with qiime2-dada2/ qiime2-deblur/vsearch/usearch

This repo covers analysis of growing trends in the recruitment in the technology domain in financial organizations i.e. top banks across United States.

Projekt zur Live-Darstellung von HVV Fahrzeugen auf einer Karte.

Demo of using Luigi to build ETL Pipelines

Shows how luigi can be used with kubernetes

EDA and Luigi pipeline for M5 Forecasting (Accuracy) Competition hosted on Kaggle.

This repository contains an ETL (Extract, Transform, Load) pipeline implemented using Luigi, a Python package for building data pipelines. The pipeline extracts data from a CSV file hosted on a GitHub repository, performs some cleaning and transformation steps, and then loads the data into a SQLite database table.

🔍 Example of an ETL pipeline using Spotify's Luigi

Easy and powerful template for ML projects

Universal Luigi ETL pipeline. Validates data received from external sources. Extracts, transforms them and lands.

Left for reference on how to write a pipeline in luigi

Pycon 2017- Creating ETL tasks with Luigi package

This repository is based on scraping data from a static website through Luigi. This was created to display my ability to utilize the Luigi pipeline to automatically collect data and other tasks.