README.md

LowRankLayers

This package provides a simple implementation of Low-Rank Adaptations (LoRAs) for Flux layers.

Usage

using Flux, LowRankLayers

dense_layer = Dense(10 => 5)
lora_layer = LoRADense(dense_layer, 3) # hidden_dim = 3