how to push model to huggingface ?

[new-Sunset-shimmer]

No description provided.

[ciCciC]

Assuming that there is a quantized model, an installation of the pkg named huggingface_hub and an existing HF repository with the repo_type model, you can use the following code chunk ->

quant_path = <path of the directory which contains your quantized model>

repo_id = <your HF repo id> e.g. "owner/my-quantized-model-awq"

api = HfApi(token=<your HF token>)

api.upload_folder(
    folder_path=quant_path,
    repo_id=repo_id,
    repo_type="model",
)

[Zeju1997]

@casper-hansen Can you please elaborate on this? Is this how you did it to push models to huggingface? Best,