fine-tuning/retraining esm2

[MarjanHJ]

is it possible to fine-tune or train esm2 with sequences that are not from Uniprot? I have a set of custom data and I want to fine-tune or train esm2 on my data but I don't know how to make the followings for my dataset.
I can see the sample data they have ur50_id and ur90_id but my data doesn't have these Ids. If this is still possible to train esm2, can you please point to the instruction to do this.

train_cluster_path = f"{data_path}/2024_03_sanity/train_clusters_sanity.parquet"
train_database_path = f"{data_path}/2024_03_sanity/train_sanity.db"
valid_cluster_path = f"{data_path}/2024_03_sanity/valid_clusters.parquet"
valid_database_path = f"{data_path}/2024_03_sanity/validation.db"

thanks.