PivotMesh: Generic 3D Mesh Generation via Pivot Vertices Guidance

Project Page | Paper | Weight

Preparation

Install the packages in requirements.txt. The code is tested under CUDA version 12.1.

conda create -n pivotmesh python=3.9
conda activate pivotmesh
pip install -r requirements.txt

Training

# train AE
accelerate launch --mixed_precision=fp16 train_AE.py 

# train PivotMesh
accelerate launch --mixed_precision=fp16 train_pivotmesh.py

Inference

python pivot_infer.py \
    --model_path checkpoints/PivotMesh-objaversexl/mesh-transformer.ckpt.ft.50.pt \
    --AE_path checkpoints/AE-objaversexl/mesh-autoencoder.ckpt.72.pt \
    --output_path output/PivotMesh \
    --dataset_name objaverse \
    --batch_size 16 \
    --sample_num 1 \
    --temperature 0.5 \
    --pivot_rate 0.1 \
    --condition no   # 'no' for unconditional, 'pivot' for conditional 

Evaluation

# evaluate the performance on PivotMesh
python evaluate.py

Acknowledgement

• MeshGPT
• HyperDiffusion

Citation

@misc{weng2024pivotmesh,
    title={PivotMesh: Generic 3D Mesh Generation via Pivot Vertices Guidance}, 
    author={Haohan Weng and Yikai Wang and Tong Zhang and C. L. Philip Chen and Jun Zhu},
    year={2024},
    eprint={2405.16890},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}