Skip to content

Latest commit

 

History

History
158 lines (116 loc) · 6.02 KB

README.md

File metadata and controls

158 lines (116 loc) · 6.02 KB
Raw

Classification of Piping Components

This repository is an official implementation of our new paper Automated Classification of Piping Components from 3D LiDAR Point Clouds using SE-PseudoGrid, published in the Automation in Construction journal and its early short version will also appear in the IPC2022 conference in early July. (For free access, you may also read our AutoCon journal paper in the ResearchGate.)

In this study, we proposed a novel local aggregation operator(LAO) based the squeeze-and-excite mechanism from the popular SENet in 2D image analysis (termed SE-LAO) for point cloud feature learning. On top of the newly proposed SE-LAO and the strong PseudoGrid, we construct a new network for piping component classification (named SE-PseudoGrid). To the best of our knowledge, it is the first attempt to generalize the squeeze-and-excite mechanism for 2D image analysis to 3D point cloud analysis. With this new design in the local aggreation operators for point clouds, our SE-PseudoGrid outpeforms the strong baseline PseudoGrid by a large margin on the piping benchmark datast(Pipework).

  • our novel SE-LAO based on the LAO (in PseudoGrid) and squeeze-and-excite mechanism

Requirements

To install requirements:

#!/bin/bash
ENV_NAME='se'
conda create –n $ENV_NAME python=3.6.10 -y
source activate $ENV_NAME
conda install -c anaconda pillow=6.2 -y
conda install pytorch==1.4.0 torchvision==0.5.0 cudatoolkit=10.1 -c pytorch -y
conda install -c conda-forge opencv -y
pip3 install termcolor tensorboard h5py easydict

Note that: the latest codes are tested on two Ubuntu settings:

  • Ubuntu 18.04, Nvidia 3090, CUDA 11.3, PyTorch 1.4 and Python 3.6

Compile custom CUDA operators

sh init.sh

Pipework dataset

We select the sole piping dataset i.e., Pipework (shown below) as the benchmark and canonicalize it following ModelNet40' pratice. The canonicalized dataset can be downloaded from Pipework dataset. Note that the detailed preprocessing steps are shown in the pipework-prepare-v2.ipynb.

instances of Pipework

typical instances for the 17 categories in the Pipework

train and test set distribution of the new Pipework dataset 
# download the pipework dataset
unzip pipework-new.zip
cd pipework-new
# move the pipe-original to the root/data folder
# or symlink to the root/data folder

The file structure should look like:

<root>
├── cfgs
│   └── s3dis
├── data
│   └── Pipework
│       └── PipeWork-original
│           ├── BlindFlange
│           ├── Cross
│           └── ...
├── init.sh
├── datasets
├── function
├── models
├── ops
└── utils

Training

To train the model(s) in the paper, run this command:

python -m torch.distributed.launch \
--master_port ${port_number} \ # 12346
--nproc_per_node ${NUM_GPUs} \ # e.g., 1
function/train_pipework_dist.py \
--cfg cfgs/pipework/${yaml_file} \ # e.g., cfgs/pipework/xxx.yaml
--num_points ${num_points} \
--val_freq 10 \
--save_freq 50 \
--loss ${LOSS} \ # e.g., smooth
--use_avg_max_pool ${use_avg_max_pool}  # e.g., true

Evaluation

To evaluate my model on ImageNet, run:

python -m torch.distributed.launch \
--master_port ${port_number} \ # 12346
--nproc_per_node ${NUM_GPUs} \
--local_rank 1 \
function/evaluate_pipework_dist.py \
--load_path ${checkpoint_path} \ # e.g., log/pipework/xxx/best.pth 
--cfg ${cfg_path} \ # e.g., cfgs/pipework/xxx.yaml
--data_aug ${data_aug} \ # e.g., true or false
--loss ${LOSS} \ # e.g., smooth
--use_avg_max_pool ${use_avg_max_pool}  # e.g., true

Pre-trained Models

You can download pretrained models here:

  • TOADD trained on the Pipework

Results

  • We benchmark six shortlisted representatative DL-based methods on the Pipework.
  • On top of our newly proposed SE-LAO and the strong baseline PseduoGrid, we construct our SE-PseudoGrid; It achieves better performance than the baseline, decreasing OA and avgAcc error rate of the backbone by 25.4%, 34.5%, respectively.

Network OA (%) avgAcc (%)
PointNet 84.15 73.95
PointNet++ 86.87 75.30
DGCNN 90.90 77.16
PointCNN 91.05 88.68
PosPool 94.33 93.61
PseudoGrid 94.97 96.24
SE-PseudoGrid (ours) 96.25 97.54

Acknowledgements

Our pytorch codes borrowed a lot from CloserLook3D and the custom trilinear interoplation CUDA ops are modified from erikwijmans's Pointnet2_PyTorch.

Besides, thanks Prof. Duhwan Mun group to provide the open PipeWork dataset.

Contributing

MIT license

Citation

If you find our work useful in your research, please consider citing:

@article{se-pseudogrid,
    Author = {Chao Yin, Jack CP Cheng*, Boyu Wang, Vincent JL Gan*},
    Title = {Automated Classification of Piping Components from 3D LiDAR Point Clouds using SE-PseudoGrid},
    Journal = {Automation in Construction},
    Year = {2022}
   }