Face-MagNet: Magnifying Feature Maps to Detect Small Faces

By Pouya Samangouei*, Mahyar Najibi*, Larry Davis, Rama Chellappa

* contributed equally.

The paper can be found here.

This Python implementation is based on Faster-RCNN.

License

Face-MagNet is released under the Apache 2 License (refer to the LICENSE file for details).

Citing Face-MagNet

@inproceedings{wacv18facemagnet,
    Author = {Pouya Samangouei and Mahyar Najibi and Larry Davis and Rama Chellappa},
    Title = {Face-MagNet: Magnifying Feature Maps to Detect Small Faces},
    Booktitle = {IEEE Winter Conf. on Applications of Computer Vision ({WACV})},
    Year = {2018}
}

Installation

• Download face-magnet.

cd <project-parent-dir>
git clone --recursive https://github.com/po0ya/face-magnet
FM_ROOT=`pwd`/face-magnet

• Install python requirements.

  cd $FM_ROOT
  pip install -r requirements.txt
  

• Make lib:

  cd $FM_ROOT/lib
  make
  

• Install nccl from https://developer.nvidia.com/nccl for multi-gpu training.

• Build caffe.

  cd caffe-facemagnet
  # Set build flags e.g., edit caffe-facemagnet/Makefile.config appropriately.
  make -j8
  make pycaffe
  

• Download the WIDER-Face dataset.

  WIDER_PATH=<path-to-wider-face>
  

• Perpare the data directory:

  • Download imagenet pretrained weights using scripts from Faster-RCNN:

    ./data/scripts/fetch_imagenet_models.sh
    

  • Create a symlink to WIDER-Face path:

    ln -s $WIDER_PATH data/wider
    

    • (optional) Copy imglist.csv files into WIDER_PATH:

    cp -r data/WIDER_imglists/* $WIDER_PATH
    

    These csv files are generated with matlab/wider_csv.m and is provided in case matlab is not available. If it is, the code will generate these automatically.

• Create a or link a debug directory for output logs.

  mkdir debug
  

  or

  ln -s <path-to-debug-dir> debug
  

Train a model:

./experiments/scripts/train_min800.sh <model-name> <gpu-ids>

• <model-name> can be:

  • facemagnet: Face-MagNet model for the 8th row of Table 1 and the final results.
  • sizesplit: SizeSplit model for the 7th row of Table 1.
  • skipface: SkipFace model for the 6th row of Table 1.
  • context: Context model for the 5th row of Table 1.
  • default: For the first row of Table 1.
  • facemagnet_nc, sizesplit_nc, and skipface_nc for the models without context pooling.

• <gpu-ids> is a string of comma separated GPU ids.

• To see the training progress tail -f <log-path> where <log-path> is shown after running the above script.

For example, for facemagnet run:

./experiments/scripts/train_min800.sh facemagnet 0,1

To train Face-MagNet on two GPUs.

For single GPU training please use ./tools/train_net.py.

 python ./tools/train_net.py --gpu <gpu-id> \
  --solver models/wider/VGG16/solvers/<model-name>.prototxt \
  --weights data/imagenet_models/VGG16.v2.caffemodel \
  --imdb wider_train \
  --iters 76000 \
  --cfg experiments/cfgs/min800.yml \
  ${EXTRA_ARGS}

Single image detection

To detect faces on a single image with a trained model:

./experiments/scripts/test_single.sh <model-name> <image-path> <args>

• <model-name> is the same as the training section.
• <image-path> is the path to the image
• args can be the following optional arguments:
  • --min_size <int> Overrides cfg.TEST.SCALES so that the minimum dimension of the image is scaled to this value.
  • --max_size <int> Overrides cfg.TEST.MAX_SIZE so that the maximum dimension is not greater than its value.
  • --pyramid Performs the detection three times on scales [0.5, 1, 2] of the image and combines the result.

For example to detect the faces in images of data/demo:

./experiments/scripts/test_single.sh facemagnet data/demo/demo0.jpg --pyramid

Reproducing the results

• To produce the results of each row of Table 1, use:

  ./experiments/scripts/test_min800.sh <model-name>
  

• To perform the benchmark test on WIDER-Face:

  ./experiments/scripts/test_wider.sh
  

• To test the fddb and pascal datasets:

  • Pascal image list can be found in data/pascal_imglist.csv
  • Download FDDB and link it to data/fddb.
  • Prepare Pascal Faces and put it under data/pascal.
  • To get the detections:

    ./experiments/scripts/test_base.sh VGG16 {fddb|pascal} <model-name> 38000 ./experiments/cfgs/min800.yml
    

  • To produce eval plots see tools/marcopede-face_eval.
  • Take a look at and use ./experiments/scripts/plot_fddb.sh for FDDB.

Notes

• The results are reported using two NVIDIA P6000 GPU with 24GB GPU memory. Big images need a higher memory because of the sizes of the convolutional feature maps, therefore if you're facing memory issues try setting cfg.TEST.MAX_SIZE to a smaller number.

TODOs:

• Uploading the models.