multi-person-gaze-following

overview

This repo provides PyTorch implementation of our paper: 'Multi-Person Gaze-Following with Numerical Coordinate Regression'

dataset

GazeFollow: You can download GazeFollow dataset from here and the additional annotation for the GazeFollow dataset from Attention-Target-Detection

VideoAttentionTarget: You can download VideoAttentionTarget dataset from Attention-Target-Detection

Please adjust the dataset path accordingly in every '.py' file.

#model You can download resnet-GazeFollow,ghost-GazeFollow,ghost-VideoAttentionTarget, three gaze-following models, and a face-detector model from Baidu Cloud Disk password: wlsj

put the model in master directory

run

After adjust the dataset path.

train:

python train_gazefollow.py or python train_videoattention.py

evaluation in dataset:

python test_gazefollow.py or python test_videoattention.py

test multi-person gaze-following:

python videoattention_face_gaze_detection_shared_save.py

reference

Attention-Target-Detection

GhostNet

yolov5-face

softargmax