The code repository for "Domain Adaptive Few-Shot Open-Set Learning" [paper] (ICCV'23) in Tensorflow.
Few-shot learning has made impressive strides in addressing the crucial challenges of recognizing unknown samples from novel classes in target query sets and managing visual shifts between domains. However, existing techniques fall short when it comes to identifying target outliers under domain shifts by learning to reject pseudo-outliers from the source domain, resulting in an incomplete solution to both problems. To address these challenges comprehensively, we propose a novel approach called Domain Adaptive Few-Shot Open Set Recognition (DA-FSOS) and introduce a meta-learning-based architecture named DAFOSNET. During training, our model learns a shared and discriminative embedding space while creating a pseudo open-space decision boundary, given a fully-supervised source domain and a label-disjoint few-shot target domain. To enhance data density, we use a pair of conditional adversarial networks with tunable noise variances to augment both domains’ closed and pseudo-open spaces. Furthermore, we propose a domain-specific batch-normalized class prototypes alignment strategy to align both domains globally while ensuring class-discriminativeness through metric objectives. Our training approach ensures that DAFOS-NET can generalize well to new scenarios in the target domain. We present three benchmarks for DA-FSOS based on the Office-Home, mini-ImageNet/CUB, and DomainNet datasets and demonstrate the efficacy of DAFOSNet through extensive experimentation.
This code requires the following:
- python 3.7+
- TensorFlow v2.12.0+
- keras_cv v1.4.0
The Domain Adaptive experiments are performed by choosing two domains from Office-Home, MiniImageNet-CUB, and DomainNet datasets.
Make two new folders, data/raw and data/processed
Keep the two domain folders of your choice from the aforementioned datasets in the data/raw folder.
For preprocessing details, take a look at data/save_data_to_numpy.py. By default, the flag for saving the input images tensor is set to "True" in config.json at "pre_process":"True". In case that is not needed, make it "False". You don't have to run this script separately.
If the flag is "True" the numpy arrays will be saved at data/processed.
Modify the settings in config.json
train checkpoints will be saved at ./checkpoints/train and fintune checkpoints at ./checkpoints/finetune
python3 train.py
python3 finetune.py
python3 test.py
If you use any content of this repo for your work, please cite the following bib entry:
@InProceedings{Pal_2023_ICCV,
author = {Pal, Debabrata and More, Deeptej and Bhargav, Sai and Tamboli, Dipesh and Aggarwal, Vaneet and Banerjee, Biplab},
title = {Domain Adaptive Few-Shot Open-Set Learning},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2023},
pages = {18831-18840}
}
DAFOS-NET is released under the MIT license.
Copyright (c) 2023 Debabrata Pal. All rights reserved.