Awesome-Visual Question Generation

Problem Statement

Give an image, the task is to generate natural Question based on the image.

Dataset

• Image Dataset-:MS-COCO and Question Dataset -: VQG-COCO

• Image Dataset-:Flickr and Question Dataset -: VQG-Bing

• Image Dataset-:Bing and Question Dataset -: VQG-Flickr

• Image Dataset-:MS-COCO and Question Dataset -: VQA-v1.0

• Image Dataset-:MS-COCO and Question Dataset -: VQA-v2.0

• Image Dataset-:MS-COCO and Question Dataset -: Visual7W

VQG Papers

• Paper Name - Author 1 et al, Conference Year. [code]

Year 2020 papers:

• Visual Question Generation from Radiology Images -Sarrouti et al, ALVR workshop 2020

• Deep Bayesian Network for Visual Question Generation -Patro et al, WACV 2020. [Project Page]

• Learning to Generate Diverse Questions from Keywords -Pen et al, ICASSP 2020

• C3VQG: Category Consistent Cyclic Visual Question Generation -Uppal et al, Arxiv 2020

Year 2019 papers:

• Information Maximizing Visual Question Generation - Krishna et al, *CVPR 2019. [code]

• Improving Neural Question Generation Using Answer Separation -Kim et al, AAAI 2019

• Visual Question Generation: The State of the Art -Patil et al, ACM Computing Survey 2019

• Joint Learning of Question Answering and Question Generation -Sun et al, Transactions on Knowledge and Data Engineering 2019

Year 2018 papers:

• Multimodal Differential Network for Visual Question Generation. - Patro et al, EMNLP 2018 [Project Link]

• Visual Question Generation as Dual Task of Visual Question Answering -Yikang et al, *CVPR 2018

Year 2017 papers:

• Automatic Generation of Grounded Visual Questions. - Zhang et al, IJCAI 2017.

• Learning to Ask: Neural Question Generation for Reading Comprehension, -Xinya et al. ACL 2017

• Creativity: Generating Diverse Questions using Variational Autoencoders. -Jain et al, CVPR 2017.

• Image-grounded conversations: Multimodal context for natural question and response generation.. -Mostafazadeh et al,IJCNLP 2017

• Asking the Difficult Questions: Goal-Oriented Visual Question Generation via Intermediate Rewards. -Zhang et al, Arxiv 2017

Year 2016 papers:

• Generating natural questions about an image. -Mostafazadeh et al, ACL 2016.

Year 2015 papers:

• Neural Self Talk: Image Understanding via Continuous Questioning and Answering] -Yang et al, Arxiv 2015.