Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Zero-Shot HOI Detection Setting #28

Open
hutuo1213 opened this issue Nov 27, 2023 · 0 comments
Open

Zero-Shot HOI Detection Setting #28

hutuo1213 opened this issue Nov 27, 2023 · 0 comments

Comments

@hutuo1213
Copy link

Hi,
We have recently considered using a two-stage method for Zero-Shot HOI Detection, but we have some confusion about the detailed setup. My understanding is that the text features (600) do similarity calculations with the final interaction representation to get the interaction categories.

  1. unseen combination (UC) has seen all verbs and objects. The two-stage method seems to handle this case directly. Alternatively, the "similarity computation" is still used.

  2. Unseen Objects (UO) Have not seen a few objects.
    We found that in GEN-VLKT (hico_text_label.py), there are only interaction categories related to unseen objects. So, are unseen objects used as GTs in training for the object detection task? Does this part still use "similarity computation"?

  3. Unseen actions (UV) have not seen few verbs. Does this part still use "similarity computation"?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant