Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Are there any complete task definitions? #26

Open
cxchhh opened this issue Oct 10, 2024 · 2 comments
Open

Are there any complete task definitions? #26

cxchhh opened this issue Oct 10, 2024 · 2 comments

Comments

@cxchhh
Copy link

cxchhh commented Oct 10, 2024

Thanks for the awesome datasets!

Currently, I'm working on my project which needs precise task definitions to describe the video, but the task_definitions.csv only has a sheet about the object and the movement, e.g. "toy car" and "Pick and place".

What I want is the entire sentence of the precise description, such as "Pick the toy car and place it on the table". Can you upload the original full description list of the tasks, or provide a method to let me assemble the object and movement to become a full description sentence? Thanks a lot.

@leolyliu
Copy link
Owner

leolyliu commented Oct 10, 2024

Hi cxchhh,

HOI4D only represents a task as a combination of the object category (C) and the action label (T). We recommend to manually define the mapping from the <object category, action label> pair to the sentence.

The <object category, "pick and place"> pair can be transferred to "Pick a {object category} and then place it somewhere.". Other action labels are category-specific and easy to understand and transfer to sentences.

@cxchhh
Copy link
Author

cxchhh commented Oct 10, 2024

Understood. Thank you very much

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants