-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] Support single depth to 3D hand keypoints baseline, NYU Hand Pose Dataset and AWR #1487
base: dev-0.29
Are you sure you want to change the base?
Conversation
Thanks a lot for your contribution! We will review the PR ASAP. |
Hi, @jin-s13 . I have signed the CLA. I will continuously submit some commits in this branch recently to improve the PR. |
Code will be significantly refactored to fit v1.x, so it will take some extra time. |
Thank you very much. We will maintain both master and 1.x branches until 2023, and still release v0.x versions with new features in this period. So it would be great to create a new pull request for the dev-1.x branch to add this feature to 1.x version. And this PR will still be merged into the master branch after review. |
Hi @walsvid, hope you're well. Thank you again for the contribution! Is this PR ready for review? Or shall we wait for your further updates/commits before code review? BTW, have you already trained a few models on NYU dataset? Would you like to share the checkpoints and training logs with us? |
Hi, I think this PR still need updates for code review. As for NYU dataset, I have checkpoints of AWR model, I can provide link. But the log is messy, this may not help. I'll update thie PR ASAP. |
Well understood. Please let us know if you have met any problems/questions. Thanks. |
Hi @walsvid ,I'm doing some nyu hand dataset and awr related research and would like to use mmpose, would you be so kind as to provide the code and checkpoints, thank you very much! |
Hi, @Enderfga @jin-s13. I upload the ckpt and nyu data meets the coco format annotations to Google Drive. The current Pull Request still needs to improve the code related to evaluation. It would be better if @Enderfga can help to improve. |
Motivation
Integrate single depth to 3D hand keypoints into mmpose.
Modification
Add an algorithm for estimating 3D gestures from a single depth image to mmpose
Includes the following changes:
3d_kpt_sview_depth_img
common dataset NYU Hand Pose dataset3d_kpt_sview_depth_img
basic baseline algorithm AWR (AAAI2020) network architecture🚧 The evaluation code is still WIP, code review are required for above part.
🚨 More unit test are needed. Maybe it could be discussed during the code review stage.
BC-breaking (Optional)
TopDownGenerateTargetRegression
to adapt the calculation method of the GT target coordinates of the algorithm that uses the depth image as inputUse cases (Optional)
Checklist
Before PR:
After PR: