Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Continual ST-GCN #370

Merged
merged 54 commits into from
Dec 21, 2022
Merged

Continual ST-GCN #370

merged 54 commits into from
Dec 21, 2022

Conversation

LukasHedegaard
Copy link
Collaborator

@LukasHedegaard LukasHedegaard commented Dec 6, 2022

This PR adds a suite of continual spatio-temporal graph convolutional networks, namely the optimized Co ST-GCN, Co A-GCN, and Co S-TR, which can operate efficiently during frame-by-frame inference

@LukasHedegaard LukasHedegaard added the test sources Run style checks label Dec 6, 2022
@LukasHedegaard
Copy link
Collaborator Author

As we are still awaiting the upload of model weights from the OwnCloud folder to the FTP server, the tests in test_costgcn.py are expected to fail.

@LukasHedegaard LukasHedegaard added the test tools Test the toolkit methods label Dec 7, 2022
@LukasHedegaard
Copy link
Collaborator Author

Ready for review @ad-daniel @passalis

@ad-daniel
Copy link
Collaborator

The failures are unrelated to this PR, seeing it across the board in the develop branch

@LukasHedegaard
Copy link
Collaborator Author

The failures are unrelated to this PR, seeing it across the board in the develop branch

Good to know :-)

ad-daniel
ad-daniel previously approved these changes Dec 20, 2022
Copy link
Collaborator

@ad-daniel ad-daniel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you! I commited a likely fix for the rate limit error we have been getting lately, seems to have worked, more info here pytorch/vision#4156

Copy link
Collaborator

@tsampazk tsampazk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @LukasHedegaard! I added some comments below.

I am not sure about having a requirements file in the demos, maybe we can add your benchmark library in the tools requirements? I can't remember any other demo adding a requirement locally, that doesn't run out of the box.

@tsampazk tsampazk mentioned this pull request Dec 20, 2022
Copy link
Collaborator

@ad-daniel ad-daniel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I could run the demo out of the box without needing to install any dependency, so it's fine for me. Perhaps it was changed in a commit. Looks good to me, thank you!

Copy link
Collaborator

@tsampazk tsampazk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

@LukasHedegaard LukasHedegaard merged commit b7c09db into develop Dec 21, 2022
@LukasHedegaard LukasHedegaard deleted the continual-stgcn branch December 21, 2022 09:20
lucamarchionni pushed a commit to lucamarchionni/opendr that referenced this pull request Jun 10, 2024
* Add prelim impl for Continual Skeleton methods

* Add co-stgcn benchmark project

* Fix warmup in benchmark-costgcn.py

* Update continual_stgcn_learner and test

* doc updated

* Update dependencies

* Format coa_gcn and co_str files

* Update cost_gcn impl for co lib v.1.0.0

* Add ONNX optimisation and inference

* Bump opset to support co-agcn and co-str

* Update benchmarking script

* Update CHANGELOG with CoSTGCN

* Simplify load in cost-gcn test

* Update download

* Add demo

* Update demo README to include info on costgcn demo

* Minor

* More

* Fix typo

* Add CoSTGCNLearner to doc index.md

* Update docs/reference/skeleton-based-action-recognition.md

Co-authored-by: ad-daniel <[email protected]>

* Update docs/reference/skeleton-based-action-recognition.md

Co-authored-by: ad-daniel <[email protected]>

* Update docs/reference/skeleton-based-action-recognition.md

Co-authored-by: ad-daniel <[email protected]>

* Update docs/reference/skeleton-based-action-recognition.md

Co-authored-by: ad-daniel <[email protected]>

* Update docs/reference/skeleton-based-action-recognition.md

Co-authored-by: ad-daniel <[email protected]>

* Add missing param description in docstring

* Add missing param descriptions in docs

* Fix param description

* Add default value to docs

* Fix rate limit bug

* Fix sources

* Fix sources

* Fix sources

* Update src/opendr/perception/skeleton_based_action_recognition/continual_stgcn_learner.py

Co-authored-by: Kostas Tsampazis <[email protected]>

* Update src/opendr/perception/skeleton_based_action_recognition/continual_stgcn_learner.py

Co-authored-by: Kostas Tsampazis <[email protected]>

* Update projects/python/perception/skeleton_based_action_recognition/REAMDE.md

Co-authored-by: Kostas Tsampazis <[email protected]>

* Update docs/reference/index.md

Co-authored-by: Kostas Tsampazis <[email protected]>

* Fix skeleton data prep docs

* Rename to README

* Fix path name

* Change download to print if verbose

Co-authored-by: Negar <[email protected]>
Co-authored-by: Kostas Tsampazis <[email protected]>
Co-authored-by: ad-daniel <[email protected]>
Co-authored-by: ad-daniel <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
test sources Run style checks test tools Test the toolkit methods
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants