Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Metric inconsistency #17

Open
swc-17 opened this issue Dec 14, 2023 · 2 comments
Open

Metric inconsistency #17

swc-17 opened this issue Dec 14, 2023 · 2 comments

Comments

@swc-17
Copy link

swc-17 commented Dec 14, 2023

Hi,
Thanks for your work! I wonder why the metrics of provided checkpoint is better than those in paper?
@swc-17
Copy link
Author

swc-17 commented Dec 14, 2023

Also wondering the prediction performance with PETRv2 as detector, which is not mentioned in the paper.

@GentleSmile
Copy link
Member

We rewrite the metrics for better readability before releasing the code, and details of metrics calculating have been updated, especially the minADE and minFDE.
As mentioned in the paper, we found that PETRv2 is not suitable for the detector of ViP3D. The tracking and prediction performance is quite poor.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@GentleSmile @swc-17