Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor valve_landmarks bundle using ApplyTransformToPoints #644

Open
KumoLiu opened this issue Sep 9, 2024 · 2 comments
Open

Refactor valve_landmarks bundle using ApplyTransformToPoints #644

KumoLiu opened this issue Sep 9, 2024 · 2 comments

Comments

@KumoLiu
Copy link
Collaborator

KumoLiu commented Sep 9, 2024

Refactor valve_landmarks bundle using ApplyTransformToPoints API to transform landmarks.

https://github.com/Project-MONAI/model-zoo/tree/dev/models/valve_landmarks

https://github.com/Project-MONAI/MONAI/blob/dev/monai/transforms/utility/array.py#L1729

@KumoLiu
Copy link
Collaborator Author

KumoLiu commented Sep 9, 2024

Hi @ericspod, could you please help take a look at this bundle whether compatible with the new API ApplyTransformToPoints we introduced in the core? Perhaps you can also include this example in your geometric pre in MONAI Day?

@ericspod
Copy link
Member

ericspod commented Sep 9, 2024

I think it would be a large amount of re-engineering to use the current API as it is. The way this bundle worked was to represent landmarks as labeled pixels in 2D images, these would be augmented in ways which didn't modify or delete these pixels such that they could be converted into 2D coordinates at the end of the transform sequence. Landmarks are all in image space as a result, and the images themselves have no spatial information as stored in the dataset.

What I had felt was important about this bundle was that it used transforms to do random deformation of the image and had to do some manipulation of the landmark data to maintain the correspondence between original image and landmark image. This and other transforms would be better implemented with proper augmentation transforms that we will implement for dealing with geometric data, however we don't have those yet so I don't feel modifying this bundle is worthwhile currently. Once we do the plan would be to change this bundle to store landmarks as 2D coordinates instead, use augmentations to manipulate image and point data together, and store results in either image or world space coordinates.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants