Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation module (+ code for training/eval FeatureFlow) #5

Open
wants to merge 36 commits into
base: main
Choose a base branch
from

Conversation

giorgiapitteri
Copy link
Collaborator

@giorgiapitteri giorgiapitteri commented Jun 20, 2024

PR for two main features:

Plots saved:

  • QQ plots
  • MNIST images obtained by sampled the base distribution
  • Function for ROC curvers implemented but not yet used.
  • Distribution of norms

Adressed Issues:

fariedabuzaid and others added 30 commits May 7, 2024 22:42
…able_layers the ones from the pretrained feature encoder.
…e to visualize the qqplots and the reconstructed images from the base distributions.
return data


def latent_radial_qqplot(models: Dict[str, Flow], data: datasets, n_samples, save_to=None):
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This function is similar to the one here: https://github.com/aai-institute/USFlows/blob/main/src/explib/visualization.py. However it has been modified to work with the FeatureFlow (even if the reconstruction process is not working properly).

plt.close()
return np.transpose(np_imgs, (1,2, 0))

def plot_digits(models: dict[str, Flow], n_samples=100, im_shape=(28, 28), save_to=None): #sqrtn: int
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This function is similar to the one in: https://github.com/aai-institute/USFlows/blob/main/src/explib/visualization.py. However the original function calls the nsample function that I couldn't find anywhere.

@giorgiapitteri giorgiapitteri changed the title DRAFT: Evaluation module (+ code for training/eval FeatureFlow) Evaluation module (+ code for training/eval FeatureFlow) Jun 21, 2024
@giorgiapitteri giorgiapitteri marked this pull request as ready for review June 21, 2024 08:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Base distribution ablation MNIST
3 participants