Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add classification and regression metrics #122

Closed
37 tasks done
msluszniak opened this issue Jun 26, 2023 · 6 comments
Closed
37 tasks done

Add classification and regression metrics #122

msluszniak opened this issue Jun 26, 2023 · 6 comments
Labels
help wanted Extra attention is needed

Comments

@msluszniak
Copy link
Contributor

msluszniak commented Jun 26, 2023

I want to add all the existing metrics which are present in Sci-kit Learn.

Classification Metrics

  • Accuracy
  • AUC
  • Average Precision (AP)
  • Balanced Accuracy
  • Brier Score Loss
  • Cohen Kappa Score
  • Confusion Matrix
  • Discounted Cumulative Gain (DCG)
  • Detection Error Tradeoff Curve (DET curve)
  • F1 Score
  • F-beta Score
  • Hamming Loss
  • Log Loss
  • Matthews correlation coefficient (MCC)
  • Normalized Discounted Cumulative Gain (Normalized DCG)
  • Precision Recall Curve
  • Precision Recall Fscore Support
  • Precision
  • Recall
  • ROC-AUC
  • ROC Curve
  • Top-k Accuracy Score
  • Zero-one Classification Loss

Regression Metrics

  • Explained Variance Score
  • Maximum Residual Error
  • Mean Absolute Error (MAE)
  • Mean Squared Error (MSE)
  • Mean Squared Log Error
  • Mean Absolute Percentage Error (MAPE)
  • $R^2$ Score
  • Mean Poisson deviance
  • Mean Gamma deviance
  • Mean Tweedie deviance
  • $D^2$ - Fraction of Tweedie Deviance Explained
  • Mean Pinball Loss
  • $D^2$ - Fraction of Pinball Loss Explained
  • $D^2$ - Fraction of Absolute Error Explained

We can do the same for distances after (look #149).

@josevalim josevalim changed the title Add all classification and regression metrics Add classification and regression metrics Jul 10, 2023
santiago-imelio added a commit to santiago-imelio/scholar that referenced this issue Jul 15, 2023
santiago-imelio added a commit to santiago-imelio/scholar that referenced this issue Jul 15, 2023
@msluszniak msluszniak added enhancement New feature or request help wanted Extra attention is needed labels Jul 17, 2023
@paulsullivanjr
Copy link
Contributor

I'd like to contribute to this project. I will start working on a PR for "Discounted Cumulative Gain (DCG)"

@msluszniak
Copy link
Contributor Author

I'd like to contribute to this project. I will start working on a PR for "Discounted Cumulative Gain (DCG)"

Really cool! Feel free to go :)

@paulsullivanjr
Copy link
Contributor

I have Normalized DCG in progress.

@JoaquinIglesiasTurina
Copy link
Contributor

I have mean pinball loss in progress.

@srzeszut
Copy link
Contributor

I am working with @ksew1 and @norm4nn on the remaining metrics.

@msluszniak
Copy link
Contributor Author

We added all metrics, thank all of you who contributed ❤️

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

5 participants