Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Outreachy applications] Comparing test sample classifications between models #9

Closed
dzeber opened this issue Mar 4, 2020 · 1 comment · Fixed by #82
Closed

[Outreachy applications] Comparing test sample classifications between models #9

dzeber opened this issue Mar 4, 2020 · 1 comment · Fixed by #82

Comments

@dzeber
Copy link
Contributor

dzeber commented Mar 4, 2020

To delve further into model performance comparisons, it would be interesting to compare the classification results (ie. predicted probabilities) for individual datapoints. This would also help to understand misclassifications.

Develop a visualization to compare predicted class probabilities across models for binary classifiers. For example, this could present a histogram of the difference in predicted probabilities between the two models across all training samples. Misclassifications under either model could also be split out.
KaairaGupta added a commit to KaairaGupta/PRESC that referenced this issue Mar 9, 2020
@KaairaGupta
For mozilla#9: Comparing classification models
8b42686
@KaairaGupta KaairaGupta mentioned this issue Mar 9, 2020
Merged
KaairaGupta added a commit to KaairaGupta/PRESC that referenced this issue Mar 10, 2020
@KaairaGupta
For mozilla#9: Comparing classification models
66e4bba
@tab1tha
Copy link
Contributor

tab1tha commented Mar 17, 2020

I'm working on this.

@Sidrah-Madiha Sidrah-Madiha mentioned this issue Mar 18, 2020
Merged
@tab1tha tab1tha mentioned this issue Mar 25, 2020
Merged
@mlopatka mlopatka reopened this Mar 25, 2020
mlopatka pushed a commit that referenced this issue Mar 30, 2020
@KaairaGupta
For #9: Comparing test sample classifications b/w models (#33)
3c95605 
* For #9: Comparing classification models

* modified code and example for better understanding

* reformat compare_model_classification.py using black
@namrathagopalabhatla namrathagopalabhatla mentioned this issue Apr 2, 2020
Closed
@dzeber dzeber changed the title Comparing test sample classifications between models [Outreachy applications] Comparing test sample classifications between models Jul 14, 2020
@dzeber dzeber closed this as completed Jul 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[fixes # 9 ] Comparing test sample classifications between models Sidrah-Madiha/PRESC
3 participants
@dzeber @mlopatka @tab1tha