Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Figma design for condition balance check #2088

Open
amurphy-cl opened this issue Oct 31, 2024 · 0 comments
Open

Figma design for condition balance check #2088

amurphy-cl opened this issue Oct 31, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request ui change UI changes

Comments

@amurphy-cl
Copy link
Collaborator

amurphy-cl commented Oct 31, 2024

This is for a new feature in the Data tab of experiments.

This feature design should be represented in the redesigned UI (not the old experiment design)

When the end user clicks on the Data tab, there should be a button or other UI element that runs the condition balance check (i.e. a chi-squared statistical test). If it returns a result that indicates that the probability of the condition assignment is unbalanced and not due to chance, it displays a warning message.

Warning message text should be brief, e.g. "The actual condition assignment doesn’t match the experiment design. Debugging recommended." (maybe we want to be stronger with language here)

Optional future case: history/audit log of times the test was run

Relevant paper:
sequential chi-squared.pdf

@amurphy-cl amurphy-cl added enhancement New feature or request ui change UI changes labels Oct 31, 2024
@amurphy-cl amurphy-cl added this to the Program Increment PI14 milestone Oct 31, 2024
@amurphy-cl amurphy-cl moved this from Refined ToDo to In Progress in UpGrade Project Dec 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request ui change UI changes
Projects
Status: In Progress
Development

No branches or pull requests

2 participants