Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow experimentation script to take time parameter indicating how long to run (Experimentation.py) #114

Open
sidsen opened this issue Nov 28, 2017 · 0 comments

Comments

@sidsen
Copy link
Contributor

sidsen commented Nov 28, 2017

A user should be able to specify a given time budget for experimentation/tuning and the script should automatically adjust its work to honor that time budget. This requires some careful though/measurement/design. An initial plan could be:

  • Measure the time it takes for a single VW pass on the data (this might change depending on the parameters, however).
  • Divide up the time budget across the different experimentation areas (learning rate, regularization, feature interaction, estimators). Should the division be equal? Which areas matter more?
  • Report the total time taken and best set of parameters found so far.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant