Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get rid of requirement for augmentation factor #64

Open
gngdb opened this issue Feb 20, 2015 · 3 comments
Open

Get rid of requirement for augmentation factor #64

gngdb opened this issue Feb 20, 2015 · 3 comments

Comments

@gngdb
Copy link
Member

gngdb commented Feb 20, 2015

Had to have an augmentation factor to know how to build the empty array before iterating over images. Unfortunately, that means it has to be written into the run settings by hand. There's no point in doing this though, because we could have a function to estimate by running the processing function over a test image (just a np.zeros 2D array) and seeing how many images result. This would also be more robust, because it wouldn't rely on people calculating the augmentation factor correctly.

@gngdb gngdb added this to the General Code Improvement milestone Feb 20, 2015
@gngdb gngdb added the ready label Feb 20, 2015
@scottclowe
Copy link
Member

However, if we were using a subsample of a very large augmentation space (sampled probabilistically) we would definitely need to know the augmentation factor. Without it we wouldn't know when to stop generating training images.

@gngdb
Copy link
Member Author

gngdb commented Feb 22, 2015

Yeah, I'm not sure how that works. The docs for Pylearn2 say they support drawing samples from some "infinite stream", but I don't know how they decide when an epoch is done in that case (how can you run through the entire dataset if it's an infinite stream?). So then we'll have to figure out how they do and the augmentation factor may matter or may not. I have no idea.

@gngdb
Copy link
Member Author

gngdb commented Mar 10, 2015

Online augmented datasets are now preferred and don't require this.

@gngdb gngdb added wontfix and removed ready labels Mar 10, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants