Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

s3 sync --size-only #473

Closed
ghost opened this issue Nov 6, 2013 · 3 comments
Closed

s3 sync --size-only #473

ghost opened this issue Nov 6, 2013 · 3 comments
Labels

Comments

@ghost
Copy link

ghost commented Nov 6, 2013

For the s3 sync command, if syncing from multiple sources to the same bucket, an option similar to --size-only in rsync to ignore time stamps and compare files only based on size would be extremely useful, as it would avoid having to put the same file just because of local time stamp differences.

@ghost
Copy link
Author

ghost commented Nov 9, 2013

To clarify my use case, I have multiple EC2 instances that generate files that need to be backed up on an s3 bucket. Often, the files generated by one instance are more or less the same as another's. Since the filename is the sha1 of the file contents, if the filename matches, the contents match too. Therefore, syncing up from an instance to the bucket, if a file with the same name already exists, there's no need to replace it and can be skipped. This can be easily achieved in rsync using the --size-only option, but this doesn't appear to be supported in s3 sync.

@rodriguezsergio
Copy link

👍

johnboxall pushed a commit to johnboxall/aws-cli that referenced this issue Mar 22, 2014
johnboxall pushed a commit to johnboxall/aws-cli that referenced this issue Mar 24, 2014
jamesls added a commit that referenced this issue Apr 4, 2014
* johnboxall-s3-size-only-compare:
  Implements #473, adding a `--size-only` param to `aws s3 sync`
@jamesls
Copy link
Member

jamesls commented Apr 4, 2014

This has been implemented in #719

@jamesls jamesls closed this as completed Apr 4, 2014
thoward-godaddy pushed a commit to thoward-godaddy/aws-cli that referenced this issue Feb 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants