Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: S3 batch storage #1087

Merged
merged 28 commits into from
Nov 17, 2022
Merged
Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
1894f39
Added PyFilesystem/s3fs as an optional dependency
jamielxcarter Oct 14, 2022
3713157
Test s3 protocol
jamielxcarter Oct 19, 2022
af2844e
Add dummy credentials to storage test
jamielxcarter Oct 19, 2022
d95cea3
Add fs-s3fs to support nox tests
jamielxcarter Oct 19, 2022
a771504
Merge branch 'main' into s3-batch-storage
jamielxcarter Oct 19, 2022
83cddcd
Shortening s3fs extras name to s3
jamielxcarter Oct 19, 2022
4cc2ed0
Include s3 extra instead of fs-s3fs directly
jamielxcarter Oct 19, 2022
55f465e
importlib-metadata 5.0.0 deprecated endpoint.
jamielxcarter Oct 19, 2022
75b187e
Merge branch 'main' into s3-batch-storage
jamielxcarter Oct 19, 2022
deec62b
Add s3 extra to cookiecutter toml, update docs
jamielxcarter Oct 28, 2022
5620359
Merge branch 'main' into s3-batch-storage
jamielxcarter Oct 28, 2022
419ba79
Mypy python 3.8 fix
jamielxcarter Nov 2, 2022
82f5fe8
Merge branch 'main' into s3-batch-storage
jamielxcarter Nov 2, 2022
ab4df4b
Sync versions
jamielxcarter Nov 7, 2022
607b815
Merge branch 'main' into s3-batch-storage
jamielxcarter Nov 7, 2022
4fd0e76
Add S3 extra to target cookiecutter
jamielxcarter Nov 8, 2022
9d610dd
Update SDK minor version in cookiecutter
jamielxcarter Nov 8, 2022
4e416b5
Merge branch 'main' into s3-batch-storage
jamielxcarter Nov 8, 2022
ae4c8e9
Merge branch 'main' into s3-batch-storage
jamielxcarter Nov 9, 2022
e2dcbb7
re-lock dependencies
jamielxcarter Nov 9, 2022
62bd670
Merge branch 'main' into s3-batch-storage
jamielxcarter Nov 9, 2022
54c5b46
Merge branch 'main' into s3-batch-storage
jamielxcarter Nov 10, 2022
1883033
Merge branch 'main' into s3-batch-storage
jamielxcarter Nov 14, 2022
e4fede2
Merge branch 'main' into s3-batch-storage
jamielxcarter Nov 14, 2022
5773a5b
Merge branch 'main' into s3-batch-storage
jamielxcarter Nov 16, 2022
febb1ea
Make explicit extra for s3 dependencies
jamielxcarter Nov 16, 2022
4c33cf8
Merge branch 'main' into s3-batch-storage
jamielxcarter Nov 16, 2022
ef9cfcd
Merge branch 'main' into s3-batch-storage
jamielxcarter Nov 16, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions noxfile.py
Original file line number Diff line number Diff line change
Expand Up @@ -69,6 +69,7 @@ def tests(session: Session) -> None:
"flake8-annotations",
"flake8-docstrings",
"mypy",
"fs-s3fs",
edgarrmondragon marked this conversation as resolved.
Show resolved Hide resolved
)

try:
Expand Down
Loading