Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

build(deps): update datasets requirement from <=2.13.1,>1.16.1 to >1.16.1,<=2.16.0 in /requirements #40

Conversation

dependabot[bot]
Copy link

@dependabot dependabot bot commented on behalf of github Dec 25, 2023

Updates the requirements on datasets to permit the latest version.

Release notes

Sourced from datasets's releases.

2.16.0

Security features

  • Add trust_remote_code argument by @​lhoestq in huggingface/datasets#6429
    • Some Hugging Face datasets contain custom code which must be executed to correctly load the dataset. The code can be inspected in the repository content at https://hf.co/datasets/<repo_id>. A warning is shown to let the user know about the custom code, and they can avoid this message in future by passing the argument trust_remote_code=True.
    • Passing trust_remote_code=True will be mandatory to load these datasets from the next major release of datasets.
    • Using the environment variable HF_DATASETS_TRUST_REMOTE_CODE=0 you can already disable custom code by default without waiting for the next release of datasets
  • Use parquet export if possible by @​lhoestq in huggingface/datasets#6448
    • This allows loading most old datasets based on custom code by downloading the Parquet export provided by Hugging Face
    • You can see a dataset's Parquet export at https://hf.co/datasets/<repo_id>/tree/refs%2Fconvert%2Fparquet

Features

  • Webdataset dataset builder by @​lhoestq in huggingface/datasets#6391
  • Implement get dataset default config name by @​albertvillanova in huggingface/datasets#6511
  • Lazy data files resolution and offline cache reload by @​lhoestq in huggingface/datasets#6493
    • This speeds up the load_dataset step that lists the data files of big repositories (up to x100) but requires huggingface_hub 0.20 or newer
    • Fix load_dataset that used to reload data from cache even if the dataset was updated on Hugging Face
    • Reload a dataset from your cache even if you don't have internet connection
    • New cache directory scheme for no-script datasets: ~/.cache/huggingface/datasets/username___dataset_name/config_name/version/commit_sha
    • Backward comaptibility: cached datasets from datasets 2.15 (using the old scheme) are still reloaded from cache

General improvements and bug fixes

... (truncated)

Commits

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Updates the requirements on [datasets](https://github.com/huggingface/datasets) to permit the latest version.
- [Release notes](https://github.com/huggingface/datasets/releases)
- [Commits](huggingface/datasets@2.0.0...2.16.0)

---
updated-dependencies:
- dependency-name: datasets
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot added the enhancement New feature or request label Dec 25, 2023
Copy link
Author

dependabot bot commented on behalf of github Dec 25, 2023

Dependabot tried to add @aniketmaurya/engs as a reviewer to this PR, but received the following error from GitHub:

POST https://api.github.com/repos/aniketmaurya/lightning-flash/pulls/40/requested_reviewers: 422 - Reviews may only be requested from collaborators. One or more of the teams you specified is not a collaborator of the aniketmaurya/lightning-flash repository. // See: https://docs.github.com/rest/pulls/review-requests#request-reviewers-for-a-pull-request

Copy link

codecov bot commented Dec 25, 2023

Codecov Report

Merging #40 (9adff9e) into master (5b4003b) will decrease coverage by 28%.
The diff coverage is n/a.

Additional details and impacted files
@@           Coverage Diff            @@
##           master     #40     +/-   ##
========================================
- Coverage      85%     58%    -28%     
========================================
  Files         291     291             
  Lines       12856   12856             
========================================
- Hits        10983    7411   -3572     
- Misses       1873    5445   +3572     

Copy link
Author

dependabot bot commented on behalf of github Jan 1, 2024

Superseded by #43.

@dependabot dependabot bot closed this Jan 1, 2024
@dependabot dependabot bot deleted the dependabot-pip-requirements-datasets-gt-1.16.1-and-lte-2.16.0 branch January 1, 2024 13:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants