Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

adds split_dataset utility #16398

Merged
merged 24 commits into from
May 9, 2022
Merged

adds split_dataset utility #16398

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
4c2d414
adds split_dataset utility to dataset_utils.py
prakashsellathurai Apr 11, 2022
231d90f
fixes random shuffle bug
prakashsellathurai Apr 11, 2022
a127de7
fixes dataset slicing errors
prakashsellathurai Apr 11, 2022
0ed4735
Merge branch 'keras-team:master' into master
prakashsellathurai Apr 12, 2022
b5bc434
adds test file and Bazel config for dataset_utils.py
prakashsellathurai Apr 13, 2022
f0e2159
add support for basic dataset inputs
prakashsellathurai Apr 13, 2022
aa102b3
adds support for list/tuples of arrays with tests
prakashsellathurai Apr 13, 2022
f6a1bda
update dataset_utils.py
prakashsellathurai Apr 13, 2022
2c6d7b6
Merge branch 'keras-team:master' into master
prakashsellathurai Apr 14, 2022
6937c38
adds support for batched list/tuples from batched tf dataset
prakashsellathurai Apr 14, 2022
f5dcdb6
renames tests with common convention
prakashsellathurai Apr 15, 2022
60d220f
adds testcases for iregualrity and improves Exception message
prakashsellathurai Apr 15, 2022
7289746
fixes bug in iterating tuple of np arrays with mismatching shapes an…
prakashsellathurai Apr 16, 2022
56b75d0
adds test case for fractional size with tuple of numpy arrays in diff…
prakashsellathurai Apr 18, 2022
a95a2af
update dataset_utils.py and dataset_utils_test.py
prakashsellathurai Apr 18, 2022
607e3f0
adds doc string to functions
prakashsellathurai Apr 19, 2022
4613009
adds assertRaisesregex tests
prakashsellathurai Apr 19, 2022
9e0c0ee
adds support to batched/unbatched dicts of tf datasets
prakashsellathurai Apr 19, 2022
3337f87
adds mnist dataset test case
prakashsellathurai Apr 19, 2022
dc2beed
adds testcase for tf dataset of vectors of different shapes
prakashsellathurai Apr 19, 2022
6fea634
Merge branch 'keras-team:master' into master
prakashsellathurai Apr 21, 2022
c3a27a6
fixed import random, removed keras import ,fixed grammer issues
prakashsellathurai Apr 22, 2022
4960f1e
fixed code formatting issues
prakashsellathurai Apr 22, 2022
28466bb
removed `data_size_warning_flag` reference from warning message
prakashsellathurai May 2, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 14 additions & 0 deletions keras/utils/BUILD
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -301,6 +301,20 @@ tf_py_test(
],
)

tf_py_test(
name = "dataset_utils_test",
size = "medium",
timeout = "moderate",
srcs = ["dataset_utils_test.py"],
python_version = "PY3",
deps = [
"//:expect_absl_installed",
"//:expect_numpy_installed",
"//:expect_tensorflow_installed",
"//keras",
],
)

tf_py_test(
name = "data_utils_test",
size = "medium",
Expand Down
1 change: 1 addition & 0 deletions keras/utils/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@
# pylint: disable=g-bad-import-order

from keras.utils.data_utils import get_file
from keras.utils.dataset_utils import split_dataset
from keras.utils.generic_utils import Progbar
from keras.utils.image_dataset import image_dataset_from_directory
from keras.utils.text_dataset import text_dataset_from_directory
Expand Down
Loading