Release 0.1.9 (cvat-ai#277)

* Rename 'openvino' plugin to 'openvino_plugin' (cvat-ai#205) Co-authored-by: Jihyeon Yi <[email protected]> * Make remap labels more accurate, allow explicit label deletion, add docs, update tests (cvat-ai#203) * Kate/handling multiple attributes and speed up detection split (cvat-ai#207) * better handling multi-attributes for classification_split * handling multi-attributes better for detection * bugfix in calculating required number of images for splitting 2 correct side effect of the changes for re-id split * allow multiple subsets with arbitrary names * rename _is_number to _is_float and improve it * Fix voc to coco example (cvat-ai#209) * Fix export filtering * update example in readme * Fix export filename for LabelMe format (cvat-ai#200) * change export filename for LabelMe format * Allow simple merge for datasets with no labels * Add a more complex test on relative paths * Support escaping in attributes * update changelog Co-authored-by: Maxim Zhiltsov <[email protected]> * split unlabeled data into subsets for task-specific splitters (cvat-ai#211) * split unlabeled data into subsets for classification, detection. for re-id, 'not-supported' subsets for this data * Fix image ext on saving in cvat format (cvat-ai#214) * fix image saving in cvat format * update changelog * Label "face" for bounding boxes in Wider Face (cvat-ai#215) * add face label * update changelog * Adding "difficult", "truncated", "occluded" attributes when converting to Pascal VOC if they are not present (cvat-ai#216) * remove check for 'difficult' attribute * remove check for 'truncated' and 'occluded' attributes * update changelog * Ignore empty lines in YOLO annotations (cvat-ai#221) * Ignore empty lines in yolo annotations * Add type hints for image class, catch image opening errors in image.size * update changelog * Classification task in LFW dataset format (cvat-ai#222) * add classification * update changelog * update documentation * Add splitter for segmentation task (cvat-ai#223) * added segmentation_split * updated changelog * rename reidentification to reid * Support for CIFAR-10/100 format (cvat-ai#225) * add CIFAR dataset format * add CIFAR to documentation * update Changelog * add validation item for instance segmentation (cvat-ai#227) * add validation item for instance segmentation * Add panoptic and stuff COCO format (cvat-ai#210) * add coco stuff and panoptic formats * update CHANGELOG Co-authored-by: Maxim Zhiltsov <[email protected]> * update detection splitter algorithm from # of samples to # of instances (cvat-ai#235) * add documentation for validator (cvat-ai#233) * add documentation for validator * add validation item description (cvat-ai#237) * Fix converter for Pascal VOC format (cvat-ai#239) * User documentation for Pascal VOC format (cvat-ai#228) * add user documentation for Pascal VOC format * add integration tests * update changelog * Support for MNIST dataset format (cvat-ai#234) * add mnist format * add mnist csv format * add mnist to documentation * make formats docs folder, create COCO format documentation (cvat-ai#241) * Make formats docs folder, move format docs * Create COCO format documentation * Fixes in CIFAR dataset format (cvat-ai#243) * Add folder creation * Update changelog * Add user documentation file and integration tests for YOLO format (cvat-ai#246) * add user documentation file for yolo * add integraion tests * update user manual * update changelog * Add Cityscapes format (cvat-ai#249) * add cityscapes format * add format docs * update changelog * Fix saving attribute in WiderFace extractor (cvat-ai#251) * add fixes * update changelog * Fix spelling errors (cvat-ai#252) * Configurable Threshold CLI support (cvat-ai#250) * add validator cli * add configurable validator threshold * update changelog * CI. Move to GitHub actions. (cvat-ai#263) * Moving to GitHub Actions * Sending a coverage report if python3.6 (cvat-ai#264) * Rename workflows (cvat-ai#265) * Rename workflows * Update repo config and badge (cvat-ai#266) * Update PR template * Update build status badge * Fix deprecation warnings (cvat-ai#270) * Update RISE docs (cvat-ai#255) * Update rise docs * Update cli help * Pytest related changes (cvat-ai#248) * Tests moved to pytest. Updated CI. Updated requirements. * Updated contribution guide * Added annotations for tests * Updated tests * Added code style guide * Fix CI (cvat-ai#272) * Fix script call * change script call to binary call * Fix help program name, add mark_bug (cvat-ai#275) * Fix prog name * Add mark_bug test annotation * Fix labelmap parameter in CamVid (cvat-ai#262) * Fix labelmap parameter in camvid * Release 0.1.9 (dev) (cvat-ai#276) * Update version * Update changelog * Fix numpy conflict (cvat-ai#278) Co-authored-by: Emily Chun <[email protected]> Co-authored-by: Jihyeon Yi <[email protected]> Co-authored-by: Kirill Sizov <[email protected]> Co-authored-by: Anastasia Yasakova <[email protected]> Co-authored-by: Harim Kang <[email protected]> Co-authored-by: Zoya Maslova <[email protected]> Co-authored-by: Roman Donchenko <[email protected]> Co-authored-by: Seungyoon Woo <[email protected]> Co-authored-by: Dmitry Kruchinin <[email protected]> Co-authored-by: Slawomir Strehlke <[email protected]>
TOsmanov · Jun 3, 2021 · 057740e · 057740e
1 parent 25d459e
commit 057740e
Show file tree

Hide file tree

Showing 197 changed files with 8,057 additions and 1,403 deletions.
diff --git a/.github/pull_request_template.md b/.github/pull_request_template.md
@@ -24,17 +24,17 @@ not fully covered by unit tests or manual testing can be complicated. -->
   https://github.com/openvinotoolkit/datumaro/tree/develop/docs) accordingly
 - [ ] I have added tests to cover my changes
 - [ ] I have [linked related issues](
-  https://help.github.com/en/github/managing-your-work-on-github/linking-a-pull-request-to-an-issue#linking-a-pull-request-to-an-issue-using-a-keyword))
+  https://help.github.com/en/github/managing-your-work-on-github/linking-a-pull-request-to-an-issue#linking-a-pull-request-to-an-issue-using-a-keyword)
 
 ### License
 
 - [ ] I submit _my code changes_ under the same [MIT License](
-  https://github.com/opencv/cvat/blob/develop/LICENSE) that covers the project.
+  https://github.com/openvinotoolkit/datumaro/blob/develop/LICENSE) that covers the project.
   Feel free to contact the maintainers if that's a concern.
 - [ ] I have updated the license header for each file (see an example below)
 
 ```python
-# Copyright (C) 2020 Intel Corporation
+# Copyright (C) 2021 Intel Corporation
 #
 # SPDX-License-Identifier: MIT
 ```
diff --git a/.github/workflows/health_check.yml b/.github/workflows/health_check.yml
@@ -0,0 +1,30 @@
+name: Build
+on:
+  push:
+    branches:
+      - 'develop'
+jobs:
+  coverage_tests_on_python:
+    strategy:
+      fail-fast: false
+      matrix:
+        python-version: ['3.6', '3.7', '3.8', '3.9']
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v2
+      - name: Installing python
+        uses: actions/setup-python@v2
+        with:
+          python-version: ${{ matrix.python-version }}
+      - name: Installing dependencies
+        run: |
+          pip install tensorflow pytest pytest-cov
+          pip install -e ./
+      - name: Code instrumentation
+        run: |
+          pytest -v --cov --cov-report xml:coverage.xml
+          datum -h
+      - name: Sending coverage results
+        if: matrix.python-version == '3.6'
+        run: |
+          bash <(curl -Ls https://coverage.codacy.com/get.sh) report -r coverage.xml -t ${{ secrets.CODACY_PROJECT_TOKEN }}
diff --git a/.github/workflows/pr_checks.yml b/.github/workflows/pr_checks.yml
@@ -0,0 +1,29 @@
+name: CI
+on:
+  push:
+    branches:
+      - 'master'
+  pull_request:
+    branches:
+      - '*'
+jobs:
+  build_and_tests_on_python:
+    strategy:
+      fail-fast: false
+      matrix:
+        python-version: ['3.6', '3.7', '3.8', '3.9']
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v2
+      - name: Installing python
+        uses: actions/setup-python@v2
+        with:
+          python-version: ${{ matrix.python-version }}
+      - name: Installing dependencies
+        run: |
+          pip install tensorflow pytest
+          pip install -e ./
+      - name: Unit testing
+        run: |
+          pytest -v
+          datum -h
diff --git a/.gitignore b/.gitignore
@@ -54,4 +54,7 @@ coverage.xml
 cover/
 
 # Sphinx documentation
-docs/_build/
+docs/_build/
+
+#Pycharm config files
+.idea/
diff --git a/.travis.yml b/.travis.yml
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -6,6 +6,45 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
 
+## 03/06/2021 - Release v0.1.9
+### Added
+- Support for escaping in attribute values in LabelMe format (<https://github.com/openvinotoolkit/datumaro/issues/49>)
+- Support for Segmentation Splitting (<https://github.com/openvinotoolkit/datumaro/pull/223>)
+- Support for CIFAR-10/100 dataset format (<https://github.com/openvinotoolkit/datumaro/pull/225>, <https://github.com/openvinotoolkit/datumaro/pull/243>)
+- Support for COCO panoptic and stuff format (<https://github.com/openvinotoolkit/datumaro/pull/210>)
+- Documentation file and integration tests for Pascal VOC format (<https://github.com/openvinotoolkit/datumaro/pull/228>)
+- Support for MNIST and MNIST in CSV dataset formats (<https://github.com/openvinotoolkit/datumaro/pull/234>)
+- Documentation file for COCO format (<https://github.com/openvinotoolkit/datumaro/pull/241>)
+- Documentation file and integration tests for YOLO format (<https://github.com/openvinotoolkit/datumaro/pull/246>)
+- Support for Cityscapes dataset format (<https://github.com/openvinotoolkit/datumaro/pull/249>)
+- Support for Validator configurable threshold (<https://github.com/openvinotoolkit/datumaro/pull/250>)
+
+### Changed
+- LabelMe format saves dataset items with their relative paths by subsets without changing names (<https://github.com/openvinotoolkit/datumaro/pull/200>)
+- Allowed arbitrary subset count and names in classification and detection splitters (<https://github.com/openvinotoolkit/datumaro/pull/207>)
+- Annotation-less dataset elements are now participate in subset splitting (<https://github.com/openvinotoolkit/datumaro/pull/211>)
+- Classification task in LFW dataset format (<https://github.com/openvinotoolkit/datumaro/pull/222>)
+- Testing is now performed with pytest instead of unittest (<https://github.com/openvinotoolkit/datumaro/pull/248>)
+
+### Deprecated
+-
+
+### Removed
+-
+
+### Fixed
+- Added support for auto-merging (joining) of datasets with no labels and having labels (<https://github.com/openvinotoolkit/datumaro/pull/200>)
+- Allowed explicit label removal in `remap_labels` transform (<https://github.com/openvinotoolkit/datumaro/pull/203>)
+- Image extension in CVAT format export (<https://github.com/openvinotoolkit/datumaro/pull/214>)
+- Added a label "face" for bounding boxes in Wider Face (<https://github.com/openvinotoolkit/datumaro/pull/215>)
+- Allowed adding "difficult", "truncated", "occluded" attributes when converting to Pascal VOC if these attributes are not present (<https://github.com/openvinotoolkit/datumaro/pull/216>)
+- Empty lines in YOLO annotations are ignored (<https://github.com/openvinotoolkit/datumaro/pull/221>)
+- Export in VOC format when no image info is available (<https://github.com/openvinotoolkit/datumaro/pull/239>)
+- Fixed saving attribute in WiderFace extractor (<https://github.com/openvinotoolkit/datumaro/pull/251>)
+
+### Security
+-
+
 ## 31/03/2021 - Release v0.1.8
 ### Added
 -
@@ -139,7 +178,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 ### Added
 - `CamVid` dataset format (<https://github.com/openvinotoolkit/datumaro/pull/57>)
 - Ability to install `opencv-python-headless` dependency with `DATUMARO_HEADLESS=1`
-  enviroment variable instead of `opencv-python` (<https://github.com/openvinotoolkit/datumaro/pull/62>)
+  environment variable instead of `opencv-python` (<https://github.com/openvinotoolkit/datumaro/pull/62>)
 
 ### Changed
 - Allow empty supercategory in COCO (<https://github.com/openvinotoolkit/datumaro/pull/54>)