Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OD metrics for CI #3269

Merged
merged 23 commits into from
Jul 9, 2024
Merged

OD metrics for CI #3269

merged 23 commits into from
Jul 9, 2024

Conversation

mariannaparzych
Copy link
Contributor

@mariannaparzych mariannaparzych commented Jun 21, 2024

OD metrics for CI

unstructured/metrics/evaluate.py Outdated Show resolved Hide resolved
unstructured/metrics/object_detection.py Show resolved Hide resolved
unstructured/metrics/object_detection.py Outdated Show resolved Hide resolved
unstructured/metrics/object_detection.py Outdated Show resolved Hide resolved
@mariannaparzych mariannaparzych marked this pull request as ready for review June 27, 2024 09:29
@mariannaparzych mariannaparzych changed the title WIP: Ml 89/od metrics ML-89/ML-148: OD metrics for CI Jul 3, 2024
Copy link
Contributor

@pawel-kmiecik pawel-kmiecik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM but as I've pushed few commits - let's have a second pair of eyes to look at this.

@mariannaparzych mariannaparzych changed the title ML-89/ML-148: OD metrics for CI OD metrics for CI Jul 8, 2024
Copy link
Contributor

@ds-filipknefel ds-filipknefel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mostly looking for clarification on slightly confusing code with paths, once these are addressed I'll re-review. Other suggestions optional.

Comment on lines +254 to +255
@click.option("--output_dir", type=str, help="Directory to structured output.")
@click.option("--source_dir", type=str, help="Directory to structured source.")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could use clicks Path type here for more control over the parameter's value e.g. only directory, existance

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

True but this should be applied to all ingest commands then - worth a separate PR.

unstructured/metrics/evaluate.py Show resolved Hide resolved
unstructured/metrics/evaluate.py Show resolved Hide resolved
unstructured/metrics/evaluate.py Outdated Show resolved Hide resolved
unstructured/metrics/evaluate.py Outdated Show resolved Hide resolved
unstructured/metrics/utils.py Outdated Show resolved Hide resolved
unstructured/metrics/evaluate.py Outdated Show resolved Hide resolved
unstructured/metrics/object_detection.py Outdated Show resolved Hide resolved
unstructured/metrics/object_detection.py Outdated Show resolved Hide resolved
unstructured/metrics/evaluate.py Outdated Show resolved Hide resolved
Copy link
Contributor

@ds-filipknefel ds-filipknefel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd put the note about stems in comment (as in line 687) rather then doc-string but LGTM

super().__post_init__()
self._document_paths = [
path.relative_to(self.documents_dir)
for path in self.documents_dir.rglob("analysis/*/layout_dump/object_detection.json")

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe this path should be declared in some common file.

@pawel-kmiecik pawel-kmiecik enabled auto-merge July 9, 2024 11:57
@pawel-kmiecik pawel-kmiecik added this pull request to the merge queue Jul 9, 2024
Merged via the queue into main with commit 176875b Jul 9, 2024
50 checks passed
@pawel-kmiecik pawel-kmiecik deleted the ML-89/od_metrics branch July 9, 2024 13:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants