Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor component package #654

Conversation

mrchtr
Copy link
Contributor

@mrchtr mrchtr commented Nov 21, 2023

Refactor component package as part of #643

@mrchtr mrchtr requested a review from RobbeSneyders November 21, 2023 13:53
Copy link
Member

@RobbeSneyders RobbeSneyders left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @mrchtr!
Just a quick partial review. I'll need to take my time to dive a bit deeper to review with Dask performance in mind.

src/fondant/component/data_io.py Outdated Show resolved Hide resolved
src/fondant/component/data_io.py Show resolved Hide resolved
src/fondant/component/data_io.py Outdated Show resolved Hide resolved
src/fondant/component/data_io.py Outdated Show resolved Hide resolved
src/fondant/component/data_io.py Show resolved Hide resolved
src/fondant/component/executor.py Outdated Show resolved Hide resolved
@mrchtr mrchtr linked an issue Nov 22, 2023 that may be closed by this pull request
@mrchtr mrchtr force-pushed the feautre/refactore-component-package branch from 46e2219 to d2182a0 Compare November 22, 2023 13:12
Base automatically changed from feature/implement-new-dataset-format to feature/redesign-dataset-format-and-interface November 23, 2023 09:37
@RobbeSneyders
Copy link
Member

I merged the base branch into this one so we can review @mrchtr. Please double check that I did it correctly :)

Copy link
Member

@RobbeSneyders RobbeSneyders left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we keep any changes related to the changed interface out of this PR and in #665? It's a bit hard to keep track otherwise.

src/fondant/component/component.py Outdated Show resolved Hide resolved
src/fondant/component/data_io.py Outdated Show resolved Hide resolved
src/fondant/component/data_io.py Outdated Show resolved Hide resolved
src/fondant/component/data_io.py Outdated Show resolved Hide resolved
src/fondant/component/data_io.py Outdated Show resolved Hide resolved
src/fondant/component/executor.py Show resolved Hide resolved
@mrchtr mrchtr force-pushed the feautre/refactore-component-package branch 2 times, most recently from 734526b to d2182a0 Compare November 23, 2023 12:13
Copy link
Member

@RobbeSneyders RobbeSneyders left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @mrchtr! Good to go!

@RobbeSneyders RobbeSneyders merged commit 3576e3f into feature/redesign-dataset-format-and-interface Nov 23, 2023
1 of 5 checks passed
@RobbeSneyders RobbeSneyders deleted the feautre/refactore-component-package branch November 23, 2023 13:47
RobbeSneyders added a commit that referenced this pull request Nov 24, 2023
Refactor component package as part of #643

---------

Co-authored-by: Robbe Sneyders <[email protected]>
Co-authored-by: Philippe Moussalli <[email protected]>
RobbeSneyders added a commit that referenced this pull request Nov 27, 2023
Refactor component package as part of #643

---------

Co-authored-by: Robbe Sneyders <[email protected]>
Co-authored-by: Philippe Moussalli <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Update component package
3 participants