Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stream-based Pipeline & Plugins #571

Closed
1 task
WenheLI opened this issue Sep 8, 2020 · 2 comments
Closed
1 task

Stream-based Pipeline & Plugins #571

WenheLI opened this issue Sep 8, 2020 · 2 comments
Assignees
Labels
pipeline Idea and discussion to create a pipeline for something

Comments

@WenheLI
Copy link
Collaborator

WenheLI commented Sep 8, 2020

We have implemented a steam-based pipeline for tensorflow-image classification, and we got a huge performance boost in terms of execution time (see #410 )

We should also modify the rest of plugins here:

- [ ] [pipcook-plugin-tensorflow-image-generation-model-train](https://github.com/imgcook/pipcook-plugin-tensorflow-image-generation-model-train) (use batch)
@WenheLI WenheLI added the pipeline Idea and discussion to create a pipeline for something label Sep 8, 2020
@WenheLI WenheLI changed the title Stream-based Dataloader Stream-based Pipeline & Plugins Sep 8, 2020
@ZijinGao
Copy link
Contributor

Hi! I'm interested in contributing to the pipcook-plugin-tensorflow-bert-ner-model-train plugin. Would like to know it in details.

@FeelyChau FeelyChau mentioned this issue Sep 21, 2020
16 tasks
@FeelyChau
Copy link
Collaborator

In v2, all the scripts are stream-based. This issue is not applicable anymore. Closed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pipeline Idea and discussion to create a pipeline for something
Projects
None yet
Development

No branches or pull requests

3 participants