Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add python notebook support #3

Merged
merged 2 commits into from
May 18, 2017
Merged

Conversation

SeaOfOcean
Copy link
Contributor

preprocess in python
reuse model.Predict in notebook

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
@zhichao-li
Copy link
Contributor

Roughly the pipeline of prediction looks good. One thing I can think of is those meta&label info can be store into an metaRDD and then post-processing like resultRDD.zip(metaRDD).map(postprocessing) in case the data is too large to pull back to driver.
but my other concerns is not sure what's behavior of zip when resultRDD and the metaRDD have the same elements but with different partitions. Maybe we can use dataframe or RDD[(img, meta)] as a safe alternatives.

@zhichao-li
Copy link
Contributor

val prediction = ssdmodel.predict(imgs.map(_.img))
val predictionAndMeta = prediction.zip(imgs.map(_.meta)) 
predictionAndMeta.map((img, meta) => postprocessing)```

@SeaOfOcean
Copy link
Contributor Author

@SeaOfOcean SeaOfOcean merged commit d26dc50 into intel:master May 18, 2017
@SeaOfOcean SeaOfOcean deleted the notebook branch November 1, 2017 08:00
glorysdj pushed a commit that referenced this pull request May 8, 2018
* more torch layers

* update

* python wrapper

* update alias

* style
Litchilitchy pushed a commit that referenced this pull request Oct 10, 2019
shanyu-sys pushed a commit to shanyu-sys/analytics-zoo that referenced this pull request Jun 10, 2020
dding3 pushed a commit to dding3/analytics-zoo that referenced this pull request Jul 19, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
dding3 pushed a commit to dding3/analytics-zoo that referenced this pull request Jul 26, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
dding3 pushed a commit to dding3/analytics-zoo that referenced this pull request Jul 27, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
dding3 pushed a commit to dding3/analytics-zoo that referenced this pull request Jul 30, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
dding3 pushed a commit to dding3/analytics-zoo that referenced this pull request Aug 7, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
dding3 pushed a commit to dding3/analytics-zoo that referenced this pull request Aug 9, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
dding3 pushed a commit to dding3/analytics-zoo that referenced this pull request Aug 9, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
Le-Zheng pushed a commit to Le-Zheng/analytics-zoo that referenced this pull request Sep 2, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
Le-Zheng pushed a commit to Le-Zheng/analytics-zoo that referenced this pull request Sep 2, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
Le-Zheng pushed a commit to Le-Zheng/analytics-zoo that referenced this pull request Sep 3, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
Le-Zheng pushed a commit to Le-Zheng/analytics-zoo that referenced this pull request Sep 3, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
Le-Zheng pushed a commit to Le-Zheng/analytics-zoo that referenced this pull request Sep 4, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
Le-Zheng pushed a commit to Le-Zheng/analytics-zoo that referenced this pull request Sep 7, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
Le-Zheng pushed a commit to Le-Zheng/analytics-zoo that referenced this pull request Sep 7, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
Le-Zheng pushed a commit to Le-Zheng/analytics-zoo that referenced this pull request Sep 8, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
Le-Zheng pushed a commit to Le-Zheng/analytics-zoo that referenced this pull request Sep 9, 2021
* more torch layers

* update

* python wrapper

* update alias

* style
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants