Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docker container #8

Open
FlorianMF opened this issue Jun 21, 2021 · 3 comments
Open

Docker container #8

FlorianMF opened this issue Jun 21, 2021 · 3 comments

Comments

@FlorianMF
Copy link
Contributor

I think it would be great for users and for developers to be able to easily share their dashboard or run it in production without deploying via Streamlit.
I could add a simple Dockerfile wrapping everything up into a container.

Torchserve-Dashbord would be to Torchserve what MongoExpress is to MongoDB.
Thoughts?

@cceyda
Copy link
Owner

cceyda commented Jun 21, 2021

I can't give any production ready guarantees 😅 but a basic setup
probably do something easily building on top of official containers https://hub.docker.com/r/pytorch/torchserve like this;
pseudo dockerfile:

FROM pytorch/torchserve:latest-gpu #pick a base image
RUN pip install torchserve-dashboard
#COPY config file
#COPY model files

EXPOSE 8080,8501 #expose prediction and/or dashboard

ENTRYPOINT ["/usr/local/bin/entrypoint.sh"] #entrypoint would start dashboard

One thing I would like to clarify is Management Dashboard is for an Admin user only and exposed ports should be secured with such privileges.

@FlorianMF
Copy link
Contributor Author

I'll give this a shot in the next days.
We can easily have a cpu and a gpu version.

I think for the beginning user rights might be a bit complicated to set up.
But that definitely is an interesting feature.

@ShuAiii
Copy link

ShuAiii commented Dec 17, 2022

any updates on this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants