Skip to content

Latest commit

 

History

History
119 lines (89 loc) · 6.34 KB

README.md

File metadata and controls

119 lines (89 loc) · 6.34 KB
Raw

kiosk-client

Build Status Coverage Status License PyPi Python Versions

kiosk-client is tool for interacting with the DeepCell Kiosk in order to create and monitor deep learning image processing jobs. It uses the asynchronous HTTP client treq and the Kiosk-Frontend API to create and monitor many jobs at once. Once all jobs are completed, costs are estimated by using the cluster's Grafana API. An output file is then generated with statistics on each job's performance and resulting output files.

This repository is part of the DeepCell Kiosk. More information about the Kiosk project is available through Read the Docs and our FAQ page.

Installation

Install with pip

pip install kiosk_client

Install from source

# clone the repository
git clone https://github.com/vanvalenlab/kiosk-client.git

# install the package
pip install kiosk-client

Usage

The only thing necessary to use the CLI is the image file to process, the type of job, and the IP address or FQDN of the DeepCell Kiosk.

python -m kiosk_client path/to/image.png \
  --job-type segmentation \
  --host 123.456.789.012

It is also possible to override the default model and post-processing function for a given job type.

python -m kiosk_client path/to/image.png \
  --job-type segmentation \
  --host 123.456.789.012 \
  --model ModelName:0 \
  --post deep_watershed

Benchmark Mode

The CLI can also be used to benchmark the cluster with high volume jobs. It is a prerequisite that the the FILE exist in the STORAGE_BUCKET inside UPLOAD_PREFIX (e.g. /uploads/image.png). There are also a number of other benchmarking options including --upload-results and --calculate_cost. A new job is created every START_DELAY seconds up to COUNT jobs. The upload time can be simulated by changing the start delay.

# from within the kiosk-client repository
python -m kiosk_client path/to/image.png \
  --job-type segmentation \
  --host 123.456.789.012 \
  --model ModelName:0 \
  --post deep_watershed \
  --start-delay 0.5 \
  --count 1000 \
  --calculate_cost \
  --upload-results

It is easiest to run a benchmarking job from within the DeepCell Kiosk.

Configuration

Each job can be configured using environmental variables in a .env file. Most of these environment variables can be overridden with command line options. Use python benchmarking --help for detailed list of options.

Name Description Default Value
JOB_TYPE REQUIRED: Name of job workflow. "segmentation"
API_HOST REQUIRED: Hostname and port for the kiosk-frontend API server. ""
STORAGE_BUCKET Cloud storage bucket address (e.g. "gs://bucket-name"). Required if using benchmark mode and upload-results. ""
MODEL Name and version of the model hosted by TensorFlow Serving (e.g. "modelname:0"). Overrides default model for the given JOB_TYPE "modelname:0"
SCALE Rescale data by this float value for model compatibility. 1
LABEL Integer value of label type. ""
PREPROCESS Name of the preprocessing function to use (e.g. "normalize"). ""
POSTPROCESS Name of the postprocessing function to use (e.g. "watershed"). ""
UPLOAD_PREFIX Prefix of upload directory in the cloud storage bucket. "/uploads"
UPDATE_INTERVAL Number of seconds a job should wait between sending status update requests to the server. 10
START_DELAY Number of seconds between submitting each new job. This can be configured to simulate upload latency. 0.05
MANAGER_REFRESH_RATE Number of seconds between completed job updates. 10
EXPIRE_TIME Completed jobs are expired after this many seconds. 3600
CONCURRENT_REQUESTS_PER_HOST Limit number of simultaneous requests to the server. 64
NUM_CYCLES Number of times to run the job. 1
NUM_GPUS Number of GPUs used during the run. Used for logging. 0
LOG_ENABLED Toggle for enabling/disabling logging. True
LOG_LEVEL Level of output for logging statements. "DEBUG"
LOG_FILE Filename of the log file. "benchmark.log"
GRAFANA_HOST Hostname of the Grafana server. "prometheus-operator-grafana"
GRAFANA_USER Username for the Grafana server. "admin"
GRAFANA_PASSWORD Password for the Grafana server. "prom-operator"

Google Cloud Authentication

When uploading to Google Cloud, you will need to authenticate using the GOOGLE_APPLICATION_CREDENTIALS set to your service account JSON file.

Contribute

We welcome contributions to the kiosk-console and its associated projects. If you are interested, please refer to our Developer Documentation, Code of Conduct and Contributing Guidelines.

License

This software is license under a modified Apache-2.0 license. See LICENSE for full details.

Copyright

Copyright © 2018-2020 The Van Valen Lab at the California Institute of Technology (Caltech), with support from the Paul Allen Family Foundation, Google, & National Institutes of Health (NIH) under Grant U24CA224309-01. All rights reserved.