-
Notifications
You must be signed in to change notification settings - Fork 0
chrishkchris/singa-ps
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
How to configure singa-ps? 1. make mxnet into "mxnet/lib/libmxnet.so" 2. copy "mxnet/lib/libmxnet.so" into "mxnet/python/mxnet" 1. copy the folder "mxnet/python/mxnet" into the working directory. 2. copy "singa_kvstore.py" and "SingaOpt.py" into the working directory. How to use singa-ps? 1. import singa_kvstore; 2. create kvstore for ps; For example: #------------------------start example------------------------------------------------------------------ kv_type = 'dist_sync' # set synchronization mode, e.g., 'dist_async','dist_sync' kv = singa_kvstore.create_kvstore(kv_type, 'SingaSGD', # set other options, like 'sgd','adam', can use mxnet optimizer lr=0.005, momentum=0.9, weight_decay=1e-5) #------------------------end example-------------------------------------------------------------------- 3. use kvstore to update parameters after the loss is computed; For example: #------------------------start example------------------------------------------------------------------ singa_kvstore.backward_and_update(kv,loss) #------------------------end example-------------------------------------------------------------------- (mnist_cnn.py is a detailed example)
About
integrate ps with singa
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published