Skip to content

chrishkchris/singa-ps

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

How to configure singa-ps?
1. make mxnet into "mxnet/lib/libmxnet.so"
2. copy "mxnet/lib/libmxnet.so" into "mxnet/python/mxnet"
1. copy the folder "mxnet/python/mxnet" into the working directory.
2. copy "singa_kvstore.py" and "SingaOpt.py" into the working directory.

How to use singa-ps?  
1. import singa_kvstore;

2. create kvstore for ps;
   For example:
   #------------------------start example------------------------------------------------------------------
   kv_type = 'dist_sync' # set synchronization mode, e.g., 'dist_async','dist_sync'
   kv = singa_kvstore.create_kvstore(kv_type,
                                     'SingaSGD', # set other options, like 'sgd','adam', can use mxnet optimizer
                                     lr=0.005, 
                                     momentum=0.9, 
                                     weight_decay=1e-5)
   #------------------------end example--------------------------------------------------------------------

3. use kvstore to update parameters after the loss is computed;
   For example:
   #------------------------start example------------------------------------------------------------------
   singa_kvstore.backward_and_update(kv,loss)
   #------------------------end example--------------------------------------------------------------------

(mnist_cnn.py is a detailed example)

About

integrate ps with singa

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages