Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature(zms): add new league middlewares and other models and tools. #458

Open
wants to merge 288 commits into
base: main
Choose a base branch
from
This pull request is big! We’re only showing the most recent 250 commits.

Commits on May 28, 2022

  1. change a bit

    hiha3456 committed May 28, 2022
    Configuration menu
    Copy the full SHA
    b404024 View commit details
    Browse the repository at this point in the history
  2. change a bit

    hiha3456 committed May 28, 2022
    Configuration menu
    Copy the full SHA
    ffcc50b View commit details
    Browse the repository at this point in the history
  3. change a bit

    hiha3456 committed May 28, 2022
    Configuration menu
    Copy the full SHA
    a55fe17 View commit details
    Browse the repository at this point in the history
  4. change a bit

    hiha3456 committed May 28, 2022
    Configuration menu
    Copy the full SHA
    8084dae View commit details
    Browse the repository at this point in the history
  5. change a bit

    hiha3456 committed May 28, 2022
    Configuration menu
    Copy the full SHA
    da46b22 View commit details
    Browse the repository at this point in the history
  6. change a bit

    hiha3456 committed May 28, 2022
    Configuration menu
    Copy the full SHA
    65b8762 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    ad9632c View commit details
    Browse the repository at this point in the history

Commits on May 30, 2022

  1. polish stdim & infonce loss

    lixl-st committed May 30, 2022
    Configuration menu
    Copy the full SHA
    192e6e4 View commit details
    Browse the repository at this point in the history
  2. polish EventEnum

    lixl-st committed May 30, 2022
    Configuration menu
    Copy the full SHA
    46ee7cf View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    654eb9f View commit details
    Browse the repository at this point in the history
  4. polish EventEnum

    lixl-st committed May 30, 2022
    Configuration menu
    Copy the full SHA
    48ddc09 View commit details
    Browse the repository at this point in the history
  5. simplify the code

    hiha3456 committed May 30, 2022
    Configuration menu
    Copy the full SHA
    474524e View commit details
    Browse the repository at this point in the history
  6. for multiple policies

    hiha3456 committed May 30, 2022
    Configuration menu
    Copy the full SHA
    9d91063 View commit details
    Browse the repository at this point in the history
  7. change a bit

    hiha3456 committed May 30, 2022
    Configuration menu
    Copy the full SHA
    6ca4ae2 View commit details
    Browse the repository at this point in the history
  8. fix style

    lixl-st committed May 30, 2022
    Configuration menu
    Copy the full SHA
    2d85ccf View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    157b9b3 View commit details
    Browse the repository at this point in the history
  10. fix codecov

    lixl-st committed May 30, 2022
    Configuration menu
    Copy the full SHA
    a13b5e6 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    9a25055 View commit details
    Browse the repository at this point in the history
  12. fix import

    lixl-st committed May 30, 2022
    Configuration menu
    Copy the full SHA
    ecd0119 View commit details
    Browse the repository at this point in the history
  13. add readme

    lixl-st committed May 30, 2022
    Configuration menu
    Copy the full SHA
    4d54abf View commit details
    Browse the repository at this point in the history
  14. drop useless codes

    hiha3456 committed May 30, 2022
    Configuration menu
    Copy the full SHA
    65525c1 View commit details
    Browse the repository at this point in the history
  15. change rolloutor

    hiha3456 committed May 30, 2022
    Configuration menu
    Copy the full SHA
    a1b0908 View commit details
    Browse the repository at this point in the history
  16. move on_league_job in call

    hiha3456 committed May 30, 2022
    Configuration menu
    Copy the full SHA
    68191a9 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2022

  1. change __call__

    hiha3456 committed May 31, 2022
    Configuration menu
    Copy the full SHA
    59f2a6e View commit details
    Browse the repository at this point in the history
  2. solve conflicts

    lixl-st committed May 31, 2022
    Configuration menu
    Copy the full SHA
    2010965 View commit details
    Browse the repository at this point in the history
  3. solve conflicts

    lixl-st committed May 31, 2022
    Configuration menu
    Copy the full SHA
    1382b7f View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b546f8a View commit details
    Browse the repository at this point in the history
  5. add league coordinator

    lixl-st committed May 31, 2022
    Configuration menu
    Copy the full SHA
    cfabb47 View commit details
    Browse the repository at this point in the history
  6. reformatting

    hiha3456 committed May 31, 2022
    Configuration menu
    Copy the full SHA
    0ff864d View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    4cf60f9 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    3e71184 View commit details
    Browse the repository at this point in the history
  9. Merge pull request opendilab#345 from lixl-st/dev-league-lxl

    feature(lxl): add league coordinator
    hiha3456 authored May 31, 2022
    Configuration menu
    Copy the full SHA
    3f0dcb6 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    6542a30 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    c7fac3f View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2022

  1. Configuration menu
    Copy the full SHA
    49ccd6c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6a2b76c View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    aeac530 View commit details
    Browse the repository at this point in the history
  4. polish league coordinator

    lixl-st committed Jun 1, 2022
    Configuration menu
    Copy the full SHA
    0cd0e1d View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    c0d5dd0 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    fe26bb3 View commit details
    Browse the repository at this point in the history
  7. polish league coordinator

    lixl-st committed Jun 1, 2022
    Configuration menu
    Copy the full SHA
    bd6395b View commit details
    Browse the repository at this point in the history
  8. Merge pull request opendilab#346 from lixl-st/dev-league-lxl

    polish(lxl): polish coordinator
    hiha3456 authored Jun 1, 2022
    Configuration menu
    Copy the full SHA
    f0601c6 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    465ce9b View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    7ff8a0a View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    a6e9343 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    8093b72 View commit details
    Browse the repository at this point in the history
  13. add locker and model_dict

    hiha3456 committed Jun 1, 2022
    Configuration menu
    Copy the full SHA
    83abc64 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    604ed59 View commit details
    Browse the repository at this point in the history
  15. debugging

    hiha3456 committed Jun 1, 2022
    Configuration menu
    Copy the full SHA
    2ad937d View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2022

  1. update quick colab link

    lixl-st authored Jun 2, 2022
    Configuration menu
    Copy the full SHA
    bfd149d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b13d49e View commit details
    Browse the repository at this point in the history
  3. drop commit "add BattleContext, policy_getter, policy_updater, modify…

    … policy_resetter", fix conflicts
    hiha3456 committed Jun 2, 2022
    Configuration menu
    Copy the full SHA
    1071dd1 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    310c279 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    d8a385d View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2022

  1. change variable names

    hiha3456 committed Jun 6, 2022
    Configuration menu
    Copy the full SHA
    0795098 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8d295c0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c4397b2 View commit details
    Browse the repository at this point in the history
  4. merge from dev-distar-learn

    lixl-st committed Jun 6, 2022
    Configuration menu
    Copy the full SHA
    d0df49e View commit details
    Browse the repository at this point in the history
  5. add league policy

    lixl-st committed Jun 6, 2022
    Configuration menu
    Copy the full SHA
    ab7b556 View commit details
    Browse the repository at this point in the history
  6. reformat

    lixl-st committed Jun 6, 2022
    Configuration menu
    Copy the full SHA
    1137a17 View commit details
    Browse the repository at this point in the history
  7. Merge pull request opendilab#349 from opendilab/main

    Merge the latest branch main to dev-distar
    hiha3456 authored Jun 6, 2022
    Configuration menu
    Copy the full SHA
    400fa60 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    e9d3b47 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2022

  1. add learner to test pipeline

    lixl-st committed Jun 7, 2022
    Configuration menu
    Copy the full SHA
    fd71c46 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2022

  1. Configuration menu
    Copy the full SHA
    77dc67e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f95113a View commit details
    Browse the repository at this point in the history
  3. change a bit rolloutor

    hiha3456 committed Jun 8, 2022
    Configuration menu
    Copy the full SHA
    7d5c112 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    bc8c332 View commit details
    Browse the repository at this point in the history
  5. change a bit

    hiha3456 committed Jun 8, 2022
    Configuration menu
    Copy the full SHA
    1078673 View commit details
    Browse the repository at this point in the history
  6. change a bit

    hiha3456 committed Jun 8, 2022
    Configuration menu
    Copy the full SHA
    d3fcc51 View commit details
    Browse the repository at this point in the history
  7. change variable name

    hiha3456 committed Jun 8, 2022
    Configuration menu
    Copy the full SHA
    0dc1c5f View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    5944584 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2022

  1. feature&optim(zzh): add DDPPO & add model-based SAC with lambda-retur…

    …n target & refactor MBRL pipeline (opendilab#332)
    
    * finish sac_nstep
    
    * draft ddppo
    
    * fix bugs
    
    * add multiprocessing
    
    * fix(jrn)
    
    * add configs
    
    add weight decay
    
    change from clip_norm to clip_value
    
    nan debug
    
    add 1e-6
    
    fix
    
    numericall stable logcosh
    
    delete debug mode
    
    * temp save
    
    * temp save
    
    * finish mbsac and (WIP) create world model interface
    
    * fix
    
    * fix
    
    * grad clip
    
    * save before refactor mbsac
    
    * draft complete
    
    * add stale files
    
    * add docstring&comments
    
    * delete stale pipelines; update new configs
    
    * delete stale files
    
    * fix eval_freq in config
    
    * fix bug in termination_fn
    
    * polish
    
    * polish 1.1
    
    * delete TanhTransform
    
    * polish 1.2
    
    * polish 1.3
    
    * fix test file name conflict
    
    * fix flake8 style
    
    * polish 1.4
    
    * polish 1.5
    
    * polish 1.6
    
    * polish 1.7
    
    * fix test_TanhTransform assertion
    
    * codecov
    
    * retrigger action
    ZHZisZZ authored and lixl-st committed Jun 9, 2022
    Configuration menu
    Copy the full SHA
    c171d59 View commit details
    Browse the repository at this point in the history
  2. add league learner

    lixl-st committed Jun 9, 2022
    Configuration menu
    Copy the full SHA
    2859423 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2aa05da View commit details
    Browse the repository at this point in the history
  4. solve conflicts

    lixl-st committed Jun 9, 2022
    Configuration menu
    Copy the full SHA
    2c46dbb View commit details
    Browse the repository at this point in the history
  5. change the distar_env to fit BaseEnvManager, write test_distar_env_wi…

    …th_manager.py to test. change config to get self-play
    hiha3456 committed Jun 9, 2022
    Configuration menu
    Copy the full SHA
    db3afc2 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2022

  1. arrage tests

    hiha3456 committed Jun 10, 2022
    Configuration menu
    Copy the full SHA
    3dc0b12 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9b4deaa View commit details
    Browse the repository at this point in the history
  3. make old test runnable

    hiha3456 committed Jun 10, 2022
    Configuration menu
    Copy the full SHA
    c65fecf View commit details
    Browse the repository at this point in the history
  4. change the distar_env to fit BaseEnvManager, write test_distar_env_wi…

    …th_manager.py to test. change config to get self-play
    hiha3456 committed Jun 10, 2022
    Configuration menu
    Copy the full SHA
    cd18955 View commit details
    Browse the repository at this point in the history
  5. arrage tests

    hiha3456 committed Jun 10, 2022
    Configuration menu
    Copy the full SHA
    6a3d433 View commit details
    Browse the repository at this point in the history
  6. make old test runnable

    hiha3456 committed Jun 10, 2022
    Configuration menu
    Copy the full SHA
    e3c95ff View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    34e6374 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2022

  1. Configuration menu
    Copy the full SHA
    8027760 View commit details
    Browse the repository at this point in the history
  2. change a bit DI-star env

    hiha3456 committed Jun 13, 2022
    Configuration menu
    Copy the full SHA
    cbe964c View commit details
    Browse the repository at this point in the history
  3. add mock policy

    lixl-st committed Jun 13, 2022
    Configuration menu
    Copy the full SHA
    fa07d12 View commit details
    Browse the repository at this point in the history
  4. reformat

    lixl-st committed Jun 13, 2022
    Configuration menu
    Copy the full SHA
    7ad26ef View commit details
    Browse the repository at this point in the history
  5. fix a bug

    hiha3456 committed Jun 13, 2022
    Configuration menu
    Copy the full SHA
    56ed8e1 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    b934260 View commit details
    Browse the repository at this point in the history
  7. Merge pull request opendilab#350 from lixl-st/dev-league-lxl

    feature(nyz, lxl): merge from dev-distar-learn
    hiha3456 authored Jun 13, 2022
    Configuration menu
    Copy the full SHA
    400a19d View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    e13a5f2 View commit details
    Browse the repository at this point in the history
  9. fix conflicts

    hiha3456 committed Jun 13, 2022
    Configuration menu
    Copy the full SHA
    3518a03 View commit details
    Browse the repository at this point in the history
  10. change mocks

    hiha3456 committed Jun 13, 2022
    Configuration menu
    Copy the full SHA
    9ae914a View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    2d050d3 View commit details
    Browse the repository at this point in the history
  12. change config

    hiha3456 committed Jun 13, 2022
    Configuration menu
    Copy the full SHA
    82af279 View commit details
    Browse the repository at this point in the history
  13. Merge pull request opendilab#361 from opendilab/dev-distar-collector

    polish(zms): modification of LeagueActor, LeagueCollector and DI-star Env, and other tests
    hiha3456 authored Jun 13, 2022
    Configuration menu
    Copy the full SHA
    d7faf35 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2022

  1. transform transitions so they could be sent, and write responding tes…

    …ts. change the finish condition of BattleStepCollector to env_episode. add env.close. And other modifications
    hiha3456 committed Jun 14, 2022
    Configuration menu
    Copy the full SHA
    1e78af8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ece3a64 View commit details
    Browse the repository at this point in the history
  3. change format

    hiha3456 committed Jun 14, 2022
    Configuration menu
    Copy the full SHA
    e9e8ebb View commit details
    Browse the repository at this point in the history
  4. Merge pull request opendilab#365 from opendilab/dev-distar-collector

    Dev distar collector
    hiha3456 authored Jun 14, 2022
    Configuration menu
    Copy the full SHA
    f9f6ef6 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2022

  1. Configuration menu
    Copy the full SHA
    22c8bcd View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d739635 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ffe8f7c View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b6c24b7 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    78bed49 View commit details
    Browse the repository at this point in the history
  6. add test for step exception

    hiha3456 committed Jun 15, 2022
    Configuration menu
    Copy the full SHA
    2ad4850 View commit details
    Browse the repository at this point in the history
  7. Merge pull request opendilab#372 from opendilab/dev-distar-collector

    Dev distar collector
    hiha3456 authored Jun 15, 2022
    Configuration menu
    Copy the full SHA
    5685f3b View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    72dfa38 View commit details
    Browse the repository at this point in the history
  9. change a bit

    hiha3456 committed Jun 15, 2022
    Configuration menu
    Copy the full SHA
    f6ec222 View commit details
    Browse the repository at this point in the history
  10. change var agent_num

    hiha3456 committed Jun 15, 2022
    Configuration menu
    Copy the full SHA
    b6129ed View commit details
    Browse the repository at this point in the history
  11. make n_episode more clear

    hiha3456 committed Jun 15, 2022
    Configuration menu
    Copy the full SHA
    c16e9e7 View commit details
    Browse the repository at this point in the history
  12. get rid of ctx.job

    hiha3456 committed Jun 15, 2022
    Configuration menu
    Copy the full SHA
    6fa1209 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    09b7145 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2022

  1. Merge pull request opendilab#375 from opendilab/dev-distar-collector

    Dev distar collector
    hiha3456 authored Jun 16, 2022
    Configuration menu
    Copy the full SHA
    06fee68 View commit details
    Browse the repository at this point in the history
  2. add timer

    hiha3456 committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    6d653a1 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    dc718dc View commit details
    Browse the repository at this point in the history
  4. add log

    hiha3456 committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    5d422d6 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    c0d5a52 View commit details
    Browse the repository at this point in the history
  6. Merge pull request opendilab#377 from opendilab/dev-distar-collector

    polish(zms): add log
    hiha3456 authored Jun 16, 2022
    Configuration menu
    Copy the full SHA
    ea3269d View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2022

  1. Configuration menu
    Copy the full SHA
    1746905 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    de5f8bb View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a30e23b View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2022

  1. Configuration menu
    Copy the full SHA
    d7a2563 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2022

  1. merge

    lixl-st committed Jun 20, 2022
    Configuration menu
    Copy the full SHA
    81502a0 View commit details
    Browse the repository at this point in the history
  2. merge

    lixl-st committed Jun 20, 2022
    Configuration menu
    Copy the full SHA
    b4dcce0 View commit details
    Browse the repository at this point in the history
  3. merge main into dev-distar

    hiha3456 committed Jun 20, 2022
    Configuration menu
    Copy the full SHA
    8f93810 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    6d89d09 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    96debf7 View commit details
    Browse the repository at this point in the history
  6. change a bit

    hiha3456 committed Jun 20, 2022
    Configuration menu
    Copy the full SHA
    ca0987b View commit details
    Browse the repository at this point in the history
  7. change a bit

    hiha3456 committed Jun 20, 2022
    Configuration menu
    Copy the full SHA
    006132f View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    c664f60 View commit details
    Browse the repository at this point in the history
  9. change a bit

    hiha3456 committed Jun 20, 2022
    Configuration menu
    Copy the full SHA
    78bfd97 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    b64a3ec View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2022

  1. add league learner exchanger

    lixl-st committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    8d30256 View commit details
    Browse the repository at this point in the history
  2. deal with step error

    hiha3456 committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    0bd6e4a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    338a2a2 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    65e3fb1 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    a9f1fc0 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    805d219 View commit details
    Browse the repository at this point in the history
  7. Merge pull request opendilab#388 from lixl-st/dev-league-lxl

    feature(lxl): add new learner
    hiha3456 authored Jun 21, 2022
    Configuration menu
    Copy the full SHA
    917a6e7 View commit details
    Browse the repository at this point in the history
  8. fix conflicts

    hiha3456 committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    716c55b View commit details
    Browse the repository at this point in the history
  9. reformat

    hiha3456 committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    87ac3ce View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    53bfdf5 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    d467140 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    7ea23f6 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2022

  1. add notes in conference

    hiha3456 committed Jun 22, 2022
    Configuration menu
    Copy the full SHA
    20d4c2b View commit details
    Browse the repository at this point in the history
  2. Merge pull request opendilab#392 from opendilab/dev-distar-collector

    Dev distar collector
    hiha3456 authored Jun 22, 2022
    Configuration menu
    Copy the full SHA
    984735f View commit details
    Browse the repository at this point in the history
  3. merge

    lixl-st committed Jun 22, 2022
    Configuration menu
    Copy the full SHA
    2e7fb1a View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    e50fc12 View commit details
    Browse the repository at this point in the history
  5. Merge pull request opendilab#393 from opendilab/dev-distar-learn

    feature(nyz): add basic distar policy collect(ci skip)
    hiha3456 authored Jun 22, 2022
    Configuration menu
    Copy the full SHA
    31cd26a View commit details
    Browse the repository at this point in the history
  6. change commit position

    hiha3456 committed Jun 22, 2022
    Configuration menu
    Copy the full SHA
    eafdf9c View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    c989cc0 View commit details
    Browse the repository at this point in the history
  8. add z infos

    hiha3456 committed Jun 22, 2022
    Configuration menu
    Copy the full SHA
    a061243 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    f44f54d View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2022

  1. Merge pull request opendilab#396 from opendilab/dev-distar-fix-bug

    Dev distar fix bug
    hiha3456 authored Jun 23, 2022
    Configuration menu
    Copy the full SHA
    763b627 View commit details
    Browse the repository at this point in the history
  2. merge

    lixl-st committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    2074302 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9c0d6f3 View commit details
    Browse the repository at this point in the history
  4. drop get config

    hiha3456 committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    37156d4 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    c923c23 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    5db2b52 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    63ac2df View commit details
    Browse the repository at this point in the history
  8. final_eval_reward

    hiha3456 committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    c1cc5af View commit details
    Browse the repository at this point in the history
  9. change a bit

    hiha3456 committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    6aefbe2 View commit details
    Browse the repository at this point in the history
  10. add logging

    lixl-st committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    b0a1051 View commit details
    Browse the repository at this point in the history
  11. rm exp files

    lixl-st committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    4ef8ea8 View commit details
    Browse the repository at this point in the history
  12. add info["result"]

    hiha3456 committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    7d3a152 View commit details
    Browse the repository at this point in the history
  13. polish

    lixl-st committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    c7e0b4c View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    7137660 View commit details
    Browse the repository at this point in the history
  15. Merge pull request opendilab#398 from lixl-st/dev-league-lxl

    feature(lxl): add logging
    hiha3456 authored Jun 23, 2022
    Configuration menu
    Copy the full SHA
    61c3b86 View commit details
    Browse the repository at this point in the history
  16. remove rep

    hiha3456 committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    723cbcc View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2022

  1. add comment

    hiha3456 committed Jun 24, 2022
    Configuration menu
    Copy the full SHA
    0bc4b20 View commit details
    Browse the repository at this point in the history
  2. add result info in job.info

    hiha3456 committed Jun 24, 2022
    Configuration menu
    Copy the full SHA
    02b9d0b View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    b72cb78 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    e12a82e View commit details
    Browse the repository at this point in the history
  5. remove rep

    hiha3456 committed Jun 24, 2022
    Configuration menu
    Copy the full SHA
    cb97628 View commit details
    Browse the repository at this point in the history
  6. change to fix bug on k8s

    hiha3456 committed Jun 24, 2022
    Configuration menu
    Copy the full SHA
    19aae09 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2022

  1. Configuration menu
    Copy the full SHA
    e9aad7e View commit details
    Browse the repository at this point in the history
  2. make old tests could run

    hiha3456 committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    98effdc View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2d71278 View commit details
    Browse the repository at this point in the history
  4. Merge pull request opendilab#402 from opendilab/dev-distar-collector

    Dev distar collector
    hiha3456 authored Jun 27, 2022
    Configuration menu
    Copy the full SHA
    94d750d View commit details
    Browse the repository at this point in the history
  5. change commit to run in k8s

    hiha3456 committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    61883a7 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    def4799 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    05cc0f0 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    8f716f1 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2022

  1. update train iter

    hiha3456 committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    d6ef348 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0cb987f View commit details
    Browse the repository at this point in the history
  3. add check of main player

    hiha3456 committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    7012966 View commit details
    Browse the repository at this point in the history
  4. fix bug

    hiha3456 committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    7912613 View commit details
    Browse the repository at this point in the history
  5. fix bug

    hiha3456 committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    2b51afc View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    c912e4b View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    83d93d0 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2022

  1. Configuration menu
    Copy the full SHA
    d96f953 View commit details
    Browse the repository at this point in the history
  2. merge dev-distar-nyz

    hiha3456 committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    8408399 View commit details
    Browse the repository at this point in the history
  3. to run in k8s

    hiha3456 committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    7b5b233 View commit details
    Browse the repository at this point in the history
  4. change num workers

    hiha3456 committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    0b985d2 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    57d3a43 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2022

  1. print exception

    hiha3456 committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    584fd82 View commit details
    Browse the repository at this point in the history
  2. reformat test

    hiha3456 committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    df21a9a View commit details
    Browse the repository at this point in the history
  3. fix bug

    hiha3456 committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    72803ef View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2022

  1. Configuration menu
    Copy the full SHA
    e8e7551 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    2da4010 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a0efe1c View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    a3c9e39 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    43f86a1 View commit details
    Browse the repository at this point in the history
  6. move GLU and build_activation in action_type_head.py to ding/torch_ut…

    …ils/network/activation.py, rename them to GLU2 and build_activation2
    hiha3456 committed Jul 6, 2022
    Configuration menu
    Copy the full SHA
    a99c8bb View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2022

  1. Configuration menu
    Copy the full SHA
    a11e146 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ca651b5 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2022

  1. Configuration menu
    Copy the full SHA
    8dd3b39 View commit details
    Browse the repository at this point in the history
  2. Merge pull request opendilab#411 from opendilab/dev-distar-collector-…

    …merge-policy
    
    Dev distar collector merge policy
    hiha3456 authored Jul 11, 2022
    Configuration menu
    Copy the full SHA
    70c1a7f View commit details
    Browse the repository at this point in the history
  3. add processss_transition

    hiha3456 committed Jul 11, 2022
    Configuration menu
    Copy the full SHA
    b2cfa91 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2022

  1. Configuration menu
    Copy the full SHA
    25a8a54 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6c75891 View commit details
    Browse the repository at this point in the history
  3. insert process transition into rolloutor, fix bug; move self._observa…

    …tion, self._output to make code more clear
    hiha3456 committed Jul 12, 2022
    Configuration menu
    Copy the full SHA
    1f2bc17 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    8dfa961 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    4a01f3d View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2022

  1. Configuration menu
    Copy the full SHA
    b06d6d8 View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2022

  1. Configuration menu
    Copy the full SHA
    0aedb77 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2022

  1. Configuration menu
    Copy the full SHA
    1dfda42 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3d19436 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    73c0367 View commit details
    Browse the repository at this point in the history
  4. Merge pull request opendilab#420 from opendilab/dev-distar-collector-…

    …merge-policy
    
    Dev distar collector merge policy
    hiha3456 authored Jul 19, 2022
    Configuration menu
    Copy the full SHA
    4fc95b1 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2022

  1. Configuration menu
    Copy the full SHA
    206b293 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2022

  1. Configuration menu
    Copy the full SHA
    146643e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ea11bc1 View commit details
    Browse the repository at this point in the history
  3. move out the distar files into DI-star

    zhumengshen committed Aug 24, 2022
    Configuration menu
    Copy the full SHA
    2e60364 View commit details
    Browse the repository at this point in the history
  4. move out tensor_dict_to_shm

    zhumengshen committed Aug 24, 2022
    Configuration menu
    Copy the full SHA
    2dc4ab5 View commit details
    Browse the repository at this point in the history
  5. add comment of CpuUnpickler

    zhumengshen committed Aug 24, 2022
    Configuration menu
    Copy the full SHA
    2c0e527 View commit details
    Browse the repository at this point in the history
  6. move out distar_test_pipelines

    zhumengshen committed Aug 24, 2022
    Configuration menu
    Copy the full SHA
    7a3bc0b View commit details
    Browse the repository at this point in the history
  7. change import of collector.py

    zhumengshen committed Aug 24, 2022
    Configuration menu
    Copy the full SHA
    3f21d3c View commit details
    Browse the repository at this point in the history
  8. drop out useless mocks

    zhumengshen committed Aug 24, 2022
    Configuration menu
    Copy the full SHA
    37b6bc7 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2022

  1. make test of coordinator pass

    zhumengshen committed Aug 25, 2022
    Configuration menu
    Copy the full SHA
    de8b6eb View commit details
    Browse the repository at this point in the history
  2. feature(zms): add test_league_learner_communicator.py

    zhumengshen committed Aug 25, 2022
    Configuration menu
    Copy the full SHA
    e63d710 View commit details
    Browse the repository at this point in the history
  3. change a bit

    zhumengshen committed Aug 25, 2022
    Configuration menu
    Copy the full SHA
    30e6249 View commit details
    Browse the repository at this point in the history
  4. change file name

    zhumengshen committed Aug 25, 2022
    Configuration menu
    Copy the full SHA
    9dc8770 View commit details
    Browse the repository at this point in the history
  5. update test_handle_step_exception.py

    zhumengshen committed Aug 25, 2022
    Configuration menu
    Copy the full SHA
    117ae79 View commit details
    Browse the repository at this point in the history
  6. update test of BattleTransitionList, and add last_step_fn in BattleTr…

    …ansitionList, make battle_rolloutor_for_distar run in dict and list cases
    zhumengshen committed Aug 25, 2022
    Configuration menu
    Copy the full SHA
    f66248d View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2022

  1. uupdate tests; actor, collector, functional collector

    zhumengshen committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    8cf4a82 View commit details
    Browse the repository at this point in the history
  2. remove one todo

    zhumengshen committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    9af8168 View commit details
    Browse the repository at this point in the history
  3. reformat

    zhumengshen committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    6221024 View commit details
    Browse the repository at this point in the history
  4. reformat

    zhumengshen committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    16281d9 View commit details
    Browse the repository at this point in the history
  5. fix bug

    zhumengshen committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    fb83c8e View commit details
    Browse the repository at this point in the history
  6. reformat; add last_step_fn in entry of LeagueActor and BattleStepColl…

    …ector
    zhumengshen committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    bc7b477 View commit details
    Browse the repository at this point in the history
  7. update tests

    zhumengshen committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    7fc8354 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2022

  1. delete useless files

    zhumengshen committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    3e01213 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2022

  1. Configuration menu
    Copy the full SHA
    0a8be2e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b3d39f9 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2022

  1. add unittest of parameter "dim" in default_collate; remove dim from c…

    …at because it is useless
    hiha3456 committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    4f09857 View commit details
    Browse the repository at this point in the history
  2. reformat

    hiha3456 committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    54ea00e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ef64a7e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    543f1ec View commit details
    Browse the repository at this point in the history