Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Formulation #6

Open
oyamad opened this issue Nov 20, 2017 · 1 comment
Open

Formulation #6

oyamad opened this issue Nov 20, 2017 · 1 comment
Labels
discussion

Comments

@oyamad
Copy link
Member

oyamad commented Nov 20, 2017

The current code solves dynamic programs with

  • reward function f(s, x) and
  • state transition function g(s, x, e)

where

  1. s is an N-dimensional continuous state variable
  2. x is a 1-dimensional continuous action variable and
  3. e is a discrete random variable, whose distribution is state independent.

Discussion:

  1. Do we want to allow discrete state variables in some dimensions?
  2. We want to allow discrete actions (Allow discrete actions #5) and multidimensional actions.
  3. Do we want to allow state dependent distributions?
@sglyon
Copy link
Member

sglyon commented Nov 20, 2017

  1. I think we should allow for discrete states

  2. yes and yes

  3. Is this different from discrete states?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
discussion
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sglyon @oyamad