Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expected value iterations #740

Open
odow opened this issue May 7, 2024 · 1 comment
Open

Expected value iterations #740

odow opened this issue May 7, 2024 · 1 comment

Comments

@odow
Copy link
Owner

odow commented May 7, 2024

Talking to Gabriel: we should add an option to run some expected values cuts (off by default).

This might be very useful in cyclic problems to cheaply get the value function to a place where it is the right height before adding more cuts.

We could do this by averaging the noise terms. We probably need an API like:

SDDP.train(
    model;
    average_value_iterations = SDDP.AverageValueIterator(; num_iterations = 50) do P, Ω
        return sum(p * ω for (p, ω) in zip(P, Ω))
    end,
)
@odow
Copy link
Owner Author

odow commented Nov 19, 2024

So perhaps the right thing to do here is an expected value forward pass. Or just pick the middle realization from the vector. It doesn't need to be the expected value...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant