Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upload benchmark results #58

Open
wants to merge 26 commits into
base: main
Choose a base branch
from
Open

Upload benchmark results #58

wants to merge 26 commits into from

Conversation

ZedongPeng
Copy link
Member

@ZedongPeng ZedongPeng commented Aug 28, 2024

TODO

  1. batch_processing
    • GLOA
  2. biofuel
    • Enumeration, stoped for all logic-based methods
  3. CSTR @AlbertLee125
    • Not working for all methods.
  4. ex1_linan_2023 @AlbertLee125
    • Hull reformulation.
    • GLOA
    • LOA
    • LBB
    • RIC
  5. gdp_col @AlbertLee125
    • Hull reformulation
    • LBB does not find a feasible solution within 1 hour. (Unknown termination condition of intermediateNonInteger. Treating as infeasible.)
  6. hda @tristantc
    • Hull reformulation
    • LBB does not find a feasible solution within 1 hour.
  7. kaibel @tristantc
    • Not working

I will keep benchmarking the rest of the problems.

Copy link
Member

@bernalde bernalde left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great results so far, for the solvers that involve MINLP I realized that GAMS has as default DICOPT. Let's replace it with BARON instead (at least we'll get good bounds)

Copy link
Member

@bernalde bernalde left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For the results, if using GAMS, we should also report the subsolvers (NLP, MIP and MINLP) used

@ZedongPeng
Copy link
Member Author

No problem. I will also use Baron to solve the BigM and Hull reformulations. We can specify the four subsolvers (nlp_solver, mip_solver, minlp_solver, local_minlp_solver) in GDPOpt. Besides the minlp_solver, is there any other solver we should consider specifying? @bernalde

@bernalde
Copy link
Member

I think BARON is state-of-the-art in MINLP and NLP but might be too expensive, especially for local_nlp_solver.
KNITRO is the best as local goes in my opinion. And SCIP as open source.

@ZedongPeng
Copy link
Member Author

  1. Use SCIP through GAMS for all subsolvers.
  2. Use BARON for all subsolvers.

@tristantc
Copy link
Contributor

tristantc commented Nov 6, 2024

Using BARON for all subsolvers.

TODO

  1. batch_processing
    • GLOA
  2. biofuel
    • Big-M reformulation
    • Hull reformulation
    • Enumerate
    • GLOA
    • LOA
    • LBB
    • RIC
  3. cstr
    • GLOA
  4. disease_model
    • Enumerate
  5. ex1_linan_2023
    • Hull reformulation.
    • GLOA
    • LOA
    • LBB
    • RIC
  6. gdp_col
    • Hull reformulation
    • GLOA
    • LBB
  7. hda
    • Hull reformulation
    • GLOA
  8. kaibel
    • Big-M reformulation
    • Hull reformulation
    • Enumerate
    • GLOA
    • LOA
    • LBB
    • RIC
  9. med_term_purchasing
    • Enumerate
    • LBB
  10. methanol
    • GLOA
  11. mod_hens
    • Enumerate
    • GLOA
    • LBB
  12. modprodnet
    • GLOA
  13. positioning
    • GLOA
  14. small_batch
    • GLOA
  15. spectralog
    • Enumerate
    • GLOA
  16. stranded_gas
    • Hull reformulation
    • Enumerate
    • GLOA
    • LOA
    • LBB
    • RIC
  17. syngas
    • GLOA
    • LBB

I will open an issue for every single instance to keep progressing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants