Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sparse LU benchmarking #359

Closed
ChrisRackauckas opened this issue Aug 8, 2023 · 6 comments
Closed

Sparse LU benchmarking #359

ChrisRackauckas opened this issue Aug 8, 2023 · 6 comments

Comments

@ChrisRackauckas
Copy link
Member

Now with #357 kicked off, we should create a similar benchmark in the sparse space. Maybe using https://github.com/JuliaSparse/MatrixMarket.jl to read https://math.nist.gov/MatrixMarket/formats.html#MMformat.
@Wimmerer do you have matrix sets like https://sparse.tamu.edu/Gset and the NIST one (where do you even find that?) easy to just loop through? If so we can just do a timing on all of them and create a few plots. After that, we can get it onto https://docs.sciml.ai/SciMLBenchmarksOutput/stable/

@j-fu
Copy link
Contributor

j-fu commented Aug 8, 2023

Hi, I did some sparse benchmarking:

https://j-fu.github.io/marginalia/julia/scalingtest/

IMHO performance quite a bit depends on structural info, eg 1D/2D/3D. The kron trick used in the notebook gives reasonably typical matrices for scalar FD/FV/FE.

Just gone cycling - will be back at my computer next week.

@ChrisRackauckas
Copy link
Member Author

That would be good to add to the SciMLBenchmarks as well. Could you take the time to PR it today? Shouldn't take more than an hour. I'd still like to see other sparse matrices in a benchmarkable format in order to setup a better default algorithm, but the scaling PDE ones are definitely useful.

@j-fu
Copy link
Contributor

j-fu commented Aug 8, 2023

Already on my smartphone... Will PR when I'll be back.

@j-fu
Copy link
Contributor

j-fu commented Aug 14, 2023

See #365

sparselubench

@briochemc
Copy link

Potentially relevant paper I stumbled upon recently comparing UMFPACK vs Paridso vs MUMPS using Matrix Market matrices relevant to finite-element methods AFAIU:

Pedroso DM. Caveats of three direct linear solvers for finite element analyses. Int J Numer Methods Eng. 2024;125(17):e7545. doi: 10.1002/nme.7545

@ChrisRackauckas
Copy link
Member Author

We have benchmarks growing at SciMLBenchmarks, so I'll close this here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants