Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add option to control use of MKL-DNN in jaxlib easyblock #2619

Merged
merged 5 commits into from
Dec 8, 2021

Conversation

lexming
Copy link
Contributor

@lexming lexming commented Nov 12, 2021

A few enhancements to the jaxlib easyblock:

  • use native CPU features for non-generic builds in EasyBuild
  • add extra parameter to control the use of Intel's MKL-DNN
  • only set support for NCCL starting from version 0.1.170

@lexming lexming added this to the 4.x milestone Nov 12, 2021
@boegel
Copy link
Member

boegel commented Nov 13, 2021

Test report by @boegel

Overview of tested easyconfigs (in order)

  • SUCCESS jax-0.2.19-foss-2020b.eb
  • SUCCESS jax-0.2.20-foss-2021a.eb

Build succeeded for 2 out of 2 (2 easyconfigs in total)
node3114.skitty.os - Linux centos linux 7.9.2009, x86_64, Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz (skylake_avx512), Python 3.6.8
See https://gist.github.com/36ec3ca8e9beeb8a2a5332e370f3b83b for a full test report.

@lexming lexming changed the title use native CPU features in jaxlib and add option to control MKL-DNN add option to control MKL-DNN in jaxlib Nov 19, 2021
@boegel boegel changed the title add option to control MKL-DNN in jaxlib add option to control MKL-DNN in jaxlib easyblock Nov 24, 2021
@branfosj
Copy link
Member

branfosj commented Dec 4, 2021

Test report by @branfosj

Overview of tested easyconfigs (in order)

  • SUCCESS jax-0.2.19-foss-2020b.eb
  • SUCCESS jax-0.2.20-foss-2021a.eb

Build succeeded for 2 out of 2 (2 easyconfigs in total)
bear-pg0211u08b.bear.cluster - Linux RHEL 8.3, x86_64, Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz (cascadelake), Python 3.6.8
See https://gist.github.com/74708d795783b7175a019711097ed305 for a full test report.

Copy link
Member

@branfosj branfosj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

based on the tests here and in easybuilders/easybuild-easyconfigs#14334

Copy link
Member

@boegel boegel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@boegel
Copy link
Member

boegel commented Dec 8, 2021

Test report by @boegel

Overview of tested easyconfigs (in order)

  • SUCCESS jax-0.2.19-foss-2020b.eb
  • SUCCESS jax-0.2.20-foss-2021a.eb

Build succeeded for 2 out of 2 (2 easyconfigs in total)
node3575.doduo.os - Linux RHEL 8.2, x86_64, AMD EPYC 7552 48-Core Processor (zen2), Python 3.6.8
See https://gist.github.com/43f07db6c9337848201353b6922633ba for a full test report.

@boegel
Copy link
Member

boegel commented Dec 8, 2021

Test report by @boegel

Overview of tested easyconfigs (in order)

  • SUCCESS jax-0.2.19-foss-2020b.eb
  • SUCCESS jax-0.2.20-foss-2021a.eb

Build succeeded for 2 out of 2 (2 easyconfigs in total)
node2624.swalot.os - Linux centos linux 7.9.2009, x86_64, Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (haswell), Python 3.6.8
See https://gist.github.com/a312005b01fce3d145010336a8a32d22 for a full test report.

@boegel
Copy link
Member

boegel commented Dec 8, 2021

Thanks @lexming!

@boegel boegel merged commit f578af6 into easybuilders:develop Dec 8, 2021
@boegel
Copy link
Member

boegel commented Dec 8, 2021

Test report by @boegel

Overview of tested easyconfigs (in order)

  • SUCCESS jax-0.2.19-fosscuda-2020b.eb

Build succeeded for 1 out of 1 (1 easyconfigs in total)
node3304.joltik.os - Linux centos linux 7.9.2009, x86_64, Intel(R) Xeon(R) Gold 6242 CPU @ 2.80GHz (cascadelake), 1 x NVIDIA NVIDIA Tesla V100-SXM2-32GB, 465.19.01, Python 3.6.8
See https://gist.github.com/96a5e7a85df29e81dcf6489b9c622472 for a full test report.

@boegel boegel changed the title add option to control MKL-DNN in jaxlib easyblock add option to control use of MKL-DNN in jaxlib easyblock Dec 11, 2021
@lexming lexming deleted the jaxlib branch December 13, 2021 22:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants