{devel,lib,system,tools}[GCCcore/11.3.0] IPython v8.5.0, libsodium v1.0.18, OpenPGM v5.2.122, ... w/ Python 3.10.4 #16251

SebastianAchilles · 2022-09-12T19:07:01Z

(created using eb --new-pr)

…-GCCcore-11.3.0.eb, OpenPGM-5.2.122-GCCcore-11.3.0.eb, ZeroMQ-4.3.4-GCCcore-11.3.0.eb

SebastianAchilles · 2022-09-12T19:36:13Z

Test report by @SebastianAchilles
SUCCESS
Build succeeded for 4 out of 4 (4 easyconfigs in total)
zen2-ubuntu-eb - Linux Ubuntu 22.04, x86_64, AMD EPYC 7452 32-Core Processor (zen2), Python 3.10.4
See https://gist.github.com/4b957c4c2883fccc3b206dce35a8b95d for a full test report.

SebastianAchilles · 2022-09-12T19:36:53Z

Test report by @SebastianAchilles
SUCCESS
Build succeeded for 4 out of 4 (4 easyconfigs in total)
bdw-opensuse-154 - Linux openSUSE Leap 15.4, x86_64, Intel(R) Core(TM) i7-6900K CPU @ 3.20GHz (broadwell), Python 3.6.15
See https://gist.github.com/c5cb25cee4e9203109c1fa5d05366335 for a full test report.

SebastianAchilles · 2022-09-12T19:37:11Z

@boegelbot please test @ generoso

boegelbot · 2022-09-12T19:40:09Z

@SebastianAchilles: Request for testing this PR well received on login1

PR test command 'EB_PR=16251 EB_ARGS= /opt/software/slurm/bin/sbatch --job-name test_PR_16251 --ntasks=4 ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:

Submitted batch job 9158

Test results coming soon (I hope)...

- notification for comment with ID 1244254439 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

SebastianAchilles · 2022-09-12T19:41:29Z

@boegelbot please test @ jsc-zen2

boegelbot · 2022-09-12T19:42:07Z

@SebastianAchilles: Request for testing this PR well received on jsczen2l1.int.jsc-zen2.easybuild-test.cluster

PR test command 'EB_PR=16251 EB_ARGS= /opt/software/slurm/bin/sbatch --job-name test_PR_16251 --ntasks=8 ~/boegelbot/eb_from_pr_upload_jsc-zen2.sh' executed!

exit code: 0
output:

Submitted batch job 1639

Test results coming soon (I hope)...

- notification for comment with ID 1244265166 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

boegelbot · 2022-09-12T19:52:54Z

Test report by @boegelbot
SUCCESS
Build succeeded for 6 out of 6 (4 easyconfigs in total)
jsczen2c1.int.jsc-zen2.easybuild-test.cluster - Linux Rocky Linux 8.5, x86_64, AMD EPYC 7742 64-Core Processor (zen2), Python 3.6.8
See https://gist.github.com/1ca71cb2144ad0e4a74bcbad05fbb967 for a full test report.

boegelbot · 2022-09-12T19:53:09Z

Test report by @boegelbot
SUCCESS
Build succeeded for 4 out of 4 (4 easyconfigs in total)
cns1 - Linux Rocky Linux 8.5, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/3a569e93cce99496043b8e94111f0000 for a full test report.

schiotz · 2022-10-03T10:18:35Z

@SebastianAchilles I am interested in this PR. Is there any reason it is still in draft?

schiotz · 2022-10-03T10:36:21Z

Test report by @schiotz
SUCCESS
Build succeeded for 7 out of 7 (4 easyconfigs in total)
slid.fysik.dtu.dk - Linux CentOS Linux 7.9.2009, x86_64, Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz, Python 2.7.5
See https://gist.github.com/bbca9c45c8cfef979ef53e3a28ef7ea1 for a full test report.

Micket

A couple of extensions here could be updated if we wanted to. other than that, it looks good.
I see a few new dependencies, but trust you knew they were needed

SebastianAchilles · 2022-10-13T14:48:11Z

This MR is in draft, because I can not update a few extensions to the latest release. The problem is that some newer Python extensions require hatchling as build backend. However, with our current Python we can not install hatchling, because of poetry 1.1.13.

This opens a fundamental question: do we want to support hatchling in 2022a? If yes, we would need to update Python. If no, we can not install some newer Python extensions.

schiotz · 2022-10-13T18:31:35Z

However, with our current Python we can not install hatchling, because of poetry 1.1.13.

This opens a fundamental question: do we want to support hatchling in 2022a? If yes, we would need to update Python. If no, we can not install some newer Python extensions.

It seems to me that updating the Python package would lead to hard-to-debug errors, where people who have installed it before the update cannot install some packages, and others can.

Would it be bad to include a newer version of poetry in a package that require it? It is certainly a bit odd, but perhaps the lesser evil.

If hatchling is only needed to build a package, would it be possible to make a PythonBundle with hatchling and a newer poetry, and then use it as a build-dependency?

I do not know these packages, so feel free to ignore me if it is obvious I don't know what I am talking about. :-)

Micket · 2022-10-14T16:51:20Z

I'd be OK with just holding some versions back, and we can look into hatchling and whatnot for 2022b.

casparvl · 2022-10-17T15:16:29Z

I'm also interested in this PR :) Also not too familiar with what Poetry and Hatchling do though. @Micket solution would definitely be the quickest. And since we're already way into the 2nd half of 2022, I'd also be in favor of just getting 'a' IPython EasyConfig in (i.e. this one), even if it uses a bit older versions for some packages.

casparvl · 2022-10-17T15:26:28Z

Test report by @casparvl
SUCCESS
Build succeeded for 5 out of 5 (4 easyconfigs in total)
gcn27 - Linux RHEL 8.4, x86_64, Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz, 4 x NVIDIA NVIDIA A100-SXM4-40GB, 515.43.04, Python 3.6.8
See https://gist.github.com/7eba818f751fc505164846db69abbb06 for a full test report.

casparvl · 2022-10-17T15:32:00Z

Test report by @casparvl
SUCCESS
Build succeeded for 5 out of 5 (4 easyconfigs in total)
software1.lisa.surfsara.nl - Linux debian 10.13, x86_64, Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz, Python 3.7.3
See https://gist.github.com/ae5f399f8d6db13a6902fb27eef365d8 for a full test report.

SebastianAchilles · 2022-10-17T16:12:27Z

Okay, you convinced me that it is okay to hold some versions back. ;-) I will mark this MR as ready.

About adding hatchling to Python one possible solution could be this change (however I am not sure, if we want to apply the change or use it as input for a future Python): #16402

Micket · 2022-10-17T16:31:40Z

Test report by @Micket
SUCCESS
Build succeeded for 5 out of 5 (4 easyconfigs in total)
alvis-c1 - Linux Rocky Linux 8.5, x86_64, Intel Xeon Processor (Skylake), Python 3.6.8
See https://gist.github.com/a5a54e73192c8e4e9456ea3627de6619 for a full test report.

casparvl

Looks good to me. To add to @Micket 's comment: I don't know which specific package pulls in lxml, but BeautifulSoup is pulled in by notebook nowadays. I'm not sure where lxml comes from though, it doesn't seem to be a dependency from any of the other listed packages - unless I overlooked something. Can you comment?

Micket · 2022-10-17T16:51:19Z

I did a pipdeptree on the build i just did. nbconvert depends on lxml and beautifulsoup4

Micket

lgtm

Micket · 2022-10-17T16:55:05Z

@boegelbot please test @ generoso

boegelbot · 2022-10-17T16:55:10Z

@Micket: Request for testing this PR well received on login1

PR test command 'EB_PR=16251 EB_ARGS= /opt/software/slurm/bin/sbatch --job-name test_PR_16251 --ntasks=4 ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:

Submitted batch job 9303

Test results coming soon (I hope)...

- notification for comment with ID 1281169284 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

boegelbot · 2022-10-17T17:09:28Z

Test report by @boegelbot
SUCCESS
Build succeeded for 4 out of 4 (4 easyconfigs in total)
cns2 - Linux Rocky Linux 8.5, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/6942b394ae007e6217869596cbc7535c for a full test report.

Micket · 2022-10-17T17:11:10Z

Going in, thanks @SebastianAchilles!

SebastianAchilles added the update label Sep 12, 2022

adding easyconfigs: IPython-8.5.0-GCCcore-11.3.0.eb, libsodium-1.0.18…

7c6aac3

…-GCCcore-11.3.0.eb, OpenPGM-5.2.122-GCCcore-11.3.0.eb, ZeroMQ-4.3.4-GCCcore-11.3.0.eb

SebastianAchilles force-pushed the 20220912210657_new_pr_IPython850 branch from 6eab4be to 7c6aac3 Compare September 12, 2022 19:11

SebastianAchilles added this to the 4.x milestone Sep 12, 2022

SebastianAchilles marked this pull request as draft September 12, 2022 19:12

Micket reviewed Oct 13, 2022

View reviewed changes

SebastianAchilles marked this pull request as ready for review October 17, 2022 16:12

casparvl mentioned this pull request Oct 17, 2022

{tools}[GCCcore/11.3.0] JupyterHub v3.0.0, configurable-http-proxy v4.5.3 w/ Python 3.10.4 #16424

Merged

1 task

casparvl reviewed Oct 17, 2022

View reviewed changes

Micket approved these changes Oct 17, 2022

View reviewed changes

Micket merged commit 7116c18 into easybuilders:develop Oct 17, 2022

casparvl modified the milestones: 4.x, release after 4.6.2, next release (4.6.2?) Oct 18, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

{devel,lib,system,tools}[GCCcore/11.3.0] IPython v8.5.0, libsodium v1.0.18, OpenPGM v5.2.122, ... w/ Python 3.10.4 #16251

{devel,lib,system,tools}[GCCcore/11.3.0] IPython v8.5.0, libsodium v1.0.18, OpenPGM v5.2.122, ... w/ Python 3.10.4 #16251

SebastianAchilles commented Sep 12, 2022

SebastianAchilles commented Sep 12, 2022

SebastianAchilles commented Sep 12, 2022

SebastianAchilles commented Sep 12, 2022

boegelbot commented Sep 12, 2022

SebastianAchilles commented Sep 12, 2022

boegelbot commented Sep 12, 2022

boegelbot commented Sep 12, 2022

boegelbot commented Sep 12, 2022

schiotz commented Oct 3, 2022

schiotz commented Oct 3, 2022

Micket left a comment

SebastianAchilles commented Oct 13, 2022

schiotz commented Oct 13, 2022

Micket commented Oct 14, 2022

casparvl commented Oct 17, 2022

casparvl commented Oct 17, 2022

casparvl commented Oct 17, 2022

SebastianAchilles commented Oct 17, 2022

Micket commented Oct 17, 2022

casparvl left a comment

Micket commented Oct 17, 2022

Micket left a comment

Micket commented Oct 17, 2022

boegelbot commented Oct 17, 2022

boegelbot commented Oct 17, 2022

Micket commented Oct 17, 2022

{devel,lib,system,tools}[GCCcore/11.3.0] IPython v8.5.0, libsodium v1.0.18, OpenPGM v5.2.122, ... w/ Python 3.10.4 #16251

{devel,lib,system,tools}[GCCcore/11.3.0] IPython v8.5.0, libsodium v1.0.18, OpenPGM v5.2.122, ... w/ Python 3.10.4 #16251

Conversation

SebastianAchilles commented Sep 12, 2022

SebastianAchilles commented Sep 12, 2022

SebastianAchilles commented Sep 12, 2022

SebastianAchilles commented Sep 12, 2022

boegelbot commented Sep 12, 2022

SebastianAchilles commented Sep 12, 2022

boegelbot commented Sep 12, 2022

boegelbot commented Sep 12, 2022

boegelbot commented Sep 12, 2022

schiotz commented Oct 3, 2022

schiotz commented Oct 3, 2022

Micket left a comment

Choose a reason for hiding this comment

SebastianAchilles commented Oct 13, 2022

schiotz commented Oct 13, 2022

Micket commented Oct 14, 2022

casparvl commented Oct 17, 2022

casparvl commented Oct 17, 2022

casparvl commented Oct 17, 2022

SebastianAchilles commented Oct 17, 2022

Micket commented Oct 17, 2022

casparvl left a comment

Choose a reason for hiding this comment

Micket commented Oct 17, 2022

Micket left a comment

Choose a reason for hiding this comment

Micket commented Oct 17, 2022

boegelbot commented Oct 17, 2022

boegelbot commented Oct 17, 2022

Micket commented Oct 17, 2022