Add script package _recommended and generate "recommended system packages" info #29557

mkoeppe · 2020-04-23T18:13:54Z

Let's improve the installation-from-source documentation regarding the "recommended system packages" for 9.1.

build/pkgs/_recommended - records additional recommended packages such as texlive-xetex (see https://wiki.sagemath.org/prerequisites/Ubuntu); also texinfo (from update ECL to 20.4.24 #22191)

Meta-ticket: Refactor and improve system package related scripts, tox.ini, build/bin/write_dockerfile.sh #29146: Meta-ticket: Refactor and improve system package related scripts, tox.ini, build/bin/write_dockerfile.sh
At the end of configure, show installation hints for non-enabled optional packages separately #29372: At the end of configure, show installation hints for disabled optional packages separately
Improve wording and formatting of configure's recommendation message #30624: Improve configure's recommendation message

CC: @egourgoulhon @dimpase @kiwifb @orlitzky @jhpalmieri @videlec @kcrisman @slel @antonio-rojas @kliem @thierry-FreeBSD @saraedum

Component: documentation

Keywords: sd109

Author: Matthias Koeppe, John Palmieri

Branch: 6d5cc43

Reviewer: John Palmieri, Matthias Koeppe

Issue created by migration from https://trac.sagemath.org/ticket/29557

The text was updated successfully, but these errors were encountered:

mkoeppe · 2020-04-23T18:16:47Z

Branch: u/mkoeppe/29557-recommended-packages

egourgoulhon · 2020-04-23T18:59:39Z

Commit: 449df5a

egourgoulhon · 2020-04-23T18:59:39Z

New commits:

`449df5a`	`build/pkgs/_recommended: New`

mkoeppe · 2020-04-24T05:22:19Z

comment:4

So far we only have the recommended packages for debian/ubuntu

mkoeppe · 2020-04-25T02:36:52Z

Dependencies: #29558

sagetrac-git · 2020-04-25T02:37:08Z

Branch pushed to git repo; I updated commit sha1. This was a forced push. New commits:

`66c07d8`	`trac 29558: first draft`
`deb84cd`	`sage-print-system-package-command: More options, update uses`
`a832dbc`	`src/doc/bootstrap: Initialize OPTIONAL_SYSTEM_PACKAGES`
`272f01b`	`build/bin/sage-spkg: Update use of sage-print-system-package-command`
`8f064f4`	`trac 29558: correct some markup, change the date at end of file`
`8273e84`	`build/pkgs/_recommended: New`

sagetrac-git · 2020-04-25T02:37:08Z

Changed commit from 449df5a to 8273e84

sagetrac-git · 2020-04-25T02:39:51Z

Branch pushed to git repo; I updated commit sha1. New commits:

`7151382`	`src/doc/bootstrap: Generate debian-recommended.txt etc`

sagetrac-git · 2020-04-25T02:39:51Z

Changed commit from 8273e84 to 7151382

mkoeppe · 2020-04-25T02:51:57Z

comment:9

Would someone like to help with the list of packages on their favorite distribution?

mkoeppe · 2020-04-25T18:36:19Z

Author: Matthias Koeppe

jhpalmieri · 2020-04-25T18:48:10Z

Changed branch from u/mkoeppe/29557-recommended-packages to u/jhpalmieri/29557-recommended-packages

jhpalmieri · 2020-04-25T18:48:38Z

Changed commit from 7151382 to 85281cf

jhpalmieri · 2020-04-25T18:48:38Z

comment:12

Here are a few suggestions for homebrew.

New commits:

`85281cf`	`trac 29557: some recommended packages for homebrew`

sagetrac-git · 2020-04-25T18:49:32Z

Branch pushed to git repo; I updated commit sha1. This was a forced push. New commits:

`2104e53`	`trac 29557: some recommended packages for homebrew`

sagetrac-git · 2020-04-25T18:49:32Z

Changed commit from 85281cf to 2104e53

mkoeppe · 2020-04-25T19:14:02Z

comment:14

I don't think gcc needs to be added here - it's already listed in build/pkgs/gfortran/distros/homebrew.txt

sagetrac-git · 2020-04-25T21:24:43Z

Branch pushed to git repo; I updated commit sha1. This was a forced push. New commits:

`8550fe0`	`trac 29557: some recommended packages for homebrew`

sagetrac-git · 2020-04-25T21:24:43Z

Changed commit from 2104e53 to 8550fe0

jhpalmieri · 2020-04-25T21:25:04Z

comment:16

Okay, I took gcc out.

mkoeppe · 2020-04-25T21:36:44Z

comment:17

Thanks!

kliem · 2020-04-28T07:16:50Z

comment:18

Typo in the ubuntu link:

+https://wiki.sagemath.org/prerequisites/Ubuntu
-https://wiki.sagemath.org/prerequisitesUbuntu

slel · 2020-04-28T09:12:38Z

comment:19

My fault: I recently moved that page from prerequisitesUbuntu
to prerequisites/Ubuntu to make it easier to find, better indexed,
and thinking we might have other prerequisites/something.

mkoeppe · 2020-04-28T13:33:06Z

comment:20

Replying to @slel:

[...] thinking we might have other prerequisites/something.

Hopefully this won't be necessary and we can keep this information up to date in a single place - the install manual.

mkoeppe · 2020-05-04T04:47:16Z

Changed author from Matthias Koeppe to Matthias Koeppe, John Palmieri

slel · 2020-10-19T23:51:29Z

comment:39

What commit are you working on top of?

What does git log --oneline -20 say (or -3 if it's enough)?

jhpalmieri · 2020-10-19T23:56:04Z

comment:40

6d5cc43d09 (HEAD -> t/29557/29557-recommended-packages) trac 29557: recommended packages for homebrew
d198e9c5b7 build/pkgs/_recommended/distros/debian.txt: Format change
fe9ba0b00c build/pkgs/_recommended/distros/homebrew.txt: New
ea5d610b21 src/doc/bootstrap: Generate debian-recommended.txt etc
2cd5ef99ee build/pkgs/_recommended: New

mkoeppe · 2020-10-20T00:00:32Z

comment:41

go for the force push. It's possible that you had a branch under your name previously that can't be fast-forwarded

jhpalmieri · 2020-10-20T00:05:30Z

Changed branch from u/mkoeppe/29557-recommended-packages to u/jhpalmieri/29557-recommended-packages

jhpalmieri · 2020-10-20T00:09:01Z

comment:43

Replying to @mkoeppe:

go for the force push. It's possible that you had a branch under your name previously that can't be fast-forwarded

Done

New commits:

`6d5cc43`	`trac 29557: recommended packages for homebrew`

jhpalmieri · 2020-10-20T00:09:01Z

Changed commit from d198e9c to 6d5cc43

mkoeppe · 2020-10-20T00:30:08Z

comment:45

We could update the installation manual, in src/doc/en/installation/source.rst, using the generated files, but probably it's best to leave this for another ticket.

mkoeppe · 2020-10-20T00:30:41Z

Reviewer: ..., Matthias Koeppe

jhpalmieri · 2020-10-20T18:22:24Z

Changed reviewer from ..., Matthias Koeppe to John Palmieri, Matthias Koeppe

jhpalmieri · 2020-10-20T18:22:24Z

comment:47

This looks good to me, although I can't really vouch for the recommendations on debian. It's certainly a good start, and people can supplement on later tickets.

vbraun · 2020-10-31T18:08:09Z

Changed branch from u/jhpalmieri/29557-recommended-packages to 6d5cc43

jhpalmieri · 2020-11-01T19:27:46Z

comment:51

On OS X, I see this:

configure:40015: notice: the following SPKGs did not find equivalent system packages: _recommended arb brial cbc cddlib cliquer cmake coxeter3 eclib ecm fflas_ffpack flint flintqs fplll gf2x gfan giac givaro gp2c iml lcalc libbraiding libsemigroups lrcalc m4ri m4rie ntl palp pari pari_elldata pari_galdata pari_galpol pari_nftables pari_seadata pari_seadata_small perl_cpan_polymake_prereq perl_term_readline_gnu planarity rw symmetrica sympow tachyon zn_poly
configure:40017: checking for the package system in use
configure:40020: result: homebrew
configure:40029: hint: installing the following system packages is recommended and may avoid building some of the above SPKGs from source:
configure:40031:   $ brew install pandoc ffmpeg imagemagick texinfo cmake

On a follow-up, we could improve this message. First, these recommended packages don't actually help to avoid building any of the listed SPKGs. Second, this message is printed regardless of whether ffmpeg et al. are installed. Third, I actually have pandoc installed, it is correctly detected by ./configure, but it recommends installing it anyway.

jhpalmieri · 2020-11-01T19:27:46Z

Changed commit from 6d5cc43 to none

mkoeppe · 2020-11-01T19:39:37Z

comment:52

Note there's also a separate pandoc script package

mkoeppe · 2020-11-01T19:47:27Z

comment:53

For improvements of this type, please see #29146, #29372

jhpalmieri · 2020-11-02T00:30:40Z

comment:54

Replying to @mkoeppe:

Note there's also a separate pandoc script package

Right, and that correctly detects my pandoc installation, so it would be nice if the ending message took that into account. The ending message automatically prints every recommended external package, even those which are installed and have corresponding script packages.

slel · 2020-11-02T14:47:49Z

comment:55

Replying to jhpalmieri (comment 51):

On a follow-up, we could improve this message. First, these recommended
packages don't actually help to avoid building any of the listed SPKGs.
Second, this message is printed regardless of whether ffmpeg et al.
are installed. Third, I actually have pandoc installed, it is correctly
detected by ./configure, but it recommends installing it anyway.

See:

Improve wording and formatting of configure's recommendation message #30624: Improve configure's recommendation message

tobiasdiez · 2020-11-02T18:34:12Z

comment:56

The package texlive-generic-extra doesn't exist for ubuntu 20.04, and on 18.04 it was already labeled as "transitional dummy package". I'm not sure what's the correct replacement, maybe simply "texlive"?

mkoeppe · 2020-11-17T02:17:53Z

comment:57

Follow-up regarding the package list at #30930

mkoeppe added this to the sage-9.1 milestone Apr 23, 2020

mkoeppe added c: documentation labels Apr 23, 2020

This comment has been minimized.

Sign in to view

mkoeppe added the s: needs review label Oct 20, 2020

mkoeppe modified the milestones: sage-9.3, sage-9.2 Oct 20, 2020

mkoeppe added s: positive review and removed s: needs review labels Oct 20, 2020

mkoeppe modified the milestones: sage-9.2, sage-9.3 Oct 24, 2020

vbraun removed the s: positive review label Oct 31, 2020

vbraun closed this as completed in fe238b0 Oct 31, 2020

This comment has been minimized.

Sign in to view

embray mentioned this issue Jul 25, 2020

Update README.md and Installation Manual for 9.1, integrate instructions for Windows (WSL and Cygwin) in manuals #25206

Closed

Add script package _recommended and generate "recommended system packages" info #29557

Add script package _recommended and generate "recommended system packages" info #29557

Comments

mkoeppe commented Apr 23, 2020

mkoeppe commented Apr 23, 2020

egourgoulhon commented Apr 23, 2020

egourgoulhon commented Apr 23, 2020

This comment has been minimized.

mkoeppe commented Apr 24, 2020

mkoeppe commented Apr 25, 2020

sagetrac-git mannequin commented Apr 25, 2020

sagetrac-git mannequin commented Apr 25, 2020

sagetrac-git mannequin commented Apr 25, 2020

sagetrac-git mannequin commented Apr 25, 2020

mkoeppe commented Apr 25, 2020

mkoeppe commented Apr 25, 2020

jhpalmieri commented Apr 25, 2020

jhpalmieri commented Apr 25, 2020

jhpalmieri commented Apr 25, 2020

sagetrac-git mannequin commented Apr 25, 2020

sagetrac-git mannequin commented Apr 25, 2020

mkoeppe commented Apr 25, 2020

sagetrac-git mannequin commented Apr 25, 2020

sagetrac-git mannequin commented Apr 25, 2020

jhpalmieri commented Apr 25, 2020

mkoeppe commented Apr 25, 2020

kliem commented Apr 28, 2020

slel commented Apr 28, 2020

mkoeppe commented Apr 28, 2020

mkoeppe commented May 4, 2020

slel commented Oct 19, 2020

jhpalmieri commented Oct 19, 2020

mkoeppe commented Oct 20, 2020

jhpalmieri commented Oct 20, 2020

jhpalmieri commented Oct 20, 2020

jhpalmieri commented Oct 20, 2020

mkoeppe commented Oct 20, 2020

mkoeppe commented Oct 20, 2020

jhpalmieri commented Oct 20, 2020

jhpalmieri commented Oct 20, 2020

vbraun commented Oct 31, 2020

jhpalmieri commented Nov 1, 2020

jhpalmieri commented Nov 1, 2020

mkoeppe commented Nov 1, 2020

mkoeppe commented Nov 1, 2020

jhpalmieri commented Nov 2, 2020

This comment has been minimized.

slel commented Nov 2, 2020

tobiasdiez commented Nov 2, 2020

mkoeppe commented Nov 17, 2020