Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI build, doc-build: Run containers explicitly, separate jobs for pyright, build, modularized tests, long tests #36498

Merged
merged 171 commits into from
May 2, 2024
Merged
Show file tree
Hide file tree
Changes from 154 commits
Commits
Show all changes
171 commits
Select commit Hold shift + click to select a range
4dc68ec
.ci/docker-exec-script.sh: New
mkoeppe Oct 21, 2023
8c845bc
.github/workflows/doc-build.yml: Run container explicitly
mkoeppe Oct 22, 2023
e1ce9fe
.github/workflows/doc-build-pdf.yml: Run container explicitly
mkoeppe Nov 1, 2023
413f600
Merge branch 'ci_docbuild_pdf_no_html' into ci_build_explicit_docker_…
mkoeppe Nov 1, 2023
461aeb8
Merge branch 'ci_docbuild_explicit_docker_exec' into ci_build_explici…
mkoeppe Nov 1, 2023
cbb9ce7
Merge branch 'ci_coverage_fixup' into ci_build_explicit_docker_exec
mkoeppe Nov 1, 2023
ae81f23
Merge branch 'ci_reduce_always' into ci_build_explicit_docker_exec
mkoeppe Nov 1, 2023
be7dacf
.github/workflows/build.yml: Run containers explicitly with docker ru…
mkoeppe Nov 1, 2023
4a3c700
.github/workflows/build.yml: Run tests from SAGE_ROOT as current dir
mkoeppe Oct 22, 2023
c7fa34f
.github/workflows/build.yml: Create coverage.xml in workspace, not co…
mkoeppe Nov 1, 2023
c62b121
.github/workflows/pyright.yml: New
mkoeppe Nov 1, 2023
caed8e3
Makefile (ci-build-with-fallback): New
mkoeppe Nov 1, 2023
ba92f3f
.github/workflows/build.yml: Separate jobs 'modularized', 'test-long'
mkoeppe Nov 1, 2023
13ca5ff
build/bin/write-dockerfile.sh: Only unminimize once
mkoeppe Oct 13, 2023
fb9582a
build/bin/write-dockerfile.sh, tox.ini (docker-incremental): Make inc…
mkoeppe Oct 11, 2023
0db6b1d
Use build kit, --cache-{from,to}=type=gha
mkoeppe Nov 2, 2023
7f352c8
Use --cache-to=type=gha,mode=max
mkoeppe Nov 2, 2023
3599733
tox.ini (docker): Pass ACTIONS_... variables
mkoeppe Nov 2, 2023
a158d39
.github/workflows/build.yml: Make 'modularized' a matrix job
mkoeppe Nov 2, 2023
7541781
.github/workflows/build.yml: Use docker/setup-buildx-action, docker/b…
mkoeppe Nov 2, 2023
46e0111
tox.ini: Fill some build-args in build/bin/write-dockerfile.sh
mkoeppe Nov 2, 2023
beb54a5
.github/workflows/build.yml: Use docker/setup-buildx-action, docker/b…
mkoeppe Nov 2, 2023
be4cc8c
build/bin/write-dockerfile.sh: eval FULL_BASE_IMAGE_AND_TAG to expand…
mkoeppe Nov 2, 2023
30de4fd
.github/workflows/build.yml: Include ghcr.io... in image name
mkoeppe Nov 2, 2023
430aaaa
.github/workflows/doc-build-pdf: Fix up merge
mkoeppe Nov 2, 2023
98f7f3a
Merge branch 'ci_docbuild_explicit_docker_exec' into ci_build_explici…
mkoeppe Nov 2, 2023
d6eccda
.github/workflows/build.yml: Remove unnecessary env vars
mkoeppe Nov 2, 2023
f82da4a
.github/workflows/doc-build.yml: Build container with cache, as in bu…
mkoeppe Nov 2, 2023
e0cd891
.github/workflows/doc-build.yml: Build container with cache, as in bu…
mkoeppe Nov 2, 2023
26bdc1f
.github/workflows/doc-build-pdf.yml: Build container with cache, as i…
mkoeppe Nov 2, 2023
a2a1524
.github/workflows/doc-build[-pdf].yml: Use /sage in container
mkoeppe Nov 2, 2023
d702f94
Merge branch 'p/doc-preview-for-all-languages' into ci_docbuild_expli…
mkoeppe Nov 3, 2023
438a61f
Merge branch 'ci_docbuild_explicit_docker_exec' into ci_build_explici…
mkoeppe Nov 3, 2023
6e8ec0f
.github/workflows/doc-build.yml: Run HTML diffing outside of the cont…
mkoeppe Nov 3, 2023
12e11d8
.github/workflows/[doc-]build[-pdf].yml: Use 'docker run --pull never…
mkoeppe Nov 3, 2023
70fe088
.github/workflows/[doc-]build[-pdf].yml: Retry if the built container…
mkoeppe Nov 3, 2023
261fbd9
.github/workflows/doc-build.yml: Run HTML diffing outside of the cont…
mkoeppe Nov 3, 2023
87e40a3
src/doc/Makefile (doc-pdf-other): Depend on doc-pdf-reference, not ..…
mkoeppe Nov 3, 2023
292cc89
.github/workflows/doc-build.yml: Run HTML diffing outside of the cont…
mkoeppe Nov 3, 2023
192e6b5
.github/workflows/[doc-]build[-pdf].yml: Refer to the built container…
mkoeppe Nov 3, 2023
12709e9
Revert "tox.ini (docker): Pass ACTIONS_... variables"
mkoeppe Nov 3, 2023
54a54bc
.github/workflows/doc-build-pdf.yml: Restore install of texlive
mkoeppe Nov 3, 2023
9670c86
.github/workflows/doc-build.yml: Fix output path
mkoeppe Nov 3, 2023
efe1051
Merge branch 'ci_reduce_always' into ci_docbuild_explicit_docker_exec
mkoeppe Nov 5, 2023
647e451
Merge remote-tracking branch 'upstream/develop' into ci_docbuild_expl…
mkoeppe Nov 5, 2023
80e8067
Merge branch 'ci_docbuild_explicit_docker_exec' into ci_build_explici…
mkoeppe Nov 5, 2023
38eb74a
.github/workflows/build.yml: Use a local registry
mkoeppe Nov 10, 2023
dd14ffd
.github/workflows/doc-build[-pdf].yml: Use a local registry
mkoeppe Nov 10, 2023
0aa347e
Merge tag '10.2.rc2' into ci_docbuild_explicit_docker_exec
mkoeppe Nov 13, 2023
dcf6d6d
.github/workflows/doc-build.yml: Use explicit docker exec also for li…
mkoeppe Nov 13, 2023
082585b
Merge branch 'p/deploy-live-doc-with-pdfs' into ci_docbuild_explicit_…
mkoeppe Nov 13, 2023
bff4219
Merge branch 'ci_docbuild_explicit_docker_exec' into ci_build_explici…
mkoeppe Nov 13, 2023
d9479b7
.github/workflows/[doc-]build[-pdf].yml: Free disk space
mkoeppe Nov 11, 2023
1fd1c5f
.github/workflows/build.yml: Fix location of .coverage
mkoeppe Nov 14, 2023
8ea64fe
Merge branch 'tox_coverage' into ci_build_explicit_docker_exec
mkoeppe Nov 16, 2023
8253cdf
src/tox.ini (coverage.py-xml): New
mkoeppe Nov 16, 2023
3097548
.github/workflows/build.yml: Run tests with coverage via tox
mkoeppe Nov 16, 2023
b8571ca
Merge tag '10.2.rc3' into ci_build_explicit_docker_exec
mkoeppe Nov 16, 2023
309d0a5
Add redirects to SAGE_ROOT/tox.ini
mkoeppe Nov 16, 2023
b4c35a8
build/bin/write-dockerfile.sh (incremental): Fix retrofitting of src/
mkoeppe Nov 16, 2023
041c3dd
.github/workflows/build.yml: Upload to codecov also on failed tests
mkoeppe Nov 16, 2023
a25a981
.github/workflows/build.yml: Copy coverage results from container in …
mkoeppe Nov 17, 2023
54b453b
Merge tag '10.2.rc4' into ci_build_explicit_docker_exec
mkoeppe Nov 18, 2023
7420be8
Merge tag '10.3.beta1' into ci_build_explicit_docker_exec
mkoeppe Dec 10, 2023
faccef1
src/sage/misc/package.py: Update # needs from #35095
mkoeppe Dec 11, 2023
deffac2
.ci/create-changes-html.sh: Quoting fix
mkoeppe Dec 11, 2023
7f982bb
.github/workflows/ci-conda-known-test-failures.json: Add random failu…
mkoeppe Dec 20, 2023
66c20ab
Merge branch 'doctester-github-annotations--prod' into ci_build_expli…
mkoeppe Dec 21, 2023
218f67e
Merge branch 'doctester-github-annotations--prod' into ci_build_expli…
mkoeppe Dec 21, 2023
c3806cf
Merge branch 'doctester-github-annotations--prod' into ci_build_expli…
mkoeppe Dec 21, 2023
ee0cb6b
.github/workflows/ci-conda-known-test-failures.json: Add https://gith…
mkoeppe Dec 21, 2023
fed6570
.github/workflows/ci-conda-known-test-failures.json: Add https://gith…
mkoeppe Dec 21, 2023
22ef486
.github/workflows/ci-conda-known-test-failures.json: Add some failure…
mkoeppe Dec 21, 2023
5e5d720
Merge branch 'doctester-baselinestats-improvement' into ci_conda_more…
mkoeppe Dec 21, 2023
179ebb4
.github/workflows/ci-conda-known-test-failures.json: Add references f…
mkoeppe Dec 21, 2023
b41999b
.github/workflows/ci-conda-known-test-failures.json: Add details from…
mkoeppe Dec 21, 2023
63b8b10
src/sage/doctest/reporting.py: Include message in '[failed in baselin…
mkoeppe Dec 21, 2023
7052139
Merge branch 'doctester-github-annotations--prod' into ci_build_expli…
mkoeppe Dec 21, 2023
0de4c5b
Merge branch 'ci_conda_more_known_failures' into ci_build_explicit_do…
mkoeppe Dec 21, 2023
2cab6c6
Merge branch 'doctester-github-annotations--prod' into ci_build_expli…
mkoeppe Dec 23, 2023
3b835a4
Merge remote-tracking branch 'upstream/develop' into ci_build_explici…
mkoeppe Dec 26, 2023
9de2dea
Merge branch 'doctester-github-annotations--prod' into ci_build_expli…
mkoeppe Jan 5, 2024
08526f7
Merge branch 'sagemath_standard_pyproject_toml' into ci_build_explici…
mkoeppe Jan 5, 2024
521da1e
Merge branch 'doctester-github-annotations--prod' into ci_build_expli…
mkoeppe Jan 14, 2024
aed04c0
Merge remote-tracking branch 'origin/sagemath_standard_pyproject_toml…
mkoeppe Feb 3, 2024
0901256
Merge branch 'sagemath_standard_pyproject_toml' into ci_build_explici…
mkoeppe Feb 14, 2024
388311a
Merge remote-tracking branch 'upstream/develop' into ci_build_explici…
mkoeppe Mar 22, 2024
2bc4143
.github/workflows/*build*.yml: Update use of easimon/maximize-build-s…
mkoeppe Mar 22, 2024
bc2585c
.github/workflows/*build*.yml: Update NUMPROC, SAGE_NUMTHREADS etc. f…
mkoeppe Mar 22, 2024
6888dc7
.github/workflows/doc-build.yml: fixup
mkoeppe Mar 22, 2024
0662491
Merge branch 'sagemath_standard_pyproject_toml' into ci_build_explici…
mkoeppe Apr 1, 2024
01beb47
Merge branch 'ci_linux_2024_02' into ci_build_explicit_docker_exec
mkoeppe Apr 5, 2024
793ae73
build/pkgs/sagemath_*/spkg-check: Replace by spkg-check.in from #35095
mkoeppe Apr 5, 2024
b163a9b
.github/workflows/ci-linux-incremental.yml: Do not run on changes to …
mkoeppe Apr 5, 2024
d236c0b
Merge branch 'sagemath-categories-check' into ci_build_explicit_docke…
mkoeppe Apr 5, 2024
95641d3
pkgs/sagemath-{objects,categories,environment,repl}/tox.ini: Update f…
mkoeppe Apr 5, 2024
cca2b8d
pkgs/sagemath-{objects,categories,environment,repl}/tox.ini: Replace …
mkoeppe Apr 5, 2024
8bad57c
Merge branch 'sagemath-categories-check' into ci_build_explicit_docke…
mkoeppe Apr 5, 2024
a8bffd3
build/pkgs/sagemath_{objects,categories,environment,repl}: Back to us…
mkoeppe Apr 6, 2024
77fa23b
CythonFeature: Do not fail on Python 3.12 without setuptools
mkoeppe Apr 6, 2024
3032102
Merge branch 'sagemath-categories-check' into ci_build_explicit_docke…
mkoeppe Apr 6, 2024
05aec74
pkgs/sagemath-repl/pyproject.toml.m4: Add dependencies ipykernel, jup…
mkoeppe Apr 6, 2024
9255a38
pkgs/sagemath-{repl,categories}/tox.ini: Set PYDEVD_DISABLE_FILE_VALI…
mkoeppe Apr 6, 2024
bdb342c
pkgs/sagemath-categories/known-test-failures.json: Update
mkoeppe Apr 6, 2024
45d757a
Merge branch 'sagemath-categories-check' into ci_build_explicit_docke…
mkoeppe Apr 6, 2024
87a042a
**/tox.ini: Set upper bound tox < 4.14.1 because of https://github.co…
mkoeppe Apr 6, 2024
79a18d5
Merge branch 'sagemath-categories-check' into ci_build_explicit_docke…
mkoeppe Apr 6, 2024
cd5a53a
Revert "pkgs/sagemath-{objects,categories,environment,repl}/tox.ini: …
mkoeppe Apr 6, 2024
7db5448
pkgs/sagemath-{repl,categories,environment,objects}/requirements-edit…
mkoeppe Apr 6, 2024
ed2b089
**/tox.ini: Set upper bound tox < 4.14.1 because of https://github.co…
mkoeppe Apr 6, 2024
8415f0a
Merge branch 'sagemath-categories-check' into ci_build_explicit_docke…
mkoeppe Apr 6, 2024
a4e925f
tox.ini: Fix 'requires' for autoprovisioning on tox 3
mkoeppe Apr 6, 2024
32ef4d0
Merge branch 'sagemath-categories-check' into ci_build_explicit_docke…
mkoeppe Apr 6, 2024
10d1ae9
Merge branch 'ci_linux_2024_02' into ci_build_explicit_docker_exec
mkoeppe Apr 6, 2024
10ba45c
Merge branch 'sagemath_standard_pyproject_toml' into ci_build_explici…
mkoeppe Apr 9, 2024
6333308
.github/workflows/build.yml: Rename jobs as test-new, test-mod, test-…
mkoeppe Apr 10, 2024
afe72b2
.github/workflows/pyright.yml: Upgrade to ubuntu-jammy here too
mkoeppe Apr 10, 2024
17583ab
.github/workflows/build.yml: Add documentation
mkoeppe Apr 11, 2024
c18ba75
build/bin/write-dockerfile.sh: Add documentation for 'unminimize'
mkoeppe Apr 11, 2024
e0d5253
build/pkgs/sagemath_*/spkg-check: Replace by spkg-check.in from #35095
mkoeppe Apr 5, 2024
3e7798f
.github/workflows/ci-linux-incremental.yml: Do not run on changes to …
mkoeppe Apr 5, 2024
8943239
pkgs/sagemath-{objects,categories,environment,repl}/tox.ini: Update f…
mkoeppe Apr 5, 2024
17dd1bc
pkgs/sagemath-{objects,categories,environment,repl}/tox.ini: Replace …
mkoeppe Apr 5, 2024
190b657
build/pkgs/sagemath_{objects,categories,environment,repl}: Back to us…
mkoeppe Apr 6, 2024
b144d8c
CythonFeature: Do not fail on Python 3.12 without setuptools
mkoeppe Apr 6, 2024
e7b66fe
pkgs/sagemath-repl/pyproject.toml.m4: Add dependencies ipykernel, jup…
mkoeppe Apr 6, 2024
039bb06
pkgs/sagemath-{repl,categories}/tox.ini: Set PYDEVD_DISABLE_FILE_VALI…
mkoeppe Apr 6, 2024
650a743
pkgs/sagemath-categories/known-test-failures.json: Update
mkoeppe Apr 12, 2024
bb8e258
**/tox.ini: Set upper bound tox < 4.14.1 because of https://github.co…
mkoeppe Apr 6, 2024
f77bb61
Revert "pkgs/sagemath-{objects,categories,environment,repl}/tox.ini: …
mkoeppe Apr 6, 2024
7da30ed
pkgs/sagemath-{repl,categories,environment,objects}/requirements-edit…
mkoeppe Apr 6, 2024
59e2911
**/tox.ini: Set upper bound tox < 4.14.1 because of https://github.co…
mkoeppe Apr 6, 2024
6d4ee48
tox.ini: Fix 'requires' for autoprovisioning on tox 3
mkoeppe Apr 6, 2024
b3f1cd7
Merge branch 'sagemath-categories-check' into ci_build_explicit_docke…
mkoeppe Apr 12, 2024
b2c1131
src/sage/doctest/reporting.py: Add missing # needs SAGE_SRC
mkoeppe Apr 13, 2024
36ce98c
build/pkgs/pip: Update to 24.0
mkoeppe Feb 10, 2024
dd24158
build/pkgs/setuptools: Update to 69.0.3
mkoeppe Feb 10, 2024
8bfd3ff
build/pkgs/hatchling: Update to 1.21.1
mkoeppe Feb 10, 2024
fc139cb
build/pkgs/hatch_fancy_pypi_readme: Update to 24.1.0
mkoeppe Feb 10, 2024
f51abda
build/pkgs/setuptools: Update to 69.1.0
mkoeppe Feb 12, 2024
451db04
build/pkgs/setuptools: Update to 69.1.1
mkoeppe Feb 24, 2024
b5cc0ac
build/pkgs/setuptools: Update to 69.2.0
mkoeppe Mar 27, 2024
d4481b8
build/pkgs/wheel: Update to 0.43.0
mkoeppe Mar 27, 2024
8cac22c
build/pkgs/packaging: Update to 24.0
mkoeppe Mar 27, 2024
05f9b74
build/pkgs/platformdirs: Update to 4.2.0
mkoeppe Mar 27, 2024
1788024
build/pkgs/hatchling: Update to 1.22.5
mkoeppe Apr 14, 2024
02e2ddc
build/pkgs/trove_classifiers: Update to 2024.4.10
mkoeppe Apr 14, 2024
2a8a958
**/tox.ini: Fix format of [tox] requires
mkoeppe Apr 15, 2024
412e3d1
Merge branch 'sagemath-categories-check' into ci_build_explicit_docke…
mkoeppe Apr 16, 2024
fce35c8
build/pkgs/setuptools: Update to 69.5.1
mkoeppe Apr 17, 2024
a177ef2
src/sage/misc/package.py: Make 'prompt-toolkit' doctest pass with all…
mkoeppe Apr 25, 2024
d2bee8e
src/sage/misc/package.py: Make comment more specific
mkoeppe Apr 25, 2024
944144b
build/pkgs/sagemath_*/spkg-check: Replace by spkg-check.in from #35095
mkoeppe Apr 5, 2024
2cbf026
.github/workflows/ci-linux-incremental.yml: Do not run on changes to …
mkoeppe Apr 5, 2024
4ee5c25
pkgs/sagemath-{objects,categories,environment,repl}/tox.ini: Update f…
mkoeppe Apr 5, 2024
4a8723f
pkgs/sagemath-{objects,categories,environment,repl}/tox.ini: Replace …
mkoeppe Apr 5, 2024
244ceef
build/pkgs/sagemath_{objects,categories,environment,repl}: Back to us…
mkoeppe Apr 6, 2024
1511066
CythonFeature: Do not fail on Python 3.12 without setuptools
mkoeppe Apr 6, 2024
062f269
pkgs/sagemath-repl/pyproject.toml.m4: Add dependencies ipykernel, jup…
mkoeppe Apr 6, 2024
4cc3ccc
pkgs/sagemath-{repl,categories}/tox.ini: Set PYDEVD_DISABLE_FILE_VALI…
mkoeppe Apr 6, 2024
ee547fa
**/tox.ini: Set upper bound tox < 4.14.1 because of https://github.co…
mkoeppe Apr 6, 2024
3f87323
Revert "pkgs/sagemath-{objects,categories,environment,repl}/tox.ini: …
mkoeppe Apr 6, 2024
388dd3b
pkgs/sagemath-{repl,categories,environment,objects}/requirements-edit…
mkoeppe Apr 6, 2024
7e6017c
**/tox.ini: Set upper bound tox < 4.14.1 because of https://github.co…
mkoeppe Apr 6, 2024
be01f00
tox.ini: Fix 'requires' for autoprovisioning on tox 3
mkoeppe Apr 6, 2024
ae34707
src/sage/doctest/reporting.py: Add missing # needs SAGE_SRC
mkoeppe Apr 13, 2024
aba5aec
**/tox.ini: Fix format of [tox] requires
mkoeppe Apr 15, 2024
6d704b0
sage -fixdoctests --distribution sagemath-categories --update-known-t…
mkoeppe Apr 28, 2024
9731d0f
Merge branch 'sagemath-categories-check' into ci_build_explicit_docke…
mkoeppe Apr 28, 2024
39d52a3
Merge branch 'pip-24' into ci_build_explicit_docker_exec
mkoeppe Apr 30, 2024
a6224a3
.github/workflows/doc-build.yml: Update mathjax_path_from as suggested
mkoeppe Apr 30, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .ci/create-changes-html.sh
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ diffParagraphs.forEach(paragraph => {
EOF
echo '</head>' >> CHANGES.html
echo '<body>' >> CHANGES.html
(cd $DOC_REPOSITORY && git diff $BASE_DOC_COMMIT -- *.html) > diff.txt
(cd $DOC_REPOSITORY && git diff $BASE_DOC_COMMIT -- "*.html") > diff.txt
python3 - << EOF
import os, re, html
with open('diff.txt', 'r') as f:
Expand Down
14 changes: 14 additions & 0 deletions .ci/docker-exec-script.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
#!/bin/sh -x
if [ $# -lt 3 ]; then
echo >&2 "usage: docker-exec-script.sh CONTAINER WORKDIR [VAR=VALUE...] SCRIPT"
exit 1
fi
CONTAINER=$1
WORKDIR=$2
shift 2
(echo "cd \"$WORKDIR\"";
while [ $# -gt 1 ]; do
echo "export \"$1\""
shift
done;
cat "$1") | docker exec -i $CONTAINER bash -ex
Loading
Loading