Improve build/pkgs/*/SPKG.rst

[mkoeppe]

With #29633, we now generate a full list of packages that Sage uses (with links to documentation - see #27495)
for the reference manual from information in build/pkgs/*/SPKG.rst (which used to be SPKG.txt).

The purpose of this ticket is to improve the SPKG.rst files and the scripts that transform them to generate a part of the Sage reference manual.

1. If other sources have better information than what is in build/pkgs, update build/pkgs accordingly. (See https://wiki.sagemath.org/SageWiki)

   • (done:) https://github.com/sagemath/website/blob/master/conf/packages.yaml (which is used for generating http://www.sagemath.org/links-components.html)
   • (done:) https://wiki.sagemath.org/spkg (another incomplete list of packages)
   • src/doc/en/installation/standard_packages.rst (yet another incomplete list of packages)

2. Delete/archive the obsolete other sources.

   • Replace components by link to spkg section in the reference manual website#212 removes packages.yaml
   • https://wiki.sagemath.org/spkg has been cleared

3. Change the titles of the SPKG.rst files to use the format "spkg_name: Short description". This will improve the table of contents shown in https://doc.sagemath.org/html/en/reference/spkg/index.html, which the Sage website is pointing to after Replace components by link to spkg section in the reference manual website#212

4. Extend build/bin/sage-spkg-info and use it to format additional information from build/pkgs/SPKG/.

5. In addition to the full alphabetical list of packages, also show the standard packages, the optional packages, and the experimental packages separately.

Follow-up:

• Move Python SPKGs to subfolder pypi/, rename to match their PyPI name #31136 Rename SPKGs to match their PyPI name

Depends on #29745
Depends on #30955

CC: @jhpalmieri @kiwifb @fchapoton @dimpase @slel @defeo @seblabbe

Component: documentation

Keywords: sd109, sd111

Author: Matthias Koeppe

Branch/Commit: 49ad8ae

Reviewer: Dima Pasechnik

Issue created by migration from https://trac.sagemath.org/ticket/29655

[mkoeppe]

Changed keywords from none to sd109

[mkoeppe]

Dependencies: #29745

[mkoeppe]

Changed keywords from sd109 to sd109, sd111

[mkoeppe]

Branch: u/mkoeppe/improve_build_pkgs___spkg_rst

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

7ad2d92

build/pkgs/a*/SPKG.rst: Update from https://wiki.sagemath.org/spkg

[sagetrac-git]

Commit: 7ad2d92

[sagetrac-git]

Changed commit from 7ad2d92 to 316a7d2

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

ea524ae	build/pkgs/beautifulsoup4/SPKG.rst: New, from pypi and https://wiki.sagemath.org/spkg
b6f40ac	build/pkgs/biopython/SPKG.rst: New, from pypi and https://wiki.sagemath.org/spkg
316a7d2	build/pkgs/b*/SPKG.rst: Update from https://wiki.sagemath.org/spkg

[sagetrac-git]

Changed commit from 316a7d2 to 546e15a

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

546e15a

build/pkgs/*/SPKG.rst: Update remaining packages from https://wiki.sagemath.org/spkg

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

e08928d

build/pkgs/[e-z]*/SPKG.rst: Update from website conf/packages.yaml

[sagetrac-git]

Changed commit from 546e15a to e08928d

[mkoeppe]

Author: Matthias Koeppe

[mkoeppe]

Changed dependencies from #29745 to #29745, #30955

[sagetrac-git]

Changed commit from e08928d to 5e61388

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

23c4903	src/doc/bootstrap: sort the SPKG list
b98bcbb	for f in build/pkgs/*/SPKG.txt; do pandoc --from=mediawiki --to=rst $f --output=$(dirname $f)/SPKG.rst; git rm -f $f; git add $(dirname $f)/SPKG.rst; done
047ffcb	build/pkgs/*/SPKG.rst: Remove remaining changelogs
224059a	Fix up RST syntax
5fe3989	Merge branch 't/30955/change_remaining_spkg_txt_to_spkg_rst' into t/29655/improve_build_pkgs___spkg_rst
5e61388	build/pkgs/[0-b]*/SPKG.rst: Reformat title in format 'spkg_name: Short description'

[sagetrac-git]

Changed commit from 5e61388 to ba4ac57

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

ba4ac57

build/pkgs/[b-c]*/SPKG.rst: Reformat title in format 'spkg_name: Short description'

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

897d8bd

build/pkgs/[c-d]*/SPKG.rst: Reformat title in format 'spkg_name: Short description'

[sagetrac-git]

Changed commit from ba4ac57 to 897d8bd

[dimpase]

Changed branch from u/mkoeppe/improve_build_pkgs___spkg_rst to u/dimpase/improve_build_pkgs___spkg_rst

[dimpase]

New commits:

54d4fb1

extra line after version

[dimpase]

Changed commit from 58c63e1 to 54d4fb1

[dimpase]

comment:42

lgtm

[dimpase]

Reviewer: Dima Pasechnik

[mkoeppe]

comment:43

Thanks!

[mkoeppe]

Changed branch from u/dimpase/improve_build_pkgs___spkg_rst to u/mkoeppe/improve_build_pkgs___spkg_rst

[mkoeppe]

New commits:

2eac7a1	src/doc/bootstrap: Use sage-spkg-info directly instead of 'sage --info', much faster now
3fe8d4c	src/sage/tests/cmdline.py: Adjust doctests

[mkoeppe]

Changed commit from 54d4fb1 to 3fe8d4c

[sagetrac-git]

Changed commit from 3fe8d4c to 49ad8ae

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

49ad8ae

src/sage/tests/cmdline.py: Adjust doctest properly

[dimpase]

comment:48

OK, good

[mkoeppe]

comment:49

Thanks!

[vbraun]

Changed branch from u/mkoeppe/improve_build_pkgs___spkg_rst to 49ad8ae