external/aurweb
0
0
Fork 0
mirror of https://gitlab.archlinux.org/archlinux/aurweb.git synced 2025-02-03 10:43:03 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat(mkpkglists): added metadata archives

Browse source 
Two new archives are available:

- packages-meta-v1.json.gz
    - RPC search formatted data for all packages
    - ~2.1MB at the time of writing.
- packages-meta-ext-v1.json.gz (via --extended)
    - RPC multiinfo formatted data for all packages.
    - ~9.8MB at the time of writing.

New dependencies are required for this update:

- `python-orjson`

All archives served out by aur.archlinux.org distribute the Last-Modified
header and support the If-Modified-Since header, which should be
populated with Last-Modified's value. These should be used by clients
to avoid redownloading the archive when unnecessary.

Additionally, the new meta archives contain a format suitable for
streaming the data as the file is retrieved. It is still in JSON
format, however, users can parse package objects line by line after
the first '[' found in the file, until the last ']'; both contained
on their own lines.

Note: This commit is a documentation change and commit body.

Signed-off-by: Kevin Morris <kevr@0cost.org>
This commit is contained in:
Kevin Morris 2021-11-06 16:23:08 -07:00
parent f3f662c696
commit d62af4ceb5
No known key found for this signature in database
GPG key ID: F7E46DED420788F3
1 changed files with 3 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
doc/maintenance.txt
View file

@ -70,7 +70,8 @@ computations and clean up the database:
* aurweb-pkgmaint automatically removes empty repositories that were created * aurweb-pkgmaint automatically removes empty repositories that were created
within the last 24 hours but never populated. within the last 24 hours but never populated.
* aurweb-mkpkglists generates the package list files. * aurweb-mkpkglists generates the package list files; it takes an optional
--extended flag, which additionally produces multiinfo metadata.
* aurweb-usermaint removes the last login IP address of all users that did not * aurweb-usermaint removes the last login IP address of all users that did not
login within the past seven days. login within the past seven days.
@ -79,7 +80,7 @@ These scripts can be installed by running `python3 setup.py install` and are
usually scheduled using Cron. The current setup is: usually scheduled using Cron. The current setup is:
---- ----
*/5 * * * * aurweb-mkpkglists */5 * * * * aurweb-mkpkglists [--extended]
1 */2 * * * aurweb-popupdate 1 */2 * * * aurweb-popupdate
2 */2 * * * aurweb-aurblup 2 */2 * * * aurweb-aurblup
3 */2 * * * aurweb-pkgmaint 3 */2 * * * aurweb-pkgmaint