Get Gentoo!
gentoo.org sites
gentoo.org Wiki Bugs Forums Packages
Planet Archives Sources
Infra Status
summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* snapshots-create.sh: support alt vars source20191221T144059ZRobin H. Johnson2019-12-211-1/+2
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: fix cleanup of EXCLUSION_LISTRobin H. Johnson2019-12-211-1/+1
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: fix overquotingRobin H. Johnson2019-12-211-7/+7
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: SC2066Robin H. Johnson2019-12-211-0/+1
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: fix SC2143Robin H. Johnson2019-12-211-1/+1
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: fix SC2006Robin H. Johnson2019-12-211-2/+2
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: improve cleanup codeRobin H. Johnson2019-12-211-5/+7
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: minor readability improvement20191221T130302ZRobin H. Johnson2019-12-211-2/+6
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: shellcheck cleanupsRobin H. Johnson2019-12-211-19/+19
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: change back to manual creation of new tarballRobin H. Johnson2019-12-211-9/+27
| | | | | | | | Perl Archive::Tar::Stream does not handle gnutar archives correctly if the file names are long. Fixes: https://bugs.gentoo.org/703460 Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: refactor tar options and include full tarformat rationaleRobin H. Johnson2019-12-211-24/+45
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create: fix subtle bug in creation of portage-YYYYMMDD.tar.xz.umd5sum20191215T054826ZRobin H. Johnson2019-12-141-1/+1
| | | | | | | | The earlier fix where $FILENAME was hardcoded in a loop: for f in $FILENAME other_files ; do ... ($FILENAME) ... ; done; Meant that portage-YYYYMMDD.tar.xz.umd5sum wasn't created anymore Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: fix gentoo*umd5sum20191209T233345ZRobin H. Johnson2019-12-091-2/+8
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots_create: handle alternate previous snapshots20191208T062327ZRobin H. Johnson2019-12-071-2/+10
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-creat: more safety around validity checksRobin H. Johnson2019-12-071-1/+1
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create: implement new output file for bug #57475220191207T075744ZRobin H. Johnson2019-12-061-3/+58
| | | | | | | | | | | Write a new output file gentoo-YYYYMMDD.tar.xz with the initial path element being gentoo-YYYYMMDD Do it by transforming the main tarball, rather than recreating an entirely new run of tar (which requires seeks). Fixes: https://bugs.gentoo.org/574752 Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* tar-transform-names.pl: new tool to do stream modification of tarballRobin H. Johnson2019-12-061-0/+80
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create: refactor20191207T072430ZRobin H. Johnson2019-12-061-10/+26
| | | | | | | | Some cleanups before new functionality. - Generate print-exclusion-list seperately before tarball - Defer all compression until the tarball sanity check Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* Revert "snapshots-create: start to implement bug 574752"Robin H. Johnson2019-12-061-59/+1
| | | | | | | | This reverts commit 62687286e02f6f7862cfff39c0bb82862fa493da. Alternate implemention coming, merging with cleanups first. Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create: start to implement bug 574752Michał Górny2019-12-051-1/+59
| | | | | | Source: https://bugs.gentoo.org/attachment.cgi?id=589026 Reference: https://bugs.gentoo.org/574752 Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* Update copyrightsRobin H. Johnson2019-12-0518-18/+19
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* sync-distfiles.sh: better rotation of INDEX files to verify changesRobin H. Johnson2019-12-051-2/+11
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* Create a INDEX of distfiles20191017T144330ZMichał Górny2019-10-171-0/+4
| | | | Signed-off-by: Michał Górny <mgorny@gentoo.org>
* sync-distfiles: Start propagating new mirror layout20191016T193130ZMichał Górny2019-10-162-0/+5
| | | | Signed-off-by: Michał Górny <mgorny@gentoo.org>
* rsync-gen: Restrict Manifest removal to metadata/ subdir20180614T173057ZMichał Górny2018-06-141-1/+1
|
* rsync-gen: Delete stale Manifests from metadata/ manually20180614T155352ZMichał Górny2018-06-141-3/+6
|
* rsync-gen: Try R/P the other way around20180614T145813ZMichał Górny2018-06-141-1/+1
|
* rsync: Fix cleaning up stale Manifests from metadata/20180614T131445ZMichał Górny2018-06-141-0/+3
| | | | | | Allow rsync to remove stale Manifests from metadata/ tree. Otherwise, stale Manifests are left in place and cause breakage e.g. when a category is removed.
* rsync-gen.sh: prepare to switch to system gemato20180606T183930ZRobin H. Johnson2018-06-061-2/+16
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* rsyncgen: switch to py3.620180521T191503ZRobin H. Johnson2018-05-211-1/+1
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* Add blackcap as a mastermirror.Alec Warner2018-03-191-0/+1
|
* Avoid manual intervention when we miss a snapshot.Alec Warner2018-03-191-6/+19
| | | | | If yesterday's snapshot is missing, scan for the last successful snapshot.
* Switch to using fully qualified prefix.productionAlec Warner2018-03-061-1/+1
| | | | | Other parts of the script already use /usr/local/bin/mastermirror as a prefix for fully specified paths; so do it for exclusions too.
* rsync-gen.sh: Fix not restoring ManifestsMichał Górny2017-11-251-1/+1
|
* rsync-gen: Sign Manifests via generation scriptMichał Górny2017-11-251-33/+3
|
* rsync-gen.sh: only sign toplevel Manifest for now, gemato bug.Robin H. Johnson2017-11-241-1/+2
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* rsync-gen.sh: gpg needs output file to NOT existRobin H. Johnson2017-11-241-0/+1
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* rsync-gen.sh: show exact command in error.Robin H. Johnson2017-11-241-3/+7
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* rsync-gen.sh/signing: improve variables and log entries.Robin H. Johnson2017-11-241-4/+8
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* rsync-gen.sh: engage GPG signing of MetaManifest.Robin H. Johnson2017-11-241-3/+29
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: improve gpg key check.Robin H. Johnson2017-11-241-1/+2
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* Move GPG key details to vars.Robin H. Johnson2017-11-242-5/+11
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create: use long keyid for signing.Robin H. Johnson2017-11-241-4/+4
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* rsync-gen.sh: Fix verbose verification outputMichał Górny2017-11-241-1/+1
|
* rsync-gen.sh: Verify the MetaManifestMichał Górny2017-11-241-4/+1
|
* rsync-gen.sh: Generate MetaManifests using gemato utility scriptMichał Górny2017-11-241-39/+21
|
* rsync-gen: Stop preserving mtimes from the git repositoryMichał Górny2017-11-241-7/+7
| | | | | | | | | | | | | | | | | | | | | | | | The rsync pipeline is currently set to try to set mtimes of git repository files to the time of last commit affecting them, and then preserve that mtime to the final repository. This has little value for end users, and causes two significant problems: 1. If the original mtime is wrong (i.e. a commit had wrong timestamp), timestamps are not guaranteed to be monotonic and can just be insane. 2. If any file in the staging directory is rewritten without modification, rsync passes the (unnecessary) mtime update to end users. To solve this, always pass '--no-times --checksum' to rsync. This way timestamps on files in the staging and final directories are only updated when the file content actually changes, being effectively equivalent to the vanilla git behavior. The only possible drawback of this is that if staging/final directory is wiped for some reason, their contents need to be restored from other mirror with preserved timestamps, or otherwise users (who don't use checksumming) will notice a full-tree resync.
* Drop changelogs from rsync dataRobin H. Johnson2017-11-232-32/+2
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* snapshots-create.sh: change the too-much-size-change margins.Robin H. Johnson2017-09-211-2/+8
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
* Fixup print-exclusion-list usage.Robin H. Johnson2017-09-213-3/+2
| | | | Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>