infra/codestorage/hg-repo-sync

Paddy 2015-10-11

1:cc08c8ed2128 Go to Latest

infra/codestorage/hg-repo-sync/push.sh

Update to be more modular. We now have a more modular approach to running our mercurial servers, and the approach to the individual containers is a bit more modular as well. The hg-repo-sync container now has a few responsibilities: 1. Install Mercurial 2. Create the group that’s going to be writing all our files 3. Create the folders we’ll store files in, and make the new group the owner 4. Define a script that pulls repos from GCS to local disk 5. Define a script that pushes repos to GCS from local disk 6. Define a script that causes a delay between runs This mainly involved breaking the previous run script into a few separate scripts, so they could be invoked individually. This docker container _can_ be used as a standalone image that will keep the local disk in sync with GCS, but it’s more useful as a base image for our other containers to work off of to achieve specialised functionality.

Download raw file
View source Diff to previous Annotate
History
1 #!/bin/bash
2 today=$(date +%F)
3
4 DOMAIN=${DOMAIN:-code.secondbit.org}
5 BACKUP_BUCKET=${BACKUP_BUCKET:-backups.$DOMAIN}
6
7 echo "Fixing permissions..."
8 chgrp -R 2000 /mounted/repos
9
10 echo "Cleaning up..."
11 rm -rf /tmp/repos/*
12
13 repos=$(find /mounted/repos -name .hg -type d)
14 for repo in $repos
15 do
16 dir=$(dirname $repo)
17 stripped=${dir#.}
18 stripped=${stripped#/mounted/repos}
19 target=/tmp/repos/$today$stripped.bundle
20 mkdir -p $(dirname $target)
21 hg --cwd $dir bundle --all $target
22 done
23
24 echo "Pushing bundles to gs://${BACKUP_BUCKET}"
25 gsutil cp -R /tmp/repos/* gs://${BACKUP_BUCKET}/
26
27 echo "Cleaning up..."
28 rm -rf /tmp/repos/*
29
30 echo "Push complete."