This script migrates a subversion repository to GitHub, with some logic for dealing with nested repositories.
This script was developed using Ubuntu 18.04
with the following packages installed:
-
bc
-
git
-
git-lfs
-
git-svn
-
subversion
To install, run the following commands:
sudo apt-get update
sudo apt-get install git git-svn git-lfs subversion bc
docker build -t github/svn2github .
- Sizing of the remote repository
- Detection of nested folders with
trunk
,tags
andbranches
- Selectable subfolders for conversion to git submodules
- Progress bar
- Failed
fetch
retries - Large file detection, with automatic LFS initialization
chmod +x svn2github.sh
./svn2github.sh
- Run the container
docker run -dit --name svn2github github/svn2github
- Enter a shell prompt in the container
docker exec -it svn2github bash
- Edit the
settings.ini
file - Create your authors file
source settings.ini
svn log -q ${REPOSITORY} | awk -F '|' '/^r/ {sub("^ ", "", $2); sub(" $", "", $2); print $2" = "$2" <"$2"@example.com>"}' | sort -u >> ${AUTHORS_FILE}
--OR--
source settings.ini
svn log --q ${REPOSITORY} | awk '/^r/{print $3" = "$3" <"$3"@example.com>"}'|sort -u|tee /tmp/authors.txt
- Edit the authors file to contain the correct user data
- Execute the script
./svn2github.sh
- Download the release and extract it
- Ensure you have a Subversion client installed with the CLI utilities.
- Open the
Git Bash
terminal - Add the Subversion binaries to your path
export PATH=${PATH}:/c/Program\ Files/TortoiseSVN/bin
- Edit the
settings.ini
file and add your specifics - Add your
git config
propertiesgit config --global user.name "Kal El"
git config --global user.email "[email protected]"
- Execute the
svn2github.sh
script and follow the prompts./svn2github.sh
$ source settings.ini
$ source _functions.sh
$ _svn_sizer
###################################
## ##
## Discovering repository size ##
## ##
###################################
Total Size: 545.575 MB
Number of Files: 17.276 K
This script was successfully tested with the following repositories:
URL | Name | Has Submodules | Has Branches | Has Tags |
---|---|---|---|---|
https://svn.eionet.europa.eu/repositories/NatureWatch | NatureWatch |
Yes | Only in submodules | Yes |
https://svn.code.sf.net/p/ultrastardx/svn | ultrastardx |
No | Yes | Yes |
REPOSITORY=https://svn.eionet.europa.eu/repositories/NatureWatch
GITHUB_TOKEN=faf0bc75ea0740ef240g2cce40a488aa98229ef3
GITHUB_URL=https://ghe-test.github.local
GITHUB_ORG=GitHub-Demo
AUTHORS_FILE=/tmp/authors.txt
SVN_USERNAME=anonymous
SVN_PASSWORD=anonymous
ENABLE_SUBMODULES=true
MIGRATE_HISTORY=true
- You may encounter issues with unsigned or self-signed certificates. In this case, disable
http.sslVerify
before running the script:git config --global http.sslVerify false
Remember to remove this when you're done!!
-
You may encounter issues with cloning the history if your repository has corrupt revisions. In this case, it will be required to do a clean cutover. This script does not yet fully support a clean cutover, but it is in the works
-
If you have a
trunk
folder and files in the root of the repository, the script will treat the root as trunk. This is becausegit-svn
cannot treat 2 folders likemaster
. If this is not the desired behavior then it is up to the administrator to consolidate these files either intrunk
or in the root. If no consolidation is done, you will still have all of those files, and a trunk folder in yourmaster
branch after the migration -
Git-LFS
is automatically initialized if large files are discovered, but this does not get around the max filesize limit of GitHub. You will still need to either increase that filesize temporarily for the migration, or else manually clean up the files. This is not handled by the script