How to download all files of a GitHub project with wget (in raw form)?

Question

How to download all files of a GitHub project with wget?

All files should be downloaded in their raw form.

Already tried:

wget -P ~/ https://raw.githubusercontent.com/u/p/b/*
wget -P ~/ https://raw.githubusercontent.com/u/p/b/{*}
wget -P ~/ --accept-regex urlregex https://raw.githubusercontent.com/u/p/b/*
wget -P ~/ --recursive https://raw.githubusercontent.com/u/p/b/

This is opposed to wget -P ~/ https://raw.githubusercontent.com/u/p/b/{file1,file2...}

_{u=user,p=project,b=branch.}

Answer 1

This is one way:

wget -P ~/ https://github.com/u/p/a/master.zip
unzip ~/master.zip

This is another:

cd
wget https://github.com/u/p/a/master.zip
unzip master.zip

_{u=user, p=project, a=archive.}

Answer 2

Short version: you can't.

Longer version 1: If you're trying to clone a git working directory, that directory needs to be under your $WEBROOT, so your web server can see and serve the files.

Longer version 2: If you're trying to clone a bare git repository, the files don't actually exist in raw form. They're entries on the projects object database.

Best idea:

git clone http://...

Answer 3

This worked for me on a repository although it requires a tool called json (similar to jq) and I don't recommend doing this over git clone.

#!/bin/bash

MY_REPO='/jessebutryn/wtfisbash'

GIT_API='https://api.github.com/repos'
GIT_URI='/contents'
CURL_OPTS=(
    -X
    GET
)

REPO_DIRS=($(curl "${CURL_OPTS[@]}" "${GIT_API}${MY_REPO}${GIT_URI}" \
    | json -a -c "type === 'dir'" name))
REPO_FILES=($(curl "${CURL_OPTS[@]}" "${GIT_API}${MY_REPO}${GIT_URI}" \
    | json -a -c "type === 'file'" download_url))

for dir in "${REPO_DIRS[@]}"; do
    REPO_FILES+=($(curl "${CURL_OPTS[@]}" "${GIT_API}${MY_REPO}${GIT_URI}/${dir}" \
        | json -a -c "type === 'file'" download_url))
done

for file in "${REPO_FILES[@]}"; do
    wget -P ./ "${file}"
done

I should also note this will only work for files up to one directory deep. If you have more directories than that I'm sure you can figure out how to dive into them with this -- but it's starting to give me a headache.