wget - command-line utility to download content non-interactively(can be called from scripts, cron jobs , terminals without the X-Windows support, etc.)
The wget utility can retrieve files from the World Wide Web (WWW) through protocols like HTTP, HTTPS and FTP. It is non-interactive command line tool that can be called from scripts, cron jobs, terminals without the X-Windows support, etc. It can also work on the background.
GNU wget has many features to make retrieving large files or mirroring entire web or FTP, including:
Can resume aborted downloads, using REST and RANGE
NLS-based message files for many different languages
- Optionally converts absolute links in downloaded documents to relative, so that downloaded documents may link to each other locally
- Runs on most UNIX-like operating systems as well as Microsoft Windows
- Supports HTTP proxies
- Supports HTTP cookies
- Supports persistent HTTP connections
- Unattended / background operation
- Uses local file timestamps to determine whether documents need to be re-downloaded when mirroring
- GNU Wget is distributed under the GNU General Public License.
Examples
Basic usage:
$ wget https://upload.wikimedia.org/wikipedia/commons/3/35/Tux.svg
Downloading image in the background, saving it in logfile.txt and try to download it up to 45 times.
$ wget -t 45 -o logfile.txt https://upload.wikimedia.org/wikipedia/commons/3/35/Tux.svg &
Reference
