The Central Ohio Linux User Group

Ohio's Oldest Linux User Group

This site is powered by:

NWS Port Columbus

wget, reviewed with Jacob Hopkins

[ Up ]

Tool:
	wget

Current Version:
	1.8

URL:
	http://www.gnu.org/software/wget/wget.html

License:
	GNU GPL

Use:
	download from and/or mirror web and ftp sites

Usage:

	# help
	wget --help

	# download to ./
	wget http://host/dirs/file

	# Mirror, no parent, honors robots.txt by default
	# will create directory(s): ./host/dir/
	# will not leave host
	wget -m -np http://host/dirs/

	# Passive ftp
	wget --passive-ftp ftp://host/dir/file
	wget -m -np --passive-ftp ftp://host/dir/
	
	# Misc options:
	# -q		quiet
	# -nv 		not verbose (verbose by default)
	# --wait=n	wait n seconds between requests
	# -U string	use string as User-Agent
	# -i file	download urls from file

Alternatives:
	rsync, not always supported, does not use http/ftp
	lynx, prefers interactive, robots.txt and crawling are weak
	curl, MIT/X type license, (I've not used it)

Document Info:

	Author:	Jacob Hopkins
	Email:	jacob@teched.net
	Date:	April 26, 2003

		Copyright © 2000 The Central Ohio Linux User Group. All rights reserved.
	Search