Recursively download entire website all files

To download all files on a website using 'wget' use:

wget -r -nH --cut-dirs=1 --no-parent -e robots=off pawie.amiciscemi.org/temp/

-r = recursive

-nH =--no-host-directories - remove www.site.com from saved folder--cut-dirs=1 = remove /folder from saved folder--no-parent = do not go above the parent directory

-e robots=off - ignore the robots.txt file

--reject="index.html*" = do not download index.html files or whatever.

Leave a Reply