I saw some of the posts on this website about how to download files from a directory recursively. So, I executed the following line:wget -r -nH --cut-dirs=3 -A '*.bz2' -np http://www.xfce.org/archive/xfce-4.6.2/src/It only downloads the index page and then deletes it automatically.Output:--2016-07-01 16:56:02--  http://www.xfce.org/archive/xfce-4.6.2/src/Resolving www.xfce.org (www.xfce.org)... 138.48.2.103Connecting to www.xfce.org (www.xfce.org)|138.48.2.103|:80... connected.HTTP request sent, awaiting response... 301 Moved PermanentlyLocation: http://archive.xfce.org/xfce/4.6.2/src/ [following]--2016-07-01 16:56:17--  http://archive.xfce.org/xfce/4.6.2/src/Resolving archive.xfce.org (archive.xfce.org)... 138.48.2.107Connecting to archive.xfce.org (archive.xfce.org)|138.48.2.107|:80... connected.HTTP request sent, awaiting response... 200 OKLength: unspecified [text/html]Saving to: index.htmlindex.html                                [ <=>                                                                      ]   8.05K  --.-KB/s   in 0.03s  2016-07-01 16:56:23 (247 KB/s) - index.html saved [8239]Removing index.html since it should be rejected.FINISHED --2016-07-01 16:56:23--Total wall clock time: 21sDownloaded: 1 files, 8.0K in 0.03s (247 KB/s)The web-directory contains a lot of tar.bz2 files. Can anyone tell me where I'm going wrong?My wget version is 1.16.3
wget not downloading files recursively
directory;wget;recursive
Seems like it is not trivial to get directory listing over http; I could get the bz2 files using bellow:wget -k -l 0 http://archive.xfce.org/xfce/4.6.2/src/ -O index.html ; cat index.html | grep -o 'http://archive.xfce.org/xfce/4.6.2/src/[^]*.bz2' | uniq -c | xargs wgetHope this help. 