Sometimes, I wish to only get the directory structure of a website, but the files themselves are not important. I only want their name. Sort of like a mirror where every entry is just an empty dummy file.Of course, doing a wget -r and afterwards run a script to empty all the files works fine, but it feels wasteful because it is not nice to neither the server nor my bandwidth. A more efficient, but even less elegant way is to manually stop and restart the process every time you hit a large file, or set a very short time-out. At least that significantly reduces the amount of data I have to download.My question is: Can I make wget only create a file, but not download its content? Or am I using the wrong tool for the job?
Can I use wget to download all files recursively, but not their actual content?
wget;download
Posting an answer as requested:Use the --spider option:wget -r -nv --spider http://example.comThen you can parse the structure of the site from the output.  This won't download files that stand no chance to contain links, such as images.