Get a listing of all the urls on a website with this simple Linux command.

This command will return a huge listing of all the visitable url`s on the http://www.google.com.au website. Give this a shot on other websites and see how you go. jason@jason-desktop:~$ wget –spider –force-html -r -l2 http://www.google.com.au 2>&1 | grep ‘^–‘ | awk ‘{ print $3 }’jason@jason-desktop:~$ wget –spider –force-html -r -l2 http://www.google.com.au 2>&1 | grep ‘^–‘ … Read more