Systems Edge SiteMap Generator  WonderWebWare.com 

I was about to write a program to create an html site map, it’s quite a chore building a site map.
Dreamweaver will create a map but not in a popular format for a web page.
Many commercial programs are available but quite expensive.
This program collects data from a live website.
 After trying various free programs I came across wonderwebware
It’s so easy to use and produces maps in various formats, Google, Yahoo, html site maps for web pages, csv
Not only these but produces a list of failed urls, creates a list of links in your websites “outboard Links”
Many thanks to the author please visit
http://wonderwebware.com/sitemap-generator/

Sitemap Generator is free software that will help you to automatically generate sitemaps in Google (XML) or yahoo (TXT) format or just to spider your website and collect all the internal links for you. The tool may export collected links to CSV or HTML file too. The main reason to build this tool was that all other similar programs didn't fit my requirements.

This software is free for any use, but comes without any warranty. Please, note that the program acts like spider, but will download all the pages of the target site. Do not use this tool to crawl 3-rd party sites without their permission.

Although the generator passed his internal tests and should be stable, the bugs are part of the software development. The author will be really thankful if you report any bug you find. Feel free to contact him with all your troubles, comments, feature requests or ideas. Use the contact form or post in his small machine forum http://ideasplayer.com/
Download the program from
http://download.cnet.com/SiteMap-Generator-beta/3000-2155_4-10815828.html
The licence agreement http://wonderwebware.com/sitemap-generator/license.html

 Enter your website in the browser.
I wanted to exclude all the links in my smf (small machines forum)
Enter *smf/* in the Exclude Patterns:
Click on the START button

After the web crawl has finished one of seven options can be selected

To output your map text file click on save to file.
Use your favourite web design program to format the text