This script will crawl any website you pass in and build an XML sitemap.
Features:
- Uses sitemap indexes when needed
- Google accepted format
- WWW safe
- Can handle 100’s of thousands of pages
- Ignores certain filetypes, anchors and query strings
- Python 2.7
Syntax:
$ py -2.7 mapper.py -l http://online-code-generator.com
Download:
Coming soon from GitHub
