Generates XML Sitemap, REQUIRED for search engine optimization for Google, MSN, Yahoo - all at once! 4 Step very easy installation, start using in 5 minutes! Completely dynamic - no additional support required. Supports UNLIMITED number of pages (when million is not enough). Supports XML Sitemap Index. Support Google, MSN, Yahoo at ONCE. Advanced Admin Section available for advanced users. 1 year FREE module upgrade included.

Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions

Manage and track visits by robots, spiders and crawlers to your website. Identify which spiders visited, when they visited, and what pages they indexed. Direct spiders to your most important pages, and exclude them from non-public pages. Maximizes effectiveness with search engines by avoiding over/under submitting. Excellent to improve search engine placements for users of automatic submission software such as WebPosition, TopDog, AddWeb, etc.

LinkFreeze is a fast and easy solution to optimize dynamic or database-driven website for search engines. It optimizes all dynamic links on your site removing all unwanted characters and making links look like static files. LinkFreeze modifies links before server sends a response to the client and rewrites URLs back when they go to the server and all optimization is done very easily and transparently to the user

The InnerPeace WebMaster Toolkit is a collection of essensial tools assembeled and made by the Webmasters of InnerPeace. Some of these essensial tools are not available anywhere else. Includes a fast, easy 4 hexillion color combo picker, PageJumper web page forwarder, EScrambler to scramble your email addresses and hide them from spamcrawlers, plus some excellent articles. Easy to use. Runs on any O/S: Windows, Mac, Unix, etc. License: GNU GPL.

ETagFix is an ISAPI plugin for Internet Information Server (IIS) that changes the etag produced by IIS so that your etag does not change every time your computer reboots. This can result in web crawlers and user clients wanting to recache your web page when they don't need to.

Email address code scrambler. Fight spam. Your spam problem comes from spam crawler robots. They crawl your site to add your email addresses their spam lists. Make your email addresses invisible to spam crawlers. Hide your mail addresses from robots in plain sight. Visitors to your web pages can read and click on your email addresses the same way they do now. Robots will not find them. Stay off spam lists. Search engine friendly. Easy to use.

By placing a Sitemap-formatted file on your webserver, you enable the Google crawlers to find out what pages are present and which have recently changed, and to crawl your site accordingly. Using Sitemaps to inform and direct the Google crawlers, they hope to expand their coverage of the web and improve the time of inclusion in their index.

Create your robots.txt files in seconds and maintain them easilly and effortlesly with the unique utility Advanced Robots.txt Generator. The software supports 300 robots, works in a WYSWIWYG visual way and comes with full documentation and unlimited customer support. It's features include automatic creation of Robots.txt files, automatic uploading, comparison with previously saved project, online/offline documentation, manual, free upgrades etc.

Build a custom web spider / web crawler using web data extraction / screen scraping technology. Use the web extract for web data mining of contact lists, product catalogs, government databases, real estate listings, or build a custom email extractor.

Creating your own web grabber that can Screen Scrape the data to a database or Excel has never been easier. The website spider / crawlers can even sort and filter the webpages while spidering.