Related to Steering and Supporting Search Engine Crawling, we found these useful Web links below. To suggest a web link, please click 'link to us' on the page where the suggested link is relevant (find that page).

Web Content Accessibility Guidelines

For those unfamiliar with accessibility issues pertaining to Web page design, consider that many users may be operating in contexts very different from your own: search engine Web robots are 'blind'. Although this W3C document is not dedicated to SE spiders, it explains how you can make your content accessible for robots.

Browser Header Check

View which data your browser sends out to a web server.

Dublin Core Metadata Initiative

All about META tags. If you still believe, that there is a robots-revisit META tag, read this page.


The search tool with complete page analysis for each result.

Keyword Density Analyzer

Although there is no such thing as an optimal keyword density, this tool will detect spammy copywriting.

Robots.txt Validator

Validate your robots.txt to ensure you're not blocking search engine spiders by accident.

Webpage Size Checker

Need to put your site on a diet? Just enter the full http url into the form and let it rip with the submit.

Search Engine Spider Simulator

This tool is from 2002, but still very useful. Enter your URLs to check what a search engine spider 'sees'.

Server Header Checker

Knowhing how your server responses to HTTP requests is quite useful, especially if you're researching a phenomenon.

Search Engine Friendly E-Commerce Catalogs

A great article on search engine friendly dynamic Web site development by Rustybrick.

Search Engine Friendly URLs

Chris Beasley over at SitePoint explains three methods to convert dynamic URLs to static looking URLs, where every segment of the URL is the value of a query string variable.

Try a new search technology from Google to find Web links relevant to this site:


Most probably you'll find more interesting Web links browsing our related categories. Click here for a list of topics providing related Web links which are not embedded in the page's content.

· Home

· Internet

· Steering SE Crawlers

· Googlebot-Spoofer

· Google Sitemaps Info

· Web Links

· Link to us

· Contact

· What's new

· Site map

· Get Help

Most popular:

· Site Feeds

· Database Design Guide

· Google Sitemaps

· smartDataPump

· Spider Support

· How To Link Properly

Free Tools:

· Sitemap Validator

· Simple Sitemaps

· Spider Spoofer

· Ad & Click Tracking

Search Google
Web Site

Add to My Yahoo!
Syndicate our Content via RSS FeedSyndicate our Content via RSS Feed

Digg this · Add to · Add to Furl · We Can Help You!

Home · Categories · Articles & Tutorials · Syndicated News, Blogs & Knowledge Bases · Web Log Archives

Top of page

No Ads

Copyright © 2004, 2005 by Smart IT Consulting · Reprinting except quotes along with a link to this site is prohibited · Contact · Privacy