This Page Updated: 3/17/2004
   
Personal
Resume
Programming
Hobbies
Weblog (old)
LiveJournal
Email

Personal
Resume
Hobbies
Email

Bookmarks
Pets
Fun!
Internet Security

I found an interesting book at the librairy; "The Invisible Web".

This ought to be required reading for any webmaster, especially those doing commercial work!   The book was printed in 2001, but amazingly for a hardcopy book in this age of internet-based content, its text is still reasonable timely, and well worth reading. It explains a lot about how search engines work (with a lot of good history!), and what they will and will not index.

Without going into a lot of detail, the main point of the book (page 65) is this; search engine spiders index only static HTML pages that have text on them.  

The spiders avoid, and do not index the following:

Yes, many engines now index images, but if you search the general index, you probably wont find the pages said images are on.

Rather ironically, Google has a pile of indexed information on "Invisible" web pages, so you don't necessarily have to buy the book, to get the information.

Some References, in order of usefulness: