The citation below is from the Librarians' Index to the Internet, a terrific subject directory of WWW links, selected and annotated by professional librarians.
Those Dark Hiding Places: The Invisible Web Revealed -
http://library.rider.edu/scholarly/rlackie/Invisible/Inv_Web.html
Internet searchers wishing focused access to content on the World Wide Web should consider that "more of it (dynamically-generated pages, certain file formats, and numerous databases) is becoming invisible to their searching spiders." This site provides links to directories, searchable sites, databases, and search engines useful for uncovering content that the general search engines fail to disclose. There is a helpful section which offers guidelines for situations when so-called "hidden content" searching is warranted. From Rider University's I-Librarian Robert J. Lackie. - rv
Subjects: Internet searching | World Wide Web -- Subject access
Beta-site: give us feedback