pages not indexed

Post Reply
Posts: 62
Joined: Fri Jul 20, 2001 11:43 am

pages not indexed

Post by anixyz »

Some of the html pages from our site are not being indexed and so not coming up in search results.
What are all the possibilities that gw does not index some html pages.(like pages navigated to via Javascript)

Some pages are not "present" in html table but are present in "refs" table.whats going on here....

User avatar
Site Admin
Posts: 5519
Joined: Tue Apr 25, 2000 6:56 pm

pages not indexed

Post by mark »

There are *many* option settings that control what pages are indexed or not. See the manual for the long list of options and what each one does.

The refs table contains all of the urls seen on the fetched pages whether they were rejected for walking or not.

If you have specific questions about particular urls in conjunction with your particular option settings let us know.
Post Reply