Page 1 of 1

Following links but not indexing them

Posted: Thu May 21, 1998 11:53 am
by Thunderstone




I am trying to index a lotus notes database but the problem occurs where
I want it to travel certain links which end in ?OpenView&Start=* (* will
be a number) but I don't want them actually indexed, and to continue
following the links given off the new page. If it is helpful, I want
pages that end in ?OpenDocument indexed.

Thanks in advance

James



Following links but not indexing them

Posted: Thu May 21, 1998 12:29 pm
by Thunderstone



You'll have to let it walk the intermediate pages then delete them when
the walk is complete. See http://www.thunderstone.com/gw2man/node33.html .

You should use -noindex on the walk, peform the deletions, then use -index:
gw -noindex http://...
gw -s "delete ...
...
gw -index