gw spider and re-index

puttakanda · Post by **puttakanda** » Mon Sep 24, 2001 5:26 pm

We have a licensed version of Texis and I wish to make use of gw to spider the site and create index.
We are planning to have docs (docs, pdf) stored in docroot in a predefined structure based on region(US, Europe etc) and language.

Two questions:
1. I need to spider and create index for the site (if possible in a way identifying the language and region)
2. I need to re-index the site each night (I had problems telling that the url already existed)

puttakanda · Post by **puttakanda** » Mon Sep 24, 2001 5:27 pm

The above is on a Win2K box..

Post by **mark** » Mon Sep 24, 2001 5:51 pm

1) Use the -n option to specify the plugin for the doc and pdf files. See http://www.thunderstone.com/site/gw25man/node52.html

You might want to place each language into it's own database (-d) so english users don't get german hits by accident. You will probably need to use the -j option to keep the walk under the desired language/region.

2) Use -rewalk