Indexing Single Pages Per Site

Post Reply
User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

Indexing Single Pages Per Site

Post by Thunderstone »



I am currently using this command line to index a list of sites:

gw -meta=keywords,description -w3 -t10 -dextdb -mlinks.opt "&links.lst"
(links.lst contains the option URLs: jhttp://whatever.com)

The problem I'm having, is that I'd like to limit it to a couple pages OR a
single page per site. Right now, it's indexing everything under that URL
(which is probably correct). I have been trying to limit gw to a couple of
pages per site, using the -p option but it only limits the pages indexed
for that session.

What command combination could I use to index a couple pages or a single
page per site while using a URL list?

- Julian



User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

Indexing Single Pages Per Site

Post by Thunderstone »

Post Reply