Walking a sub-site

Post Reply
User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

Walking a sub-site

Post by Thunderstone »



Hi,

I was wondering if it was possible to tell gw to walk a portion of a site,
and ignore the rest of the site even if it's linked from the portion that's
being indexed.

I.e., I want to index all URLs linked from http://foo.bar.edu/foo/ that are
in that path and begin with that URL, but I don't want to index anything
else on foo.bar.edu.

Is that possible?

I tried including foo.bar.edu/foo/ and excluding foo.bar.edu/, but then it
excluded foo.bar.edu/foo/.

Thanks!

----------------------------------------------------------------
Christopher A. Manly cam2@cornell.edu
CIT/ATS (607) 255-4958
<http://www.people.cornell.edu/pages/cam2/>


User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

Walking a sub-site

Post by Thunderstone »




Use gw -jhttp://foo.bar.edu/foo/ http://foo.bar.edu/foo/

-j Will exclude URLs not having the prefix URL. (May be used multiple times)





Post Reply