No spider to dir

Post by **Thunderstone** » Fri Oct 27, 2000 2:35 pm

Dear Support,
We are trying to spider this site : http://www.sourceegypt.com/

But GW instead to spider all the site it spiders only the home page.
This home page has inside only links to directories ending with the /
How we can spiders one site with all dir links inside?
Reagards

--------------------------------------------

/usr/noago/more.noago.com/webinator/bin/gw -m/usr/noago/more.noago.com/webinator/bin/more_E.set -C -r http://www.sourceegypt.com/
Adding todo: http://www.sourceegypt.com/
http://www.sourceegypt.com/
1/0
Visited 1 pages total

Post by **Thunderstone** » Fri Oct 27, 2000 2:40 pm

Hard to say exactly without knowing what other options are in your
options file. You have something in there that is making gw
reject all of the urls. We can crawl that site just fine.

Review your options. If you don't see the problem try turning
verbosity all the way up with -v9 to see what's going on.