Strange...

Post Reply
User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

Strange...

Post by Thunderstone »




I haven't had trouble in the past months indexing our resource page:
http://www.doe.gov/webinator/index2.html

This month different story..

I was going to try to create a new db this month so I did this:

gw -d/newef -create -o -D10 -unique http://mysite

When gw starts the first url hit shows 1/587 and from then on it looks
like it's skipping pages it should get. I tried wiping the db and the
todo list but still does the same... any ideas..

dga



User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

Strange...

Post by Thunderstone »



With no examples, it hard to comment.
Make sure you are using the same options you used on the other database.
Turn up verbosity to 5 (-v5) to see why it rejects urls.




Post Reply