I haven't had trouble in the past months indexing our resource page:
http://www.doe.gov/webinator/index2.html
This month different story..
I was going to try to create a new db this month so I did this:
gw -d/newef -create -o -D10 -unique http://mysite
When gw starts the first url hit shows 1/587 and from then on it looks
like it's skipping pages it should get. I tried wiping the db and the
todo list but still does the same... any ideas..
dga