ok sites added, but how do I make it go?

Post Reply
User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

ok sites added, but how do I make it go?

Post by Thunderstone »



I'm now running Webinator under NT. I installed webinator and told it to
collect data, but it doesn't seem to want to do it.

I used:
gw -d- -mconfig.txt "&url.list"

Where 'url.list' is a text list of urls I want to index. It goes through
each line of the url.list and says something like:
Getting http://www.domain-here.com robot.txt Not found - Ok
Adding to Todo

Then it stops and says:
0 Pages Visited

I can't seem to get it to actually collect data from those pages. I was
previously running it under FreeBSD and it would automatically collect the
pages after cycling through the site list using the above command, but it
doesn't seem to work under NT. It just goes through the whole list and
never indexes the sites.


-- Michael

michael@filez.com (619) 453-2845

~~ The Z Company ~~
<http://www.filez.com> o Largest software search site - 75M files
<http://www.websitez.com> o Find *any* domain name in seconds!
<http://www.mp3.com> o Listen to CD quality music on your computer!




User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

ok sites added, but how do I make it go?

Post by Thunderstone »




What's in your config.txt?

To spy on what gw's doing, you can turn up verbosity with -v (e.g.: -v4).


Post Reply