The WEBINATOR actually appeals to me, but I have a problem.
I tried to tackle it myself, then I tried to find something
appropriate in the Tech Support Message Archive.
I have read a lot. And now I feel like a fool with my little problem.
I AM REALLY EXTREMELY SORRY FOR TROUBLING YOU.
The problem is that the walking process starts with the error
message:
And goes on with a number of error messages like:
I run GW.EXE under Windows 95 (apache 1.3.3 is also installed on
this computer.)
The error WSAENOBUFS is generated by winsock, the Windows socket
layer. Windows 95 is likely to have fewer resources available than NT,
which is the supported platform. You should make sure that you have as
little running on your machine as possible while gw is running, and
that apache is configured in a manner not to hold too many resources.
It is possible that gw is trying to fetch pages faster than apache or
Windows 95 can serve them, in which case you might want to use the -w
option to slow gw down.
If all else fails you can try limiting the number of pages fetched
with each invocation of gw, with -p30, and then issue gw -d- -p30 to
continue, and repeat until the walk is complete.