when we add new URL to existing database, gw is walking through old refs =
like these:
Getting http://194.8.12.142/robots.txt...Not there...Ok.
Getting http://195.62.128.36/robots.txt...Not there...Ok.
...
and when any of previously walked servers are down, gw stops and hangs =
up without comments.
so it is inpossible to walk new URL until all previously walked web =
servers are operational.
is it our mistake or is it possible to remove referencies to walked =
URLs?
I tried to find were they reside, but without results

thank you,
edmunds zalite=20