problem indexing a site with greater depth

Post Reply
User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

problem indexing a site with greater depth

Post by Thunderstone »



Hi,

I used to index a lot of pages using the -D1 option, but now I want to
index a new server with the -D2 option.
Just saying gw -D2 newurl doesnt work, because webinator is rewalking
every old URL in the database with -D2
Saying gw -D2 -jnewurl newurl does the same effect -why?
Anyone solved the problem so far?

-Eike Kiltz

PS: running webinator 2.0 on solaris




User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

problem indexing a site with greater depth

Post by Thunderstone »




When walking to a specific depth, urls for the next depth are still stored
in the todo table. gw also remembers every url specified in the past for
use with -rewalk.

You can clear the todo table with:
gw -s "delete from todo"

You can clear the remembered urls with:
gw -s "delete from options where Name='URL'"

Then you can walk a new server to a different depth.


Post Reply