Indexing hosts on same ip

Post Reply
User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

Indexing hosts on same ip

Post by Thunderstone »



gw converts everything to IP addresses internally to resolve redundant aliases.
This behavior requires that virtual hosts using the same IP be walked
separately.

A script like this on unix will automate the process for you:

#!/bin/sh
while read url;do
gw -st "delete from options where Name='URL'"
gw -L -noindex $url
done <url_list_file
gw -index


Post Reply