Indexing external sites using PROXY

jgeorge · Post by **jgeorge** » Tue Oct 01, 2002 3:02 pm

Hi, I tried using the following command since we have a proxy server BUT it fails

./gw -g -a -proxy=myproxy.com:1080 http://www.handango.com

error is

000 Can't get address for host `www.handango.com': Error 0
000 Can't get address for host `www.handango.com': Error 0
000 Can't get address for host `www.handango.com': Error 0
http://www.handango.com/: Can't get IP address
Visited 0 pages total

Post by **mark** » Tue Oct 01, 2002 3:10 pm

gw still wants to lookup the ip address for all specified urls even if using a proxy to fetch them. You either need to setup dns or hosts for those sites or use a vortex scripted walker such as in webinator 4 or on our ftp site (dowalk) instead of gw.

jgeorge · Post by **jgeorge** » Tue Oct 01, 2002 3:30 pm

So I need to enable dns. How do I setup hosts for this site , i am on AIX

Thanks,

Post by **mark** » Tue Oct 01, 2002 3:46 pm

Edit /etc/hosts
See your system manuals (man hosts).

jgeorge · Post by **jgeorge** » Tue Oct 01, 2002 3:46 pm

One other issue is probably the authetication, does webinator 4.2 allow proxy authetication

Thanks in advance, joe

Post by **John** » Tue Oct 01, 2002 3:49 pm

Yes, Webinator 4.2 can do proxy authentication.

Post by **Kai** » Wed Oct 02, 2002 10:24 am

But only through the web admin interface, not the 2.x-version gw.