file not found when fetched through proxy

Faiz
Posts: 109
Joined: Wed Jan 10, 2001 1:29 pm

file not found when fetched through proxy

Post by Faiz »

Hi,
Sometimes I get a "file not found" error on fetching a url through proxy. It happens with our intranet Urls. External urls are ok.
When I fetch a Url, http://xyz/abc/index.htm, using the geturl function in dowalk script, it re-directs(actualurl) to http://www.xyz.com/, and there is no such Url. May be, thats the reason why it gives a file not found error. But why does it redirect to www.xyz.com? Is it something related to the server on which it resides? When I view the page on the browser, it does not redirect to any Url.
User avatar
mark
Site Admin
Posts: 5519
Joined: Tue Apr 25, 2000 6:56 pm

file not found when fetched through proxy

Post by mark »

Redirects are issued by the server. We just follow them. Perhaps the server is giving different answers based on client IP or user agent.
You could also try the geturl program in the webinator/bin directory to see the raw return from the webserver.
Faiz
Posts: 109
Joined: Wed Jan 10, 2001 1:29 pm

file not found when fetched through proxy

Post by Faiz »

How can I tell the geturl in /bin to fetch the url through proxy, because, when I type in,
geturl http://fldwebdevcorpge/icuisine/Index.htm, it gives an error,
000 Can't get address for host `fldwebdevcorpge': Unknown error in the function:
setaddr
Can't connect(1) to fldwebdevcorpge:80 : Error 0
User avatar
mark
Site Admin
Posts: 5519
Joined: Tue Apr 25, 2000 6:56 pm

file not found when fetched through proxy

Post by mark »

Sorry, forgot about the proxy thing, geturl util doesn't do proxy's.
You need to check with admin of server issuing redirect to find out why it doesn't always do it.

You could try setting your user agent in dowalk to the same thing your browser sends.