Forbidden access and broken link

kelvin.tee · Post by **kelvin.tee** » Thu Oct 30, 2003 6:29 am

While perform a walk using Webinator, I kept on getting this error on some of the documents. What is the cause and how do I troubleshoot the following error messages while walking a site?

The link : http://www.mywebsite.com/fact/
Referenced by : http://www.mywebsite.com/fact/folder_a/
http://www.mywebsite.com/fact/folder_b/
Had this error: Document access forbidden:
http://www.mywebsite.com/fact/ returned code 403 (Access Forbidden)

If broken link(s) were encountered during the walk for a particular folder, does the walking of subsequent sub-folder be skipped? For my case, the walk either skipped or halted (finished). I have about 500+ documents in my website but due to this problem, only 150+ documents can be processed. I am getting lost; the manual doesn't helpl much.

Any help will be much appreciated. Thanks.

kelvin.tee · Post by **kelvin.tee** » Thu Oct 30, 2003 8:39 pm

What form of basic authentication are you referring to?

The type of documents in the website, www.mywebsite.com are .html,.pdf & .js -> Mostly static pages.

The documents have the following permissions:
for file: -rw-r--r--
for directory: drwxr-xr-x

Are you saying that any URL-related issues must be resolved before Webinator can fetch the remaining pages?

Post by **mark** » Thu Oct 30, 2003 9:33 pm

HTTP standard authentication. Document type is not relevant. Filesystem perms are probably not relevant either since they look ok. The website must be fully navigable with a web browser for it to be fully indexed. Password protected pages need the password supplied under "all walk settings".

kelvin.tee · Post by **kelvin.tee** » Tue Nov 04, 2003 10:16 pm

Well, I guess I overlook the trivial stuff. You guys are absolutely correct. Upon enabling the Directory Browsing, now most of the documents (except those related to broken link) can be walked. Thanks a lot.