query re "offsite" error

legedza.henry · Post by **legedza.henry** » Wed Aug 06, 2003 2:23 am

Hi there,

I am attempting to index this site http://www.childcare.sa.gov.au

and Webinator index tells me the following:

Pages linked by http://www.childcare.sa.gov.au/
Select a link to see information about that page.
(links that are not selectable are not in the database)

http://www.decs.sa.gov.au/ (Offsite )
http://www.childcare.sa.gov.au/ybsproviders/ (Offsite )
http://www.childcare.sa.gov.au/cel_contact/
http://www.childcare.sa.gov.au/cel_search/
http://www.childcare.sa.gov.au/ybsproviders/ (Offsite )
http://www.childcare.sa.gov.au/ybsparents/ (Offsite )
http://www.childcare.sa.gov.au/ybsstaff/ (Offsite )
http://www.sacentral.sa.gov.au/copyright.html (Offsite )
http://www.sacentral.sa.gov.au/disclaimer.html (Offsite )
http://www.childcare.sa.gov.au/ybsparents/ (Offsite )
http://www.childcare.sa.gov.au/ybsstaff/ (Offsite )

What I'm trying to determine is why /ybsproviders/ is being deemed as offsite and does not appear in the index whereas ybsparents & ybstaff although both listed as offsite are indexed.

Thanks
Henry

legedza.henry · Post by **legedza.henry** » Wed Aug 06, 2003 2:26 am

I should also point out that I have specified http://www.childcare.sa.gov.au/ as a base url.

I have also specified do not index external sites and Stay Under is NO

Henry

Post by **mark** » Wed Aug 06, 2003 12:00 pm

You probably have verbosity turned up to 4 where various status info gets logged as errors. Those pages probably have some offsite content.

The walker sees ybsproviders as a dup of ybsparents so only one is stored. (check your walk status duplicate report) Probably due to the nested frames. Only the first level framset is processed.