Off-Site Pages

velevi · Post by **velevi** » Fri Sep 30, 2005 10:49 am

Off-Site Pages option in all walk settings allows fetching and indexing of any individual pages that do not match any of urls in the Base Url field, but are linked from indexed content. The links on these off-site pages should not be walked any further.

But then how come a few other off-site pages linked from the previous off-site pages (not from regular indexed content) get indexed? Do I misunderstand the use of the Off-Site Pages field?

Post by **John** » Fri Sep 30, 2005 12:05 pm

Links on the offsite pages should not be followed. Did you check with List/Edit URLs to see if there were any other pages were indexed that linked to it?

velevi · Post by **velevi** » Fri Sep 30, 2005 12:11 pm

I cannot check thru List/Edit URLs for that information; but I could check what the parents of the indexed documents are. Some of the off-site pages indexed had only parents that were off-site pages themselves. How is that possible?

I do not believe these URLs appear anywhere else on the site, since they didn't use to appear among indexed URLs before I turned on the "Off-Site Pages" feature on.

Post by **John** » Fri Sep 30, 2005 1:48 pm

List/Edit URLs can show parents as well. I'm not aware of any way that is possible. Can you give an example, i.e. the page you did want walked, the off-site page that is the parent of a further off-site page? If you can send that with other settings to tech support we can try and replicate it.