I'm using "Single Page(s)" in a profile. According to the documentation, "These pages will be fetched but hyperlinks on them will not be followed.". It seems that links on them ARE actually followed. Is that a known behavior?
Single Page not working as expected?
Single Page not working as expected?
Are you using just singles pages or do you also have base urls or such? Perhaps some of the same links occur in the pages being walked.
Single Page not working as expected?
I also have base URL's, but I'm setting the depth to 1, and the unwanted links that are indexed are not referenced in the base Url.
-ds
-ds
Single Page not working as expected?
It looks like that can happen on a subsequent refresh crawl. We'll have to look into it.