webinator hanging randomly

waynes · Post by **waynes** » Wed Nov 21, 2001 6:40 pm

I have uploaded the files after the last walk to above location

Post by **mark** » Mon Nov 26, 2001 12:29 pm

Just wanted to let you know that we haven't forgotten you. We just got back from a 4 day holiday weekend in the USA and are looking into your data.

Post by **mark** » Mon Nov 26, 2001 3:25 pm

Our differences in walk counts may be due to various aliasing across sections of your site where the parallel walks on your machine proceed at a different rate than those on mine. Mine is finding a duplicate earlier and cutting off an infinitely deep calendar. You might want to exclude the calendar from your walk since, apparently it will let you keep clicking back in time forever.

/a8_publish/modules/calendar/

waynes · Post by **waynes** » Mon Nov 26, 2001 5:31 pm

Mark,

If you check in settings - i have excluded /calendar/ The calendar is not included in the search - when i ran the crawl first it hung ouround 8000 pages (with the calendar being the main problem) but since then it has been excluded.

Post by **mark** » Mon Nov 26, 2001 6:29 pm

There's part of the problem. A closer look at your options reveals that you have spaces at the end of your lines. They get included in the exclusion pattern and therefore match nothing. The same is true for your extra domains and urls. Remove all of the trailing spaces.

Post by **mark** » Wed Dec 12, 2001 2:33 pm

If you're still having problems, there's a new dowalk script you can download from http://www.thunderstone.com/texis/site/ ... ample.html

It does more checking on child processes so it's not likely to be fooled by the OS reusing process id's rapidly. Hopefully this will solve the problem you're encountering.