dowalk issue

KMandalia · Post by **KMandalia** » Mon Jul 19, 2004 10:15 am

Webinator 5.0.2
$Id: dowalk.src,v 2.189 2004-05-28 13:56:36-04 kai Exp $

OS: Windows 2000

I have default and min. refresh set at 1 min, process size is large and max. refresh is 90 days. I have only a single base url for our domain. I had webinator 4 and the dowalk used to fetch around 2800 pages. Now it only fetches around 20 pages. Do you know what is wrong. All the settings are the same as webinator 4.

Post by **mark** » Mon Jul 19, 2004 10:55 am

Doing a new walk or refresh. You shouldn't use v5 refresh on a v4 database. Do a new walk with v5 before trying a refresh walk.

Otherwise can't tell without more info. Review the errors you got. If that doesn't help turn verbosity up to 4 and do a new walk. It should tell about every rejected url.

KMandalia · Post by **KMandalia** » Mon Jul 19, 2004 11:31 am

Let me fill you with all details. Reply precisely:

-I just installed v5 and set up password. Haven't made a single change in search or dowalk
-Nothing is imported from v4. Everything is v5. so v4 doesn't come into picture at all.
-I created two profiles. One is for our website and other for several other websites. I changed default location to another directory (instead of e:\program files/... I specified a different path on E:)
-did the exclusions by listing folders like /folder/anotherfolder/ etc.
-changed rewalk to new.
-entered rewalk schedule.
-changed settings as needed (exclusions, meta etc)
-When I hit GO for the first time, the display is refreshed but the page listing shows only a single page crawled, and the following error is shown up

006 2004-07-19 11:28:14 e:\INSTALLDIR\texis\scripts/Webinator/dowalk

Timeout reading from www.mysite.com:80 in the function htbuf_readnblk

Any Help would be appreciated. If possible, as I am a paid user for enterprise webinator, if you can give me your direct number, I can call you.

Post by **mark** » Mon Jul 19, 2004 12:15 pm

The timeout error says it all. The machine you're trying to index is not reachable from the machine where Webinator is installed or it's very slow to respond.

Under all walk settings try setting netmode to System. If that doesn't help try a browser running on that machine to see if it can reach the site to be indexed.

Paid users may call Thunderstone's main number listed on the contact page to request tech support. Or use the Tech support page to create a ticket.