abandoning new walk

KMandalia · Post by **KMandalia** » Wed Sep 08, 2004 1:02 pm

115 E:\Program Files\Thunderstone Software\Webinator\texis\scripts/Webinator/dowalk(verifynewdb) 4622: Query '.&.?.' would require linear search
Abandoning new walk. Test query `.&.?.' failed.

5.0.10 dowalk and search script from sept 7.

another profile works fine so dowalk must be fine.

tried remakeindex this morning after changing sql statement to exclude keyword meta tags from getting into html table. It showed a couple bars reaching only 50% and 75% (others reached 100%, error was sqlprepare failed with -1). Then I downloaded the dowalk script (still sept 7 version) from your website.

I did monitor -k and -U before doing remakeindex.

Don't know what to do.Don't want to loose any data. Need hourly refresh.

Post by **mark** » Wed Sep 08, 2004 1:57 pm

We've found that it does that once in a while. The tester fails which makes it appear as if the database is bad. It's on the to-fix list. For now just put
<return "ok">
at the beginning of the verifynewdb function of dowalk.
<return "ok">
Verifying usability of new walk.

Post by **mark** » Wed Sep 08, 2004 11:28 pm

dowalk 5.0.11 is online and should fix that problem.

KMandalia · Post by **KMandalia** » Thu Sep 09, 2004 10:03 am

Did no good.

Now says:

Abandoning new walk. Test query `a.' failed.

Post by **mark** » Thu Sep 09, 2004 10:56 am

Odd. That query works here. You didn't tweek the dowalk script after downloading did you?
Check the vortex log for messages that occurred at the end of that walk to see why that query failed.

KMandalia · Post by **KMandalia** » Thu Sep 09, 2004 11:29 am

I did tweak it in the sense I removed the keywords from createtable sql.

It may be possible that after remakeindex if you do refresh then it fails because thats what I did ( I downloaded the scripts, stopped and unregistered monitor, did the change in dowalk, registered monitor and did remakeindex which was successful. But when I went to admin page I got the message above)

Post by **mark** » Thu Sep 09, 2004 4:22 pm

Try a new walk on a new profile with an unmodified dowalk script.

KMandalia · Post by **KMandalia** » Thu Sep 09, 2004 4:36 pm

That would work, but I need to take out keywords meta tag from getting into index. How to do that without changing it in dowalk and doing remakeindex?

If I need to change anything related to index in the dowalk, I only do it in the sql statement 'create metamorph inverted index on html........'. No other places in dowalk right?

Post by **mark** » Thu Sep 09, 2004 5:13 pm

I just wanted you to try an unmodified dowalk to see if the mods were causing the problem.

You shouldn't have to use remakeindex except when you have an existing walk database indexed differently than you want to index now (different word expressions or different fields). In other words, once the index is the way you want it you never need to remake it because you've modified the script to do it right in the first place and the system will maintain it. As discussed in http://thunderstone.master.com/texis/ma ... 413dcd9c15 there's one thing to change in dowalk and several in search.

KMandalia · Post by **KMandalia** » Thu Sep 09, 2004 5:33 pm

I do understand.

Lets say I had 5.0.1 dowalk. After sometime I decided to remove keywords meta from index and so got the latest 5.0.11 dowalk from the website, made changes and did remakeindex. The profile is set to refresh hourly and the database have 150,000 pages indexed so there is no way I am doing a new walk, and after remakeindex it will run sometime soon. When it does, it gives the test query error and I have no way of being certain whether keyword removal is successful or not. I just wanted to make sure we will never search based on keywords. Did I do something wrong?