Page 1 of 2
abandoning new walk
Posted: Wed Sep 08, 2004 1:02 pm
by KMandalia
115 E:\Program Files\Thunderstone Software\Webinator\texis\scripts/Webinator/dowalk(verifynewdb) 4622: Query '.&.?.' would require linear search
Abandoning new walk. Test query `.&.?.' failed.
5.0.10 dowalk and search script from sept 7.
another profile works fine so dowalk must be fine.
tried remakeindex this morning after changing sql statement to exclude keyword meta tags from getting into html table. It showed a couple bars reaching only 50% and 75% (others reached 100%, error was sqlprepare failed with -1). Then I downloaded the dowalk script (still sept 7 version) from your website.
I did monitor -k and -U before doing remakeindex.
Don't know what to do.Don't want to loose any data. Need hourly refresh.
abandoning new walk
Posted: Wed Sep 08, 2004 1:57 pm
by mark
We've found that it does that once in a while. The tester fails which makes it appear as if the database is bad. It's on the to-fix list. For now just put
<return "ok">
at the beginning of the verifynewdb function of dowalk.
<return "ok">
Verifying usability of new walk.
abandoning new walk
Posted: Wed Sep 08, 2004 11:28 pm
by mark
dowalk 5.0.11 is online and should fix that problem.
abandoning new walk
Posted: Thu Sep 09, 2004 10:03 am
by KMandalia
Did no good.
Now says:
Abandoning new walk. Test query `a.' failed.
abandoning new walk
Posted: Thu Sep 09, 2004 10:56 am
by mark
Odd. That query works here. You didn't tweek the dowalk script after downloading did you?
Check the vortex log for messages that occurred at the end of that walk to see why that query failed.
abandoning new walk
Posted: Thu Sep 09, 2004 11:29 am
by KMandalia
I did tweak it in the sense I removed the keywords from createtable sql.
It may be possible that after remakeindex if you do refresh then it fails because thats what I did ( I downloaded the scripts, stopped and unregistered monitor, did the change in dowalk, registered monitor and did remakeindex which was successful. But when I went to admin page I got the message above)
abandoning new walk
Posted: Thu Sep 09, 2004 4:22 pm
by mark
Try a new walk on a new profile with an unmodified dowalk script.
abandoning new walk
Posted: Thu Sep 09, 2004 4:36 pm
by KMandalia
That would work, but I need to take out keywords meta tag from getting into index. How to do that without changing it in dowalk and doing remakeindex?
If I need to change anything related to index in the dowalk, I only do it in the sql statement 'create metamorph inverted index on html........'. No other places in dowalk right?
abandoning new walk
Posted: Thu Sep 09, 2004 5:13 pm
by mark
I just wanted you to try an unmodified dowalk to see if the mods were causing the problem.
You shouldn't have to use remakeindex except when you have an existing walk database indexed differently than you want to index now (different word expressions or different fields). In other words, once the index is the way you want it you never need to remake it because you've modified the script to do it right in the first place and the system will maintain it. As discussed in
http://thunderstone.master.com/texis/ma ... 413dcd9c15 there's one thing to change in dowalk and several in search.
abandoning new walk
Posted: Thu Sep 09, 2004 5:33 pm
by KMandalia
I do understand.
Lets say I had 5.0.1 dowalk. After sometime I decided to remove keywords meta from index and so got the latest 5.0.11 dowalk from the website, made changes and did remakeindex. The profile is set to refresh hourly and the database have 150,000 pages indexed so there is no way I am doing a new walk, and after remakeindex it will run sometime soon. When it does, it gives the test query error and I have no way of being certain whether keyword removal is successful or not. I just wanted to make sure we will never search based on keywords. Did I do something wrong?