We are using Webinator Professional 5.0.6. We just added some new meta keywords and performed a rewalk of the site. I did a select on the keywords column in the html table, and the old keywords are there. What do I need to do to update the keywords so a search will find those keywords.
Is there any other changes that requires a new walk before the content is picked up? We have only the rewalked scheduled automatically because it is so much quicker than a new walk. Are there any other cases where we need to do a manual new walk?
How does the Webinator know what is the last modified time? Currently it is on the same server as the website so I suppose it can look at the filesystem. But we are planning to move the Webinator to a dedicated server, at which point, it can only use an external ip address. Also, the site is an ASP site so the dynamic content can change without the ASP page being modified. Is it able to find changes in dynamic content?
I performed a new walk and now the page in question is no longer in the html table. The page is linked from the menu that is on every page. Why would the meta keywords not be picked up? The meta keywords for other pages are in the html table but I'm not sure if all pages are in the table.
Meta keywords are fairly irrelevant if the page isn't even being indexed. Is the page a javascript reference? Do you have javascript turned on? Did you get any errors for that page in the walk status?
Go to list/edit urls. Lookup a page that links to the missing page. Click it's "Children" link and see if the missing url is listed. Is it plain text or is it clickable? If it's clickable it's in the database. Is there an error message to the right of the url?
If the url's not in the Children list it wasn't discovered on the page. If it's listed it was discovered but not stored. If there's an error listed with it that's the problem. If not, one of the exclude rules probably skipped it. Turn verbosity up to 4 and do a new walk if you can't see why it was skipped.
We have a calendar page which has links for the next month and previous month. The webinator is walking the years 1780 through 2530. I see a timeout error reading from the calendar page.
Could the Webinator have aborted without walking further pages? Can I assume that the Max Depth setting will limit the number of calendar month pages that it will traverse?
Now I am gettng a Failure error immediately when I do a new walk. In the status, it says it is creating db1, then later it says it is keeping db2. But all of the data is in db1 and it should try to create db2. In the db2.long file, I keep getting the following.
2004-11-29 19:31:29 New walk could not remove db .../db2: Permission denied
100 C:\Program Files\Thunderstone Software\Webinator\texis\scripts/Webinator/dowalk(toptodo) 3729: id is not a valid field
I've tracked down the problem. I need to give full control to the Webinator file folder to the IIS User. It was working before with just read and write access to the folder. What changed, and do I really need to give full access?
Now that I can walk the site, I'd like to go back to Mark's message #8. Javascript is not turned on, but the page is not a javascript reference. List/Edit urls does not find the page. The page is on the menu for every page. We use CSS to display the menu, if that makes a difference. Also, the root index.asp does an immediate redirect to "home/", and this folder also contains an index.asp which contains the main page. Also not sure if that makes a difference.
I did find two errors in the walk status.
id Reason Url
015 _VortexSearchForErrors.txt:17: Line 7: parse error at "="
000 _VortexSearchForErrors.txt:17: SQLPrepare() failed with -1 in the function prepntexis