No documents match the query ...

sduggan
Posts: 84
Joined: Tue Mar 20, 2001 9:16 am

No documents match the query ...

Post by sduggan »

Volume in drive Q has no label.
Volume Serial Number is 38CC-B230

Directory of Q:\Program Files\Thunderstone Software\Webinator\Texis\default\db2

05/07/02 11:37a 3,324 SYSUSERS.tbl
05/07/02 11:37a 3,212 SYSTRIG.tbl
05/07/02 11:37a 3,212 SYSMETAI.tbl
05/07/02 11:37a 422 SYSSTATS.tbl
05/07/02 11:37a 148 xvid.btr
05/07/02 11:37a 3,212 vortex.tbl
05/07/02 11:37a 3,212 categories.tbl
05/07/02 11:37a 148 xcatno.btr
05/07/02 11:37a 10,335 SYSTABLE.tbl
05/07/02 11:37a 26,007 SYSCOLUM.tbl
05/07/02 11:37a 148 xqueryid.btr
05/07/02 11:37a 3,212 querylog.tbl
05/07/02 11:37a 8,346 xoptname.btr
05/07/02 11:37a 3,295 options.tbl
05/07/02 11:37a 8,346 xoptstr.btr
05/07/02 11:41a 4,552 SYSPERMS.tbl
05/07/02 11:41a 5,671 SYSINDEX.tbl
05/07/02 11:41a 4,279 todo.tbl
05/07/02 11:41a 9,380 xtodourl.btr
05/07/02 12:05p 6,700,142 refs.tbl
05/07/02 12:06p 28,607 error.tbl
05/07/02 12:06p 131,316 xhtmlid.btr
05/07/02 12:06p 24,742 xerrorurl.btr
05/07/02 12:06p 90,326 xhtmlhash.btr
05/07/02 12:06p 303,474 xhtmlurl.btr
05/07/02 12:06p 3,234 counts.tbl
05/07/02 12:06p 21,716,283 html.tbl
05/07/02 01:50p 8 SYSLOCKS.SEQ
05/07/02 02:25p <DIR> .
05/07/02 02:25p <DIR> ..
05/07/02 02:40p 0 list.txt
31 File(s) 29,098,593 bytes
6,568,845,312 bytes free
User avatar
mark
Site Admin
Posts: 5513
Joined: Tue Apr 25, 2000 6:56 pm

No documents match the query ...

Post by mark »

It's still in the walk phase (or right after it). It hasn't summarized the walk or tried to make any search indices yet.

I don't suppose you can tell from the webserver's log what the last page(s) it fetched were? If so you might try a separate walk of just the last or last few pages to see if they are causing a problem. Otherwise you probably need to do a walk by hand with high verbosity. Set verbosity to 3 in the admin interface. Then see http://www.thunderstone.com/texis/site/ ... ing+dowalk for how to start a walk by hand. You want the "dispatch" function with ttyverbose=9. Something similar to
NSTALLDIR\texis profile=default ttyverbose=9 dowalk/dispatch.txt

You're mainly interested in what it says right before it gets "stuck". A lot of stuff is going to fly by before that. The walk status report will also have some more info in it.

It might also be helpful to know what settings you have changed from their defaults.
sduggan
Posts: 84
Joined: Tue Mar 20, 2001 9:16 am

No documents match the query ...

Post by sduggan »

Hi Mark,
You say it's still in the 'Walk' phase or right after it, then why would I get the message 'Abandoned' ? Also,
last week I tried to do a walk of a separate website we have altogether and got the same situation. How would I know what are the last few pages,(is that what appears in the "Walk Status" window, and how would I do a search on just those?

I'll try changing the verbosity and see what happens.

If this works by doing a walk by hand, does that mean I'm not going to be able to use the Web Inteface any more?
User avatar
mark
Site Admin
Posts: 5513
Joined: Tue Apr 25, 2000 6:56 pm

No documents match the query ...

Post by mark »

I mean that's where it was abandoned.

I was suggesting looking at the webserver logs of the server you were walking if you have access to them. You can tell which ones were by webinator by user agent or by the ip of the machine where you're running webinator.

I don't expect anything to change with the walk by hand. Just doing it that way with verbosity cranked up may help point more specifically to the problem.
sduggan
Posts: 84
Joined: Tue Mar 20, 2001 9:16 am

No documents match the query ...

Post by sduggan »

I haven't tried to do a manual walk yet, but I did exclude a URL that I thought my be causing problems and and got this for a status report. I thought it might provide some clue to pin point the problem/

+++++++++++++
Walk Status
Current Profile: default Webinator 4.0.5-Windows-w/plugin
Latest run: ABANDONED

Webinator Walk Report for default

Creating database C:\Program Files\Thunderstone Software\Webinator/texis/default/db2...Done.
Walk started at 2002-05-08 13:20:00 (by user)
Verbosity set to 3
Start fetching at http://{sitename}/
http://webdev/
Ignore urls containing any of the following:
/cgi-bin/
~
?
/worldwide/pr/uk/www.westcoast.com/events/awards/
started 1 (768) on http://{sitename}/

200 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: Timed out waiting for Mutex in the function semlock while processing url http:///{sitename}/support/impguides/category.asp

200 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: Timed out waiting for Mutex in the function semlock while processing url http:///{sitename}/support/impguides/category.asp

200 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: Timed out waiting for Mutex in the function semlock while processing url http://{sitename}/support/impguides/category.asp

000 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: Could not create locks for error in the function opendbtbl while processing url http:///{sitename}/support/impguides/category.asp

115 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: No such table: error in the database: C:\Program Files\Thunderstone Software\Webinator\texis\default\db2\ while processing url http:///{sitename}/support/impguides/category.asp

000 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: SQLExecute() failed with -1 in the function execntexis while processing url http:///{sitename}/support/impguides/category.asp
1449 pages (89,159,308 bytes).
36 errors.
11 duplicate pages.

1449 http://{sitename}/support/life-cycle/agent-matrix.html (18,183 bytes)
1448 http://{sitename}/support/forms/tokenfaq.html (31,409 bytes)
1447 http:///{sitename}/support/call-handling/holidays.html (20,807 bytes)
1446 http:///{sitename}/support/call-handling/call-handling.html (24,923 bytes
User avatar
mark
Site Admin
Posts: 5513
Joined: Tue Apr 25, 2000 6:56 pm

No documents match the query ...

Post by mark »

Badness has occured. That message is in the category of "that should never happen". That means some process held the lock for many seconds when it should never need to be held for more than a small fraction of a second. Is this system heavily loaded or swapping (things that could cause a process with the lock to get suspended for an excessively long time)?

An overloaded system *might* cause the walker to die or be killed ungracefully somehow. Maybe the overall dispatcher is getting killed so when the site walker finishes it's site the dispatcher is gone so the summary and indices are never made?
sduggan
Posts: 84
Joined: Tue Mar 20, 2001 9:16 am

No documents match the query ...

Post by sduggan »

I'm making some progress..

I did a search on just html and htm extensions and had success, I did another search, narrowed the scope for speed and on just .pdf's and that worked fine, but then I did it again with same scope on just .asp's and got this:
==============================
Walk Status
Current Profile: default Webinator 4.0.5-Windows-w/plugin
Latest run: ABANDONED

Webinator Walk Report for default

Creating database C:\Program Files\Thunderstone Software\Webinator/texis/default/db1...Done.
Walk started at 2002-05-08 14:35:06 (by user)
Verbosity set to 4
Start fetching at http:///{sitename}/support
http://{sitename}/support
Ignore urls containing any of the following:
/cgi-bin/
~
?
/worldwide/pr/uk/www.westcoast.com/events/awards/
started 1 (1156) on http:///{sitename}/support

200 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: Timed out waiting for Mutex in the function semlock while processing url http://w/{sitename}/support/impguides/category.asp

200 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: Timed out waiting for Mutex in the function semlock while processing url http:///{sitename}/support/impguides/category.asp

200 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: Timed out waiting for Mutex in the function semlock while processing url http:///{sitename}/support/impguides/category.asp

000 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: Could not create locks for error in the function opendbtbl while processing url http://{sitename}/support/impguides/category.asp

200 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: Timed out waiting for Mutex in the function semlock while processing url http:///{sitename}/support/impguides/category.asp

115 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: No such table: error in the database: C:\Program Files\Thunderstone Software\Webinator\texis\default\db1\ while processing url http:///{sitename}/support/impguides/category.asp

000 E:\inetpub\millenium\webinator\dowalk(procpage) 1378: SQLExecute() failed with -1 in the function execntexis while processing url http:///{sitename}/support/impguides/category.asp
9 pages fetched (150,875 bytes) from http:///{sitename}/support
9 pages (150,875 bytes).
153 errors.
2 duplicate pages.

9 http://{sitename}/support/securcare/value-kit/ (16,477 bytes)
8 http://{sitename}/support/impguides/index.asp (21,722 bytes)
7 http://{sitename}/support/securcare/ (17,861 bytes)
6 http:///{sitename}/support/life-cycle/ (21,787 bytes)
5 http:///{sitename}/support/forms/ (16,495 bytes)
4 http:///{sitename}/support/call-handling/ (13,963 bytes)
3 http:///{sitename}/support (19,265 bytes)
User avatar
mark
Site Admin
Posts: 5513
Joined: Tue Apr 25, 2000 6:56 pm

No documents match the query ...

Post by mark »

I assume you're running webinator on the same server containing the asp pages. It would appear that that server does not have enough power to run the walk and execute asp pages at the same time.
sduggan
Posts: 84
Joined: Tue Mar 20, 2001 9:16 am

No documents match the query ...

Post by sduggan »

Maybe,
I did it again on just .asp's and excluded the /support folder and it worked. I think it's just this URL that's causing the problem:http://{sitename}/support/impguides/category.asp
(unfortunately a very important URL to index)

You can visit the live site http://www.rsasecurity.com/support/impguides/index.asp to see how the .asp app lication works and maybe get some clue.

I'm also getting this problem lately as well, the webadmin is crapping out after doing a search with this message:
===================================================
Texis Web Script (Vortex) Copyright © 1996-2002 Thunderstone - EPI, Inc.
Unknown Version 4.00.1017771124 of Apr 2, 2002 (i686-intel-winnt-32)

Error
011 Texis Monitor process failed to create license segment
000 May 8 14:57:40 Cannot get config settings 000 Cannot get config settings
====================================================

I'm not going to give up on this...I've come so far :)
User avatar
mark
Site Admin
Posts: 5513
Joined: Tue Apr 25, 2000 6:56 pm

No documents match the query ...

Post by mark »

Can't really tell what asp is doing behind the scenes to construct those pages since we only see the end result. They are pretty slow to deliver though. They must be doing a lot of processing (compared to the power available on the server). Try reducing how hard the walker hits the server by reducing Threads and Servers both to 1.
Post Reply