Page 1 of 2

Error deleting URL

Posted: Wed Dec 06, 2006 5:08 pm
by edev
I tried to delete 355 URLs from the list/edit URL option in admin, everything seem to be fine but after the deletion the "schedule status" on the admin screen had dissapeared for all profiles, everything showed up as "site has not been submitted for walk yet".

I tried the list URL again in the profile I updated, and the URLs are there, however when I do a search it gave me the following error:
002 /webinator/search:2203: Unable to open table E:\profile1\db2\bestbets
115 /webinator/search:2203: No such table: bestbets in the database: E:\profile1\db2\
000 /webinator/search:2203: SQLExecute() failed with -1
002 /webinator/search:2203: Unable to open table E:\CultureCaWalks\CultureCa_testAll\db2\bestbets
115 /webinator/search:2203: No such table: bestbets in the database:E:\profile1\db2\
000 /webinator/search:2203: SQLExecute() failed with -1
002 /webinator/search:1731: Unable to open table E:\profile1\db2\SYSCOLUM
115 /webinator/search:1731: No such table: SYSCOLUMNS in the database: E:\profile1\db2\
000 /webinator/search:1731: SQLPrepare() failed with -1

It also cancelled one of my current walks. I have enterprise webinator and have license to index 1 million records. Is there anyway I can retrieve back my records? There are almost 1 million records in this profile and it will take days before I can get it walked again.

Error deleting URL

Posted: Wed Dec 06, 2006 5:20 pm
by edev
I tried "reindex", "redict" and "remakeindex" and still no results turned up. Oddly all the data is still there in the directories.

Error deleting URL

Posted: Wed Dec 06, 2006 5:47 pm
by mark
http://thunderstone.master.com/texis/ma ... 4577338a10

Are you sure you didn't bash something when you were fussing with the options table? Compare what the options table says for SS_db and SS_dataspace with where you see the data.

Error deleting URL

Posted: Wed Dec 06, 2006 7:16 pm
by edev
Actually this is on a different server, it's on our development server. The previous problem was on our production server.

Now I have all the records in the directories, I just can't reindex them. Is there any way to get them working again?

Error deleting URL

Posted: Thu Dec 07, 2006 12:46 pm
by mark
A bunch of files in the dir doesn't mean the records are there. See what's in the table with

texis -d YOURDB -s "select count(Url) from html"
texis -d YOURDB -l 20 -s "select Url from html"
texis -d YOURDB -s "select * from SYSINDEX"

Error deleting URL

Posted: Thu Dec 07, 2006 1:33 pm
by edev
Thank you Mark. So I got these:

texis -d YOURDB -s "select count(Url) from html"

count(Url)
-----------
971208texis

texis -d YOURDB -l 20 -s "select Url from html"

Got a bunch of URLs


Texis Web Script (Vortex) Copyright (c) 1996-2006 Thunderstone - EPI, Inc.
Commercial Webinator Version 5.01.1160077904 20061005 (i686-intel-winnt-64-32)

count(Url)
------------+
971208

C:\Program Files\Thunderstone Software\Webinator>texis -d E:\CultureCaWalks\Cult
ureCa_testAll/db2 -l 20 -s "select Url from html"
Texis Web Script (Vortex) Copyright (c) 1996-2006 Thunderstone - EPI, Inc.
Commercial Webinator Version 5.01.1160077904 20061005 (i686-intel-winnt-64-32)

Url
------------+
http://www.civilization.ca/archeo/inuksuit/inuk00f.html
http://www.civilization.ca/archeo/inuks ... kbiof.html
http://www.civilization.ca/archeo/inuks ... kphof.html
http://www.civilization.ca/archeo/inuks ... kintf.html
http://www.civilization.ca/archeo/inuks ... kp01f.html
http://www.civilization.ca/archeo/inuks ... kp02f.html
http://www.civilization.ca/archeo/inuks ... kp03f.html
http://www.civilization.ca/archeo/inuks ... kp04f.html
http://www.civilization.ca/archeo/inuks ... kp05f.html
http://www.civilization.ca/archeo/inuks ... kp06f.html
http://www.civilization.ca/archeo/inuks ... kp07f.html
http://www.civilization.ca/archeo/inuks ... kp08f.html
http://www.civilization.ca/archeo/inuks ... kp09f.html
http://www.civilization.ca/archeo/inuks ... kp10f.html
http://www.civilization.ca/archeo/inuks ... kp11f.html
http://www.civilization.ca/archeo/inuks ... kp12f.html
http://www.civilization.ca/archeo/inuks ... kp13f.html
http://www.civilization.ca/archeo/inuks ... kp14f.html
http://www.civilization.ca/archeo/inuks ... kp15f.html
http://www.civilization.ca/archeo/inuks ... kp16f.html

C:\Program Files\Thunderstone Software\Webinator>texis -d E:\CultureCaWalks\Cult
ureCa_testAll/db2 -l 20 -s "select * from SYSINDEX"
Texis Web Script (Vortex) Copyright (c) 1996-2006 Thunderstone - EPI, Inc.
Commercial Webinator Version 5.01.1160077904 20061005 (i686-intel-winnt-64-32)

NAME TBNAME FNAME COLLSEQ TYPE NON_UNIQUE
FIELDS PARAMS
------------+------------+------------+------------+------------+------------+--
----------+------------+
xhtmlurl html xhtmlurl A B 00 Ur
l
xvid vortex xvid A B 00 id

xhtmlhash html xhtmlhash A B 01 Ha
sh
xhtmlid html xhtmlid D B 01 id
-
xhtml_nc html xhtml_nc A B 01 Ne
xtCheck
xerrorurl error xerrorurl A B 00 Ur
l
xerrorid error xerrorid D B 00 id
-
xtodourl todo xtodourl A B 00 Ur
l
xcatno categories xcatno A B 01 Ca
tno
xoptname options xoptname A B 01 Na
me
xoptstr options xoptstr A B 01 St
ring max_index_text=128;
xqueryid querylog xqueryid D B 01 id
-
xhtmlvisit html xhtmlvisit D B 01 Vi
sited-
xtodocoll todo xtodocoll A B 01 Co
llectionId
xrefsurl refs xrefsurl A B 01 Ur
l
xrefsref refs xrefsref A B 01 Re
f
xmmbestbetskeywords bestbets xmmbestbetskeywords A F 0
1 Keywords
xtodoid todo xtodoid A B 01 id

xhtmlcat html xhtmlcat A B 01 Ca
tno
xhtmldepth html xhtmldepth A B 01 ,D
epth Url

C:\Program Files\Thunderstone Software\Webinator>

Error deleting URL

Posted: Thu Dec 07, 2006 1:34 pm
by edev
So it really looks like I still have all my data, I just can't index anything.

Error deleting URL

Posted: Thu Dec 07, 2006 1:47 pm
by edev
Actually this happened twice today to two of my new walks...nothing was indexed after the walk. I reindexed over and over and still no luck. There was no errors in "walk status".

Error deleting URL

Posted: Thu Dec 07, 2006 3:04 pm
by mark
Check vortex.log.
Make sure your disk isn't full or read-only.
Tell exactly how you're trying to index.

If you create a completely new profile and walk a few pages with it does that work?

Error deleting URL

Posted: Thu Dec 07, 2006 3:07 pm
by edev
I tried once last night it worked, but this morning it didn't work again.

When I tried to do a search on one of the old profiles that used to work, it gave me this error:

118 /webinator/search:1978: <EXEC> command "C:\Program Files\Thunderstone Software\Webinator\etc\aspell\bin\aspell" returned exit code 1
"C:\Program Files\Thunderstone Software\Webinator\etc\aspell\bin\aspell" errors: Error: The file "E:\profile1/db2/aspellDict1" can not be opened for reading.