Wrong server id

Post by **mark** » Thu Feb 21, 2002 2:54 pm

I left you voice mail. Call me.

jai.thomas · Post by **jai.thomas** » Thu Feb 21, 2002 6:16 pm

cleaning up shared mems on production server fixed that problem and I just started a walk.
Meanwhile, the walk on our test server got abandoned.
Here's the entries in vortex.log
000 Feb 21 17:01:38 /appsvr/inet/lyport/web/webinator/dowalk:848: Vortex (12542) ABEND: signal 11
000 Feb 21 17:01:38 /appsvr/inet/lyport/web/webinator/dowalk:848: Vortex (12542) ABEND: signal 11

line 848 is:
<sql "create metamorph inverted index xhtmlbodv on html(Title\Description\Keywords\Meta\Body,Visited)"></sql>

This is where we had the problem before and I doubt the same thing might happen on production also.
Is this another memory related problem? How do I fix this?

Thanks
Jai

Post by **mark** » Thu Feb 21, 2002 6:28 pm

A little suprising not see some other messages before the ABEND, but I'll take a guess that you didn't put the indexmem setting in updatemmindex as suggested earlier. Put it right after the <sqlcp cache close> in the updatemmindex function:
<sql "set indexmem=30000000"></sql>

Since your ulimit is 64meg, I would keep the indexmem number below 40meg just for safety.

jai.thomas · Post by **jai.thomas** » Thu Feb 21, 2002 6:40 pm

Actually I added the 'set indexmem' on both places. It is after the first line on both functions as given below. But I set it to 50000000. I will change it to 30000000 and try again. Meanwhile,if you can think of anything else, please let me know.

<a name=updatemmindex export drop=0>
<sqlcp cache close>
<sql "set indexmem=50000000"></sql>
................

<a name=createindex drop=0>
<sqlcp cache close>
<sql "set indexmem=50000000"></sql>
............

Thanks
Jai

jai.thomas · Post by **jai.thomas** » Thu Feb 21, 2002 7:04 pm

Just curious, is it possible to manually do the indexing and make the database live (flip). I have noticed that the failed walk has fetched all data and wondering if we could avoid doing another walk like this for testing purposes.
Thanks
Jai

Post by **mark** » Thu Feb 21, 2002 9:05 pm

with some gacking around...

Assuming the install directory is /usr/local/morph3 and the profile name is "myprofile", run this to find the currently live database:

texis -d /usr/local/morph3/texis/testdb -s "select String from options where Profile='myprofile' and Name='SS_db'"

Look at the returned value. It will end with db1 or db2. You need to change it to the other (eg if it's db1 you need to change it to db2). Use an update statement similar to the following to make the change:

texis -d /usr/local/morph3/texis/testdb -s "update options set String='/mydir/db1' where Profile='myprofile' and Name='SS_db'"

Delete the T*.* files, if any, from the database directory you have just made "live". Then run a remakeindex job from the command prompt (as the correct user).
texis profile=myprofile DOCUMENTROOT/webinator/dowalk/remakeindex.txt
See http://www.thunderstone.com/texis/site/ ... ing+dowalk

jai.thomas · Post by **jai.thomas** » Fri Feb 22, 2002 11:43 am

remakeindex is also failing with the same errors
000 Feb 22 10:17:21 /appsvr/inet/lyport/web/webinator/dowalk:848: Vortex (10829) ABEND: signal 11
000 Feb 22 10:17:21 /appsvr/inet/lyport/web/webinator/dowalk:848: Vortex (10829) ABEND: signal 11

But I am able to index by executing the sqls in tsql.
$ ../../../bin/tsql
Texis Version 04.00.1005677610(20011113) Copyright (c) 1988-2001 Thunderstone EP
I

SQL 1>drop index xhtmlbodv;
SQL 1>set indexmem=30000000;
SQL 1>create metamorph inverted index xhtmlbodv on html(Title\Description\Keywords\Meta\Body,Visited);
SQL 1>$

Same thing is happening on production server too.
Thanks
Jai

Post by **mark** » Fri Feb 22, 2002 12:19 pm

You say you set indexmem to 50meg in the script, but 30meg in tsql. Try 30meg in the script. It's also possible the ulimits are different under CGI land on your server. Put the following script into your webinator directory and try it from the web to see what you CGI ulimits are:

<script language=vortex>
<a name=main>
<exec nobr /bin/sh -c "ulimit -a"></exec>
<pre><send $ret></pre>
</a>
</script>

e.g.: save the above into a file called DOCUMENTROOT/webinator/ul then access it as http://yourserver/cgi-bin/texis/webinator/ul

jai.thomas · Post by **jai.thomas** » Fri Feb 22, 2002 3:28 pm

The one failed last night was with the changed indexmem=30mg.

I ran the script you gave and here' steh result
time(seconds) unlimited
file(blocks) unlimited
data(kbytes) 65536
stack(kbytes) 8192
memory(kbytes) unlimited
coredump(blocks) 4194303
nofiles(descriptors) 4096

Apparently there is no change.
I am wondering whether thiis is an HP-UX 11 specific problem. Error happens on both servers when executed using script.

Thanks
Jai

jai.thomas · Post by **jai.thomas** » Mon Feb 25, 2002 11:01 am

I tried with indexmem=10mg as you suggested and go the same result
000 Feb 22 21:25:18 /appsvr/inet/lyport/web/webinator/dowalk:848: Vortex (14048) ABEND: signal 11
000 Feb 22 21:25:18 /appsvr/inet/lyport/web/webinator/dowalk:848: Vortex (14048) ABEND: signal 11

Heres the directoy listing on db1(failed db) after abend.
$ ls -l
total 1291944
-rw------- 1 www other 32224 Feb 22 14:57 SYSCOLUMNS.tbl
-rw------- 1 www other 6956 Feb 22 21:16 SYSINDEX.tbl
-rw-rw-rw- 1 www other 8 Feb 25 10:08 SYSLOCKS.SEQ
-rw------- 1 www other 3318 Feb 22 14:57 SYSMETAINDEX.tbl
-rw------- 1 www other 5278 Feb 22 14:57 SYSPERMS.tbl
-rw------- 1 www other 1996 Feb 22 21:25 SYSSTATS.tbl
-rw------- 1 www other 10968 Feb 22 14:57 SYSTABLES.tbl
-rw------- 1 www other 3318 Feb 22 14:57 SYSTRIG.tbl
-rw------- 1 www other 3466 Feb 22 14:57 SYSUSERS.tbl
-rw------- 1 www other 3318 Feb 22 14:57 categories.tbl
-rw------- 1 www other 3360 Feb 22 21:12 counts.tbl
-rw------- 1 www other 1169446 Feb 22 21:12 error.tbl
-rw------- 1 www other 381516392 Feb 22 21:12 html.tbl
-rw------- 1 www other 3456 Feb 22 14:57 options.tbl
-rw------- 1 www other 3318 Feb 22 14:57 querylog.tbl
-rw------- 1 www other 89938748 Feb 22 21:12 refs.tbl
-rw------- 1 www other 6084 Feb 22 20:25 todo.tbl
-rw------- 1 www other 3318 Feb 22 14:57 vortex.tbl
-rw------- 1 www other 160 Feb 22 14:57 xcatno.btr
-rw------- 1 www other 844966 Feb 22 21:12 xerrorurl.btr
-rw------- 1 www other 50 Feb 22 21:16 xhtmlbodv_D.btr
-rw------- 1 www other 721 Feb 22 21:25 xhtmlbodv_P.tbl
-rw------- 1 www other 160 Feb 22 21:16 xhtmlbodv_T.btr
-rw------- 1 www other 160 Feb 22 21:13 xhtmlcat.btr
-rw------- 1 www other 9580160 Feb 22 21:13 xhtmldepth.btr
-rw------- 1 www other 1763590 Feb 22 21:12 xhtmlhash.btr
-rw------- 1 www other 2362336 Feb 22 21:12 xhtmlid.btr
-rw------- 1 www other 7710040 Feb 22 21:12 xhtmlurl.btr
-rw------- 1 www other 8362 Feb 22 14:57 xoptname.btr
-rw------- 1 www other 8362 Feb 22 14:57 xoptstr.btr
-rw------- 1 www other 160 Feb 22 14:57 xqueryid.btr
-rw------- 1 www other 77730514 Feb 22 21:16 xrefsref.btr
-rw------- 1 www other 88639174 Feb 22 21:14 xrefsurl.btr
-rw------- 1 www other 9400 Feb 22 20:25 xtodourl.btr
-rw------- 1 www other 160 Feb 22 14:57 xvid.btr

Thanks
Jai