Walk fails

tmarino · Post by **tmarino** » Thu May 09, 2002 4:19 pm

We get the following (see below) after performing a walk. We have already increased disk space by 1 gig and are walking in excess of 175,000 pages. Any ideas on how much disk space we need? Tom

***************************************************
Creating search index on fetched pages...
106 /usr/local/morph3/htdocs/webinator/dowalk(updatemmindex) 810: You may be low on disk space. in the function create index

006 /usr/local/morph3/htdocs/webinator/dowalk(updatemmindex) 810: Can't write 0x7D06 bytes at 0x7A9508 to KDBF file /usr/local/morph3/texis/default/db2/T35554a.btr: error 28: No space left on device in the function write_block

000 /usr/local/morph3/htdocs/webinator/dowalk(updatemmindex) 810: Abandoning index /usr/local/morph3/texis/default/db2/xhtmlbodv due to errors

006 /usr/local/morph3/htdocs/webinator/dowalk(updatemmindex) 810: Can't write 0x18600 bytes at 0x1A882DE to KDBF file /usr/local/morph3/texis/default/db2/T35554a.dat: error 28: No space left on device in the function write_outbuf

006 /usr/local/morph3/htdocs/webinator/dowalk(updatemmindex) 810: Can't write start pointers (0x0 and 0x0) to KDBF file /usr/local/morph3/texis/default/db2/T35554a.dat: error 28: No space left on device in the function write_start_ptrs

111 /usr/local/morph3/htdocs/webinator/dowalk() 810: Too many messages in the function addputmsg

111 () 810: Too many messages in the function addputmsg
Done.

Walk finished at 2002-05-09 11:41:52 (took 46 hours 25 minutes 11 seconds)
Making new database live: /usr/local/morph3/texis/default/db2

******************************************************

Post by **John** » Thu May 09, 2002 5:02 pm

You have actually crawled all the pages. How large are the html.tbl and html.blb files in the /usr/local/morph3/texis/default/db2 directory? That will give you an idea of how much data you have crawled.

tmarino · Post by **tmarino** » Thu May 09, 2002 5:52 pm

ok, thanks. How do I recreate the index from the command line using Reindex ?

Post by **mark** » Thu May 09, 2002 6:12 pm

See
http://www.thunderstone.com/texis/site/ ... ing+dowalk
for instructions on using reindex from the command line.

tmarino · Post by **tmarino** » Fri May 10, 2002 9:22 am

The instructions are confusing. Please explain "This would be used after changing the Word Definition expressions."

Post by **mark** » Fri May 10, 2002 10:37 am

That's just an example of when it might be used. Ignore that and use it.