Webinator walking problem

rluan · Post by **rluan** » Wed Aug 15, 2001 8:11 am

I got the following error when walking a large site,

2001/08/15 02:18:24 Corrupt start pointers in KDBF file /usr/local/morph3/import/ccf_three/refs.tbl
2001/08/15 02:18:24 Record write failed

Do you know what is the actual problem and what can I do to fix it? Thanks in advance.

bart · Post by **bart** » Wed Aug 15, 2001 8:18 am

Sounds like you might have run out of disk space. You'll have to un-index and re-index after you free some space up.

rluan · Post by **rluan** » Wed Aug 15, 2001 8:23 am

I don't think so. When I run a du -k, I got the follows:

Filesystem kbytes used avail capacity Mounted on
/dev/dsk/c0t1d0s0 19623432 1781593 17645605 10% /usr/local/morph3/import

Plus, I use -noindex parameter when 'gw'.

Post by **John** » Wed Aug 15, 2001 9:27 am

While walking the Webinator was unable to write to the end of the refs.tbl. That could either be due to lack of disk space, or the refs.tbl may have exceeded the file size limit. That is unusual, but can happen if you have pages with a lot of links, and little text content. You can run gw with -R to not write to that table.

Post by **mark** » Wed Aug 15, 2001 10:22 am

Also check your file size ulimit. The system may be restricting your maximum allowed file size.