btree

resume.robot · Post by **resume.robot** » Sun Feb 17, 2002 1:07 pm

000 Unable to read page from btree

This error killed off gw spidering.

What is the cause/solution?

Thanks

Red Hat Linux release 6.2 (Zoot)
Kernel 2.0.36 on an i686

Webinator WWW Site Indexer Version 2.52 (Commercial)
Copyright(c) 1995,1996,1997,1998 Thunderstone EPI Inc.
Release: 19990218

Texis Web Script (Vortex) Copyright (c) 1996-1999 Thunderstone - EPI, Inc.
Commercial Webinator Version 2.6.919371322 of Feb 18, 1999

Post by **Kai** » Mon Feb 18, 2002 11:08 am

Was there any other text to the message, such as a file involved?

resume.robot · Post by **resume.robot** » Mon Feb 18, 2002 10:39 pm

nope

I just noticed a core dump in the working directory at the same time this was killed off.

There were simultaneous gw processes running. Is there a max? I have run multiple gw spiders many times but this server has not given me problems in the past.

Is there a practical limit to the number of gw's that can be run simultaneously?

Post by **mark** » Mon Feb 18, 2002 11:06 pm

There's no particular max, but a practical limit is probably between 10 and 30 depending on machine speed, connection speed, and remote server responsiveness and whether you're storing refs.