Thunderstone Support Forums

We have just migrated our current IBM Websphere server , Oracle,Jasper 1.2.7, Java1.4 to Tomcat,MySql,Java 1.6 and Jasper 1.2.7 environment. But in production server we are seeing when thunderstone search crawler is crawling report urls, the threads are getting piled up and killing server. Please suggest settings? We tried changing below values, but no luck.

Thunderstone :

Max Process Size – 50 MB to Unlimited

Tomcat :

Max Threads – 200 to 400

Apache :

Timeout : 300 to 600

Seems your new setup can't take a rapid walk.
I can't help with tomcat or mysql.

In Webinator settings set threads to 1. If still problems try setting walk delay to non zero, maybe .1 or .5 or as much as 1 or 2 if the server is that poorly performing.

Max process size doesn't need to be increased unless you see frequent restarts due to that in the walk status. "Unlimited" should be avoided unless absolutely necessary as it could overwhelm the system if it got too huge.