Sorry, you have reached the maximum number of HTML pages allowed.

[mhudack]

I'm afraid that I have a rather large site (intellnet.org) with what's estimated to be thousands of pages (we use a SQL database that currently has about 5,000 records in it -- every record has at least one page associated with it, in addition to the indexes that display the records.

The first time I walked the site, things seemed to work relatively well -- the database was built and was well searchable.

However, I am now getting the error message "Sorry, you have reached the maximum number of HTML pages allowed." whenever I try to walk the site. Given that new content is added daily (on the order of twenty to fifty records daily), I need to be able to walk the site nightly.

Is this a limitation of the free version, or is there a problem with my configuration perhaps?

--
Mike Hudack
Editor: IntellNet.org

[mhudack]

Okay. I'm rather red in the face right now.

I just read the description of the free version, and it has a ten thousand page limit. I believe that at this time we can prevent the walking of the index pages, however this won't work forever.

IntellNet's a non-profit and has made a total of zero dollars in its six months of operation (even our bandwidth and servers are donated) and we can't afford seven hundred dollars for search software.

Does anyone have any ideas about options that may be available to us besides ht://dig?

[ryan4]

I haven't done this, but I believe the free version does support multiple databases. You might try dividing your site into multiple databases. There should be a way for your search script to hit both databases.
-Ryan Casey