Can anyone suggest a way to do this:
I gave the free version of Webinator 3000 URLs to look at. It stopped after 10,000 pages as designed. Can anyone suggest a way that I could get a rough estimate from this of how many pages would be indexed if the 10,000 page limitation was not in place?
I need to know in order to decide which commercial version we need and how much bandwidth we should plan for the crawls.
Thanks in advance,
I gave the free version of Webinator 3000 URLs to look at. It stopped after 10,000 pages as designed. Can anyone suggest a way that I could get a rough estimate from this of how many pages would be indexed if the 10,000 page limitation was not in place?
I need to know in order to decide which commercial version we need and how much bandwidth we should plan for the crawls.
Thanks in advance,