While going through the Texis specifications, I note that maximum table size for a 32-bit machine is 2GB. I wondered about people's experience in getting around this in common use. In my case, the use will be for indexing a large number of web pages. My test run of 10,000 pages added up to 100MB; I guess this means I will be able to have 200,000 with a 2GB limit.
I thought of several ways to do this, for example by dividing the pages up into categories and then running the search on them together.
Has anyone any experience of doing this sort of thing? I suppose I could also limit the amount of data received for each page, although this would affect functionality.
Help much appreciated,
Benjamin Sims
I thought of several ways to do this, for example by dividing the pages up into categories and then running the search on them together.
Has anyone any experience of doing this sort of thing? I suppose I could also limit the amount of data received for each page, although this would affect functionality.
Help much appreciated,
Benjamin Sims
