Hi
We are planning to use webinator as the main search tool for a quite large amount of web sites. I have a few "special demands" that I would like to check with you before we decide to use webinator.
There are several web sites that we want to index. One for each country. Each web site is also available in one or more languages. For example, the Swedish web site is available in English and Swedish. We want to generate a database (index?) per web site and language to be able to search them all separately. So if there are 10 countries it will be about 20 web sites to index (depending on how many languages each web site support).
For each database we will be generating a list of links that webinator should crawl. For each page in the list we want webinator to crawl each link on that page only one level down, but not to crawl certain links on the page, for example, each page has links to the same page in the the other available languages, and we don't want webinator to follow these links.
Can we use the "Ignore Tags" function in webinator and put specific tags around the links we don't want webinator to follow?
Can I create the settings for each database manually (programmatically)? When I look at the files generated from my settings in the free version, it looks like binary database-files of unknown format. I don't want to have to create the configuration for each database by using the web-interface.
How does the licensing work? If I know that no single database will contain more than 1 000 pages, can I go by that number when I purchase the webinator license, or should I count all the databases as one?
Many thanks for your help.
Regards,
Marcus Johansson
We are planning to use webinator as the main search tool for a quite large amount of web sites. I have a few "special demands" that I would like to check with you before we decide to use webinator.
There are several web sites that we want to index. One for each country. Each web site is also available in one or more languages. For example, the Swedish web site is available in English and Swedish. We want to generate a database (index?) per web site and language to be able to search them all separately. So if there are 10 countries it will be about 20 web sites to index (depending on how many languages each web site support).
For each database we will be generating a list of links that webinator should crawl. For each page in the list we want webinator to crawl each link on that page only one level down, but not to crawl certain links on the page, for example, each page has links to the same page in the the other available languages, and we don't want webinator to follow these links.
Can we use the "Ignore Tags" function in webinator and put specific tags around the links we don't want webinator to follow?
Can I create the settings for each database manually (programmatically)? When I look at the files generated from my settings in the free version, it looks like binary database-files of unknown format. I don't want to have to create the configuration for each database by using the web-interface.
How does the licensing work? If I know that no single database will contain more than 1 000 pages, can I go by that number when I purchase the webinator license, or should I count all the databases as one?
Many thanks for your help.
Regards,
Marcus Johansson
