An external site is complaining to us about 1000s of hits Webinator seems to generate every day.
I have tried many things to stop this from happening as we don't want to index this site anyway.
These are the things I have done so far (in this order):
1. Removed the url from Base URL (under all walks)
2. Made sure robots.txt was set to Y
3. Deleted the whole profile and re-created it again (without this external url and the above settings) and reindexed.
Besides only two rather drastic measures (below) I am at a loss what to do:
A. asking this external company to stop all requests coming from the search engine's site (IP address) with agent string Mozilla/4.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E)";
B. remove Webinator and carry out a complete reinstall.
PS. This problem started when I installed the latest version of Webinator (V5.1 with PDF/Word plugin).
Thanks a lot,
Jan
I have tried many things to stop this from happening as we don't want to index this site anyway.
These are the things I have done so far (in this order):
1. Removed the url from Base URL (under all walks)
2. Made sure robots.txt was set to Y
3. Deleted the whole profile and re-created it again (without this external url and the above settings) and reindexed.
Besides only two rather drastic measures (below) I am at a loss what to do:
A. asking this external company to stop all requests coming from the search engine's site (IP address) with agent string Mozilla/4.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E)";
B. remove Webinator and carry out a complete reinstall.
PS. This problem started when I installed the latest version of Webinator (V5.1 with PDF/Word plugin).
Thanks a lot,
Jan