I am currently running the previous version of Webinator (1.2?)
on our production web server, and am testing Webinator 2.1 on
a production-identical evaluation machine. The indexes come out
way different, with identical robots.txt.
2.1 finds more. Much more. Shouldn't the indexes be identical if
the web dir, robots.txt, and the gw commands are identical?
In general yes. They should be the same. But if you are referring to your
web server by several different names within your documents, the older
webinator could miss some pages, because it didn't always recognize every
alias for a given host. Version 2 recognizes every alias for a host (unless
you use -L).
