Multiple robots.txt files?

[Thunderstone]

I want to use the robots.txt file to disallow certain trees from getting
indexed for one database, but allow webinator to index those trees for a
different database.

Is this possible, or must I use the -x option?

Thanks so much for your help.
Steve Bohler

[Thunderstone]

Yes. See the -r option (http://www.thunderstone.com/gw2man/node21.html)
for ignoring robots.txt.