I seem to have a strnge problem here at www.mccc.edu -- not
everything at www.mccc.edu gets indexed!
I know about robots.txt; the directories listed there don't
get indexed but that's OK.
It seems that gw doesn't follow symbolic links. Is that
true? Is there a way to force it to follow specified ones?
Also, it seems that SOME directories with 755 permissions
are not indexed. However, when I changed one of those to
775 (like the ones that get indexed) and did a rewalk, it
still wasn't included. I'm going to -wipe and try again.
Thanks,
Pete