prob with gw

[Thunderstone]

Hi,

i am using gw -C -fshtml -d/XXX/newdb http://XXX.com

but it seems the index doesnt include any cgi script in my page.

help pls

Aaron.

[Thunderstone]

Perhaps your robots.txt is excluding them (see -r)
or maybe they are returning mime types that are not allowed (see -T).
You can turn up verbosity with -v5 to see why it rejects specific urls.