Hi
I am using free webinator 2.5
when I try to exclude pages from another site ie. newsgroup lists.
Webinator goes ahead and indexes them anyway
I have tried
gw -http://www.scu.edu.au/lists/ http://www.scu.edu.au
it gets all the folders under lists ie
www.scu.edu.au/lists/future_1/1851.html
I tried
gw -xhttp://www.scu.edu.au/lists/ http://www.scu.edu.au/
same result . I end up with 10,000 pages of news articles
I tried to delete the extra pages with
gw -s"delete from html where Url like '/www.scu.edu.au/lists'"
gw -s"delete from refs where Url like '/www.scu.edu.au/lists'"
gw -index
but the pages appear to still be there
help please.
when you run webinator the first time with a option file and url list it
indexes the home page
if you run it again it goes to the links on the home page .. Is there any
way to know how deep it will go before you run it ?
Wayne