multiple directories, multiple pages, multiple depths

[Thunderstone]

I have a series of directories and subdirectories which contain pages
which, during normal browsing, are obtained only through a CGI script.
However, I would also like these pages to appear in search results.
There is no index page or html page which links them together.

I realize that I can give it a list of URLs in a file, but that would
be a maintenance nightmare. Is there a way that I can tell Webinator to
look in all of the subdirectories of a given directory and grab all of
the html files it finds?

Thanks in advance.

[Thunderstone]

Either enable directory indexing on the Webserver or walk the cgi script.

[Thunderstone]

This will only give you the first directory... not all of it's
subdirectories.

Got any other ideas?


Thunderstone - EPI wrote:

[Thunderstone]

Directory indexing WILL do all other subdirectories provided you
don't have an index.html in each one.