Is there a way to use a regex to walk an entire domain so I don't have to
specify each web server on our campus? I can't be sure I can get a
canonical list of servers at our site since new ones come on line all the
time. Any help is appreciated.
Hans
------------------------------------------------------------------
Hans Kuhn, Academic User Services office (541) 346-1714
University of Oregon, 233 CC fax (541) 346-4397
An Interesting question, and one without a simple answer.
Many DNS servers prohibit reverse lookups thereby preventing
a scan of the registered domain space. A network scan within
a range of IP addresses is another way to identify all the servers,
but the time and bandwidth required might be prohibitive.
We are adding a "domain" option to Webinator that will allow
the walker to follow all links that reside within a domain.
This will be available next week along with the release of
Webinator 2.
We decided that DNS and IP-range scanning was outside the intended scope
of the Webinator GW program, and will be adding another utility
program to the suite of Webinator tools that will provide these
functions. There's no date yet for the release of this tool.
( You could get a copy of Satan, and strip it down to do this. )
We have added a lot of new functionality to Webinator that provide
it with more flexibility and ease of use within a batch/scheduled
environment . These features will also help automate domain indexes.
