Page 1 of 1

extra domains

Posted: Thu Oct 17, 2002 1:40 pm
by vallinem
We're running Thunderstone on an Intranet, and I'd like to index a small portion of our Internet site as well.

What I did
1) created a test index, copying the Intranet index
2) marked enterprise = YES with the domain name of the intranet site
3) on one of the Intranet pages, added a link to a page on the internet site - http://www.co.kern.ca.us/its/default.asp

4) under Extra domains, entered http://www.co.kern.ca.us/its/

5) indexed the site

6) looked at list of URLs, and also at the children of the page I'd added the link to, and confirmed that the /its directory it wasn't indexed.

I also tried a test index where I just indexed
http://www.co.kern.ca.us/its/ and that was successful.

What am I doing wrong?

extra domains

Posted: Thu Oct 17, 2002 1:48 pm
by mark
http://www.co.kern.ca.us/its/ is not a domain. www.co.kern.ca.us and co.kern.ca.us are domains. What you want is just to add another base url. Start over with a copy of your working profile. Then add another line to the "Base URL" box that reads
http://www.co.kern.ca.us/its/
(or http://www.co.kern.ca.us/its/default.asp if the "default.asp" part is required)
And make sure you have .asp in your extension list.

extra domains

Posted: Tue Feb 24, 2004 1:17 pm
by mmcfadden
I am trying to determine when it is a good time to add an extra domain or add another base URL. What is the benefit to one or the other. We use stay under all the time to index only sub sections of a site. For example http://www.usdoj.gov/crt/ada/adahom1.htm but from this page there is a link to a page within the http://www.usdoj.gov/crt/foia/index.htm that we would like to index this set of documents aswell. This seems like a time when I would want to use the extra domain setting right? I am trying to determine a reasoning for choosing one or the other.

extra domains

Posted: Tue Feb 24, 2004 2:22 pm
by mark
Extra domain means Webinator is allowed to get urls from that domain/site if it happens to encounter them.

Base URL tells Webinator places to start looking.

You'll want multiple base urls for what you describe.

When your base urls are on multiple hosts it's often a good idea to also add the associated hosts to the extra domains.