webinator improvements

Post Reply
User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

webinator improvements

Post by Thunderstone »



We are very impressed with your Webinator indexing and searching
utility. It allows us to index other web servers at affiliated
institutions, and provides ranked results with a variety of search
options.

I will echo the remarks seen recently on this list: we'd like to keep
a log of each search query performed by the Webinator, preferably with
the NUMBER OF SECONDS required for each search. This is important for
performance evaluation on our web servers.

As I begin to move webinator into production use I am struck by
another important issue. We need to recreate each index on a weekly
basis but we want the existing index to remain available during this
process. It takes about 12 hours to create the index. Can we create
the index in a separate directory, and then move it to the real
location when it's complete?

Ben Beecher
AcIS R&D
Columbia University
User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

webinator improvements

Post by Thunderstone »



On Thu, 5 Dec 1996, Ben Beecher wrote:
[...snip...]
Yes. You could also create a temporary database which you rename to the
live database when the indexing is complete. Here is an outline

#--------------------------------------------
#!/sbin/sh

cd /path-to-webinator/bin
gw -d/path/temp-database -(options) http://url/
gw -i -dtempname -(options) http://url/

gw -wipe -d/path/old-database
mv /path/live-database /path/old-database
mv /path/temp-database /path/live-database

#---------------------------------------------

Hope that helps.


Regards
Anthony,
Post Reply