multiple metasearch engine

Post Reply
User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

multiple metasearch engine

Post by Thunderstone »




Hi:
I want to use webinator program for make a multiple/metasearch engine
including my metasearch site.
I´m using the next example:
Meta Search Engine & Parser

my problem is that the script not function to my search engine, i make the
next changes in the script:

<$searchurl =
"http://www.excite.com/search.gw?search=xyzzy"
"http://guide-p.infoseek.com/Titles/?qt=xyzzy"
"http://ink.yahoo.com/bin/query?p=xyzzy"
"http://www.lycos.com/cgi-bin/pursuit?mt ... ava&npl=ma
t$
* here is
change"http://edcf.netspace.com.mx/cgi-bin/tex ... ?db=db&que
ry=xyzz$
"http://search.yahoo.com/searcho=1&p=xyz ... s&g=0&n=10"
<$searchname =
"Excite"
"Infoseek"
"Inktomi"
"Lycos"
"NetSpace"
"Yahoo"
<$bases =
"http://www.excite.com/"
"http://guide-p.infoseek.com/"
"http://ink.yahoo.com/bin/query/"
"http://www.lycos.com/"
"http://edcf.netspace.com.mx"
"http://www.yahoo.com/"

and in the $imports zone i´m use the same funtions to thunderstone:

'#NetSpace
multiple
recexpr >><dt>=[^<\x0a]+<a
=[^>]+>=[^<\x0a]+</a><dd>=[^<\x0a]+<tt>=[^<\x0a]+</t$
# 1 2 3 4 5 6 7 8 9 0 $
# Name Type Tag
field Link varchar(40) 3-5
field Title varchar(80) 6
field Abstract varchar(180) 8

but the search in my homepage not found anything.

which is the possible problem?
how i make my personal recexpr function for my site?

Thank you




User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

multiple metasearch engine

Post by Thunderstone »





Summary: This guy has a pretty nifty idea. He wants to metasearch
his own server's Webinator in conjunction with the rest of the servers.
Wish we'd thought of it.

Here's a the init function to do this.

<a name=init> <!-- This sets up all of the lists we need later on -->

<$removeme= "\x0d" "<b>" "</b>"> <!-- List of things to remove before parsing -->

<$searchurl =
"http://localhost/cgi-bin/texis/webinato ... uery=xyzzy"
"http://www.excite.com/search.gw?search=xyzzy"
"http://guide-p.infoseek.com/Titles/?qt=xyzzy"
"http://ink.yahoo.com/bin/query?p=xyzzy"
"http://www.lycos.com/cgi-bin/pursuit?mt ... &cat=lycos"
"http://search.thunderstone.com/texis/we ... 0&w3meta=1"
"http://search.yahoo.com/search?o=1&p=xy ... s&g=0&n=10"
>
<$searchname =
"This Site"
"Excite"
"Infoseek"
"Inktomi"
"Lycos"
"Thunderstone"
"Yahoo"
>
<$bases =
"/"
"http://www.excite.com/"
"http://guide-p.infoseek.com/"
"http://ink.yahoo.com/bin/query/"
"http://www.lycos.com/"
"http://search.thunderstone.com/"
"http://www.yahoo.com/"
>


<!-- See TIMPORT DOCUMENTATION for more details on how the imports work -->
<!-- See REX DOCUMENTATION for more on our regular expression syntax -->
<$imports=

'#Webinator
multiple
recexpr >><td valign\=top>=[^<]+<a href=[^>]+>=<strong>=[^<]+</strong></a>\x0a<br>=!<br>+
# 1 2 3 4 5 6 7 8 9
# Name Type Tag
field Link varchar(40) 3-5
field Title varchar(80) 7
field Abstract varchar(180) 9
'

'#Excite
multiple
recexpr >>\% </SMALL>\x0a=<a href=[^>]+>=[^<]+</a>&nbsp;\x0a\- =[^<]+
# 1 2 3 4 5 6 7
# Name Type Tag
field Link varchar(40) 2-4
field Title varchar(80) 5
field Abstract varchar(180) 7
'

'#Infoseek
multiple
recexpr >><p>=<a href=[^>]+>=[^<]+</a>=[^<]+<br>=[^<]+
# 1 2 3 4 5 6 7 8 9
# Name Type Tag
field Link varchar(40) 2-4
field Title varchar(80) 5
field Abstract varchar(180) 9
'

'#Inktomi
multiple
recexpr >><LI>=<a href=[^>]+>=[^<]+</a>=[^\-]+\-=[^<]+
# 1 2 3 4 5 6 7 8 9
# Name Type Tag
field Link varchar(40) 2-4
field Title varchar(80) 5
field Abstract varchar(180) 9
'

'#Lycos
multiple
recexpr >><a href\==[^>]+>=[^<]+</a>\n<br>=[^<]+<br>=
# 1 2 3 4 5 6 7
# Name Type Tag
field Link varchar(40) 1-3
field Title varchar(80) 4
field Abstract varchar(180) 6
'

'#Thunderstone
multiple
recexpr >><dt>=[^<\x0a]+<a =[^>]+>=[^<\x0a]+</a><dd>=[^<\x0a]+<tt>=[^<\x0a]+</tt><br><i>=[^<\x0a]+</i><br><small><a =[^>]+>=[^<\x0a]+</a>=[^<\x0a]+</small><p>\x0a
# 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9
# Name Type Tag
field Link varchar(40) 3-5
field Title varchar(80) 6
field Abstract varchar(180) 8
'

'#Yahoo
multiple
recexpr >><ul type\=disc><LI>=<a href=[^>]+>=[^<]+</a>\x0a=[^<]+
# 1 2 3 4 5 6 7
# Name Type Tag
field Link varchar(40) 2-4
field Title varchar(80) 5
field Abstract varchar(180) 7
'

</a>
<!-- End of the <init> function -->




User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

multiple metasearch engine

Post by Thunderstone »




This is great! While I was there I added a link to go to the top of the
page so the searcher wouldn't have to scroll up the entire list to get back
to the top of the page and also added a slightly different background. I
hope this is permissible?
I placed at:


<a name=main>
<html>
<head>
<title>Meta Search<if $q neq "">: $q</if></title>
</head>

<body background="http://www.yoursite/favorite_background.gif"
link=#0000A0 vlink=#0000A0 alink=#ff8080>
<A NAME="top_page"></A>

****************************************************************************
****************************************************************
and the hyper link to go to top of page to be written at the end of each
sites results goes here


<flush>
<div align="CENTER"><A HREF="#top_page"> <font face="Times New
Roman" size="+2"><b>Top of Page</b></font> </a></div>
<if $loop eq 0>
$searchhost returned no answers.<br><small><a
href=$acturls>$acturls</a></small><p>
<if $debug neq ""> <!-- Use this if your adding a new Engine -->


****************************************************************************
*****************************************************************

------------------------------------------------


Attachment: http://thunder/texis/intra/attach/at.bin/+/BAAsjkID_
text/html



Post Reply