Page 5 of 5

Ignoring robots.txt file

Posted: Wed Aug 06, 2003 11:50 am
by sunnedaze
Sorry for the delay. I do not have access to Dos. Here is the display from a system admin...
HTTP/1.1 200 OK
Server: Netscape-Enterprise/6.0
Date: Wed, 06 Aug 2003 15:21:01 GMT
Content-type: text/plain
Last-modified: Fri, 01 Aug 2003 16:24:24 GMT
Content-length: 605
Accept-ranges: bytes
Connection: close

User-agent: *
Disallow: /webinator
Disallow: /worldwideops
Disallow: /wlc050403
Disallow: /uwsurvey
Disallow: /unixshop
Disallow: /tmp
Disallow: /testhome
Disallow: /stylesheets
Disallow: /stats
Disallow: /search
Disallow: /savepoll
Disallow: /reports
Disallow: /realvideopoll
Disallow: /quality_site_test
Disallow: /savepoll
Disallow: /promosite
Disallow: /opsreview
Disallow: /logs
Disallow: /graphics
Disallow: /HPOV_webresponse
Disallow: /graphics
Disallow: /fxsurvey
Disallow: /savepoll
Disallow: /flightpoll
Disallow: /cashsurvey
Disallow: /catering
Disallow: /counter

Ignoring robots.txt file

Posted: Wed Aug 06, 2003 12:13 pm
by mark
You couldn't have run the texis tests you did earlier in this thread if you didn't have access to dos. Anyhow, we need to go down that road again now that you have updated scripts.

"F:\Thunderstone Software\Webinator\Texis\texis" profile=allenet top=http://cleohsenet01.napa.adpa.ad.etn.com/ "F:/Thunderstone Software/Webinator/Texis/Scripts/Webinator/dowalk/getrobots.txt"

BTW, I see that robots.txt has been modified since this discussion started. Does the walk handle it as expected now.

Ignoring robots.txt file

Posted: Wed Aug 06, 2003 2:52 pm
by sunnedaze
He got the following error:

Texis Web Script (Vortex) Copyright (c) 1996-2003 Thunderstone - EPI, Inc.
Commercial Webinator Version 4.02.1042579553 of Jan 14, 2003 (i686-intel-winnt-3
2)

002 can't open C:\Documents and Settings\kaisejf\: no SYSTABLES in the function
ddopen
000 Could not connect to . in the function openntexis

(functionality still not working)

Ignoring robots.txt file

Posted: Wed Aug 06, 2003 4:21 pm
by mark
Open a tech support ticket from the link on the left. Reference this thread.
http://thunderstone.master.com/texis/ma ... 3f314e8110