Ignoring robots.txt file

[sunnedaze]

Sorry for the delay. I do not have access to Dos. Here is the display from a system admin...
HTTP/1.1 200 OK
Server: Netscape-Enterprise/6.0
Date: Wed, 06 Aug 2003 15:21:01 GMT
Content-type: text/plain
Last-modified: Fri, 01 Aug 2003 16:24:24 GMT
Content-length: 605
Accept-ranges: bytes
Connection: close

User-agent: *
Disallow: /webinator
Disallow: /worldwideops
Disallow: /wlc050403
Disallow: /uwsurvey
Disallow: /unixshop
Disallow: /tmp
Disallow: /testhome
Disallow: /stylesheets
Disallow: /stats
Disallow: /search
Disallow: /savepoll
Disallow: /reports
Disallow: /realvideopoll
Disallow: /quality_site_test
Disallow: /savepoll
Disallow: /promosite
Disallow: /opsreview
Disallow: /logs
Disallow: /graphics
Disallow: /HPOV_webresponse
Disallow: /graphics
Disallow: /fxsurvey
Disallow: /savepoll
Disallow: /flightpoll
Disallow: /cashsurvey
Disallow: /catering
Disallow: /counter

[mark]

You couldn't have run the texis tests you did earlier in this thread if you didn't have access to dos. Anyhow, we need to go down that road again now that you have updated scripts.

"F:\Thunderstone Software\Webinator\Texis\texis" profile=allenet top=http://cleohsenet01.napa.adpa.ad.etn.com/ "F:/Thunderstone Software/Webinator/Texis/Scripts/Webinator/dowalk/getrobots.txt"

BTW, I see that robots.txt has been modified since this discussion started. Does the walk handle it as expected now.

[sunnedaze]

He got the following error:

Texis Web Script (Vortex) Copyright (c) 1996-2003 Thunderstone - EPI, Inc.
Commercial Webinator Version 4.02.1042579553 of Jan 14, 2003 (i686-intel-winnt-3
2)

002 can't open C:\Documents and Settings\kaisejf\: no SYSTABLES in the function
ddopen
000 Could not connect to . in the function openntexis

(functionality still not working)

[mark]

Open a tech support ticket from the link on the left. Reference this thread.
http://thunderstone.master.com/texis/ma ... 3f314e8110