Walk Error -

Post Reply
rjshelq
Posts: 75
Joined: Thu Nov 17, 2005 3:25 pm

Walk Error -

Post by rjshelq »

Hi,

When I run a Webinator walk of my web site, I get the following error:

The link : http://my.site/xx/xxx.htm
Had this error: Truncated chunked encoding data in the function TXfetchCteDecoderTranslate_chunked

I do not see anything odd about the headers or content of that specific file on the server. This is the only page (out of about a thousand pages) which has a walk error in Webinator.

I tried deleting and then re-creating the file, but that did not affect the problem. The file downloads normally in a web browser, and does not show any errors. My server is running Centos 5.9.

Can you offer any clues about how to resolve this problem?
User avatar
Kai
Site Admin
Posts: 1271
Joined: Tue Apr 25, 2000 1:27 pm

Walk Error -

Post by Kai »

Are you getting any other errors on that page like `Max page size exceeded' or `Max download size exceeded'? Exceeding max download size causes the download to be truncated, which might occur mid-chunk, causing the `Truncated chunked encoding' error. Increase Max Page Size.
rjshelq
Posts: 75
Joined: Thu Nov 17, 2005 3:25 pm

Walk Error -

Post by rjshelq »

No, there are no other error messages, only the "Truncated chunked encoding data" error message.

In my walk settings, Max Page Size is currently set at 20000000, which is about 10 times larger than the file causing the error. The page causing the error has a file size of 203kB, and is somewhat smaller than several other files (around 300kB) which are being properly indexed.

As a test, I just set Max Page Size to -1, but the error is the same:

Displaying all 1 errors.

At date/time : 2013-09-06 11:19:02
The link : http://my.site/xx/xxx.htm
Had this error: Truncated chunked encoding data in the function TXfetchCteDecoderTranslate_chunked

Any other ideas?
User avatar
Kai
Site Admin
Posts: 1271
Joined: Tue Apr 25, 2000 1:27 pm

Walk Error -

Post by Kai »

What Texis version is this (output of texis -version)? Are there any other messages in /usr/local/morph3/texis/vortex.log near the `Truncated chunked encoding data' message?

Some sites do not send the last EOF chunk during chunked transfers, which can cause this, but then the error message would have included `... at chunked boundary: Response missing last-chunk EOF' in Texis version 6.
rjshelq
Posts: 75
Joined: Thu Nov 17, 2005 3:25 pm

Walk Error -

Post by rjshelq »

Please forgive my ignorance, but I do not know how/where to enter the texis -version command.

However, I can say that the Webinator "Maintenance" "Thunderstone Information" says Version: Free Webinator Version 6.01.1325780201 20120105 (x86_64-unknown-linux2.6.9-64-64)

I do not find any errors in the vortex.log file, just messages such as this, from my most recent walk:

100 2013-09-06 13:46:06 /my_path/www/vhosts/my.server/my_directory/webinator/texis/scripts/webinator/dowalk:8530: User PUBLIC has been added without a password.


When I go to "Maintenance" "Test network and Servers" and enter the URL of the troublesome page, everything seems to work fine, the portion of the report called "Text" correctly shows the text of the document, and in the portion of the report called "Derived Data" the sorted words of the document are shown.
User avatar
mark
Site Admin
Posts: 5513
Joined: Tue Apr 25, 2000 6:56 pm

Walk Error -

Post by mark »

Try setting Parallelism->Threads to 1.
Also set Rewalk Type to New instead of Refresh while testng.
rjshelq
Posts: 75
Joined: Thu Nov 17, 2005 3:25 pm

Walk Error -

Post by rjshelq »

Thanks Mark... that seems to have solved the problem.
Post Reply