Page 1 of 1

Walk Error -

Posted: Fri Sep 06, 2013 11:53 am
by rjshelq
Hi,

When I run a Webinator walk of my web site, I get the following error:

The link : http://my.site/xx/xxx.htm
Had this error: Truncated chunked encoding data in the function TXfetchCteDecoderTranslate_chunked

I do not see anything odd about the headers or content of that specific file on the server. This is the only page (out of about a thousand pages) which has a walk error in Webinator.

I tried deleting and then re-creating the file, but that did not affect the problem. The file downloads normally in a web browser, and does not show any errors. My server is running Centos 5.9.

Can you offer any clues about how to resolve this problem?

Walk Error -

Posted: Fri Sep 06, 2013 12:56 pm
by Kai
Are you getting any other errors on that page like `Max page size exceeded' or `Max download size exceeded'? Exceeding max download size causes the download to be truncated, which might occur mid-chunk, causing the `Truncated chunked encoding' error. Increase Max Page Size.

Walk Error -

Posted: Fri Sep 06, 2013 1:21 pm
by rjshelq
No, there are no other error messages, only the "Truncated chunked encoding data" error message.

In my walk settings, Max Page Size is currently set at 20000000, which is about 10 times larger than the file causing the error. The page causing the error has a file size of 203kB, and is somewhat smaller than several other files (around 300kB) which are being properly indexed.

As a test, I just set Max Page Size to -1, but the error is the same:

Displaying all 1 errors.

At date/time : 2013-09-06 11:19:02
The link : http://my.site/xx/xxx.htm
Had this error: Truncated chunked encoding data in the function TXfetchCteDecoderTranslate_chunked

Any other ideas?

Walk Error -

Posted: Fri Sep 06, 2013 2:44 pm
by Kai
What Texis version is this (output of texis -version)? Are there any other messages in /usr/local/morph3/texis/vortex.log near the `Truncated chunked encoding data' message?

Some sites do not send the last EOF chunk during chunked transfers, which can cause this, but then the error message would have included `... at chunked boundary: Response missing last-chunk EOF' in Texis version 6.

Walk Error -

Posted: Fri Sep 06, 2013 4:10 pm
by rjshelq
Please forgive my ignorance, but I do not know how/where to enter the texis -version command.

However, I can say that the Webinator "Maintenance" "Thunderstone Information" says Version: Free Webinator Version 6.01.1325780201 20120105 (x86_64-unknown-linux2.6.9-64-64)

I do not find any errors in the vortex.log file, just messages such as this, from my most recent walk:

100 2013-09-06 13:46:06 /my_path/www/vhosts/my.server/my_directory/webinator/texis/scripts/webinator/dowalk:8530: User PUBLIC has been added without a password.


When I go to "Maintenance" "Test network and Servers" and enter the URL of the troublesome page, everything seems to work fine, the portion of the report called "Text" correctly shows the text of the document, and in the portion of the report called "Derived Data" the sorted words of the document are shown.

Walk Error -

Posted: Fri Sep 06, 2013 4:42 pm
by mark
Try setting Parallelism->Threads to 1.
Also set Rewalk Type to New instead of Refresh while testng.

Walk Error -

Posted: Fri Sep 06, 2013 5:02 pm
by rjshelq
Thanks Mark... that seems to have solved the problem.