Bad fetches

Post Reply
cpm18
Posts: 35
Joined: Mon Apr 13, 2009 3:21 pm

Bad fetches

Post by cpm18 »

I noticed a site(discussion.forum.nokia.com/forum/) I have been trying to fetch has been sometimes returning bad data.

A sample of the 'bad' fetch is listed below...

HTTP/1.1 200 OK
Date: Thu, 02 Dec 2010 19:27:29 GMT
Server: Apache
Set-Cookie: bb_lastactivity=0; expires=Fri, 02-Dec-2011 19:27:29 GMT; path=/; domain=.forum.nokia.com
Expires: 0
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Cache-Control: private, post-check=0, pre-check=0, max-age=0
Last-Modified: Thu, 02 Dec 2010 16:32:26 GMT
Content-Encoding: gzip
Vary: Accept-Encoding
Keep-Alive: timeout=15, max=97
Connection: Keep-Alive
Transfer-Encoding: chunked
Content-Type: text/html; charset=UTF-8

43d6
&#31;‹&#8;&#0;&#0;&#0;&#0;&#0;&#0;&#3;ì}ks$ÉqØç݈û&#15;Å9ó°«CÏ&#11;ƒç.f&#5;°· &#23;&#3;p·<RŒ‰ž隙¾íéžëîÁ&#0;'*‚”¬GH²&#20;–e†¥ #&#20;&#14;9DK–dÙ&#14;‹:¤&#8;ó&#15;ìý‡[’úä¿à̬GWO÷?f&#6;&#0;yë&#3;n&#15;议ÊÊÊÊÊÊÌʪzø•ÃíÓ&#15;ŽvY7îyìè½ÇÏö¶YÁ*•ž/m—J;§;ì&#27;OO÷Ÿ±J±ÌNCۏÜØ
|Û+•v&#15;
¬ЍãþF©4&#28;&#14;‹åb&#16;vJ§ǥs„UÁÂòъ’E'v
õ7î>¤&#26;Ï{ž&#31;mæÀ©¬¯¯‹â&#5;æ¸áfÁ‹Ã&#2;ól¿³Yà~¹Îfá¬9ð<&#30;»~ƒò&#17;Pn;ð÷ÎÃ&#30;m†`-þÑÀ=Û,|ÃzoËÚ&#14;z};v›&#30;/°VàÇ܏7&#11;{»›k&#5;VÂâ™RÛ"“uzÑ7‹Äü<.a¥&#15;X«k‡&#17;7ß;}b¥À †¼qÖlà[£Ù&#28;„Ð&#20;ßîqD<•¨ÁJ28nÔ&#26;D&#17;«Ø&#14;ÂA¯è&#7;/\»Ø
z%z—µ4툳nÈÛS&#23;,aɇ_±¬o¹m¶·ûíúÃ&#18;&#2;¤oqßqÛ߶,¾À´Ã}&#30;Úq&#16;&#26;Xž=–dgµb¹X&#19;ؤÿ{&#24;µB·&#31;³&#24;È&©õ¡}f‹Ô&#2;‹ÂÖf¡å¹&#0;N$•.&#6;.þï&#5;¶ÃCË z&#22;?ƒ¯yiÅ&#15;£Gg›µr­&#0;è‹âõ9k„&ù¼…|i<Z=ן§&#14;Ì&#0;¤&#5;æ;³Cv²{r²wxðÞñ3¶É
…&#7;:yû½ã½Ó&#15;N&#15;¿¾{€_:&#3;&#30;ÅúóÞþ;;{Ǎý½“müèöì&#14;J=èÖÑ,ß;==<025&#7;q&#28;ø‘Î&#7;<&#6;ì`&#3;«7ì&#15;ísÈÙGFÝóã{…ra‘UÊ÷5R{ûGÏvßß=FŒ&#17;$6\}|üX¶aZæT&#5;Ÿ&#29;¾óÎîÎ&#30;&#2;,³:üÿˆÅဳ
ֶ½ˆ«l§O÷N&#26;'ÛÇ{G§XKÔ
†10µí &&#127;0ãñ­ӧéLÅ~·ÿ¨Z©--W­&#19;îA&#15;rÇB)1@¢X€‘&#5;&#8;ǡ&#11;ä&#1;”߲{ý&#7;Ž}&#17;õÁÏ7­
VR*1Á÷³qӴc.ÅuZdY­ äùl&þ»óÐsý&#23;,äÞfÁöb&#30;úv?"H`d÷ûž۲‰sÃ(zû&#28;ÅdìÆ&#30;|ہQâ&#5;}&#30;²&#29;&#26;{&#28;ء&#19;±ã“&#19;ö„s§0£Ü&#0;&#2;


And it continues like this. This seems to occur on about 10-15% of fetches and the rest of the time, the normal page html is returned. Am I getting encoded data and is there a way to prevent fetches returning data like this?
User avatar
mark
Site Admin
Posts: 5514
Joined: Tue Apr 25, 2000 6:56 pm

Bad fetches

Post by mark »

According to the headers it's gzip encoded. Texis 6 can handle that. But the server shouldn't be sending it unless the client says it will accept it.

Try using http/1.0 instead of http/1.1 and/or set the Accept-Encoding header to tell the server only "identity" which should be default.

As a last resort you could check the Content-Encoding header yourself and exec out to gunzip as needed.
User avatar
Kai
Site Admin
Posts: 1271
Joined: Tue Apr 25, 2000 1:27 pm

Bad fetches

Post by Kai »

Texis version 5.01.1249039000 20090731 and later can also handle HTTP/1.1 gzip, though you'll have to enable it with <urlcp httpversion 1.1>.
cpm18
Posts: 35
Joined: Mon Apr 13, 2009 3:21 pm

Bad fetches

Post by cpm18 »

It seems that setting httpversion 1.0 prevents any of these bad fetches. Thanks.
Post Reply