Page 1 of 1

Webinator Fails To Properly Process Truncated Pages?

Posted: Mon Jun 21, 2010 8:43 pm
by lbneal
"Max Page Size"

"Sets retrieved page size limit to the specified number of bytes. Pages larger than the limit will be truncated - not discarded."

This is NOT true! Truncated pages are totally ignored and treated as an error.

I tried to walk a site where the start page exceeded the "Max Page Size" specified and it promptly stopped.

Webinator Fails To Properly Process Truncated Pages?

Posted: Mon Jun 21, 2010 10:05 pm
by mark
It's more picky about errors on the Base URL as that's a known starting point and is expected to be a good and fully acceptable page.

Webinator Fails To Properly Process Truncated Pages?

Posted: Mon Jun 21, 2010 10:17 pm
by lbneal
Thanks!