Page 1 of 1

Odd response from site

Posted: Fri Dec 10, 2010 6:01 pm
by cpm18
I've been trying to fetch a site and locate certain pieces of data on the page. For some reason I get very inconsistant responses from the page.

The page url is...
http://www.hotels.com/ho325735/trump-so ... s/#reviews

and this specific rex statement should return a result...
<rex '>><div class\="userReviewsCntr"=!</div>+' $pagehtml>

This block holds the data of how many total reviews are present and what % are recommedations.

Other elements on the page are found with every fetch but this specific block only shows up once every 6th or 7th fetch. I've tested this by fetching over and over without and modifications to my code. I tried tinkering with the httpversion and also different user agents without any change in results.

The data always seems to show on the page when viewed through a browser so I think there must be some kind of setting my fetch might need but I can't determine what.

Odd response from site

Posted: Fri Dec 10, 2010 10:28 pm
by mark
I fetched that page a number of times in my Firefox browser and never got userReviewsCntr anywhere in the source. This is what I consistently get for the area you describe:

<h2>Guest review summary</h2>
<div class="summary">
<ul class="clearfix">
<li class="first">
<em title="Score out of 5 from Hotels.com customers.">

<span>4.7</span>
Average rating:
</em>
All Trip Types</li>
<li><span>94%</span> Recommended</li>
<li class="last"><span>67</span> Reviews</li>

</ul>
<ul class="breakdown clearfix">
<li title="Score out of 5 from Hotels.com customers.">
4.8
&nbsp;Hotel Service</li>
<li title="Score out of 5 from Hotels.com customers.">
4.8
&nbsp;Room Comfort</li>
<li title="Score out of 5 from Hotels.com customers.">

4.9
&nbsp;Hotel Condition</li>
<li title="Score out of 5 from Hotels.com customers.">
4.9
&nbsp;Room Cleanliness</li>
</ul>
</div>

Odd response from site

Posted: Mon Dec 13, 2010 9:47 am
by mark
Also 10 vortex <fetch>es 1 minutes apart using all default settings produced the same results each time except for subtle changes in the ad related javascript.

Odd response from site

Posted: Mon Dec 13, 2010 3:02 pm
by cpm18
The field seems to be showing up in all my fetches now. I guess whatever was going on was a temp issue with the site.