Odd response from site

Post Reply
cpm18
Posts: 35
Joined: Mon Apr 13, 2009 3:21 pm

Odd response from site

Post by cpm18 »

I've been trying to fetch a site and locate certain pieces of data on the page. For some reason I get very inconsistant responses from the page.

The page url is...
http://www.hotels.com/ho325735/trump-so ... s/#reviews

and this specific rex statement should return a result...
<rex '>><div class\="userReviewsCntr"=!</div>+' $pagehtml>

This block holds the data of how many total reviews are present and what % are recommedations.

Other elements on the page are found with every fetch but this specific block only shows up once every 6th or 7th fetch. I've tested this by fetching over and over without and modifications to my code. I tried tinkering with the httpversion and also different user agents without any change in results.

The data always seems to show on the page when viewed through a browser so I think there must be some kind of setting my fetch might need but I can't determine what.
User avatar
mark
Site Admin
Posts: 5513
Joined: Tue Apr 25, 2000 6:56 pm

Odd response from site

Post by mark »

I fetched that page a number of times in my Firefox browser and never got userReviewsCntr anywhere in the source. This is what I consistently get for the area you describe:

<h2>Guest review summary</h2>
<div class="summary">
<ul class="clearfix">
<li class="first">
<em title="Score out of 5 from Hotels.com customers.">

<span>4.7</span>
Average rating:
</em>
All Trip Types</li>
<li><span>94%</span> Recommended</li>
<li class="last"><span>67</span> Reviews</li>

</ul>
<ul class="breakdown clearfix">
<li title="Score out of 5 from Hotels.com customers.">
4.8
&nbsp;Hotel Service</li>
<li title="Score out of 5 from Hotels.com customers.">
4.8
&nbsp;Room Comfort</li>
<li title="Score out of 5 from Hotels.com customers.">

4.9
&nbsp;Hotel Condition</li>
<li title="Score out of 5 from Hotels.com customers.">
4.9
&nbsp;Room Cleanliness</li>
</ul>
</div>
User avatar
mark
Site Admin
Posts: 5513
Joined: Tue Apr 25, 2000 6:56 pm

Odd response from site

Post by mark »

Also 10 vortex <fetch>es 1 minutes apart using all default settings produced the same results each time except for subtle changes in the ad related javascript.
cpm18
Posts: 35
Joined: Mon Apr 13, 2009 3:21 pm

Odd response from site

Post by cpm18 »

The field seems to be showing up in all my fetches now. I guess whatever was going on was a temp issue with the site.
Post Reply