I've been trying to fetch a site and locate certain pieces of data on the page. For some reason I get very inconsistant responses from the page.
The page url is...
http://www.hotels.com/ho325735/trump-so ... s/#reviews
and this specific rex statement should return a result...
<rex '>><div class\="userReviewsCntr"=!</div>+' $pagehtml>
This block holds the data of how many total reviews are present and what % are recommedations.
Other elements on the page are found with every fetch but this specific block only shows up once every 6th or 7th fetch. I've tested this by fetching over and over without and modifications to my code. I tried tinkering with the httpversion and also different user agents without any change in results.
The data always seems to show on the page when viewed through a browser so I think there must be some kind of setting my fetch might need but I can't determine what.
The page url is...
http://www.hotels.com/ho325735/trump-so ... s/#reviews
and this specific rex statement should return a result...
<rex '>><div class\="userReviewsCntr"=!</div>+' $pagehtml>
This block holds the data of how many total reviews are present and what % are recommedations.
Other elements on the page are found with every fetch but this specific block only shows up once every 6th or 7th fetch. I've tested this by fetching over and over without and modifications to my code. I tried tinkering with the httpversion and also different user agents without any change in results.
The data always seems to show on the page when viewed through a browser so I think there must be some kind of setting my fetch might need but I can't determine what.