fetch and timouts

Fippy
Posts: 11
Joined: Fri Feb 09, 2007 7:15 pm

fetch and timouts

Post by Fippy »

That count was interesting, thanks Kai. I found an obscure piece of code before my fetch loop that was building $adlinks. It is using <urllinks>.

Now <urllinks> is only returning a subset of the links I know are on the page. I'm assuming that <urlcp timeout> controls urllinks as well? The docs don't explicitly say so.

Does anyone know of any configuration settings I should play with to allow the urllinks to find all the links. I have <urlcp timeout 50000> before the urllinks statement and yet it sometimes returns in seconds with perhaps 20 links out of 1000.
User avatar
mark
Site Admin
Posts: 5519
Joined: Tue Apr 25, 2000 6:56 pm

fetch and timouts

Post by mark »

No, timeout does not affect urllinks. Take a look at the source of the page in comparison to the list of links urllinks returns. You may spot a pattern in those that are excluded. Whatever's similar about the excluded ones may tell where to look...

Are they javascript generated links? Do you have javascript processing on?
Post Reply