when to reindex page - last-modied and REFRESH tags

dietric · Post by **dietric** » Mon Aug 15, 2005 1:16 pm

I understand that the walker relies on the page's last-modifed attribute (either in the request header or META tag) to determine when to reindex a page.
What if there is no meaningful value that could be attached to these attributes and I want to simply use a META EXPIRES tag to ensure that a page gets reindex every hour, day or week?

Post by **John** » Mon Aug 15, 2005 2:59 pm

If there is no last modified tag it will look at when it last saw a change in the page contents. You can specify a URL that will be updated more frequently.

dietric · Post by **dietric** » Mon Aug 15, 2005 3:05 pm

So it's not looking at the META EXPIRES tag at all?

Post by **John** » Mon Aug 15, 2005 4:51 pm

Not currently, but that should be added soon.

jgdoke · Post by **jgdoke** » Tue Feb 28, 2006 11:29 am

Has this been added???

Post by **John** » Wed Mar 01, 2006 5:20 pm

No, that is not in the current version.

jgdoke · Post by **jgdoke** » Fri Mar 31, 2006 11:19 am

You said "You can specify a URL that will be updated more frequently."

Most of my site is fairly static and once a week is good. But a part of the site needs updating nightly.

Is there a best way to do this?

John

thomas.schaefer · Post by **thomas.schaefer** » Wed May 24, 2006 9:30 am

Does anyone know if I can force a page to update even if the LAST-MODIFIED META tag has not been updated. I am using the last modified tag to assign a different timestamp for an application. This allows me to sort my results by the date the event closes. This means that the page could be updated but the LAST-modified date will not actually change. I would want the walk to force this.

Thanks,

Tom

Post by **John** » Wed May 24, 2006 10:26 am

The last modified meta tag will be used to calculate the refresh frequency, however if the webserver still returns the document when conditionally fetched the updated contents will be stored when the page is refreshed.

You can set the Max Refresh Time shorter to refresh pages more frequently.

dietric · Post by **dietric** » Wed Jan 31, 2007 1:30 pm

It was mentioned that support for the META EXPIRES tag would be added to the search appliance (that was last May). Has that happened, and if so, is there any documentation? Specifically, is it guaranteed that the search appliance will revisit an indexed page during refresh walks if that tag is set accordingly?