Preventing duplicates

dietric · Post by **dietric** » Thu Sep 13, 2007 9:34 am

I have three URL's in an index that reference the same piece of content, but are not seen as duplicates:
http://www.rnweb.com/rnweb/Assessment/W ... oryId=6042
http://www.rnweb.com/rnweb/Assessment/W ... oryId=6063
http://www.rnweb.com/rnweb/article/arti ... ?id=109931

The duplicate fields in the search settings are set to "Duplicate Check Fields". I did a diff on the actual body stored in the appliance, and it seems to be identical. However, the hash key of the three indexes is different. What else could cause a difference?

Post by **mark** » Thu Sep 13, 2007 11:30 am

Did you happen to change the duplicate check field settings between when those pages were walked?

dietric · Post by **dietric** » Thu Sep 13, 2007 12:12 pm

No, they were always set to "Body".

-ds

dietric · Post by **dietric** » Wed Sep 19, 2007 10:24 am

Do you have any more insight into this?

Thanks
-ds

Post by **mark** » Wed Sep 19, 2007 11:11 am

Not really. Maybe we could spot something if we had access to the appliance. If you want us to look open a ticket with appliance access information (hostname, login, password, profile).