duplicate pages with slash

phoebe · Post by **phoebe** » Sun Nov 30, 2003 11:13 am

While looking at the html pages I noticed these entries:
Url Depth
http://xyz.com/ 1
http://xyz.com 0

with different hashes for each.
These Urls are considered the same by the protocol, but not in webinator. The hash is different because one page is generated a second later with minor differences. The referrer data is also split into 2 versions, one with and one without the slash which makes it very difficult to count the number of refs to the page. Is there a good way to modify webinator to take care of the trailing slash problem? I'd like to keep it consistent in the database, either with or without the slash.

Thanks,

Post by **John** » Sun Nov 30, 2003 12:50 pm

The easiest may be to add the slash on the Base URL, which would work as long as you never have the unslashed version as a URL. Do you have duplicate detection enabled? If so, then the contents is different as well.