I have a page that shows our Article Archive. You start out by going to archive.asp.. If you click on the Next 30 button you go to a link like this.
Archive1.asp?NAV=2
Is there a way to have our Thunderstone appliance index this page with the NAV= switch. Currently these archive pages are the only thing that reference all of our article files. The folders that the archive files are in do not allow directory browsing.
I don't see the ? in the exclusions right now, but the strip queries was set to yes.
This appliance is something that I have inherited and I'm trying to make it usable, because honestly it's been pretty crappy since I started here.. I think it's mostly configuration, but I've already tweaked it to make it better..
My confusion on this part is that you start on a Archive.asp page and when you choose next 30 it changes you to an archive1.asp. Does the Strip Queries option let the appliance virtually press that next 30 button?
> My confusion on this part is that you start on a
> Archive.asp page and when you choose next 30 it changes
> you to an archive1.asp
That part isn't an issue, however...
> Does the Strip Queries option let the appliance
> virtually press that next 30 button?
The crawler does not press buttons to submit forms when it is crawling. These are usually for actions that have repercussions, like "submit order" or "create account", things you don't want an automatic crawler doing.
If there's a regular link that goes to "Next 30", then it should be followed.