Page 1 of 1

Indexing dynamically generated pages

Posted: Tue Nov 20, 2001 5:16 am
by t.wuersch
Hello all,

I've got a bit of a problem here trying to index dynamically generated pages usind the dowalk script. These pages all have got a url like

"http://myhost.com/import?pageid=12345"

and dowalk doesn't seem to index them. All other pages are indexed normally. How can I tell dowalk to index the dynamically generated pages as well?
Thanks a lot for your help,

Timo

Indexing dynamically generated pages

Posted: Tue Nov 20, 2001 7:27 am
by bart
Urls containing "?" are excluded by default. Remove "?" from the exclusions.

Indexing dynamically generated pages

Posted: Tue Nov 20, 2001 8:03 am
by t.wuersch
How do I edit the exclusions?

Indexing dynamically generated pages

Posted: Tue Nov 20, 2001 9:18 am
by John
Is that the Webinator 4 dowalk script? If you look in the "All Walk Settings" page there is an option "Strip Queries". Set that to "N"

Indexing dynamically generated pages

Posted: Wed Nov 28, 2001 9:29 am
by t.wuersch
No unfortunately it's an older dowalk script (version 2 something)

Indexing dynamically generated pages

Posted: Wed Nov 28, 2001 10:04 am
by mark
Change the $rejects variable in the settings function. See also http://thunderstone.master.com/texis/ma ... 3c02629e10