Page 1 of 1

Problem Indexing a single page!

Posted: Fri Nov 15, 2002 4:31 pm
by jgeorge
I am trying to index a single page & for some reason it does not take it...ANy ideas ????

The full URL is this
http://abc.com/cgi-bin/ncommerce3/Produ ... 1&zipcode=

However in the logs I notice that the URL is truncated & it does not take anything from character "&" . here is the log

2002/11/15 15:10:32 Begin (29376) ./gw -g -C -o -a -d- http://abc.com/cgi-bin/ncommerce3/Produ ... nbr=249144
2002/11/15 15:10:33 Retrieving http://abc.com/cgi-bin/ncommerce3/Produ ... nbr=249144
2002/11/15 15:10:33 End (29376) Visited 1 pages total
2002/11/15 15:10:33 Begin (29376) Indexing new pages
2002/11/15 15:10:33 End (29376)
2002/11/15 15:12:41 Begin (29382) ./gw -g -C -o -a -d- http://abc.com/cgi-bin/ncommerce3/ProductDisplay?pr
rfnbr=249144
2002/11/15 15:12:41 Retrieving http://abc.com/cgi-bin/ncommerce3/Produ ... nbr=249144
2002/11/15 15:12:41 End (29382) Visited 1 pages total
2002/11/15 15:12:41 Begin (29382) Indexing new pages
2002/11/15 15:12:41 End (29382)

Problem Indexing a single page!

Posted: Fri Nov 15, 2002 4:59 pm
by jgeorge
OK, I resolved the "&" issue.

However if some of these pages with "&" are in the subsequent pages of the walk, how do I tell gw to put " ", quotes for those URL's containing the "&"

Thanks in advance.

Problem Indexing a single page!

Posted: Fri Nov 15, 2002 5:03 pm
by mark
& is special to the command shell. Therefore you need to quote your urls to prevent the shell from interpreting them before giving them to gw.

gw -youroptions "http://abc.com/cgi-bin/ncommerce3/Produ ... 1&zipcode="

Once the url is into gw it and all of it's children are safe. No need to tell gw to quote it.