Page 1 of 1

@ sign and REX

Posted: Wed Aug 17, 2005 11:10 am
by KMandalia
does @ have special meaning and need escaping while putting it in exclusions and exclusion rex in all walk settings?

Somehow I can see that webinator is crawling webpages like http://someone@somesite.com/ and I want to throw out the webpage every time i see @ in the URL while crawling.

So, can I just put @ in exclusions and exclusion rex or there is some other way of doing it?

@ sign and REX

Posted: Wed Aug 17, 2005 12:11 pm
by mark
* is the only special character in the "Exclude" list.

@ sign and REX

Posted: Wed Aug 17, 2005 1:35 pm
by KMandalia
oh really?

What about the exclude rex? I was escaping things like ? and =. I am supposed to do that right?

@ sign and REX

Posted: Wed Aug 17, 2005 3:28 pm
by mark
Yes. But exclude rex is a full rex expression so it must follow all rex rules. See the rex docs.