@ sign and REX

KMandalia · Post by **KMandalia** » Wed Aug 17, 2005 11:10 am

does @ have special meaning and need escaping while putting it in exclusions and exclusion rex in all walk settings?

Somehow I can see that webinator is crawling webpages like http://someone@somesite.com/ and I want to throw out the webpage every time i see @ in the URL while crawling.

So, can I just put @ in exclusions and exclusion rex or there is some other way of doing it?

Post by **mark** » Wed Aug 17, 2005 12:11 pm

* is the only special character in the "Exclude" list.

KMandalia · Post by **KMandalia** » Wed Aug 17, 2005 1:35 pm

oh really?

What about the exclude rex? I was escaping things like ? and =. I am supposed to do that right?

Post by **mark** » Wed Aug 17, 2005 3:28 pm

Yes. But exclude rex is a full rex expression so it must follow all rex rules. See the rex docs.