Asian Charsets

luc.boilly · Post by **luc.boilly** » Sat Aug 18, 2001 10:47 am

Hi,
I would like to know if webinator support asian charsets such as Thai, Chinese, Japanese for indexing and retrieval.

Thanks for your answers, Luc.

bart · Post by **bart** » Sat Aug 18, 2001 12:56 pm

To do this you must change the indexing expression. See the other messages here relating to this.

luc.boilly · Post by **luc.boilly** » Sun Aug 19, 2001 12:03 pm

Thanks Bart, but I did not see anything within the others messages, that let me know how clearly how asian charsets (thai, chinese, japanese) are been properly handled in indexing and retrieval.
I am asking this question, as I am looking to purchase a software product that handle such features, and I did not see anything clear within the documentation.

Post by **John** » Sun Aug 19, 2001 12:53 pm

There are several different encodings for the asian character sets. One set of common options that works in many cases is:

-k"\alnum{2,99}" -k"[\alnum\x80-\xff]{1,30}" -k"[\x80-\xff]."

although it may need modifications for the particular charsets you are using. You can download and try the free version of Webinator to test these.