org.apache.lucene.analysis.cjk

Class CJKAnalyzer

public class CJKAnalyzer extends Analyzer

Filters CJKTokenizer with StopFilter.

Author: Che, Dong

Field Summary
static String[]	STOP_WORDS An array containing some common English words that are not usually useful for searching and some double-byte interpunctions.

Constructor Summary
	CJKAnalyzer() Builds an analyzer which removes words in STOP_WORDS.
	CJKAnalyzer(String[] stopWords) Builds an analyzer which removes words in the provided array.

Method Summary
TokenStream	tokenStream(String fieldName, Reader reader) get token stream from input

Field Detail

public static final String[] STOP_WORDS

An array containing some common English words that are not usually useful for searching and some double-byte interpunctions.

public CJKAnalyzer()

Builds an analyzer which removes words in STOP_WORDS.

public CJKAnalyzer(String[] stopWords)

Builds an analyzer which removes words in the provided array.

Parameters: stopWords stop word array

public final TokenStream tokenStream(String fieldName, Reader reader)

get token stream from input

Parameters: fieldName lucene field name reader input reader

Returns: TokenStream