Lucene++ - a full-featured, c++ search engine
API Documentation
Go to the documentation of this file.
7 #ifndef CHARTOKENIZER_H
8 #define CHARTOKENIZER_H
37 virtual bool incrementToken();
39 virtual void reset(
const ReaderPtr& input);
45 virtual bool isTokenChar(
wchar_t c) = 0;
49 virtual wchar_t normalize(
wchar_t c);
clucene.sourceforge.net