The Text Manager module settings are loaded through the TextModule.default.xml configuration file. Table 4-7 shows the parameters in this file.
Parameter |
Default |
Description |
|---|---|---|
min.term.length |
2 |
The minimum term length deemed valid for indexing. This is not taken into account in the list of preserved terms and does not apply to single-digit terms. |
max.term.length |
20 |
The maximum term length deemed valid for indexing. This value must match the Term Lexicon Manager parameter term.length.max. |
stopwords.filename |
stopwords_en.txt |
Contains a list of stopwords to remove during the indexing and querying processes to improve system performance. See “Defining the list of stopwords”. |
preserved.terms.filename |
preserved_terms_en.txt |
Contains the list of preserved terms that are not stemmed during indexing. The list can also include terms less than the minimum term length defined in the min.term.length parameter. See “Defining the list of preserved terms”. |
term.splitter.class |
com.isdduk.text.Break IteratorSplitter |
Specifies the Java class used for breaking text into separate words. The default BreakIteratorSplitter handles all double-byte character sets. |
term.stemmer.class |
com.isdduk.text. Porter2Stemmer |
Specifies the Java class used for term stemming. The default Porter2Stemmer is for English text. |
query.augmentor.filename |
query_aug_en.txt |
Contains a list of synonyms and acronyms. See “Augmenting queries”. |
parsers.filename |
Parsers.xml |
The name of the file in the config folder that contains the list of text parsers. |
You can set the term splitter and stemmer classes to language-independent classes or to language-specific classes. Language-specific stemmers allow an increase in system performance when Sybase Search is going to index documents in one language only.
