Learn about using external libraries to supply prefiltering
and term breaking for documents.
Pre-Filter and Term-Breaker External Libraries
SAP Sybase IQ can use external pre-filter and term-breaker libraries written in C or C++ to prefilter and tokenize the documents during index creation or query processing. These libraries can be dynamically loaded into the process space of the database server.