Extracting data into memory

The first indexing process has a threshold for restricting the amount of memory the extracted data buffer can consume before the data is written to disk (process 2). The greater the memory allocation, the more efficient is the entire indexing process, because more data can be handled at once.

Parameters that affect the extraction process are shown in Table 4-26.

Table 4-26: General upload parameters

Parameter

Default

Description

omniq.index.buffer.maxMemory

10MB

The indexing process is more efficient if many documents are indexed in a batch. The buffer's maximum memory allocation determines how many documents are processed in each batch.

omniq.indexer.maxDocumentSize

10MB

Sets the maximum document size to be indexed by Sybase Search.

NoteVery long documents have an adverse effect on the query results.