Setting memory options

Sybase IQ uses memory for a variety of purposes:

The options discussed below, as well as other options you can set once the server is running, determine how much memory is available for these purposes.

IQ buffer cache sizes

The default IQ buffer cache sizes of 16MB for the main cache and 8MB for the temporary cache are too low for any active database use. You need to set the buffer cache sizes for the IQ main and temporary stores in one of two ways:

If you set IQ buffer cache sizes higher than your system will accommodate, however, Sybase IQ cannot open the database.

The server options (-iqmc and -iqtc) also let you use as much memory as your system allows, the only limit being the amount of physical memory on the machine. For this reason, on 64-bit systems you should use -iqmc and -iqtc. The -iqmc and -iqtc options do not override settings by sa_server_option procedure.

The cache sizes set by -iqmc and -iqtc apply to all databases started until the server is shut down. So for example, if you set both -iqmc and -iqtc to 500 (MB) and start one database at server startup and another database later on the same server, you need at least 2GB available for the two main and two temp caches.

Concurrent users

Your license sets the absolute number of concurrent users. However, you must also set the -gm switch. This required switch lets you limit the number of concurrent user connections on a particular server.

The -gn switch sets the number of execution threads that will be used for the catalog store and connectivity while running with multiple users. It applies to all operating systems and servers.

On Windows, start_iq calculates the value of this parameter and sets it using the following formula:

gn_value = gm_value + 5

Specify a minimum of 25.

On UNIX platforms, see the Installation and Configuration Guide for your platform for more information.

There may be times when you want to tune performance for a particular operation by limiting the number of user connections to fewer than your license allows. Alternatively, you may want to use the -iqgovern switch to control query use; see “Concurrent queries”.

Concurrent queries

The -iqgovern switch lets you specify the number of concurrent queries on a particular server. This is not the same as the number of connections, which is controlled by your license. By specifying the -iqgovern switch, you can help IQ optimize paging of buffer data out to disk, and avoid overcommitting memory. The default value of -iqgovern is (2 x the number of CPUs) + 10. You may need to experiment to find an ideal value. For sites with large numbers of active connections, try setting -iqgovern slightly lower.

Wired memory

The -iqwmem switch creates a pool of “wired” memory on certain UNIX platforms only. For details, see “Platform-specific memory options” in Performance and Tuning Guide.

WARNING! Use this switch only if you have enough memory to dedicate some of it for this purpose. Otherwise, you can cause serious performance degradation.

Number of processing threads

Use the -iqmt switch to set the number of processing threads that Sybase IQ can use. Sybase IQ assigns varying numbers of kernel threads to each user connection, based on the type of processing being done by that process, the total number of threads available, and the setting of various options. Increasing the number of threads can improve performance.

Number of processors

If you are running on a multiprocessor machine, you can set the number of processors used by the database server for catalog store operations with the -gt option. By default, all available processors are used.

Catalog store cache size

Use the -c switch to set the amount of memory in the cache for the catalog store.

The start_iq command, and the iqdemo.cfg and default.cfg configuration files set the -c parameter to 48MB on 64-bit systems and 32MB on 32-bit systems. Sybase recommends that you use one of these methods.

If you start the server without using start_iq, iqdemo.cfg or default.cfg, the default initial cache size is computed based on the amount of physical memory, the operating system, and the size of the database files. The database server takes additional cache for the catalog when the available cache is exhausted.

Any cache size less than 10000 is assumed to be in KB (1K =1024 bytes); any cache size 10000 or greater is assumed to be in bytes. You can also specify the cache size as nK or nM.

WARNING!  To control catalog store cache size, you must do either of the following, but not both, in your configuration file (.cfg) or on the UNIX command line for server startup:

Do not specify other combinations of these parameters.

NoteThe cache size for the IQ store does not rely on the catalog cache size. See “IQ buffer cache sizes”.

For more information on setting the catalog cache size, see the -c, -ca, -ch, and -cl server options in “Starting the database server” in Utility Guide.