Multiple Writers Configuration for Loading Data

Sybase IQ InfoPrimer supports the multiple writer functionality that is available in Sybase IQ 15.0; you can add multiple writers for loading data into an IQ database. Multiple writers allow parallel loading of Sybase IQ tables, which is faster than sequential loading.

You can use multiple writers if you have:
  • Selected more than one table from the source database and you are migrating to more than one table in the target IQ database.

  • Created a job with a multiproject component involving multiple tables, or if you have selected multiple projects that are linked to parallel execution topology for job execution.

To use the multiple writer functionality, you must have these permissions in the target IQ database:

Object Name

Type

Required Permission

ETL_MULTIPLEX_STATE

Table

create

ETL_MULTIPLEX_VERSION

Table

create

sp_iqstatistic

Stored Procedure

execute

Note:

Sybase IQ InfoPrimer creates two tables, ETL_MULTIPLEX_STATE and ETL_MULTIPLEX_VERSION in the IQ database. Each row in the ETL_MULTIPLEX_STATE table signifies an IQ writer selected by an Sybase IQ InfoPrimer grid node, which is automatically removed after each execution. If a grid node fails due to an unexpected error, you must manually clean the data in this table.

You can set the required permissions using Sybase Central:

  1. In Sybase Central, connect to the Sybase IQ 15.0 server.

  2. Expand Users & Groups, then select the user for whom you want to set the create table permission.

  3. Right-click the user and select Properties.

  4. Select the Authorities tab and click the Resource option to give the user permission to create database objects in the IQ database.

  5. Select the Permissions tab and then select the Procedures & Functions option to see a list of available permissions.

  6. Select sp_iqstatistics and click the corresponding Execute column to give the user permission to execute the stored procedure in the IQ database.

  7. Click OK to save the settings.

Note:

To support multiplex execution, you must install the SQL Anywhere 11 ODBC driver on the same machine as Sybase IQ InfoPrimer Development and Sybase IQ InfoPrimer Server.