DB Bulk Load Sybase IQ properties list

DB Bulk Load Sybase IQ properties list identifies the connection parameters and other items you define on the Database Configuration window.


Required properties

Property

Description

Interface

Specify the method or driver to use to connect to the data source.

Host Name

Specify the host where the Sybase IQ target is running.

Destination

Select the destination table from a set of existing tables.

Load Stage

Specify a Data File path or pipe name. The load stage file must reside on the same machine as the IQ Server.

If you use named pipes on UNIX or Linux, the ETL Server and the IQ Server must reside on the same machine. This is not a requirement for Windows.

Note If you have selected the Use IQ Client Side Load option, provide a file path name instead of a pipe name in the Load Stage field. Client side loading is not supported using named pipes.


Optional properties

Property

Description

User and Password

Identify an authorized database user, and protect the database against unauthorized access.

Shared Connection

Select this option to allow the component to share a single connection to the database with other target components that have identical connection and database parameters.

A connection can be shared only between components within the same project. Components in different projects within the same job cannot share a connection

Components that use the same database interface and login information, but have differing database options cannot share a connection, and generate an error when the project is executed or simulated.

NoteConnection sharing is not supported if the Use IQ Multiplex property is enabled.

Key

Select target key attributes to identify the records on Upsert or Delete operations.If no key is selected, the interface works with the primary key information, which is delivered from the DB host. An error appears if no primary key information is available.

Function

Select one of these load functions:

  • Insert (default) – load records directly into the selected target table using the specified file path or pipe name.

  • Upsert – update existing records and insert the new records. Existing records are replaced and not updated on an attribute level. You can use the Key property to specify the target attributes identifying the records you want to update.

  • Delete – delete records from the target tables based on the keys in the incoming data. You can use the Key property to specify the target attributes identifying the records you want to delete.

If you have selected the Truncate option, all records are removed from the target table before loading. In this scenario, the selected functions perform as follows:

  • Insert and Upsert load all records to the target table directly.

  • Delete does not move any records, but Pre-processing and Post-processing SQL are still executed.

Truncate

Remove all records from the destination table before the load.

Use IQ Client Side Load

Add records from files located on remote host machines into the Sybase IQ table, using the LOAD TABLE statement.

Load Script

The LOAD TABLE Statement is generated at runtime based on the component settings, if this property is empty.

To use a customized script, right-click the component and select Generate Load Script. The LOAD TABLE script is generated for Insert. After you generate the script, you can click Load Script and edit the script.

NoteIf a custom Load Script is provided, the Function property is ignored.

Load Stage (Server)

Specify the server path to the data file or, leave it empty when using a pipe.

If the Sybase IQ server needs to use a different path to the temporary data file than specified in the Load Stage property, enter it here.

Pre Processing SQL

Create a script that runs during component initialization.

Scripts can include one or more SQL statements. If you use multiple statements, separate them with a semicolon (;).

NoteIf you have selected the Truncate option, all records from the destination table are deleted before the Pre Processing SQL is executed.

Post Processing SQL

Create a script that runs after all components execute.

Scripts can include one or more SQL statements. If you use multiple statements, separate them with a semicolon (;).

Database

Identify the database to use as data source.

If you select this option, you must also select an appropriate interface, and in some cases, specify an appropriate user ID and password.

Schema

Identify the schema/owner you want to use as data source. The objects that appear are restricted accordingly and new tables are created in that schema.

Standardize Data Format

Converts incoming DATE and NUMBER information into a standard format that Sybase ETL can move between systems that support different formats.

Dates are converted into a format that includes the year, month, day, hour, minute, seconds, and fraction of a second: YYYY-MM-DD hh:mm:ss.s.

For example:

2005-12-01 16:40:59.123

Numbers are converted using a period (“.”) as the decimal separator.

Database Options

Set options that override performance defaults and control the behavior of some transactions.

See “Database connection settings”.

IQ Lock Table in Exclusive Mode

Lock the target table and prevent it from being updated by concurrent transactions. When an exclusive table lock is applied, no other transaction can execute queries or perform any updates against the locked table. The IQ Lock Table in Exclusive Mode option also queues multiple projects that load the same table in Sybase IQ.

Wait Time for IQ Lock Table

Specify the maximum blocking time that the project should wait before acquiring an Exclusive lock.

Specify the time argument in the format hh:nn:ss.sss. If you do not enter a time argument, the server waits indefinitely until an Exclusive lock is available or an interruption occurs. When you specify “00:00:00.000” as the time argument, an Exclusive lock is acquired as soon as the project starts.

Use IQ Multiplex

Support multiplex execution by using multiple writers to load data into the IQ database.

Transactional

All work performed by the DB Bulk Load Sybase IQ component, including pre-SQL and post-SQL, is done in a single database transaction that is committed when the project finishes normally. Select this option to roll back the transaction, if this component encounters an error. See “Job components” and “Enabling transactionality for projects and jobs” for information on the “Propagate Rollback” property.