You can now use ETL with Sybase Replication Server® to load data changes that Replication Server captures from Sybase Adaptive Server® Enterprise (ASE) and Oracle databases, into Sybase IQ. This solution supports different schemas between the source and target tables, as well as transformation of data by Sybase ETL.
Figure 1: Incremental loading using Sybase Replication Server
Sybase ETL 4.9 includes a new component, CDC Provider Sybase Replication Server, which supports the Sybase Replication Server based incremental load solution, thus enhancing performance and usability, as well as supporting additional use cases.
In versions earlier than 4.9, incremental load was supported by the DB Data Provider Index Load component, which captured the modified data based on ascending index attribute values only.
In addition, you can now capture all data changes, including insert, update and delete activities in the source database, without depending on or modifying the source table schemas, or hampering the performance of the source database. To ensure consistency, you can enable the ETL project-level transactionality feature.
All data changes in the source database are captured by Sybase Replication Server. ETL receives the data changes from Replication Server, transforms it, and loads it into Sybase IQ.
Using the CDC Provider Sybase Replication Server component, you can automate the process of configuring Sybase Replication Server to create and drop replication definitions, replication connections, function strings, and replication subscriptions, or mark table in a source database to replicate, for all ETL tasks.
You can use the ETL incremental load solution to:
Extract data changes from Oracle and Sybase Adaptive Server Enterprise databases.
Load data to a target Sybase IQ database or a file.
Transfer data changes from source tables to target tables that have different table schemas.
Use different transformation rules on different sets of changed data received from Replication Server.
Retrieve old values and then apply a transformation rule to compare between old and the changed data.
See Chapter 5, “Components” in the Sybase ETL 4.9 Users Guide.
