Sybase ETL architecture

This graphic describes the ETL architecture.

Sybase ETL components

Sybase ETL includes Sybase ETL Development and Sybase ETL Server.

Sybase ETL Development, which is available only on Windows, is a Graphical User Interface (GUI) tool for creating and designing data transformation projects and jobs. This tool provides a complete simulation and debugging environment, designed to speed the development of ETL transformation flows.

Sybase ETL Server is a scalable and distributed grid engine, which connects to data sources, and extracts and loads data to data targets using transformation flows, which are designed using Sybase ETL Development. See “Sybase ETL Server”.

Sybase ETL Development includes a ETL Development Server that controls the actual processing, such as connecting to databases and executing procedures. To perform parallel execution of jobs and projects, you can add multiple ETL servers on different operating systems within your network. Each server exposes certain services to all other peer servers. Sybase ETL uses the various servers on a grid for parallel execution of projects and jobs, which improves scalability of transformation speed.

Sybase ETL Server connects to the destination or the source database using methods or drivers called interfaces. Out of the supported interfaces, ODBC driver used for connecting to Sybase IQ is automatically installed by the Sybase IQ installer. To install the other supported interfaces, see the respective vendor documentation.

NoteTo perform parallel execution of projects and jobs developed using Sybase ETL Development, you must install the Sybase ETL Server, which is available as a separate executable.

You can also perform execution of jobs and projects on all supported platforms, using the command line. See “Using ETL Server to execute projects and jobs” for more information.

Registering ETL servers

All the ETL servers that you add to the grid must be registered. You can register them using the Engine Manager available within the Sybase ETL Development tool. See “Using multiple engines to reduce job execution time”.

Monitoring ETL servers

You can monitor the servers in your network using the Engine Monitor available within the Sybase ETL Development tool. See “Engine Monitor”. You can also monitor remote projects and jobs, which are started from command line, using a Web browser. See “Monitoring projects and jobs using a Web browser”.

NoteThe terms grid engine and ETL Server are used interchangeably in this guide.