Informatica PowerExchange Presentation

PowerExchange Informatica Solution

Use as platform for migration to or from DB2, Upgrade to newer DB2 environment, Data Warehousing, synchronization or RealTime Integration

PowerExchange Different ways from access according to required latencies

Classic batch extraction
Batch - read and write (native access)

Incremental extraction (CDC) using system logs

CDC Real Time Continuously CDC Change Periodically

PowerExchange How does it work?

MAINFRAME ADABAS DATACOM DB2 IDMS IMS VSAM MID-RANGE AS/400 HP3000

PowerExchange

Real-time Change

Batch

PowerCenter

Step by Step:
SERVER ORACLE SQL Server

Identifify Capture Deliver

5

PowerExchange Why PowerExchange is unique ?

PowerExchange Vantajas del uso de PowerExchange

No necesidad de escritura de cdigo para la extraccin de datos.

Instalacin y proceso de configuracin diseado para minimizar su impacto operativo.

Opcionalmente, la condensacin de los registros cambiados minimiza el coste del proceso Es una solucin no invasiva que usa un interfaz estndar de IBM (IFCID 0306) para monitorizar los cambios. Usa el subsistema de Hiperspaces de IBM de alto rendimiento como mecanismo de almacenamiento intermedio de los cambios capturados, permitiendo una propagacin de los cambio near-realtime.

PowerExchange Classic Batch Extraction

read and write native access

PowerExchange DB2 Native Access Architecture Overview

Operating Environment Data Sources
ADABAS Datacom DB2 IDMS IMS VSAM MQ Series DB2/400 FlatFiles MQ Series/400 HP3000 TurboIMAG HP3000 Flat Files C-ISAM DB2 UDB Informix Oracle MS SQL Server Sybase MQ Series Tibco

Client Tool

Informatica PowerExchange
PowerExchange Navigator

Mainframe Listener
Native Requests

Data Records

SQL

Legacy Mid-Range

Create Metadata

Relational and Flat Files

Data Maps for Non-Relational Access

PowerExchange Components DB2 Native Access

Listener El job listener es la interfaz a travs de la cual las herramientas cliente se comunican con el entorno mainframe. Es la puerta de entrada para el Host.

10

PowerExchange Abilities DB2 Native Access

PowerExchange exploits DB2s new Array Insert and Array Fetch functions that were added in DB2 for z/OS Version 8. This provides significant performance improvements by allowing multiple rows to be processed by a single SQL call. PowerExchange for DB2, on z/OS, provides the ability to dynamically execute a DB2 Bulk Load Utility. This includes support for generating separate LOAD files for each partition of a partitioned tablespace. (Others Connectors does not have this ability).

PowerExchange for DB2 for z/OS can use a DB2 image copy as a data source or use the DB2 LOAD utility to load data to the target. The task flow can vary significantly by bulk data movement strategy.

11

PowerExchange Abilities DB2 Native Access

PowerExchange issue standard SQL calls to DB2 to access DB2 tables, now it takes no special advantage of zIIP or zAAP processors. Informatica has been submitted to provide the

capability to allow the MVS started tasks to run on a ZIIP processor.

PowerExchange is able to read data from image file. PowerExchange allows for Asynchronous Write capability which enhances the DB2 write performance.

12

PowerExchange Abilities IBM Software formats

Because DB2 is a relational database, you do not need to create a data map for DB2 tables to allow PowerExchange to access them. However, some DB2 tables use single DB2 columns to store an array of fields in a format not necessarily consistent with the column type. For example, a CHAR column might contain a set number of packed data fields, or a VARCHAR column might contain a varying number of packed fields. When you create a DB2 data map for tables with these types of columns, PowerExchange allows you to manipulate the sub-fields in the columns using expression fields and expose them to downstream processing by PowerCenter.

After DB2 data maps are available they can be extended to make it easier to map columns that have been unloaded into flat files by standard utilities.
PowerExchange provides data maps for DB2 tables and for DB2 unload files. For DB2 unload files, PowerExchange supports the following IBM software formats:
DB2 for z/OS online REORG TABLESPACE utility with UNLOAD EXTERNAL DB2 for z/OS online UNLOAD utility DB2 for z/OS sample unload program DSNTIAUL

Note: When you create a DB2 unload data map and select DSNUTILB UNLOAD for the Unload Type, PowerExchange includes a field for the OBID in the record. If you create DB2 unload files specifying HEADER NONE in the DB2 UNLOAD control statements, select UNDEFINED for the Unload Type.

13

PowerExchange Incremental Extraction

CDC Real Time Continuously CDC Change Periodically

14

PowerExchange Characteristics Change Data Capture (CDC)

Detailed capture mechanism differs from database to database Only once changes have been hardened onto the Change Stream can they be consumed

Restart and recovery are built into the system

Supports user-selectable latency

15

PowerExchange Change Data Capture (CDC) CDC for DB2/MVS

Mainframe Change Stream
Capture Registrations Restart Tokens

Collector

PWC

Listener

Source System

Logger files

CDC Change

Condense files

Single/dual Active logger datasets Single/Dual Archive datasets Single/Dual restart datasets

Checkpoint files

16

PowerExchange Components DB2 Change Data Capture

Listener El job listener es la interfaz a travs de la cual las herramientas
cliente se comunican con el entorno mainframe.

Agente El job reserva espacio de memoria necesario para que los otros
procesos trabajen, y por otro lado es quien controla y gestiona a los dems procesos.

ECCR

El job realiza peticiones al sistema db2 a travs de la interfaz

estndar IFI306 para pedirle los cambios que se producen en la base de datos y los escribe inmediatamente en un rea perteneciente al job logger.

Logger Su funcin es recoger los datos capturados por el proceso ECCR

y guardados en el hiperspace para grabarlos en disco. Crea una serie logs activos (PRILOG y SECLOG) al estilo de otros logs activos de db2 y con el mismo funcionamiento.

Condenser El job condensa literalmente los registros almacenados en

los archivos persisted change stream para consumo peridico.

17

PowerExchange DB2 CDC Architecture Overview

18

PowerExchange Configuration DB2 CDC Architecture Overview

The dbmover configuration file provides the connection information
Source System Application PWX Executables dbmover .cfg Data transfer DB2 SQL/Native Access SQL Data transfer SQL PowerCenter Client PWX Executables Data transfer dbmover .cfg dbmover .cfg Listener PWX Executables PowerCenter Server

Data transfer VSAM

19

PowerExchange Restart Tokens

Restart tokens specify the point from which PowerExchange extracts changed data from the source database (based in RBA) PowerCenter Server reads restart tokens from a restart token file When a session completes successfully, the PowerCenter Server updates the restart tokens in the restart token file If necessary you can restart from an earlier point

20

PowerExchange Log of activity

PowerExchange maintains a log of activity performed with messages generated by PowerExchange.

21

PowerExchange Navigator Client Tools

PowerExchange Navigator is the graphical user interface supplied with PowerExchange, and used to specify and activate changed data capture for source data (Change Registration)

22

MUCHAS GRACIAS

23