Copyright 2010, Oracle. All rights reserved.

PTS Workshop: ODI 11g

<Insert Picture Here>

Oracle Data Integrator Topology Concepts

Agenda
ODI Topology Overview Physical Architecture Logical Architecture Topology Planning Advanced Concepts Lab Overview Q&A
<Insert Picture Here>

Copyright 2010, Oracle. All rights reserved.

ODI Topology

Copyright 2010, Oracle. All rights reserved.

What is the Topology?

Topology The representation of the information system in ODI:
Technologies: Oracle, DB2, File, etc. Data Servers for each technologies Physical Schemas under each data server

ODI Agents (run-time modules)

Definition of Languages and Actions Topology Navigator provides access to everything that is considered part of the ODI topology

Copyright 2010, Oracle. All rights reserved.

What Topology Navigator Contains

Physical architecture Data servers, physical schemas and agents Logical architecture Logical schemas and agents, contexts Technology-related information Technologies, languages, actions ODI architecture components Repositories and agents

Copyright 2010, Oracle. All rights reserved.

Topology Navigator: Overview

Topology Navigator stores all the information in the Master repository. Making changes in Topology Navigator: Affects all attached repositories May affect the behavior of the work in progress or running processes

Copyright 2010, Oracle. All rights reserved.

Topology Navigator: Overview

Manual refresh

Tree view

Workbench

Topology Navigator views

Copyright 2010, Oracle. All rights reserved.

Physical Architecture

Copyright 2010, Oracle. All rights reserved.

Physical Architecture View

Technology Data server Physical schemas

Physical agent

To reduce the number of technologies displayed: Select Windows > Hide Unused Technologies
Copyright 2010, Oracle. All rights reserved.

Properties of Physical Schemas

An ODI physical schema always consists of 2 data server schemas: The Data Schema, which contains the datastores The Work Schema, which stores temporary objects A data server schema is technology-dependant. Catalog Name and/or Schema Name Example: Database and Owner, Schema A data server has: One or more physical schemas One default physical schema for server-level temporary objects

Copyright 2010, Oracle. All rights reserved.

Concepts in Reality

Technology
Oracle Microsoft SQL Server Sybase ASE DB2/400 Teradata Microsoft Access JMS Topic File

Data server
Instance Server Server Server Server Database Router File Server

Schema
Schema Database/Owner Database/Owner Library Schema (N/A) Topic Directory

Copyright 2010, Oracle. All rights reserved.

Prerequisites for Connecting to a Server

Drivers (JDBC, JMS) Drivers must be installed in the appropriate driver subdirectory for ODI Studio, standalone agent, and JEE agent This should be done on all the machines connecting to the data server Machines running an Oracle Data Integrator GUI Machines running an Oracle Data Integrator Agent Connection settings (server-dependent) Machine name (IP address), port User/password Instance/database name

Copyright 2010, Oracle. All rights reserved.

Important Note
The username is used to access all the underlying schemas, databases, or libraries in the data server. Ensure that this user account has sufficient privileges. For database: SELECT INSERT/UPDATE CREATE/DROP READ

Copyright 2010, Oracle. All rights reserved.

Creating a Data Server

1. Right-click the technology of your data server 2. Select New Data Server 3. Fill in the Name 4. Fill in the connection settings:
Data Server User and Password

(Optional) JNDI Connection

Copyright 2010, Oracle. All rights reserved.

Creating a Data Server - JDBC

Select driver Select URL

1. 2. 3. 4. 5.

Select the JDBC tab Fill in the JDBC driver Fill in the JDBC URL Test the connection Save the Data Server

Copyright 2010, Oracle. All rights reserved.

The JDBC URL

The JDBC driver uses a URL to connect to a database system.
The URL describes how to connect to the database system. The URL may also contain driver-specific parameters

Use the select button to choose the driver class name and URL template.

Copyright 2010, Oracle. All rights reserved.

Testing a Data Server connection

1. 2.

Click the Test Connection button Select the Agent to test this Connection
Local (No Agent) performs the test with the Topology Manager GUI.

3.

Click Test The driver must be installed

Copyright 2010, Oracle. All rights reserved.

Logical Architecture

Copyright 2010, Oracle. All rights reserved.

Logical Architecture and Context Views

Technology Logical schemas Contexts

Logical agent

The same technologies are displayed in Physical and Logical Architecture views.
To reduce the number of technologies displayed:

Select Windows > Hide Unused Technologies

Copyright 2010, Oracle. All rights reserved.

What is a Logical Schema?

Developers should not have to worry about the actual location of the data servers, or the updates in user names, IP addresses, passwords, etc. To isolate them from the actual physical layer, the administration will create a Logical Schema that is simply an alias for the physical layer.

Copyright 2010, Oracle. All rights reserved.

Context Connects Logical to Physical

Logical architecture
ORACLE_ORCL_LOCAL_SALES (Logical schema)

Contexts
(a context maps individual logical resources onto individual physical resources)

Development

Global

Production

Physical architecture
Windows
SALES_DEV

Linux
SALES_DEV

Linux
SALES_PROD

Oracle

Oracle

Oracle

Development site: New York

Production site: Tokyo

Production site: Boston

Copyright 2010, Oracle. All rights reserved.

Creating a Logical Schema

1. Go to the Logical Architecture view. 2. Right-click the schema technology. 3. Select New Logical Schema. 4. Enter the schema Name. 5. You can associate the schema with the physical schemas, in different contexts, here.

Copyright 2010, Oracle. All rights reserved.

Editing a Context to Link the Logical and Physical

1. Double-click the context. 2. Click the Agents tab. 3. For each Logical agent, select the corresponding Physical agent in the context. 4. Click the Schemas tab. 5. For each logical schema, select a corresponding physical schema in the context.

Copyright 2010, Oracle. All rights reserved.

Planning

Copyright 2010, Oracle. All rights reserved.

Planning the Topology

1.

Identify the physical architecture

All data servers All physical schemas Required physical agents

2. 3.

Identify the contexts Define the logical architecture

Name the logical schemas Name the logical agents

4.

On paper, write out a matrix of logical/physical mappings

This matrix helps you plan your topology

Copyright 2010, Oracle. All rights reserved.

Matrix of Logical/Physical Mappings

Logical Schemas Accounting

ACCOUNTING in Oracle on Windows ACCT in Oracle on Linux

Contexts Development Tokyo

Sales
SALES in Oracle on Windows

Copyright 2010, Oracle. All rights reserved.

Lab Overview

Copyright 2010, Oracle. All rights reserved.

Lab Objectives
In this lab series, you will learn how to:

Set up Oracle Data Integrator environment by creating the Master and Work repositories Use Topology Navigator to create the physical and logical architectures Create data servers and physical schemas Link the physical and logical architectures Install an ODI Agent as a background service

Copyright 2010, Oracle. All rights reserved.

Lab 4-1: Master and Work Repository Overview

Create and connect to the ODI Master Repository and the ODI Work Repository
Oracle Data
SQL Developer
Create SNPM1 database user for master repository Create SNPW1 database user for work repository

Oracle Data Integrator Integrator

Create master repository

Create master repository Create Master Repository connection Master connection Master Repository Pr Repository Pr 21 with 21 with SNPM1 as the user Create work repository

Create Master Repository

SNPM1 as the user

Create work repository work Create WORKREP_PR2-1

repository connection with Create WORKREP_PR2-1 SNPW1 as the user

work repository connection with SNPW1 as the user

Copyright 2010, Oracle. All rights reserved.

Lab 4-2: Topology Objects You Create in the Lab

Data server you create in practice Physical schemas you create in practice
Two contexts you create in practice Logical schema you create in practice

Global is a pre-seeded context Check mark indicates default context

Copyright 2010, Oracle. All rights reserved.

Lab 4-2: Topology Overview

1. 2. 3. 4. Define Production context Define Development context (a 3rd context, Global, is pre-seeded) Define ORACLE_ORCL_LOCAL data server Define ODI physical schemas for data server: SALES_DEV, SALES_PROD 5. Define ORACLE_ORCL_LOCAL_SALES ODI logical schema 6. Map logical schema to the two physical schemas, in terms of the three contexts
Data server you create in practice
Physical schemas you create in practice Two contexts you create in practice

Global is a
pre-seeded context Check mark indicates default context

Logical schema you create in practice

Copyright 2010, Oracle. All rights reserved.

Lab 4-3: Agents Overview

Set up and install ODI Agent as a service

Copyright 2010, Oracle. All rights reserved.

Copyright 2010, Oracle. All rights reserved.

Copyright 2010, Oracle. All rights reserved.