Running Oracle in EC2

Cloud Computing Group System Research Lab TRDDC Pune

Overview

Section 1: Pricing and Licensing Section 2: Getting Started with AWS Section 3: Installing Oracle Section 4: Secure Backup

Section 1 Pricing and Licensing

Section 1: Pricing and Licensing

1. 2. 3. 4.

Amazon Web Services (AWS) Overview Pricing of relevant AWS Services Oracle Licensing and Support Oracle Secure Backup Cloud Module

1.1 AWS Overview:

Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Cloud Front Amazon SimpleDB Amazon Simple Queue Service (SQS) Amazon Elastic MapReduce

1.2 AWS Pricing EC2:

Elastic Compute Cloud (EC2)

Prices http://aws.amazon.com/ec2/#pricing Amazon Machine Image (AMI):

On Demand, Reserved 1 Year, 3 Years Small Large XLarge $0.10/hr, $325/yr ($0.03/hr),$500/3yr $0.40/hr, $1300/yr($0.12/hr),$2000/3yr $0.80/hr, $2600/yr($0.24/hr),$4000/3yr

Standard CPU AMI:

High CPU AMI:

Medium XLarge

$0.20/hr, $650/yr($0.06/hr),$1000/3yr $0.80/hr, $2600/yr($0.24/hr),$4000/3yr

1.2 AWS Pricing EC2 (Contd):

Elastic Compute Cloud (EC2)

Elastic IP

Public, Static IP IP Map/Re-map > 100/month $0.10 each $0.01 non-attached per hour $0.10 GB/month provisioned $0.10 per 1MM/month I/O requests $0.15 GB/month $0.01 per 1,000 PUT requests (when saving a snapshot) $0.01 per 10,000 GET requests (when loading a snapshot)

Elastic Block Store (EBS)

EBS Snapshots to S3

1.2 AWS Pricing S3:

Simple Storage Service (S3)

Prices http://aws.amazon.com/s3/#pricing Operations: PUT, GET, DELETE Storage

$0.15GB/Month < 50TB $0.14GB/Month > 50TB, < 400TB $0.13GB/Month > 400TB, < 500TB $0.12GB/Month > 500TB

Data Transfer

$0.10GB all data transfer in

1.2 AWS Pricing S3 (Contd):

Requests

$0.01 per 1,000 PUT, COPY, POST or LIST request DELETES are free $0.01 per 10,000 GET and all other requests Device Handling $80.00 each Data loading $2.49 per hr (hourly increment)

AWS Import/Export

1.2 AWS Pricing Import/Export:

Not Database exp/imp AWS Import/Export

Device Handling $80.00 each Data loading $2.49 per hr (hourly increment) http://aws.amazon.com/importexport/ Calculator: http://awsimportexport.s3.amazonaws.com/awsimport-export-calculator.html

10

1.2 AWS Data Transfer Pricing:

Data Transfer:

Regions: US, EU Sub-region (zone) Free within zones on private IP Elastic IP or Public IP outside AWS, regional charges

11

1.3 Oracle Licensing:

Existing or New License http://www.oracle.com/corporate/pricing/cloudlicensing.pdf Cost of AMI Pre-built Oracle AMI (11g) Roll your own AMI

12

1.3 Oracle Support:

Virtualization Support AWS Database Support Oracle Secure Backup Cloud Module http://www.oracle.com/technology/tech/cloud/fa q.html#support No RAC

13

1.4 Oracle Secure Backup Cloud Module:

Backups to S3 via. RMAN 9i R2 and higher Pre-installed on Oracle AMIs EC2 and non-EC2 databases Requires S3 and OTN accounts Integrated with Enterprise Manager

14

Section 2 Getting Started with AWS

15

Section 2: Getting Started with AWS

1. 2. 3. 4. 5.

6.
7. 8. 9.

AWS account AWS EC2 Console EC2 Security Groups EC2 Key Pairs EC2 Amazon Machine Images (AMIs) EC2 Elastic IP EC2 EBS Volumes EC2 Snapshots Using EC2 Command Line tools
Oracle on EC2, NoCOUG Aug 20th 2009

16

2.1 AWS account

Amazon.com account Sign up for services at http://aws.amazon.com EC2 Console: http://console.aws.amazon.com

17

2.2 AWS EC2 Console

18

2.2 AWS EC2 Console

Security Groups Key Pairs AMIs Instances Elastic IPs EBS Volumes EBS Snapshots

19

2.3 EC2 Security Groups

20

2.3 EC2 Security Groups - Create

21

2.3 EC2 Security Groups Configuration

22

2.4 EC2 Key Pairs

23

2.4 EC2 Key Pairs Create

24

2.4 EC2 Key Pairs Save PEM file

25

2.4 EC2 Key Pairs Save PEM file

Only one opportunity Make a copy Make another offline copy Cannot be retrieved or restored PEM?

26

2.5 EC2 AMIs

27

2.5 EC2 AMIs List Options

Show/Hide (Owner, Platform, Architecture) Oracle owner id = 725966715235 Linux only

28

2.5 EC2 AMIs Launch Instance

29

2.5 EC2 AMIs Instance Options

30

2.5 EC2 AMIs Availability Zones

us-east-1a us-east-1b us-east-1c us-east-1d

31

2.5 EC2 AMIs Instance Launch

32

2.5 EC2 Instances - Pending

33

2.5 EC2 Instances Launched

34

2.5 EC2 Instances Command Line Tools

Scriptable command line tools:

ec2-bundle-instance ec2-confirm-product-instance ec2-describe-instances ec2-describe-reserved-instances ec2-describe-reserved-instances-offerings ec2-monitor-instances ec2-purchase-reserved-instances-offering ec2-reboot-instances ec2-run-instances ec2-terminate-instances ec2-unmonitor-instances

35

2.6 EC2 Elastic IP

Static IP tied to account Assign to any account instance Unassigned is more expensive Redirect failed services Scriptable command line tools:

ec2-allocate-address ec2-associate-address ec2-disassociate-address ec2-release-address

36

2.6 EC2 Elastic IPs

37

2.6 EC2 Elastic IP - Allocate

38

2.6 EC2 Elastic IP - Allocated

39

2.6 EC2 Elastic IP - Associate

40

2.6 EC2 Elastic IP - Associated

41

2.7 EC2 Elastic Block Store (EBS) Volumes

Persistent Storage Pick zone and region Assign to an instance within a zone Scriptable command line tools:

ec2-create-volume ec2-delete-volume ec2-attach-volume ec2-detach-volume ec2-describe-volume

42

2.7 EC2 EBS Volumes

43

2.7 EC2 EBS Volumes - Create

44

2.7 EC2 EBS Volumes - Creating

45

2.7 EC2 EBS Volumes - Created

46

2.7 EC2 EBS Volumes - Attach

47

2.7 EC2 EBS Volumes - Attached

48

2.8 EC2 EBS Snapshots

Copy of EBS Volume into S3 S3 replicates snapshots across zones Snapshots restorable in any zone Snapshots used to copy EBS volumes within zones Scriptable command line tools:

ec2-create-snapshot ec2-delete-snapshot ec2-describe-snapshot

49

2.8 EC2 EBS Snapshots

50

2.8 EC2 EBS Snapshots - Create

51

2.8 EC2 EBS Snapshots - Created

52

2.9 Using EC2 Command Line Tools

Requires at least Java 5 runtime SSH Acces for Linux (Putty for Windows SSH) RDC for windows (not covered) AWS -> Resources Developer tools EC2API tools (ec2-api-tools.zip) Setup ENV variables:

JAVA_HOME EC2_HOME is path to unzipped files EC2_PRIVATE_KEY (PEM file path) EC2_CERT (your X.509 cert file path)

53

Section 3 Installing Oracle

54

Section 3: Installing Oracle

1. 2. 3.

Connecting to a new instance Mount EBS Volumes Create database

55

3.1 Connecting to a New Instance

PEM file is private key First connection SSH as root Linux SSH command line connect using PEM file

ssh -i <PEM_file> root@<ip_address> PuttyGen to load and convert PEM file Save Windows equivalent Private Key file Create Session in Putty using new Private Key file for authentication

Windows Putty SSH Client

56

3.1 Connecting License Acceptance

57

3.1 Connecting Oracle Password

58

3.1 Connecting No DB auto creation

59

3.2 Mount EBS Volumes

Create Partitions on devices

fdisk /dev/sdf mkfs.ext3 /dev/sdf1

Create Filesystems

Create mount points, mount, set permissions

mkdir /m1 mount /dev/sdf1 /m1; chown R oracle:dba /m1 /dev/sdf1 /m1 ext3 defaults 1 1

Edit /etc/fstab to automount

60

Repeat for EBS Volumes

3.2 Mount EBS Volume Create FS

61

3.2 Mount EBS Volume /etc/fstab

62

3.2 Create Database - Choices

11g Oracle Home:

/u01/app/oracle/product/11.1.0/db_1 /home/oracle/scripts/run_dbca.sh (as root) Customize database post creation

Oracle provided script:

DBA crafted scripts (better) Free script:

http://ocpdba.net/dbcreate/index.html (10g)

63

3.2 Create Database - Recommendations

Create separate EBS Volume for /admin /admin used for:

DB Creation scripts Admin scripts DB files (init.ora, spfile, broker files, etc.)

Symlinks from /admin/<dbname>/<file> to Oracle software home EBS volume snapshot used for new DB hosts

64

3.2 Create Database - Recommendations

Allow only SSH port to be open in Security Group Tunnel SQL*Net across SSH outside the cloud If opened, restrict listener port to fixed IPs

65

3.2 Create Database - Cloning

/admin EBS Snapshot cloneable to new Instances EBS volume snapshots (cold db) used for new db cloning of database files

66

3.2 Create Database - Performance

CPU & Memory fixed Within the cloud fastest for I/O I/O can be scaled

Multiple EBS Volumes Oracle ASM Stripe across EBS Volumes

67

Section 4 Oracle Secure Backup (OSB) Cloud Module

68

Section 4: OSB Cloud Module

1. 2. 3. 4. 5.

OSB Pre-requisites OSB Setup OSB RMAN Integration OSB Performance RMAN / OSB / S3 Use cases

69

4.1 OSB Pre-requisites

Download Cloud Backup Installer Included in Oracle AMIs

/home/oracle/scripts/osbws/osbws_install.jar

S3 Oracle 9i R2 and higher OTN account

70

4.2 OSB Setup Installer Options

List options for OSB Installer

su oracle java -jar ~oracle/scripts/osbws/osbws_install.jar more ~oracle/scripts/osbws/osbws_readme.txt

71

4.2 OSB Setup Installer Options

Required

AWSID AWSKey otnUser & otnPass walletDir libDir

AWS account access key ID AWS account secret access key OTN Credentials for download Stores credentials for use Location for platform specific download (RMAN SBT library)

Optional platform and proxy parameters Optional Recommended

configFile

Initialization parameter file used by future RMAN jobs

Default: $ORA_HOME/dbs/osbsws<ORACLE_SID>.ora

72

4.2 OSB Setup Sample Installer Script

# install_osb.sh # Set before running: AWSID, AWSKEY, OTNUSER, OTNPASS # libDir stores software specific to the platform for RMAN SBT library parms use java -jar ~oracle/scripts/osbws/osbws_install.jar \ -AWSID $AWSID \ -AWSKEY $AWSKEY \ -otnUser $OTNUSER \ -otnPass $OTNPASS \ -walletDir /admin/osbws/wallet \ -configFile /admin/osbws/osb_config.dat \ -libDir /admin/osbws/software

73

4.2 OSB Setup Install Platform Library

74

4.3 OSB RMAN Integration

RMAN SBT Parms configuration Installed to libDir parameter in installation RMAN Command:
RMAN> configure channel device type sbt parms SBT_LIBRARY=/admin/osbws/sofware/libosbws11.so ENV=(OSB_WS_PFILE=/admin/osbws/osb_config.dat) ;

Ready for backups

75

4.4 OSB RMAN Performance

11g Multiple RMAN Channels 11g datafiles can be backed up across multiple channels 11g Fast Backup Compression RMAN block change tracking

76

4.5 RMAN / OSB / S3 Use Cases

Cloning Scalable backups Moving databases Regional Backup/Recovery Availability

77

Thank You