CON8059 Puntambekar-CON8059 OEM Virtualization OpenStack BestPractices Final

Oracle
Enterprise Manager,
OpenStack, Virtualiza6on :
Engineering Best Prac6ces to
Minimize Storage Tuning and
Troubleshoo6ng for Oracle
Environments

CON8059
Nirant Puntambekar, Senior Manager

Paul Monday, Architect
Oracle ZFS Storage Engineering
Shrikanth Krupanandan,
Fidelity Inc.

October, 2015
Copyright 2015, Oracle and/or its aliates. All rights reserved.
Safe Harbor Statement

The following is intended to outline our general product direc6on. It is intended for
informa6on purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or func6onality, and should not be relied upon
in making purchasing decisions. The development, release, and 6ming of any features or
func6onality described for Oracles products remains at the sole discre6on of Oracle.
Overview of Session
Oracle ZFS Storage delivers record performance and eciency with
both NAS & SAN Protocols
Shines in Database, Virtualiza6on and other general storage
workloads. Co-engineered for Op6mal Performance
Today, we will discuss how applica6on admins can take control of
their storage to perform various storage monitoring, administra6on
and tuning tasks as well as present best prac6ces for various
applica6ons

Agenda
1
ZFS Storage Applica6on Engineered Storage
Enterprise Manager, Virtualiza6on, Snap Management,

OpenStack : Use cases
Customer Case Study - Fidelity
Oracle
ZS
Over 20,000 systems deployed
Deployed by vast majority of Fortune 100 Companies
- 9 of the top 10 Global Telecommunica6on companies
- 5 of the top 5 Semiconductor companies
- 7 of the top 10 Global Banks
- 3 of the top 5 Oil and Gas Companies
- Founda6on Storage for Oracle Cloud
Achieved #3 in global share
15 quarters of double-digit year-over-year growth

Surpassed IBM, HP, Hitachi, etc. in the NAS market
Averaging over 150 new customers per quarter
6
6
Oracle ZS - Storage Technical Innova6ons

Record-sePng
Storage Performance
Industry-leading
Storage Value
Lower Cost to Acquire

and Run: Best $ per
GB, Best $ per IOPS,
Lower Entry Price
DRAM/Flash
architecture, SMP
(Solaris) RTOS, Most
Scalable Filesystem
(ZFS)
Oracle Database Co-

Engineering
OISP, HCC, ADO, OEM

Provisioning, SMU,
Pluggable Database
Analy6cs
Oracle Co-Engineering:
Server, PCA, Eng.
Systems, Cloud and *IT
IB, RDMA, FMA, Rolling
Upgrades, Shadow
Migra6on, User-level
analy6cs, Workows
Oracle ZS Enterprise Storage Series
ZFS Storage Operating System
ZS3-2
Most powerful storage software suite

Engineered integration with Oracle software
Single or Dual Controllers

512GB or 1TB DRAM
8 PCIe Slots
16 Disk Enclosures
13TB Read Flash
4TB Write Flash
ZS4-4
Single or Dual Controllers

3TB DRAM
14 PCIe Slots
36 Disk Enclosures
13TB Read Flash
28TB Write Flash
ZS4 is DRAM Storage
80-90% of IO is delivered from memory

Most Horsepower Possible
Dynamic Storage Tiering (HSP)
120 Cores
Processing
Power
13TB
Read Flash
30TB
Write Flash
10K
SAS-2
3TB
DRAM
7.2K
SAS-2
12TB
READ
FLASH
4 Write SSDs
DRAM
High
Endurance
Adaptive
I/O Staging
3TB DRAM
3TB
per Tray (max)
WRITE FLASH
LRU
MRU
LFU
MFU
Sync I/O Only
SAS-2
(10K, 7K)
Adaptive Throttle Algorithm

Determines Pipe Size
(Evicted)
READ FLASH
Read Intensive
L2ARC
10K
SAS-2
! Automated, real-time data migration from DRAM

to multi-class flash, to multi-class disk storage
! Software specifically engineered for multi-level
flash and disk storage
ZS Comprehensive Suite of Enterprise Software

Data protocols
Data services
Management
OISP
Fibre channel
iSCSI
Hybrid columnar compression
RESTful API, OpenStack/Cinder
Hybrid storage pools
Browser and CLI interface
Single, double and triple-parity RAID
Inniband
- NFS/RDMA
Management dashboard
Mirroring and triple mirroring
Hardware/component view
End-to-end data integrity
Role-based access control
Local and Remote replica6on
Phone home
Snapshots and clones

Quota(s)
Event and threshold

based aler6ng
Deduplica6on
Dtrace analy6cs
Compression
Scrip6ng
Encryp6on
Workow automa6on
Thin provisioning
Advanced networking
An6virus via ICAP protocol
Snap Management U6lity
- IPoIB
- iSER
- SRP
NFS V3 and V4
SMB/CIFS
HTTP
WebDAV
FTP/SFTP/FTPS
ZFS NDMP V4
Online data migra6on

Clustering
Source aware rou6ng
10
Agenda
1

OpenStack : Use cases
Customer Case Study - Fidelity
11

Enterprise Manager Integra6on

12
Is This Your Day?

60% have 2+ full-
6me for DB storage
management
>20% of 6me spent

addressing
performance issues
60%
indicate storage admin

and maintenance
increasing
49% say storage
management tools DO NOT

give enough visibility into
DB eects on storage
13
Integrate Oracle ZFS Storage Appliance

Monitor and Manage ZFS Storage Appliances through Oracle Enterprise Manager
Plug-in for Enterprise Manager

Enables n-way monitoring and managing
of mul6ple ZFS Storage Appliances
through Enterprise Manager interface
You can
Monitor key ZFS Storage Appliance
metrics
Threshold based aler6ng, reports
Provision LUNs and shares; adjust
tunable parameters
14
N-way Monitoring : View By Groups
Arrange similar systems together in a group
Dashboard to quickly
iden6fy status of systems
in the specied group
Monitor a variety of systems
together by opera6onal unit
Include database, servers
and storage
Single pane of glass n-way

monitoring.
Device Summary View Simplies Monitoring Tasks

Uses powerful analyWcs to provide intuiWve displays of key metrics
Share capacity and u6liza6on at a
glance
Graphs of disk I/O and network
performance for quick review of recent
ac6vity
System alert no6ca6ons displayed in
the summary view
Link to launch appliance GUI for
detailed analy6cs and device
management
ASR Alerts: Cri6cal, Major
16
Ready to Take Control of Your Database Storage?

Using Oracle ZS3 Storage Appliance as your storage plaYorm makes it easier
What do you need to know about your storage?

Is it available? How is it performing?
Is there capacity I can use?
Is it tuned to properly support the database I/O?
Owning the storage resource is not painful

Oracle Enterprise Manager can help you monitor and manage
your ZS3 database storage plasorm
Easily monitor use paterns and capacity u6liza6on, then adjust
parameters or add capacity through Enterprise Manager
17
What Do I Get From Monitoring My Storage?

Fewer calls to the storage administrator
Iden6fy if a disk has failed

RAID rebuild may be slowing down the storage performance
See how fast the storage is sending data over the network
If the storage is performing, then the network could be to blame for the slowdown
Pick out the other clients using the storage system

Could be another client is taking up all the resources
Why wait for someone else to tell you what you can nd out yourself? Take
the reins yourself
18
End User Example: What Would a DBA Need to Change?

RMAN backup use case
Backup I/O characteris6cs for RMAN workload

Tune SSD write ash accelerator bias to send data straight to disk spindles
Matching 1MB storage record size to 1MB backup I/O record size typically results in a
signicant improvement in restore performance
Enterprise Manager enables the

Oracle Intelligent Storage Protocol
DBA to set the same parameters for (OISP) in 12c does this automa6cally
earlier database versions
Database passes informa6on directly to
Simple steps to take through Enterprise
Manager
the ZFS Storage Appliance to set

parameters
19
Modify Storage Alloca6on to Respond

Only Oracle ZFS Storage Appliance can be provisioned from Enterprise Manager
Access a full set of provisioning

capabili6es
Create or tune the storage your
database needs
Adjust write bias, database record size
Make snapshots visible for RMAN
Manage your ZFS Storage Appliance

through Enterprise Manager
No new interfaces to learn
20
Database/ Pluggable Database Level Analy6cs

Deeper drill downs in Oracle Database 12c environments
Database level granular visibility of our
industry leading DTrace-based storage
analy6cs in Oracle Database 12c environments
Iden6fy contribu6on of individual database to overall
performance of the system
Signicant in Mul6tenant Oracle Database 12c

environments
Break I/O trac by each pluggable database level
within a container database
Quick iden6ca6on of root cause and saves

eort in troubleshoo6ng

Engineered Systems Backup

22
ZFS Storage Appliance for Oracle Engineered

Systems - Backup & Recovery
Application Engineered Storage for Oracle
Engineered Systems Backup
Extreme Performance ~42TB/hour backup,
~55TB/hour restore
Less Complexity with Fewer Storage
Systems and Streamlined Management.
Scales upto 3.4 PB raw capacity.
Lower TCO with Extreme Efficiency.
Combine with dev/test workloads for ROI
advantage
Engineered Systems Backup Congura6on Sovware

ESBU - Congura6on u6lity to setup a ZFS Backup Appliance to receive
backups via RMAN
Tunes parameters based on best prac6ces
ZFSSA : project and shares
Eng System : nfs/dnfs mounts, backup services,
network interfaces
Op6mized RMAN commands to use
Prod
Database
Backup/Restore
RMAN
Image
Support for Exadata, SuperCluster and ODA

ESBU Cong
U6lity
24

Oracle Snap Management U6lity

25

FuncWonality
Execute snapshot backups of the database on the ZFSSA

Cold (oine) and hot (online) backup procedures
File- and block-based storage, Single-instance and RAC
environments
BUI or CLI interface
Scheduler and reten6on policies, alerts no6ca6ons
Restore to a snapshot backup

Restore database to a point in 6me backup
Rapid Cloning for Dev/Test

Thin Clones from a snapshot backup or an RMAN image copy
26

Snapshot Backups and Restores and Thin Cloning

SID = PROD
Produc6on Server
SID = PROD
SMU Host
Snapshot Backups

Clone from RMAN backups
RMAN
Image Copy
Snapshot
SMU Host
CLONE
Development Server
SID = DEV
SID = DEV

Virtualiza6on

29
Virtualiza6on Environments
Up to 120
CPU cores
Virtualiza6on workloads shine with the ZFSSA

Workloads are CPU and IOPs intensive
Hybrid storage pools/DRAM centric cache/ SMP arch
80-90% cache hit rate
Avoid VM bootstorms, cpu botlenecks and I/O
satura6on.
Highly Granular Analy6cs with VM level visibility
More VMs per storage system
High IOPs for lowest cost in the industry

13TB Read Flash

Flash
30TB Read
Cache

3TB

DRAM
Fast Network
(InniBand, 10GbE,
16Gbit ,FC, NFS, iSCSI)
DRAM
Nanosecond
Response

Flash
Storage Microseco
Media nd
Latencies Response
Disk
Millisecond
Response
30
ZS: Designed to Thrive in

Highly Virtualized Environments
NAS Filer
Highly Taxed CPUs
10x VM consolida6on is typical

Recommenda6ons:
Use NAS (nfs) instead of SAN
NAS Easiest to setup/get running
Powerful granular analy6cs
250
VMs
2,500+
VMs
Low CPU Use
Virtualisa6on stresses the limits

of conven6onal systems
Oracle ZS
IntegraWons/CerWcaWons
Oracle VM
HW cer6ca6ons
Storage Connect Integra6on
Simultaneous VM Boots, ZS3-2

Elapsed Time (secs)
Virtualiza6on Environments
600
500
400
300
200
100
0
0
5,000
10,000
15,000
20,000
Number of VMs BooWng Simultaneously

Clones of Golden Master
VMware
ESX4.x, 5.x and 6.0 hardware cer6ca6ons
Site Recovery Manager, vCenter WebClient, VASA (Storage
Awareness), VAAI (Storage Ooads)
Impressive Boot storm and VDI benchmarks
Citrix/HyperV
Hardware Cer6ca6ons
1000 sessions VDI test

35%CPU, 80-90% cache hit rate
32

OpenStack

33
The Oracle OpenStack Ecosystem
Oracle OpenStack and Oracle ZFS Storage Appliance

Deliver QoS with Oracle ZFS Storage Appliance iSCSI Cinder Driver
Take control of the storage environment in OpenStack by using an Oracle

ZFS Storage Appliance for Cinder Volumes
Deliver a variety of quali6es of service from a centrally managed point
Capacity vs. performance pools
Varying block sizes, write biases, cache devices, compression op6ons, replica6on
Clustered heads
Easy split of responsibili6es

Simplied / centralized under cloud administra6on for the storage administrator
IT Consumers get choices and quotas delivered through Oracle OpenStack
35
Mul6ple Backend Deni6ons for iSCSI Cinder

Use mul6ple Cinder back-ends to
split up based on various criteria
Virtual Machines
Organiza6onal workgroups / projects

I/O Characteris6cs (block sizes, cache)
Capacity vs. Performance
Ini6ator / Target Groups
Oracle ZFS Storage Appliance iSCSI Cinder Driver

Performance
Back-end
DB Log Back-
end
Capacity Back-
end
VM Volume
DB Data Back-
Back-end
end
Example, Oracle Database

Log Volume Type (larger block sizes
with throughput cache seyngs)
Data Volume Type (small block sizes
with latency cache seyngs)
36
OpenStack Administrator delivers to IT Consumer

OpenStack Administrator
IT Consumer
zfssa_pool=performance!
zfssa_lun_volblocksize=128k!
zfssa_lun_logbias=throughput
zfssa_pool=capacity!
zfssa_lun_logbias=latency
zfssa_pool=capacity!
zfssa_lun_logbias=latency
37
Enterprise Network Architecture
OpenStack API Network
Combine volume back ends with

rst class network architectures for
Reliability / Availability
Scalability / Performance
Security
A few network details

Separate the storage network
Enable and use mul6pathing
Use a sucient number of physical
network ports to par66on trac
Tenant Network
SPARC T4 Solaris 12
SPARC T4 Solaris 12
Controller node
Data Center Compute node
Network
Storage Network
38
Using Analy6cs to View Cinder Volume Trac

Trac on LUNs that are
Cinder Volumes
Trac from Compute Nodes

that atach to Cinder
Volumes
Trac on network devices

(Volume trac comes over
two devices through iSCSI
mul6pathing)
39
Best Prac6ces Overview

Best-Prac6ces Paper from Oracle ZFS Storage Appliance Applica6on
Integra6on Engineering Team: Using the Oracle ZFS Storage Appliance as a
Storage Backend for OpenStack Cinder
Oracle OpenStack Juno Release
Oracle SPARC Hardware with Oracle Solaris
Oracle ZFS Storage Appliances with OS8.4
A few of the documented prac6ces

Network Architecture -> Separate into mul6ple networks
Uniform network design / Symmetrical hardware design
Cinder Congura6on -> Mul6ple back-end volume types
Volume Management -> Use of volume labels
40
Oracle ZFS Storage OpenStack and Cloud Roadmap

Cinder
iSCSI (Juno)
Advanced NFS and Replica6on (Liberty)
Manila
Basic le sharing (Kilo)
NFS and CIFS (Liberty)
Swiv
Solaris proxy with NFS backend (by Liberty)
HTTPS backend services by direct or proxy (CY16)
41
References
Oracle ZFS Storage
htps://www.oracle.com/storage/nas/index.html
Oracle ZFS Storage Whitepapers/Solu6ons Briefs

htp://www.oracle.com/technetwork/server-storage/sun-unied-storage/documenta6on/index.html
Oracle ZFS Storage Applica6on Integra6ons Downloads
htp://www.oracle.com/technetwork/server-storage/sun-unied-storage/downloads/index.html
Oracle OpenStack for Linux
htp://www.oracle.com/us/technologies/linux/openstack/overview/index.html
Oracle OpenStack for Solaris

htp://www.oracle.com/technetwork/server-storage/solaris11/technologies/openstack-2135773.html
42
Program Agenda with Highlight

1

Open Stack :
Customer Use Case - Fidelity

43
Safe Harbor Statement

The preceding is intended to outline our general product direc6on. It is intended for
informa6on purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or func6onality, and should not be relied upon
in making purchasing decisions. The development, release, and 6ming of any features or
func6onality described for Oracles products remains at the sole discre6on of Oracle.
44
Keep Learning with Oracle University
Classroom Training
Cloud
Learning Subscrip6on
Technology
Live Virtual Class
Applica6ons
Training On Demand
Industries
educaWon.oracle.com
45

CON8059 Puntambekar-CON8059 OEM Virtualization OpenStack BestPractices Final

Enviado por

Dados do documento

Descrição original:

Direitos autorais

Formatos disponíveis

Compartilhar este documento

Compartilhar ou incorporar documento

Opções de compartilhamento

Você considera este documento útil?

Este conteúdo é inapropriado?

Direitos autorais:

Formatos disponíveis

CON8059 Puntambekar-CON8059 OEM Virtualization OpenStack BestPractices Final

Enviado por

Direitos autorais:

Formatos disponíveis

Oracle

Nirant Puntambekar, Senior Manager

Safe Harbor Statement

Copyright 2015, Oracle and/or its aliates. All rights reserved.

ZFS Storage Applica6on Engineered Storage

Enterprise Manager, Virtualiza6on, Snap Management,

Customer Case Study - Fidelity

Copyright 2015, Oracle and/or its aliates. All rights reserved.

Achieved #3 in global share

15 quarters of double-digit year-over-year growth

Oracle ZS - Storage Technical Innova6ons

Lower Cost to Acquire

Oracle Database Co-

OISP, HCC, ADO, OEM

Copyright 2015, Oracle and/or its aliates. All rights reserved.

Oracle ZS Enterprise Storage Series

ZFS Storage Operating System

Most powerful storage software suite

Single or Dual Controllers

Copyright 2015, Oracle and/or its aliates. All rights reserved.

Single or Dual Controllers

ZS4 is DRAM Storage

80-90% of IO is delivered from memory

Dynamic Storage Tiering (HSP)

per Tray (max)

Sync I/O Only

Adaptive Throttle Algorithm

! Automated, real-time data migration from DRAM

ZS Comprehensive Suite of Enterprise Software

Hybrid columnar compression

RESTful API, OpenStack/Cinder

Hybrid storage pools

Browser and CLI interface

Single, double and triple-parity RAID

Mirroring and triple mirroring

End-to-end data integrity

Role-based access control

Local and Remote replica6on

Snapshots and clones

Event and threshold

An6virus via ICAP protocol

Snap Management U6lity

Online data migra6on

Source aware rou6ng

Copyright 2015, Oracle and/or its aliates. All rights reserved.

ZFS Storage Applica6on Engineered Storage

Enterprise Manager, Virtualiza6on, Snap Management,

Customer Case Study - Fidelity

Copyright 2015, Oracle and/or its aliates. All rights reserved.

Copyright 2015, Oracle and/or its aliates. All rights reserved.

Is This Your Day?

>20% of 6me spent

indicate storage admin

49% say storage

management tools DO NOT

Copyright 2015, Oracle and/or its aliates. All rights reserved.

Integrate Oracle ZFS Storage Appliance

Plug-in for Enterprise Manager

N-way Monitoring : View By Groups

Arrange similar systems together in a group

Single pane of glass n-way

Copyright 2015, Oracle and/or its aliates. All rights reserved.

Device Summary View Simplies Monitoring Tasks