Section 2 : Storage Networking Technologies and Virtualization

Storage Virtualization

Chapter 10

EMC Proven Professional

The #1 Certification Program in the information storage and management industry

2009 EMC Corporation. All rights reserved.

Chapter Objectives
Upon completion of this chapter, you will be able to: o Identify different virtualization technologies

o Describe block-level virtualization technologies

o Describe file-level virtualization technologies o Discuss virtual provisioning

2009 EMC Corporation. All rights reserved.

Lesson Virtualization Overview

Upon completion of this lesson, you will be able to: o Identify and discuss virtualization technologies

2009 EMC Corporation. All rights reserved.

What is Virtualization

o Virtualization is a technique of abstracting physical resources into logical view

o Increases utilization and capability of IT resource o Simplifies resource management by pooling and sharing resources o Significantly reduce downtime
o Planned and unplanned

o Improved performance of IT resources

2009 EMC Corporation. All rights reserved.

What is a Virtual Machine ?

2009 EMC Corporation. All rights reserved.

Virtualization Comes in Many Forms

Virtual Memory

Each application sees its own logical memory, independent of physical memory

Each application sees its own logical Virtual Networks network, independent of physical network

Virtual Servers

Each application sees its own logical server, independent of physical servers

Virtual Storage

Each application sees its own logical storage, independent of physical storage

2009 EMC Corporation. All rights reserved.

Memory Virtualization

Virtual Memory

Each application sees its own logical memory, independent of physical memory Physical memory
App

App

App

Swap space

Benefits of Virtual Memory Remove physical-memory limits Run multiple applications at once
7

2009 EMC Corporation. All rights reserved.

Network Virtualization

Each application sees its own logical Virtual Networks network, independent of physical network

VLAN A VLAN B VLAN C

Switch

Switch

VLAN trunk

Benefits of Virtual Networks Common network links with accesscontrol properties of separate links Manage logical networks instead of physical networks Virtual SANs provide similar benefits for storage-area networks
8

2009 EMC Corporation. All rights reserved.

Server Virtualization
Before Server Virtualization: After Server Virtualization:

Application
Operating system
Single operating system image per machine Software and hardware tightly coupled Running multiple applications on same machine often creates conflict Underutilized resources

App App App

App App App

Operating system Operating system

Virtualization layer
Virtual Machines (VMs) break dependencies between operating system and hardware Manage operating system and application as single unit by encapsulating them into VMs Strong fault and security isolation Hardware-independent

2009 EMC Corporation. All rights reserved.

Storage Virtualization
o Process of presenting a logical view of physical storage resources to hosts o Logical storage appears and behaves as physical storage directly connected to host o Examples of storage virtualization are:
o Host-based volume management o LUN creation o Tape virtualization

Servers

Virtualization Layer

o Benefits of storage virtualization:

o Increased storage utilization o Adding or deleting storage without affecting applications availability o Non-disruptive data migration
Heterogeneous Physical Storage
2009 EMC Corporation. All rights reserved.

Lesson Summary
Key topics covered in this lesson: o Various forms of virtualization
o Memory, network, server and storage virtualization

Additional Task Research on Virtual LAN & Virtual SAN

2009 EMC Corporation. All rights reserved.

Lesson Storage Virtualization Implementation

Upon completion of this lesson, you will be able to: o Discuss SNIA virtualization taxonomy

o Describe Block-Level Virtualization technologies and implementation

o Describe File Level Virtualization technologies and implementation

2009 EMC Corporation. All rights reserved.

SNIA Storage Virtualization Taxonomy

Storage Virtualization

What is created

Block Virtualization

Disk Virtualization

Tape, Tape Drive, Tape Library Virtualization

File System, File/record Virtualization

Other Device Virtualization

Where it is done Host Based Virtualization Network Based Virtualization Storage Device/Storage Subsystem Virtualization

How it is implemented In-band Virtualization Out-of-band Virtualization

2009 EMC Corporation. All rights reserved.

Storage Virtualization Requires a Multi-Level Approach

Path management Server Volume management Replication

Storage Network

Path redirection Load balancing - ISL trucking

Access control - Zoning

Volume management - LUNs Storage Access control Replication RAID

2009 EMC Corporation. All rights reserved.

Storage Virtualization Configuration

Servers Servers

Virtualization Appliance
Storage Network

Virtualization Appliance

Storage Network

Storage Arrays

Storage Arrays

Out-of-Band (a)

In-Band (b)

2009 EMC Corporation. All rights reserved.

Storage Virtualization Configuration

o Out-of-band implementation
o Virtualized environment configuration is stored external to the data path o Virtualization appliance is hardware-based and optimized for fibre channel o Enables data to be processed at network speed o More scalable

o In-band implementation
o Virtualization function is placed in the data path o Virtualization appliance is software-based and runs on general-purpose servers o During processing, data storing and forwarding through the appliance results in additional latency o Less scalable only suitable for static environment with predictable workloads
2009 EMC Corporation. All rights reserved.

Storage Virtualization Challenges

o Scalability
o Without virtualization, each storage array is managed independently to meet application requirements in terms of capacity and IOPS o With virtualization, the environment as a whole must be analyzed

o Functionality
o Virtualized environment must provide same or better functionality

o Must continue to leverage existing functionality on arrays

o Manageability
o Virtualization device breaks end-to-end view of storage infrastructure

o Must integrate with existing management tools

o Support
o Interoperability in multivendor environment
2009 EMC Corporation. All rights reserved.

Block-Level Storage Virtualization

o Ties together multiple independent storage arrays
o Presented to host as a single storage device o Hosts are directed to virtualized volumes on the virtualization device o Mapping is done to redirect I/O on this virtual storage device to underlying physical arrays
Servers

Virtualization Applied at SAN Level

o Deployed in a SAN environment o Non-disruptive data mobility and data migration

Heterogeneous Storage Arrays

o Enable significant cost and resource optimization

2009 EMC Corporation. All rights reserved.

File-Level Virtualization
Before File-Level Virtualization Clients IP Network Clients After File-Level Virtualization Clients Clients

IP Network
Virtualization Appliance

File Server

Storage Array

File Server

File Server

Storage Array

File Server

NAS Devices/Platforms

NAS Devices/Platforms

Every NAS device is an independent entity, physically and logically Underutilized storage resources Downtime caused by data migrations
2009 EMC Corporation. All rights reserved.

Break dependencies between end-user access and data location

Storage utilization is optimized Nondisruptive migrations

Lesson: Summary
Key points covered in this lesson: o Storage virtualization challenges

o Storage virtualization configuration

o Types of storage virtualization

Additional Task Research on Global File Virtualization

2009 EMC Corporation. All rights reserved.

Lesson: Virtual Provisioning

Upon completion of this lesson, you will be able to: o Explain Virtual Provisioning o Describe and explain Thin vs. Traditional LUNs o Explain the benefits of Virtual Provisioning

o Explain how to create, monitor, and manage Thin LUNs

2009 EMC Corporation. All rights reserved.

What is Virtual Provisioning

o Capacity-on-demand from a shared storage pool
o Logical units presented to hosts have more capacity than physically allocated (thin provisioning)

o Physical storage is allocated only when the host requires it

o Provisioning decisions not bound by currently available storage

o Above and beyond Thin Provisioning

o Includes management tools that make it easier to configure, use, monitor and manage Thin Pools and Thin LUNs

Host Reported Capacity Allocated Allocated Allocated

Shared Storage Pool

Storage perceived by the application is larger than physically allocated storage

2009 EMC Corporation. All rights reserved.

Traditional Provisioning vs. Virtual Provisioning

1650 GB Or 1.65 TB Available Capacity

350 GB Actual Data

LUN 1

LUN 2

LUN 3

Storage System

Traditional Provisioning
2009 EMC Corporation. All rights reserved.

Virtual Provisioning

Virtual Provisioning Benefits

o Reduce administrative costs
o Simplifies storage provisioning o Over-provisioning can eliminate challenges of expansion o Reduces time required to repeatedly add storage capacity

o Reduce storage costs

o o o o o Increased space efficiency for primary storage and replicas Storage on demand from shared storage pool Deploy assets as needed Reduce levels of unused physical storage Avoid pre-allocating physical storage to applications

o Reduce operating costs

o Fewer disks consume less power, cooling and floor space

o Reduce downtime
o Less disruptive to applications
2009 EMC Corporation. All rights reserved.

Virtual Provisioning Thin Pool Expansion

o Adding drives to the pool non-disruptively increases available shared capacity for all Thin LUNs in pool
o Drives can be added to a Thin Pool while pool is being used in production

o Allocated capacity is reclaimed by the pool when Thin LUNs are deleted
Test & Dev Pool 2

Additional Disk Drives

2009 EMC Corporation. All rights reserved.

Traditional vs. Thin LUNs

Use RAID Groups and traditional LUNs o When microseconds of performance matters o For the best and most predictable performance o For precise data placement o You are not as concerned about space efficiency Use Virtual Provisioning with Thin Pools and Thin LUNs o When the best space efficiency is needed o For minimal host impact o When energy and capital savings are paramount o For applications where space consumption is difficult to forecast

2009 EMC Corporation. All rights reserved.

Lesson Summary
Key points covered in this module: o Virtual Provisioning

o Thin vs. Traditional LUNs

o Benefits of Virtual Provisioning

2009 EMC Corporation. All rights reserved.

Chapter Summary
Key points covered in this chapter: o Virtualization technologies and forms

o SNIA storage virtualization taxonomy

o Storage virtualization configuration o Storage virtualization challenges o Types of storage virtualization o Virtual provisioning overview

2009 EMC Corporation. All rights reserved.

Cloud Storage Infrastructure

EMC Proven Professional

The #1 Certification Program in the information storage and management industry

2009 EMC Corporation. All rights reserved.

Challenges with Traditional Storage Approach

o Not designed to scale in the multi-petabyte
o Addition of new arrays for capacity enhancement
o Cost and management overhead o Increased time to market

o Can address transactional and distributed computing

o But fell short for Internet Era requirements o Designed for Operation Within ITs Walls

2009 EMC Corporation. All rights reserved.

Cloud Storage Infrastructure: The Big Picture

o To deal with Internet Era data growth
o A massively scalable infrastructure is required o One that offers global data distribution, self-healing, self-management, and multi-tenancy features

o A Cloud approach to storage

o A cost effective approach to handling Internet Era data growth

o Focusing on five key infrastructure requirements

o Infinite Scale o No Boundaries o Operationally Efficient o Self-Management o Self-Healing

2009 EMC Corporation. All rights reserved.

Use of Cloud Computing Resources

o Cloud computing takes hold as 69% of all Internet users have either stored data online or used a web-based software application

Source: Use of Cloud Computing Applications and Services, Pew Internet & American Life Project, 9/12/2008
2009 EMC Corporation. All rights reserved.

Defining Cloud Computing

Cloud Computing is an emerging IT development, deployment and delivery model, enabling real-time delivery of products, services and solutions over the Internet (i.e. enabling cloud services)

o Services include
o Software-as-a-Service (SaaS) o Storage-as-a-Service (Staas) o Computing-as-a-Service (CaaS) o Platform-as-a-Service (PaaS) / Infrastructure-as-a-Service (IaaS)

o Examples:
o Amazon: Elastic Compute Cloud (EC2), Simple Storage Services (S3)

o Storage Cloud Dropbox, Google Drive, SugarSync, Skydrive, Box.net, SpiderOak, iDrive, Ubuntu One, etc
o Google Apps o Salesforce.com provide CRM (customer relationship management) product
2009 EMC Corporation. All rights reserved.

Cloud Services:
o In cloud execution
o Offsite, provided by third-party

o Pricing
o Fine-grained & usage-based pricing capability

o Accessed via Internet

o Not bound to corporate/private network

o Similar to other utilities such as electricity and water

o Minimal/no IT skills to implement

o Users need not have expertise

o User Interface
o Simple, not tied to any specific device/platform

o Provisioning
o Self-requesting

o System Interface
o Web based standard framework

o Shared resources
o Shared asset approach

2009 EMC Corporation. All rights reserved.

Cloud Applications
o Enterprise Solutions
o Transactional data or high performance file sharing applications
o Example: Amazon EC2

o Cloud storage infrastructure

o Example: EMC Atmos

o End-user Solutions
o Rich Internet applications and online service providers
o Examples: Social media sites, Online photo sharing

o Online data backup

o Example: iDrive
Additional Task Research on Cloud Storage & EMC Atmos
2009 EMC Corporation. All rights reserved.

#1 IT company

For more information visit

2009 EMC Corporation. All rights reserved.

http://education.EMC.com