Virtualization For Data Centers of Today Tomorrow

Virtualization for Data Centers of Today & Tomorrow
Jim Rymarczyk IBM Fellow, Chief Virtualization Technologist rymar@us.ibm.com
August 2008
2008 IBM Corporation
IT Complexity the need for IT transformation
Virtualization for Data Centers of Today & Tomorrow - August 2008
Drivers of Data Center Transformation Multiple forces are driving a transformation of the data center
Operational issues have IT at a breaking point
New Enterprise Data Center
Accelerated pace of technology innovations
Costs & Service Delivery

Rising costs of systems & networking operations Explosion in volume of data and information Difficulty in deploying new applications & services
Technology Advances
Service-oriented architecture End-to-end service mgmt Comprehensive virtualization Converged networks Flash storage IT appliances Ensembles & mgmt. integration Many cores & threads per chip Low-cost high-BW fiber optics Petaflop supercomputers Cloud computing services Real-time data streams
Business Resilience & Security

Growing systems & applications availability needs Security of your assets & your clients information Landslide of compliance requirements
Energy Requirements
Rising energy costs & rising energy demand Power & thermal issues inhibit operations Environmental compliance & governance mandates
The IT Infrastructure Complexity and Cost Problem

Business processes as services
Topologies of federated services must be mapped onto large numbers of diverse physical and virtual resources
Sea of heterogeneous servers, storage, networks and their virtualization
Businesses spend a large fraction of their IT budgets on data center resource management rather than on valuable applications and business processes
Enterprises report that IT operational overhead = 70% of their IT budget and growing . . . leaving precious few resources for new initiatives.
Forrester, 2007
Virtualization for Data Centers of Today & Tomorrow - August 2008 2008 IBM Corporation
Todays Enterprise Application Complexity

Ma inframe apps - B lue PC/NT apps - G reen Unix apps - Y ellow 3rd party interface - Orange Lines: Colors have no special meaning.
They are to help make the diagram easier to read. For More Information: See the database containing information about each Application V4.mdb application: Vendor Setup Vendor Maintenance Printer Maintenance Printer PO S01 - Sales Corrections Print Costing Broadcast Filter General Maintenance Invoice App E13 E3 Interface Fringe PO
Application Diagram V4
Process Servers (Imaging)
Mesa Data
Page 1 of 2
Depository Banks Sterling VAN Mailbox (Value) I13- Auto Replenishment UAR - Universal Account Reconcilliation I17 Customer Perceived In-Stock
Budget Analysis Tool
S20-Sales Polling
NEW Soundscan NPD Group AIG Warranty Guard
Roadshow
AIS Reports AIS Calendar Due Dates Stores & Mrkts Smart Plus Smart Plus Launcher P16 - Tally Sheet M02 - Millennium M03 - Millennuim 3.0
Insertions Orders
I06 - Customer Order
I15 Hand Scan Apps
I06 Warehouse Management
S04 - Sales Posting S07 - Cell Phones I03 Return to Vendor
D01 Post Load Billing
S06 - Credit App
Equifax Stock Options L02-Resource Scheduling (Campbell) P15 EES Employee Change Notice I12 Entertainment Software A04 - Cust Refund Chks E01-EDI
1
S09 - Digital Satellite System
L01-Promo Analysis
P14 On-line New Hire Entry Resumix P01Employee Masterfile P09 - P17 Cyborg CTS ACH Prodigy Banks - ACH and Pos to Pay Plan Administrators (401K, PCS, Life, Unicare, Solomon Smith Barney) E02-Employee Purchase Scorecard - HR V03- Mkt Reactions P09 Bonus/HR S03-Polling V01-Price Management System Intercept S08 - Vertex Sales Tax POS Frick Co V04-Sign System
AAS
V02-Price Marketing Support
Washington, RGIS, Ntl Bus Systems
Cobra
CTO2.Bestbuy. com
I04 Home Deliveries
I10 Cycle Physical Inventory
S11 - ISP Tracking
U18 - CTO I02 Transfers X92-X96 Host to AS400 Communication
Spec Source SKU Tracking NPD, SoundScan Spec Source
B01 - Stock Status I09 Cycle Counts S02 Layaways
I11 Price Testing
Supplier Compliance
I01 PO Receiving L60 MDF Coop
SKU Performance
I05 Inventory Info
SKU Selection Tool
I35 - CEI ASIS Rebate Transfer Store Monitor I18 SKU Rep I55 SKU Information ELT PowerSuite G02 - General Ledger Sign System NARM
K02 Customer Repair Tracking
I35 Early Warning System
Arthur Planning
I07 Purchase Order
Ad Expense
Store Scorecard
Texlon 3.5
I14 Count Corrections Valley Media
Store Budget Reporting
U16-Texlon
CopyWriter's Workspace
B02 Merchandise Analysis EDI Coordinator
BMP - Bus performance Mngt
Merch Mngr Approval Batch Forcasting Ad Measurement AIMS Admin
AIMS
A05 - AP
Journal Entry Tool Kit
Ad Launcher
AIMS Reporting
Cellular Rollover S05 - House Charges Optika C02 - Capital Projects US Bank Recon File Connect 3 SiteSeer Connect 3 PDF Transfe Connect 3 Reports Cash Receipts/Credit ICMS Credit
INVENTORY CONTROL APPS - PC OTHER APPS - PC AP - Collections/Credit TM - Credit Card DB Code Alarm Debit Receivings Devo Sales Display Inventory In Home Junkouts Merchandise Withdrawl Promo Credits RTV Accrual Shrink AP Research - Inv Cntrl AP Research-Addl Rpts Book to Perpetual Inventory Close Out Reporting Computer Intelligence Data Count Corrections Cross Ref for VCB Dnlds Damage Write Off Debit Receivings DFI Vendor Database Display Inventory Reconcil Display Inventory Reporting
INVENTORY CONTROL APPS - PC DPI/CPI IC Batching Inventory Adj/Count Correct Inventory Control Reports Inventory Levels Inventory Roll Merchandise Withdrawl Open Receivings PI Count Results PI Time Results from Inv Price Protection Sales Flash Reporting Shrink Reporting SKU Gross Margin SKU Shrink Level Detail USM VCB Downloads
ACCTS REC APPS - PC 990COR Bad Debt Benefical Fees Beneficial Reconcil JEAXF JEBFA JEBKA JEDVA JESOA JEVSA JEVSF NSF TeleCredit Fees
PSP
Data Warehouse (Interfaces to and from the Data Warehouse are not displayed on this diagram)
In-Home Repair F06 - Fixed Assets Star Repair
Warranty Billing System
Cash Over/ Short
Misc Accounting/Finance Apps - PC/NT COBA (Corp office Budget Assistant) PCBS(Profit Center Budget System) Merchandising Budget
Prepared by Michelle Mills
Source: IBM client engagement experience
Not shown: physical and virtual resources used

Basic Forces Will Drive Increases In IT Complexity

The numbers of systems deployed will continue to grow rapidly, driven largely by: New applications (Web-based apps, surveillance, operational asset mgmt., etc.) Improving hardware price/performance The diversity of IT products will increase as competing suppliers continue to introduce new applications, systems, and management software products Todays innovations become tomorrows legacy The coupling of IT components is extensive and increasing, driven by application tiering, advances in high-performance standard networks, The virtualization of resources will affect existing IT processes and can lead to virtual server sprawl Introducing virtualization can have significant hidden costs, and requires considerable skills, planning, and discipline
Virtualization its current and expanding IT role
Virtualization Functions and Benefits

Virtual Resources Virtual Resources
Sharing
Resources
Aggregation
Resources
Examples: LPARs, VMs, virtual disks, VLANs Benefits: Resource utilization, workload manageability, flexibility, isolation
Resource Type Y
Examples: Virtual disks, IP routing to clones Benefits: Management simplification, investment protection, scalability
Virtual Resources
Virtual Resources
Emulation
Resource Type X
Insulation
Resources
Add, Replace, or Change
Resources
Examples: Arch. emulators, iSCSI, virtual tape Benefits: Compatibility, software investment protection, interoperability, flexibility
Examples: Spare CPU subst., CUoD, SAN-VC Benefits: Continuous availability, flexibility, software investment protection
Server Virtualization Hierarchy

Virtual Resources System Stack
Applications Virtual runtimes (application containers)
Implementation Methods
Middleware provides JVM, J2EE, or CLR application containers Multiple middleware instances act as one OS creates virtual OS environment per app. Each container has its own name space, files, root, Hypervisors HW partitioning Virtual I/O Servers Self-virtualizing I/O adapters In-memory VLANs
Examples
WebSphere VE Microsoft and Sun JVMs BEA Liquid VM z/OS Address Spaces AIX 6.1 WPARs Solaris Containers HP-UX Syst. Res. Part. MS SoftGrid zSeries PR/SM and z/VM Power Hypervisor HP vPars, Integrity VM Sun Logical Domains VMware, MS Hyper-V, Xen, KVM, Virtual Iron,
Middleware Virtual operating systems (application containers)
Operating Systems
Hardware
Virtual servers (virtual machines / LPARs) Virtual I/O Virtual networks Virtual devices (CPUs, memory, I/O adapters, )
There are three levels in the system stack at which virtualization is often done: (1) hardware virtualization, (2) OS virtualization, and (3) middleware virtualization Concurrent use of virtualization at these levels requires coordinated management
Virtualized IT Envisioned Benefits

Future Virtualized IT IT Without Virtualization
Web Servers App Servers App/DB Servers
Virtual Environment
Virtual resources are easier to deploy, grow, move, Virtual resources, configurations, and workloads are decoupled and insulated from physical environment
Virtual Virtual Virtual Application Application Application Server Server Server
End Users App Servers
App Servers App/DB Server
Virtual Clients
Virtual Servers
Virtual Storage
Virtual Networks
Virtualization
IT Resources for a Medium Business
Decouples Virtual and Physical Environments
Rigid configurations Fixed resources per server Low server utilization Wasted energy and floor space HW changes impact SW assets Servers managed individually
Physical Environment
Physical resource changes can be made without impact to running IT workloads Improved HW utilization and energy efficiency
Network Hardware
Blades
SMP Servers
Storage Servers and Storage
Virtualization technologies with emerging management software will significantly improve the efficiency, resiliency, responsiveness, and greenness of IT data centers.
Expanding IT Role Of Virtualization

A new IT era is dawning in which virtualization will provide major new IT benefits
The industry is investing to make this happen and it will unfold over the next 3-5 years The resulting high value to customers will render non-virtualized IT obsolescent
Future: Virtual IT Configurations
Virtual Systems
Virtual Web Virtual Web Server Web Server Server Virtual App App App Server Server Server
Virtual LANs
Virtual Database Database Server Server
Virtual Disks
Virtual resources are fully self-describing objects Adjustable dynamically Movable while active Durable over HW generations Storable and versionable in shared libraries Distributable as appliances Pools of physical systems are manageable as one system
Emerging Benefits: Better SW investment protection Simplified HA\DR/PD solutions Improved resource optimization Ready-to-run packaged software
Emerging: Multi-System Virtualization Mgmt. Software Maturing: Physical Systems with Local Virtualization
Virtual Servers Virtual Storage Virtual Networks
Provides virtual resource mgmt. and virtualization-based solutions spanning physical resource pools
V
SMP Servers
V
Blades
V
Storage Servers and Storage
V
Network Hardware
Todays Benefits: Better hardware utilization Improved IT agility Lower power consumption
Stages of IT Infrastructure Transformation

Strategic Imperatives
Evolve data centers from ad-hoc to well-architected Better manage the IT complexity end-to-end service mgmt Reduce the IT complexity to be managed via ensembles Virtualization has major benefits but introduces more complexity Abstraction and Pooling
Virtual Resource Objects
(Servers, Storage, Networks)
Integration and Simplification

New Enterprise Data Center
Service Mgmt. Green IT
Ensemble
Ensemble Ensemble
SOA TVDC Cloud Computing
Physical Consolidation
Local Virtualization Windows Server Multi-System Virtualization Resilience
V V
Mainframe or Unix Server
V
Servers
Resource Pools
V
Storage
V
Networks
V
Networks
Reduced scale-out complexity Integrated autonomic mgmt Dynamic energy optimization Business resilience foundation
V V
Linux Server Storage
Better SW investment protection Simplified HA solutions Improved resource optimization Ready-to-run packaged software
Continuing Advances
Better hardware utilization Improved IT agility Lower power consumption
Continuing Advances (I/O, network, resilience, performance, )
Applying Simplification First Principles to IT

Virtualize as many resources as possible Allows the elimination of dependencies between virtual and physical resources Modularize the data center decouple resources and management roles by type Decouple servers, storage, and network controllers Decouple server management from storage management Decouple data management from physical storage management Provide compatibility across families and generations of hardware resources Enable virtual resources to function unchanged despite changes to underlying hardware Group physical resources into pools of like types Provide virtual resource mobility within these pools Make groups of resources look like single resources to users and resource managers Hide their internal design complexities and their parallelism Provide a single system management image per pool Apply the first principles to the management software itself Decouple management of virtual resources from management of physical resources Use hierarchy of management software
Key Complementary Methods for IT Simplification

1
Service oriented architecture technologies frame business processes as services,

facilitating deployment, composition, reuse, modular change, agility, efficiency,
Business Processes as Services
Service management software spans the diversity of heterogeneous physical and virtual
2 resources, providing unified cross-platform management in support of SOA Services registry, service life cycle mgmt., image libraries, multi-tier composition, provisioning, autonomic optimization, network services, security services,
Sea of Heterogeneous Servers, Storage, Networks and Their Virtualization
Ensemble
Ensemble
E E
Ensembles and scalable servers replace multitudes of individual servers An ensemble is a pool of like systems that is manageable as a single system
3 It integrates compatible networked systems, virtualization, and management functions It scales from few to many servers, while having management complexity and cost like that of a single system essentially independent of the ensemble size
Ensembles a new integrated systems approach
Ensemble Components
Server Ensemble Example
Workload Mobility OS OS OS OS OS OS
Hypervisor Server Ensemble Manager
Hypervisor Server
Ensemble definition: a pool of like systems that is manageable as a single system
An Ensemble generally consists of the following components:

A pool of compatible system nodes (e.g., N physical servers; need not be homogeneous) Virtual resource mobility within an ensemble and with compatible ensembles The networks which interconnect the ensemble nodes (may be local / optimized) Resource virtualizers (hypervisors, I/O virtualizers, storage virtualizers, ) An ensemble manager appliance that provides platform management for the ensemble virtual and physical resources Tools for planning, ensemble creation, P2V migration, image mgmt. & composition, Ensemble-local automated optimization software of performance, availability, energy usage, security, with intelligent defaults Multi-system services (locking, caching, message queuing, ) may be integrated with some ensembles
The Benefits of Server Ensembles

Individual Servers
OS OS OS OS OS OS OS OS
Server Ensemble
Workload Mobility OS OS OS OS
Hypervisor Server
Hypervisor Server
Hypervisor Server
Ensemble Manager
Hypervisor Server
# of Things to Manage Create, Test, and Maintain Management Automation Management Interfaces # of Consoles Data Center Mgmt. Arch.
N virtual servers; M physical servers Do it yourself; few assemblies are alike Add-on software, custom scripts, Many individual knobs and variables Separate consoles for physical & virtual Monolithic; spans d. c. heterogeneity
N virtual servers; one physical ensemble Standard off the shelf assemblies Built-in optimizations; intelligent defaults Menus of selectable standard behaviors Single console; in-context functionality Hierarchical; pool-level modularity
Ensembles will significantly reduce IT resource management complexity and cost, and improve IT functionality, in consumable data center increments
Cloud Computing the next phase of Internet-based sharing
What Is Cloud Computing?

Cloud computing is an emerging style of computing in which applications and data are provided as services to users over the Web. The services provided can be available globally, always on, low in cost, on demand, massively scalable, pay as you grow, Consumers of the services need only care about what the service does for them, not how it is implemented
Datacenter Infrastructure
Monitor & Manage Resources
Service Consumers
Access Services
Cloud Administrator
IT Cloud
Component Library
Component Vendors / Software Publishers
Examples: Amazon Elastic Compute Cloud EC2 IBM Research Compute Cloud RC2
Publish & Update Components
Evolution of Sharing on the Internet

Services Sharing Cloud Computing
Everything as a service over the Web: SaaS, utility computing, IT services, Ubiquitous and always available
Resource Sharing
Grid Computing
Standards and software for sharing of remote resources and collaboration Mainly used for highly scalable HPC jobs
Information Sharing
The World Wide Web

HTML page format, HTTP protocol, and Mosaic browser for document exchange Initially in universities; worldwide adoption
Network Sharing
Inter-Networking and the Internet

Inter-Networking of regional networks with TCP/IP Began to replace regional alternatives Worldwide adoption
Networking
Networks
Multiple regional networks linking computers Initially at universities and national labs
The Grid
Cloud Computing Examples
Amazon EC2, S3 Xen / SLES based; 3 basic virtual machine sizes; various applications and application build tools Google Proprietary; virtualization in OS image IBM / Google / Hadoop Cloud Google Map/Reduce application on different infrastructure IBM Research Compute Cloud (RC2) Self-service, Web-based cloud for computer science research Includes System p and System x resources University of North Carolina, Virtual Compute Lab Xen / Linux based; used for teaching and computer science research
The IBM HiPODS Team Building Clouds Today
Research Computing Cloud RC2 - Overview
A living lab to advance research strategies Provides self service on demand delivery solution for research computing resources Integrates existing assets and products using SOA Leverages Tivoli products Zero touch support for the full life cycle of service delivery
Order creation Approval process E-mail notification Automated provisioning Monitoring
RC2
SelfService Portal
Business Process Workflow Application
Business Process Workflow Mgmt

Capacity Mgmt Provisioning & Orchestration Monitoring Metering & Rating
Virtualized Infrastructure
Summary
Summary
IT data center complexity and costs are continuing to increase and have already reached a crisis level A breakthrough in data center architecture and management is needed Virtualization will become pervasive and play a vital role in enabling the required data center transformations Today it improves hardware utilization, energy efficiency, and agility but it impacts most IT processes and introduces new complexities / costs Going forward, virtualization will be used to reduce management costs, modularize data center architecture, and facilitate ongoing improvement Integration will be key to achieving IT simplification Server, storage, and network ensembles will be used as pre-built scalable modular data center building blocks Cloud Computing will become widely used for IT services delivery globally across the Web and locally within enterprise data centers It will yield a range of attractive Web-based services platforms
IBMs Vision: The New Enterprise Data Center
An evolutionary new model for efficient IT delivery
New economics: Virtualization with optimized systems and networks to break the lock between IT resources and business services Rapid service delivery: Service management enables visibility, control and automation to deliver quality service at any scale Aligned with business goals: Real-time integration of transactions, information and analytics and delivery of IT as a service
New Enterprise Data Center Stages of Adoption
Management
Physical consolidation and optimization Business Virtualization of Resiliency individual systems / Security Systems, network and Service energy management
Green
Highly virtualized resource pools (ensembles) Integrated IT service management Green by design
Virtualization of IT service Business-driven service management Service-oriented delivery of IT
The end.
Thank you!
Any questions or thoughts?
THANK YOU

Virtualization For Data Centers of Today Tomorrow

Enviado por

Dados do documento

Descrição original:

Título original

Direitos autorais

Formatos disponíveis

Compartilhar este documento

Compartilhar ou incorporar documento

Opções de compartilhamento

Você considera este documento útil?

Este conteúdo é inapropriado?

Direitos autorais:

Formatos disponíveis

Virtualization For Data Centers of Today Tomorrow

Enviado por

Direitos autorais:

Formatos disponíveis

Virtualization for Data Centers of Today & Tomorrow

Jim Rymarczyk IBM Fellow, Chief Virtualization Technologist rymar@us.ibm.com

2008 IBM Corporation

IT Complexity the need for IT transformation