OPENSTACK FOR VSPECIALISTS

MODULE 1: OPENSTACK OVERVIEW

EMC CONFIDENTIAL—INTERNAL USE ONLY 1

MODULE 1: OPENSTACK OVERVIEW

Upon completion of this module, you should be able

to:
• Define OpenStack
– What it wants to be, what it is, what it isn’t
• List key projects within the OpenStack ecosystem
• Illustrate the OpenStack (m)Architecture
• Understand EMC OpenStack strategy and initiatives

EMC CONFIDENTIAL—INTERNAL USE ONLY 2

WHAT IS OPENSTACK?

What does it mean?

EMC CONFIDENTIAL—INTERNAL USE ONLY 3

NIST DEFINITIONS: CLOUD ESSENTIALS
• On-demand self-service
– A customer can provision computing resources (e.g. processing, storage, network)
without human interaction

• Broad network access

– Capabilities accessible over network and standard mechanisms

• Resource pooling
– Computing resources are pooled to serve multiple consumers in a multi-tenant model
– Customer has no control or knowledge of exact location of resources

• Rapid elasticity
– Capabilities can be rapidly provisioned and released; capabilities can appear to be
unlimited

• Measured service
– Control and optimize resource use by leveraging a metering capability
EMC CONFIDENTIAL—INTERNAL USE ONLY 4
NIST DEFINITIONS: SERVICE MODELS
• Software as a Service
– Consumer uses provider’s applications via thin client or API
– Consumer manages application configuration settings
– Customer cannot manage application or underlying cloud infrastructure

• Platform as a Service
– Consumer deploys applications into a hosting environment
– Customer manages applications and any hosting configuration settings
– Consumer cannot manage underlying infrastructure (e.g. network,
servers, OS, storage)

• Infrastructure as a Service
– Consumer provisions computing resources (processing, storage, networks)
– Customer manages applications, OS, storage, and local networking
– Customer cannot manage underlying cloud infrastructure
EMC CONFIDENTIAL—INTERNAL USE ONLY 5
NIST DEFS: DEPLOYMENT MODELS
• Private cloud / Community cloud
– Provisioned for single organization or consortium
– Operated on or off prem by organization and/or provider
• Public cloud
– Provisioned for use by general public
– Operated on premises of cloud provider
• Hybrid cloud
– Composition of two or more distinct cloud infrastructures
– Bound together by some sort of technology for data and workload
portability

EMC CONFIDENTIAL—INTERNAL USE ONLY 6

 PUTTING IT TOGETHER: THE SPI MODEL
Abstraction

• IaaS is enabler for both PaaS

SaaS and SaaS
Software applications with user
configuration
• Trade off flexibility for higher-
level services and support as
PaaS abstraction level increases
Access to deploy and manage
application stacks with defined tools • More control entails more
responsibility for operations
IaaS
and management
Access to manage virtual or physical
infrastructure for arbitrary purposes

Public Hybrid Private

Client control and governance
Client responsibility
EMC CONFIDENTIAL—INTERNAL USE ONLY 7
OPENSTACK PROJECT MISSION
"To produce the ubiquitous Open Source Cloud Computing
platform that will meet the needs of public and private cloud
providers regardless of size, by being simple to implement
and massively scalable.

OpenStack is open source, openly designed, openly developed,

by an open community.”

Code Community
EMC CONFIDENTIAL—INTERNAL USE ONLY 8
THE OPENSTACK WAY (FOUR OPENS)
Open Open
Source Design
Apache OpenStack is not “open Design is pursued in OpenStack
core” software. Truly public mailing lists, IRC
2.0 license open source software is channels, and semi- Launchpad
not feature or annual summits. Code
performance limited. reviews and blueprints
are all publicly available.

Open Open
Development Community
OpenStack All project source code All processes are Ask
Repos repositories are public documented, open and OpenStack
and available during the transparent. Contributors
entire development elect technical leadership
process. (PTL’s, Technical
Committee members).

EMC CONFIDENTIAL—INTERNAL USE ONLY 9

OPENSTACK: THE PROMISE
• Diversity of opinions and wants, but
a few themes keep coming up
 OpenStack project ideally functions
as a technical meritocracy
 Delivers community-driven
technology for the next wave of IT
 The next wave of IT is the next
wave of software-driven civilization
 OpenStack as the alternative to
closed enterprise (VMware) and
public (AWS) vendors

EMC CONFIDENTIAL—INTERNAL USE ONLY 10

ONE PART OF A MARKET PATTERN

July, 2010 October, 2010 April, 2011

NASA, Rackspace Intel Facebook

September, 2014
April, 2013 / Linux Foundation Linux Foundation
EMC CONFIDENTIAL—INTERNAL USE ONLY 11
OPENSTACK IS GAINING MINDSHARE

Source: 451 Research Market Monitor: OpenStack (Q1 2015)

EMC CONFIDENTIAL—INTERNAL USE ONLY 12
OPENSTACK REVENUES GROWING

Source: 451 Research OpenStack Market Monitor, Q1 2015.

EMC CONFIDENTIAL—INTERNAL USE ONLY 13
 OPENSTACK BUSINESS DRIVERS

ABILITY TO OPEN
INNOVATE PLATFORM
AND WITH
COMPETE CHOICES

OPERATION COST
AL SAVINGS
EFFICIENCY
Source: OpenStack User Survey, October 2015

EMC CONFIDENTIAL—INTERNAL USE ONLY 14

OPENSTACK PARTICIPATION

Source: State of the Stack v4, May 2015

EMC CONFIDENTIAL—INTERNAL USE ONLY 15
PUBLIC REFERENCES FOR OPENSTACK

References taken from openstack.org/user-stories

EMC CONFIDENTIAL—INTERNAL USE ONLY 16
WHAT IS OPENSTACK? IAAS++

Source: OpenStack.org
Liberty core services demo
EMC CONFIDENTIAL—INTERNAL USE ONLY 17
OPENSTACK ENABLES TRANSFORMATION
PaaS

Lends itself nicely to User Portal Dev-Ops

3rd Platform Apps Application Fabric New
Roles

Developer Friendly Data Fabric Service API provide

Catalog capability to
New Apps Orchestrate
Services For
Policy Agile, Cost
Engine
Effective
SOFTWARE DEFINED DC Operations.
TRANSFORMATION Orchestration
Agile
Processes
Cloud Software Engine Need new skill
Platform a
sets and roles
foundation for
SDDC Metering
enablement Engine

EMC CONFIDENTIAL—INTERNAL USE ONLY 18

OPENSTACK PROJECT ORIGINS
• Initiated through code contributions
from NASA and Rackspace in
July,2010
• First release (Austin) in October,
2010
Nebula (compute) -> OpenStack Nova
• Ubuntu Linux 11.04 distribution
includes second release (Bexar) in
April, 2011
• Project managed by Rackspace until
transfer to independent foundation in
September, 2012
Cloud Files (object) -> OpenStack Swift

EMC CONFIDENTIAL—INTERNAL USE ONLY 19

 OPENSTACK RELEASE HISTORY
Release name Release date Integrated projects (by codename)

Austin (PoC) Oct 21, 2010 Nova, Swift

Bexar (PoC) Feb 3, 2011 Nova, Glance, Swift

Cactus (PoC) April 15, 2011 Nova, Glance, Swift

Diablo Sept 22, 2011 Nova, Glance, Swift

Essex April 5, 2012 Nova, Glance, Swift, Horizon, Keystone

Folsom Sept 27, 2012 Nova, Glance, Swift, Horizon, Keystone, Quantum, Cinder

Grizzly April 4, 2013 Nova, Glance, Swift, Horizon, Keystone, Quantum, Cinder

Havana Oct 17, 2013 Nova, Glance, Swift, Horizon, Keystone, Neutron, Cinder, Heat, Ceilometer

Icehouse April 17, 2014 Nova, Glance, Swift, Horizon, Keystone, Neutron, Cinder, Heat, Ceilometer, Trove

Juno Oct 16, 2014 Nova, Glance, Swift, Horizon, Keystone, Neutron, Cinder, Heat, Ceilometer, Trove,
Sahara
Kilo April 30, 2015 Nova, Glance, Swift, Horizon, Keystone, Neutron, Cinder, Heat, Ceilometer, Trove,
Sahara, Ironic, Zaqar, Manila, Designate, Barbican, Congress, Magnum, Murano,
Mistral,…
Source: State ofOctober
Liberty the Stack v4, May 2015
16, 2015 Nova, Glance, Swift, Horizon, Keystone, Neutron, Cinder, Heat, Ceilometer, Trove,
Sahara, Ironic, Zaqar, Manila, Designate, Barbican, Congress, Magnum, Murano,
EMC CONFIDENTIAL—INTERNAL USE ONLY 20
OPENSTACK LIBERTY STATISTICS
• 6,000+ Attendees at
Vancouver summit for
Liberty planning in May,
2015
• 20+ ‘OpenStack’ Projects
• 1,933 developers
• 164 organizations
• 24,758 commits
Source: https://www.openstack.org/software/liberty/
EMC CONFIDENTIAL—INTERNAL USE ONLY 21
 OPENSTACK KILO (m)ARCHITECTURE
User/Admin
UI CLI
(Horizon) (python-*client)

Data Advanced Services (Consume IaaS) Database

Processing Management
(Sahara) (Trove)
Cloud Management
Key Message
Management Queue
(Barbican)
Telemetry Infrastructure as a Service Orchestration
(Ceilometer) (HEAT) (Zaqar)
Network
DNS Compute (Neutron Storage Service
Management (Nova) ) (Swift)(Ci Catalog
(Designate) Deployment (Ironic) (LBaaS) nder) Test Suites (Murano)
(Magnum
(Triple O) (Magnum) (VPNaaS) (Manila) (Tempest)
)
Policy (FWaaS) (Rally)
(Rally) Workflow
Management Management
Image Management
(Congress) (Mistral)
(Glance)
Message Queue / Database(s)

Common/Shared Identity (Keystone) Common Library (Oslo)

Legend: Integrated prior to Kilo Official in Kilo

EMC CONFIDENTIAL—INTERNAL USE ONLY 23

 Integrated prior to Kilo

OPENSTACK IAAS Official in Kilo

Infrastructure as a Service Project Description

User/Admin
Horizon Operations and Administrative UI

UI CLI Nova Virtual Compute Management

(Horizon) (python-*client)
Ironic Bare Metal Management
API
(REST)
Magnum Container Management Services
Infrastructure as a Service
Neutron Network Connectivity Abstraction
Network includes separate projects for LB,
Compute (Neutron Storage VPN, and FW.
(Nova) ) (Swift)(Ci
(Ironic)
(Magnum (LBaaS) nder) Swift Object Store
(Magnum) (VPNaaS) (Manila)
)
(FWaaS) Cinder Persistent Block Services
Image Management
(Glance) Manila Shared File-Systems Service

Message Queue / Database(s)

Glance Image Management Services
Identity (Keystone)

Common Libraries (Oslo) Keystone Identity Management Services

EMC CONFIDENTIAL—INTERNAL USE ONLY 24

 Integrated prior to Kilo

OPENSTACK MANAGEMENT Official in Kilo

Cloud Management

Project Description
User/Admin
UI CLI Ceilometer Monitoring and metrics service
(Horizon) (python-*client)

Triple O OpenStack On OpenStack

eployment solution

HEAT Application orchestration engine

API
(REST)
Tempest Functionality tests
Cloud Management
Rally Benchmarking and scale tests
Telemetry Deployment
(Ceilometer) (Triple O)

IaaS

Orchestration Test Suites

(HEAT) (Tempest)
(Rally)

EMC CONFIDENTIAL—INTERNAL USE ONLY 25

 Integrated prior to Kilo

OPENSTACK EXTENDED Official in Kilo

Advanced Services (Consume IaaS)

User/Admin Project Description
UI CLI
(Horizon) (python-*client)
Sahara Elastic data processing service
API
(REST) Trove Database as a Service

Advanced Services Barbican Key management service

Data Databases Zaqar Messaging and notification services

Processing (Trove)
(Sahara) Designate DNS management service

Key Mgmt.
(Barbican) Cloud
Message
Queue
Murano Application catalog service
(Zaqar)
Congress Policy management/enforcement
IaaS
DNS
Management
Service
Catalog
Mistral Workflow management service
(Designate) (Murano)
Mgmt.
Policy Workflow
Management Management
(Congress) (Mistral)
EMC CONFIDENTIAL—INTERNAL USE ONLY 26
WHAT COULD BE MISSING?
• OpenStack is a project of projects, providing component
services, not a product -> open cloud toolkit
• Depending on service selection and deployment models,
OpenStack could power wide variety of clouds
• A number of critical areas are left as an exercise for the
deployer (but work is in progress…)
– Hardware design and selection
– Physical network design
– Service selection, configuration, and plugin profile
– HA and resiliency, system monitoring, patch and upgrade
management

EMC CONFIDENTIAL—INTERNAL USE ONLY 27

COMPLEXITY WITHOUT COMPLETENESS

• Interdependence between projects and project proliferation are driving complexity

• Complexity fuels ongoing debate on what is OpenStack

• Community starting to focus more on product management and interoperability

Diagram source: State of the Stack v4, May 2015
EMC CONFIDENTIAL—INTERNAL USE ONLY 28
WHAT IS OPENSTACK? COMMUNITY
• 18,000+ Individual
members, with open
enrollment as
Community or
Foundation member
with voting
responsibilities in
annual board elections
• Foundation marketing
focuses on community
building, e.g.
superuser magazine

EMC CONFIDENTIAL—INTERNAL USE ONLY 29

OPENSTACK BOARD OF DIRECTORS
• Foundation Board handles strategic
oversight of Foundation resources and staff,
including use of the OpenStack trademark
• Corporate sponsor members underwrite
Foundation budget and activities (sponsor,
Gold, Platinum)
• Annual Individual Director elections by
Individual Members
• Annual Gold Director elections by Gold
Member organizations

Source: OpenStack.org
EMC CONFIDENTIAL—INTERNAL USE ONLY 30
OPENSTACK TECHNICAL COMMITTEE
• Responsible for overall technical leadership
and enforcement of OpenStack ideals
• Controls which projects are considered
official OpenStack projects and resolves
cross-project issues
• Holds weekly public IRC meetings
• Half of seats elected by Active Technical
Contributors (ATCs) from all projects every
six months, for one-year terms
• Each OpenStack project led by Project
Technical Lead (PTL) elected by project ATCs
Source: OpenStack.org
every six months
EMC CONFIDENTIAL—INTERNAL USE ONLY 31
OPENSTACK USER COMMITTEE
• Formed to collect user requirements and
feed back to board, technical committee,
and project development teams
• Bylaws provide for three appointed
members (1 – TC, 1 – BoD, 1 – other
appointees), structure still developing
• Runs semi-annual user surveys to track
deployments and usage
• Works with user groups worldwide
• Oversees an increasing number of working
groups to focus on market segments and
Source: OpenStack.org
cross-project requirements
EMC CONFIDENTIAL—INTERNAL USE ONLY 32
 USER COMMITTEE WORKING GROUPS

Source: State of the Stack v4, May 2015

EMC CONFIDENTIAL—INTERNAL USE ONLY 33
CONTRIBUTING TO PROJECTS
• Open to Individual members of the
Foundation (requires accepting
Individual Contributor License
Agreement)
• Need account in Launchpad, local
git and Gerrit setup
• Bugfixes and patches subject to
peer review and test-driven gates
• New projects can be proposed by
workgroups via committing a
patch to the governance
repository
Source: docs.openstack.org
EMC CONFIDENTIAL—INTERNAL USE ONLY 34
HOW OPENSTACK WAS RELEASED
• Technical Committee has run a few years of Integrated Releases every six
months, which were the single answer to ‘What is OpenStack now’
• Projects were put through a graduation path to get into the Integrated Release
• By Juno, the Integrated Release was both too small to cover key programs and
too big to deploy and test centrally

Project Classification and Graduation Path

• Integrated
OpenStack
– Integration completed with other relevant integrated projects (Set by TC)
Repo
– Maturity (large and diverse team)
– QA, Process, Documentation, Support, Release Management, Security, etc.

OpenStack • Incubated
Repo Integrated – Stable API
– Documentation
– # of Developers, Commits
StackForge
– Agrees to governance by TC
Repo Incubated
– The four opens

EMC CONFIDENTIAL—INTERNAL USE ONLY • Project Launched 35

 NEW RELEASE MODEL: THE BIG TENT
• TC moved from Integrated Release to coordinated release point with opt-in by
the constituent projects
• Projects still need to comply with OpenStack mission, OpenStack way, TC
oversight, and basic interoperability -> new focus on interoperability testing
• Tagging system set up to support new model – tags provide information on
project release cycle, project type (service vs. library), e.g.
Tag Description
tc-approved-release Projects recommended by TC to Foundation Board as candidates for trademark use
starter-kit:compute Common starting point for compute cloud (Nova, Glance, Keystone, Neutron)
team:diverse-affiliation Marker of healthy diversity in affiliation of project contributors
assert:supports-upgrade One possible assertion by project team on capability: cold (offline) upgrades
release:cycle-with-milestones Traditional OpenStack release model on 6-month cycle, with milestone dates
release:indepedent Release independent of 6-month cycle, as with infrastructure support projects
type:service|library Classification for projects: service is user-facing service with REST API, or standalone tool
Source: http://governance.openstack.org/reference/tags
EMC CONFIDENTIAL—INTERNAL USE ONLY 36
UNCHANGED FOR NOW: DESIGN SUMMITS
• Every six months, OpenStack Foundation
convenes a dual summit for the community
• OpenStack Conference focuses on
customer use cases, technology updates,
operator topics, and vendor pitches
• OpenStack Design Summit convenes
working groups for project contributors to
iron out design decisions for next six-
month cycle
• Conference starts one day earlier than the
Design Summit, to allow contributors to
attend keynotes and initial sessions

Image Source: OpenStack Tokyo Summit

EMC CONFIDENTIAL—INTERNAL USE ONLY 37
OPENSTACK CLOUD MARKETPLACE
Distros & Appliances Integration & Consulting
OpenStack distributions, some with their Solutions to ease deployment of OpenStack
own value-added components

Training
Public Clouds Drivers OpenStack courses, ‘certifications’ & labs
OpenStack-powered IaaS Infra. drivers included in OpenStack releases

EMC CONFIDENTIAL—INTERNAL USE ONLY 38

HARDWARE COMMUNITY
X86 Server Vendors

TOP 3 VENDORS IN EACH CATEGORY SUPPORT

OPENSTACK

Router Vendors Blade Vendors Linux Vendors

Switch Vendors Storage Vendors Hypervisors

3
EMC CONFIDENTIAL—INTERNAL USE ONLY 39
NEW: APPLICATION MARKETPLACE

• Offering applications via Murano packages, Heat templates, and Glance images
• Beta at apps.openstack.org
EMC CONFIDENTIAL—INTERNAL USE ONLY 40
ANNOUNCED: OFFICIAL CERTIFICATIONS

• Foundation announced first official certification

• Working group developing criteria and testing, including two
participants from EMC
• Testing slated to commence Q2 2016, in conjunction with Austin
Summit for N-release
Source: https://www.openstack.org/coa
EMC CONFIDENTIAL—INTERNAL USE ONLY 41
HOW TO GET OPENSTACK
• Grab the code
– Set up DevStack (OpenStack community) or PackStack (RDO community)
in VM for an all-in-one cloud suitable for basic testing or development
– Use packages from Debian or Fedora
– Use packages from a commercial Linux vendor (e.g Ubuntu Cloud Archive)
– Build a CI system and grab code from GitHub to make your own packages

• Grab a distribution
– Get packages, extra plugins and bugfixes, deployment and management
frameworks, integrations, and security fixes
– Get enterprise-level support from the distribution vendor

• Use an appliance by some means

– Buy OpenStack in a converged form factor (box, rack)
– Obtain private cloud as a service
EMC CONFIDENTIAL—INTERNAL USE ONLY 42
HOW OPENSTACK IS OBTAINED

Source: OpenStack User Survey, October 2015

EMC CONFIDENTIAL—INTERNAL USE ONLY 43

OS CONTEXT FOR OPENSTACK

Ubuntu used
for 65% of
deployments
>1000 users

Source: OpenStack User Survey, October 2015

EMC CONFIDENTIAL—INTERNAL USE ONLY 44

 BIG TENT VS. CORE SERVICES

[1] List of “big tent” services : http://governance.openstack.org/reference/tags/type_service.html#tag-type-service

EMC CONFIDENTIAL—INTERNAL USE ONLY 45
NAVIGATING THE BIG TENT

Check projects
for:

• Maturity
• User adoption
• Project age
• Project
governance
• Contribution
history
• Top
contributors

Source: https://www.openstack.org/software/project-navigator/

EMC CONFIDENTIAL—INTERNAL USE ONLY 46

CORE SERVICES ≈ WHAT’S IN USE

Source: OpenStack User Survey, October 2015

EMC CONFIDENTIAL—INTERNAL USE ONLY 47

BIG TENT SERVICES EMERGING

Source: OpenStack User Survey, October 2015

EMC CONFIDENTIAL—INTERNAL USE ONLY 48

 FOR NOW: CORE SERVICES + A BIT

Cloud IAM
Formation Horizon

Heat dashboard Keystone

S3 AMI EC2 EBS vPC RDS

Swift Glance Nova Cinder Neutron Trove

object store image store compute node volume service networking database

Orchestration identity service

Celiometer telemetry service

• BOLD projects are in scope for this course

• All these projects communicate via public RESTful API’s
• Services can be seen as analogues to AWS services

EMC CONFIDENTIAL—INTERNAL USE ONLY 49

 STILL A LOT OF OPEN QUESTIONS

Cloud IAM
Formation Horizon

Heat dashboard Keystone

S3 AMI EC2 EBS vPC RDS

Swift
What Glance Nova Cinder Neutron Trove
Do I use What
type of What What HV What What Do I
this? identity
object back end and storage model & use
storage? provider
object store storage?
image store network?
compute node backends
volume service plugins?
networking this?
database
?
? identity service
Orchestration

What meters and

Celiometer telemetry service
deployment model?

• What services and service configurations are needed?

• What hardware and network architectures should we use for deployment?
• How will we solve for resiliency and high availability?

EMC CONFIDENTIAL—INTERNAL USE ONLY 50

INTERLUDE: EMC AND OPENSTACK

EMC CONFIDENTIAL—INTERNAL USE ONLY 51

OPENSTACK: THE HOPE

5
EMC CONFIDENTIAL—INTERNAL USE ONLY 52
OPENSTACK: THE REALITIES

OpenStack Framework OpenStack-powered Products

5
EMC CONFIDENTIAL—INTERNAL USE ONLY 53
SOME SCALE BEING ACHIEVED

How many compute

nodes?

How many cores?

How many users?

Source: OpenStack User Survey, October 2015 (test/QA and production only)

EMC CONFIDENTIAL—INTERNAL USE ONLY 54

STORAGE SCALE

How much
Swift?

How many objects?

How much Cinder?

Source: OpenStack User Survey, October 2015 (test/QA and production only)

EMC CONFIDENTIAL—INTERNAL USE ONLY 55

OPEN @ THE FEDERATION
• Capture 2nd and 3rd Platform Workloads

• Offering customers choice as to which

cloud platform/framework to place
workloads

• Choices allow customers to:

• Run traditional and enterprise class
workloads
• Webscale and cloud-native
applications
• Applications & Microservices that can
run in containers and bare metal
• Leverage Big Data and Real Time
Analytics

EMC CONFIDENTIAL—INTERNAL USE ONLY 56

WORKLOADS DRIVE INFRASTRUCTURE

EMC CONFIDENTIAL—INTERNAL USE ONLY 57

EMC STRATEGY: CUSTOMER CHOICE
WORKLOADS DRIVE SELECTION

Application Workloads

• Web Services
• QA/Test Environment
Platform 3.0
• Databases OpenStack Solutions
• Data Mining / Hadoop & Products @EMC
• Cloud Citizens
• HPC • Modernization VxRack FLEX
• CDN / Video Streaming • Rebuild/Replace Apps
• Storage / Backup
• Management and Monitoring
• Mobile Applications Suitability
• File Sharing Evaluation
• Enterprise Applications FEHC
Platform 2.5
• Legacy Applications VMware VIO
VxRack SDDC
• Enhance automation
• Rehost Application.
• Refactor: Minor code changes to
connect apps to new Infrastructure .
EMC CONFIDENTIAL—INTERNAL USE ONLY 58
WORKLOADS RUNNING ON OPENSTACK

Source: OpenStack User Survey, October 2015

EMC CONFIDENTIAL—INTERNAL USE ONLY 59

PAAS TOOL USAGE ON OPENSTACK

Source: OpenStack User Survey, October 2015

EMC CONFIDENTIAL—INTERNAL USE ONLY 60

SIDEBAR: OPEN SOURCE @ EMC
• Prominent memberships in multiple open-source foundations

PLATINUM SILVER PLATINUM

• Enabling community meet-ups and contributions through EMC CODE and Office
of the CTO
http://emccode.github.io/
Recent Meetups:
ContainerDays Boston
OpenStack Meetup: Boston
OpenStack Meetup: Austin

• Delivering/Leading open-source platforms to market based on EMC domain

expertise

http://coprhd.github.io/
EMC CONFIDENTIAL—INTERNAL USE ONLY 61
 OPENSTACK-RELATED ACQUISITIONS

• Founded in 2006
• Technology focused on improving economics and
• Originally a professional services company that provisioning efficiencies through hardware
worked primarily with large service/telecom discovery, monitoring tools, workflow engine,
providers and other software assets.

• Started deploying OpenStack powered solutions in • One of the team members was Project Technical
2011 Lead for Keystone

• Built their first OpenStack Product (OCS v1) in • Team has experience with OpenStack and brings
2012 which solved scheduling and networking HA development capabilities. The team ran
using vast amount of expertise gained through engineering for Nebula prior to starting Renasar
large-scale cloud deployments Technologies.

• Customers included Service Providers, Retailers, • EMC product contribution: RackHD ( aka
Software Firms, etc. OnRack)

• EMC product contribution: Neutrino (aka Caspian)

EMC CONFIDENTIAL—INTERNAL USE ONLY 62
 EMC OPENSTACK STRATEGY

Leadership
• Public cloud-like IaaS Move In
Project Caspian • Integrated OpenStack
(EMC Neutrino) Platform 3
• Converged
Infrastructure
Value

• Validated Designs
EMC OpenStack • Partner Tools Integration
Reference Architecture • Cooperative Support Enhance
Program • Professional Services Presence In
OpenStack
• Platform Integration Ecosystem
EMC OpenStack • Drivers and Core Features
Contribution • Working Group Participation
• Board of Directors

Time

EMC CONFIDENTIAL—INTERNAL USE ONLY 64

OPENSTACK COMMUNITY PARTICIPATION
• Working Group Participation
– Diversity, Enterprise, and Product
OpenStack Foundation • Resolved iSCSI-based Live Migration Bugs
Gold Member • Primary care-takers/creators of EC2 API
Support in Nova and also the creators of the
Randy Bias new EC2/VPC API (not merged yet)
OSF Board of Directors
• Contributed support for non-disruptive
Cinder backups and consistency group
OpenStack Project cloning in Liberty
Core Members • EMC Federation Code Contributions
– Top 10 Overall Contributors to OpenStack
Cinder – #10 in Commits for Liberty (VMware)
Manila
Barbican • Community Book Sprints
– OpenStack Architecture Guide
Drivers/Com Reference Engineered
– OpenStack: A Business Perspective
munity Architectures Solutions

EMC CONFIDENTIAL—INTERNAL USE ONLY 65

HISTORY OF FEDERATION CONTRIBUTION

• Changes focused • Contributions in • Contributions • Contributions • Contributions in • Contributions in Neutron • Contributions in Neutron (VMW)
on foundation of Neutron in Neutron in Neutron Neutron (VMW) (VMW) • SPBM Support in VC Driver (VMW)
Neutron (pre- (Incubation) (VMW) (VMW*) (VMW)
• Live Migration Bug Fixes (EMC)
incubation) • VMwareVCDriver • VMwareVCDriver for Nova
• VIF Fixes in Nova • VCDriver for for Nova (VMW) (VMW) • Nova Bug Fixes (VMW)
• Nova Networking Nova (VMW) • Framework for Glance-Specs (VMW)
• SMI-S Driver • VMDK Driver for • Updated SMI-S Driver for • Glance Bug Fixes (VMW)
for Cinder (VMW) VNX/VMAX (EMC)
• VNX Driver for Manila (EMC)
VNX/VMAX
iSCSI (EMC) • Nova Multi-Path • Direct Driver for VNX • VNX Driver for Cinder (EMC)
for iSCSI Fix (EMC) • VMAX Driver for Cinder (EMC)
• Nova Multi- (EMC) • XtremIO Driver for Cinder (EMC)
path Detach • ConsistencyGroup API in Cinder
Bug (EMC) (EMC)
• Object Updater Optimization (EMC)

EMC CONFIDENTIAL—INTERNAL USE ONLY 66

 EMC LIBERTY CONTRIBUTIONS

Data Source: Stackalytics for EMC commits, Liberty

EMC CONFIDENTIAL—INTERNAL USE ONLY 68
LIBERTY RELEASE – EMC PLUGINS

New Features New Features

Plugins Plugins
(Liberty Plugin*) (Liberty Plugin*)
VMAX • Manage/un-manage volume
XtremIO • Support iSCSI multipath
(Cinder) • Multiple pools per backend
(Cinder) • iSCSI discovery authentication
• Modify CG
• Consistency group support (create/delete
• Create CG from CG snapshot
CG and CG snapshot)
• Support SMI-S provider v8.0.3

VNX • Create CG from CG snapshot Isilon • Base driver; meets API requirements
(Cinder) • Over subscription support
(Manila)
• Attach snapshot
• iSCSI multipath enhancement (multiple iSCSI
portals) ScaleIO • New driver (Cinder, Nova, os-brick)
• Snap copy feature (Cinder) • Meets API requirements
• Add white list support for target ports
• VNX pool full threshold Cinder • Non-disruptive backup
• Clone Consistency Group API
VNX • Add access level support for ro/rw shares.
(Manila)
Manila • Oversubscription in thin provisioning

EMC CONFIDENTIAL—INTERNAL USE ONLY 69

EMC PLUGIN SUPPORT MATRIX

ScaleIO
driver
in trunk!

EMC CONFIDENTIAL—INTERNAL USE ONLY 70

EMC INTEGRATION WITH OPENSTACK
Isilon Ephemeral Storage Image Storage Persistent Storage ScaleIO
(Nova) (Cinder)
ScaleIO (Glance) VNX
 Used for non-persistent  Used for volumes that need
VNX VM storage (e.g. root disk)  Used for storing image to persist even if instance is VMAX
files (e.g. iso, qcow2, terminated
VNXe  Storage Types: Shared raw, etc.)
XtremIO
and Not Shared  Storage Types: Virtual
VMAX Block (bootable and non- ViPR
 Storage Types: File or
 Protocols: FC, iSCSI, NFS Object bootable)
XtremIO
 Protocols: HTTP, NFS  Protocols: FC, iSCSI, NFS
(+ others)
Isilon
Object Storage File Storage
(Swift) ECS (Manila)
Isilon  Used for image and  Used for providing shared Isilon
VNX
application data storage storage to instances
ECS VNX
 Storage Types: Container  Storage Types: File

 Protocols: REST  Protocols: NFS, CIFS

(+ others)
Drivers/Com Reference Engineered
munity Architectures Solutions

EMC CONFIDENTIAL—INTERNAL USE ONLY 71

FEDERATION IAAS/PAAS SOLUTIONS
NEW
Reference Arch. Elastic Cloud EMC Developer Platform VMware Integrated OpenStack
Program Infrastructure (ECI) (VIO)

• Strategic Partnerships with
Major OpenStack Vendors (Red
Hat, Mirantis, Canonical)
• Certified and tested
Configurations with ScaleIO,
XtremIO, VNX
• Partner Tools Integration
• Joint Support Efforts
• Joint PS Offerings
• Joint Go-to-Market
• Offers The Most Customized
Deployment Model
• Converged Infrastructure
(OnRack) with EMC
Engineered OpenStack
Distribution
• Amazon Web Services Like
Experience
• Ideal for Next Gen Apps
• Also Ideal for Developers
• All OpenStack Services Run
Inside Docker Containers
• ViPR Object Storage,
ScaleIO, M&R,
Chargeback/Showback
• Same APIs as DIY OpenStack
• Pivotal Cloud Foundry PaaS
Layer
• Pivotal or Hortonworks
Hadoop Big Data
• Jointly Engineered btw. EMC
and Pivotal
• Ops Manager, CI/CD, and
App Lifecycle Management
Integrations
• VMware’s OpenStack
Distribution
• Removes Complexity of
Deploying OpenStack
• Runs on vSphere 6.0/5.5 U2,
NSX-V, NSX-MH ViPR,
ScaleIO
• Free with Enterprise+ License
• Integrates with vRA, Log
Insight, ITBM
• OpenStack Can be Managed
via vCenter or OpenStack
API’s and Dashboard

Use Case Use Case Use Case Use Case

Production Grade OpenStack
Build-Your-Own
Converged Environment
General Purpose Cloud
Feature Rich PaaS Based on
Starting Transformation
ECI
Journey (P2.5)

Mirantis – Available Now

Canonical – Available Now Available – Q1 2016 Available – 1H 2016 Available - Now
Red Hat – Available Now
EMC CONFIDENTIAL—INTERNAL USE ONLY 72
OPENSTACK ON VMWARE
• VMware Integrated OpenStack (VIO)
• Plugs into VMware compute, network, and storage
virtualization technologies as part of OpenStack SDDC

OpenStack Horizon Cloud Management

OpenStack APIs Platform

VMware Integrated OpenStack (VIO)

vSphere NSX vCenter Datastores Log Insight

(compute) (network, security) (shared storage /vSAN) (centralized logging)

Automated Deployment and Configuration

(configuration-driven web client)

EMC CONFIDENTIAL—INTERNAL USE ONLY 73

WHAT IS VMWARE INTEGRATED OPENSTACK?
Fully Validated
Architecture

Existing OpenStack VMware-optimized vCenter Log vCloud

vSphere code with reference arch, with Operation Insight Automation IT Business
VMware integrated tools for s Managemen
environment Center t
drivers install, upgrade, etc Manager

VMware Integrated OpenStack OpenStack-aware Cloud

Management
Single Support
Contact
EMC CONFIDENTIAL—INTERNAL USE ONLY 7 74
 VMWARE AS COMPONENT PROVIDER
Do-it-Yourself or 3rd-party OpenStack Distributions
If you are looking to consume VMware technologies as part of a multi-vendor
OpenStack cloud…

VMware works openly with the OpenStack vendor ecosystem to make sure
technologies like vSphere, NSX, vRealize Operations, vRealize Automation, etc. all
work with third-party distros.

EMC CONFIDENTIAL—INTERNAL USE ONLY 75

REFERENCE ARCHITECTURE PROGRAM

Certified & Partner Tools Joint Cooperative

Validated Designs Integration Services Support

EMC
Drivers/Com Reference Engineered
munity Architectures Solutions

EMC CONFIDENTIAL—INTERNAL USE ONLY 76

DRIVERS INTEGRATE EMC STORAGE
OpenStack drivers (e.g. Cinder, Manila)
Broad Portfolio
Fit Your Environment
Evolve With Your Cloud
Hyper Delivers On Reduce Low $ Per
Software Data Lake
Converged, Speed And Deployment Transaction
Defined
S/W Defined Space Costs
Scale out File
Efficient and Object
Use Your Flash File or Block
Management System
Hardware Performance Hybrid Any Workload

Isilon

Drivers/Com Reference Engineered

munity Architectures Solutions

EMC CONFIDENTIAL—INTERNAL USE ONLY 77

MIRANTIS REFERENCE ARCH.

Download
Here

EMC CONFIDENTIAL—INTERNAL USE ONLY 78

FUEL PLUGINS FOR SCALEIO
AN EMC {CODE} PROJECT

• Fuel plugin ScaleIO Cinder is targeted to

OpenStack environments that want to
take advantage of an existing ScaleIO
deployment

• Fuel plugin ScaleIO is targeted for a new

ScaleIO deployment on an OpenStack
cluster in a High Availability (HA)
configuration

EMC CONFIDENTIAL—INTERNAL USE ONLY 79

UBUNTU REFERENCE ARCH.

Download
Here

EMC CONFIDENTIAL—INTERNAL USE ONLY 80

RED HAT REFERENCE ARCH.

Download
Here

EMC CONFIDENTIAL—INTERNAL USE ONLY 81

EMC MANAGEMENT PLUGINS

EMC VNX Charm from the Charm Store

EMC XtremIO Charm from the Charm Store

EMC VNX - Fuel Plugin from Git

EMC ScaleIO Fuel Plugin from Git

EMC ScaleIO Cinder Fuel Plugin from Git

Drivers/Com Reference Engineered

munity Architectures Solutions

EMC CONFIDENTIAL—INTERNAL USE ONLY 82

EMC NEUTRNO (aka CASPIAN, ECI)
• A Converged Infrastructure deployment experience…
– Modular hardware building blocks with simple deployment
– Integrated software stack
• An AWS-like user experience…
– Instant provisioning of services from service catalog / API
– Ideal for Platform 3 workloads
• With EMC Value
– OpenStack-based IP – no vendor tax, portability options
– Integrated experience with Compute, Big Data and Object
Storage services
Drivers/Com Reference Engineered
munity Architectures Solutions

EMC CONFIDENTIAL—INTERNAL USE ONLY 83

EMC NEUTRINO PORTFOLIO
Neutrino is a private cloud platform that enables
customers to rapidly deploy and simply manage cloud
services offerings for their tenants and users.
1. Neutrino Big Data: Big Data PaaS – Hadoop-based big data
service (similar to EMR)
2. Neutrino Cloud Compute: OpenStack operating
environment (similar to EC2)
3. Neutrino Developer Platform: CloudFoundry on OpenStack
(similar to EB)

Drivers/Com Reference Engineered

munity Architectures Solutions

EMC CONFIDENTIAL—INTERNAL USE ONLY 84

IDEAL USE CASES FOR NEUTRINO

1.Web and Mobile Apps – Cloud-native

applications - elastically scaling, self-healing
applications that leverage commodity hardware
infrastructure.
2.Devops –Internal development environments
for cloud-native apps.
3.Hadoop Batch Analytics – These applications
may or may not leverage related services such as
HAWQ.
EMC CONFIDENTIAL—INTERNAL USE ONLY 85
KEY ADVANTAGES
1. Fully open source application interfaces
2. Stable, tested infrastructure stack
3. Enterprise-grade storage (ScaleIO, ECS)
4. Low TCO provisioning and management
5. One throat to choke support
6. Integrated patches and upgrades
7. Common user directory across services
(leveraging Keystone)
EMC CONFIDENTIAL—INTERNAL USE ONLY 86
 INITIAL CUSTOMER TARGETING

• “I don’t believe • “I believe in the • “I believe in the

OpenStack and principles of principles of
Hadoop are OpenStack and OpenStack and
enterprise-ready” Hadoop” Hadoop”
• “I am comfortable • “I don’t think my • “I have an all-star
with the status quo team is capable of IT team”
and I can afford to building a world- • “I want to tune my
pay for 5-9s class DIY system to optimize
infrastructure environment” performance and
uptime” • “I want a stable utilization”
environment”

Ideal product: FEHC, Ideal product: Ideal product: VxRack

VxRack SDDC Neutrino FLEX

EMC CONFIDENTIAL—INTERNAL USE ONLY 87

NEUTRINO ARCHITECTURE
Developer Platform
(Cloud Foundry)
Orchestration /
Reporting

Cloud Compute
(OpenStack) Big Data
(Pivotal, Hortonworks)
(ScaleIO) (ECS)
….
Provisioning Engine

Hardware
Dense / High-Cap Add-on brick

EMC CONFIDENTIAL—INTERNAL USE ONLY 88

EMC CONVERGED INFRASTRUCTURE
Driving Efficiency For Everyone

BLOCKS APPLIANCES RACKS

“PROVEN” “SIMPLE” “FLEXIBILE” “TURN-KEY”

1000
CASPIAN

1032 1034
(FLEX) (SDDC)
EMC CONFIDENTIAL—INTERNAL USE ONLY 89
EMC CONVERGED INFRA STRATEGY

Application
Simplicity, Optimization and Flexibility
M&O

VMware, OpenStack and Multi-Cloud

More
M&O

Object
ScaleIO
vOneFS
VSAN Infrastructure
RP4VM Hadoop M&O User Experience
And More…

CPU MEMORY STORAGE NETWORK

HW M&O

EMC CONFIDENTIAL—INTERNAL USE ONLY 90

 SPECTRUM OF xAAS SOLUTIONS
RISK

CloudFoundry CloudFoundry CloudFoundry

Git Distribution System

DIY
PAAS
OpenStack OpenStack OpenStack OpenStack OpenStack
Git Packages Distribution System Fixed Appliance

DIY
IAAS
Rackmount Converged Hyperconverged Fixed Datacenter
hardware Infrastructure Rack scale Appliance
DIY
HW
SUPPORT

EMC CONFIDENTIAL—INTERNAL USE ONLY 91

 MAPPING OF FEDERATION SOLUTIONS
RISK

CloudFoundry Pivotal Project

Git CF Bravo

DIY
PAAS
OpenStack OpenStack EMC Reference EMC OpenStack
Git Packages Architectures Neutrino Fixed Appliance

DIY
IAAS
Rackmount Converged VCE VxRack Fixed Datacenter
hardware Infrastructure (vSphere, KVM, …) Appliance
DIY
HW
SUPPORT

EMC CONFIDENTIAL—INTERNAL USE ONLY 92

EMC IMMEDIATE ROADMAP
• EMC is increasing participation in OpenStack, including working groups and
core projects
– 80 attendees at Vancouver Summit
– 14 breakout sessions with EMC presenters and panelists

• Reference Architecture Program phase 1 complete and in planning for 2016

• EMC Neutrino entering beta by end of Q4 2015, GA in Q1 2016

EMC OpenStack Reference

Phase 1 1H 2015 Phase 2 1H 2016 …….
Architecture Program

EMC Neutrino 1H 2016 …….

EMC CONFIDENTIAL—INTERNAL USE ONLY 96