ELASTIC CLOUD STORAGE (ECS)

STORAGE FOR THE 3RD PLATFORM

WHAT'S NEW IN 2015

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

ROADMAP INFORMATION DISCLAIMER

EMC makes no representation and undertakes no obligations with
regard to product planning information, anticipated product
characteristics, performance specifications, or anticipated release
dates (collectively, Roadmap Information).
Roadmap Information is provided by EMC as an accommodation to the
recipient solely for purposes of discussion and without intending to be
bound thereby.
Roadmap information is EMC Restricted Confidential and is provided
under the terms, conditions and restrictions defined in the EMC NonDisclosure Agreement in place with your organization.

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

MODERN APPS ARE CHANGING

INDUSTRIES

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

MODERN APPS ARE BREAKING

TRADITIONAL STORAGE

NOT DESIGNED FOR MODERN APPLICATIONS AND HYPERSCALE

Architecture is too complex

Locking, replication, High Availability, geodistribution is complex

Not Web or firewall friendly

Distributed (WAN) access is complex

Storage silos impede development

Different hardware for every data type and
access protocol

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

NEW DEMANDS FOR HYPERSCALE

SOFTWARE-DEFINED STORAGE AND COMMODITY ARE FOUNDATIONAL

The Potential

Reduce storage costs with

commodity off-the-shelf (COTS)
components and standard, open
technologies

7:1

Savings

The Reality

Individual components provide

lower performance, lower
reliability, etc.

You need sufficient scale, the right

software, and operational expertise
to provide a reliable, scalable
infrastructure

Copyright 2014
2015 EMC Corporation. All rights reserved.

Storage Appliance

Commodity Hardware

#EMCECS
Source: IDC DSS Tracker Q4 2014 , Dec. 2014

WHAT DO CUSTOMERS NEED?

Customer need simple, APIaccessible, software-based

storage
that can be deployed on
commodity off-the-shelf
components
in a hyperscale architecture
#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

ECS IS COMMODITY INNOVATION

ECS BRINGS HYPERSCALE AND RAS TO COMMODITY

COTS components
X86 Servers, Ethernet networking, SATA disk drives

EMC Innovation in:

Market leading software-defined object storage
engine
How the software and hardware are integrated to
enable scalability and serviceability!
Enterprise grade support from EMC

Integrated appliance or software on 3rdparty commodity

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

COMPLETE CLOUD STORAGE

PLATFORM
Lower cost than public cloud
Hyperscale independently scale performance and
capacity for billions of files across sites
Anywhere read/write access with strong consistency
simplifies application development
Single global namespace and multi-tenancy
simplifies storage and data management
No single points of failure increases availability
and performance
Broad API support eliminates storage silos and
inefficient ETL processes
#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

ECS ARCHITECTURE
Object archiving

Cloud Backup

Next-gen File

Custom apps
(web/mobile)

Packaged apps

Analytics

HTTP/S (REST), S3, Swift, Atmos, CAS, HDFS

https://accesspoint.yourcompany.com

SITE 1

Geo-Replicated Data Protection

Active-Active read/write support
with strong consistency
Copyright 2015 EMC Corporation. All rights reserved.

SITE 2

SITE 3

Global namespace
Performance and efficiency for
small and large objects
#EMCECS

DESIGN PRINCIPLE: LAYERED ARCHITECTURE

HDFS
OBJECT

HDFS
OBJECT

Storage Engine

Persistence Layer

JBODs

HDFS
OBJECT

Limitless Scale: Each layer is

independently scalable, highly
available, and has no single
point of failure.
Scale-Out Architecture: Scale
by adding more nodes, no
special nodes or roles
Global Namespace: Any node
has full system view off data and
meta-data
#EMCECS

Copyright 2015 EMC Corporation. All rights reserved.

COMPREHENSIVE DATA ACCESS

COMPATIBILITY WITH COMMON INDUSTRY APIS

Simultaneous access to underlying data

through multiple interfaces
Object, HDFS, File (future)

HDFS compatible with Cloudera,

Hortonworks, Pivotal etc.
ATMOS

Support for S3, Swift, Atmos and Centera

CAS APIs object
Extensions to APIs

Byte-Range updates, Atomic appends, Rich ACLs

etc.

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

GEO-REPLICATED DATA PROTECTION

EFFICIENT PROTECTION AGAINST LOCAL AND GLOBAL FAILURES

Handles local hardware and full

data center failures
Disk, Node, Rack, Data Center are
failure domains

Site 2

Site 1

Site 3

Local hardware failure recovery

requires no WAN traffic
New Hybrid encoding approach
enables low storage overhead
#EMCECS

Copyright 2015 EMC Corporation. All rights reserved.

OPTIMIZED STORAGE OVERHEAD

# of Data
Centers

Overhead

1.33 x

2.67 x

2.00 x

1.77 x

1.67 x

1.60 x

1.55 x

1.52 x

Low Storage Overhead:

~1.8x replication over
head across 4 sites
WAN Optimization: All
node and disk failures
are repaired within the
site, without any WAN
traffic.
Increasing the number of
data centers lowers
storage overhead and
increases protection

Business Value: Hyperscale economics to leverage key

#EMCECS
assets and compete with public cloud IaaS
Copyright 2015 EMC Corporation. All rights reserved.

ACTIVE-ACTIVE, READ/WRITE
ARCHITECTURE

FASTER DEVELOPMENT AND ANYWHERE ACCESS TO CONTENT

https://accesspoint.yourcompany.com

Single global namespace across

data centers
Strong consistency across data
centers
Optimized for minimal WAN round
trips by sensing access patterns
across data centers on individual
entities
#EMCECS

Copyright 2015 EMC Corporation. All rights reserved.

ECS Software
Enterprise & SPs
DIY with 3rd Party Commodity
Hardware

ECS Appliance

Enterprise & SPs

Hyperscale Cloud Storage Platform
EMC Service and Support
#EMCECS

Copyright 2015 EMC Corporation. All rights reserved.

ECS SOFTWARE vs. ECS APPLIANCE

ECS Software

ECS Appliance

Package

Software Only; BYO

Hardware

Appliance (HW+SW)

Services

Object and HDFS

Object and HDFS

Network
Infrastructure

Customer Provided

EMC Provided

OS Deployment
& Patching

Customer Managed

Managed by EMC

Support

Joint support between

customer and EMC

Fully supported by
EMC

EMC Phone Home Yes

Yes
#EMCECS

Copyright 2015 EMC Corporation. All rights reserved.

ECS 1.2 WHAT'S NEW

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

ECS 1.2 - SIMPLIFIED DEPLOYMENT

Simplified Configuration
Define your data center
topology

Single Command Install

Connect to any ECS Server

and start the install process

Rolling Upgrade Support

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

STORAGE POOL, VIRTUAL DATA

CENTER
Virtual Data Center

Storage Pool

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

VIRTUAL DATA CENTER VIEW

Virtual Data Center

Storage Pool 1

Storage Pool 2

Storage Pool 3

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

REPLICATION GROUPS
Replication Groups define the replication policy
across one or more virtual data centers
Up to 8 vdcs per replication group
Multiple replication groups per virtual data center

Geo-Replication
Storage Pool/VDC1

Storage Pool/VDC2

Replication Group
#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

MULTI-TENANCY

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

ECS 1.2 MULTI-TENANT ROLES

Assigns Object user to a
namespace

Add Namespace &

System Admins

Namespace Admin

Namespace 1

Authorization Provider
(AD/LDAP)

Create Namespace

System Admin

Namespace 2

Object Users

Object Users

Object Buckets

Object Buckets

Namespace 3

Object Users

Object Buckets

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

ECS 1.2 NEW MULTITENANT FEATURES

Meter Usage

Namespace/Bucket Metering

Metering at bucket or namespace level

Objects Created, Deleted, Capacity, Bandwidth

Quota Management
Manage Quota

Quota can be enabled at a particular GB value

Ability to block writes
Ability to set Quota at namespace or bucket level

Bucket and Namespace Auditing

Audit

Create, Delete, Update bucket

Set bucket ACL
Change bucket owner

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

MONITORING &
DIAGNOSTICS

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

ECS 1.2 CAPACITY MONITORING

Capacity Utilization

Usable, used and available capacity

Drill down from VDC, to Node to Disk.

Traffic Metrics

Read/write Avg Latency

Read/write Bandwidth
Read/write Transaction/sec

Disk Bandwidth

Read/Write traffic across various

background operations
#EMCECS

Copyright 2015 EMC Corporation. All rights reserved.

ECS 1.2 PHYSICAL ENVIRONMENT

Hardware Health

Node and Disk Health

Node Health

CPU, Memory and Network

Process Health

CPU, Memory and Network

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

ECS 1.2 STORAGE EFFICIENCY

Erasure Coding

EC vs Non-EC Data
Rate of EC

Recovery Metrics

Recovery Rate
Total Data to be recovered

Geo-Replication

Copyright 2015 EMC Corporation. All rights reserved.

Replication Rate
Index vs Data replication
Data Reduction Operations
#EMCECS
RPO

GEOENHANCEMENTS

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

ECS 1.2 - MULTI SITE PERFORMANCE

Improved access to secondary site Geo caching at
the array level
Cache can be invalidated based on time
Dynamic cache resizing on node add/remove
Diagnostics have been added to provide insight on cache
utilization
Bottom line: Lower Latency

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

ECS 1.2 GEO-FAILOVER ON

NETWORK OUTAGE
Automatic Failover in the event
of a network outage

Automatic failover initiated once

data replication lags behind RPO
Access to buckets and objects
available across all sites
Automatic site synchronization
occurs when all zones are
reconnected
Capability is set at the bucket level
#EMCECS

Copyright 2015 EMC Corporation. All rights reserved.

ECS @ EMC WORLD 2015

Booth # ?
ECS Related sessions (list day/Times and room)
ECS Architecture Deep Dive
ECS & Vmware vCloud Air Architecting and
Deploying and Exabyte+ Cloud

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.

ECS AT EMC WORLD

ECS is Everywhere at EMC World!
On The Show Floor

ECS at CTD/ETD Booth 813 and kiosks #8 and #9

Breakout Sessions

EMC ECS:
Scale IT
EMC ECS:
Deploying
EMC ECS:
EMC ECS:
2015

ECS and Unstructured Content Strategies for Web

ECS and VMware vCloud Air - Architecting and
an Exabyte+ Cloud
ECS Architecture Deep Dive
ECS Storage for 3rd Platform and What's New in

HOLs (Hands-on Labs)

EMC ECS: Empowering Storage Admins for Cloud Storage

#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.