Escolar Documentos
Profissional Documentos
Cultura Documentos
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
17 years in IT 10 in Storage Certified Storage Specialist Netapp Certified Technologist Microsoft Certified Professional Blog: The Storage Tank Twitter: IBMRich rswain@us.ibm.com
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Moores Law, Gordon Moore Co-Founder of Intel The number of transistors on integrated circuits doubles approximately every two years
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Kryders Law: Mark Kryder, CTO Seagtate The density of hard drives increases by a factor of 1,000 every 10.5 years (doubling every 13 months).
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Capacity VS Throughput
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Demand for storage is continuing to rise Drives are becoming larger and out pacing the processing power Throughput is not scaling compared to drive size As drives become larger, fewer drives can be used driving down total IOPS
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Virtualization
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Storage hypervisor is a rapidly emerging way of describing the same value points in a storage context
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
How? Pooled physical resources from virtually any disk array vendor or tier
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Common Capabilities
Deliver tier-1 service regardless of hardware choice
SLA (Service Level Agreement) is encapsulated with the data in a virtual volume.
How? Common capabilities delivered by the storage hypervisor I/O caching, thin provisioning, automated tiering, application-integrated snapshot and mirroring, mobility-driven disruption avoidance
The desired service is delivered by the Storage hypervisor independent of the underlying hardware platform.
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Mobility
Balance workload, manage lease termination, improve datacenter performance How? Mobility of virtual volumes between any physical disk arrays Move on the fly, snapshot or mirror between arrays In a single physical datacenter or across two physical datacenters up to 300km apart
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Centralized Management
Optimize your people for the challenges of day-to-day operations How? Centralized management Visualization, health, capacity, performance Storage services catalog, automated provisioning, payper-use
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Compression
15
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Compression Capability
50%
50%
75%
85% 85% 85%
0%
Databases Database Logs E-Mail Virtual Servers Text
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
2000
1500 1000 500 0 Oracle TPC-C DB2 TPC-C No Compression Exchange Jetstress 986 987 982 988
Compressed
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
MailServer Qos
40
Storwize V7000 with Real-time Compression delivers up to 4x compression while maintaining VMware and Application performance
30 20 10
Uncompressed
Compressed
Compressed
OLIO Score
4000 3000
Uncompressed
OLIO Qos
70 60 50 40 30 20 10 0
Uncompressed Compressed
2000 1000
Compressed
19
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Database Performance
1.2 1.144 No Compression - 96 disks Compressed 48 disks
Storwize V7000 with Real-time Compression delivers up to 5x compression while maintaining or improving database transaction response time and overall business throughput
.857
.8
.701 .665 .501 .468 .385
.4
.46
.20
Stock Level
Delivery
Order Status
The benchmark was performed using a Storwize V7000 system with 48 x 300GB SAS disks. 1.2TB database with 700 concurrent clients were used in the benchmark. The same test was performed with compressed volumes and non-compressed volumes.
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Traditional Approaches
Must decompress entire file to edit Much more I/O
Real-time Compression
No need to decompress data to modify data No application performance impact The only storage compression solution that works in real time on active data
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
SystemFlash
22
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
~8-10x
~7-9x ~100x ~20x ONLY 1.2x
Network speed performance increased Bus speed performance increased Disk speed performance increased
Storage disk speed is the bottleneck thats slowing everything else in the IT stack
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Flash delivers performance and value to boost the critical applications running your business
Extreme performance: MicoLatency: Macro efficiency: Low TCO: Enterprise reliability: Serve customers faster Gain competitive advantage Do more things at once Save money and boost value Go the distance
Eliminate the storage-tier bottleneck and drive efficiency across the entire data path!
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Consolidation
Application scalability
Footprint minimization
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Flash benefits
Boost performance/efficiency without re-architecting applications or the storage infrastructure
75% reduction in footprint Store one petabyte in one floor tile, add compression and add up to 100% more
Enterprise reliability High availability, 2D RAIDTM and Variable Stripe RAIDTM (VSR)
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Density Flash provides 500TB of usable capacity Disk requires almost 4.5 racks of 600GB drives Nearly a 9:1 capacity/rack space advantage
Environmental Flash uses <10 KVA Disk drives would consume ~6,000 KVA Nearly a 600:1 energy/IOPS advantage
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Flash is a block data storage device that delivers deterministic high performance (s) and enables customers to: Increase CPU (application) efficiency Decrease time to operation results Unlock scale of users or processes Provide the best end-user experience
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Time to process 1 I/O request = 100 s + 5,000 s + 100 s = 5,200 s CPU utilization = Wait time / Processing time = 200 / 5,200 = ~4%
~100s Processing
~100s
CPU state
~5000 s
Waiting
Time
1 I/O request
2013 IBM Corporation
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Time to process 1 I/O request = 100 s + 200 s + 100 s = 400 s CPU utilization = Wait time / Processing time = 200 / 400 = ~50%
~100s Processing
~100s
CPU state
1 I/O request
2013 IBM Corporation
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
The world's biggest e-tailer estimates that every millisecond delay to its online service costs it $4.8 million in lost sales
Source: Richard Irving Capacity Magazine
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
33
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
IBM Smarter Storage is an approach for the design and deployment of storage
34
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
SVC is designed to pool storage volumes into a reservoir of capacity for centralized management. SVC helps to hide the boundaries among disk systems, which simplify management and enables customers to focus on managing storage as a resource to meet business requirements and not as a set of boxes.
SAN
Apply common copy services across the storage pool
DS8000
EM C
Combine the capacity from multiple arrays into a single pool of storage
35
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
1024 Hosts
iSCSI or FCOE Point-in-time Copy 1Gb or 10Gb Full volume, Copy on write 256 targets, Incremental, Cascaded, Reverse, Snapshots, FlashCopy Mgr
Thin Provisioning Easy Tier
SAN
Real-time Compression
MA, EMA Lightning CLARiiON StorageTek FAS iStorage N series DS MSA, EVA, CX4, Thunder StorEdge Storwize V7000 TagmaStore DS3000, DS4000 XP, P9500, Symmetrix, XioTech Bull DS5000, DS6000 DCS9XXX 3Par AMS, WMS, DMX, VMAX, Violin DS8000 Emprise USP, USP-V Storeway VNX, VNXe VSP * Confirm all supported configurations at ibm.com/storage/support/2145 and click on Support
IBM XIV
IBM
Hitachi
HP
EMC
Sun
NetApp NEC
Fujitsu
Eternus
TMS
RamSAN
NexSAN
SATABeast
Pillar
Axiom
36
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
1.1
1.2
2.1
3.1
4.1
4.2
4.3
5.1
6.1
6.2 6.2
6.3
6.4
2004 8 nodes
2005 2145-8F4
2009 2145-CF8 SSD support 3 site Mirror > 2TB VDisk Split cluster iSCSI Zero detect
2011 2145-CG8 VAAI >2 TB MDisk Performance monitor Flash Copy enhancements
2012 Real-time Compression Non-disruptive volume move FCoE 4 way Storwize V7000 clustering
37
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
10Gbp s iSCSI
1Gbps iSCSI
10Gbps iSCSI
Supports up to four internal 146GB SSDs Optional 10 Gb Ethernet support for 10 Gb iSCSI host attachment and future FCoE support Two 10Gb ports per storage engine Storage engine supports 10Gb iSCSI or internal SSDs but not both Factory install or nondisruptive field upgrade Engines may be intermixed in pairs with other engines in SVC clusters Mixing engine types in a cluster results in volume throughput characteristics of the engine type in that I/O group
38 38
Cluster non-disruptive upgrade capability may be used to replace older engines with CG8 engines
Replaces the SVC 2145-CF8 engine
38 2013 IBM Corporation
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Host
Host
Host
SSD
HDD
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
SE
Production
SE
FA
Test master copy
FA
SE SE
Test
Test master can be used to reset test virtual disks after test runs
Implementation uses snapshots, cascaded, and multi-target FC This example uses around 2x production data Compare with 5x for regular FlashCopy
40
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
SVC stores two copies of a virtual disk, usually on separate disk systems SVC maintains both copies in sync and writes to both copies If disk supporting one copy fails, SVC provides continuous data access by using other copy Copies are automatically resynchronized after repair Intended to protect critical data against failure of a disk system or disk array A local high availability function, not a disaster recovery function Copies can be split Either copy can continue as production copy Either or both copies may be space-efficient
41
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
SVC remote mirror now supports replication to/from Storwize V7000 systems Enables lower cost DR configurations by mirroring directly to Storwize V7000 disk system without need for second SVC system Provides options to redeploy existing storage to extend life and enhance value
42
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Up to 300km
Data center 1 Data center 2
Improve availability, load-balance, and deliver real-time remote data access by distributing applications and their data across multiple sites. Seamless server / storage failover when used in conjunction with server or hypervisor clustering (such as VMware or PowerVM) Up to 300km between sites (3x EMC VPLEX)
Server Cluster 1
Failover
Server Cluster 2
Server Cluster 1
Failover
Server Cluster 2
For combined high availability and disaster recovery needs, synchronously or asynchronously mirror data over long distances between two high-availability stretch clusters.
Data center 1
Data center 2
Data center 1
Data center 2
High Availability
43
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Integrated IBM Real-time Compression Improves efficiency with up to 80% reduction in physical disk space required enabling up to 5x data in the same space Lower rack space, power, and cooling Applicable to much wider range of data than alternative options Significantly enhanced value for existing storage Nondisruptive volume move Rebalance workload across complete systems without disruption Support for Fiber Channel over Ethernet (FCoE) Supports next-generation converged data center networking
44
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
45
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
46
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Introducing IBM SAN Volume Controller Real-time Compression Innovative, easy-to-use compression fully integrated into SVC High performance implementation supports active primary workloads Real-time Compression builds on storage efficiency advantages of SVC SVC Real-time Compression delivers up to 50% or better compression for data that is not already compressed Compression helps reduce Storage purchase costs Rack space Power and cooling Software costs for additional functions
Compression can help freeze storage growth or delay need for additional purchases
47
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Compression Without Compromise Variable Sized Compression Enhances Performance and Efficiency
RACE flips this approach, taking a variable data stream and producing a fixed output Compressed volume has a consistent logical layout Temporal locality: data thats accessed together is compressed together Variable sized input chunks get better compression Less data is compressed and decompressed Fewer disk I/Os Better performance
Real-time Compression Variable input Fixed output
Map
1 MB chunk
Traditional Compression
1 MB Read
1 MB Decompress 100 Byte Update 1 MB Compress 1 MB Write
0 MB Read
0 MB Decompress 0 Byte Update 100 Byte Compress <100 Byte Write
Total I/O: 2 MB
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
49
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Shipped over 72 Petabytes of Flash storage in 2012 Broad array of products to fit a wide variety of client needs
IBM FlashSystem
eXFlash
DS8000 XIV
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Extreme Performance
SLC (720)/eMLC (820) 5,10, 20 TB w/ High Availability (6,12, 24 TB non HA) 525K (720/820) IOPS 5 (720) / 4 (820) GB/s Bandwidth
MicroLatency
Low Latency 100/25 s (720) 110/25 s (820) Read/Write Purpose-built, highly parallel design Maximize host CPU efficiency and productivity
Macro Efficiency
1U form factor- minimal footprint for best of breed ROI Two dual-port 8 Gb Fibre Channel controllers or dual-port 40Gb QDR InfiniBand controllers Hot swappable flash modules Low power 500 watts (720) / 450 watts(820)
Enterprise Reliability
Variable Stripe RAID to protect against chip failure Redundancy for power, data, and management 2D Flash RAID eliminates single point of failures Available integrated spare flash card limiting down time Error Correcting Code (ECC) at chip level
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Extreme Performance
SLC (710) / eMLC (810) 1-5 TB or 2-10 TB 570K (710) / 550K (810) IOPS 5 GB/s (710)/ 4 GB/s (810) Bandwidth
MicroLatency
Low latency 100/60 s (710) and 110 / 60 s (810) Read/Write Purpose-built, highly parallel design Maximize host CPU efficiency and productivity
Macro Efficiency
1U form factor- minimal footprint for best of breed ROI Two dual-port 8 Gb Fibre Channel controllers or dual-port 40Gb QDR InfiniBand controllers Low power 450 watts (710) / 400 watts(810) Available hot-swapable flash modules in 720/820
Enterprise Reliability
Variable Stripe RAID to protect against chip failure Redundant power supplies with active failover protection against single-source power issues Error Correcting Code (ECC) at chip level Available integrated spare flash card
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
1U Chassis
Redundant Fans
2013 IBM Corporation
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Use Cases
57
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Sprint had a lot of heterogeneity in their storage environment with low utilization
Started at 35% Achieved 82% utilization Started at 70% T1 / 30%T2 Achieved 30% T1 / 70% T2 Storage maintenance costs have been reduced 60% YoY
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Solution
Implement a high-impact, nondisruptive RamSan solution which was installed in a single day
With flash, streaming batch jobs completed up to 70 percent faster and improved performance and efficiency on other disk storage platforms by 40 percent!
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Business challenges
Accelerate nightly backups to meet windows
We literally just turned it on and thats all the performance tuning we did. It just worked out of the box. Theyre very well made and a very mature product. Jason Holmes, Lead System Admin
Solution
Implement flash instead of adding 200 high performance disks
Flash instantly increased perfomance in nightly backups 6x while reducing power consumption by 90 percent!
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Banco Azteca integrates flash into its SAN for increased performance in its credit processing business
Business challenges
Speed up application processing without architectural changes
Solution
Integrate flash seamlessly into the existing infrastructure
Flash integrated seamlessly into a production SAN while delivering an order of magnitude better response time!
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Conclusions, Q&A
62
Thank you
63
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
The headline should not be resized or moved The headline should always use lower case, other than the first letter
It should not have more than two lines (which may expand to three lines after translation) When a headline is two lines long, choose a division that is grammatically logical and aesthetically pleasing Ideally, the top line should be moderately longer than the lower line Avoid dividing articles from nouns, prepositions from prepositional phrases, verbs from nouns, etc.
The text above the headline is called the running header, Arial 10pt. Regular This text can be changed in View > Master > Slide Master
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Use the Tab key (or increase indent button) to obtain the proper indents and bullets. Use 16 point Arial body text as the minimum type size. The line spacing has been carefully chosen to introduce a balance between text and white space (1 Lines for line spacing, .2 Lines before paragraph spacing) and should be checked for consistency. On a white background, body text should appear in black and should be set in upper and lower case. Where required you can use indents as follows Second level Third level
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
To change the language settings: Make sure you are in normal view View > Normal (from the command menu) Click anywhere in the text box Now select everything by using Edit > Select All or Ctrl A The language can now be set to your local language by using Tools > Language, and selecting the language you require from the available languages. If you want to create a local language version of this template, then you should also set the language on the Slide Master, Title Master, Notes Master and Handout Master as well and save the file as a Document Template. To make it appear as a standard template save it to the location of your MS Office templates, this location varies according to the version of Windows you are using.
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Footers
Footers can be used if necessary for dates, confidential material, etc. The Footer text has the standard form <date> and <footer> The contents of the fields <date> and <footer> can be set using the View > Header and Footer command The Edge2013 branding in the lower right corner should be preserved whenever possible, however, it is permissible to remove or hide it on select pages where it interferes with full-page charts, tables, etc. A Section Header template page is included, and can be used to bring more event branding to presentations There are 4 fixed elements on each page which should not be changed The IBM Logo The horizontal rule Page number location The IBM copyright statement
Source: If applicable, describe source origin 67 2013 IBM Corporation
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
68
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Basic alignment
This template has the GRID on as a default Use the snap objects to grid to align objects Set to 0.1 inches or 0.254 cm Use drawing guides to help align if needed
Grids help objects to be spaced evenly, aligned and consistent in size First Box Second Box Third Box
B
Fourth Box
C
Fifth Box
Creating Better Storage Efficiencies through Virtualization, Compression and Flash Technology
Color palette
A color palette has been selected and keyed to basic elements such as headline type in Edge Orange and basic text in black. Hyperlinks have been keyed to blue. Visited hyperlinks have been keyed to purple. There is also a palette for accent colors, including orange, aqua and yellow-green. Other color selections can be made, but should be limited so that our presentations match consistently. The color palettes have been built into the templates (numbers refer to RGB values).
0 0 0
240 78 55
127 28 125
255 207 1
255 100 0
153 0 204