Big Data

New Frontiers for IT Management

Tavo De Len
BigDataArchitecture.com

Executive Briefing
Definition Catalysts Potential Value of Big Data Thought Lea ers Lea ing Technology Ven ors !ou " The #T Professional

The Age of Big Data

Data is a new class of economic asset, like currency and gold.

Source: World Economic Forum 2012

$hat is Big Data

%A massive volume of &oth structure an unstructure ata that is so large that it's ifficult to (rocess )ith tra itional ata&ase an soft)are techni*ues.+

$hat is Big Data

$almart han les more than , million customer transactions every hour. -ace&oo. han les /0 &illion (hotos from its user &ase. Deco ing the human genome originally too. ,0 years to (rocess1 no) it can &e achieve in one )ee..

2 The Economist3 40,0

Volume3 Velocity an Variety

Big ata s(ans three imensions
Petabytes per day/week

Volume

Real-time capture and Real-time analytics

Velocity

Big Data

nstructured data, web logs, audio, !ideo, image

Variety

Catalyst " Commo ity 5ervers

Commo ity server har )are creating the (ossi&ility for cost effective massively (arallel (rocessing 67PP8
"

"#ample ser!er mig$t contain% &P ' () &ores R*+ ' ( ,erabyte Disk ' -.. ,erabytes "t$ernet ' ( /bit

Catalyst " 9umans an the #nternet

,.4 Billion active mo&ile &roa &an su&scri(tions $e& sites )ith :00; million uni*ue visitors<month " -ace&oo. " !ahoo " =oogle " !ouTu&e
"

Potential Value of Big Data

>:00 &illion (otential annual value to ?5 health care. >@00 &illion (otential annual consumer sur(lus from using (ersonal location ata. @0A (otential in retailersB o(erating margins.

Source: McKinsey Global Institute - 2010

Thought Lea ers

The 7cCinsey =lo&al #nstitute
Big data: The next frontier for innovation, competition, and productivity May 2011

=artner Desearch
" The timely conversion of ata to information is next challenge for cor(orations " Dole of Data 5cientist

EDeilly Boo.s
" E ucation " 5trata Conference

Lea ing Technology Ven ors

Example Vendors #B7 " FeteGGa E7C " =reen(lum Eracle " Exa ata Commonality 7PP architectures Commo ity 9ar )are DDB75 &ase -ull 5HL com(liance

9a(oo " E(en 5ource

5tarte &y =oogle an !ahooI Fo) E(en 5ource " 9a oo( %Fo5HL+ a((roach to ata -oun ational TechnologiesJ
" 9a oo( Data 5torage -rame)or. " 7a(De uce engine " 9#VE an P#= *uery tools

Almost 5HL com(liant

Lea ing Ven ors 2 9a oo(

Clou era " E(en 5ource 9ADEEP
" Pro uction Deleases " Very goo su((ort " Conferences an e ucation "

AmaGon's Elastic Com(uting Clou

" " " " 7a(<De uce environment 7PP for everyone Cost effective An you can &uy a &oo.I

!ou " The #T Professional

De*uire rea ingJ
" The 7c.insey re(ort " F!T 2 %The Age of Big Data+

Big Data is an environment )hich re*uires care an fee ing Develo( in2house s.ills 6AmaGon EC48 Proof of conce(t &efore (urchase Big Data analytic tools are %infants+ Big Data &rings ne) (rivacy an com(liance concerns

5taying Com(etitive
0or almost (.. years baseball pitc$ers producti!ity $as been defined by t$eir "arned Run *!erage or ".R.*. 1t2s a statistic for pitc$ers t$at measures $ow good t$ey are at pre!enting runs.

E.R.A = Earned Runs/Innings Pitched x 9

5taying Com(etitive 2 7oney&all

&orporations 3baseball teams4 need more data and ad!anced analytics to remain competiti!e. ".R.* e!ol!ed into 5 6kill-1nteracti!e "arned Run *!erage SIERA = 6.145 16.986*(SO/PA) + 11.434*(BB/PA) 1.858*((GB-FBPU)/PA) + 7.653*((SO/PA)^2) +/ 6.664*(((GB-FB-PU)/PA)^2) + 1 .13 *(SO/PA)*((GB-FB-PU)/PA) 5.195*(BB/PA)*((GB-FB-PU)/PA)

Source: New or! "imes

BigDataArchitect re!com

Ta"o#BigDataArchitect re!com