Introduction

Amir H. Payberah
amir@sics.se

Amirkabir University of Technology

(Tehran Polytechnic)

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 1 / 48

 Course Information

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 2 / 48

Course Objective

I Introduction to main concepts and principles of cloud computing

and data intensive computing.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 3 / 48

Course Objective

I Introduction to main concepts and principles of cloud computing

and data intensive computing.

I How to read, review and present a scientific paper.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 3 / 48

Topics of Study

I Topics we will cover include:

Cloud platforms
Cloud storage, NoSQL and NewSQL databases
Cloud resource management
Batch processing frameworks
Stream processing frameworks
Graph processing frameworks

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 4 / 48

Course Material

I Mainly based on research papers.

I You will find all the material on the course web page:
http://www.sics.se/amir/cloud14.htm

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 5 / 48

Course Examination

I Mid term exam: 20%

I Final exam: 20%

I Reading assignments: 27%

I Final presentation: 23%

I Final project: 10%

I Lab assignments: 0% :)

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 6 / 48

Reading Assignments

I Nine reading assignments.

I You should write a review for each paper (at most two pages).

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 7 / 48

Reading Assignments

I Nine reading assignments.

I You should write a review for each paper (at most two pages).

I For each paper you should:

Identify and motivate the problem.
Pinpoint the main contributions.
Identify positive/negative aspects of the solution/paper.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 7 / 48

Reading Assignments

I Nine reading assignments.

I You should write a review for each paper (at most two pages).

I For each paper you should:

Identify and motivate the problem.
Pinpoint the main contributions.
Identify positive/negative aspects of the solution/paper.

I For each paper, you might be given some questions to answer.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 7 / 48

Reading Assignments

I Nine reading assignments.

I You should write a review for each paper (at most two pages).

I For each paper you should:

Identify and motivate the problem.
Pinpoint the main contributions.
Identify positive/negative aspects of the solution/paper.

I For each paper, you might be given some questions to answer.

I Students will work in groups of two.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 7 / 48

Presentation

I Each group give a 30 minutes talk on a scientific paper.

I The list of papers will be available in the course web page.

I You are also free to choose any other paper, but it should be con-
firmed.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 8 / 48

Lab Assignments and the Project

I Implement simple applications on different frameworks through the

course.

I The solution of each lab assignment will be uploaded on the course

page, one week after their start dates.

I The final project on top of Spark.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 9 / 48

Discussion Forum

I Use the course discussion forum if you have any questions:

http://www.sics.se/amir/cloud14.htm

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 10 / 48

 Course Overview

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 11 / 48

 Data is not information, information is not knowledge, knowledge is
not understanding, understanding is not wisdom.
- Clifford Stoll

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 12 / 48

Big Data

small data big data

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 13 / 48

 I Big Data refers to datasets and flows large
enough that has outpaced our capability to
store, process, analyze, and understand.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 14 / 48

The Four Dimensions of Big Data

I Volume: data size

I Velocity: data generation rate

I Variety: data heterogeneity

I This 4th V is for Vacillation:

Veracity/Variability/Value

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 15 / 48

 Where Does
Big Data Come From?

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 16 / 48

Big Data Market Driving Factors
The number of web pages indexed by Google, which were around
one million in 1998, have exceeded one trillion in 2008, and its
expansion is accelerated by appearance of the social networks.

[Wei Fan et al., Mining big data: current status, and forecast to the future, 2013]

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 17 / 48

Big Data Market Driving Factors

The amount of mobile data traffic is expected to grow to 10.8

Exabyte per month by 2016.

[Dan Vesset et al., Worldwide Big Data Technology and Services 2012-2015 Forecast, 2013]

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 18 / 48

Big Data Market Driving Factors
More than 65 billion devices were connected to the Internet by
2010, and this number will go up to 230 billion by 2020.

[John Mahoney et al., The Internet of Things Is Coming, 2013]

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 19 / 48

Big Data Market Driving Factors

Open source communities

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 20 / 48

Big Data Market Driving Factors

Many companies are moving towards using Cloud services to

access Big Data analytical tools.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 21 / 48

 History of Data

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 22 / 48

4000 B.C
I Manual recording
I From tablets to papyrus, to parchment, and then to paper

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 23 / 48

1450

I Gutenbergs printing press

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 24 / 48

1800s - 1940s

I Punched cards (no fault-tolerance)

I Binary data
I 1890: US census
I 1911: IBM appeared

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 25 / 48

1940s - 1950s

I Magnetic tapes

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 26 / 48

1950s - 1960s

I Large-scale mainframe computers

I Batch transaction processing
I File-oriented record processing model (e.g., COBOL)

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 27 / 48

1960s - 1970s

I Hierarchical DBMS (one-to-many)

I Network DBMS (many-to-many)
I VM OS by IBM multiple VMs on a single physical node.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 28 / 48

1970s - 1980s

I Relational DBMS (tables) and SQL

I ACID
I Client-server computing
I Parallel processing

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 29 / 48

1990s - 2000s

I Virtualized Private Network connections (VPN)

I The Internet...

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 30 / 48

2000s - Now

I Cloud computing
I NoSQL: BASE instead of ACID
I Big Data

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 31 / 48

 Cloud and Big Data

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 32 / 48

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 33 / 48
Big Data Analytics Stack

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 34 / 48

Hadoop Big Data Analytics Stack

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 35 / 48

Spark Big Data Analytics Stack

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 36 / 48

Big Data - File systems

I Traditional file-systems are not well-designed for large-scale data

processing systems.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 37 / 48

Big Data - File systems

I Traditional file-systems are not well-designed for large-scale data

processing systems.

I Efficiency has a higher priority than other features, e.g., directory

service.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 37 / 48

Big Data - File systems

I Traditional file-systems are not well-designed for large-scale data

processing systems.

I Efficiency has a higher priority than other features, e.g., directory

service.

I Massive size of data tends to store it across multiple machines in a

distributed way.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 37 / 48

Big Data - File systems

I Traditional file-systems are not well-designed for large-scale data

processing systems.

I Efficiency has a higher priority than other features, e.g., directory

service.

I Massive size of data tends to store it across multiple machines in a

distributed way.

I HDFS/GFS, Amazon S3, ...

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 37 / 48

Big Data - Database

I Relational Databases Management Systems (RDMS) were not de-

signed to be distributed.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 38 / 48

Big Data - Database

I Relational Databases Management Systems (RDMS) were not de-

signed to be distributed.

I NoSQL databases relax one or more of the ACID properties: BASE

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 38 / 48

Big Data - Database

I Relational Databases Management Systems (RDMS) were not de-

signed to be distributed.

I NoSQL databases relax one or more of the ACID properties: BASE

I Different data models: key/value, column-family, graph, document.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 38 / 48

Big Data - Database

I Relational Databases Management Systems (RDMS) were not de-

signed to be distributed.

I NoSQL databases relax one or more of the ACID properties: BASE

I Different data models: key/value, column-family, graph, document.

I Hbase/BigTable, Dynamo, Scalaris, Cassandra, MongoDB, Volde-

mort, Riak, Neo4J, ...

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 38 / 48

Big Data - Resource Management

I Different frameworks require different computing resources.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 39 / 48

Big Data - Resource Management

I Different frameworks require different computing resources.

I Large organizations need the ability to share data and resources

between multiple frameworks.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 39 / 48

Big Data - Resource Management

I Different frameworks require different computing resources.

I Large organizations need the ability to share data and resources

between multiple frameworks.

I Resource management share resources in a cluster between multiple

frameworks while providing resource isolation.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 39 / 48

Big Data - Resource Management

I Different frameworks require different computing resources.

I Large organizations need the ability to share data and resources

between multiple frameworks.

I Resource management share resources in a cluster between multiple

frameworks while providing resource isolation.

I Mesos, YARN, Quincy, ...

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 39 / 48

Big Data - Execution Engine

I Scalable and fault tolerance parallel data processing on clusters of

unreliable machines.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 40 / 48

Big Data - Execution Engine

I Scalable and fault tolerance parallel data processing on clusters of

unreliable machines.

I Data-parallel programming model for clusters of commodity ma-

chines.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 40 / 48

Big Data - Execution Engine

I Scalable and fault tolerance parallel data processing on clusters of

unreliable machines.

I Data-parallel programming model for clusters of commodity ma-

chines.

I MapReduce, Spark, Stratosphere, Dryad, Hyracks, ...

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 40 / 48

Big Data - Query/Scripting Language

I Low-level programming of execution engines, e.g., MapReduce, is

not easy for end users.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 41 / 48

Big Data - Query/Scripting Language

I Low-level programming of execution engines, e.g., MapReduce, is

not easy for end users.

I Need high-level language to improve the query capabilities of exe-

cution engines.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 41 / 48

Big Data - Query/Scripting Language

I Low-level programming of execution engines, e.g., MapReduce, is

not easy for end users.

I Need high-level language to improve the query capabilities of exe-

cution engines.

I It translates user-defined functions to low-level API of the execution

engines.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 41 / 48

Big Data - Query/Scripting Language

I Low-level programming of execution engines, e.g., MapReduce, is

not easy for end users.

I Need high-level language to improve the query capabilities of exe-

cution engines.

I It translates user-defined functions to low-level API of the execution

engines.

I Pig, Hive, Shark, Meteor, DryadLINQ, SCOPE, ...

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 41 / 48

Big Data - Stream Processing

I Providing users with fresh and low latency results.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 42 / 48

Big Data - Stream Processing

I Providing users with fresh and low latency results.

I Database Management Systems (DBMS) vs. Data Stream Man-

agement Systems (DSMS)

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 42 / 48

Big Data - Stream Processing

I Providing users with fresh and low latency results.

I Database Management Systems (DBMS) vs. Data Stream Man-

agement Systems (DSMS)

I Storm, S4, SEEP, D-Stream, Naiad, ...

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 42 / 48

Big Data - Graph Processing

I Many problems are expressed using graphs: sparse computational

dependencies, and multiple iterations to converge.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 43 / 48

Big Data - Graph Processing

I Many problems are expressed using graphs: sparse computational

dependencies, and multiple iterations to converge.

I Data-parallel frameworks, such as MapReduce, are not ideal for

these problems: slow

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 43 / 48

Big Data - Graph Processing

I Many problems are expressed using graphs: sparse computational

dependencies, and multiple iterations to converge.

I Data-parallel frameworks, such as MapReduce, are not ideal for

these problems: slow

I Graph processing frameworks are optimized for graph-based prob-

lems.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 43 / 48

Big Data - Graph Processing

I Many problems are expressed using graphs: sparse computational

dependencies, and multiple iterations to converge.

I Data-parallel frameworks, such as MapReduce, are not ideal for

these problems: slow

I Graph processing frameworks are optimized for graph-based prob-

lems.

I Pregel, Giraph, GraphX, GraphLab, PowerGraph, GraphChi, ...

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 43 / 48

Big Data - Machine Learning

I Implementing and consuming machine learning techniques at scale

are difficult tasks for developers and end users.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 44 / 48

Big Data - Machine Learning

I Implementing and consuming machine learning techniques at scale

are difficult tasks for developers and end users.

I There exist platforms that address it by providing scalable machine-

learning and data mining libraries.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 44 / 48

Big Data - Machine Learning

I Implementing and consuming machine learning techniques at scale

are difficult tasks for developers and end users.

I There exist platforms that address it by providing scalable machine-

learning and data mining libraries.

I Mahout, MLBase, SystemML, Ricardo, Presto, ...

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 44 / 48

Big Data - Configuration and Synchronization Service

I A means to synchronize distributed applications accesses to shared

resources.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 45 / 48

Big Data - Configuration and Synchronization Service

I A means to synchronize distributed applications accesses to shared

resources.

I Allows distributed processes to coordinate with each other.

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 45 / 48

Big Data - Configuration and Synchronization Service

I A means to synchronize distributed applications accesses to shared

resources.

I Allows distributed processes to coordinate with each other.

I Zookeeper, Chubby, ...

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 45 / 48

 Summary

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 46 / 48

Summary

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 47 / 48

 Questions?

Amir H. Payberah (Tehran Polytechnic) Introduction 1393/6/22 48 / 48