Scala for Machine Learning

Table of Contents

Scala for Machine Learning

Credits

About the Author

About the Reviewers

www.PacktPub.com

Support files, eBooks, discount offers, and more

Why subscribe?

Free access for Packt account holders

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Downloading the example code

Errata

Piracy

Questions

1. Getting Started

Mathematical notation for the curious

Why machine learning?

Classification

Prediction

Optimization

Regression

Why Scala?

Abstraction

Scalability

Configurability

Maintainability

Computation on demand

Model categorization

Taxonomy of machine learning algorithms

Unsupervised learning

Clustering

Dimension reduction

Supervised learning

Generative models

Discriminative models

Reinforcement learning

Tools and frameworks

Java

Scala

Apache Commons Math

Description

Licensing

Installation

JFreeChart

Description

Licensing

Installation

Other libraries and frameworks

Source code

Context versus view bounds

Presentation

Primitives and implicits

Primitive types

Type conversions

Operators

Immutability

Performance of Scala iterators

Let's kick the tires

Overview of computational workflows

Writing a simple workflow

Selecting a dataset

Loading the dataset

Preprocessing the dataset

Basic statistics

Normalization and Gauss distribution

Plotting data

Creating a model (learning)

Classify the data

Summary

2. Hello World!

Modeling

A model by any other name

Model versus design

Selecting a model's features

Extracting features

Designing a workflow

The computational framework

The pipe operator

Monadic data transformation

Dependency injection

Workflow modules

The workflow factory

Examples of workflow components

The preprocessing module

The clustering module

Assessing a model

Validation

Key metrics

Implementation

K-fold cross-validation

Bias-variance decomposition

Overfitting

Summary

3. Data Preprocessing

Time series

Moving averages

The simple moving average

The weighted moving average

The exponential moving average

Fourier analysis

Discrete Fourier transform (DFT)

DFT-based filtering

Detection of market cycles

The Kalman filter

The state space estimation

The transition equation

The measurement equation

The recursive algorithm

Prediction

Correction

Kalman smoothing

Experimentation

Alternative preprocessing techniques

Summary

4. Unsupervised Learning

Clustering

K-means clustering

Measuring similarity

Overview of the K-means algorithm

Step 1 – cluster configuration

Defining clusters

Defining K-means

Initializing clusters

Step 2 – cluster assignment

Step 3 – iterative reconstruction

Curse of dimensionality

Experiment

Tuning the number of clusters

Validation

Expectation-maximization (EM) algorithm

Gaussian mixture model

EM overview

Implementation

Testing

Online EM

Dimension reduction

Principal components analysis (PCA)

Algorithm

Implementation

Test case

Evaluation

Other dimension reduction techniques

Performance considerations

K-means

EM

PCA

Summary

5. Naïve Bayes Classifiers

Probabilistic graphical models

Naïve Bayes classifiers

Introducing the multinomial Naïve Bayes

Formalism

The frequentist perspective

The predictive model

The zero-frequency problem

Implementation

Software design

Training

Classification

Labeling

Results

Multivariate Bernoulli classification

Model

Implementation

Naïve Bayes and text mining

Basics of information retrieval

Implementation

Extraction of terms

Scoring of terms

Testing

Retrieving textual information

Evaluation

Pros and cons

Summary

6. Regression and Regularization

Linear regression

One-variate linear regression

Implementation

Test case

Ordinary least squares (OLS) regression

Design

Implementation

Test case 1 – trending

Test case 2 – features selection

Regularization

Ln roughness penalty

The ridge regression

Implementation

The test case

Numerical optimization

The logistic regression

The logit function

Binomial classification

Software design

The training workflow

Configuring the least squares optimizer

Computing the Jacobian matrix

Defining the exit conditions

Defining the least squares problem

Minimizing the loss function

Test

Classification

Summary

7. Sequential Data Models

Markov decision processes

The Markov property

The first-order discrete Markov chain

The hidden Markov model (HMM)

Notation

The lambda model

HMM execution state

Evaluation (CF-1)

Alpha class (the forward variable)

Beta class (the backward variable)

Training (CF-2)

Baum-Welch estimator (EM)

Decoding (CF-3)

The Viterbi algorithm

Putting it all together

Test case

The hidden Markov model for time series analysis

Conditional random fields

Introduction to CRF

Linear chain CRF

CRF and text analytics

The feature functions model

Software design

Implementation

Building the training set

Generating tags

Extracting data sequences

CRF control parameters

Putting it all together

Tests

The training convergence profile

Impact of the size of the training set

Impact of the L2 regularization factor

Comparing CRF and HMM

Performance consideration

Summary

8. Kernel Models and Support Vector Machines

Kernel functions

Overview

Common discriminative kernels

The support vector machine (SVM)

The linear SVM

The separable case (hard margin)

The nonseparable case (soft margin)

The nonlinear SVM

Max-margin classification

The kernel trick

Support vector classifier (SVC)

The binary SVC

LIBSVM

Software design

Configuration parameters

SVM Formulation

The SVM kernel function

SVM execution

SVM implementation

C-penalty and margin

Kernel evaluation

Application to risk analysis

Features and labels

Anomaly detection with one-class SVC

Support vector regression (SVR)

Overview

SVR versus linear regression

Performance considerations

Summary

9. Artificial Neural Networks

Feed-forward neural networks (FFNN)

The Biological background

The mathematical background

The multilayer perceptron (MLP)

The activation function

The network architecture

Software design

Model definition

Layers

Synapses

Connections

Training cycle/epoch

Step 1 – input forward propagation

The computational model

Objective

Softmax

Step 2 – sum of squared errors

Step 3 – error backpropagation

Error propagation

The computational model

Step 4 – synapse/weights adjustment

Momentum factor for gradient descent

Implementation

Step 5 – convergence criteria

Configuration

Putting all together

Training strategies and classification

Online versus batch training

Regularization

Model instantiation

Prediction

Evaluation

Impact of learning rate

Impact of the momentum factor

Test case

Implementation

Models evaluation

Impact of hidden layers architecture

Benefits and limitations

Summary

10. Genetic Algorithms

Evolution

The origin

NP problems

Evolutionary computing

Genetic algorithms and machine learning

Genetic algorithm components

Encodings

Value encoding

Predicate encoding

Solution encoding

The encoding scheme

Flat encoding

Hierarchical encoding

Genetic operators

Selection

Crossover

Mutation

Fitness score

Implementation

Software design

Key components

Selection

Controlling population growth

GA configuration

Crossover

Population

Chromosomes

Genes

Mutation

Population

Chromosomes

Genes

The reproduction cycle

GA for trading strategies

Definition of trading strategies

Trading operators

The cost/unfitness function

Trading signals

Trading strategies

Signal encoding

Test case

Data extraction

Initial population

Configuration

GA instantiation

GA execution

Tests

The unweighted score

The weighted score

Advantages and risks of genetic algorithms

Summary

11. Reinforcement Learning

Introduction

The problem

A solution – Q-learning

Terminology

Concept

Value of policy

Bellman optimality equations

Temporal difference for model-free learning

Action-value iterative update

Implementation

Software design

States and actions

Search space

Policy and action-value

The Q-learning training

Tail recursion to the rescue

Prediction

Option trading using Q-learning

Option property

Option model

Function approximation

Constrained state-transition

Putting it all together

Evaluation

Pros and cons of reinforcement learning

Learning classifier systems

Introduction to LCS

Why LCS

Terminology

Extended learning classifier systems (XCS)

XCS components

Application to portfolio management

XCS core data

XCS rules

Covering

Example of implementation

Benefits and limitation of learning classifier systems

Summary

12. Scalable Frameworks

Overview

Scala

Controlling object creation

Parallel collections

Processing a parallel collection

Benchmark framework

Performance evaluation

Scalability with Actors

The Actor model

Partitioning

Beyond actors – reactive programming

Akka

Master-workers

Messages exchange

Worker actors

The workflow controller

The master Actor

Master with routing

Distributed discrete Fourier transform

Limitations

Futures

The Actor life cycle

Blocking on futures

Handling future callbacks

Putting all together

Apache Spark

Why Spark

Design principles

In-memory persistency

Laziness

Transforms and Actions

Shared variables

Experimenting with Spark

Deploying Spark

Using Spark shell

MLlib

RDD generation

K-means using Spark

Performance evaluation

Tuning parameters

Tests

Performance considerations

Pros and cons

0xdata Sparkling Water

Summary

A. Basic Concepts

Scala programming

List of libraries

Format of code snippets

Encapsulation

Class constructor template

Companion objects versus case classes

Enumerations versus case classes

Overloading

Design template for classifiers

Data extraction

Data sources

Extraction of documents

Matrix class

Mathematics

Linear algebra

QR Decomposition

LU factorization

LDL decomposition

Cholesky factorization

Singular value decomposition

Eigenvalue decomposition

Algebraic and numerical libraries

First order predicate logic

Jacobian and Hessian matrices

Summary of optimization techniques

Gradient descent methods

Steepest descent

Conjugate gradient

Stochastic gradient descent

Quasi-Newton algorithms

BFGS

L-BFGS

Nonlinear least squares minimization

Gauss-Newton

Levenberg-Marquardt

Lagrange multipliers

Overview of dynamic programming

Finances 101

Fundamental analysis

Technical analysis

Terminology

Trading signals and strategy

Price patterns

Options trading

Financial data sources

Suggested online courses

References

Index

Scala for Machine Learning

Scala for Machine Learning

Copyright © 2014 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

First published: December 2014

Production reference: 1121214

Published by Packt Publishing Ltd.

Livery Place

35 Livery Street

Birmingham B3 2PB, UK.

ISBN 978-1-78355-874-2

www.packtpub.com

Credits

Author

Patrick R. Nicolas

Reviewers

Subhajit Datta

Rui Gonçalves

Patricia Hoffman, PhD

Md Zahidul Islam

Commissioning Editor

Owen Roberts

Acquisition Editor

Owen Roberts

Content Development Editor

Mohammed Fahad

Technical Editors

Madhuri Das

Taabish Khan

Copy Editors

Janbal Dharmaraj

Vikrant Phadkay

Project Coordinator

Danuta Jones

Proofreaders

Simran Bhogal

Maria Gould

Paul Hindle

Elinor Perry-Smith

Chris Smith

Indexer

Mariammal Chettiyar

Graphics

Sheetal Aute

Valentina D'silva

Disha Haria

Abhinash Sahu

Production Coordinator

Arvindkumar Gupta

Cover Work

Arvindkumar Gupta

About the Author

Patrick R. Nicolas is a lead R&D engineer at Dell in Santa Clara, California. He has 25 years of experience in software engineering and building large-scale applications in C++, Java, and Scala, and has held several managerial positions. His interests include real-time analytics, modeling, and optimization.

Special thanks to the Packt Publishing team: Mohammed Fahad for his patience and encouragement, Owen Roberts for the opportunity, and the reviewers for their guidance and dedication.

About the Reviewers

Subhajit Datta is a passionate software developer.

He did his Bachelor of Engineering in Information Technology (BE in IT) from Indian Institute of Engineering Science and Technology, Shibpur (IIEST, Shibpur), formerly known as Bengal Engineering and Science University, Shibpur.

He completed his Master of Technology in Computer Science and Engineering (MTech CSE) from Indian Institute of Technology Bombay (IIT Bombay); his thesis focused on topics in natural language processing.

He has experience working in the investment banking domain and web application domain, and is a polyglot having worked on Java, Scala, Python, Unix shell scripting, VBScript, JavaScript, C#.Net, and PHP. He is interested in learning and applying new and different technologies.

He believes that choosing the right programming language, tool, and framework for the problem at hand is more important than trying to fit all problems in one technology.

He also has experience working in the Waterfall and Agile processes. He is excited about the Agile software development processes.

Rui Gonçalves is an all-round, hardworking, and dedicated software engineer. He is an enthusiast of software architecture, programming paradigms, algorithms, and data structures with the ambition of developing products and services that have a great impact on society.

He currently works at ShiftForward, where he is a software engineer in the online advertising field. He is focused on designing and implementing highly efficient, concurrent, and scalable systems as well as machine learning solutions. In order to achieve this, he uses Scala as the main development language of these systems on a day-to-day basis.

Patricia Hoffman, PhD, is a consultant at iCube Consulting Service Inc., with over 25 years of experience in modeling and simulation, of which the last six years concentrated on machine learning and data mining technologies. Her software development experience ranges from modeling stochastic partial differential equations to image processing. She is currently an adjunct faculty member at International Technical University, teaching machine learning courses. She also teaches machine learning and data mining at the University of California, Santa Cruz—Silicon Valley Campus. She was Chair of Association for Computing Machinery of the Data Mining Special Interest Group for the San Francisco Bay area for 5 years, organizing monthly lectures and five data mining conferences with over 350 participants.

Patricia has a long list of significant accomplishments. She developed the architecture and software development plan for a collaborative recommendation system while consulting as a data mining expert for Quantum Capital. While consulting for Revolution Analytics, she developed training materials for interfacing the R statistical language with IBM's Netezza data warehouse appliance.

She has also set up the systems used for communication and software development along with technical coordination for GTECH, a medical device start-up.

She has also technically directed, produced, and managed operations concepts and architecture analysis for hardware, software, and firmware. She has performed risk assessments and has written qualification letters, proposals, system specs, and interface control documents. Also, she has coordinated with subcontractors, associate contractors, and various Lockheed departments to produce analysis, documents, technology demonstrations, and integrated systems. She was the Chief Systems Engineer for a $12 million image processing workstation development, and had scored 100 percent from the customer.

The various contributions of Patricia to the publications field are as follows:

A unified view on the rotational symmetry of equilibria of nematic polymers, dipolar nematic polymers, and polymers in higher dimensional space, Communications in Mathematical Sciences,Volume 6, 949-974

She worked as a technical editor on the book Machine Learning in Action, Peter Harrington, Manning Publications Co.

A Distributed Architecture for the C3 I (Command, Control, Communications, and Intelligence) Collection Management Expert System, with Allen Rude, AIC Lockheed

A book review of computer-supported cooperative work, ACM/SIGCHI Bulletin, Volume 21, Issue 2, pages 125-128, ISSN:0736-6906, 1989

Md Zahidul Islam is a software developer working for HSI Health and lives in Concord, California, with his wife.

He has a passion for functional programming, machine learning, and working with data. He is currently working with Scala, Apache Spark, MLlib, Ruby on Rails, ElasticSearch, MongoDB, and Backbone.js. Earlier in his career, he worked with C#, ASP.NET, and everything around the .NET ecosystem.

I would like to thank my wife, Sandra, who lovingly supports me in everything I do. I'd also like to thank Packt Publishing and its staff for the opportunity to contribute to this book.

www.PacktPub.com

Support files, eBooks, discount offers, and more

For support files and downloads related to your book, please visit www.PacktPub.com.

Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.PacktPub.com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at for more details.

At www.PacktPub.com, you can also read a collection of free technical articles, sign up for a range of free newsletters and receive exclusive discounts and offers on Packt books and eBooks.

https://www2.packtpub.com/books/subscription/packtlib

Do you need instant solutions to your IT questions? PacktLib is Packt's online digital book library. Here, you can search, access, and read Packt's entire library of books.

Why subscribe?

Fully searchable across every book published by Packt

Copy and paste, print, and bookmark content

On demand and accessible via a web browser

Free access for Packt account holders

If you have an account with Packt at www.PacktPub.com, you can use this to access PacktLib today and view 9 entirely free books. Simply use your login credentials for immediate access.

To Jennifer, for her kindness and support throughout this long journey.

Preface

Not a single day passes by that we do not hear about Big Data in the news media, technical conferences, and even coffee shops. The ever-increasing amount of data collected in process monitoring, research, or simple human behavior becomes valuable only if you extract knowledge from it. Machine learning is the essential tool to mine data for gold (knowledge).

This book covers the what, why, and how of machine learning:

What are the objectives and the mathematical foundation of machine learning?

Why is Scala the ideal programming language to implement machine learning algorithms?

How can you apply machine learning to solve real-world problems?

Throughout this book, machine learning algorithms are described with diagrams, mathematical formulation, and documented snippets of Scala code, allowing you to understand these key concepts in your own unique way.

What this book covers

Chapter 1, Getting Started, introduces the basic concepts of statistical analysis, classification, regression, prediction, clustering, and optimization. This chapter covers the Scala languages features and libraries, followed by the implementation of a simple application.

Chapter 2, Hello World!, describes a typical workflow for classification, the concept of bias/variance trade-off, and validation using the Scala dependency injection applied to the technical analysis of financial markets.

Chapter 3, Data Preprocessing, covers time series analyses and leverages Scala to implement data preprocessing and smoothing techniques such as moving averages, discrete Fourier transform, and the Kalman recursive filter.

Chapter 4, Unsupervised Learning, focuses on the implementation of some of the most widely used clustering techniques, such as K-means, the expectation-maximization, and the principal component analysis as a dimension reduction method.

Chapter 5, Naïve Bayes Classifiers, introduces probabilistic graphical models, and then describes the implementation of the Naïve Bayes and the multivariate Bernoulli classifiers in the context of text mining.

Chapter 6, Regression and Regularization, covers a typical implementation of the linear and least squares regression, the ridge regression as a regularization technique, and finally, the logistic regression.

Chapter 7, Sequential Data Models, introduces the Markov processes followed by a full implementation of the hidden Markov model, and conditional random fields applied to pattern recognition in financial market data.

Chapter 8, Kernel Models and Support Vector Machines, covers the concept of kernel functions with implementation of support vector machine classification and regression, followed by the application of the one-class SVM to anomaly detection.

Chapter 9, Artificial Neural Networks, describes feed-forward neural networks followed by a full implementation of the multilayer perceptron classifier.

Chapter 10, Genetic Algorithms, covers the basics of evolutionary computing and the implementation of the different components of a multipurpose genetic algorithm.

Chapter 11, Reinforcement Learning, introduces the concept of reinforcement learning with an implementation of the Q-learning algorithm followed by a template to build a learning classifier system.

Chapter 12, Scalable Frameworks, covers some of the artifacts and frameworks to create scalable applications for machine learning such as Scala parallel collections, Akka, and the Apache Spark framework.

Appendix A, Basic Concepts, covers the Scala constructs used throughout the book, elements of linear algebra, and an introduction to investment and trading strategies.

Appendix B, References, provides a chapter-wise list of references for [source entry] in the respective chapters. This appendix is available as an online chapter at https://www.packtpub.com/sites/default/files/downloads/8742OS_AppendixB_References.pdf.