Everand Logo

Welcome to Everand!

  • Discover millions of ebooks, audiobooks, and so much more with a free trial

    Only $11.99/month after trial. Cancel anytime.

    Unavailable
    Fast Data Processing with Spark
    Unavailable
    Fast Data Processing with Spark
    Unavailable
    Fast Data Processing with Spark
    Ebook244 pages1 hour

    Fast Data Processing with Spark

    By Holden Karau

    1/5

    ()

    Currently unavailable

    Currently unavailable

    About this ebook

    In Detail

    Spark is a framework for writing fast, distributed programs. Spark solves similar problems as Hadoop MapReduce does but with a fast in-memory approach and a clean functional style API. With its ability to integrate with Hadoop and inbuilt tools for interactive query analysis (Shark), large-scale graph processing and analysis (Bagel), and real-time analysis (Spark Streaming), it can be interactively used to quickly process and query big data sets.

    Fast Data Processing with Spark covers how to write distributed map reduce style programs with Spark. The book will guide you through every step required to write effective distributed programs from setting up your cluster and interactively exploring the API, to deploying your job to the cluster, and tuning it for your purposes.

    Fast Data Processing with Spark covers everything from setting up your Spark cluster in a variety of situations (stand-alone, EC2, and so on), to how to use the interactive shell to write distributed code interactively. From there, we move on to cover how to write and deploy distributed jobs in Java, Scala, and Python.

    We then examine how to use the interactive shell to quickly prototype distributed programs and explore the Spark API. We also look at how to use Hive with Spark to use a SQL-like query syntax with Shark, as well as manipulating resilient distributed datasets (RDDs).

    Approach

    This book will be a basic, step-by-step tutorial, which will help readers take advantage of all that Spark has to offer.

    Who this book is for

    Fast Data Processing with Spark is for software developers who want to learn how to write distributed programs with Spark. It will help developers who have had problems that were too much to be dealt with on a single computer. No previous experience with distributed programming is necessary. This book assumes knowledge of either Java, Scala, or Python.

    LanguageEnglish
    PublisherPackt Publishing
    Release dateOct 23, 2013
    ISBN9781782167075
    Unavailable
    Fast Data Processing with Spark
    Author

    Holden Karau

    Holden Karau is a queer transgender Canadian, Apache Spark committer, Apache Software Foundation member, and an active open source contributor. She also extends her passion for building community with industry projects including Scaling for Python for ML and teaching distributed computing to children. As a software engineer, she's worked on a variety of distributed compute, search, and classification problems at Google, IBM, Alpine, Databricks, Foursquare, and Amazon. She graduated from the University of Waterloo with a bachelor of mathematics in computer science. Outside of software she enjoys playing with fire, welding, riding scooters, eating poutine, and dancing.

    Related to Fast Data Processing with Spark

    Related ebooks

    Programming For You

    View More
    View More

    Related podcast episodes

    Related articles

    • Article

      DJANGO Create A Database-driven Website

      Jun 4, 2019

      The Django web framework was named after the famous guitarist Django Reinhardt and was first created by web developers at a small newspaper in Kansas. The main goals of Django is to enable fast development of complex websites with database needs. It

      7 min read

    • Article

      FLASK Web Frameworks

      Jun 4, 2019

      The main focus of Python has always been to get you cracking on with your coding – the language was never made for web programming. However, this has just made it more interesting to extend the language for the web, or to create an interface to web-b

      9 min read

    • Article

      HotPicks

      Jun 27, 2023

      HotPicks
      12 min read

    • Article

      Developer Tools

      Mar 1, 2022

      Developer Tools
      1 min read

    • Article

      Developer Tools

      May 2, 2022

      Developer Tools
      1 min read

    • Article

      Usability

      Oct 19, 2021

      Usability
      3 min read

    • Article

      Get To Grips With Kali

      May 2, 2023

      Get To Grips With Kali
      5 min read

    • Article

      Group Test

      Nov 8, 2022

      Group Test
      5 min read

    • Article

      Mind Your Language!

      Apr 4, 2023

      Mind Your Language!
      9 min read

    • Article

      Craft A Perfect Personal Document Library

      Jan 26, 2023

      There are countless apps available that can be used to organise your notes and also many word processors designed to help you create smart-looking documents, but Craft aims to do both in style. The idea is to include a huge number of advanced documen

      1 min read

    • Article

      HotPicks

      Nov 15, 2022

      HotPicks
      12 min read

    • Article

      Manage Your Apps!

      Nov 14, 2023

      Manage Your Apps!
      17 min read

    • Article

      Mac Writing Apps

      Nov 15, 2022

      Mac Writing Apps
      5 min read

    • Article

      Top 10 Programming Languages

      Jan 5, 2023

      Top 10 Programming Languages
      8 min read

    • Article

      Get Packing!

      May 3, 2022

      Get Packing!
      8 min read

    • Article

      Get Packing!

      May 3, 2022

      Get Packing!
      8 min read

    • Article

      Free All Your Files

      Jul 25, 2023

      Free All Your Files
      16 min read

    • Article

      Newsdesk

      Dec 13, 2022

      OPEN SOURCE FUNDING GitHub, Fastly and Mozilla are all looking for new projects to back, giving a boost to open source development. Small open source projects might be created solely by enthusiasts but most make use of outside developers, often paid

      9 min read

    • Article

      Poisoning The Well

      Jan 11, 2022

      Poisoning The Well
      4 min read

    Reviews for Fast Data Processing with Spark

    1/5

    1 rating1 review

    What did you think?

    Tap to rate

    Review must be at least 10 words

    • 1/5
      O livro é muito mal escrito, mal elaborado e com pouco conteúdo. Não recomendo.