Mastering Apache Spark 2.x

Mastering Apache Spark 2.x

Advanced analytics on your Big Data with latest Apache Spark 2.x About This Book An advanced guide with a combination of instructions and practical examples to extend the most up-to date Spark functionalities. Extend your data processing capabilities to process huge chunk of data in minimum time using advanced concepts in Spark. Master the art of real-time processing with the help of Apache Spark 2.x Who This Book Is For If you are a developer with some experience with Spark and want to strengthen your knowledge of how to get around in the world of Spark, then this book is ideal for you. Basic knowledge of Linux, Hadoop and Spark is assumed. Reasonable knowledge of Scala is expected. What You Will Learn Examine Advanced Machine Learning and DeepLearning with MLlib, SparkML, SystemML, H2O and DeepLearning4J Study highly optimised unified batch and real-time data processing using SparkSQL and Structured Streaming Evaluate large-scale Graph Processing and Analysis using GraphX and GraphFrames Apply Apache Spark in Elastic deployments using Jupyter and Zeppelin Notebooks, Docker, Kubernetes and the IBM Cloud Understand internal details of cost based optimizers used in Catalyst, SystemML and GraphFrames Learn how specific parameter settings affect overall performance of an Apache Spark cluster Leverage Scala, R and python for your data science projects In Detail Apache Spark is an in-memory cluster-based parallel processing system that provides a wide range of functionalities such as graph processing, machine learning, stream processing, and SQL. This book aims to take your knowledge of Spark to the next level by teaching you how to expand Spark's functionality and implement your data flows and machine/deep learning programs on top of the platform. The book commences with an overview of the Spark ecosystem. It will introduce you to Project Tungsten and Catalyst, two of the major advancements of Apache Spark 2.x. You will understand how memory management and binary processing, cache-aware computation, and code generation are used to speed things up dramatically. The book extends to show how to incorporate H20, SystemML, and Deeplearning4j for machine learning, and Jupyter Notebooks and Kubernetes/Docker for cloud-based Spark. During the course of the book, you will learn about the latest enhancements to Apache Spark 2.x, such as interactive querying of live data and unifying DataFrames and Datasets. You will also learn about the updates on the APIs and how DataFrames and Datasets affect SQL, machine learning, graph processing, and streaming. You will learn to use Spark as a big data operating system, understand how to implement advanced analytics on the new APIs, and explore how easy it is to use Spark in day-to-day tasks. Style and approach This book is an extensive guide to Apache Spark modules and tools and shows how Spark's functionality can be extended for real-time processing and storage with worked examples.


Author
Publisher Packt Publishing Ltd
Release Date
ISBN 178528522X
Pages 354 pages
Rating 4/5 (26 users)

More Books:

Mastering Apache Spark 2.x
Language: en
Pages: 354
Authors: Romeo Kienzler
Categories: Computers
Type: BOOK - Published: 2017-07-26 - Publisher: Packt Publishing Ltd

Advanced analytics on your Big Data with latest Apache Spark 2.x About This Book An advanced guide with a combination of instructions and practical examples to
Mastering Machine Learning with Spark 2.x
Language: en
Pages: 340
Authors: Alex Tellez
Categories: Computers
Type: BOOK - Published: 2017-08-31 - Publisher: Packt Publishing Ltd

Unlock the complexities of machine learning algorithms in Spark to generate useful data insights through this data analysis tutorial About This Book Process and
Apache Spark 2.x for Java Developers
Language: en
Pages: 350
Authors: Sourav Gulati
Categories: Computers
Type: BOOK - Published: 2017-07-26 - Publisher: Packt Publishing Ltd

Unleash the data processing and analytics capability of Apache Spark with the language of choice: Java About This Book Perform big data processing with Spark—
Apache Spark Deep Learning Cookbook
Language: en
Pages: 474
Authors: Ahmed Sherif
Categories: Computers
Type: BOOK - Published: 2018-07-13 - Publisher: Packt Publishing Ltd

A solution-based guide to put your deep learning models into production with the power of Apache Spark Key Features Discover practical recipes for distributed d
Mastering Apache Cassandra 3.x
Language: en
Pages: 348
Authors: Aaron Ploetz
Categories: Computers
Type: BOOK - Published: 2018-10-31 - Publisher: Packt Publishing Ltd

This practical guide explains you to program and understand the power of Apache Cassandra 3.x. You will explore the integration and interaction of Cassandra com
Business Analytics
Language: en
Pages: 156
Authors: Thomas W. Jackson
Categories: Business & Economics
Type: BOOK - Published: 2018-09-21 - Publisher: Bloomsbury Publishing

This innovative new textbook, co-authored by an established academic and a leading practitioner, is the first to bring together issues of cloud computing, busin
BIG DATA ANALYTICS
Language: en
Pages: 534
Authors: Raj Kamal
Categories: Computers
Type: BOOK - Published: 2019-02-16 - Publisher: McGraw-Hill Education

Big Data Analytics(BDA) is a rapidly evolving field that finds applications in many areas such as healthcare, medicine, advertising, marketing, and sales. This
Mastering TensorFlow 2.x
Language: en
Pages: 418
Authors: Rajdeep
Categories: Antiques & Collectibles
Type: BOOK - Published: 2022-03-24 - Publisher: BPB Publications

Work with TensorFlow and Keras for real performance of deep learning KEY FEATURES ● Combines theory and implementation with in-detail use-cases. ● Coverage
Network and System Security
Language: en
Pages: 731
Authors: Joseph K. Liu
Categories: Computers
Type: BOOK - Published: 2019-12-10 - Publisher: Springer Nature

This book constitutes the proceedings of the 13th International Conference on Network and System Security, NSS 2019, held in Sapporo, Japan, in December 2019. T
Mastering Hadoop 3
Language: en
Pages: 544
Authors: Chanchal Singh
Categories: Computers
Type: BOOK - Published: 2019-02-28 - Publisher: Packt Publishing Ltd

A comprehensive guide to mastering the most advanced Hadoop 3 concepts Key Features Get to grips with the newly introduced features and capabilities of Hadoop 3