Data Analytics and Big Data

by Soraya Sedkaoui

The main purpose of this book is to investigate, explore and describe approaches and methods to facilitate data understanding through analytics solutions based on its principles, concepts and applications.

Data Analytics and Big Data

Author: Soraya Sedkaoui

Publisher: John Wiley & Sons

ISBN: 1786303264

Page: 220

View: 594

The main purpose of this book is to investigate, explore and describe approaches and methods to facilitate data understanding through analytics solutions based on its principles, concepts and applications. But analyzing data is also about involving the use of software. For this, and in order to cover some aspect of data analytics, this book uses software (Excel, SPSS, Python, etc) which can help readers to better understand the analytics process in simple terms and supporting useful methods in its application.

Big Data Analytics

by Anirban Mondal

This book constitutes the refereed proceedings of the 6th International Conference on Big Data analytics, BDA 2018, held in Warangal, India, in December 2018.

Big Data Analytics

Author: Anirban Mondal

Publisher: Springer

ISBN: 3030047806

Page: 424

View: 276

This book constitutes the refereed proceedings of the 6th International Conference on Big Data analytics, BDA 2018, held in Warangal, India, in December 2018. The 29 papers presented in this volume were carefully reviewed and selected from 93 submissions. The papers are organized in topical sections named: big data analytics: vision and perspectives; financial data analytics and data streams; web and social media data; big data systems and frameworks; predictive analytics in healthcare and agricultural domains; and machine learning and pattern mining.

Big Data Analytics

by Venkat Ankam

A handy reference guide for data analysts and data scientists to help to obtain value from big data analytics using Spark on Hadoop clusters About This Book This book is based on the latest 2.0 version of Apache Spark and 2.7 version of ...

Big Data Analytics

Author: Venkat Ankam

Publisher: Packt Publishing Ltd

ISBN: 1785889702

Page: 326

View: 959

A handy reference guide for data analysts and data scientists to help to obtain value from big data analytics using Spark on Hadoop clusters About This Book This book is based on the latest 2.0 version of Apache Spark and 2.7 version of Hadoop integrated with most commonly used tools. Learn all Spark stack components including latest topics such as DataFrames, DataSets, GraphFrames, Structured Streaming, DataFrame based ML Pipelines and SparkR. Integrations with frameworks such as HDFS, YARN and tools such as Jupyter, Zeppelin, NiFi, Mahout, HBase Spark Connector, GraphFrames, H2O and Hivemall. Who This Book Is For Though this book is primarily aimed at data analysts and data scientists, it will also help architects, programmers, and practitioners. Knowledge of either Spark or Hadoop would be beneficial. It is assumed that you have basic programming background in Scala, Python, SQL, or R programming with basic Linux experience. Working experience within big data environments is not mandatory. What You Will Learn Find out and implement the tools and techniques of big data analytics using Spark on Hadoop clusters with wide variety of tools used with Spark and Hadoop Understand all the Hadoop and Spark ecosystem components Get to know all the Spark components: Spark Core, Spark SQL, DataFrames, DataSets, Conventional and Structured Streaming, MLLib, ML Pipelines and Graphx See batch and real-time data analytics using Spark Core, Spark SQL, and Conventional and Structured Streaming Get to grips with data science and machine learning using MLLib, ML Pipelines, H2O, Hivemall, Graphx, SparkR and Hivemall. In Detail Big Data Analytics book aims at providing the fundamentals of Apache Spark and Hadoop. All Spark components – Spark Core, Spark SQL, DataFrames, Data sets, Conventional Streaming, Structured Streaming, MLlib, Graphx and Hadoop core components – HDFS, MapReduce and Yarn are explored in greater depth with implementation examples on Spark + Hadoop clusters. It is moving away from MapReduce to Spark. So, advantages of Spark over MapReduce are explained at great depth to reap benefits of in-memory speeds. DataFrames API, Data Sources API and new Data set API are explained for building Big Data analytical applications. Real-time data analytics using Spark Streaming with Apache Kafka and HBase is covered to help building streaming applications. New Structured streaming concept is explained with an IOT (Internet of Things) use case. Machine learning techniques are covered using MLLib, ML Pipelines and SparkR and Graph Analytics are covered with GraphX and GraphFrames components of Spark. Readers will also get an opportunity to get started with web based notebooks such as Jupyter, Apache Zeppelin and data flow tool Apache NiFi to analyze and visualize data. Style and approach This step-by-step pragmatic guide will make life easy no matter what your level of experience. You will deep dive into Apache Spark on Hadoop clusters through ample exciting real-life examples. Practical tutorial explains data science in simple terms to help programmers and data analysts get started with Data Science

BIG DATA ANALYTICS

by Raj Kamal

This book dwells on all the aspects of Big Data Analytics and covers the subject in its entirety.

BIG DATA ANALYTICS

Author: Raj Kamal

Publisher: McGraw-Hill Education

ISBN: 9353164974

Page: 534

View: 824

Big Data Analytics(BDA) is a rapidly evolving field that finds applications in many areas such as healthcare, medicine, advertising, marketing, and sales. This book dwells on all the aspects of Big Data Analytics and covers the subject in its entirety. It comprises several illustrations, sample codes, case studies and real-life analytics of datasets such as toys, chocolates, cars, and student’s GPAs. The book will serve the interests of undergraduate and post graduate students of computer science and engineering, information technology, and related disciplines. It will also be useful to software developers. Salient Features: - Comprehensive coverage on Big Data NoSQL Column-family, Object and Graph databases, programming with open-source Big Data - Hadoop and Spark ecosystem tools, such as MapReduce, Hive, Pig, Spark, Python, Mahout, Streaming, GraphX - Inclusion of latest topics machine learning, K-NN, predictive-analytics, similar and frequent item sets, clustering, decision-tree, classifiers recommenders, real-time streaming data analytics, graph networks, text, web structure, web-links, social network analytics. - Web supplement includes instructional PPT’s, solution of exercises, analysis using open source datasets of a car company, and topics for advanced learning.

Big Data Analytics in Bioinformatics and Healthcare

by Wang, Baoying

Big Data Analytics in Bioinformatics and Healthcare merges the fields of biology, technology, and medicine in order to present a comprehensive study on the emerging information processing applications necessary in the field of electronic ...

Big Data Analytics in Bioinformatics and Healthcare

Author: Wang, Baoying

Publisher: IGI Global

ISBN: 1466666129

Page: 528

View: 423

As technology evolves and electronic data becomes more complex, digital medical record management and analysis becomes a challenge. In order to discover patterns and make relevant predictions based on large data sets, researchers and medical professionals must find new methods to analyze and extract relevant health information. Big Data Analytics in Bioinformatics and Healthcare merges the fields of biology, technology, and medicine in order to present a comprehensive study on the emerging information processing applications necessary in the field of electronic medical record management. Complete with interdisciplinary research resources, this publication is an essential reference source for researchers, practitioners, and students interested in the fields of biological computation, database management, and health information technology, with a special focus on the methodologies and tools to manage massive and complex electronic information.

Understanding Big Data Analytics for Enterprise Class Hadoop and Streaming Data

by Paul Zikopoulos

This book reveals how IBM is leveraging open source Big Data technology, infused with IBM technologies, to deliver a robust, secure, highly available, enterprise-class Big Data platform.

Understanding Big Data Analytics for Enterprise Class Hadoop and Streaming Data

Author: Paul Zikopoulos

Publisher: McGraw Hill Professional

ISBN: 0071790543

Page: 176

View: 967

Big Data represents a new era in data exploration and utilization, and IBM is uniquely positioned to help clients navigate this transformation. This book reveals how IBM is leveraging open source Big Data technology, infused with IBM technologies, to deliver a robust, secure, highly available, enterprise-class Big Data platform. The three defining characteristics of Big Data--volume, variety, and velocity--are discussed. You'll get a primer on Hadoop and how IBM is hardening it for the enterprise, and learn when to leverage IBM InfoSphere BigInsights (Big Data at rest) and IBM InfoSphere Streams (Big Data in motion) technologies. Industry use cases are also included in this practical guide. Learn how IBM hardens Hadoop for enterprise-class scalability and reliability Gain insight into IBM's unique in-motion and at-rest Big Data analytics platform Learn tips and tricks for Big Data use cases and solutions Get a quick Hadoop primer

Big Data Analytics Methods

by Peter Ghavami

This book's state of the art treatment of advanced data analytics methods and important best practices will help readers succeed in data analytics.

Big Data Analytics Methods

Author: Peter Ghavami

Publisher: Walter de Gruyter GmbH & Co KG

ISBN: 1547401583

Page: 254

View: 720

Big Data Analytics Methods unveils secrets to advanced analytics techniques ranging from machine learning, random forest classifiers, predictive modeling, cluster analysis, natural language processing (NLP), Kalman filtering and ensembles of models for optimal accuracy of analysis and prediction. More than 100 analytics techniques and methods provide big data professionals, business intelligence professionals and citizen data scientists insight on how to overcome challenges and avoid common pitfalls and traps in data analytics. The book offers solutions and tips on handling missing data, noisy and dirty data, error reduction and boosting signal to reduce noise. It discusses data visualization, prediction, optimization, artificial intelligence, regression analysis, the Cox hazard model and many analytics using case examples with applications in the healthcare, transportation, retail, telecommunication, consulting, manufacturing, energy and financial services industries. This book's state of the art treatment of advanced data analytics methods and important best practices will help readers succeed in data analytics.

Data Science and Big Data Analytics in Smart Environments

by Taylor & Francis Group

This book will primarily encompass practical approaches that advance research in all aspects of data processing, data analytics, data processing in Cloud/Edge/Fog systems, having a large variety of tools and software to manage them.

Data Science and Big Data Analytics in Smart Environments

Author: Taylor & Francis Group

Publisher: CRC Press

ISBN: 9780367407131

Page: 275

View: 346

Most applications generate large datasets, like social networking and social influence programs, smart cities applications, smart house environments, Cloud applications, public web sites, scientific experiments and simulations, data warehouse, monitoring platforms, and e-government services. Data grows rapidly, since applications produce continuously increasing volumes of both unstructured and structured data. Large-scale interconnected systems aim to aggregate and efficiently exploit the power of widely distributed resources. In this context, major solutions for scalability, mobility, reliability, fault tolerance and security are required to achieve high performance and to create a smart environment. The impact on data processing, transfer and storage is the need to re-evaluate the approaches and solutions to better answer the user needs. A variety of solutions for specific applications and platforms exist so a thorough and systematic analysis of existing solutions for data science, data analytics, methods and algorithms used in Big Data processing and storage environments is significant in designing and implementing a smart environment. Fundamental issues pertaining to smart environments (smart cities, ambient assisted leaving, smart houses, green houses, cyber physical systems, etc.) are reviewed. Most of the current efforts still do not adequately address the heterogeneity of different distributed systems, the interoperability between them, and the systems resilience. This book will primarily encompass practical approaches that promote research in all aspects of data processing, data analytics, data processing in different type of systems: Cluster Computing, Grid Computing, Peer-to-Peer, Cloud/Edge/Fog Computing, all involving elements of heterogeneity, having a large variety of tools and software to manage them. The main role of resource management techniques in this domain is to create the suitable frameworks for development of applications and deployment in smart environments, with respect to high performance. The book focuses on topics covering algorithms, architectures, management models, high performance computing techniques and large-scale distributed systems.

Data Science and Big Data Analytics

by EMC Education Services

Data Science and Big Data Analytics is about harnessing the power of data for new insights. The book covers the breadth of activities and methods and tools that Data Scientists use.

Data Science and Big Data Analytics

Author: EMC Education Services

Publisher: John Wiley & Sons

ISBN: 1118876059

Page: 432

View: 406

Data Science and Big Data Analytics is about harnessing the power of data for new insights. The book covers the breadth of activities and methods and tools that Data Scientists use. The content focuses on concepts, principles and practical applications that are applicable to any industry and technology environment, and the learning is supported and explained with examples that you can replicate using open-source software. This book will help you: Become a contributor on a data science team Deploy a structured lifecycle approach to data analytics problems Apply appropriate analytic techniques and tools to analyzing big data Learn how to tell a compelling story with data to drive business action Prepare for EMC Proven Professional Data Science Certification Corresponding data sets are available from the book’s page at Wiley which you can find on the Wiley site by searching for the ISBN 9781118876138. Get started discovering, analyzing, visualizing, and presenting data in a meaningful way today!

Big Data Analytics with Hadoop 3

by Sridhar Alla

What you will learn Explore the new features of Hadoop 3 along with HDFS, YARN, and MapReduce Get well-versed with the analytical capabilities of Hadoop ecosystem using practical examples Integrate Hadoop with R and Python for more ...

Big Data Analytics with Hadoop 3

Author: Sridhar Alla

Publisher: Packt Publishing Ltd

ISBN: 1788624955

Page: 482

View: 645

Explore big data concepts, platforms, analytics, and their applications using the power of Hadoop 3 Key Features Learn Hadoop 3 to build effective big data analytics solutions on-premise and on cloud Integrate Hadoop with other big data tools such as R, Python, Apache Spark, and Apache Flink Exploit big data using Hadoop 3 with real-world examples Book Description Apache Hadoop is the most popular platform for big data processing, and can be combined with a host of other big data tools to build powerful analytics solutions. Big Data Analytics with Hadoop 3 shows you how to do just that, by providing insights into the software as well as its benefits with the help of practical examples. Once you have taken a tour of Hadoop 3’s latest features, you will get an overview of HDFS, MapReduce, and YARN, and how they enable faster, more efficient big data processing. You will then move on to learning how to integrate Hadoop with the open source tools, such as Python and R, to analyze and visualize data and perform statistical computing on big data. As you get acquainted with all this, you will explore how to use Hadoop 3 with Apache Spark and Apache Flink for real-time data analytics and stream processing. In addition to this, you will understand how to use Hadoop to build analytics solutions on the cloud and an end-to-end pipeline to perform big data analysis using practical use cases. By the end of this book, you will be well-versed with the analytical capabilities of the Hadoop ecosystem. You will be able to build powerful solutions to perform big data analytics and get insight effortlessly. What you will learn Explore the new features of Hadoop 3 along with HDFS, YARN, and MapReduce Get well-versed with the analytical capabilities of Hadoop ecosystem using practical examples Integrate Hadoop with R and Python for more efficient big data processing Learn to use Hadoop with Apache Spark and Apache Flink for real-time data analytics Set up a Hadoop cluster on AWS cloud Perform big data analytics on AWS using Elastic Map Reduce Who this book is for Big Data Analytics with Hadoop 3 is for you if you are looking to build high-performance analytics solutions for your enterprise or business using Hadoop 3’s powerful features, or you’re new to big data analytics. A basic understanding of the Java programming language is required.

Big Data Management

by Peter Ghavami

The book is a must-read for data scientists, data engineers and corporate leaders who are implementing big data platforms in their organizations.

Big Data Management

Author: Peter Ghavami

Publisher: Walter de Gruyter GmbH & Co KG

ISBN: 3110664062

Page: 174

View: 646

Data analytics is core to business and decision making. The rapid increase in data volume, velocity and variety offers both opportunities and challenges. While open source solutions to store big data, like Hadoop, offer platforms for exploring value and insight from big data, they were not originally developed with data security and governance in mind. Big Data Management discusses numerous policies, strategies and recipes for managing big data. It addresses data security, privacy, controls and life cycle management offering modern principles and open source architectures for successful governance of big data. The author has collected best practices from the world’s leading organizations that have successfully implemented big data platforms. The topics discussed cover the entire data management life cycle, data quality, data stewardship, regulatory considerations, data council, architectural and operational models are presented for successful management of big data. The book is a must-read for data scientists, data engineers and corporate leaders who are implementing big data platforms in their organizations.

Hands On Big Data Analytics with PySpark

by Rudy Lai

In this book, you will not only learn how to use Spark and the Python API to create high-performance analytics with big data, but also discover techniques for testing, immunizing, and parallelizing Spark jobs.

Hands On Big Data Analytics with PySpark

Author: Rudy Lai

Publisher: Packt Publishing Ltd

ISBN: 1838648836

Page: 182

View: 287

Use PySpark to easily crush messy data at-scale and discover proven techniques to create testable, immutable, and easily parallelizable Spark jobs Key Features Work with large amounts of agile data using distributed datasets and in-memory caching Source data from all popular data hosting platforms, such as HDFS, Hive, JSON, and S3 Employ the easy-to-use PySpark API to deploy big data Analytics for production Book Description Apache Spark is an open source parallel-processing framework that has been around for quite some time now. One of the many uses of Apache Spark is for data analytics applications across clustered computers. In this book, you will not only learn how to use Spark and the Python API to create high-performance analytics with big data, but also discover techniques for testing, immunizing, and parallelizing Spark jobs. You will learn how to source data from all popular data hosting platforms, including HDFS, Hive, JSON, and S3, and deal with large datasets with PySpark to gain practical big data experience. This book will help you work on prototypes on local machines and subsequently go on to handle messy data in production and at scale. This book covers installing and setting up PySpark, RDD operations, big data cleaning and wrangling, and aggregating and summarizing data into useful reports. You will also learn how to implement some practical and proven techniques to improve certain aspects of programming and administration in Apache Spark. By the end of the book, you will be able to build big data analytical solutions using the various PySpark offerings and also optimize them effectively. What you will learn Get practical big data experience while working on messy datasets Analyze patterns with Spark SQL to improve your business intelligence Use PySpark's interactive shell to speed up development time Create highly concurrent Spark programs by leveraging immutability Discover ways to avoid the most expensive operation in the Spark API: the shuffle operation Re-design your jobs to use reduceByKey instead of groupBy Create robust processing pipelines by testing Apache Spark jobs Who this book is for This book is for developers, data scientists, business analysts, or anyone who needs to reliably analyze large amounts of large-scale, real-world data. Whether you're tasked with creating your company's business intelligence function or creating great data platforms for your machine learning models, or are looking to use code to magnify the impact of your business, this book is for you.

Big Data Analytics in Future Power Systems

by Ahmed F. Zobaa

Additionally, this book discusses the various security concerns that become manifest with Big Data and expanded communications in power grids.

Big Data Analytics in Future Power Systems

Author: Ahmed F. Zobaa

Publisher: CRC Press

ISBN: 1351601288

Page: 174

View: 255

Power systems are increasingly collecting large amounts of data due to the expansion of the Internet of Things into power grids. In a smart grids scenario, a huge number of intelligent devices will be connected with almost no human intervention characterizing a machine-to-machine scenario, which is one of the pillars of the Internet of Things. The book characterizes and evaluates how the emerging growth of data in communications networks applied to smart grids will impact the grid efficiency and reliability. Additionally, this book discusses the various security concerns that become manifest with Big Data and expanded communications in power grids. Provide a general description and definition of big data, which has been gaining significant attention in the research community. Introduces a comprehensive overview of big data optimization methods in power system. Reviews the communication devices used in critical infrastructure, especially power systems; security methods available to vet the identity of devices; and general security threats in CI networks. Presents applications in power systems, such as power flow and protection. Reviews electricity theft concerns and the wide variety of data-driven techniques and applications developed for electricity theft detection.

Big Data Analytics for Entrepreneurial Success

by Sedkaoui, Soraya

Big Data Analytics for Entrepreneurial Success provides emerging perspectives on the theoretical and practical aspects of data analysis tools and techniques within business applications.

Big Data Analytics for Entrepreneurial Success

Author: Sedkaoui, Soraya

Publisher: IGI Global

ISBN: 152257610X

Page: 300

View: 901

In a resolutely practical and data-driven project universe, the digital age changed the way data is collected, stored, analyzed, visualized and protected, transforming business opportunities and strategies. It is important for today’s organizations and entrepreneurs to implement a robust data strategy and industrialize a set of “data-driven” solutions to utilize big data analytics to its fullest potential. Big Data Analytics for Entrepreneurial Success provides emerging perspectives on the theoretical and practical aspects of data analysis tools and techniques within business applications. Featuring coverage on a broad range of topics such as algorithms, data collection, and machine learning, this publication provides concrete examples and case studies of successful uses of data-driven projects as well as the challenges and opportunities of generating value from data using analytics. It is ideally designed for entrepreneurs, researchers, business owners, managers, graduate students, academicians, software developers, and IT professionals seeking current research on the essential tools and technologies for organizing, analyzing, and benefiting from big data.

Handbook of Big Data Analytics

by Wolfgang Karl Härdle

Addressing a broad range of big data analytics in cross-disciplinary applications, this essential handbook focuses on the statistical prospects offered by recent developments in this field.

Handbook of Big Data Analytics

Author: Wolfgang Karl Härdle

Publisher: Springer

ISBN: 3319182846

Page: 538

View: 119

Addressing a broad range of big data analytics in cross-disciplinary applications, this essential handbook focuses on the statistical prospects offered by recent developments in this field. To do so, it covers statistical methods for high-dimensional problems, algorithmic designs, computation tools, analysis flows and the software-hardware co-designs that are needed to support insightful discoveries from big data. The book is primarily intended for statisticians, computer experts, engineers and application developers interested in using big data analytics with statistics. Readers should have a solid background in statistics and computer science.

Big Data Analytics with Vehicle Data

by Ashok Singamaneni

There is a lot of data collected from vehicles. The volume, velocity, variability and complexity of the data from various sensors are massive.

Big Data Analytics with Vehicle Data

Author: Ashok Singamaneni

Publisher:

ISBN: 9781369139341

Page: 27

View: 572

Many companies have invested a lot over the past decade just to collect the data and store them in a cloud. However collection of such large amount of data will be justified only when there are some useful insights drawn from them. There is a lot of data collected from vehicles. The volume, velocity, variability and complexity of the data from various sensors are massive. Access to this type of data is only going to increase with time, so industries need appropriate methods to transform this raw data into insights and knowledge. Extraction of insights which were previously unknown or potentially useful patterns or knowledge from this kind of these massive amounts of data can only be achieved by using Big Data analytics. Conventional software cannot handle the robustness of these, so modern tools such as Hadoop and Knime were used in this thesis to analyze the data. Raw high resolution data was used and a model was developed to understand vehicle/customer behaviors and then compared and contrasted. This thesis involves found a proper method for identifying and calculating the principal attributes that accurately and efficiently characterize a vehicle's operation. Predicting the power of new vehicles and finding the similarities between new vehicles and old vehicles was the main goal of this thesis.

Big Data Analytics

by V. B. Aggarwal

This volume focuses on Big Data Analytics. The contents of this book will be useful to researchers and students alike. This volume comprises the select proceedings of the annual convention of the Computer Society of India.

Big Data Analytics

Author: V. B. Aggarwal

Publisher: Springer

ISBN: 9811066205

Page: 766

View: 903

This volume comprises the select proceedings of the annual convention of the Computer Society of India. Divided into 10 topical volumes, the proceedings present papers on state-of-the-art research, surveys, and succinct reviews. The volumes cover diverse topics ranging from communications networks to big data analytics, and from system architecture to cyber security. This volume focuses on Big Data Analytics. The contents of this book will be useful to researchers and students alike.

Practical Guide to SAP HANA and Big Data Analytics

by Dominique Alfermann

In this book written for SAP BI, big data, and IT architects, the authors expertly provide clear recommendations for building modern analytics architectures running on SAP HANA technologies.

Practical Guide to SAP HANA and Big Data Analytics

Author: Dominique Alfermann

Publisher: Espresso Tutorials GmbH

ISBN: 3960128649

Page: 235

View: 804

In this book written for SAP BI, big data, and IT architects, the authors expertly provide clear recommendations for building modern analytics architectures running on SAP HANA technologies. Explore integration with big data frameworks and predictive analytics components. Obtain the tools you need to assess possible architecture scenarios and get guidelines for choosing the best option for your organization. Know your options for on-premise, in the cloud, and hybrid solutions. Readers will be guided through SAP BW/4HANA and SAP HANA native data warehouse scenarios, as well as field-tested integration options with big data platforms. Explore migration options and architecture best practices. Consider organizational and procedural changes resulting from the move to a new, up-to-date analytics architecture that supports your data-driven or data-informed organization. By using practical examples, tips, and screenshots, this book explores: - SAP HANA and SAP BW/4HANA architecture concepts - Predictive Analytics and Big Data component integration - Recommendations for a sustainable, future-proof analytics solutions - Organizational impact and change management

Scala Programming for Big Data Analytics

by Irfan Elahi

This is followed by sections on Scala fundamentals including mutable/immutable variables, the type hierarchy system, control flow expressions and code blocks.

Scala Programming for Big Data Analytics

Author: Irfan Elahi

Publisher: Apress

ISBN: 1484248104

Page: 306

View: 931

Gain the key language concepts and programming techniques of Scala in the context of big data analytics and Apache Spark. The book begins by introducing you to Scala and establishes a firm contextual understanding of why you should learn this language, how it stands in comparison to Java, and how Scala is related to Apache Spark for big data analytics. Next, you’ll set up the Scala environment ready for examining your first Scala programs. This is followed by sections on Scala fundamentals including mutable/immutable variables, the type hierarchy system, control flow expressions and code blocks. The author discusses functions at length and highlights a number of associated concepts such as functional programming and anonymous functions. The book then delves deeper into Scala’s powerful collections system because many of Apache Spark’s APIs bear a strong resemblance to Scala collections. Along the way you’ll see the development life cycle of a Scala program. This involves compiling and building programs using the industry-standard Scala Build Tool (SBT). You’ll cover guidelines related to dependency management using SBT as this is critical for building large Apache Spark applications. Scala Programming for Big Data Analytics concludes by demonstrating how you can make use of the concepts to write programs that run on the Apache Spark framework. These programs will provide distributed and parallel computing, which is critical for big data analytics. What You Will Learn See the fundamentals of Scala as a general-purpose programming language Understand functional programming and object-oriented programming constructs in Scala Use Scala collections and functions Develop, package and run Apache Spark applications for big data analytics Who This Book Is For Data scientists, data analysts and data engineers who intend to use Apache Spark for large-scale analytics. /div

Big Data Analytics

by Saumyadipta Pyne

This book has a collection of articles written by Big Data experts to describe some of the cutting-edge methods and applications from their respective areas of interest, and provides the reader with a detailed overview of the field of Big ...

Big Data Analytics

Author: Saumyadipta Pyne

Publisher: Springer

ISBN: 8132236289

Page: 276

View: 204

This book has a collection of articles written by Big Data experts to describe some of the cutting-edge methods and applications from their respective areas of interest, and provides the reader with a detailed overview of the field of Big Data Analytics as it is practiced today. The chapters cover technical aspects of key areas that generate and use Big Data such as management and finance; medicine and healthcare; genome, cytome and microbiome; graphs and networks; Internet of Things; Big Data standards; bench-marking of systems; and others. In addition to different applications, key algorithmic approaches such as graph partitioning, clustering and finite mixture modelling of high-dimensional data are also covered. The varied collection of themes in this volume introduces the reader to the richness of the emerging field of Big Data Analytics.