Advanced Analytics with Spark : Patterns for Learning From Data at Scale

In this practical book, four Cloudera data scientists present a set of self-contained patterns for performing large-scale data analysis with Spark. The authors bring Spark, statistical methods, and real-world data sets together to teach you how to approach analytics problems by example. You'll start with an introduction to Spark and its ecosystem, and then dive into patterns that apply common techniques-classification, collaborative filtering, and anomaly detection among others-to fields such as genomics, security, and finance. If you have an entry-level understanding of machine learning and statistics, and you program in Java, Python, or Scala, you'll find these patterns useful for working on your own data applications. Patterns include: Recommending music and the Audioscrobbler data set, Predicting forest cover with decision trees, Anomaly detection in network traffic with K-means clustering, Understanding Wikipedia with Latent Semantic Analysis, Analyzing co-occurrence networks with GraphX, Geospatial and temporal data analysis on the New York City Taxi Trips data, Estimating financial risk through Monte Carlo simulation, Analyzing genomics data and the BDG project and Analyzing neuroimaging data with PySpark and Thunder." from publisher's website;Analyzing big data -- Introduction to data analysis with Scala and Spark -- Recommending music and the audioscrobbler data set -- Predicting forest cover with decision trees -- Anomaly detection in network traffic with K-means clustering -- Understanding Wikipedia with latent semantic analysis -- Analyzing co-occurrence networks with GraphX -- Geospatial and temporal data analysis on the New York City taxi trip data -- Estimating financial risk through Monte Carlo simulation -- Analyzing genomics data and the BDG project -- Analyzing neuroimaging data with PySpark and Thunder In this practical book, four Cloudera data scientists present a set of self-contained patterns for performing large-scale data analysis with Spark. The authors bring Spark, statistical methods, and real-world data sets together to teach you how to approach analytics problems by example.You’ll start with an introduction to Spark and its ecosystem, and then dive into patterns that apply common techniques—classification, collaborative filtering, and anomaly detection among others—to fields such as genomics, security, and finance. If you have an entry-level understanding of machine learning and statistics, and you program in Java, Python, or Scala, you’ll find these patterns useful for working on your own data applications.Patterns include:Recommending music and the Audioscrobbler data setPredicting forest cover with decision treesAnomaly detection in network traffic with K-means clusteringUnderstanding Wikipedia with Latent Semantic AnalysisAnalyzing co-occurrence networks with GraphXGeospatial and temporal data analysis on the New York City Taxi Trips dataEstimating financial risk through Monte Carlo simulationAnalyzing genomics data and the BDG projectAnalyzing neuroimaging data with PySpark and Thunder In this practical book, four Cloudera data scientists present a set of self-contained patterns for performing large-scale data analysis with Spark. The authors bring Spark, statistical methods, and real-world data sets together to teach you how to approach analytics problems by example. You{u2019}ll start with an introduction to Spark and its ecosystem, and then dive into patterns that apply common techniques{u2014}classification, collaborative filtering, and anomaly detection among others{u2014}to fields such as genomics, security, and finance. If you have an entry-level understanding of machine learning and statistics, and you program in Java, Python, or Scala, you{u2019}ll find these patterns useful for working on your own data applications. Patterns include: Recommending music and the Audioscrobbler data set Predicting forest cover with decision trees Anomaly detection in network traffic with K-means clustering Understanding Wikipedia with Latent Semantic Analysis Analyzing co-occurrence networks with GraphX Geospatial and temporal data analysis on the New York City Taxi Trips data Estimating financial risk through Monte Carlo simulation Analyzing genomics data and the BDG project Analyzing neuroimaging data with PySpark and Thunder In the second edition of this practical book, four Cloudera data scientists present a set of self-contained patterns for performing large-scale data analysis with Spark. The authors bring Spark, statistical methods, and real-world data sets together to teach you how to approach analytics problems by example. Updated for Spark 2.1, this edition acts as an introduction to these techniques and other best practices in Spark programming. Youll start with an introduction to Spark and its ecosystem, and then dive into patterns that apply common techniquesincluding classification, clustering, collaborative filtering, and anomaly detectionto fields such as genomics, security, and finance. If you have an entry-level understanding of machine learning and statistics, and you program in Java, Python, or Scala, youll find the books patterns useful for working on your own data applications. With this book, you The authors bring Spark, statistical methods, and real-world data sets together to teach you how to approach analytics problems by presenting examples and a set of self-contained patterns for performing large-scale data analysis with Spark. You'll start with an introduction to Spark and its ecosystem, and then dive into patterns that apply common techniques-classification, collaborative filtering, and anomaly detection among others-to fields such as genomics, security, and finance. If you have an entry-level understanding of machine learning and statistics, and you program in Java, Python, or Scala, you'll find these patterns useful for working on your own data applications Sandy Ryza, Uri Laserson, Sean Owen And Josh Wills. Previous Edition Published: 2015. Includes Index.