Big Data: Apache Spark 2.0 with Scala

Location
Online
Dates
Can be taken anytime
Course Type
Professional Training Course
Accreditation
Yes (Details)
Language
English
Price
$10

Course Overview

Big Data Analysis is the hottest selling skill in the market currently. All major companies use Big Data Analysis to generate reports and plan accurately for the future. This course will help you Learn and master the art of framing data analysis problems as Spark problems through over 20 hands-on examples, and then scale them up to run on cloud computing services in this course. By the end of this course, you can expect to be able to run code that analyses gigabytes worth of information - in the cloud - in a matter of minutes.

Coupon code - WIISEGT

Who should take this course

It is available for all the learners.

Accreditation

WIISE

Course content

The outline of this course is mentioned below:

Introduction:

  • Introduction
  • Histogram Creation: Real Movie Ratings with Spark

Scala Crash Course:

  • Basics of Scala: Part 1
  • Basics of Scala: Part 2
  • Scala: Flow Control
  • Scala: Functions
  • Scala: Data Structures

Basics of Spark:

  • Introduction to Spark
  • The Resilient Distributed Dataset (RDD)
  • Ratings: Histogram Walkthrough
  • Spark Internals
  • Key / Value RDD's
  • Running the Average Friends by Age Example
  • Filtering RDD's
  • Example: Minimum Temperature and Modifying it for Maximum
  • Counting Word Occurrences using Flatmap
  • Improving the Word Count Script with Regular Expressions
  • Sorting the Word Count Results
  • Total Amount Spent by Customer
  • Results and Sorting
  • Results and Implementation Against Mine

Advanced Examples of Spark Programs:

  • Most Popular Movie
  • Broadcast Variables to Display Movie Names
  • Most Popular Superhero in a Social Graph
  • Superhero Degrees of Separation: Introducing Breadth-First Search
  • Superhero Degrees of Separation: Accumulators, and Implementing BFS in Spark
  • Superhero Degrees of Separation: Review the code, and run it
  • Item-Based Collaborative Filtering in Spark, Cache and Persist
  • Running the Similar Movies Script using Spark's Cluster Manager
  • Improve the Quality of Similar Movies

Running Spark on a Cluster:

  • Using spark-submit to run Spark driver scripts
  • Packaging driver scripts with SBT
  • Introducing Amazon Elastic MapReduce
  • Creating Similar Movies from One Million Ratings on EMR
  • Partitioning
  • Best Practices for Running on a Cluster
  • Troubleshooting and Managing Dependencies

SparkSQL, DataFrames and DataSets:

  • Introduction to SparkSQL
  • Using SparkSQL
  • DataFrames and DataSets
  • DataSets instead of RDD's

Machine Learning with MLLib - Introducing MLLib - MLLib to Produce Movie Recommendations - Linear Regression with MLLib - DataFrames with MLLib

Introduction to Spark Streaming:

  • Spark Streaming Overview
  • Set up a Twitter Developer Account and Stream Tweets
  • Structured Streaming

Introduction to GraphX:

  • GraphX, Pregel, and Breadth-First-Search with Pregel.
  • Superhero Degrees of Separation using GraphX

Next Steps:

  • Learning More, and Career Tips

About Course Provider

WIISE is a 'Professional Learning Network'​ with a global outreach that helps anyone to learn anything to achieve personal and professional goals.

We bring top-rated interactive learning courses & certifications from across the world through respected Global Academic Institutes and Industry experts to our learners.

WIISE for Teams is a Smart training solution suitable for growing businesses (SMB’s) - deliver online cost-effective, on-demand training, staff engagement & Upskilling to their employees and customers. WIISE incorporates the latest micro-learning & social-learning techniques that provides fast and engaging training at a fraction of cost of traditional training methods.

WIISE is brought by respectable Learning services & Skill development company - PositiveShift Group - Silicon Valley CA USA, India (www.positiveshift.in). The company has been awarded unique Innovation partnership with National Skill Development Corporation (NSDC) and Ministry of Skill Development and Entrepreneurship, Govt of India.

Frequently asked questions

{{ item.question }}