Big Data: Spark Streaming and Scala

Location
Online
Dates
Can be taken anytime
Course Type
Professional Training Course
Accreditation
Yes (Details)
Language
English
Price
$10

Course Overview

In this course, you get to access a crash course on Scala Programming and learn how Apache Spark operates on a cluster in an easy and simplified form. By the end of this course, you can expect to run SQL queries on streamed data in real time, train on machine learning models in real time with streaming data and use them to make predictions and improvise on a regular basis.

Coupon code - WIISEGT

Who should take this course

It is available for all the learners.

Accreditation

WIISE

Course content

The outline of this course is mentioned below:

Overview:

  • Overview
  • Stream Live Tweets with Spark Streaming

A Crash Course in Scala:

  • Scala Basics: Part 1
  • Scala Basics: Part 2
  • Flow Control in Scala
  • Functions in Scala
  • Data Structures in Scala

Spark Streaming Concepts:

  • Introduction to Spark
  • The Resilient Distributed Dataset (RDD)
  • RDD's in action: simple word count application
  • Introduction to Spark Streaming
  • Revisiting the PrintTweets application
  • Windowing: Aggregating data over longer time spans
  • Fault Tolerance in Spark Streaming

Spark Streaming Examples with Twitter:

  • Saving Tweets to Disk
  • Tracking the Average Tweet Length
  • Tracking the Most Popular Hashtags

Spark Streaming Examples:

  • Tracking the Top URL's Requested
  • Alarming on Log Errors
  • Integrating Spark Streaming with Spark SQL
  • Introduction to Structured Streaming in Spark 2
  • Analyzing Apache Log files with Structured Streaming

Integrating with Other Systems:

  • Integrating with Apache Kafka
  • Integrating with Apache Flume
  • Integrating with Amazon Kinesis
  • Writing Custom Data Receivers
  • Integrating with Cassandra

Advanced Spark Streaming Examples:

  • Stateful Information in Spark Streams
  • Streaming K-Means Clustering
  • Streaming Linear Regression

Spark Streaming in Production:

  • Running with spark-submit
  • Packaging your code with SBT
  • Running on a real Hadoop cluster with EMR
  • Troubleshooting and Tuning Spark Jobs

You Made It! :

  • Learning More

About Course Provider

WIISE is a 'Professional Learning Network'​ with a global outreach that helps anyone to learn anything to achieve personal and professional goals.

We bring top-rated interactive learning courses & certifications from across the world through respected Global Academic Institutes and Industry experts to our learners.

WIISE for Teams is a Smart training solution suitable for growing businesses (SMB’s) - deliver online cost-effective, on-demand training, staff engagement & Upskilling to their employees and customers. WIISE incorporates the latest micro-learning & social-learning techniques that provides fast and engaging training at a fraction of cost of traditional training methods.

WIISE is brought by respectable Learning services & Skill development company - PositiveShift Group - Silicon Valley CA USA, India (www.positiveshift.in). The company has been awarded unique Innovation partnership with National Skill Development Corporation (NSDC) and Ministry of Skill Development and Entrepreneurship, Govt of India.

Frequently asked questions

{{ item.question }}